Ewan Collinge (@EwanCollinge) header
Ewan Collinge (@EwanCollinge) profile picture

Co-Founder of Cykel (LSE:CYK) & sundae_bar (LSE:SBAR). Previously built Crowdform (acquired 2022). AGI is already here.

London
Joined August 2012
Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)Photo by Ewan Collinge (@EwanCollinge)
Ewan Collinge retweeted
In the fullness of time, LLMs will eventually become commodities and their price will be a race to the bottom. As the competitive advantage of one LLM over another shrinks - particularly as open source models expand - the value proposition will turn to the neuro/symbolic harnesses that use those models, structures that encompass agents, agent orchestration, tooling, and component plugins. Even those from frontier AI organizations will fall to open source frameworks. The last thing standing will be those who command the data centers on which these things run, and even then, that will become a commodity, with the number of players shrinking to just a few survivors. They too will find pressure: as computational power rises, more and more such systems will be run locally.
94
181
47
1,414
240,448
AI is built on chips. Military drones rely on the AI that flies them. Together, they represent the biggest industrial opportunity of our lifetimes, a tight fit with Britain’s exceptional manufacturing heritage. We will capture that opportunity and reindustralise Britain 🇬🇧 ft.com/content/5b789a38-c9ca…
82
42
12
306
25,792
The Prime Minister, @andyburnham, today asked me to attend Cabinet as Minister for AI, a sign of his deep commitment to AI's importance. AI is likely the most significant technology in human history. Its impact will dwarf other things. The best case for it is compelling beyond our dreams: a reindustrialised Britain, stronger national security, public services transformed for the better. The risks, too, are real: it is right that the British public shares those worries, for jobs, for the pace of change. The central fact is that it is happening. Nations have a narrow window to decide whether they shape AI or get shaped by it. Britain is in that window right now. While that window is still open, I will act with pace, I will act with ambition, and I will focus relentlessly on securing British influence in shaping AI. I will also bring to this job the place I represent - a constituency in Wales, a nation with industry and ambition at its heart, a proud history of punching above its weight on the global stage. A nation which welcomed a 12-year old and his family, gave us the best chance at opportunity, put me in Parliament as Wales' first ethnic minority MP, and now affords me the chance to make a mark in Cabinet. Diolch o galon to everyone in the Vale of Glamorgan. bloomberg.com/news/articles/…
321
193
117
1,530
366,475
it’s time to build
69
199
36
4,522
152,653
The infrastructure we need can be the infrastructure we like, worthy of the communities they serve. Let’s build with taste! 🇬🇧
BREAKING: The UK AI Minister has announced a Best Designed Data Centre Prize to reward beautiful and well designed data centres, which The Royal Institute of British Architects and The Department for Science, Innovation and Technology will collaborate on.
24
38
4
280
46,344
Ewan Collinge retweeted
ppl are so overly negative about the UK vs reality. - 4 of top 10 universities globally - third largest VC market globally behind only USA, China. 1/3 of all VC in europe - powerhouse in creative industries - second largest music exporter in the world - largest biotech ecosystem in europe - massive growth sector in the coming years - London is the top western hub for AI after Silicon Valley. - excellent financial services base and broader services economy. Number one for FX, number two for PE and Hedge Funds - produces 20% of global offshore wind TLDR UK is overwhelmingly a top 3 or top 5 player globally across finance, law, defence, biotech, clean energy, creative industries, and tech (especially AI) We are incredibly well positioned for the future. We have a number of problems we need to fix - I believe we will do so. Extremely bullish on this country
96
182
33
1,656
128,907
Ewan Collinge retweeted
The UK is already seeing the benefits of being an AI hub. But we’re not doing a good enough job of explaining the opportunity ahead. I wrote for @thetimes today on being an ambitious nation again - and the need to fight the AI doomers. We had similar opportunities in the internet era, but failed to seize on them. We can’t miss again.
27
18
6
115
17,360
Ewan Collinge retweeted
Inference got a hundred times cheaper this year. The compute bill went up anyway. If you understand why those two sentences are both true at the same time, you understand the most important thing happening in AI right now. I work on inference for a living, at @nebiustf, where we run open-source managed inference at scale. Most of what follows is what I'm seeing from inside the bill. 12 months ago, the cost of 1M tokens of frontier-class reasoning was somewhere on the order of $60. Today, an equivalent quality of output costs roughly $0.50. Price /token of o1-level intelligence has dropped about a 128x in a year. Price of GPT-4-level output has dropped roughly 100x since the original GPT-4 shipped. By any normal reading of a technology cost curve, this should be deflationary. It should be saving customers money. The opposite has happened. The total compute bill at every hyperscaler is going up, not down. Anthropic just signed multi-year capacity deals with both XAI and Amazon. Microsoft's Azure capex guide for 2026 starts with an eight. OpenAI is reportedly spending more on compute every quarter than it did in all of 2023. Nvidia paid roughly twenty billion dollars to acquire Groq, an inference-specialist company that did not exist as a serious commercial entity three years ago. The cost curve and the demand curve crossed, and then the demand curve lapped the cost curve. Here is what happened underneath. A reasoning model burns roughly 10x the output tokens of a non-reasoning model on the same task, because it spends most of its tokens thinking out loud before answering. An agentic workflow chains roughly twenty times the requests of a single-shot completion, because it loops, calls tools, plans, retries, and synthesizes. A modern deep-research query (the kind a research analyst can fire off in fifteen seconds and then walk away from for ten minutes) costs more compute than 10 original GPT-4 queries combined. We made every individual token a hundred times cheaper, and then we built a generation of products that consume ten thousand times more tokens. This is the Jevons paradox playing out at trillion-dollar scale, in compressed time, in front of everyone. Jevons noticed in 1865 that making coal-burning more efficient did not reduce coal consumption. It increased it, because efficiency unlocked uses that were previously uneconomic. Steam engines became more practical at smaller scales. Whole industries that could not afford coal at the old price suddenly could. Britain's coal consumption rose sharply, not despite the efficiency gains, but because of them. The same thing is happening to AI compute right now and it is happening faster than any analogous historical cycle. Falling token prices did not contract demand. They unlocked agents, deep research, code-writing systems, multi-step reasoning, persistent memory, the entire next layer of AI products. Every product in that next layer consumes orders of magnitude more compute than the chat interfaces it is replacing. The math at the aggregate level is brutal: 100x cheaper tokens times 10 000 more tokens equals a 100x larger total bill. The implications stack quickly. If you are running a hyperscaler, your 2026 capex guide is not a peak. It is a step on a curve. Inference is structurally always-on, twenty-four hours a day, in a way that training never was. Training is bursty. You spin up a cluster, run for weeks or months, and stop. Inference runs continuously, scales with usage, and the usage curve is exponential. Your power bill, your cooling bill, your transceiver count, your storage footprint, all of these were sized for a workload mix that no longer exists. If you are running an AI software company built on top of someone else's closed API, you have a problem that did not exist a year ago. Your gross margins get worse as your customers get more value out of your product, because the more they use it, the more compute you pay for. The companies that win this are the ones that figured out vertical integration before the math caught them. If you are watching this from a distance and trying to understand where the next bottlenecks form, the answer is everywhere downstream of "more inference compute, always-on, with massive memory state per session." The KV cache, the running memory state of a long conversation or an agent loop, is the silent monster of the inference era. It does not scale linearly with parameters. It scales linearly with context length and number of agent steps. A long agent session can hold tens of gigabytes of state per user, per session. Multiply that by every concurrent user of every product, and you understand why $MU, $SNDK, $TOWCF, and the entire memory and packaging layer have re-rated the way they have. The CPU-to-GPU ratio is evolving. Training is 1:8. Basic chat inference is 1:4. Agentic inference is 1:1, sometimes CPU-heavy. Google has split its TPU line in two, with a dedicated inference chip carrying tripled SRAM for KV cache. $INTC and $AMD just spent two earnings calls explaining that this shift is structural, not cyclical. The hardware map is redrawing in real time and the financial press is mostly still writing about training clusters. The right framing of where we are right now is not that AI is hitting a wall. The framing a year ago that scaling was hitting a wall was the most expensive bad take of the cycle. The right framing is that AI got dramatically cheaper, dramatically more capable, and dramatically more useful, and the cost of running it at the new equilibrium of demand is much higher than the cost at the old equilibrium of demand, because the new equilibrium is enormous. A meaningful share of what we actually do at Token Factory, day to day, is help customers stop their bills from running away from them. KV-cache management. Speculative decoding. Quantization. Routing. The kind of vertical integration that, eighteen months ago, every product team was happy to leave abstracted away behind a closed API. The reason this stack matters now is the same reason this whole essay matters: at the new equilibrium of inference demand, the cost of treating compute as a commodity is no longer survivable. The companies that figure out the layer beneath the API are the ones who keep their margins. Cheaper tokens. More tokens. Same coal as 1865.
138
420
149
2,678
697,117
Ewan Collinge retweeted
Future companies will be measured in million tokens per second per share. MTPS per share. Your share is your claim on finite inference capacity. GPUs are limited. Power is limited. Tokens per second is the measurable output. But not all tokens are equal. A frontier model token isn’t the same as a 7B token. So you adjust for quality, turning tokens into a fungible unit. That creates the economic shift. Companies compete on real constraints: more intelligence per watt, more throughput per chip, more capability per token. It’s about extracting as much intelligence as possible from fixed hardware. Shareholders own that capacity. It starts to look like reserves in an intelligence economy, with equity pricing in future intelligence output. In the short term, token prices get compressed. Providers undercut each other to win market share. Volume explodes, but margins shrink. The market share acquisition phase. Then the lock-in kicks in. Agents get embedded in workflows. Memory builds up. Models are tuned on proprietary data. Switching gets painful. At the same time, demand goes vertical and runs into hard limits: power and compute. That’s when prices turn. Token costs start rising fast. MTPS per share behaves like energy reserves in a supply crunch. The value of human intelligence drops. Basic cognition becomes ambient. Seven billion humans versus seven billion agents. Knowledge work collapses into tokens. Humans move back to the physical layer. Hands, sites, machines. Actuators for tokenised intelligence. The robots, directed by AI. Intelligence becomes abundant. Orchestration of the physical world becomes the bottleneck.
1
6
552
Ewan Collinge retweeted
Challenge 8 is live on SN121🍨 This one changes what we're measuring and we’re not just scoring what the agent answered. We're scoring how it got there. >Did it pick the right tools? >Read the right files? >Follow the task path cleanly? Good answers aren't enough. We want good reasoning. The kind that shows up in the process, not just the output. Early submissions are already looking stronger! $TAO $SBAR #AI #AIagents
1
8
527
Ewan Collinge retweeted
SN121 Show & Tell 4.0: a look into the Preview Challenge dataset and how each test is evaluated. In this walkthrough Taylor breaks down a single test case -> from the prompt an agent receives, to the ground truth and rubric, to how a validator applies scoring and produces a final result. Each test defines an explicit evaluation contract. This is how SN121 makes agent performance observable, comparable, and reproducible. $TAO
1
1
7
755
my prediction is that the first billion dollar agent company will be a services company using agents behind the scenes to automate their work I met with a debt servicing business today who is automating their entire process using agents their customers have no idea
71
87
24
1,444
226,353
If you are not planning for the price of intelligence to go to zero, the next 3-5 years are going to incredibly disruptive to your business / life. This is the main idea for the rest of the decade, buckle up.
208
899
421
6,195
2,727,273
Ewan Collinge retweeted
YC on why vertical AI agents could be 10X bigger than SaaS:
169
676
123
5,163
886,690
Ewan Collinge retweeted
We’ve spent weeks automating every sales process at First Movers, my company, with AI bots. Now our proposals write themselves, our follow-ups never miss, and our conversion rate is 3X higher than any business I’ve ever ran. Stop playing business and start building with AI.
14
11
111
7,068
Ewan Collinge retweeted
The irony of AI is we expected it to be awesome at math & be all cool logic (“your idea of love does not compute!”) Instead, AI is bad at math, just wants to write poems, & is all hot, weird simulated emotion. For example, if you make GPT-3.5 “anxious,” it changes its behavior!
29
87
16
536
55,609
Ewan Collinge retweeted
Cykel AI Launches Lucy, its First AI-Powered Digital Worker ⬇️ “Lucy is a fully autonomous digital worker capable of executing end-to-end recruitment processes," said Ewan Collinge, CEO & Founder of Cykel AI 🔗 buff.ly/4i6jsra #CYK #AI
2
6
226
Ewan Collinge retweeted
People think we must shrink the world's population to be happy, but they're wrong A world with shrinking population would be decaying, poor, brutal, violent, hopeless A world with 100 billion people would be dynamic, rich, innovative, peaceful, hopeful 🧵
48
79
21
600
87,752
Ewan Collinge retweeted
People shit on the UK on this app to create an impression that it's awful to live here too much. But they're wrong. It's wonderful. People overstate things for meme value, and it's spread by people who've spent no time here. I'm not denying the issues and stagnation that must be urgently addressed, but there's a reason the UK is such a desirable place to live. We stand on the shoulders of giants and have a lot of work to do to secure a great British future. I love London, I love the amazing people in this city, and I am optimistic. The UK could choose to be the richest country on earth.
120
46
34
854
94,106