anand iyer (@ai) profile picture

Founder Canonical · We back, build, incubate early-stage companies · Venture Partner Lightspeed · Few-shotting open source AI

San Francisco, CA
Joined February 2008
Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)Photo by anand iyer (@ai)
anand iyer retweeted
Running Inkling 2 Mini at 125 tok/sec on my M5 Max MacBook Pro American open weight model, looped transformer, competitive with Qwen 27B. Probably the best model at this size.
We worked with @thinkymachines to make Inkling 2 Mini run fast locally: - 210 tok/sec decode, 3620 tok/sec prefill on 96GB M5 Ultra Mac Studio - 125 tok/sec decode, 1750 tok/sec prefill on 48GB M5 Max MacBook Pro It built a native weather app 1.8x faster than Claude Sonnet 5.5 on an M5 Ultra Mac Studio and 11x cheaper (API pricing). The looping architecture is ideal for local devices like MacBooks, which are memory constrained. Looping layers of the model increases inference-time compute (and intelligence) without increasing the size of the model.
81
99
16
1,619
83,329
A few nights a week I sit next to my daughter while she does her homework, and I do mine (lately that's linear algebra again and training MNIST models from @zicokolter's modern-AI course) She sees that I never stop learning. And I know it's rubbing off on her. The highest-leverage parenting move is refusing to stop being a student. @nikesharora is totally right: kids don't copy what you say. They copy what you do.
.@nikesharora on parenting: “I think you’re blessed if you can find a way that your kids want to achieve, they want to build, they want to make things happen on their own.” “The hardest part of parenting is to make sure that your kids have drive, your kids have ambition, your kids want to achieve.” “I let them follow their own passion… If my kids can have passion, they can go chase their passion. They can show ambition and drive. I don't care [what they do] as long as they wake up every morning, and are happy and felt that they gave it their best.” “Your kids will watch your behavior. They watch more behavior than you think. They know more about how we are, who we are, than we possibly can ever understand.”
2
38
3,972
has ai progress stalled? i'm personally not aware of any major breakthroughs since riemann a few hours ago
413
1,529
130
29,071
697,178
Not justifying the behavior, but if this sounds unprecedented or novel to you, trust me, it’s not. If you lived through the early 2000s tech era, you know extreme outbursts and tirades have been a staple.
BREAKING: Jensen Huang reportedly threatened to forcibly remove an Nvidia employee’s skullcap, exposing their brain, and then urinate on it. — NYT
4
1
14
2,063
A major milestone for @AnthropicAI. The Anthropic team understood something very deep about AI early on. That trust would be critical for AI to be built and to be used broadly in our economy. That conviction shows up in what they build. Claude and Claude Code are part of how we work at Lightspeed every day, and they get sharper with every release. With AI making its mark on chemistry, robotics and healthcare, we’re only beginning to scratch the surface of possibilities. Huge congratulations to @DarioAmodei, @DanielaAmodei, @NotTomBrown, @jackclarkSF, Jared, @Sam_McCandlish, @ch402, Krishna and everyone at Anthropic on the IPO. It has been both a privilege and an honor to be part of the journey. Cc: @lightspeedvp, @ravi_lsvp, Sebastian Duesterhoeft
Today, @AnthropicAI goes public. Lightspeed was founded 26 years ago to be early believers in what’s next. Across technology cycles, from the internet to mobile, cloud, and now AI, that has remained constant. From the very beginning, @DarioAmodei, @DanielaAmodei, and the team saw a future where progress and safety had to go hand in hand. They understood both the extraordinary potential of AI and the immense responsibility that would come with advancing it. It's rare to witness a company reshape an industry so deeply, so quickly. Rarer still to see it done by people who have stayed so close to the principles that brought them together. Congratulations to co-founders @DarioAmodei, @DanielaAmodei, @NotTomBrown, @jackclarkSF, Jared Kaplan, @Sam_McCandlish, @ch402, and the entire Anthropic team! What a journey, and what an exciting future still ahead. CC: @ravi_lsvp, @guruchahal, Sebastian Duesterhoeft
8
8
39
1,892
anand iyer retweeted
Today the world’s eyes are on @AnthropicAI as they go public. While their success might seem like an inevitability now, it’s easy to forget the unprecedented levels of courage that it took to get here. When @DarioAmodei, @DanielaAmodei, @NotTomBrown, @jackclarkSF, Jared Kaplan, @Sam_McCandlish and @ch402, set out to build Anthropic, few outside the AI ecosystem believed that their vision was possible. It was a time where AI coding agents and AI driven task competition seemed like something from the pages of science fiction and not the mission of a global company. Fast forward to 2026 and Anthropic is very much on track to help lead us into the next era of intelligence. We are at a moment in our history where we are likely to see transformative gains from science and innovation, to work and productivity. This is being driven not only by exceptional engineers and researchers at Anthropic but it’s also the product of the outstanding leadership team. All of the seven co-founders remain at the company, a testament to the culture of curiosity and integrity that they have built. The founding team’s bond rests on a shared belief that safe and trustworthy AI is possible, and that conviction has been strengthened by challenges few founders have faced before. For the past five years they have worked at the frontier of intelligence and at the frontier of what it means to build a global business at the dawn of a new era. Their persistence has not only helped the company go from strength to strength but it has also been the driving force behind building a wider team that include brilliant minds such as Krishna Rao, @realpaulsmith, @mikeyk and Rahul Patil. For Anthropic this is only the beginning and all of us who share in their mission are ready to support them and be part of their journey to take humanity to places it has never been before. Congratulations to the whole Anthropic team.
17
29
5
127
10,312
Anyone who still believes the stereotype that men hate talking on the phone has clearly never been in an Uber with an immigrant driver.
2
24
2,908
Interesting cultural divide at events like @SlushHQ: outside the US, WhatsApp is the default for networking. For me, it’s strictly for friends & family. How do we bridge this gap?
5
1
12
3,443
Replying to @ai
I think great idea to actually put skid in the game Cyber insurance is really not pricing in many of these properly, especially at enterprise scale There needs to be a mechanism to be able to fix this properly.
1
3
523
Nothing prepares you for the emotional whiplash of parenting a teenager. This was taken 1 year ago. Today she won’t be caught dead within 10 ft of me in public. brutal rite of passage: realizing that doing your job as a parent means watching them pull away.
45
7
1
588
65,103
Prediction markets for which service or infra provider goes down next. And then lets watch uptime hit 5 9s.
3
3
18
3,405
Just your average Finnish day 0 @SlushHQ where warm intros happen in hot saunas.
4
33
3,765
anand iyer retweeted
2.67m+ private inferences served so far. OpenGradient has now processed 51.5 billion+ tokens. The last five days added 280k+ requests and 8.2b+ tokens, or 1.6b+ a day. Every prompt is encrypted on your device and answered inside a hardware enclave that shuts us out too.
12
10
42
3,795
Excited to be back in Helsinki after 16 years for @SlushHQ! Dm if you are here and want to jam.
9
34
3,915
Let’s all blame that one dude who didn’t put his phone in airplane mode.
There has been a temporary telecommunications outage - out of an abundance of caution all flights have been halted. Every flight has been accounted for and international flights will be handled on a case by case basis.
4
2
22
4,494
1/ Most look at data center moratoria and see a power bottleneck. The real story is a structural split in how AI infrastructure gets built. 2/ Voters passed 40 of 41 local data center restrictions this month, many drawing the line at 20-25MW. @antavedissian modeled the fallout: our base case has 41% of 2031 inference running under 20MW across devices, metro pods, solar farms, and old telecom buildings. 3/ Small sites lose on raw hardware cost, so the whole model runs on routing. Utilization has to stay high so GPUs don't sit idle. Scheduling has to respect model state and latency. Verification has to prove the work ran untouched. 4/ Most likely casualty: assumption that AI compute ends up looking like the power grid, owned by a handful of mega-campuses. 5/ Instead of looking like the power grid, inference starts looking like the internet: 10K fragmented boxes acting like a cloud that don't require permits.
I think total AI inference grows ~1,000x in the next five years. But the power to run it only grows ~10x. So where does all that AI actually run? I modeled it. 🧵
6
15
3,215
Something about November, post mid-terms
5
2,384
I've gone down some weird algorithmic rabbithole and now my feed is mostly Jensen & Alice deepfakes in Bollywood songs. I can't look away and I need to it stop.
9
7
8
59
5,585