Michael Cole (@_michaelcole) header
Michael Cole (@_michaelcole) profile picture

Freshman @ Carnegie Mellon. Prev @iondotdesign and @whop; am in SF or Pittsburgh usually, dms r open!

constant state of confusion
Joined October 2021
Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)Photo by Michael Cole (@_michaelcole)
uh oh
I have a major result to share. I’ve found conclusive forensic evidence that the top 4 Chinese AI labs—DeepSeek, Moonshot, MiniMax and Ant Group—have built their newest models on NVIDIA’s most advanced Blackwell chips, which are barred from export to China. This sounds insane, but I discovered that almost every AI model carries a hidden signature of the GPU that trained it. When a model is first set up, the starting values of its weights are laid out in a pattern that depends on the exact GPU. Each combination of GPU and seed number produces a unique pattern—a sort of fingerprint of the hardware used to create the model. Traces of that pattern survive training into the published model. Again, this evidence isn’t based on any insider information or leaking. It’s based on a forensic analysis of the model weights released by the companies themselves. I searched more than six trillion combinations of chip layout and seed number and matched them to open-weights models. In doing so, I found conclusive evidence that six Chinese AI models—including DeepSeek-V4-Pro, Kimi K3, and MiniMax-M3—were initialized on NVIDIA Blackwell systems. Four of the models match Grace Blackwell, the GB200 and GB300 parts in NVIDIA’s flagship liquid-cooled rack-scale systems. I then verified these results on real hardware. Running unmodified PyTorch with the seeds I’d recovered, a Blackwell B300 reproduced DeepSeek-V4-Flash’s untouched starting weights bit for bit, and a rented GB200 reproduced Kimi K3’s to a correlation of 0.999995. A Hopper H100 reproduced none of DeepSeek-V4-Flash’s, and changing the seed by one broke the match. (DeepSeek’s seed is 953049583 by the way.) The method also was verified to match 24 known open-weights models to the hardware that developers said they used. It is exceedingly unlikely that these results are a coincidence. Across six trillion combinations, the best accidental match should reach only about 8 sigma (i.e., eight standard deviations above what random chance would produce). The real matches range from 49 to 1,385 sigma, and even the weakest single test hits 20. These were data-center-scale training runs. With some analysis of release schedules and model details, I estimate that the largest, Kimi K3 and DeepSeek-V4-Pro, used 2,000 to 3,000 Blackwell GPUs each. Clusters of this size cost on the order of $150 to $200 million each to buy, and across these labs alone would add up to more than half a billion dollars of export-controlled GPUs, not counting experimental compute or otherwise. It’s quite likely that we see multi-billion dollar expenditure on export-controlled GPUs. I am highly confident in this result, and it has been independently verified by senior researchers at OpenAI and Anthropic. You can read the full report at unemploymentlabs.com/checkpo…. There is much more I’ve identified about these models through other forms of checkpoint forensics like this, and will have more to share soon.
1
3
148
serious question: why isn't linkedin open source? the technical aspects of the product are mostly not their moat (they could keep sales nav features and others like it private) and they have 6k engineers burning billions a year.
1
157
following the logic of the recent instinct valuation ($30b dollars) this one feature indicates at least an additional $100b to openai's valuation
By popular request, you can now text your dot. Give it a task to take off your plate or something to keep an eye on, using text, photos, or even voice notes. It will text you proactively with relevant updates. Safe, secure texting via iMessage or RCS. You’re the only one who can text your dot, and your dot can only text you. Rolling out now as a preview for Pro users in the US.
7
506
Michael Cole retweeted
This just in: Hynix down 6% on the back of META announcing that it’s willing to bankrupt itself to buy more DRAM.
14
28
3
803
35,973
i take it all back he has quickly become a generational poster
1
4
148
Whop has raised $200M in Series D funding at a $5.1B valuation, backed by @sequoia and @shopify. It really feels like we are barely touching the tip of the iceberg in a market larger than anyone can imagine. We first launched Whop as a better way for us to sell sneaker bots, one of the most niche types of desktop software out there. Total TAM? Probably $20,000 per day. Who cares, tiny market. But, what people discounted is the idea that there were actually 70,000 other markets exactly like that one. Beyond the investment itself, I am especially excited to welcome legendary silicon valley investor @dougleone to our board of directors. Doug and the sequoia team are nothing but a brilliant, resourceful, and principled group of people. My co-founder Cameron and I started building on Shopify when we were 13 years old. Shopify is one of the most impactful all-in-one cloud ecosystems ever created; @tobi has pioneered modern entrepreneurship the way we know it and we are thrilled to have him in our corner. We have a tenet at Whop to be the dumbest in the room and I am very grateful that this has recently become a lot easier. We are focused on markets, scale economies, and progressive media. If that is up your alley, please message me directly. The $200M raised will support our expansion as we build economic infrastructure for the next century, continuing on our mission of delivering everyone an income.
693
466
243
4,712
1,599,865
Michael Cole retweeted
the lunch offerings at the citrini offices must be insane to get this kind of employee loyalty
What is AI really capable of in bio? To separate hype from reality, we spent 3 months working firsthand with @AnthropicAI's internal research model to see if it could create an experimental scorpion antivenom. Introducing Citrini Therapeutics. citriniresearch.com/p/citrin…
53
104
38
4,882
343,273
just use the connector bro bro you just need to log in to add the app yes you need to individually connect every google app on each account you have just install the extension bro yup now copy paste the mcp url from the software bro can we fix this?
1
152
you ever fuck with a song so much you restart it before it even finishes
106
I was 5 years ago today I made my (at the time) twitter account. this app genuinely changed the course of my life by exposing me to opportunities/a whole world I never would have known about. praise the algorithm!
1
11
312
I mean it’s gotta be the greatest game oat
GTA VI’s entire original score was composed by French electronic duo Justice 🚨
1
127
Michael Cole retweeted
surprisingly common mentality In SF seen way too many people scared of competing because a startup was "kingmade" by VCs luckily, as an american, i don't believe in kings
33
4
9
317
53,360
Michael Cole retweeted
This is Dynamite. It takes any website & dynamically personalizes it for every visitor, so they see what is most likely to convert. Within 300ms. It installs on ANY site with one line of javascript.
85
43
20
774
83,616
Michael Cole retweeted
Look at him, thats my Qual. Your what? My Qualitative! My vibe specialist. Look at him, you notice anything different about him? Look at his face. I'll give you a hint, his name is Jayden. He won a local poetry competition in bushwick! Yeah I'm sure of the vibe.
Quant firms are hiring idea guys, not quants I've been skeptical about the whole - software is commoditized, ideas are the moat argument But I've seen first hand the best quant and technical firms in the world hire thinkers, liberal arts grads, and generalists I predict the trend accelerates Letter from @AQRCapital below
141
1,653
153
23,725
1,403,914
pretty sure it could build its way to replacing an accountant though.
AGI doesn't mean "really smart AI". It means "artificial *general* intelligence". A model that is wildly superhuman in mathematics but still can't replace an accountant isn't AGI (yet)
1
1
236
may or may not be testing this this winter 👀
49
Michael Cole retweeted
How cool is it that you can just talk to government officials online about issues you’re having
3
49
2,204
this is gonna go so hard on a smart fridge
It’s all about family assistants. labs.google.com/cc
8
240
Bullish on this
It’s all about family assistants. labs.google.com/cc
2
241