Just donated with a generous match from @dwarkeshpodcast , @seemaychou and others. farmkind.giving/dwarkesh
1
9
347
I have no idea why Google continues to publish so much stuff that seems like it could help competitors, but I enjoyed reading this guide to scaling LLM training and inference.
jax-ml.github.io/scaling-boo…
1
151
Just finished Triton Puzzles. Honestly not sure how I feel about Triton. It's more abstract than CUDA but less abstract than Torch or JAX, and likely has perf to match its abstraction level.
102
My most significant open source contribution to date. Earl: a framework for scalable reinforcement learning research
Lets you do RL the way DeepMind does :-) Blog post about it:
garymm.org/blog/2025/03/03/e…
120
Nvidia Nsight Systems (performance profiler) takes like 3 minutes to start up on an M2 Pro. Oh the irony.
77
This surprised me:
(computer science) seniors in the United States substantially outperform seniors in China, India, and Russia by 0.76–0.88 SDs and score comparably with seniors in elite institutions in these countries.
pnas.org/doi/10.1073/pnas.18…
51
Gary Mindlin Miguel 🔸 retweeted
anyway I guess as long as whatever thing you're doing has the property that it can withstand a factual error rate of ≥85%, this thing is safe to use
Summary of my C++23 implementation of Deflate decompression (core of Gzip, Zip, PNG)
garymm.org/blog/2025/01/31/s…
45
Blog post on assembling infrastructure for ML research from mostly off the shelf components. garymm.org/blog/2025/01/27/a…
39
I just donated to Nuclear Threat Initiative. They focus on reducing risks from nuclear weapons and bio weapons. nti.org/
35
Grigori Perelman declined the fields medal and a million dollar Millennium Prize.
en.wikipedia.org/wiki/Grigor…
44
California coastal commission blocking SpaceX launches because they don't like Elon's political opinions. This encapsulates so much about California.
latimes.com/california/story…
48
Chongqing residents: how long it takes to walk from the doorstep of your condo to the entrance and exit of your xiaoqu/neighborhood and get yourself stand on the street
tumblr.com/fuckyeahchinesefa…
1
35
Gary Mindlin Miguel 🔸 retweeted
Many people have been saying things like this, but this is quite false.
500m in damage isn't the end of the world -- it's a Tuesday in the global economy.
Let me give examples.
Replying to @janleike
If your model causes mass casualties or >$500 million in damages, something has clearly gone very wrong. Such a scenario is not a normal part of innovation.
I just made the docs for Equinox (a cool JAX library for neural networks) available for offline consumption in Dash / Kapeli. I find it super useful to have a keybinding that searches for the current symbol in the official docs.
github.com/Kapeli/Dash-User-…
51
nothing that occasions no trouble when present has any right to pain us in anticipation. Therefore death, the most frightening of evils, is nothing to us, for the excellent reason that while we live it is not here and when it is here we are not living.
pressbooks.pub/phronesis/cha…
32
JAX and Equinox: What are they and why should I bother?
I wrote a blog post / Jupyter notebook for my coworkers, sharing with you all :-)
garymm.org/blog/2024/09/08/j…
47




