Chen Lu retweeted
LTM-2-Mini is our first model with a 100 million token context window. That’s 10 million lines of code, or 750 novels.
Full blog: magic.dev/blog/100m-token-co…
Evals, efficiency, and more ↓
I wrote a UNet diffusion model in pure CUDA: github.com/clu0/unet.cu
This project was inspired by @karpathy 's llm.c (github.com/karpathy/llm.c). I also learnt a lot about CUDA kernels from @Si_Boehm 's Matmul blog (siboehm.com/articles/22/CUDA…).
(1/3)
Most of the effort so far was spent getting the whole model to work. There is still a lot of room for optimization. Current per iteration timings on a single RTX 4090:
- this repo: 143ms
- PyTorch: 66ms
- PyTorch with torch.compile: 59ms
(2/3)




