euclaise ๐ŸŒ  (@euclaise_) header
euclaise ๐ŸŒ  (@euclaise_) profile picture
San Diego
Joined July 2025
euclaise ๐ŸŒ  retweeted
is the Anthropic IPO chart a better LR schedule than warmup cosine decay? let's find out! @mridul__agarwal @ananthsiyer and i are running 4 identical pretraining runs, with the LR driven live by ANT, SPCX, SPY, and NVDA. watch the models train at stockasticdescent.live
40
76
16
1,000
57,493