Xiaolong Yang (@yang_appstats) header
Xiaolong Yang (@yang_appstats) profile picture

Learning important things deeply.

Tokyo-to, Japan
Joined April 2020
Photo by Xiaolong Yang (@yang_appstats)Photo by Xiaolong Yang (@yang_appstats)Photo by Xiaolong Yang (@yang_appstats)Photo by Xiaolong Yang (@yang_appstats)Photo by Xiaolong Yang (@yang_appstats)
true
Replying to @Zen_with_AI
Your experiences and the choices you made define who you are. Being able to choose your path is a privilege. Be proud of it, never second guess yourself.
78
Xiaolong Yang retweeted
You’d think we’d have learned from Steve Jobs and Travis Kalanick that one does not just simply replace the founder…
1,257
4,967
577
61,079
2,635,262
Xiaolong Yang retweeted
Chinese 𝕏 is 牛逼
22,464
13,723
8,582
172,754
25,758,036
Xiaolong Yang retweeted
you already knew this, but repeating @stripe is hiring engineers/product people who wanna solve Hard Problems™️ in agentic commerce, e.g.: - wallets - payments - identity - risk - discovery - tokens - tools - provisioning - catalogs - micropayments - etc. [email protected]
80
81
12
1,549
291,547
Xiaolong Yang retweeted
Working hard to make useful products & services for your fellow humans is deeply morally good
13,096
19,974
2,412
258,619
Xiaolong Yang retweeted
My 2026 job search experience as an ordinary PhD
77
143
29
1,785
273,475
Xiaolong Yang retweeted
AI in Econometric Theory: An Example Isaiah Andrews, Anna Mikusheva arxiv.org/abs/2610.35831 [𝚎𝚌𝚘𝚗.𝙴𝙼]
5
80
18
297
120,173
I'm posting a series of prediction questions from Stanford CS312 (Deep Learning Alchemy) exams to test deep learning intuition. First up: optimization. If we increase an LM's batch size 8× (same token budget), can rescaling learning rate or weight decay compensate? Try below ↓ This quiz is part of our optimizer hyperparameter assignment and unit designed by @wen_kaiyue Setup: We train an 8-layer, ~35M-parameter Transformer on 614.4M tokens using AdamW. At batch size 64, the best reference run has peak LR 0.003, weight decay (WD) 0.2, and final validation loss 2.9178. Now increase the batch size from 64 to 512, which gives 8× fewer optimizer steps. Everything else stays fixed except the changes below. Which recipe gives the lowest final validation loss? A. Keep LR and WD unchanged B. LR ×√8 C. LR ×8 D. WD ×8 E. LR ×√8 and WD ×√8 What would you predict, and why?
13
82
10
917
86,355
visited Berkeley campus back then on my phd admissions day, and the fact that I didn’t find much beauty in many architectures left a deep impression on me..
I visited Wurster Hall at UC Berkeley today. It was designed by, and currently houses, the architecture faculty. The UC Berkeley website notes that "Wurster is often voted Berkeley's ugliest building." I visited because I was curious about whether it would in person seem as unattractive as it does in photos. And, in short: it does. It's gaunt, austere, and filmed in grime. On an elysian campus, it stands out for its bleak hostility. It reminds me of the German submarine base in Bordeaux. The UC Berkeley page agrees that it was never designed to be attractive, quoting the curator of their design archives: “Wurster and his handpicked architects didn’t want anything romantic, or sentimental — they hated the idea of ‘making pretty buildings. They wanted a serious building.” I guess we have to concede success relative to their stated goals, but it does make one wonder what it all says about architecture as a discipline.
1
68
Xiaolong Yang retweeted
I visited Wurster Hall at UC Berkeley today. It was designed by, and currently houses, the architecture faculty. The UC Berkeley website notes that "Wurster is often voted Berkeley's ugliest building." I visited because I was curious about whether it would in person seem as unattractive as it does in photos. And, in short: it does. It's gaunt, austere, and filmed in grime. On an elysian campus, it stands out for its bleak hostility. It reminds me of the German submarine base in Bordeaux. The UC Berkeley page agrees that it was never designed to be attractive, quoting the curator of their design archives: “Wurster and his handpicked architects didn’t want anything romantic, or sentimental — they hated the idea of ‘making pretty buildings. They wanted a serious building.” I guess we have to concede success relative to their stated goals, but it does make one wonder what it all says about architecture as a discipline.
430
121
107
3,335
471,244
omarchy is the best os ive used for a long time.. nothing comes close
47
Xiaolong Yang retweeted
(8/8) I’m not entirely sure why I'm sharing this story. Maybe it’s to make myself seen, just like how a post back when I only had 20 followers brought me an internship. Or maybe it can encourage someone else to hit ‘post’. Still, I'm very grateful for the opportunity.
1
1
56
3,550
Xiaolong Yang retweeted
I had 5 papers accepted to NeurIPS 2026, with a total of 12 papers accepted from all DL Theory team members! aip.riken.jp/news/neurips202…
6
17
5
204
15,942
Deep learning is often taught as a sanitized collection of facts and math. But work at the frontier of AI is messy and empirical. Our new class, Deep Learning Alchemy, aims to teach the art and science of deep learning in the hands-on spirit of Language Modeling From Scratch. Students build intuition by running experiments on small LMs, then test it through prediction quizzes: given an unseen code diff, can you predict what happens? deep-learning-alchemy.github… My co-instructor @kothasuhas and I think there's significant demand for classes that treat students as serious learners who want to be assessed for what they’ve learned, and so we're trying a new exam-heavy approach to the class (7 exams, 85% of the grade, with the remaining 15% in-person discussion assessments). We’ve designed the class so students can use AI agents to run their experiments and do their assignment, but they then have to demonstrate that mastery on exams without access to the assignment, and any partial credit on the exam has to come through citations to the assignment, incentivizing them to know what’s in their write-up. The same assignments and quizzes are public for anyone to try (lecture recordings will be released through @StanfordOnline with some delay). We have some very fun assignments and quizzes covering both classic topics (like NQM, run-to-run stochasticity, and scaling laws) and new and timely topics like muP or hyperball. Made by some real experts like @TristanThrush and @wen_kaiyue Try some quizzes below!
43
313
30
2,462
180,579
Xiaolong Yang retweeted
➕➕ New research ➕➕ On the design of agents for markets and markets for agents. AI agents are increasingly entering markets, acting on behalf of people— How do we make sure they represent their people well, and that these markets are set up safely and fairly for everyone?
17
52
20
287
44,308
Xiaolong Yang retweeted
I’m excited about the AllBirds AI pivot because this is the first completely pure act of retardmaxxing in the public markets and I’m so on board with watching that journey play out.
47
97
8
2,704
165,243
Xiaolong Yang retweeted
Exploring random topics, driven by your own curiosity, is the most valuable form of learning. This is where the real outlier ideas come from. Whereas running a startup is the intellectual equivalent of being dragged by a horse.
36
43
20
975
64,419
Statistical Rethinking 2026 is done: 20 new lectures emphasizing logical & critical statistical workflow, from basics of probability to causal inference to reliable computation to sensitivity. It's all free, made just for you. Lecture list & links: github.com/rmcelreath/stat_r…
17
352
17
1,768
186,212