Ali Shiravand (@owlish___) header
Ali Shiravand (@owlish___) profile picture

Doctoral Student & Normalien in Cognitive Neuroscience @ENS_Ulm, Human Reinforcement Learning Team @HRLteam \ Interested in Decision Modeling & Photography

Paris
Joined July 2015
Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)Photo by Ali Shiravand (@owlish___)
«قاعده‌ی بنیادی این است که تا واپسین لحظه همه‌چیز نوعی تدارک است. بنابراین باید خطر کرد و در خاطر داشت که هیچ تصمیمی قطعی و حتمی نیست.»
8
18
396
دکترا رو دفاع کردم! 🪂
48
718
8,655
حس جالبی باید باشه ولی مردم دنیا ۱۴۰ میلیارد دلار روت حساب کنن.
64
1,621
این روزها شنیدن آهنگ‌هایی که تو سفرها با خانواده گوش می‌دادیم دلم رو خوب آروم می‌کنه. دلتنگیِ رام‌کننده.
1
86
1,274
«تا همدم من‌ است نفس‌های زندگی من با خیالِ مرگ دمی سر نمی‌کنم.»
3
205
1,966
Ali Shiravand retweeted
جناب دماوند از کویر مرنجاب آذر ۹۷
14
53
17
1,138
به اندازه‌ی کافی بزرگ فکر نمی‌کنی.
9
149
2,210
جامعه انگار یک آدمه با مقیاس بزرگ‌تر. جوگیر می‌شه، سرخورده و افسرده می‌شه، افراط می‌کنه و عادت‌های متفاوت می‌سازه؛ با این تفاوت که در این مقیاس انگار تک‌تک افراد تبدیل به اون کشش‌ها و روایت‌های درونی می‌شن.
1
1
84
1,340
به جای اثبات خودت به اون ٪۱ برو به یه دردی بخور برای ٪۹۰.
2
1
2
125
2,518
Our paper “Machine Psychology” is out in @ScienceAdvances. We argue that LLMs should be studied like participants in psychology experiments. Benchmarks measure performance. Behavioral experiments show how models reason and act. science.org/doi/10.1126/scia…
4
28
5
129
8,876
نداشتن و نخواستن
1
117
1,413
نمی‌دونم اطرافمون پر شده از تحلیل‌های صد من یه غاز یا ما بیش از حد باهاش این روزها مواجه می‌شیم. وقتی یه رویدادی موافق باورهات اتفاق میفته سریع شروع نکن تفت دادن. ببین دو سال پیش که یه جور دیگه پیش رفت تحلیل‌هات مفت می‌ارزید یا نه. چه تغییری تو سیستم فکریت ایجاد شده از بار پیش؟
2
3
66
1,702
این کار خیلی عجیب، زیبا و خیلی ترسناکه! *)* ما با چیزی طرف هستیم که بدون ترینینگ‌های مرسوم می‌تونه یه نتورک دیگه‌ رو بهتر کنه و ما هیچ ایده‌ای نداشته باشیم چطور و با چه ظرفیت‌های دیگه‌ای!
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math. It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training. We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵 Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math. rikiyat.github.io/blog/weight-sp… github.com/RikiyaT/lm_und… huggingface.co/Qwen/Qwen3.5-0… huggingface.co/RikiyaT/Qwen3.…
4
2
93
2,843
This is a cool paper, but I think it's best thought of as Astra is surprisingly capable of doing old school mechanistic interpretability research rather than anything spooky. The things it's doing are clever, but typically exploiting structure in the data and using known method mechanistic interpretability techniques (which Astra was surely pretrained on), though it is better at this than I would have predicted! This is an exciting development for the prospects of ambitiously scaling interpretability or doing very laborious analysis like this, on more real models. However, I'm not holding my breath. This kind of analysis was pretty common up until about 2022, it largely fell out of favor because a lot of it is just exploiting fairly clean surface-level patterns that doesn't scale to the annoying complexity of real LLMs or which only works for the more simpler and superficial properties. And as far as I can tell, basically all the case studies here are just using a bag of interpretability tricks rather than anything spooky. The piece doesn't really update me on how far old school mech interp can go, just on how good LLMs are at it. It's very fun to see the creative solutions Astra came up with though!
1
3
303
دیدین مهربونی چه معجزه‌ای می‌کنه؟
13
121
2,514
گوشه‌ی شخصی
2
193
2,051
واقعا آدم فکر نمی‌کرد «گوگل» core business خودش رو به این زودی در خطر ببینه!
2
210
13,450
Ali Shiravand retweeted
What is life like at different levels of GDP per capita? In this new chart I visualised it for 12 different dimensions.
80
627
130
2,488
262,368
حریق خزان بود و تاراجِ باد
27
238
10
5,561
92,473