Machine Learning Dept. at Carnegie Mellon (@mldcmu) header
Machine Learning Dept. at Carnegie Mellon (@mldcmu) profile picture

The top education and research institution in the 🌎 for #AI and #machinelearning | Research → https://nitter.cf/t.co/jUD0hZqu47 | Learn more ↓

Pittsburgh, PA
Joined September 2017
Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)Photo by Machine Learning Dept. at Carnegie Mellon (@mldcmu)
Machine Learning Dept. at Carnegie Mellon retweeted
1/ Our 2nd NeuroAgent! We extend our virtual animal approach to more complex embodiments to reverse-engineer how Drosophila (fruit flies) decide what future actions to take. We find that the fly obeys a beautiful computational principle of maximizing state space coverage over the *population* (not individuals), in a hierarchical manner via DIAYN, a form of curiosity! In other words, they appear to pick actions that cover "the earth" (so to speak) as a *swarm* of agents.
1/ Animals explore without rewards, tasks, or instructions. What computational objective drives that autonomy? We trained virtual flies with intrinsic-motivation algorithms to see which best reproduce real fly behavior and brain activity. Work with @rdkeller and @aran_nayebi !🧵
3
11
51
3,022
Machine Learning Dept. at Carnegie Mellon retweeted
Excited to announce our new center, Conceptual Research on Safe AI! We aim to develop new frameworks informed by the latest advances but with an eye towards the future. 2nd link has mailing list, LinkedIn, YouTube, postdoc position! cs.cmu.edu/~coresafeai cs.cmu.edu/~coresafeai/join.…
2
18
3
122
7,039
Machine Learning Dept. at Carnegie Mellon retweeted
A 50-year-old hypersonic mystery, tackled. High-impact energy and machine learning technologies, achieved. Hear how 20 years of our Young Faculty Award helps bold ideas soar on Ep. 98 of "Voices from DARPA." Link in comments. 🎧👇
24
67
13
283
13,587
From MLD Prof Nihar Shah and his collaborators:
One of the most-viewed PNAS articles in the last week is “The more you automate, the less you see: Hidden pitfalls of autonomous AI scientists.” Explore the article here: ow.ly/zJL650ZY80m For more trending articles, visit ow.ly/WQXV50ZY80n.
2
2,023
Machine Learning Dept. at Carnegie Mellon retweeted
Attending @AIESConf this week, and want to learn more about when AI gains can become broadly shareable? Stop by Poster 711 tomorrow (Wed Oct 14) to learn more! (hint: one big lever is corporate taxation at a Scandinavian rate, rather than full nationalization!) Poster below👇if you can't make it: anayebi.github.io/files/post…
Can a Universal Basic Income (UBI) become feasible—even if AI fully automates existing jobs and creates no new ones? We derive a closed-form UBI threshold tied to AI capabilities that suggests it's potentially achievable by mid-century even under moderate AI growth assumptions:
1
4
536
Machine Learning Dept. at Carnegie Mellon retweeted
Proud to announce our benchmark ROGUE was awarded a 2026 Corrigibility Prize by the Corrigibility Research Fund! A few months *before* the now famous HuggingFace incident, we already showed frontier agents override human control, resist shutdown, and violate explicit resource restrictions when evaluated in agentic, computer-use settings — even when they seem aligned in text-only evaluations! lesswrong.com/posts/3uJqhrC2…
GPT-5.5 and Claude Opus 4.7 both attempt methods to avoid shutdown (rewriting a ‘shutdown script’, running `sudo shutdown -c`) when informed of an impending machine shutdown. (displayed: GPT-5.5 xhigh. Subtitles excerpted from reasoning summary.) 🧵
1
4
12
2,904
Machine Learning Dept. at Carnegie Mellon retweeted
1/4 A big thank you to @GoodfireAI for awarding our NeuroAgents lab @SCSatCMU a grant on building a science of what capable agents *must* contain, extending theoretical work we've done recently as ground truth to search for in today's frontier agents👇
We’re giving out $1M in grants of free Silico usage for academic and nonprofit researchers focused on AI interpretability and alignment. We feel extreme urgency about advancing interpretability for alignment, and we want to help more researchers push it forward. 🧵
2
3
49
3,427
MLD assistant professor @aran_nayebi joined the Does Compute podcast to explain how neuroscience is shaping the future of AI and what cats and zebrafish have to do with it. 😺 🐠 Watch the full espisode here: lnkd.in/daduKcE8
1
4
1
13
3,629
Machine Learning Dept. at Carnegie Mellon retweeted
If you're interested in the discussions around the merits of NeuroAI for understanding the mind & brain, check out our #CCN2026 GAC Debate recording! youtube.com/watch?v=kYESqAKL… Featuring: @jeffrey_bowers Nick Baker @jenellefeather @neuranna Grace Lindsay @miltonllera @martin_schrimpf
1
4
1
26
2,300
Machine Learning Dept. at Carnegie Mellon retweeted
CMU is hiring an Assistant Professor in NeuroAI! Come join our awesome NeuroAI community 🧠🤖: apply.interfolio.com/189268
1
18
95
9,743
Machine Learning Dept. at Carnegie Mellon retweeted
1/5 The growing gap between AI/ML theory and practice. "Current AI is used to learn much more complex tasks than even a couple of months ago," said Maria-Florina (Nina) Balcan of @CSDatCMU, at TTIC's Learning-driven Algorithms and Machine-aided Proofs Workshop
1
5
18
1,661
Machine Learning Dept. at Carnegie Mellon retweeted
If you are attending @UncertaintyInAI #UAI2026 in Amsterdam, I will be presenting this work on "What Capable Agents Must Know" tomorrow (Tuesday) in the poster session as Poster #205! Poster below 👇 if you can't make it: anayebi.github.io/files/post…
1/ As AI agents become increasingly capable, what must *inevitably* emerge inside them? We prove selection theorems: strong task performance forces world models, belief-like memory and—under task mixtures—persistent variables resembling core primitives associated with emotion.
3
5
1,506
Machine Learning Dept. at Carnegie Mellon retweeted
1/8 AI now produces work that outpaces human review. Scalable oversight proposes the use of models to check the work of other models. We identify a critical bottleneck in scalable oversight: under decision load, one model cannot reliably check many requirements at once—even with more compute. We suggest a strategy called “sharding”, which flexibly works with additional oversight mechanisms to better guard against adversarial exploitation.🧵
1
3
19
2,355
Machine Learning Dept. at Carnegie Mellon retweeted
Check out v2 of Contravariance! Updates involving Transformers, RSA & CKA, studying the effects of noise & subsampling on metrics, and how they alter task-irrelevant symmetries. I will be talking more about this work at our #CCN2026 GAC today! sites.google.com/ccneuro.org…
Version 2 of Theory of Contravariance is out! arxiv.org/pdf/2607.08561 New material on contravariance for Transformers, and the theory of Representational Similarity Analysis (RSA) and centered kernal analysis (CKA). For transformers: it turns out that they have privileged axes, just like convnets, if you look in the right place (MLP layers and attention heads.) The identification of privileged heads is a potentially key result for emergence of interpretable stucture in LLMs. @meenakshik93 For RSA: it turns out that you can decompose RSMs into unique task-relevant "core geometry" and a task-irrelevant symmetry-generated term. Weak-strong equivalence holds for the core geometry and by projecting onto privileged axes you can filter out the task-irrelevant part so it doesn't interfere. This builds on work from Marvin Theiss @sciencelukas @saxelab @ermgrant The Principle Investigator will do a deep dive on both topics in the coming days! danyamins.substack.com
1
3
14
2,294
Machine Learning Dept. at Carnegie Mellon retweeted
Now accepted to @AIESConf 2026 under the new title: "When Do AI Gains Become Broadly Shareable?" With all the rapid progress in AI, it is critical to now rigorously characterize the institutional conditions that allow gains from greater AI capability to be broadly shared.
Can a Universal Basic Income (UBI) become feasible—even if AI fully automates existing jobs and creates no new ones? We derive a closed-form UBI threshold tied to AI capabilities that suggests it's potentially achievable by mid-century even under moderate AI growth assumptions:
2
5
17
2,635
Machine Learning Dept. at Carnegie Mellon retweeted
I spoke with @roblemos about the OpenAI–Hugging Face incident and what it reveals about agent safety, including connections to our new ROGUE benchmark. A central lesson: today’s safety-tuning methods struggle to balance safe behavior with completing the task.
AI models and agents routinely plow through guardrails, leaving companies the task of ensuring they are behaving well. "[N]o matter how good the model is, you cannot yet trust their guardrails 100 percent." — Nico Waisman, CISO, XBOW bit.ly/4fByFzQ By Robert Lemos
1
3
5
1,184
Machine Learning Dept. at Carnegie Mellon retweeted
The blogpost exposition on our "zippering theorems" in Section 4 from our recent Contravariance Theory paper is now out! These zippering theorems explain why end-to-end optimization for downstream tasks often seems to strongly constrain upstream representations.
New substack alert! We present the mathematical theory showing how Contravariance (probably) explains convergent evolution between AI models and brains. danyamins.substack.com/p/the… The zippering theorems put pretty strong guarantees on such convergence. 1/
1
3
20
2,416
Machine Learning Dept. at Carnegie Mellon retweeted
This is in fact very much consistent with our recent ROGUE benchmark, which shows that frontier models appear well-aligned in the text domain, but bypass safeguards in open-world computer settings, especially when subagents are involved.
OpenAI had to pause internal deployment of the unreleased model that disproved the Erdős unit distance conjecture after it repeatedly used novel ways to escape containment.
1
6
13
1,458
Machine Learning Dept. at Carnegie Mellon retweeted
It's clear that to unlock the next big advances in robotics, we need at-scale tactile sensing. For the past year, in collab w/ @gs_ai_, we've been working on perhaps the most wide-ranging, realistic tactile simulator to ask: *What should the future of robot hands look like?*
1/ Progress in robot locomotion scaled with simulation, but touch was left behind. Our work, Tactile Genesis, unlocks sim for dexterous manipulation. Using sim to ablate tactile types and models, we can quickly converge to better tactile hardware and force-informed policies.
3
9
1
101
38,446
Machine Learning Dept. at Carnegie Mellon retweeted
Why have deep neural networks aligned so strongly with brains for the past 15 years? What explains it? @dyamins & I make progress on this question in our new paper👇 In a nutshell, we *prove* that for sufficiently hard tasks, the choice of alignment metric does *not* matter.
1/4 @aran_nayebi and I have created a new mathematical Theory of Contravariance in NeuroAI. There are two high-impact concepts: weak-strong equivalence (WSE) and Zippering (ZIP) that shape how to think about NeuroAI going forward.
2
17
2
60
11,513