M Ganesh Kumar retweeted
How does the brain track odor dynamics? Check out new insights from #KempnerInstitute's Venki Murthy (@VMurthyLab), Demba Ba (@dunbar_ba) and collaborators in research just published in @NatureComms
Sniffing Out Distance: How the Brain Tracks Odor Dynamics #Olfaction #Neuroscience
mcb.harvard.edu/department/n…
@luxorboero @JosephDZak @paul_masset @siddjakes29 @BTolooshams @VMurthyLab @RachelleGaudet @hseas @harvardbrainsci @KempnerInst
M Ganesh Kumar retweeted
Spontaneous behavior in freely exploring mice is not random wandering but a succession of self-directed tasks where low-level actions are sequenced to achieve high-level goals.
cell.com/neuron/fulltext/S08…
Nice paper @ABAtanasov and @blake__bordelon ! Happy that our paths crossed!
Beautiful new paper from Harvard, Stanford, UC Berkeley and other top labs.
Shows that DeepLearning is finally becoming the kind of thing science can explain, not just optimize.
Because we still do not have a compact, predictive theory that tells us ahead of time how a neural network will learn, scale, and respond to training choices without mostly testing it first.
Not that we will soon explain every weight, but that we may learn the coarse laws governing training, representation, and performance.
That shift matters because neural nets are not hidden systems. We know the architecture, the data, the objective, and the update rule. The obstacle is not secrecy. It is the complexity of many simple parts interacting at once.
So the authors propose “learning mechanics,” a physics-like program that studies the motion of learning itself.
“Learning mechanics” is their name for a hoped-for set of broad laws, similar to how physics explains gases without tracking every molecule, that explains the overall behavior of neural nets instead of just describing one model at a time.
Physics became useful by ignoring microscopic detail when the right aggregate variables were enough, and this paper says deep learning theory is maturing in exactly that direction through solvable toy models, infinite limits, scaling laws, hyperparameter theories, and universal behaviors.
The claim is that training a neural net may be less like recipe tweaking and more like physics, where you stop tracking every tiny part and instead predict the large patterns that keep showing up.
That means studying how gradients move parameters, how representations form, and why behavior changes in regular ways as model size, data, and compute grow.
The paper says this theory is taking shape through 5 routes: solvable toy models, simplifying limits like infinite width, simple laws like scaling laws, theories of hyperparameters, and behaviors that look universal across many systems.
The central bet is that useful laws can exist even when full microscopic detail is hopeless, just like thermodynamics explains gases without tracking every molecule.
This also fits neatly beside mechanistic interpretability, because one tries to find local circuits while the other tries to find global laws of learning.
----
Paper Link – arxiv. org/abs/2604.21691
Paper Title: "There Will Be a Scientific Theory of Deep Learning"
M Ganesh Kumar retweeted
If the brain tells time through neural dynamics (not a central clock) what does that mean for AI? Dean Buonomano’s work hints that intelligence may depend on temporal structure, not just computation. Would artificial networks benefit from brain-like temporal dynamics? #neuroai
What if your brain doesn’t just process information, it tells time through it? @dgsomucla's Buonomano chats with @neiltyson about how neural activity encodes time. Cracking this could reshape how we understand biological & artificial intelligence #neuroai youtube.com/watch?v=s5RBUSu0…
M Ganesh Kumar retweeted
We develop a new TMS targeting algorithm and test it in an open label trial in a treatment-resistant depression population with high comorbidities. Preprints by @rubykong92 @Torphernchern
1. doi.org/10.1101/2025.05.15.6…
2. doi.org/10.64898/2026.01.11.…
Our new approach ...
M Ganesh Kumar retweeted
This is the strongest ephys evidence so far for a generative model in the brain that I know of.
Congratulations @WadiaVarun! Wonderful collaboration with @UeliRutishauser on science that could only be done in humans.
And please check out Fig. 5FG. This is new since biorxiv and really surprised me: the mean response to imagery and viewing is actually the same & there are many cells that respond only during imagery--challenging the idea that signal strength is what distinguishes reality from imagination.
1/8 Our preprint is now a peer-reviewed paper :) Big thanks to our reviewers who pushed us to examine our results more carefully and Olivier Wyart (headquarter.paris/) for the exquisite visual. science.org/doi/10.1126/scie…
M Ganesh Kumar retweeted
Less than a week left to apply for the Junior Theoretical Neuroscientists Workshop, July 21–24, 2026 at @FlatironInst: simonsfoundation.org/event/j…
Apply here: simonsfoundation.formstack.c…
Acceptance includes travel, lodging, and meals
M Ganesh Kumar retweeted
Am I the only one who thinks Cotter & Conwell's "Fixed-weight networks can learn" (1990) is so underappreciated in light of in-context learning (and beyond)? with follow-ups including @HochreiterSepp's masterpiece (2001).
Cited 62 times (of which 10% are me). Seems too few.
M Ganesh Kumar retweeted
Academic friends who work on AI x Science, consider applying to the Google.org Impact Challenge on AI for Science before Apr 17. The funding amount ($500k-3M) is substantial to help push research for a moonshot. I'm happy to help provide feedback on some proposals, ff to email me !
M Ganesh Kumar retweeted
Neural manifolds do not map one-to-one onto circuit architecture. This study shows that distinct recurrent circuits can generate similar low-dimensional dynamics, yet still leave identifiable constraints on neural selectivity and population activity.
cell.com/neuron/fulltext/S08…
M Ganesh Kumar retweeted
Running a research lab is about leading people.
I created a free toolkit on the human side of lab leadership—covering hiring, mentoring, conflict navigation, lab culture, and performance management.
Open access: doi.org/10.5281/zenodo.19039…
#TeamScience #AcademicLeadership
M Ganesh Kumar retweeted
New discovery! Different anesthetics all seem to push the brain into unconsciousness in the same way: Activity is destabilized and dominated by slow waves. This could block signals.
cell.com/cell-reports/fullte…
#neuroscience @MIT_Picower @mitbrainandcog @mcgovernmit @ScienceMIT
M Ganesh Kumar retweeted
The newest model in the Mamba series is finally here 🐍
Hybrid models have become increasingly popular, raising the importance of designing the next generation of linear models.
We've introduced several SSM-centric ideas to significantly increase Mamba-2's modeling capabilities without compromising on speed. The resulting Mamba-3 model has noticeable performance gains over the most popular previous linear models (such as Mamba-2 and Gated DeltaNet) at all sizes.
This is the first Mamba that was student led: all credit to @aakash_lahoti @kevinyli_ @_berlinchen @caitWW9, and of course @tri_dao!
M Ganesh Kumar retweeted
Self-supervised learning from natural dynamical stimuli yields a circuit that resembles the Drosophila motion detector, reproducing both its directional selectivity and characteristic synaptic weight structure. By Abdelrahman Sharafeldin and Erik Schomburg at Cosyne poster 2-137
Thank you for covering our paper! It indeed is interesting that the hippocampus is learning representation like deep reinforcement learning agents using a reward prediction error.
The hippocampus does more than just map space; it actively predicts future rewards by learning state transitions within the world.
nature.com/articles/s41586-0…
M Ganesh Kumar retweeted
Our work on causal mechanistic interpretability across brains and machines: arxiv.org/abs/2603.06557 to appear at #ICLR26 expertly lead by @melandrocyte @Zaki_Alaoui1, @sunnyliu1220 w/ Steve Baccus
Key idea: there are two ways to understand hidden reps in a neural network:
1) how do inputs activate them?
2) what *causal impact* do they have on output?
We introduce CODEC (COntribution DECompostion) to find sparse codes for all contributions network elements make to the input output map, combining *both* input activation *and* causal output impact.
In both brains and machines we find:
1) sparser codes for contributions than activations
2) separation into interpretable excitatory/inhib effects
3) improved steerability
4) elucidation of causal computations that can't be seen through activations alone
For more details see the excellent thread below
Trying to interpret how a neural-network does what it does? Activations tell you if a neuron responded. Contributions tell you if a neuron mattered!
New paper from myself, @Zaki_Alaoui1, @sunnyliu1220 , @SuryaGanguli, and Steve Baccus: arxiv.org/abs/2603.06557
M Ganesh Kumar retweeted
The next step for autoresearch is that it has to be asynchronously massively collaborative for agents (think: SETI@home style). The goal is not to emulate a single PhD student, it's to emulate a research community of them.
Current code synchronously grows a single thread of commits in a particular research direction. But the original repo is more of a seed, from which could sprout commits contributed by agents on all kinds of different research directions or for different compute platforms. Git(Hub) is *almost* but not really suited for this. It has a softly built in assumption of one "master" branch, which temporarily forks off into PRs just to merge back a bit later.
I tried to prototype something super lightweight that could have a flavor of this, e.g. just a Discussion, written by my agent as a summary of its overnight run:
github.com/karpathy/autorese…
Alternatively, a PR has the benefit of exact commits:
github.com/karpathy/autorese…
but you'd never want to actually merge it... You'd just want to "adopt" and accumulate branches of commits. But even in this lightweight way, you could ask your agent to first read the Discussions/PRs using GitHub CLI for inspiration, and after its research is done, contribute a little "paper" of findings back.
I'm not actually exactly sure what this should look like, but it's a big idea that is more general than just the autoresearch repo specifically. Agents can in principle easily juggle and collaborate on thousands of commits across arbitrary branch structures. Existing abstractions will accumulate stress as intelligence, attention and tenacity cease to be bottlenecks.
M Ganesh Kumar retweeted
🚨BREAKING: Berkeley researchers spent 8 months inside a tech company watching how employees actually use AI.
The promise was simple: AI will save you time. Do less. Work smarter.
The opposite happened.
Workers didn't use AI to finish early and go home. They used it to take on more. More tasks. More projects. More hours. Nobody asked them to. They did it to themselves.
The researchers sat inside the company two days a week for 8 months. They watched 200 employees in real time. They tracked work channels. They conducted 40+ interviews across engineering, product, design, and operations.
Here's what they found. AI made everything feel faster, so people filled every gap. They sent prompts during lunch. Before meetings. Late at night. The natural stopping points in the workday disappeared. People ran multiple AI agents in the background while writing code, drafting documents, and sitting in meetings simultaneously.
It felt like momentum. It felt productive. But when they stepped back, they described feeling stretched, busier, and completely unable to disconnect.
83% said AI increased their workload. Not decreased. Increased.
62% of associates and 61% of entry-level workers reported burnout. Only 38% of executives felt the same strain. The people doing the actual work absorbed the damage while leadership celebrated the productivity numbers.
Then came the trap nobody saw coming. When one person uses AI to take on extra work, everyone else feels like they're falling behind. So the whole team speeds up. Nobody formally raises expectations. But the new pace quietly becomes the default. What AI made possible became what was expected.
The researchers gave it a name: workload creep. It looks like productivity at first. Then it becomes the new baseline. Then it becomes burnout.
AI was supposed to give you your time back. Instead it's eating more of it. And the worst part? You're doing it to yourself. Voluntarily.
M Ganesh Kumar retweeted
Online now: Linking neural manifolds to circuit structure in recurrent networks dlvr.it/TRL6b7
M Ganesh Kumar retweeted
The first time you start a research lab, there’s no manual.
So I made one.
A practical toolkit for postdocs and early-career faculty launching their first lab: hiring, startup planning, collaborations, and building a sustainable research program.
zenodo.org/records/18883545


































