ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ (@petergchang) header
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ (@petergchang) profile picture

PhD Student | @MIT EECS (with @m_sendhil) | AI for Scientific Understanding

Cambridge, MA
Joined May 2022
Photo by ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ (@petergchang)Photo by ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ (@petergchang)
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
I don’t think you do? Impressive for an LLM! But this is basic for retrosynthesis software The job of the synthetic chemist is to figure out which beautiful whiteboard routes fail, why, and fix them. That’s >80% of the effort!
do you realise how fucking insane this is?!
3
1
62
3,230
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
Working with AI requires perpetually operating at the edge of sanity. You have to recalibrate your mental model of AI capabilities and your own job description every few months, without getting delusional about seemingly infinite productivity gains, or feeling threatened by losing what you thought was the uniquely human part of your job, or obsessing over the perfect setup, or losing your mind over the clumsiness and jaggedness of agents, or ... Maybe AI literacy needs to be less about prompting and more about improving emotional regulation.
116
136
38
975
48,598
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
November in Cambridge. ❤️
3
28
3
523
12,891
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
The ideal outcome for science isn't a couple of labs using proprietary models and millions of dollars to crack trophy problems, it's to have millions of AI-aided human scientists who follow their curiosity and become way more ambitious
159
343
56
2,647
92,372
Relatedly, this is how basically every jazz musician trains, by transcribing old masters (i.e., listening to solos over and over again, often writing down the notes, until you can play along). When first learning to transcribe, students often mistakenly think that the point of transcriptions is to learn to play the notes. Especially students who’ve already had some classical music training often make this mistake, myself included. But the point of transcriptions is to imitate the mental process that resulted in the notes being produced, and not to merely imitate the notes themselves. (As Rich Sutton likes to point out) This is a crucial distinction, as learning to play the notes requires a completely different mental process from one required to improvise the notes in real time. Clearly, there is no hope in you ever being able to imitate in full fidelity the entire thought process of Miles Davis as he blows through a nasty solo. There are infinitely many mental processes that could improvise the notes that he plays (Rashomon effect). But that is the entire point of transcriptions! You learn your own digested version that is compatible with your own sensibilities, and the accumulation of these “world models” is what comes to define your own artistry and style.
I was talking with someone earlier today about the process of becoming a stronger writer and what it takes to get better at clearly explaining ideas - I forgot to mention one really helpful tip, and thought it would be good to share broadly. Try to write style imitations of writers you like! Spend time trying to work out how they structure their arguments and how to replicate that argument structure. Do special effects tests where you try to write like them and see if what you produce can inspire the same feelings in you as the original author's writing. The old masters in many other domains of art learned by imitation; writing is not so different in this respect.
4
165
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
Replying to @BachFrancis
(1/7) I'd like to provide some additional context for the remarks that can be found in this interview. (2/7) My discomfort with the attention being paid to existential risk---and with the ongoing dominance of the public discussion of such risks by a few so-called thought leaders---is that there's an elephant in the room that is being missed. That elephant is the effect of all of this discussion on young people, and indeed the effect---beginning with social media a decade ago---of information technology on young lives broadly speaking. (3/7) I recently read an interview by Jill Lepore in which she reports on discussions that she had recently with a group of college students: "They had just three things to say. One, social media completely destroyed their childhoods. Two, AI is destroying their college education and their likely prospects for employment. And three, what the hell are we all doing?" To add a fourth bullet that I've heard in similar discussions: "I'm not going to have children, because the existential risk is just too high." (4/7) Please contemplate such a statement, those of you who think that it's OK that the public, widely diffused, discussion coming from seemingly authoritative figures is so adamant about existential risk. (5/7) Let me add that I have little interest in a debate about what "superintelligence" might mean, or whether we're currently seeing the emergence of superintelligence. For what it's worth, I would certainly agree that the solution of extremely challenging math problems (for example) exhibits a very impressive form of intelligence, although I would want to argue that such intelligence is impossible to dissociate from the collective of humans that provided data to the machine learning system (which itself has become a kind of collective). (6/7) Such philosophical debates are entertaining and even important, but when they then head in the direction of "when such superintelligence emerges, there's a good chance that it will want to kill all humans", I say "science fiction". Again, I don't think that it's bad to consider such thoughts, but I strongly believe that it's bad for society, and especially young people, for such thoughts, unaccompanied by any serious real-world analysis, to become a dominant form of discourse of the era. (7/7) We are damaging human lives, and the consequences of that damage will no doubt be a major theme of the next several decades.
48
233
61
1,199
152,989
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
10 remarks on AI and math that can be true all at once: 1. The recent progress is stunning and exciting. 2. The Quasi-Riemann Hypothesis is arguably Fields-medal level. 3. Mathematics is being transformed and there is no way back. 4. OpenAI doesn't give a fuck about the future of mathematics. 5. Half-baked unreadable preprints claiming major results can effectively stall mathematical progress. 6. Some mathematicians are responding with naive, overly defensive comments. 7. The social-media wankers framing this as "OpenAI tramples gatekeeping" have no experience of mathematical research. 8. The product of mathematics is clarity and understanding. Not theorems, by themselves. 9. Mathematics is a critical infrastructure of human cognition. The human need for understanding isn't obsolete and it can't be offloaded to machines. 10. We haven't "solved" mathematics and we won't get there before the Sun burns out.
158
465
58
2,962
160,067
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
The cruelty has been puzzling me. Under almost every post which recounts the anguish of someone seeing AI models becoming shockingly good at their own craft, there is a stream of comments telling the poster to, essentially, accept their own obsolescence. If the poster calls for this development to slow down, the response is to stop standing in the way of progress. If the poster wants to nuance the picture of the machine god steamrolling everything, reply guys call it “cope” and “cringe”. Most recently, this has been happening in mathematics with the field’s shocked reaction to the deluge of AI-generated proofs, but similar dynamics have played out for musicians and visual artists, and to a more limited extent for programmers. These people seem to be cheering for the machines rather than humans. But I don’t think it’s as simple (or as extreme) as anti-human sentiment. The more charitable read is that most of these people really believe that this represents progress. They are excited about scientific and technical progress, and don’t want old farts like professors and other credentialed types to stand in the way. Let’s unleash machine science, and if the professors and intellectuals don’t like it, they can find something else to do! But this is a perverted idea of progress. What good is a proof of the Riemann conjecture if there is no one who understands it? And not just a single person: you need a whole community of people to understand it and then gradually think about what it might lead to. Maybe the result will contribute to a better encryption algorithm, or a better understanding of quasars, or something else. But this requires diffusion of understanding through scientific communities. A proof of the Riemann conjecture by itself is meaningless; to me, or to the vast majority of people out there, it’s just a bunch of symbols that we can’t read. The same thing can be said for other types of research: say, for example, that your AI system deciphers some cellular mechanism that could help with a cure for cancer. A whole network of experts is then needed to do all the complex science and innovation that helps translate this into a cure, test it, and so on. The paper itself would just be collecting digital dust unless the right scientific communities were there to build on it. Now, where do all these experts and their communities come from? From doing research. The only way we know of making people understand the frontiers of a field of knowledge is by trying to advance it, which must come with a real chance of succeeding and being recognized for it. It’s very hard, not to mention boring, to understand the minutiae of some arcane topic if you are not working on producing new knowledge there. If you fully automate the production of results in some discipline, you will also cut off the supply of experts who can understand it. People who have never participated in research may not understand this. If that’s you, try reading a recent paper in a field you know nothing about: category theory perhaps, or carbon nanotube synthesis, or cecidology, or loop quantum gravity. Faced with pages of mysterious scribblings, you can ask Claude or Gemini to explain the paper to you, but then the terms used in the explanations will need to be explained again, and so on. You will find that, in order to actually understand the research and its significance, you will need to understand the whole research field. Then there are those who do understand the role of expertise and the difficulty with which it is cultivated, and still ridicule those who are less than enthusiastic about the AI-driven disruption/destruction of whole research fields. Wherefore? What are they thinking, really? Let us again try the most charitable interpretation. Maybe they believe that we will not need anyone to understand that proof of the Riemann conjecture, because some complex sequence of AI systems will take us all the way from a proof in fundamental mathematics, via all kinds of research, development, and design, to a finished consumer product shipped to your door. This would imply end-to-end automation of much of the economy. I guess some people are really worried that something like this might happen, and therefore want to pre-empt it by acting as if it were already a certainty. This, I think, is the gist of statements like “everything will be AI anyway”, which I’ve seen cropping up with alarming frequency. Submit to the machine god before it arrives, a form of anticipatory grief. Abandoning agency early makes you look like you have situational awareness. “Coping” is uncool. I get it, but cynicism is always the easy choice. It’s also the cowardly choice. Let’s not be cowards. We have agency here; it is a given that technology will advance, but the exact way in which it will advance is down to all of us, and how we adopt this technology in society is something we can and must decide on together. Finally, there are those who have thought all this through, and still welcome the wholesale replacement of human cognitive work. Those for whom it would be a good thing that some sequence of AI systems does all the thinking, so we don’t have to. Who would think this? Well, clearly, someone who doesn’t much enjoy thinking. But I think it’s more than that. I think that there are people for whom the devaluation of expertise would be a good thing. Those who “have had enough of experts”, as Michael Gove said of the British people in the campaign for the Brexit referendum. Those who think these clever know-it-alls should be put in their place. They think people who have spent much of their lives specializing in some narrow topic should not be given all that respect and influence they seem to have now. This is called anti-intellectualism. And that’s where the cruelty comes from. I can’t know what’s going on in their heads, but when I see people telling mathematics professors to go get a real job, as if their jobs would somehow be less real than those of massage therapists, real estate agents, or police officers, I call that anti-intellectualism. Much the same as for people who would rather take health advice from a podcaster than from a medical doctor, or who would happily see a news show host rather than a decorated general in charge of the military. At the extreme end of anti-intellectualism, we have the Cultural Revolution and the Khmer Rouge. I hate anti-intellectualism. I think our society should incentivize people to study hard, think deeply and originally, try to push the boundaries of knowledge, and talk freely about it. I think those who spend their lives specializing in arcane topics should be respected and protected. Yes, it goes without saying, I am an intellectual. A tenured professor even, the worst of the worst from an anti-intellectual’s point of view. So you would expect me to defend the experts and intellectuals. But let me make a non-self-serving argument: humans will always compete. That’s human nature. Would you rather live in a society where the smartest people compete in understanding the mysteries of nature, developing complex technology, and producing beautiful art, or in a society where the smartest humans compete by accumulating money and/or simply by fighting each other? As I have written about before, I am worried. I am not worried that out-of-control AI will kill us all or even that it would put us all out of work. There will always be some kind of work for us. I am worried there will be no place for us in advancing knowledge and understanding the world. I think that the defining question of our time is how to avoid this fate. It’s not a matter of my own job, or yours; it’s a matter of the purpose and dignity of humanity as a whole. Big words, I know, but I think they are warranted, and I don’t care if the cynics call it cringe. So next time you see someone complaining that AI is steamrolling their field of expertise, don’t join in the heckling choir. Don’t be cruel. And don’t assume that someone who has devoted their life, or at least their career, to furthering knowledge wants to stand in the way of progress. Instead, try thinking constructively about how we can work together to ensure that human experts and intellectuals can float on top of the AI wave rather than be drowned by it. Do we have a deal? Alright, thank you! Now I will go back to thinking and working on AI, meaning artificial intelligence, not anti-intellectualism.
105
133
33
775
49,408
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
It sounds insane, because we're used to a particular way of doing research: of giving and receiving credit, of counting beans, of hiring, recruiting, and promoting. And the machine god came to crush that game. The old game is dead. That reasonably causes incredible amounts of dread for many folks, who understand this as the death of research. But it's not about Research, but the way we played the game. The old game was built around scarcity, scarce compute, scarce students, scarce hours, scarce people who knew the right technique and method etc. Most of a research career went into managing and playing along these constraints. Those walls just came crushing down. One person with a good question can now do what used to take a lab and five years. You do not need permission, you do not need a big grant, you do not need a professor or researcher title, or a team of twenty experts , or one thousand gpus to stare straight into the first light of the universe. How absolutely incredible
I know this may sound insane, but this is the best time to be a Researcher.
59
181
39
1,381
81,956
This reminds me of the time I sought advice from my academic advisor (a very famous theoretical physicist) as a starry-eyed junior about potentially applying for graduate school in theoretical physics. He asked me why I wanted to pursue physics; I muttered some grandiosity about wanting to make a significant contribution. He ended our meeting by confessing that he strongly believes that even if Einstein hadn’t existed, progress in physics would have been delayed by at most five years. Now, if a young, ambitious student seriously believed this thesis (that scientific progress cannot be meaningfully perturbed by any individual scientist), then what path should they take? First is to go into a field which brings them great personal joy. Second is to go into engineering. The apparent determinism in the sciences is not so apparent in fields like computer science; TeX wouldn’t exist if Donald Knuth hadn’t invented it, the Transformer architecture in its current state, arguably, would not exist if not for the several individuals that engineered it to existence. The third option is to go into a scientific field where expedition of a discovery even by a few months or even days has a significant tangible impact; I would put medical research in this category. To end on a more optimistic note: at the time, I was dejected and struck by his apparent cynicism. But looking back I realize he told me just what I needed to hear at the time. AI for Science, the field that I’ve ended up in somehow via a series of serendipities, is an extremely compelling path, certainly for me and I’m sure for many others.
Grigori Perelman and Andrew Wiles could have just taken it easy and worked mid-level marketing jobs, and we'd have gotten the solutions to the Poincare Conjecture and Fermat's Last Theorem before 2030 anyway
1
6
351
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
OpenAI recently published data on its researchers’ coding-agent usage. We took their weekly figures from January to mid-August 2026 and fitted trends to summarize how quickly spending grew. We found that spending has been doubling about once a month.
60
76
39
707
119,569
Taste is a judgment about aesthetics. It’s easy to think that taste applies exclusively to the final artifact, but in fact it is more often a judgment on the creation process itself. This is why a banana taped to a wall can sell for millions of dollars. It is also why OpenAI’s approach to solving Navier Stokes is widely regarded as low taste. People are judging the process of creation (deploy 10k agents) even before looking at the outcome. It is also why the bitter lesson is so hard to swallow; there is beauty to the simplicity of the idea of the bitter lesson, but the lesson applied to any particular domain feels distinctively low-taste.
Research taste in particular may be trickier than it looks. Say the next generation of AI really does have an interesting, high-taste set of research directions to pursue. Well presumably find those fast, after which the fruit will have been plucked, and the ideas will no longer be high taste (because they’ve been explored en masse). This is a similar dynamic to the ever-moving target of “slop.” *Any* output that is recognizably of the agents becomes slop, or at least commodified, in a sense, once that output is sufficiently promulgated in bulk. Certain styles of math paper will become (are becoming) slop. Certain styles of web design already are. On and on it will go. It’s unclear if any kind of media/intellectual output proliferated at such scale can remain high taste, even if we’d have considered it genius from a human just a few years ago. The bar will continually be raised. The world will get smarter as what was once brilliance becomes commodified, but *what was once brilliance will nevertheless be commodified.* And so the definition of brilliant will change. The wedge for continued value creation by humans lies here, I would guess.
3
130
I found this to be a deeply confused view of what writing is. The professor identifies the two utilities of writing as: 1) a process of “achieving thought”; and 2) a summary of thought already achieved, and he claims that writing is useful as 2) but overrated as 1). His evidence? When he teaches, he doesn’t prepare scripts and instead engages in conversations. Also, his students demonstrated more clarity of thought during oral exams than in their final essays. His mistake is that he believes that the process of “achieving thought” exclusively lies in the response to whatever question posed by an external agent (his students during his lecture, himself during the oral exam). It is ironic that he brings up Socrates as a defender of his argument, since Socrates’ writing is the ultimate example of how clarity of thought is achieved through writing down the back-and-forth that is required to develop and mature an idea. What writing allows is for the writer to play both parts: once the words are externalized, they are no longer the writer’s; this allows the writer to examine them and interrogate them. Thus, writing allows the writer to engage in the oral exam through oneself without relying on an audience. Probing and asking questions that motivate development and movement of ideas is arguably the most important component in the process of achieving thought. The distinct lack of deep interrogation within the opinion piece perhaps is the biggest indictment of his thesis.
The head of the philosophy department at Williams College downplays the pedagogical value of writing: “What if we are mistaken in treating writing as the highest cultivation of thought? The evidence that supports this belief is thin at best. Writing can be useful cognitive scaffolding for memory and self-regulated learning, but the notion that it is the best process for developing thinking skills is a fairly recent idea, traceable to the 1970s writing-across-the-curriculum movement.”
3
163
I'm noticing a disproportionate level of hostility towards this project. Are all theorems with long, incompressible proofs interesting? Of course not. But I would argue that "easy to state, hard to prove" is at least a defensible proxy for what is ultimately a subjective judgment, though “length of proof” as a proxy for “hard to prove” is perhaps a less defensible one. Overall I think it's a timely (perhaps too timely...) and very well-executed paper, and I hope to see more active academic research in the direction of explicitly training models to solve more ambitious scientific problems, as opposed to the current paradigm of setting up elaborate agentic frameworks and waiting for the frontier models to become “smarter”. People’s reactions make more sense when considering the sudden loss of value of “length” as a proxy for insight, as evidenced by the deluge of hundred-page proofs that no one wants to read. There is a deep confusion in the field as to whether a theorem can be unconditionally interesting, i.e., whether a problem previously thought to be interesting can be retroactively made uninteresting by the existence of a slop proof (see the ambivalent reaction towards Navier Stokes).
“An accumulation of facts is no more a science than a heap of stones is a house.” - Poincaré LLMs are now proving results that have resisted mathematicians for decades. Finding interesting theorems without human guidance is a new bottleneck. We show that we can teach an LLM to do it! TL;DR: → a quantitative notion of interestingness → 4.3× higher interestingness → a self-expanding discovery loop [1/5]
3
205
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
Replying to @AlgoSvensson
This is exactly what I have been telling students. Before last fall, I did not really believe P vs NP could be resolved in my lifetime. Now I do.
3
8
86
3,060
ᴘᴇᴛᴇʀ ɢ. ᴄʜᴀɴɢ retweeted
In a way, pure mathematics is having its first computational revolution - which is coming quite late relative to other STEM fields. Like if you compare the astronomy workflows of a modern CMB cosmologist computing bispectra on their laptop with Tycho Brahe doing naked eye observing, they look like completely different fields. But the goal of understanding the universe is the same. I think math is going to experience something similar. And the workflow is going to evolve past finding proofs and towards something new - but with the same underlying goal of understanding the "mathematical universe."
12
20
3
312
16,990