EvolutionaryScale retweeted
Scaling laws are powering AI. It’s time to scale biology.
Today we’re launching the Virtual Biology Initiative to generate the data to unlock scaling laws in biology and build accurate predictive models of the cell.
Digital representations of proteins are already expanding our understanding of life at the molecular level, and accelerating the design of molecules and medicines. Accurate digital representations of the cell could reveal the mechanisms that are responsible for disease, and show how to reverse them.
The protein data bank, and worldwide repositories of protein sequence biodiversity were created through decades of work by the scientific community. The advances in artificial intelligence for proteins would not have been possible without them.
The cell is orders of magnitude more complex, and we will need to create the data in just a few years rather than decades.
This will require a coordinated global effort. We're partnering with Broad, Wellcome Sanger, Arc, Allen, Human Cell Atlas, Human Protein Atlas, NVIDIA, and Renaissance Philanthropy.
Biohub is contributing to this effort as both a funder and a builder. We are developing microscopy to observe millions of cells in living organisms, and cryo-ET to resolve the cell in atomic detail. We're building instruments that expand the range of modalities and parameters that can be simultaneously measured. We’re developing molecular, cellular, and tissue engineering to create models of disease and design interventions.
The data we generate will be available to the worldwide scientific community.
We’re also committing $100M over the next five years to support work beyond Biohub.
We invite other scientific teams and funders to join.
Link: biohub.org/news/virtual-biol…
EvolutionaryScale retweeted
honored to host Priscilla and @finkd on LS, I think their first joint pod since Huberman 2023
10 years in and @ChanZuckerberg is both the most well funded nonprofit in human history and dead serious in its mission of providing {data,tools,models} to cure and prevent all diseases by end of the century:
- Biohubs have huge pmf (i explain in writeup below) and now CZI is all in on Biohub
- acquiring @EvoscaleAI, the frontier bio research lab backed by @natfriedman
- 10,000 GPU cluster in 3 years
- imaging and cataloging every cell type and releasing for free (billions of them from nm scale up)
- releasing 3 new models for simulating virtual cells: VariantFormer, CryoLens, scLDM
being close to solving single cells; they are now launching the Virtual Immune System project, a flagship effort to model the immense complexity of The ENTIRE HUMAN IMMUNE SYSTEM.
i was very struck by how Priscilla puts it on the pod: if the immune system is working you’re much more likely to be healthy, if it isn’t you’re not. this may cure diseases we don’t even know are directly connected, like Depression (!!)
again, was such a rare honor to host this CZI BioHub pod with @FanaHOVA . Enjoy.
Priscilla Chan and Mark Zuckerberg co-founded the Chan Zuckerberg Initiative (CZI) in 2015, committing 99% of their Meta shares to advance science, education, and opportunity. As a pediatrician and CEO of Meta respectively, they've built CZI into one of the most ambitious technology-driven philanthropic organizations with a moonshot goal to help cure, prevent, or manage all diseases by the end of the century.
In this episode, we sit down with Priscilla and Mark to unpack how CZI bridges state-of-the-art AI with open biomedical research, their investments in open-source tools like the Human Cell Atlas, their philosophy on building teams across different disciplines, and what they envision the future of healthcare.
@czi @swyx @FanaHOVA
ES will be joining forces with @Biohub to create the first large-scale scientific initiative combining frontier AI & frontier biology. Together, we're building world-class compute, AI research & state-of-the-art technologies to cure or prevent disease. bit.ly/4nOUGO4
Today CZI is announcing an unprecedented new scientific initiative to build the future of AI-powered biology. I am joining CZI to lead this initiative as Head of Science, and the EvolutionaryScale team is joining forces with Biohub.
This is the first large scale scientific effort to combine frontier AI and frontier biology.
I feel an incredible sense of optimism in this moment. There is a path to build predictive models of life that can fundamentally accelerate science, and unlock a new understanding of disease.
biohub.org/blog/frontier-ai-…
We're sponsoring the use of ESM3 and EMSC to help researchers engineer improved PETase enzymes in the @AlignBio 2025 Protein Engineering Tournament.
Get started using ESMC to predict protein function and ESM3 to generate new enzymes here: github.com/evolutionaryscale…
1/4
🚀 Announcing the 2025 Protein Engineering Tournament. This year’s challenge: design PETase enzymes, which degrade the type of plastic in bottles. Can AI-guided protein design help solve the climate crisis? Let’s find out! ⬇️
#AIforBiology #ClimateTech #ProteinEngineering #OpenScience
We're thrilled to announce the publication of ESM3 in Science Magazine. We’re opening our API for biological intelligence, now in public beta, allowing scientists in academia and industry a free limited time preview of the capabilities of some of our models through Forge.
We're thrilled to present ESM3 in @ScienceMagazine. ESM3 is a generative language model that reasons over the three fundamental properties of proteins: sequence, structure, and function. Today we're making ESM3 available free to researchers worldwide via the public beta of an API for biological intelligence.
Trained with over a trillion teraflops of compute, this is the first time a model of this scale has been trained for biology, pushing the frontier of AI for biological discovery and engineering.
ESM3 learns to represent the immense complexity of protein biology, learning from billions of natural proteins. From this training it developed the capability to design proteins, responding to complex prompts combining atomic level details and high level instructions to generate new proteins.
ESM3 can explore protein space far beyond natural evolution. We prompted ESM3 to generate a fluorescent protein at a far distance from any known fluorescent proteins, searching an unknown region of protein space, to discover a new fluorescent protein.
We estimate this is equivalent to simulating five hundred million years of evolution.
Read the paper: science.org/doi/10.1126/scie…
Access the beta: forge.evolutionaryscale.ai/s…
EvolutionaryScale retweeted
Introducing ESM Cambrian.
Unsupervised learning can invert biology at scale to reveal the hidden structure of the natural world.
We’ve scaled up compute and data to train a new generation of protein language models. ESM C defines a new state of the art for protein representation learning.
An incredible day for our field. Congratulations David Baker, Demis Hassabis, and John Jumper!!
BREAKING NEWS
The Royal Swedish Academy of Sciences has decided to award the 2024 #NobelPrize in Chemistry with one half to David Baker “for computational protein design” and the other half jointly to Demis Hassabis and John M. Jumper “for protein structure prediction.”
EvolutionaryScale is partnering with @Lux_Capital & @envedabio to bring you a Bio x ML Hackathon from Oct 10-20.
Build on ESM3 *98 billion* and proprietary datasets of protein activity to develop next-gen bio applications.
Open globally. Get started: hackathon.bio
Model APIs, datasets & compute powered by @AWS, @OpenAI, @nvidia, @digitalocean, @EvoscaleAI, @modal, @togethercompute, @envedabio, @latchbio & more. (2/2)
EvolutionaryScale retweeted
After we trained ESM3, we were excited to see it could respond to complex prompts, which greatly improved with scale.
While scaling has been driving advances across AI—in biology it has been largely underestimated.
Article by @ewencallaway for @Nature: nature.com/articles/d41586-0…
EvolutionaryScale retweeted
Weekend project: Comparing ESM3 from @EvoscaleAI to ESM2 and inv_cov. The ultimate test of a protein language models is how well the pairwise dependencies it learns correlate to structure. (1/8)
EvolutionaryScale retweeted
It's been a wild ride building ESM3, a new frontier AI Model for Biology 🚀🧬 @EvoscaleAI
I'm especially excited about our results on post-training that indicate that models develop a deep understanding of biology at scale which enables it to solve harder problems with less data
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…
EvolutionaryScale retweeted
I’m so excited to share what we’ve been working on @EvoscaleAI. ESM3 is a multimodal generative masked language model for programming biology. Here’s a short thread on the architecture behind ESM3. 🧵
nitter.cf/alexrives/status/18055…
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…
EvolutionaryScale retweeted
I'm so excited to share that I've been at EvolutionaryScale, it feels like a dream come true!
As one of our first projects, we took on designing a new green fluorescent protein with ESM3, our frontier generative language model for programming biology
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…
EvolutionaryScale retweeted
🧵Today is an exciting day! We have just announced ESM3, the design of a new green fluorescent protein, and the launch of our company. Here's a short thread about the scaling and infrastructure work involved in making ESM3 happen! 🧵
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…
EvolutionaryScale retweeted
🧵 Check out what I've been working on at @EvoscaleAI 🧵
We trained a bidirectional masked generative model on protein sequence, structure and function! From 1.4B to 98B parameters, our models are so good that beating ESMFold was just a footnote 🤯
👇👇👇
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…
EvolutionaryScale retweeted
We have trained ESM3, a generative bidirectional masked language model that reasons over the sequence, structure, and function of proteins. ESM3 is trained at three model scales - 1.4B, 7B, and 98B.
nitter.cf/alexrives/status/18055…
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…
EvolutionaryScale retweeted
Delighted to co-lead the $142M seed round in EvolutionaryScale with @natfriedman @danielgross @Lux_Capital, a new frontier AI lab that has now trained ESM3, a natively multimodal and generative language model for proteins and the largest biological language model to date
We have trained ESM3 and we're excited to introduce EvolutionaryScale.
ESM3 is a generative language model for programming biology. In experiments, we found ESM3 can simulate 500M years of evolution to generate new fluorescent proteins.
Read more: evolutionaryscale.ai/blog/es…