Ian Simon retweeted
Introducing Magenta RealTime 2 (MRT2): the live music model you can play as an instrument.
MRT2 offers MIDI and prompt controls, and runs natively on a MacBook with <200ms latency.
Open weights. Open source inference engine. Suite of apps and plugins.
Hear what it can do and try it out for yourself below 🧵
Ian Simon retweeted
Replying to @huangcza
@huangcza @iansimon @notwaldorf tiny labor of love to revive an old model ♡ kylemcdonald.github.io/Music…
Ian Simon retweeted
Today, we're open sourcing the code behind "The Infinite Crate," our VST/AU plugin that lets you play with Lyria RealTime directly inside your favorite DAW! 🎧🎶
Since we released The Infinite Crate last year, it’s been used by some of our favorite artists - including a wonderful showcase with @daitomanabe in Tokyo - and being featured as a top new music tool at NAMM 2026.
We’re now fully open sourcing the plugin for developers to fork, modify, and make their own under the permissive Apache 2.0 license.
💾 Get it here: github.com/magenta/the-infin…
Ian Simon retweeted
Daylight savings is awesome. Means we can get both late sunsets in the summer and not-too-late sunrises in the winter.
This is absolutely shameful. Agents of a federal agency unnecessarily escalating, and then executing a defenseless citizen whose offense appears to be using his cell phone camera. Every person regardless of political affiliation should be denouncing this.
Ian Simon retweeted
Magenta is hiring student researchers for 2026!
We're looking for candidates to push the boundaries of interactive real-time music generation, such as the next generation of Lyria RealTime and Magenta RealTime models.
Follow instructions to apply here:
forms.gle/EAvTt1KLNqpVHx9h7
Ian Simon retweeted
We built a web app that lets you fly a spaceship through a 3D constellation of music - powered by our Lyria RealTime model. 🎶
Space DJ is an interactive visualization where every star represents a different music genre. As you explore, your path is translated into prompts for the API, creating a continuously evolving soundtrack. ↓
Ian Simon retweeted
How do we design real-time audio jamming models, and do we have the right data? Our new arXiv preprint studies the design and its tradeoffs.
Paper: arxiv.org/abs/2510.22105
Audio samples & code: lukewys.github.io/stream-mus…
Ian Simon retweeted
Realtime interactive generative models FTW!
Announcing a new 🌊 of details and features for Magenta RealTime, the open weights live music AI model from GDM!
* Live Jamming with audio input 🎤🎸🎵
* Personalize your own models 🔧
* Tech report 📜
Links below in the 🧵...
Ian Simon retweeted
Excited to announce 🎵Magenta RealTime, the first open weights music generation model capable of real-time audio generation with real-time control.
👋 **Try Magenta RT on Colab TPUs**: colab.research.google.com/gi…
👀 Blog post: g.co/magenta/rt
🧵 below
Ian Simon retweeted
On the occasion of returning to Magenta's roots at @sonarplusd, we're dusting off the blog to share news and insights about what we're working on at @GoogleDeepMind on the Lyria Team.
g.co/magenta/lyria-realtime
Our latest post is about the Lyria RealTime API, providing access to our "live music model" that powers MusicFX DJ. Lyria RealTime enables unprecedented interactivity with a generative audio model for music, and has been stretching our imagination with the ways it can be integrated into physical and virtual instruments, spaces, and applications.
We've included a few open source interfaces for you to fork and build with, including the one @ToroyMoi used during the I/O preshow controlled by a MIDI Fighter. We are so excited to see what you will do with the technology yourself.
Enjoy!
Ian Simon retweeted
So excited that Lyria RealTime is now available as an API!
Try it out and fork our examples here: aistudio.google.com/app/apps…
Ian Simon retweeted
I’m so proud of the updated version of #MusicFXDJ we developed in collaboration with @jacobcollier, available today at labs.google/musicfx.
Over the past year I’ve spent countless hours experimenting with our real-time music models, and it feels like I’ve learned to play a new type of instrument, in the spirit of what we started @GoogleMagenta to achieve.
It was validating to hear Jacob echo these sentiments the first time he played an early version. With his help, we’ve added new controls, raising the ceiling on what players are able to do with it.
Now anyone can experiment with this new instrument and share what they create with the world.
I'll start things off with my most recent jam session...
It’s here! Thrilled to collab with @jacobcollier on our latest #LabSession exploring the magical possibilities of generative music and #MusicFXDJ. Watch full video: youtu.be/y7gKlzvg8xk
Tune in 10/24 at 5 PM ET as Jacob livestreams a MusicFX DJ sesh on his YT channel.
Ian Simon retweeted
We built a real-time music jamming system using RL and generative models -- you can play along with this model and learn more about our work at #ICML2024 🎶!
📄 paper: twtr.to/UFe6X
🌐 website: twtr.to/v9E5y
🕐 Tue 23 Jul 1:30 - 3 p.m. CEST
📍 Hall C 4-9
🧵
Ian Simon retweeted
📣 Now you can jam with MusicFX DJ in 48kHz Stereo 🔊 🔊
There are lots of ways to use this tool, but for me it's all about getting lost while mining for trippy new sounds.
Have fun!
labs.google/musicfx-dj
Ian Simon retweeted
I made something: kiwipedia.xyz - an entirely AI-generated version of wikipedia.
Kiwipedia explores the feeling of navigating a world where you can't be sure if anything is real.
Ian Simon retweeted
In partnership with @GoogleMagenta, we invited 13 professional writers to use Wordcraft, our experimental LaMDA-powered AI writing tool. We've published all of the stories written with the tool, along with a discussion on the future of AI and creativity.
g.co/research/wordcraft
Ian Simon retweeted
This paper really shows the power of a generic seq2seq architecture for transcription. Instead of transcribing all the notes of the input, just transcribe a piano cover instead! Works surprisingly well, even on songs not seen during training.
Amazing work, @_JonghoChoi!
Pop2Piano : Pop Audio-based Piano Cover Generation
abs: arxiv.org/abs/2211.00895
project page: sweetcocoa.github.io/pop2pia…
github: github.com/sweetcocoa/pop2pi…
This media is unavailable
Ian Simon retweeted
We’re happy to announce the Chamber Ensemble Generator and CocoChorales Dataset!
We use generative models to create a massive, highly-annotated, and realistic-sounding dataset of chorale performances.
Blog & Samples🔊: g.co/magenta/ceg-and-cococho…
Paper📝: arxiv.org/abs/2209.14458
🧵
















