Google Magenta RealTime 2 Turns MacBooks into Live AI Music Instruments

Google GemmaGoogle Gemma

Google's Magenta Project released Magenta RealTime 2 (MRT2), an open-weight, open-source live music model. It enables low-latency, real-time music synthesis natively on Apple Silicon MacBooks using MIDI, text, and audio inputs. This allows musicians to play AI-generated music as an instrument directly on their device, fostering new creative workflows.

Magenta RealTime 2 (MRT2) from Google's Magenta Project is a live music model that musicians can play as an instrument. The model is open-weights (its trained parameters are publicly released) and its inference engine is open-source, allowing it to run natively on Apple Silicon MacBooks. It performs real-time music synthesis (generating music instantly) using MIDI, text, and audio inputs.
Latency
<200ms
Platform
Apple Silicon MacBooks
Model Type
Open-weights, open-source inference engine
Inputs
MIDI, text, audio
Base Model Requirement
M3 Pro / M2 Max or higher
Small Model Requirement
Any Apple Silicon MacBook

This update matters by enabling interactive, on-device AI music generation with low latency, measured at under 200ms. This capability opens new creative avenues for musicians, enabling them to experiment with cloning sounds, blending genres, and creating live accompaniment directly from their laptops.

Users can download a suite of playable apps and plugins for MacBooks, including Jam, Collider, and a standalone MRT2 application with DAW integration. Key features include MIDI steering for harmonic control, text-to-synth for generating instruments from descriptions, audio cloning from snippets, prompt mixing, and gesture control for dynamic modulation.

View the full update on magenta.withgoogle.com
Google Gemma
Google Gemma
@googlegemma
X

Introducing Magenta RealTime 2, a new open model musicians can play as an instrument! Run low-latency, live music synthesis natively on your MacBook using MIDI, text, and audio. 🎶 We love seeing Google’s open model ecosystem grow! https://t.co/80jc3S5uua

334retweets2.9klikes
View on X

Still wondering? A few quick answers below.

Magenta RealTime 2 (MRT2) is a live music model from Google's Magenta Project that allows musicians to play AI-generated music as an instrument. It runs natively on Apple Silicon MacBooks, offering real-time music synthesis with low latency.

MRT2 offers MIDI steering for harmonic control, text-to-synth to generate instruments from descriptions, audio cloning from brief snippets, and prompt mixing to explore new styles. It also supports sound design and modulation via gesture control.

The Base MRT2 model requires an M3 Pro / M2 Max or higher Apple Silicon MacBook. A Small model variant is available that runs on any Apple Silicon MacBook, including the MacBook Air. Both require audio sample rate set to 48kHz.

You can download a bundle of apps and plugins directly to your MacBook. This includes standalone applications like Jam and Collider, as well as an MRT2 plugin for digital audio workstations (DAWs). The model weights are downloaded upon first launch.

Every HeadsUpAI update is written based on its original source and reviewed before it's published. Read our editorial standards →

Share this update