Breaking

Google Unveils Magenta RealTime 2, an AI You Can Play Like an Instrument

June 4, 2026 at 15:36 EDT

On June 4, 2026, Google introduced Magenta RealTime 2, an open-weights model for low-latency live music synthesis controllable via MIDI, text, and audio. It runs natively on a MacBook and is positioned as an AI you can "play" as an instrument. Following the announcement from the Gemma account, Google DeepMind's Omar Sanseviero and Jesse Engel shared further details (the announcement and Sanseviero's post).

June 4, 2026 · Google DeepMind

Magenta RealTime 2: an AI you can play like an instrument

Open-weights, low-latency live music synthesis — controllable via MIDI, text, and audio — now running natively on a MacBook in real time, generating 48kHz stereo audio.

~2s

max control latency

15×

lower latency vs. version 1

48kHz

stereo audio, streamed continuously

15× lower latency than version 1

Control response — the wait between your input and the music reacting (shorter is better).

Magenta RealTime 1~30s

Magenta RealTime 2~2s

From lab demo to stage-ready: the gap drops far enough to "play" the model live.

Base model

2.4B params

High-quality. Runs in real time on M3 Pro / M2 Max or better.

Small model

230M params

Lightweight. Runs on nearly all Apple Silicon — even the MacBook Air.

Three ways to control it

MIDI

play & improvise live

Text

blend styles by prompt

Audio

live signal input

→

Live music

continuous streaming

Why it stands apart

Playable low-latency streaming + open weights + local Mac operation is currently unmatched — unlike cloud generators (Suno/Udio) or voice-conversion tools (RVC/So-VITS).

"Neural synthesis just moved from the lab to the stage." — early reaction

Continue reading

The rest of this article is for AI News Blitz readers. Choose an option below to keep reading.