Today, we’re announcing our research on Genie 4, our new world model that brings unprecedented realism and native audio to real-time interactive simulation.
The Genie 4 model incorporates and builds on capabilities from the Gemini family: Gemini Omni anchors simulations in real-world appearance and behavior, while other Gemini models provide the complex reasoning needed to help maintain a simulation’s coherence and continuity.
With Genie 4, you can set an event in motion and steer scenes in real time using natural language, like moving the camera, changing the weather, or introducing new characters. Every world also generates native audio on the fly, including ambient sounds, music, and interactive dialogue.
Simulating the world is a crucial step toward AGI, enabling safe training environments for robots and agents, and amplifying creative tools across industries like filmmaking, journalism, gaming, and manufacturing.
We have started rolling out Genie 4 to a limited group of trusted testers. It’s coming soon to Google AI Ultra subscribers in Project Genie and early access partners in the Gemini API and AI Studio.
Explore the demos on the Google DeepMind blog.
