Genie 4 旨在实时模拟互动世界，包括声音和会说话的角色。Gemini 模型在后台规划模拟中接下来会发生什么。目前只有部分测试人员可以尝试这个世界模型。
Google Deepmind 推出了 Genie 4，这是 Genie 3 的继任者，该公司于 2025 年 8 月展示了 Genie 3。该世界模型不生成完整的视频，而是逐帧计算场景，并在过程中对输入做出反应。用户使用键盘在场景中移动，并通过文本提示引导事件。
据 Deepmind 称，Genie 4 是公司首个直接生成声音的实时世界模型。公司表示，每个世界都有其自己的背景音频，例如树间的风声。Genie 4 还处理对话，角色应该彼此交谈，并对用户输入或事件做出实时反应。
Deepmind 认为，该模型在渲染人物方面的真实感提升最大。角色应该自然地移动并对外界环境做出反应，用户应该能够直接控制他们。
Gemini 模型提前规划以保持世界连贯性
据 Deepmind 称，Genie 4 建立在视频模型 Gemini Omni 的能力之上，使世界看起来和行为都符合现实。其他 Gemini 模型有助于规划模拟，以保持其一致性。
如果用户通过文本提示改变天气，Gemini 应该会将指令适应到正在运行的场景中。Deepmind 表示，Gemini 还在输入之间引导事件的发展，使世界以合理的方式持续演变。
Deepmind 用多步骤任务解释了这一过程。Gemini 3.8 Flash 持续观察场景，将目标分解为步骤，并使用新帧来检查每一步是否成功。如果世界发生变化或用户介入，模型会调整其计划。
Deepmind 还在测试 Gemini 4 Argon，将其 Genie 工作与机器人学研究 Gemini Robotics 联系起来。在一个演示中，Argon 将玩跳棋的任务分解为步骤。Genie 4 将这些作为文本指令，并用它们来模拟 Apptronik 的人形机器人 Apollo 玩游戏，没有涉及真正的机器人。
更长的会话仍会使模型出错
Deepmind 称 Genie 4 是一个早期的实验性模型。据该公司称，世界在短时间的会话中保持一致，但在较长的模拟或经过几次复杂的提示更改后，视觉细节可能会发生变化，物体也不总是持久存在。
Deepmind 表示，它仍在研究复杂的物理交互、准确的实时声音以及可读文本。
目前，Genie 4 仅作为研究预览版提供给选定的测试人员。它即将在 Project Genie 网络应用中面向 Google AI Ultra 订阅用户开放，同时也向拥有 Gemini API 和 Google AI Studio 早期访问权限的合作伙伴开放。
Google 表示，所有视频和音轨都将带有其 SynthID 水印，这会对 AI 生成的内容进行不可见的标记。
一旦成熟，世界模型可以作为训练环境，让机器人和 AI 代理从模拟经验中学习，而不仅仅是从数据中学习。Deepmind 认为，将 Gemini 与 Genie 配对是迈向混合世界模型的早期一步，这种模型结合了语言和代码模型的推理能力与像素级模拟。
无炒作的人工智能新闻 – 由人工策划
订阅 THE DECODER，享受无广告阅读、每周 AI 通讯、每年六次的独家 "AI Radar" 前沿报告、完整档案访问权限以及我们的评论区访问权限。
立即订阅
查看原文
Genie 4 is supposed to simulate interactive worlds in real time, including sound and talking characters. Gemini models plan in the background what happens next in the simulation. Only select testers can try the world model for now.
Google Deepmind has introduced Genie 4, the successor to Genie 3, which the company showed in August 2025. The world model doesn't produce finished videos but calculates a scene frame by frame, reacting to input as it goes. Users move through the scene with the keyboard and steer events with text prompts.
According to Deepmind, Genie 4 is the company's first real-time world model that generates sound directly. The company says each world has its own background audio, such as wind in the trees. Genie 4 also handles dialogue, with characters that are supposed to talk to each other and react in real time to user input or events.
Deepmind sees the biggest gain in realism in how the model renders people. Characters are supposed to move naturally and react to their surroundings, and users should be able to control them directly.
Gemini models plan ahead to keep the world coherent
According to Deepmind, Genie 4 builds on capabilities of the video model Gemini Omni so the world looks and behaves realistically. Other Gemini models help plan the simulation to keep it consistent.
If a user changes the weather with a text prompt, Gemini is supposed to adapt the instruction to the running scene. Deepmind says Gemini also steers events between inputs so the world keeps developing in a way that makes sense.
Deepmind explains the process with multistep tasks. Gemini 3.8 Flash watches the scene continuously, breaks a goal into steps, and uses new frames to check whether each step worked. If the world changes or the user steps in, the model adjusts its plan.
Deepmind is also testing Gemini 4 Argon to tie its Genie work to its robotics research, Gemini Robotics. In one demo, Argon breaks the task of playing checkers into steps. Genie 4 gets these as text instructions and uses them to simulate Apptronik's humanoid robot Apollo playing the game, with no real robot involved.
Longer sessions still trip up the model
Deepmind calls Genie 4 an early, experimental model. According to the company, the world stays consistent over short sessions, but visual details can shift and objects don't always persist in longer simulations or after several complex prompt changes.
Deepmind says it's still researching complex physical interactions, accurate real-time sound, and readable text.
For now, Genie 4 is only available to select testers as a research preview. It's set to reach Google AI Ultra subscribers in the Project Genie web app soon, along with partners who have early access to the Gemini API and Google AI Studio.
Google says all videos and audio tracks will carry its SynthID watermark, which invisibly marks AI-generated content.
Once they mature, world models could serve as training environments where robots and AI agents learn from simulated experience rather than just from data. Deepmind sees pairing Gemini with Genie as an early step toward hybrid world models that combine the reasoning of language and code models with pixel-level simulation.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
原文版权归 The Decoder 及原作者所有，本站转载仅供阅读。如需删除，请联系 support@aisa.one。
Studio