Google DeepMind's Genie 2 can generate interactive 3D worlds

Engadget 05.12.2024 21:20 World models — AI algorithms capable of generating a simulated environment in real-time — represent one of the more impressive applications of machine learning. In the last year, there’s been a lot of movement in the field, and to that end, Google DeepMind announced Genie 2 on Wednesday. Where its predecessor was limited to generating 2D worlds, the new model can create 3D ones and sustain them for significantly longer. Genie 2 isn’t a game engine; instead, it’s a diffusion model that generates images as the player moves through the world the software is simulating. As it generates frames, Genie 2 can infer ideas about the environment, giving it the capability to model water, smoke and physics effects — though some of those interactions can be very gamey. The model is also not limited to rendering scenes from a third-person perspective, it can also handle first-person and isometric viewpoints. All it needs to start is a single image prompt, provided either by Google’s own Imagen 3 model or a picture of something from the real world. Introducing Genie 2: our AI model that can create an endless variety of playable 3D worlds - all from a single image.

Číst celý článek >>