Introducing Lyra 2.0, NVIDIA's latest tech that transforms an image into an explorable 3D world
, by Enzo
Transform a single image into a 3D world you can explore. That’s the promise of Lyra 2.0, NVIDIA’s new technology. It’s an AI-based framework that combines video generation and 3D reconstruction to create coherent virtual worlds.
Let’s delve into some slightly more technical concepts. The most interesting advancement with this technology is that it addresses two long-standing shortcomings in AI: spatial forgetting (inconsistencies in structures) and temporal drift (the accumulation of visual errors).
This new model uses a spatial memory system that retrieves relevant historical images, but also draws on its own imperfect models to correct them and learn from them.
Medias
