Odyssey’s Innovative AI Model Enables Streaming of 3D Interactive Worlds

Odyssey, a startup founded by self-driving technology pioneers Oliver Cameron and Jeff Hawke, has unveiled a groundbreaking AI model that allows users to interact with streaming video in a 3D environment. Currently available in an early demo on the web, this model generates and streams video frames at an impressive rate of every 40 milliseconds. Users can manipulate basic controls to navigate through areas of the video, akin to exploring a 3D-rendered video game.

The AI model is designed to predict the next state of a virtual environment based on a given action and a history of past events. It possesses a world model that is capable of creating realistic pixel generation, maintaining spatial consistency, learning actions from video inputs, and producing coherent video streams that last five minutes or longer.

Odyssey acknowledges the growing interest in world models among startups and major tech players like DeepMind, Microsoft, and others, believing that these technologies could be pivotal in creating interactive media like games and films. However, concerns linger among creatives regarding AI’s impact on job security in the industry.

In light of this, Odyssey is committed to working in collaboration with creative professionals rather than replacing them. The company envisions a future where all video content—spanning entertainment, ads, education, and more—evolves into interactive formats fueled by its AI technology.

Despite its potential, Odyssey’s demo currently shows signs of instability, with environments appearing blurry and layouts changing unpredictively. Nevertheless, the startup is dedicated to refining its model, aiming for better visual quality and user interactions.

Utilizing a unique backpack-mounted 360-degree camera system, Odyssey captures real-world landscapes to train its AI models, which they believe will yield superior quality compared to models derived solely from publicly available data. With nearly $27 million raised from various investors, including GV and EQT Ventures, Odyssey is positioned for continued innovation in creating interactive experiences.

As the technology progresses, Odyssey is exploring richer representations of virtual environments and expanding the range of interactive actions that users can perform, further enhancing user engagement in interactive narratives.