0:00
/
Generate transcript
A transcript unlocks clips, previews, and editing.

World Models: From Pixels to Physics w/ SpAItial CEO Matthias Neissner

The what, how, why of world models

Apple Podcast Link

Spotify Podcast Link


Today’s episode is brought to you by… Bifrost.AI

Bifrost is a leading simulation and evaluation platform for Physical AI.

Their platform helps robotics teams build high-fidelity simulations, test models against the edge cases that are hard to capture in the real world, and generate perfectly labeled synthetic data along the way.

If you’re building robots and want to understand where your model fails before it reaches the field, visit bifrost.ai.


World models have become the most hyped frontier in AI, and for good reason: the technology is reaching a tipping point, it’s attracting some of the world’s best AI talent, and many believe world models could be the unlock for both AGI and general-purpose robotics.

But if you ask five people what a “world model” actually is, you’ll get five different answers.

That’s because there isn’t one approach.

There’s a whole spectrum of world models being built today, each trying to understand and simulate the physical world in different ways; from video models that generate pixels, to 3D spatial models, to systems learning physics and cause and effect in latent space.

To wade through the ambiguity, I sat down with Matthias Niessner, CEO of SpAItial, a London + Munich based startup building one of the leading world models for physical AI.

In this episode, we get into why video models may be hitting a wall, the spectrum of approaches from pixel-first models to pure latent-space representations, how world models are actually trained, and the critical difference between worlds that “look right” and worlds that “behave right.”

We also explore what happens when these models begin to understand real physics, how they could dramatically improve robotics simulation and close the sim-to-real gap, and how close we may actually be to generating realistic virtual environments where robots can learn before ever entering the real world.

I learned a ton in this episode and walked away even more optimistic about how quickly we may be approaching general-purpose robotics.

So with that, I bring you Matthias Niessner.

Discussion about this video

User's avatar

Ready for more?