- World modelWorld Model
- An internal AI simulator that learns the state and dynamics of an environment and predicts the future as time passes and actions are taken.
- World foundation modelWFM
- A general-purpose world model pretrained on large-scale data and fine-tuned for many tasks. A term popularized by NVIDIA when it introduced Cosmos.
- Physical AIPhysical AI
- AI that perceives the physical world and acts in it, like robots and self-driving cars.
- Embodied AIEmbodied AI
- AI that has a body (sensors and actuators) and learns and acts by interacting with its environment.
- Latent state · latent spaceLatent state / space
- An abstract numerical representation obtained by compressing observations (pixels and so on). World models mostly predict the future in this space.
- Action-conditionedAction-conditioned
- The property of taking an action as input and predicting its result. The key criterion separating world models from video-generation models.
- Latent actionLatent action
- A “virtual control input” inferred from frame changes in video that has no action labels. Introduced by Genie 1.
- JEPAJoint Embedding Predictive Architecture
- An architecture proposed by LeCun. It does not reconstruct pixels, but predicts the “representation” of masked parts or the future in an abstract space.
- Self-supervised learningSelf-supervised learning
- Learning by hiding part of the data itself and guessing it, without labels attached by people.
- Autoregressive diffusionAutoregressive diffusion
- A generation method that produces high-quality frames one chunk at a time with a diffusion model and chains the chunks sequentially. The mainstream of real-time interactive models.
- RolloutRollout
- Unrolling several steps of the future by continuous prediction with a world model.
- Imagination trainingImagination training
- Training an agent with reinforcement learning inside virtual experience produced by a world model instead of a real environment (the Dreamer family).
- Model predictive controlMPC
- A method that simulates candidate actions with a model, picks the action with the best result and replans at every moment.
- Promptable world eventsPromptable world events
- A Genie 3 feature. Inserts events such as weather changes or a character’s appearance into a running world by text.
- Gaussian splatting3D Gaussian Splatting
- A 3D technique that represents a scene with millions of semi-transparent ellipsoidal particles. Fast realistic rendering. Marble’s output format.
- Collision meshCollision mesh
- A simplified 3D shape built so a physics engine can compute collisions.
- Sim-to-Real
- Carrying abilities learned in a virtual environment into a real one. The performance difference between the two is called the “gap.”
- Digital twinDigital twin
- A virtual replica of an actual factory, city or facility.
- VLAVision-Language-Action model
- A model that takes vision and language instructions and outputs robot actions. Trained and evaluated in combination with world models.
- Closed-loop evaluationClosed-loop evaluation
- Evaluation that runs an AI to the end inside a simulator so its actions feed into the next input. Closer to reality than replaying recorded data (open loop).
- Counterfactual scenarioCounterfactual
- Simulating “what if I had acted differently then?” Central to validating autonomous driving.
- Inductive biasInductive bias
- The built-in assumptions a model leans on when generalizing to new data. Vafa et al. used it to test whether a model learned the “law.”
- Spatial intelligenceSpatial intelligence
- A concept Fei-Fei Li stresses. The ability to perceive, reason about and generate 3D space and act within it.