RESEARCH PAPERYear 2024

Genie: Generative Interactive Environments

View all authors

Jake Bruce; Michael D Dennis; Ashley Edwards; Jack Parker-Holder; Yuge Shi; Edward Hughes; Matthew Lai; Aditi Mavalankar; Richie Steigerwald; Chris Apps; Yusuf Aytar; Sarah Maria Elisabeth Bechtle; Feryal Behbahani; Stephanie C.Y. Chan; Nicolas Heess; Lucy Gonzalez; Simon Osindero; Sherjil Ozair; Scott Reed; Jingwei Zhang; Konrad Zolna; Jeff Clune; Nando De Freitas; Satinder Singh; Tim Rocktäschel

Read paper PDF

Classification

View four quadrants

Major category: Benchmarks & simulators
Quadrant: Not applicable
Architecture: Not applicable
Prediction paradigm: Not applicable
Subcategories: Neural world simulators Latent action pretraining
Source review status: Verified from primary sources

Category review. Genie assembles a video tokenizer, latent-action model and dynamics transformer into an interactive learned environment. At interaction time the user chooses latent codes and the model generates frames; the separately calibrated imitation experiment does not turn the general simulator into a canonical encoder/backbone. Reading evidence

AT A GLANCE

Contribution

A contribution summary has not been added yet.

Abstract

An abstract has not been added yet.

Affiliations

Not listed in the collection.

BibTeX

@inproceedings{genie,
  author       = {Jake Bruce and
                  Michael D. Dennis and
                  Ashley Edwards and
                  Jack Parker{-}Holder and
                  Yuge Shi and
                  Edward Hughes and
                  Matthew Lai and
                  Aditi Mavalankar and
                  Richie Steigerwald and
                  Chris Apps and
                  Yusuf Aytar and
                  Sarah Bechtle and
                  Feryal M. P. Behbahani and
                  Stephanie C. Y. Chan and
                  Nicolas Heess and
                  Lucy Gonzalez and
                  Simon Osindero and
                  Sherjil Ozair and
                  Scott E. Reed and
                  Jingwei Zhang and
                  Konrad Zolna and
                  Jeff Clune and
                  Nando de Freitas and
                  Satinder Singh and
                  Tim Rockt{\"{a}}schel},
  title        = {Genie: Generative Interactive Environments},
  booktitle    = {ICML},
  pages        = {4603--4623},
  year         = {2024},
}

Classification

Contribution

Abstract

Affiliations

BibTeX

More in this category

Programmable World Model

FolDeX: A Physical-World Benchmark for Long-Horizon Robotic Manipulation of Deformable Objects

TourPhysics: Bringing Physics to World Models for Exploration and Manipulation from a Single Image