Fast LeWorldModel

13d ago · Global · primary source: export.arxiv.org

A new latent world model called Fast LeWorldModel accelerates visual planning by replacing the step-by-step simulation used in its predecessor with a parallel action-prefix prediction method, according to a paper submitted to arXiv on 24 Jun 2026 [1]. The predecessor, LeWorldModel, belongs to a family of Joint-Embedding Predictive Architectures that build internal representations of environments without reconstructing raw images [1][2]. World models of this kind simulate dynamics such as physics and object interactions, allowing artificial agents to plan actions without constant real-world trial and error [6]. LeWorldModel evaluates candidate action sequences through an autoregressive rollout, applying a local one-step latent transition model repeatedly [1][3]. This approach becomes computationally expensive and exposes predicted trajectories to accumulating latent errors as the planning horizon lengthens [1][4]. Fast LeWorldModel addresses those limitations by encoding action prefixes and predicting the future latent states reached after executing those prefixes, all in a single parallel forward pass [2][5]. The model uses an action-prefix encoder with a causal mask to convert a candidate action sequence into multiple prefix tokens, where each token summarizes a partial sequence together with the current latent context [3][5]. A parallel latent predictor then maps the current latent and all prefix tokens to their corresponding future latents simultaneously [3][5]. Dense prefix-level supervision ties each prefix token to the future latent reached after executing the corresponding partial action sequence, forcing the model to learn how states continuously evolve under different action prefixes rather than only fitting one-step transitions [2][3]. During planning, the predictor can use the last prefix token from the encoded action sequence to evaluate the corresponding future latent without explicitly rolling through each intermediate imagined state [1][4]. Across multiple tasks, Fast LeWorldModel improved average success over LeWorldModel while substantially reducing planning time [1][2]. It also achieved lower open-loop latent loss, with loss growth becoming significantly slower as the rollout horizon increased [1][4]. The paper was posted on arXiv, a repository that provides rapid dissemination of research findings at no cost to readers and submitters [10].

research-paper

Background sources we checked (10)
  • arxiv.org ↗ Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step …
  • arxiv.org ↗ Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step …
  • huggingface.co ↗ Paper page - Fast LeWorldModel ... # Fast LeWorldModel ... Fast-LeWM accelerates visual planning by replacing autoregressive rollout with parallel action-prefix prediction, reducing computational costs and latency accumulation during long-horizon predictions. ... Joint-Embedding …
  • arxiv.org ↗ Joint-Embedding Predictive Architectures (JEPAs), including recent LeWorldModel (LeWM), have become a promising foundation for reconstruction-free visual world models. For visual planning, however, LeWM evaluates candidate action sequences by repeatedly applying a local one-step …
  • en.wikipedia.org ↗ A world model in artificial intelligence is a machine learning system that builds an internal representation of an environment. The model predicts how that environment changes over time in response to actions. Researchers design world models to help agents plan, reason, and act w…
  • en.wikipedia.org ↗ In artificial intelligence, a foundation model (FM), also known as large x model (LxM, where "x" is a variable representing any text, image, sound, etc.), is a machine learning or deep learning model trained on vast datasets so that it can be applied across a wide range of use ca…
  • en.wikipedia.org ↗ VinFast Auto Ltd. is a Vietnamese multinational automotive manufacturer established in 2017 in Hải Phòng, Vietnam, as a subsidiary of Vingroup, one of the largest private conglomerates in Vietnam, founded by billionaire Phạm Nhật Vượng. It is the first Vietnamese automaker to sel…
  • en.wikipedia.org ↗ In machine learning, diffusion models, also known as diffusion-based generative models or score-based generative models, are a class of latent variable generative models. A diffusion model consists of two major components: the forward diffusion process, and the reverse sampling p…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…

Sources

Spot something wrong? Report an issue