Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving

28d ago · Global · primary source: export.arxiv.org

A new self-supervised framework called Envision4D can forecast future driving scenes without requiring pre-set camera poses, according to a paper posted to the arXiv preprint server [1]. The method uses a feed-forward design to extrapolate dynamic environments frame by frame [2]. The paper, submitted on June 9, 2026, describes a system built to address a persistent problem in autonomous-driving research: existing feed-forward models are tuned for interpolation between known frames and produce ghosting artifacts when asked to predict farther into the future [2]. Envision4D tackles this by introducing a Future Pose Prediction module that infers upcoming camera parameters through an iterative denoising process, removing the need for fixed pose priors [2]. To handle the non-linear motion of vehicles, pedestrians, and cyclists, the authors added In-layer Temporal Attention and a technique called Conditioned Motion Lifting. The latter recasts the uncertain extrapolation task as a set of relational mappings, which the paper states leads to more stable predictions [2]. A Progressive Training Strategy is also used to keep unsupervised motion learning from drifting as errors accumulate over longer time horizons [2]. The framework is fully self-supervised, meaning it learns directly from raw video without annotated ground-truth poses or depth maps [2]. In experiments reported in the preprint, Envision4D achieved state-of-the-art results on future view synthesis, outperforming prior methods by a significant margin [2]. arXiv, where the work appears, is an open-access repository that hosts electronic preprints across physics, computer science, mathematics, and related fields [6]. Papers on the site are moderated but not peer-reviewed before posting [6]. As of late 2024, the repository was receiving roughly 24,000 new articles per month and had surpassed two million total submissions by the end of 2021 [6]. The platform also supports community-built tools through its arXivLabs program, which lets third-party developers offer features such as citation explorers and code-finding widgets directly on abstract pages [5]. No external funding or institutional affiliations were disclosed in the preprint abstract, and the research has not yet appeared in a peer-reviewed journal [1].

applicationresearch-paperbenchmarktool-release

Background sources we checked (7)
  • arxiv.org ↗ Forecasting the future evolution of dynamic scenes is crucial in autonomous driving. However, existing feed-forward paradigms are primarily designed for interpolation. When extended to future extrapolation, they suffer from ghosting artifacts under large displacements and are con…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository [...] # arXivLabs: Showcase [...] arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. [...] While the arXiv team is focused on our core miss…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …

Sources

Spot something wrong? Report an issue