VideoWeave: Unlocking Geometric Consistency in Video Generation via Joint Geometry-Video Modeling

23d ago · Global · primary source: export.arxiv.org

A new post-training framework called VideoWeave aims to reduce geometric drift in AI-generated video by jointly modeling appearance and implicit geometry features in a shared denoising space, according to a paper submitted in 2026 [1]. Large-scale video diffusion models frequently fail to preserve 3D structure over time, producing implausible motion when the viewpoint changes [1]. Existing approaches often rely on explicit geometry reconstructions — depth maps, point clouds, or reconstructed 3D structures — to provide conditions or supervision signals, but this makes the generator sensitive to errors from upstream geometry pipelines [1]. VideoWeave instead adapts implicit geometry-model features into geometry latents and jointly models them with video latents, allowing geometry to shape the generative distribution during training without rigid reconstruction constraints [1]. The framework is designed as a post-training module that can be applied to existing video generation models [1]. To support the method, the authors built GeoVid-80K, a dataset of 80,000 videos with paired appearance and geometry representations [1]. Experiments on text-to-video and image-to-video generation showed that VideoWeave improves geometric coherence while preserving strong visual quality [1]. The work arrives as major AI laboratories continue to advance generative video models. Google DeepMind, for instance, has developed the text-to-video model Veo as part of its broader generative AI portfolio, alongside the text-to-image model Imagen and the Gemini family of large language models [3]. The VideoWeave paper was submitted to arXiv on 12 June 2026 [1].

tool-releaseresearch-paper

Background sources we checked (7)
  • arxiv.org ↗ Large-scale video diffusion models often fail to preserve 3D structure over time, causing geometric drift and implausible motion under viewpoint changes. Existing methods usually enforce geometric consistency by using explicit geometry reconstructions, such as depth maps, point c…
  • en.wikipedia.org ↗ Google DeepMind, trading as Google DeepMind or simply DeepMind, is a British-American artificial intelligence (AI) research laboratory which serves as a subsidiary of Alphabet Inc. Founded in the UK in 2010, it was acquired by Google in 2014 and merged with Google AI's Google Bra…
  • arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
  • arxiv.org ↗ With the creation of new datasets, the question arises of whether the data in them is complementary to other datasets for training ML models (see recent reviews for a perspective of catalysts informatics22, 23, 24). This is especially important when consolidating data with a vari…
  • arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
  • en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…
  • en.wikipedia.org ↗ In molecular biology, a transcription factor (TF) (or sequence-specific DNA-binding factor) is a protein that controls the rate of transcription of genetic information from DNA to messenger RNA, by binding to DNA sequences. Specificity can be due to sequence motifs, or epigenetic…

Sources covering this (2)

Spot something wrong? Report an issue