Memento: Reconstruct to Remember for Consistent Long Video Generation

23d ago · Global · primary source: export.arxiv.org

Multi-source synthesis by The Embedding Report from 2 sources. Every numeric and quoted claim traces to a cited source body (see methodology).

Researchers have proposed two new methods for generating consistent long videos and cardiac sequences, improving upon existing techniques in terms of subject consistency and visual quality.

The first method, called Memento, is a framework for consistent long video generation by preserving subject identity across shots and scene transitions[1]. Memento treats subject preservation as an explicit identity grounding problem and jointly trains autoregressive next-shot generation with memory-based subject reconstruction. It introduces a dual-query memory mechanism to disentangle long-range subject evidence from short-range cues. According to the researchers, Memento achieves state-of-the-art performance in long-term subject consistency, cross-shot coherence, and visual quality. A second, separate research effort proposes a generative method for synthesizing temporally coherent and anatomically consistent cardiac sequences. This method decouples cardiac spatial structure from temporal motion and generates diverse sequences with high temporal coherence and strong fidelity to input prompts[2]. The model achieves a FID of 31.68 for image realism and a CLIP score of 31.04 for text-image alignment.

research-paperbenchmarktool-release

Background sources we checked (2)
  • arxiv.org ↗ Long-form video generation requires recurring subjects to remain consistent across various shots, viewpoints, motions, and scene transitions. Existing temporal decomposition methods improve scalability by generating videos shot by shot. However, they mainly focus on optimizing pl…
  • en.wikipedia.org ↗ Mariano Rivera (born November 29, 1969) is a Panamanian-American former professional baseball player who was a pitcher for 19 seasons in Major League Baseball (MLB) for the New York Yankees, from 1995 to 2013. Nicknamed "Mo" and "Sandman", he spent most of his career as a relief …

Sources cited (2)

  1. arxiv.org ↗ E
  2. arxiv.org ↗ E
Spot something wrong? Report an issue