FreeStory: Training-Free Character Consistency for Free-Form Visual Storytelling

14d ago · Global · primary source: export.arxiv.org

A new training-free framework called FreeStory aims to solve a persistent problem in AI-driven visual storytelling: keeping characters visually consistent when prompts use free-form language instead of rigid, repeated descriptions, according to research posted on arXiv [1]. The work, submitted on June 23, 2026, reformulates character consistency as “entity-grounded feature reuse” [1]. In natural storytelling, a character is typically introduced once and later referenced with pronouns or type-based expressions. Existing training-free methods, which reuse attention features to maintain identity, depend on structured prompts where full character descriptions appear in every line — a condition that diverges from how people actually write narratives [1]. FreeStory addresses the gap by associating reference mentions with their corresponding character descriptions. It combines dynamic character masks, correspondence-aware feature matching, key-value injection, and query blending to preserve identity while retaining generation diversity [1]. The researchers also introduce FreeStoryBench, a benchmark that includes both single- and multi-character stories under free-form prompts [1]. Visual storytelling sits at the intersection of text-to-video generation and narrative theory. Text-to-video models, driven largely by video diffusion models, have advanced rapidly during the 2020s, producing high-quality, text-conditioned videos [2]. The narrative paradigm, a communication theory articulated by scholar Walter Fisher, holds that all meaningful communication occurs through storytelling and that humans naturally understand complex information through narrative [4]. Computational creativity research, meanwhile, seeks to model or simulate human-like creative processes, with one applied branch known as media synthesis [5]. The FreeStory paper appears on arXiv, an open-access repository that hosts preprints across mathematics, physics, computer science, and related fields [9]. As of November 2024, the repository was receiving about 24,000 submissions per month [9]. The platform also supports arXivLabs, a framework enabling community collaborators to build tools such as bibliographic explorers and code-finding services that sit alongside paper abstracts [7][8]. Experiments reported in the paper show that FreeStory achieves state-of-the-art performance among training-free methods on structured benchmarks and delivers stronger overall consistency than baselines when tested under free-form prompts [1]. The authors did not provide numerical metrics in the abstract, and no external validation of the results was available at the time of this report.

research-paperbenchmarktool-release

Background sources we checked (10)
  • en.wikipedia.org ↗ A text-to-video model is a form of generative artificial intelligence that uses a natural language description as input to produce a video relevant to the input text. Advancements during the 2020s in the generation of high-quality, text-conditioned videos have largely been driven…
  • en.wikipedia.org ↗ Hitman 3 is a 2021 stealth game developed and published by IO Interactive. It is the eighth main installment in the Hitman video game series, the sequel to 2018's Hitman 2, and the third game in the World of Assassination trilogy. Concluding the story arc started in 2016's Hitman…
  • en.wikipedia.org ↗ Narrative paradigm is a communication theory conceptualized by 20th-century communication scholar Walter Fisher. The paradigm claims that all meaningful communication occurs via storytelling or reporting of events. Humans participate as storytellers and observers of narratives. T…
  • en.wikipedia.org ↗ Computational creativity (also known as artificial creativity, mechanical creativity, creative computing or creative computation) is a multidisciplinary endeavour that is located at the intersection of the fields of artificial intelligence, cognitive psychology, philosophy, and t…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue