Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents
- lab arXiv
- lab arXivLabs
- location arXiv
- model GPT-4o
- person Dehao Tao
- product DagsHub
- product Hugging Face
- product LoCoMo
A new memory architecture called Membox organizes long-running AI dialogues by topic continuity rather than isolated turns, yielding substantial retrieval gains over existing systems, according to a paper posted on arXiv [1]. The work, authored by Dehao Tao and colleagues, introduces a hierarchical design that treats topic continuity as an explicit organizational layer for agent memory [1]. The system’s Topic Loom incrementally groups dialogue streams into boxes whose internal turns follow the same local topic, while a second component, the Trace Weaver, links extracted events across boxes into macro-topic traces that recover recurring activities, goals, and factual developments across distant sessions [1]. The paper argues that many current LLM agent memory systems first decompose histories into isolated turns or fixed-size chunks, then rely on enrichment, consolidation, or retrieval mechanisms still tied to semantic proximity or fragment-level records [1]. This approach, the authors write, “weakens temporal and causal organization and biases memory access toward semantic proximity rather than task- or topic-level continuity” [1]. On the LoCoMo dataset, Topic-Loom-only retrieval improved over the best Mem0/A-MEM retrieval-depth setting by 13.00 F1 points, reaching 53.95 F1 compared with 40.95 [1]. When trace-expanded retrieval was added, the score rose to 55.28 [1]. With GPT-4o, trace-expanded retrieval reached 59.71 F1 [1]. Additional experiments on the DialSim dataset showed the same gain from adding cross-box traces in multi-party dialogue [1]. The paper was submitted to arXiv on January 7, 2026, and revised most recently on June 24, 2026 [1]. arXiv, an open-access repository of electronic preprints and postprints, was founded in 1991 and now receives about 24,000 submissions per month as of November 2024 [6]. The platform hosts papers across mathematics, physics, computer science, and related fields, and its content is moderated but not peer-reviewed [6]. The Membox paper appears with experimental tools provided through arXivLabs, a framework launched in 2020 that allows community collaborators to develop and share features directly on the arXiv site [4]. arXivLabs projects include bibliographic explorers, code-and-data linkers, and recommender systems, all governed by guidelines that emphasize openness, community, excellence, and user data privacy [4][5]. The framework is currently on hiatus for new proposals while the arXiv development team focuses on modernizing and migrating systems to the cloud [3].
applicationmodel-releaseresearch-paper
Background sources we checked (7)
- arxiv.org ↗ Long-term human-agent dialogues are organized by topic continuity: adjacent turns often develop the same goal, plan, problem, or event, while related activities may recur across distant sessions. Yet many LLM agent memory systems first decompose histories into isolated turns or f…
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…
Sources
- export.arxiv.org — Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents ↗