AdaSTORM: Scaling LLM Reasoning on Dynamic Graphs via Adaptive Spatio-Temporal Multi-Agent Collaboration
- lab arXiv
- lab arXivLabs
- person Sam Altman
A new framework called AdaSTORM enables large language models to reason over dynamic graphs containing thousands of nodes, a scale far beyond the tens of nodes that current models can handle, according to research posted to the arXiv preprint server on June 15 [1][2]. Large language models, or LLMs, are machine learning models trained on vast text corpora for tasks such as language generation [8]. Their application to dynamic graph reasoning has been constrained by exponential reasoning overhead and finite context windows, limiting them to graphs with tens of nodes [2]. The new paper introduces AdaSTORM, which stands for Scaling LLM Reasoning on Dynamic Graphs via Adaptive Spatio-Temporal Multi-Agent Collaboration [1][2]. The framework reformulates large-scale dynamic graph reasoning into two stages. The first, Adaptive Partitioning, divides large-scale dynamic graphs into subregions matched to the model’s reasoning capacity while minimizing inference cost. The second, Collaborative Reasoning, aligns graph partition topologies with a spatio-temporal decoupled multi-agent architecture [1][2]. The authors describe AdaSTORM as the first multi-agent framework tailored for dynamic graph reasoning [2]. In experiments, AdaSTORM scaled reasoning to thousand-node graphs with over 90% accuracy across several large-scale dynamic graph settings, without relying on external tools [1][2]. It outperformed seven competitive baselines, achieved state-of-the-art accuracy on existing benchmarks, and generalized robustly to real-world datasets [1][2]. The source code has been made available on GitHub [2]. The paper was submitted to arXiv’s artificial intelligence section. arXiv is an open-access repository of electronic preprints, founded in 1991, that hosts scientific papers across mathematics, physics, computer science, and related fields [6]. As of November 2024, the repository receives about 24,000 new articles per month [6]. Papers on arXiv are moderated but not peer-reviewed [6]. The AdaSTORM preprint appears alongside a suite of experimental community tools offered through arXivLabs, a framework that allows collaborators to develop and share features such as bibliographic explorers and code finders directly on the abstract page [4][5].
applicationresearch-papertool-releasemodel-releaseproduct-launchbenchmarkinfrastructure
Background sources we checked (7)
- arxiv.org ↗ Large Language Models (LLMs) demonstrate remarkable potential in dynamic graph reasoning, but suffer from a scaling bottleneck: current models can only handle graphs with tens of nodes, constrained by exponential reasoning overhead and finite context windows. While multi-agent sy…
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…