SkillCAT: Contrastive Assessment and Topology-Aware Skill Self-Evolution for LLM Agents

26d ago · Global · primary source: export.arxiv.org

A new framework called SkillCAT allows large language model agents to improve their own capabilities without additional training, according to a paper submitted to arXiv on 11 Jun 2026 [1]. The system organizes learned skills into a routable topology, boosting benchmark scores by up to 40.40% over baseline methods [2]. SkillCAT separates the skill self-evolution process into three stages: Contrastive Causal Extraction, Assessment-Augmented Evolution, and Topology-Aware Task Execution [1]. The framework is designed to address limitations in current pipelines, which typically learn from a single trajectory per task, merge candidate skill patches before verification, and load an entire skill corpus prior to inference [2]. In the first stage, Contrastive Causal Extraction samples multiple trajectories for each task and compares successful and failed attempts on the same task to isolate evidence that explains the difference in outcomes [2]. The second stage, Assessment-Augmented Evolution, replays each candidate skill patch on clones of the source task and retains only those patches that improve or preserve task results before performing a hierarchical merge [2]. The final stage, Topology-Aware Task Execution, compiles the evolved skills into a routable sub-skill topology so that inference loads only the capability nodes relevant to the current task [2]. The researchers evaluated SkillCAT on common agent benchmarks including SpreadsheetBench, WikiTableQuestions, and DocVQA, and also tested cross-model and out-of-distribution generalization [2]. Across these settings, SkillCAT raised the average score over baselines by up to 40.40% [2]. The paper was posted on arXiv, an open-access repository of electronic preprints that, as of November 2024, receives about 24,000 submissions per month and hosts over two million articles [7]. The work appears under the Computation and Language category [1]. Large language models, the underlying technology for these agents, are neural networks trained on vast text corpora for tasks such as generation, summarization, and translation [9]. Benchmark evaluations for such models typically measure reasoning, factual accuracy, and safety [9]. The SkillCAT framework does not require model training, instead relying on trajectory replay and topological routing to achieve reliable skill evolution [2].

applicationresearch-paperinfrastructuretool-release

Background sources we checked (8)
  • arxiv.org ↗ Skill self-evolution methods for LLM agents aim to turn execution trajectories into reusable skill documents, but current pipelines typically learn from one trajectory per task, merge candidate skill patches before checking them, and load the full skill corpus before inference. W…
  • en.wikipedia.org ↗ This article presents a detailed timeline of events in the history of computing from 2020 to the present. For narratives explaining the overall developments, see the history of computing. Significant events in computing include events relating directly or indirectly to software, …
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository [...] # arXivLabs: Showcase [...] arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. [...] While the arXiv team is focused on our core miss…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …

Sources

Spot something wrong? Report an issue