Red-Teaming Agent Execution Contexts: Open-World Security Evaluation on OpenClaw

22d ago · Global · primary source: export.arxiv.org

A research team has released DeepTrap, an automated framework designed to uncover security flaws in agentic language-model systems by manipulating their execution contexts rather than user prompts, according to a paper submitted to arXiv on 11 May 2026 [1]. The framework targets OpenClaw, a system that relies on mutable elements such as files, memory, tools, and skills, which the authors argue create attack surfaces beyond direct user input [1]. DeepTrap treats adversarial context manipulation as a black-box trajectory-level optimization problem, balancing risk realization, benign-task preservation, and stealth [1]. It employs risk-conditioned evaluation, multi-objective trajectory scoring, reward-guided beam search, and reflection-based deep probing to identify compromised contexts that can trigger unsafe behavior while maintaining user-facing task completion [1]. The researchers constructed a 42-case benchmark spanning six vulnerability classes and seven operational scenarios [1]. Nine target models were evaluated using attack and utility grading scores [1]. The results indicate that final-response evaluation alone is insufficient for detecting such compromises, and the authors call for execution-centric security evaluation of agentic AI systems [1]. Agentic AI systems differ from narrow models in their ability to generalize knowledge and transfer skills across domains, a capability that companies such as OpenAI, Google, xAI, and Meta have stated as a goal [8]. The DeepTrap findings arrive as the AI industry undergoes rapid consolidation and valuation growth. Anthropic, a San Francisco-based AI safety company, reached an estimated valuation of $965 billion in May 2026, making it the most valuable pure-play AI company globally [6]. Google DeepMind, which merged with Google Brain in April 2023, has been responsible for developing the Gemini family of large language models and other generative tools [7]. The paper, titled "Red-Teaming Agent Execution Contexts: Open-World Security Evaluation on OpenClaw," was submitted by Hongwei Yao and revised on 14 June 2026 [1]. The initial submission was 3,603 KB, with the revised version reduced to 939 KB [1]. The code has been released on GitHub [2].

safety-researchresearch-paperapplicationtool-releasemodel-releasebenchmark

Background sources we checked (7)
  • arxiv.org ↗ Agentic language-model systems increasingly rely on mutable execution contexts, including files, memory, tools, skills, and auxiliary artifacts, creating security risks beyond explicit user prompts. This paper presents DeepTrap, an automated framework for discovering contextual v…
  • en.wikipedia.org ↗ This is a list of wars involving the Islamic Republic of Iran, excluding its predecessor states. It is an unfinished historical overview.…
  • en.wikipedia.org ↗ Donald Trump's second and current tenure as the president of the United States began upon his inauguration as the 47th president on January 20, 2025. Trump, a Republican, previously served as the 45th president from 2017 to 2021. He lost re-election to Democratic nominee Joe Bide…
  • en.wikipedia.org ↗ This is an incomplete list of United States Department of Defense code names primarily the two-word series variety. Officially, Arkin (2005) says that there are three types of code name: Nicknames – a combination of two separate unassociated and unclassified words (e.g. Polo and…
  • en.wikipedia.org ↗ Anthropic PBC is an American artificial intelligence (AI) company headquartered in San Francisco, California. It has developed a series of large language models (LLMs) named Claude and has a focus on AI safety. Anthropic was founded in 2021 by former members of OpenAI, including …
  • en.wikipedia.org ↗ Google DeepMind, trading as Google DeepMind or simply DeepMind, is a British-American artificial intelligence (AI) research laboratory which serves as a subsidiary of Alphabet Inc. Founded in the UK in 2010, it was acquired by Google in 2014 and merged with Google AI's Google Bra…
  • en.wikipedia.org ↗ Artificial general intelligence (AGI) is a hypothetical type of artificial intelligence that matches or surpasses human capabilities across virtually all cognitive tasks. Beyond AGI, artificial superintelligence (ASI) would outperform the best human abilities across every domain …

Sources

Spot something wrong? Report an issue