Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents
- lab CatalyzeX
- lab DagsHub
- lab GotitPub
- lab Hugging Face
- lab ScienceCast
- lab alphaXiv
- lab arXiv
- lab arXivLabs
Researchers have introduced a stakeholder-centric benchmark to assess how web agents powered by large language models distribute harm when they fall victim to prompt-injection attacks, moving beyond conventional evaluations that focus solely on technical feasibility [1][2]. The benchmark, detailed in a paper submitted on 11 Jun 2026, is designed to systematically categorize and attribute harm across different affected entities such as users, sellers, and platforms [1][2]. Existing security evaluations adopt an attack-centric perspective, concentrating on whether an injection is technically possible while overlooking the nuanced distribution of resulting harms [2]. In practice, the researchers argue, prompt-injection risk is victim-dependent: a single exploit can produce asymmetric consequences for different stakeholders, and the same attack pattern may exhibit substantially different effectiveness depending on whom it targets [2]. The evaluation framework decomposes attacks into concrete objectives and applies complementary outcome- and process-level metrics [2]. Results reveal substantial and heterogeneous vulnerabilities across current agents. Not a single attack objective was reliably resisted, and failures distributed across qualitatively distinct modes [2]. These modes include stealthy parasitism, where an attack succeeds without disrupting the user's delegated task; misaligned disruption, where the task is disrupted without the attack succeeding; and compounded failure, in which both the adversarial objective and task integrity are simultaneously violated [2]. The findings highlight a gap in conventional evaluation methods, which miss these patterns of harm distribution [2]. The benchmark is publicly available on GitHub [2]. The work underscores the need for stakeholder-aware assessment as LLM-based agents are increasingly deployed in real-world environments where they operate over untrusted web content and execute actions with direct consequences [2].
research-paperapplicationsafety-researchbenchmarkmodel-releaseproduct-launchcontroversytool-releasecommentary
Background sources we checked (8)
- arxiv.org ↗ Web agents driven by large language models (LLMs) are increasingly deployed in real-world environments, where they operate over untrusted web content and execute actions with direct consequences. This makes them vulnerable to prompt-injection attacks, in which seemingly benign co…
- en.wikipedia.org ↗ Oil sands are a type of unconventional petroleum deposit. They are either loose sands, or partially consolidated sandstone containing a naturally occurring mixture of sand, clay, and water, soaked with bitumen (a dense and extremely viscous form of petroleum). Significant bitumen…
- en.wikipedia.org ↗ An informal economy (informal sector or grey economy) is the part of any economy that is neither taxed nor monitored by any form of government. Although the informal sector makes up a significant portion of the economies in developing countries, it is sometimes stigmatized as tro…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
- en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…
- en.wikipedia.org ↗ In molecular biology, a transcription factor (TF) (or sequence-specific DNA-binding factor) is a protein that controls the rate of transcription of genetic information from DNA to messenger RNA, by binding to DNA sequences. Specificity can be due to sequence motifs, or epigenetic…
Sources covering this (3)
- export.arxiv.org — Who Pays the Price? Stakeholder-Centric Prompt Injection Benchmarking for Real-world Web Agents ↗
- export.arxiv.org — Defending against Adaptive Prompt Injection Attacks via Reasoning-enabled Task Alignment · Global
- export.arxiv.org — MUZZLE: Adaptive Agentic Red-Teaming of Web Agents Against Indirect Prompt Injection Attacks · Global