ERTS: Adversarial Robustness Testing of Ethical AI via Semantic Perturbation in a Bounded Consequence Space

26d ago · Global · primary source: export.arxiv.org

A new adversarial testing framework called ERTS evaluates whether AI systems can maintain ethical reasoning under deliberate manipulation, according to a paper posted to the arXiv preprint repository. Only one-third of the models tested passed the assessment [1]. The Ethical Robustness Testing System, introduced in a paper submitted June 11, 2026, encodes ethical dilemmas into a 22-dimensional Ethical Consequence Space grounded in established ethical theory [1][2]. It then applies 17 semantic perturbation functions, which are governed by 6 validity constraint classes, including a novel semantic coherence constraint [1][2]. The framework measures how far a model’s decisions deviate under attack using a 4-component Ethical Instability Index [1][2]. Researchers evaluated four structured baseline models and two production large language models — Gemini 2.0 Flash and Llama 3.2 — across 50 ethical scenarios spanning eight deployment domains, generating 1,500 adversarial test cases [1][2]. Large language models are neural networks trained on vast text corpora and serve as the foundation for modern chatbots, though biased or inaccurate training data can undermine their reliability [8]. Only 33 percent of the models achieved assessment clearance [1][2]. The local Llama-3.2 model showed particular vulnerability to fairness corruption and information degradation attacks, recording an evaluation result of 0.737 [1][2]. The paper states that no existing framework combines a bounded ethical consequence space, semantic coherence constraints, and domain-adaptive assessment in a single adversarial testing pipeline [1][2]. The paper appears on arXiv, an open-access repository of electronic preprints that has been operating since August 1991 and now receives roughly 24,000 submissions per month [6]. Papers on arXiv are moderated but not peer-reviewed before posting [6]. The repository hosts work across mathematics, physics, computer science, and related fields [6].

safety-researchresearch-papertool-releasemodel-releaseapplication

Background sources we checked (7)
  • arxiv.org ↗ As AI systems are deployed in high-stakes ethical contexts such as healthcare triage, autonomous vehicle control, and employment screening, formal methods for evaluating their robustness against adversarial manipulation of ethical reasoning remain underdeveloped. This paper intro…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository [...] # arXivLabs: Showcase [...] arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. [...] While the arXiv team is focused on our core miss…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …

Sources

Spot something wrong? Report an issue