Decoding Hidden Deception in Reasoning LLMs: Activation Explainers for Deception Auditing
- lab CatalyzeX
- lab DagsHub
- lab GotitPub
- lab Hugging Face
- lab ScienceCast
- lab alphaXiv
- lab arXiv
- lab arXivLabs
A new tool called STATEWITNESS aims to make hidden deception in large language models more inspectable by translating a model’s internal activations into human-readable reports, its developers report. [1] The system, described in a paper submitted to arXiv on 16 June 2026, is designed as an activation explainer for deception auditing. As large language models develop stronger reasoning abilities, their potential for deceptive behavior has become a pressing safety concern. Existing monitors typically produce a text transcript score or a single scalar probe value, offering little evidence for why a response was flagged. [1] STATEWITNESS takes a different approach: a separate decoder reads the hidden states of a target model and then answers natural-language questions or generates structured reports about those states. [1] The researchers evaluated the tool on two reasoning LLMs across seven deception datasets. STATEWITNESS achieved a mean AUROC of 0.916, which represents a relative gain of 11.6% over the best black-box text monitor and 25.0% over the best activation-probe baseline under the same evaluation protocol. [1] When combined with existing monitors in simple threshold ensembles, the system reduced the number of deceptive examples that were missed. [1] Beyond a single detection score, the decoder returns query-level answers, schema-based reports, and evidence traces at the token or sentence level that are intended for human inspection. The authors frame this interface as a potential building block for broader interpretability and alignment tools. [1] The work arrives amid wider efforts to open the “black box” of neural networks. For context, the field of mechanistic interpretability has long sought to connect internal model computations to human-understandable concepts, though progress has been uneven across different architectures and tasks. [1] The challenge is analogous to problems in molecular biology, where transcription factors control gene expression by binding to specific DNA sequences; understanding those regulatory mechanisms required tools that could reveal not just that a gene was active, but why and how. [7] Similarly, STATEWITNESS attempts to provide a causal narrative—rather than a single alarm—when a reasoning model exhibits deceptive behavior. [1]
research-papersafety-researchmodel-release
Background sources we checked (6)
- arxiv.org ↗ As LLMs acquire stronger reasoning capabilities, deceptive behavior becomes an increasingly serious safety concern. Existing deception monitors either score visible transcripts or derive scalar probe scores from representation vectors, leaving little inspectable evidence about wh…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
- arxiv.org ↗ With the creation of new datasets, the question arises of whether the data in them is complementary to other datasets for training ML models (see recent reviews for a perspective of catalysts informatics22, 23, 24). This is especially important when consolidating data with a vari…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) ... DagsHub Toggle ... DagsHub (What is DagsHub?)…
- en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…
- en.wikipedia.org ↗ In molecular biology, a transcription factor (TF) (or sequence-specific DNA-binding factor) is a protein that controls the rate of transcription of genetic information from DNA to messenger RNA, by binding to DNA sequences. Specificity can be due to sequence motifs, or epigenetic…