Reframing AI Loss of Control: What It Is, How to Have It, How to Lose It

26d ago · Global · primary source: export.arxiv.org

A new paper argues that public discourse on AI loss-of-control risks rests on “surprisingly weak foundations,” proposing a formal definition of control anchored to the setting and getting of goals [1][2]. The preprint, submitted to arXiv on 19 May 2026, draws on concepts from cybernetics, management control, and control theory to build a framework for who or what can be in control and what is required to maintain it [1][2]. The authors identify prerequisites such as a functional control loop, requisite variety, and sufficient goal alignment [2]. Once that framework is established, the paper examines how control can be lost and how AI systems can contribute to that loss [2]. A central finding is that humanity can lose varying degrees of control because of AI behaviour that operates far below the level of superintelligence [2]. The authors state that “the potential for loss of control scenarios (as we define them) already exist, and have existed for a long time” [2]. The work arrives amid intensifying scrutiny of AI-generated media. Deepfakes, which use machine-learning techniques such as generative adversarial networks, have raised concerns about disinformation, election interference, and financial fraud [3]. Academics have warned that such synthetic media can promote hate speech and undermine trust in information ecosystems [3]. Social-media platforms amplify these effects: algorithms that track user engagement tend to favour content that spurs negative emotions, and most online misinformation originates from a small minority of superspreaders whose reach is magnified by the platforms [5]. Psychological research offers a parallel lens. When people encounter information that clashes with existing beliefs, they often experience cognitive dissonance and may resolve the discomfort by rationalizing, selectively perceiving facts, or avoiding contradictory evidence altogether [4]. Leon Festinger, who formalized the theory in the 1950s, described the phenomenon bluntly: “Tell him you disagree and he turns away. Show him facts or figures and he questions your sources. Appeal to logic and he fails to see your point” [4]. The paper’s framework suggests that loss of control is not a distant, speculative risk tied only to advanced AI. By defining control concretely and identifying its failure modes, the authors aim to give researchers and policymakers a shared vocabulary for evaluating systems already in deployment [1][2].

research-papersafety-researchtool-release

Background sources we checked (10)
  • arxiv.org ↗ At present, loss of control risks have gained much prominence in public discussion, particularly in relation to AI, with extensive discourse present among academics, frontier labs, and even governments. However, in the existing literature, the concept seems to rest on surprisingl…
  • en.wikipedia.org ↗ Deepfakes (a portmanteau of 'deep learning' and 'fake') are images, videos, or audio that have been edited or generated using artificial intelligence, AI-based tools or audio-video editing software. They may depict real or fictional people and are considered a form of synthetic m…
  • en.wikipedia.org ↗ In the field of psychology, cognitive dissonance is described as a mental phenomenon in which people unknowingly or subconsciously hold fundamentally conflicting cognitions. Being confronted by situations that create this dissonance or highlight these inconsistencies motivates ch…
  • en.wikipedia.org ↗ Social media are new media technologies that facilitate the creation, sharing and aggregation of content (such as ideas, interests, and other forms of expression) amongst virtual communities and networks. Common features include: Online platforms enable users to create and share…
  • en.wikipedia.org ↗ Well-being is a multifaceted topic studied in psychology, especially positive psychology. Biologically, well-being is highly influenced by endogenous molecules that impact happiness and euphoria in organisms, often referred to as "well-being related markers". Related concepts are…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository [...] # arXivLabs: Showcase [...] arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. [...] While the arXiv team is focused on our core miss…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…

Sources

Spot something wrong? Report an issue