HauntAttack: When Attack Follows Reasoning as a Shadow

13d ago · Global · primary source: export.arxiv.org

A new black-box adversarial attack framework called HauntAttack can systematically embed harmful instructions into reasoning questions, achieving an average attack success rate of over 70% across 11 Large Reasoning Models, according to a preprint posted on arXiv [1]. The framework, introduced by researcher Jingyuan Ma and submitted to the open-access repository arXiv on 8 June 2025, modifies key reasoning conditions in existing questions with harmful instructions to construct a reasoning pathway that guides the model step by step toward unsafe outputs [1][2]. The paper, last revised on 25 June 2026, reports that HauntAttack achieves up to 13 percentage points of absolute improvement over the strongest prior baseline [1][2]. arXiv, which began on 14 August 1991, hosts electronic preprints across mathematics, physics, computer science, and related fields, and as of November 2024 receives about 24,000 articles per month [8]. The repository passed the two-million-article milestone by the end of 2021 [8].\n\nThe study evaluated HauntAttack on 11 LRMs and found that even advanced safety-aligned models remain highly susceptible to reasoning-based attacks [1][2]. The authors frame the work around a central question: when reasoning becomes intertwined with harmfulness, will LRMs become more vulnerable to jailbreaks in reasoning mode? [1][2]. The preprint is categorized under Cryptography and Security within computer science [1].\n\nThe vulnerability documented in HauntAttack adds to a growing body of research examining how enhanced reasoning capabilities in AI systems can introduce new failure modes. The paper notes that the exposure of internal reasoning processes itself creates safety vulnerabilities that adversaries can exploit [1][2]. The findings offer what the authors describe as insights into the urgent challenge of balancing reasoning capability and safety in future model development [1][2].

controversyresearch-papersafety-researchtool-releasecommentary

Background sources we checked (9)
  • arxiv.org ↗ Emerging Large Reasoning Models (LRMs) consistently excel in mathematical and reasoning tasks, showcasing remarkable capabilities. However, the enhancement of reasoning abilities and the exposure of internal reasoning processes introduce new safety vulnerabilities. A critical que…
  • en.wikipedia.org ↗ Peter Andreas Thiel ( ; born 11 October 1967) is a German-American entrepreneur, venture capitalist, and conservative political activist. A co-founder of PayPal (1998), Palantir Technologies (2003), and Founders Fund (2005), he was also the first outside investor in Facebook (200…
  • en.wikipedia.org ↗ Freddy Krueger () is a fictional character and the antagonist of the A Nightmare on Elm Street horror film franchise. Created by Wes Craven, he made his debut in Craven's A Nightmare on Elm Street (1984) as the malevolent spirit of a child killer who had been burned to death by h…
  • en.wikipedia.org ↗ Destiny 2: Lightfall is a major expansion for Destiny 2, a first-person shooter video game by Bungie. Representing the seventh expansion and the sixth year of extended content for Destiny 2, it was released on February 28, 2023, after being pushed back from its original fall 2022…
  • en.wikipedia.org ↗ Sir Isaac Newton ( ; (1643-01-04)4 January 1643 [O.S. 25 December 1642] – 31 March [O.S. 20 March] 1727) was an English polymath who was a mathematician, physicist, astronomer, alchemist, theologian, author and inventor. He was a key figure in the Scientific Revolution and the En…
  • en.wikipedia.org ↗ This is a list of notable conspiracy theories. Many conspiracy theories relate to supposed clandestine government plans and elaborate murder plots. They usually deny consensus opinion and cannot be proven using historical or scientific methods, and are not to be confused with res…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ LK-99 also called PCPOSOS, is a gray–black, polycrystalline compound, identified as a copper-doped lead‒oxyapatite. A team from Korea University led by Lee Sukbae (이석배) and Kim Ji-Hoon (김지훈) began studying this material as a potential superconductor in 1999, and in July 2023 publ…

Sources

Spot something wrong? Report an issue