‘Dangerous’ AI Models Are Coming No Matter What
- company Anthropic
- company OpenAI
- model Claude Fable 5
- model Mythos 5
- person Bruce Schneier
- person Chris Wysopal
- person Logan Graham
- person Tarah Wheeler
The United States government has restricted access to Anthropic's Claude Fable 5 and Mythos 5 AI models, citing national security risks from their advanced software vulnerability exploitation capabilities, even as researchers warn that comparable capabilities will soon emerge from competitors and open-source projects [1]. Anthropic took both models offline late last week following an export-control directive that bars "any foreign national" from using the services [1]. The company has been in talks with the White House since Friday but has yet to secure an agreement to reinstate the offerings [1]. Mythos 5 was released privately to a select consortium known as Project Glasswing, while Claude Fable 5 — a Mythos-grade model — was released to the general public with blocks on responses about biology and cybersecurity [1]. The Trump administration moved to restrict both models based on its assessment that Fable 5's guardrails can be disabled, granting full access to Mythos 5 capabilities [1]. Anthropic, founded in 2021 by former OpenAI members and now valued at an estimated $965 billion as of May 2026, has positioned AI safety as a central focus [10]. The company's Claude series of large language models is trained using "constitutional AI," a technique developed to improve ethical and legal compliance [11]. Large language models are neural networks trained on vast text corpora for natural language processing tasks, and biased or inaccurate training data can make outputs less reliable [2]. Anthropic itself acknowledged the dual-use nature of the technology. "A great deal of advanced usage of AI models is dual use: the same queries that are beneficial in the hands of cybersecurity professionals and biology researchers could be dangerous if available to malicious actors," the company wrote in a blog post [1]. Security researchers argue the restriction addresses a single company rather than the broader trend. "It's myopic in the extreme to think that no other competitors to Anthropic will develop similar capabilities to Mythos or even that they have not already done so," said Tarah Wheeler, chief security officer of TPO Group [1]. Bruce Schneier, a researcher at Harvard University and the University of Toronto, said smaller, cheaper, open-source models can match Mythos and Fable's performance with more sophisticated prompting, and other models should match their capabilities "within months" [1]. The AI sector has experienced rapid growth during the 2020s, with generative AI technologies from OpenAI, Google, and Anthropic driving what is sometimes called an AI spring [3]. OpenAI, which released ChatGPT in November 2022 and was valued at $500 billion in October 2025, also conducted a private release of a cybersecurity-focused model in mid-April [4][1]. Logan Graham, Anthropic's frontier red team lead, said when Mythos Preview launched in April: "The real message is that this is not about the model or Anthropic. We need to prepare now for a world where these capabilities are broadly available in 6, 12, 24 months" [1]. Chris Wysopal, cofounder of Veracode, framed the policy question: "The policy question is not whether a technology has risk. The question is whether a specific restriction meaningfully reduces that risk or whether it mainly slows down the people trying to make systems safer" [1]. US federal agencies had already begun phasing out Claude usage after Anthropic refused to remove contractual prohibitions on mass domestic surveillance and fully autonomous weapons, leading the Department of Defense to designate the company a supply chain risk — a designation temporarily blocked by a federal judge on March 26, 2026 [11].
controversysafety-researchresearch-paper
Background sources we checked (10)
- en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …
- en.wikipedia.org ↗ An AI boom is a period of rapid growth in the field of artificial intelligence. The most recent boom happened in the 2020s before seeing increased acceleration and media coverage. Examples of this include generative AI technologies, such as large language models (LLM) and AI imag…
- en.wikipedia.org ↗ OpenAI is an American artificial intelligence (AI) research organization headquartered in San Francisco, consisting of OpenAI Group PBC, a for-profit public benefit corporation (PBC), partially controlled by OpenAI Foundation, a nonprofit. OpenAI developed the generative pre-trai…
- arxiv.org ↗ We present DarkAgents: a multi-agent system that leverages the reasoning and code-generation capabilities of large language models (LLMs), together with deterministic tested human-written code, to build orchestrated pipelines for theoretical astroparticle physics research. While …
- arxiv.org ↗ Indirect prompt injection in tool-use agents is a concrete production threat: LLM agents read from integrations (third-party services such as Gmail, Salesforce, or Jira accessed through tool calls) whose response content the user neither writes nor controls. Existing benchmarks u…
- arxiv.org ↗ Selecting the right electricity market region for a hyperscale AI datacenter requires reasoning across live electricity prices, grid carbon intensity, technology cost trajectories, and causal grid dynamics -- a multi-step, multi-source analytical task that static knowledge benchm…
- arxiv.org ↗ Coding agents often pass per-prompt safety review yet ship exploitable code when their tasks are decomposed into routine engineering tickets. The challenge is structural: existing safety alignment evaluates overt requests in isolation, leaving models blind to malicious end-states…
- arxiv.org ↗ Existing benchmarks of language-model refusal on malicious-coding tasks routinely conflate requests for executable malicious software with requests for harmful security knowledge. This conflation matters because the two request types plausibly trigger distinct refusal pathways in…
- en.wikipedia.org ↗ Anthropic PBC is an American artificial intelligence (AI) company headquartered in San Francisco, California. It has developed a series of large language models (LLMs) named Claude and has a focus on AI safety. Anthropic was founded in 2021 by former members of OpenAI, including …
- en.wikipedia.org ↗ Claude is a series of large language models developed by American software company Anthropic. Claude was released as an AI-based chatbot in March 2023. It is also used in AI-assisted software development. Claude is trained using "constitutional AI", a technique developed by Anthr…