NeST: Neuron Selective Tuning for LLM Safety
- lab arXiv
- lab arXivLabs
- location arXiv
- person Lichao Wu
- product LLMs
- product Low-Rank Adaptation (LoRA)
- product NeST
- product Neuron Selective Tuning for LLM Safety
A new post-hoc safety alignment method called NeST sharply reduces jailbreak success rates in large language models while training only a fraction of the parameters required by full fine-tuning, according to a paper posted on arXiv [1]. The framework, Neuron-Selective Tuning, identifies safety-relevant feed-forward neurons by probing activations on vanilla harmful and benign prompts, then clusters neurons with similar profiles and trains shared cluster-level updates while freezing the rest of the model [1]. The learned updates are folded into the original weights, so the technique adds no inference-time overhead [1]. NeST is trained exclusively on vanilla malicious prompts, without exposure to jailbreak-specific attack data, yet it generalizes to diverse jailbreaks [1]. Evaluated across 14 open-weight language and multimodal models, NeST outperformed lightweight baselines and approached the robustness of full fine-tuning with significantly fewer trainable parameters [1]. On text-only models, the average jailbreak attack success rate fell from 44.5% to 1.1% while training an average of 0.4 million parameters [1]. In multimodal settings, the attack success rate dropped from 55.3% to 1.1%, and for downstream fine-tuned variants, it was restored from 53.8% to 0.8% [1]. The work was submitted to arXiv on 18 February 2026 by Lichao Wu and revised on 12 June 2026 [1]. arXiv, an open-access repository for electronic preprints in fields including computer science, was launched in 1991 and passed the two-million-article milestone by the end of 2021 [8]. The repository is not peer reviewed, though submissions are moderated before posting [8]. Existing safety-alignment approaches often depend on heavyweight fine-tuning that is costly to update, audit, and maintain across model families, while parameter-efficient methods such as Low-Rank Adaptation trade efficiency for inconsistent safety gains and sensitivity to design choices [1]. Safety intervention mechanisms can reduce unsafe outputs without modifying model weights but do not directly shape the internal representations that govern safety behavior [1]. The NeST authors argue that robust, maintainable safety alignment can be achieved by concentrating adaptation on localized, functionally coherent safety structures [1].
safety-researchinfrastructureresearch-papercontroversytool-release
Background sources we checked (9)
- arxiv.org ↗ Safety alignment is essential for the responsible deployment of Large Language Models (LLMs). Yet, existing approaches often rely on heavyweight fine-tuning that is costly to update, audit, and maintain across model families. Full fine-tuning incurs substantial computational and …
- en.wikipedia.org ↗ This article presents a detailed timeline of events in the history of computing from 2020 to the present. For narratives explaining the overall developments, see the history of computing. Significant events in computing include events relating directly or indirectly to software, …
- en.wikipedia.org ↗ This glossary of artificial intelligence is a list of definitions of terms and concepts relevant to the study of artificial intelligence (AI), its subdisciplines, and related fields. Related glossaries include Glossary of computer science, Glossary of robotics, Glossary of machin…
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…
Sources
- export.arxiv.org — NeST: Neuron Selective Tuning for LLM Safety ↗