Gaming AI-Assisted Peer Reviews Poses New Risks to the Scientific Community
- lab CatalyzeX
- lab DagsHub
- lab GotitPub
- lab Hugging Face
- lab ScienceCast
- lab alphaXiv
- lab arXivLabs
- model Gemini 3 Flash
AI-assisted peer review systems can be gamed through superficial rewording of manuscript abstracts, according to new research that raises concerns about the integrity of automated scientific evaluation [1]. The study, posted to arXiv on June 8, 2026, demonstrates that adversarially rewritten abstracts can significantly improve AI review scores without altering the underlying scientific content or communication [1]. The manipulation works even when authors have no knowledge of which reviewing model is being used [1]. AI is increasingly deployed across the peer review pipeline, from manuscript screening and reviewer assistance to editorial triage [1]. Generative AI tools, built on large language models using the transformer architecture, have proliferated since the AI boom of the 2020s and are now used in sectors including software development, healthcare, and finance [3]. Their application in scientific gatekeeping, however, has received less scrutiny regarding robustness to strategic manipulation [1]. The strongest attack achieved an attack-success-rate of approximately 38%, increasing acceptance ratings by +1.31 for Gemini 3 Flash reviewers and by +0.88 for GPT 5.4 Mini reviewers on a 10-point scale [1]. When the original AI review recommended rejection, the success rate climbed above 50% [1]. The effect extended beyond overall score inflation, boosting review confidence and scores on criteria such as soundness, significance, and perceived contribution [1]. The attack is practical and low-cost, requiring roughly five minutes and $1 for a 10-page AI conference submission [1]. The rewritten abstracts are difficult to distinguish from ordinary scientific editing, the researchers note [1]. The findings point to a structural vulnerability: when AI-generated reviews influence editorial decisions, authors may be incentivized to optimize manuscripts for AI judgment rather than scientific merit [1]. The researchers caution that AI tools should not be treated as neutral evaluators in high-stakes peer review without systematic robustness testing, transparent safeguards, and careful human oversight [1]. The broader context of AI-generated content has drawn increasing scrutiny. The term "AI slop" emerged in the 2020s to describe low-effort, high-volume synthetic media produced for the attention economy, and was selected as the 2025 Word of the Year by both Merriam-Webster and the American Dialect Society [5]. The study's authors argue that inflated AI reviews could bias downstream human decision-making, shifting editorial recommendations from rejection toward acceptance [1].
safety-researchresearch-papercontroversy
Background sources we checked (10)
- arxiv.org ↗ AI is increasingly used to support scientific peer review, from manuscript screening, reviewer assistance to editorial triage. Although such systems promise to reduce reviewer burden and accelerate publication, their robustness to strategic manipulation remains poorly understood.…
- en.wikipedia.org ↗ Generative artificial intelligence (GenAI) is a subfield of artificial intelligence (AI) that uses generative models to generate text, images, videos, audio, software code (vibe coding) or other forms of data. These models learn the underlying patterns and structures of their tra…
- en.wikipedia.org ↗ Artificial intelligence (AI) is the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of research in engineering, mathematics and computer…
- en.wikipedia.org ↗ AI slop (also known as slop content or simply slop) is digital content made with generative artificial intelligence that is perceived as lacking in effort, quality, or meaning, and produced in high volume as clickbait to gain advantage in the attention economy, or earn money. It …
- en.wikipedia.org ↗ The neurodiversity paradigm is a framework for understanding human brain function that considers the diversity within sensory processing, motor abilities, social comfort, cognition, and focus as neurobiological differences. This diversity falls on a spectrum of neurocognitive dif…
- en.wikipedia.org ↗ Lead poisoning, also known as plumbism and saturnism, is a type of metal poisoning caused by the presence of lead in the human body. Symptoms of lead poisoning may include abdominal pain, constipation, headaches, irritability, memory problems, infertility, numbness and tingling i…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
- arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
- en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…