RiskNet: A large-scale dataset of AI risk incidents from news with alignment and multi-dimensional annotations

28d ago · Global · primary source: export.arxiv.org

A new dataset called RiskNet aims to provide a large-scale empirical foundation for tracking real-world AI failures, drawing from hundreds of millions of multilingual news records to organize incident reports into structured, analyzable records [1]. The resource, described in a paper submitted to arXiv on June 7, 2026, applies a multi-stage pipeline that identifies AI risk news, screens event-level reports, aligns related incidents, and classifies them across multiple dimensions [1]. The resulting collection organizes dispersed news reports into incident-centered records and provides benchmark datasets for event classification, incident alignment, and incident-level risk labeling [1]. An online platform also allows browsing and exploration of the data [1]. The creators argue that existing incident collections are often manually curated and too small for continuous, data-driven monitoring [1]. High-quality labeled training datasets for supervised machine learning are usually difficult and expensive to produce because of the large amount of time needed to label the data [4]. RiskNet is intended to support downstream research on AI safety, governance, risk analysis, and benchmarking, as well as longitudinal and cross-source analyses of AI-related harms [1]. Large language models, the technology behind modern chatbots, are typically based on transformer architectures and can generate, summarize, and translate text [3]. Biased or inaccurate training data can make an LLM’s output less reliable [3]. Benchmark evaluations for LLMs attempt to measure model reasoning, factual accuracy, alignment, and safety [3]. According to the Stanford HAI 2025 AI Index Report, on harder benchmarks introduced in 2023, model scores rose sharply within a single year; performance increased by 18.8, 48.9, and 67.3 percentage points on the MMMU, GPQA, and SWE-bench testing suites respectively by 2024 [3]. RiskNet’s release comes as AI incidents continue to draw scrutiny. DeepSeek, a Chinese AI company, launched its R1 model in January 2025 with training costs it claimed were US$6 million, far less than the US$100 million cost for OpenAI’s GPT-4 in 2023 [9]. Observers described the breakthrough as triggering a “Sputnik moment” for the United States in artificial intelligence [9]. The RiskNet paper is accessible through arXiv, which since November 2022 has collaborated with Hugging Face to integrate machine learning demos directly alongside papers [7]. Hugging Face’s paper pages also allow users to find models, datasets, and apps related to a paper [6].

safety-researchresearch-paperbenchmarkcommentarymodel-release

Background sources we checked (10)
  • arxiv.org ↗ As artificial intelligence (AI) systems are increasingly deployed across socially consequential domains, reports of AI-related harms and failures have grown in frequency and diversity. Although existing governance frameworks articulate high-level principles for responsible AI, la…
  • en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …
  • en.wikipedia.org ↗ These datasets are used in machine learning (ML) research and have been cited in peer-reviewed academic journals. Datasets are an integral part of the field of machine learning. Major advances in this field can result from advances in learning algorithms (such as deep learning), …
  • arxiv.org ↗ We review thirteen generative systems and five supporting datasets for quantum circuit and quantum code generation, identified through a structured scoping review of Hugging Face, arXiv, and provenance tracing (January-February 2026). We organize the field along two axes: artifac…
  • huggingface.co ↗ # Paper Pages Paper pages allow people to find artifacts related to a paper such as models, datasets and apps/demos (Spaces). Paper pages also enable the community to discuss about the paper. ## Linking a Paper to a model, dataset or Space If the repository card (`README.md`) …
  • huggingface.co ↗ Hugging Face Machine Learning Demos on arXiv Back to Articles [...] # Hugging Face Machine Learning Demos on arXiv Published November 17, 2022 Update on GitHub Upvote 1 - - - - - Abubakar Abid abidlabs Follow …
  • huggingface.co ↗ # How to Add a Space to ArXiv [...] Demos on Hugging Face Spaces allow a wide audience to try out state-of-the-art machine learning research without writing any code. Hugging Face and ArXiv have collaborated to embed these demos directly along side papers on ArXiv! [...] Thanks t…
  • en.wikipedia.org ↗ Hangzhou DeepSeek Artificial Intelligence Basic Technology Research Co., Ltd., doing business as DeepSeek, is a Chinese artificial intelligence (AI) company that develops large language models (LLMs). Based in Hangzhou, Zhejiang, DeepSeek is owned and funded by High-Flyer, a Chin…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…
  • en.wikipedia.org ↗ Qwen (also known as Tongyi Qianwen, Chinese: 通义千问; pinyin: Tōngyì Qiānwèn) is a family of large language models developed by Alibaba Cloud. Many Qwen models are distributed under the free and open-source Apache 2.0 license, the source-available Qwen License, or the non-commercial…

Sources

Spot something wrong? Report an issue