The Atlantic created a searchable database of the music used to train AI
- company The Atlantic
- person Alex Reisner
- person Aphex Twin
- person Bruce Springsteen
- person Fred Again..
- person Hainbach
- person Lady Gaga
- person Radiohead
The Atlantic has published a searchable database exposing millions of music tracks used to train generative AI models, revealing a sprawling landscape of freely available datasets that include work by major artists. Reporter Alex Reisner identified four datasets, two of which contain 12 million and 9 million tracks respectively, while two smaller collections hold over 100,000 songs each [1]. The datasets have been downloaded thousands of times, and both Google and Stability have confirmed their use in research papers [1]. The database surfaces names such as Lady Gaga, Fred Again.., Radiohead, Aphex Twin, Wu-Tang Clan, and Bruce Springsteen [1]. Reisner noted that three of the datasets are distributed as lists of links to songs on YouTube or Spotify, and developers often use automated tools to download the audio in ways that can bypass logins, advertisements, and mechanisms that generate revenue for creators — practices that violate the platforms’ terms of service [1]. Some sources, like the Free Music Archive dataset, are free for personal streaming but require licensing for commercial applications [1]. The findings arrive amid broader scrutiny of how generative AI systems are built. Generative AI models learn underlying patterns from their training data to produce new text, images, video, and audio [2]. Since the 2020s AI boom, the prevalence of such tools has grown sharply, driven by advances in deep neural networks and the transformer architecture [2][3]. Companies across software, entertainment, and other sectors have adopted the technology, but its reliance on copyrighted material without rightsholder permission has become a flashpoint [2]. Concerns about training-data provenance extend beyond music. The Atlantic previously reported that the Common Crawl foundation, whose web archives are widely used to train large language models, misled publishers about respecting paywalls and failed to honor content-removal requests [8]. Algorithmic bias researchers have also warned that imbalances in training data can produce systematic, unfair outcomes, compounding existing racial, socioeconomic, and gender biases [5]. The European Union’s Artificial Intelligence Act, adopted in 2024, and the General Data Protection Regulation represent early legal frameworks attempting to address such harms [5]. Reisner’s searchable database is part of The Atlantic’s AI Watchdog project, which allows the public to explore the songs, books, and other media incorporated into AI training sets [1]. While the datasets are freely available online, using them as training data is not as simple as downloading a single file; developers must still assemble and process the audio through automated pipelines [1].
research-paperinfrastructure
Background sources we checked (7)
- en.wikipedia.org ↗ Generative artificial intelligence (GenAI) is a subfield of artificial intelligence (AI) that uses generative models to generate text, images, videos, audio, software code (vibe coding) or other forms of data. These models learn the underlying patterns and structures of their tra…
- en.wikipedia.org ↗ Artificial intelligence (AI) is the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of research in engineering, mathematics and computer…
- en.wikipedia.org ↗ Google Search (also known simply as Google or google.com) is a search engine operated by Google. It allows users to search or ask for information by entering keywords or phrases on a website page or in an installed application program. Google Search uses algorithms to analyze an…
- en.wikipedia.org ↗ Algorithmic bias describes systematic and repeatable harmful tendency in a computerized sociotechnical system to create "unfair" outcomes, such as "privileging" one category over another in ways that may or may not be different from the intended function of the algorithm. Bias ca…
- en.wikipedia.org ↗ OpenSubtitles is a website dedicated to the aggregation of subtitles for audiovisual works. In 2022, OpenSubtitles was one of the 5,000 most accessed websites from the internet.…
- en.wikipedia.org ↗ Caity Weaver is an American journalist, humorist, and writer at The Atlantic. Previously she wrote for The New York Times, GQ magazine and Gawker, and contributed to Mental Floss.…
- en.wikipedia.org ↗ The Common Crawl Foundation (Common Crawl) is a nonprofit 501(c)(3) organization that crawls the web and freely provides its archives and datasets to the public. Access to the data is free on Amazon Web Services, but users may incur storage and compute costs. Common Crawl was fo…