Generative causal testing to bridge data-driven models and scientific theories in language neuroscience

22d ago · Global · primary source: export.arxiv.org

A new framework called generative causal testing (GCT) can produce concise explanations of how the brain processes language, using large language models to bridge the gap between opaque predictive models and formal scientific theory, according to a paper posted to arXiv [1]. The framework, detailed in a submission last revised on 13 Jun 2026, addresses a core limitation in neuroimaging research: while representations from large language models (LLMs) predict BOLD fMRI responses to language stimuli with high accuracy, the features driving those responses in specific brain areas have remained unclear [1]. GCT generates explanations of language selectivity and then tests them in follow-up experiments using stimuli produced by the LLM itself [2]. The authors report that the method successfully explains selectivity in individual voxels and in cortical regions of interest, including newly identified microROIs in the prefrontal cortex [2]. Explanatory accuracy, they find, is closely tied to the predictive power and stability of the underlying models [1]. The work also shows that GCT can dissect fine-grained functional differences between brain areas that exhibit similar selectivity profiles [2]. This capability marks a step toward resolving long-standing questions about the division of linguistic labor across the cortex. The paper argues that LLMs can serve as a conduit between purely data-driven models and the kind of formal, testable theories that have traditionally been harder to extract from high-dimensional neural networks [1]. LLMs are a class of machine learning model trained with self-supervised learning on vast text corpora to perform natural language processing tasks such as generation [10]. Their internal representations have become a dominant tool in computational neuroscience, even though current neural networks are generally regarded as low-quality models of biological brain function [3]. The GCT framework attempts to move beyond correlation by introducing a causal testing step, generating stimuli designed to confirm or refute a candidate explanation [2]. The paper appeared on arXiv, the preprint server that, through collaborations such as arXivLabs, now integrates interactive demos from platforms like Hugging Face Spaces directly alongside paper abstract pages [6][7]. This integration allows readers to explore open-source demos without writing code, a feature aimed at increasing the reproducibility and accessibility of machine learning research [6][8]. The GCT paper's submission history shows three versions, with the file size growing from 28,458 KB in the initial October 2024 upload to 40,253 KB by the June 2026 revision [1]. The lead author is Richard Antonello [1].

research-papertool-release

Background sources we checked (10)
  • arxiv.org ↗ Representations from large language models are highly effective at predicting BOLD fMRI responses to language stimuli. However, these representations are largely opaque: it is unclear what features of the language stimulus drive the response in each brain area. We present generat…
  • en.wikipedia.org ↗ In machine learning, deep learning (DL) focuses on utilizing multilayered neural networks to perform tasks such as classification, regression, and representation learning. The field takes inspiration from biological neuroscience and revolves around stacking artificial neurons int…
  • en.wikipedia.org ↗ In mathematics, a time series is a sequence of data points indexed, listed, or graphed in chronological order. Most commonly, a time series consists of observations recorded at successive equally spaced points in time. Thus, it represents a form of discrete-time data. A time seri…
  • en.wikipedia.org ↗ These datasets are used in machine learning (ML) research and have been cited in peer-reviewed academic journals. Datasets are an integral part of the field of machine learning. Major advances in this field can result from advances in learning algorithms (such as deep learning), …
  • huggingface.co ↗ Hugging Face Machine Learning Demos on arXiv Back to Articles ... # Hugging Face Machine Learning Demos on arXiv Published November 17, 2022 Update on GitHub Upvote 1 - - - - - Abubakar Abid abidlabs Follow …
  • info.arxiv.org ↗ ## Hugging Face Spaces ... Hugging Face code repositories, About Hugging Face ... Collaborators: Abubakar Abid, Omar Sanseviero, Ahsen Khaliq, and the Hugging Face team ... Hugging Face Spaces includes links to demos created by the community or the authors themselves. By going to…
  • huggingface.co ↗ Demos on Hugging Face Spaces allow a wide audience to try out state-of-the-art machine learning research without writing any code. Hugging Face and ArXiv have collaborated to embed these demos directly along side papers on ArXiv! ... Thanks to this integration, users can now find…
  • en.wikipedia.org ↗ Hangzhou DeepSeek Artificial Intelligence Basic Technology Research Co., Ltd., doing business as DeepSeek, is a Chinese artificial intelligence (AI) company that develops large language models (LLMs). Based in Hangzhou, Zhejiang, DeepSeek is owned and funded by High-Flyer, a Chin…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…
  • en.wikipedia.org ↗ Douwe Kiela is a Dutch-American research scientist and entrepreneur working in the field of artificial intelligence with a focus on machine learning and natural language processing. He is a research scientist director at Google DeepMind. He previously co-founded and served as CEO…

Sources

Spot something wrong? Report an issue