Causal Inference with Generative Artificial Intelligence: Application to Texts as Treatments

26d ago · Global · primary source: export.arxiv.org

A new methodology harnesses generative artificial intelligence to strengthen causal inference when the treatment is unstructured text, according to a paper posted to arXiv. The approach, called GenAI-Powered Inference, sidesteps the need to learn a causal representation directly from the data. The framework, detailed in a submission last revised in June 2026, proposes using a deep generative model — specifically a large language model — to generate treatments and then exploit its internal representation for causal effect estimation [1]. Researcher Kentaro Nakamura and collaborators show that knowing this true internal representation helps separate treatment features of interest, such as specific sentiments or topics, from other potentially confounding features [1]. Unlike existing causal representation learning algorithms, GPI does not require the representation to be learned from the observed data, which the authors argue yields more accurate and efficient estimates [1]. Generative AI, the broader technology underpinning the method, refers to computational systems that can produce text, images, audio, and video from prompts [2]. Since the 2020s, such models have become widely available, and their rapid advance has coincided with what some observers call an AI boom [2]. The GPI paper leverages an open-source large language model, Llama 3, to generate text data for both simulation and empirical studies [1]. The authors formally establish conditions for nonparametric identification of the average treatment effect and propose an estimation strategy designed to avoid violating the overlap assumption [1]. They derive asymptotic properties of the estimator through double machine learning and extend the methodology, via an instrumental variables approach, to settings where the treatment feature is based on human perception [1]. The technique is also applicable to text reuse, in which a large language model regenerates existing texts [1]. The work sits at the intersection of causal inference and knowledge representation. In artificial intelligence, knowledge representation and reasoning aims to model information so that a computer system can solve complex tasks [4]. Parameterized models such as neural networks — including the transformer architectures that underpin modern large language models — can be viewed as a family of knowledge representation formalisms [4]. By treating a generative model’s internal representation as a given, GPI avoids the long-standing challenge of learning which formalism is most appropriate for a particular knowledge-based system [4]. The paper was first submitted in October 2024 and has undergone five revisions through mid-2026 [1]. Simulation and empirical results reported in the manuscript illustrate advantages over state-of-the-art causal representation learning algorithms, though independent replication has not yet been documented [1].

infrastructureresearch-paperbenchmarktool-release

Background sources we checked (9)
  • en.wikipedia.org ↗ Artificial intelligence (AI) is the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of research in engineering, mathematics and computer…
  • en.wikipedia.org ↗ The free energy principle is a mathematical principle of information physics. Its application to fMRI brain imaging data as a theoretical framework suggests that the brain reduces surprise or uncertainty by making predictions based on internal models and uses sensory input to upd…
  • en.wikipedia.org ↗ Knowledge representation (KR) aims to model information in a structured manner to formally represent it as knowledge in knowledge-based systems whereas knowledge representation and reasoning (KRR, KR&R, or KR²) also aims to understand, reason, and interpret knowledge. KRR is wide…
  • en.wikipedia.org ↗ The following scientific events occurred in 2024.…
  • arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
  • arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
  • arxiv.org ↗ CatalyzeX Code Finder for Papers (What is CatalyzeX?) [...] DagsHub Toggle [...] DagsHub (What is DagsHub?)…
  • en.wikipedia.org ↗ Sustainable Development Goals (abbr. SDGs) were adopted in 2015 by all United Nations (UN) members for the 2030 Agenda for Sustainable Development. The aim of the 17 global goals is "peace and prosperity for people and the planet", tackling climate change, and working to preserv…
  • en.wikipedia.org ↗ In molecular biology, a transcription factor (TF) (or sequence-specific DNA-binding factor) is a protein that controls the rate of transcription of genetic information from DNA to messenger RNA, by binding to DNA sequences. Specificity can be due to sequence motifs, or epigenetic…

Sources

Spot something wrong? Report an issue