EvidenceLens: A Claim-Evidence Matrix for Auditing Financial Question Answering

15d ago · Global · primary source: export.arxiv.org

A new visual analytics prototype called EvidenceLens aims to help financial analysts verify answers produced by large language models by decomposing those answers into atomic claims and mapping them against source evidence, according to a paper posted to arXiv on June 19, 2026. [1][2] The system treats financial question answering as a claim-evidence alignment problem. It breaks an LLM-generated answer into individual claims, then summarizes the support composition, confidence levels, and support gaps for each claim. The core interface is a multimodal claim-evidence matrix that makes coverage, contradiction, and modality imbalance immediately visible. [1][2] Analysts can coordinate claim-level inspection with source passages, table cells, and chart regions. The authors argue that fluent LLM answers often blend directly grounded statements, weak synthesis, and unsupported claims across narrative text, tables, and charts, making verification difficult in high-stakes financial workflows. [2] The paper specifies a JSON-based artifact schema, a lightweight multimodal alignment pipeline, and a deterministic review-priority ranking that maps backend signals into an auditable visual structure. Through representative report-auditing scenarios, the researchers show how EvidenceLens helps analysts distinguish grounded claims from overconfident synthesis that conventional chat interfaces flatten. [2] The work appears on arXiv, an open-access repository of electronic preprints that is not peer-reviewed. As of November 2024, the repository was receiving about 24,000 submissions per month. [9] The paper is hosted within arXiv's computer science and information retrieval category. [1] EvidenceLens is listed as an arXivLabs project, a framework that allows community collaborators to develop and share experimental features directly on the arXiv website. [1][7] arXivLabs was formalized in 2020 to enable collaborations with individuals and organizations that share arXiv's values of openness, community, excellence, and user data privacy. [7] The framework appears as a set of tabs at the bottom of article abstract pages, highlighting tools such as the Bibliographic Explorer and the CORE Recommender. [7][8] arXiv has stated that third-party collaborators receive only minimal and anonymized data about users, strictly for ensuring correct feature functionality. [7] Large language models, the type of model EvidenceLens is designed to audit, are machine learning models with many parameters trained on vast amounts of text for natural language processing tasks such as language generation. [11] The EvidenceLens paper addresses a specific gap in applying such models to financial documents, where verification of outputs is critical. [2]

safety-researchresearch-paper

Background sources we checked (10)
  • arxiv.org ↗ Large language models are increasingly used to answer questions over annual reports, earnings decks, and analyst notes, yet their outputs remain difficult to verify in high-stakes financial workflows. A fluent answer can blend directly grounded statements, weak synthesis, and uns…
  • en.wikipedia.org ↗ Wikipedia is a free online encyclopedia written and maintained by a community of volunteers, known as Wikipedians, through open collaboration and the wiki software MediaWiki. Founded by Jimmy Wales and Larry Sanger in 2001, Wikipedia has been hosted since 2003 by the Wikimedia Fo…
  • en.wikipedia.org ↗ Dhananjaya Yeshwant Chandrachud (born 11 November 1959) is a retired Indian jurist, who served as the 50th Chief Justice of India from 9 November 2022 to 10 November 2024. He was appointed a judge of the Supreme Court of India in May 2016. He has also previously served as the chi…
  • en.wikipedia.org ↗ A private prison, or for-profit prison, is a place where people are imprisoned by a third party that is contracted by a government agency. Private prison companies typically enter into contractual agreements with governments that commit prisoners and then pay a per diem or monthl…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue