Bridging Vision and Language Concepts through Optimal Transport Semantic Flow

13d ago · Global · primary source: export.arxiv.org

A new machine-learning architecture rethinks how artificial intelligence systems connect visual data with human language concepts, treating alignment as a dynamic transport process rather than a static projection, according to a preprint posted to arXiv on June 25, 2026 [1][2]. The model, called the Optimal Transport Flow Concept Bottleneck Model (OTF-CBM), builds on Concept Bottleneck Models (CBMs), a class of interpretable AI systems that make predictions through human-understandable concepts [1][2]. CBMs have been limited by their reliance on pre-aligned encoders or global cosine similarity, which the authors argue obscures fine-grained concept localization and fails to reflect true semantic geometry [2]. OTF-CBM instead frames concept alignment as a cross-modal transport process. It first learns a data-driven semantic cost using Inverse Optimal Transport to measure distances between visual and textual representations, then applies unbalanced optimal-transport-based flow matching to model semantic transitions between image patches and text concepts [2]. A velocity-based concept activation mechanism captures geometric relations without requiring ordinary differential equation integration [2]. The preprint, hosted on the open-access repository arXiv, has not yet undergone peer review [5]. arXiv, founded in 1991, now receives roughly 24,000 submissions per month and serves as a primary distribution channel for computer science and physics research before journal publication [5]. Artificial intelligence research has long pursued systems that can perceive and reason about the world in ways that are transparent to humans [3]. The field, formally established in 1956, has experienced multiple cycles of optimism and retreat, with a sustained boom since the 2010s driven by deep learning and, after 2017, the transformer architecture [3]. Interpretability remains a central challenge, particularly as models are deployed in high-stakes domains. The OTF-CBM paper reports superior classification accuracy and concept faithfulness compared to existing vision-language CBMs [1][2]. The authors describe the work as offering a new geometric and dynamical perspective for interpretable cross-modal reasoning [2]. No external validation or replication results were available at the time of the preprint's posting.

research-papersafety-researchcommentary

Background sources we checked (6)
  • arxiv.org ↗ Concept Bottleneck Models (CBMs) promise transparent reasoning by predicting through human-interpretable concepts, yet their effectiveness fundamentally depends on how well visual and textual representations are aligned or matched. Existing vision-language CBMs often rely on pre-…
  • en.wikipedia.org ↗ Artificial intelligence (AI) is the capability of computational systems to perform tasks typically associated with human intelligence, such as learning, reasoning, problem-solving, perception, and decision-making. It is a field of research in engineering, mathematics and computer…
  • en.wikipedia.org ↗ These datasets are used in machine learning (ML) research and have been cited in peer-reviewed academic journals. Datasets are an integral part of the field of machine learning. Major advances in this field can result from advances in learning algorithms (such as deep learning), …
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ LK-99 also called PCPOSOS, is a gray–black, polycrystalline compound, identified as a copper-doped lead‒oxyapatite. A team from Korea University led by Lee Sukbae (이석배) and Kim Ji-Hoon (김지훈) began studying this material as a potential superconductor in 1999, and in July 2023 publ…

Sources

Spot something wrong? Report an issue