Trimodal Glioma Representation Alignment via Volumetric Contrastive Learning

23d ago · Global · primary source: export.arxiv.org

A new computational framework called GLORIA integrates three distinct data types — histopathology slides, mRNA expression profiles, and 3D MRI scans — to improve glioma grading and survival prediction, according to a paper posted to the arXiv preprint server on June 12 [1][2]. The model, whose name stands for GLioma Omics - Radiology - hIstopathology Alignment, is designed to address a gap in existing prognostic tools, which typically combine only two of these data sources [2]. GLORIA processes whole-slide image regions, gene-expression profiles, and 3D MRI volumes through separate encoders before projecting them into a shared latent space [2]. Alignment is achieved using a Gramian contrastive loss, a technique that measures the volume spanned by the three modality embeddings [2]. The aligned representations are then fused through a cross-modal gating module and jointly optimized for three-class glioma grading and overall survival prediction [2]. The researchers evaluated the framework on a matched cohort drawn from the TCGA-GBM/LGG and BraTS21 datasets, comprising 132 patients for whom all three modalities were available [2]. On the shared trimodal test set, GLORIA outperformed a bimodal baseline that used only whole-slide images and mRNA data across all reported metrics [2]. The paper was submitted by Eleonora Grassucci [1]. The work appears on arXiv, an open-access repository for electronic preprints that, as of late 2024, receives about 24,000 submissions per month [6]. arXiv hosts papers that are moderated but not peer-reviewed, serving as a rapid dissemination channel across physics, mathematics, computer science, and related fields [6]. The platform also supports community-built tools through its arXivLabs framework, which allows third-party developers to create features such as citation explorers and code finders that appear on article pages [4][5]. These integrations operate under guidelines that require partners to uphold arXiv’s values of openness, community, excellence, and user data privacy [4].

safety-researchresearch-papertool-release

Background sources we checked (7)
  • arxiv.org ↗ Glioma grading and survival prediction require the integration of heterogeneous information collected at different spatial and biological scales. Histopathology describes tissue morphology, mRNA expression captures molecular activity, and magnetic resonance imaging provides a non…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue