PerceptionDLM: Parallel Region Perception with Multimodal Diffusion Language Models
- lab arXiv
- lab arXivLabs
- location arXiv
- model PerceptionDLM
- model PerceptionDLM-Base
A research team has introduced PerceptionDLM, a multimodal diffusion language model designed to perform region perception tasks in parallel rather than sequentially, according to a paper submitted to arXiv on June 17, 2026 [1]. The model is built on PerceptionDLM-Base, a foundational system that the authors describe as achieving state-of-the-art performance among open-source diffusion multimodal large language models [1]. Most existing MLLMs rely on autoregressive generation, which processes regions one after another and limits efficiency for tasks requiring captions across multiple image areas [1]. PerceptionDLM instead uses efficient prompting and structured attention masking to enable simultaneous perception of multiple masked regions, generating descriptions in parallel at both the sequence and token levels [1]. The researchers report that this approach yields substantial speed improvements for multi-region perception tasks while maintaining competitive performance in region captioning [1]. To measure the parallelism property of visual perception, the team constructed a new benchmark called ParaDLC-Bench by scaling the existing DLC-Bench to include multiple region masks per image [1]. The benchmark allows joint evaluation of caption quality and inference efficiency [1]. The authors state they are the first to achieve parallel region captioning and perception by leveraging the advantages of diffusion language models [1]. Code, models, and datasets have been released alongside the paper [1]. arXiv, where the paper was posted, is an open-access repository of electronic preprints that are moderated but not peer-reviewed [6]. It was founded on August 14, 1991, and by the end of 2021 had surpassed two million articles [6]. As of November 2024, the submission rate stood at roughly 24,000 articles per month [6]. The repository serves fields including computer science, mathematics, and physics, and in some disciplines nearly all scientific papers are self-archived there before journal publication [6]. The paper appears under the Computer Vision and Pattern Recognition category and is accompanied by experimental browser features such as Bibliographic Explorer and CORE Recommender, which are part of the arXivLabs framework for community-contributed tools [4][5]. arXivLabs sets guidelines for collaborations between arXiv and third parties, requiring partners to share the repository's values of openness, community, excellence, and user data privacy [4].
benchmarkresearch-paperinfrastructuremodel-releasetool-release
Background sources we checked (7)
- arxiv.org ↗ Multimodal large language models (MLLMs) have achieved remarkable progress in visual understanding tasks. However, most existing MLLMs rely on autoregressive generation, which limits their efficiency for perception tasks that require captioning multiple regions. In this work, we …
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…