PIXELRAG: Web Screenshots Beat Text for Retrieval-Augmented Generation

71d ago · Global · primary source: export.arxiv.org

A new retrieval method called PixelRAG processes web pages as screenshots rather than parsed text, outperforming conventional text-based retrieval-augmented generation systems across multiple benchmarks, according to a paper posted to arXiv on June 1, 2026 [1][2]. The system, described by its authors as the first pipeline to operate over a full Wikipedia corpus in its native visual form, builds a datastore of 30 million screenshot images and uses an efficient visual retrieval index [1][2]. PixelRAG is built on the Qwen3-VL-Embedding model, which the researchers fine-tuned on screenshot data with contrastive training [1][2]. Retrieved screenshots are fed directly as pixel inputs to a vision-language model, bypassing the HTML parsing and text-extraction steps that dominate current web retrieval pipelines [1][2]. The paper reports that PixelRAG consistently outperforms both no-retrieval and text-based baselines, including on widely studied text-centric tasks such as Natural Questions and SimpleQA [1][2]. On multimodal open-domain question-answering benchmarks like MMSearch, noisy news corpora such as LiveVQA, and agentic benchmarks like MoNaCo, accuracy improved by up to 18.1% over text-based baselines [1][2]. The authors also demonstrate that image compression can reduce token costs by up to 3x at lower resolutions while maintaining accuracy [1][2]. The preprint was posted to arXiv, the open-access repository that hosts e-prints across physics, computer science, and other fields [6]. As of November 2024, arXiv receives roughly 24,000 submissions per month and has surpassed two million total articles [6]. Papers on the platform are moderated but not peer-reviewed, a distinction that has drawn attention in cases such as the 2023 LK-99 room-temperature superconductor claims, which were later found to be unsupported after replication attempts [6][8]. PixelRAG’s approach challenges the assumption that web retrieval requires text representations, suggesting that operating directly in the web’s visual form can improve both performance and efficiency [1][2]. The paper is available on arXiv under the computer science information retrieval category [1].

research-paper

Background sources we checked (7)
  • arxiv.org ↗ Augmenting large language models (LLMs) with retrieved web text has become a dominant paradigm, yet the web is not natively textual: existing systems depend on complex parsing pipelines that linearize HTML and discard layout, visual structure, and formatting. We introduce PixelRA…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ LK-99 also called PCPOSOS, is a gray–black, polycrystalline compound, identified as a copper-doped lead‒oxyapatite. A team from Korea University led by Lee Sukbae (이석배) and Kim Ji-Hoon (김지훈) began studying this material as a potential superconductor in 1999, and in July 2023 publ…

Sources

Spot something wrong? Report an issue