DriveStack-VLA: Render-Teacher Alignment for BEV-Based DeepStack Vision-Language-Action Model

15d ago · Global · primary source: export.arxiv.org

A new framework called DriveStack-VLA aims to improve the spatial reasoning of Vision-Language-Action driving models by incorporating a bird’s-eye-view representation and a self-critique module, according to a preprint posted on arXiv [1]. The paper, submitted on 23 June 2026, details how existing VLA driving models convert a pretrained Vision-Language Model into a driving policy, enabling them to use world knowledge and follow language instructions [1]. The authors argue that current models lack driving-oriented spatial intelligence because their policies rely on perspective image tokens and language priors, whereas precise motion planning requires metric geometry, top-down scene structure, and attention to safety-critical perceptual cues [1]. This limitation makes the models vulnerable to weak visual geometry modeling and perceptual coverage in expert demonstrations [1]. To address this, DriveStack-VLA is built upon a large VLM backbone and introduces dual visual modeling components [1]. A Bird-Eye-View representation is injected into the Large Language Model decoder through a DeepStack-style connection, and a technique called Render-Teacher Alignment aligns the perceptual focus of real images with that of rasterized images [1]. The framework also includes a head-based self-critique module that ranks sampled trajectories and conditionally refines the best one, bridging the gap in multimodal trajectory selection [1]. On the NAVSIMv1 benchmark, DriveStack-VLA achieves a PDMS score of 91.6, and on NAVSIMv2 it records an EPDMS of 91.0 with the human penalty filter enabled [1]. In closed-loop testing on the Bench2Drive dataset, the model posts a driving score of 79.49 and a success rate of 56.36% [1]. The preprint appears on arXiv, an open-access repository of electronic preprints that is not peer-reviewed and which, as of November 2024, receives about 24,000 submissions per month [6]. The work is categorized under Computer Vision and Pattern Recognition [1].

safety-researchresearch-paperregulationmodel-releaseproduct-launchtool-releasecommentary

Background sources we checked (7)
  • arxiv.org ↗ Vision-Language-Action driving models convert a pretrained Vision-Language Model into a driving policy, allowing them to use world knowledge and follow language guidances. However, existing VLA driving models still lack driving-oriented spatial intelligence: their policies are ma…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue