Dense Coordinate-List Fine-Tuning Induces a Controllable Interference Surface in Vision-Language Models
- lab arXiv
- lab arXivLabs
- location COCO 2017
- model Gemini-2.5-Pro
- model Gemma 4 12B
- model Qwen3-VL-8B
- product DagsHub
- product Hugging Face
Fine-tuning vision-language models to produce dense coordinate lists sharpens visual grounding but also alters how models serialize, repeat, and terminate structured outputs, according to a preprint posted to arXiv on June 12, 2026 [1]. The study examines this behavior as a generation and control surface [1]. In experiments with the Gemma 4 12B model, applying high-capacity q/k/v/o LoRA adapters lifted class-aware [email protected] from 0.007 to 0.448 while introducing repeated-tail pressure, with a duplicate rate of 0.080 and a maximum repeat of 23 [1]. A sweep of q/v ranks kept the maximum repeat at 21–22 across ranks 4–64, indicating that the interference persists across adapter capacities [1]. The target signal proved separable. An object-level repeat-stop intervention eliminated exact repeated records, driving the duplicate rate to 0.000 and the maximum repeat to 1, while preserving F1 scores of 0.494 to 0.490 and stricter [email protected] scores of 0.381 to 0.385 [1]. Structure-axis probes localized the effect to bounding-box coordinate object lists; dense non-bbox outputs and spatial or count JSON remained repeat-clean, even under high-capacity adapters [1]. Cross-model reproduction reinforced the findings. The Qwen3-VL-8B model reached a clean controlled endpoint with an [email protected] of 0.318 and a duplicate rate of 0.000 [1]. The COCO 2017 dataset, a widely used benchmark in computer vision, reproduced both the acquisition of grounding capability and the duplicate pressure [1]. The work was posted on arXiv, an open-access repository that hosts preprints across physics, computer science, and related fields and has grown to receive roughly 24,000 submissions per month as of late 2024 [8]. The authors frame dense coordinate-list adaptation as creating a structure-bound, cross-family interference surface that can be measured and controlled [1].
research-paper
Background sources we checked (9)
- arxiv.org ↗ Fine-tuning vision-language models to emit dense coordinate lists improves visual grounding but also changes how models serialize, repeat, and terminate structured outputs. We study this behavior as a generation and control surface. In Gemma 4 12B, high-capacity q/k/v/o LoRA rais…
- en.wikipedia.org ↗ Lidar (, an acronym of light detection and ranging or laser imaging, detection, and ranging, often stylized LiDAR) is a method for determining ranges by targeting an object or a surface with a laser and measuring the time for the reflected light to return to the receiver. Lidar m…
- en.wikipedia.org ↗ The Fox News Channel (FNC), often referred to as Fox News, is an American multinational conservative news and political commentary television channel and website based in New York City. Owned by the Fox News Media subsidiary of Fox Corporation, as of 2022, it is the most-watched …
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…