Self-Evolving Visual Questioner

23d ago · Global · primary source: export.arxiv.org

A team of researchers has proposed a self-evolving framework that allows vision-language models to improve as visual questioners without any external supervision, according to a paper submitted to arXiv on 11 Jun 2026 [1]. Vision-language models, or VLMs, are typically trained as passive answerers, while their ability to actively ask diverse, non-trivial, visual-centric and grounded questions remains underexplored [1]. Existing visual questioners' performance is bottlenecked by the availability of high-quality training data or the cost of curating them [1]. The new framework uses a VLM itself as both a proposer and a filter to produce harder, more informative, and visual-centric questions, while maintaining their exploration diversity to avoid training collapse [1]. These questions are then used to train the VLM in both questioner and answerer modes [1]. To evaluate the questioner, the researchers introduce an agentic protocol that assesses questions along perception, reasoning, and diversity dimensions [1]. Experiments across various backbone VLMs show that the method substantially enhances the quality and substantially expands the difficulty boundary of autonomous question generation [1]. Under the same budget, the self-supervision is more effective than training on the static source data [1]. Moreover, the self-evolving questioner remains a competitive or even better answerer [1]. The paper was posted on arXiv, an open-access repository of electronic preprints that, as of November 2024, receives about 24,000 articles per month [9]. The work appears within the Computer Vision and Pattern Recognition section, a field where large language models with many parameters are often trained with self-supervised learning on vast amounts of text [11]. The abstract page for the paper includes a link to Hugging Face, a platform commonly used to share machine-learning models and datasets [1]. The research was disseminated through arXivLabs, a framework that allows collaborators to develop and share new arXiv features directly on the website, with partners that have accepted values of openness, community, excellence, and user data privacy [7].

model-releaseresearch-paperproduct-launchapplicationtool-release

Background sources we checked (10)
  • arxiv.org ↗ Vision-language models (VLMs) are typically trained as passive answerers, while their ability to actively ask diverse, non-trivial, visual-centric and grounded questions remains underexplored. Existing visual questioners' performance is bottlenecked by the availability of high-qu…
  • en.wikipedia.org ↗ Charles James Kirk (October 14, 1993 – September 10, 2025) was an American right-wing political activist, entrepreneur, and media personality. He co‑founded the conservative student organization Turning Point USA (TPUSA) in 2012 and served as its executive director until his ass…
  • en.wikipedia.org ↗ Halt and Catch Fire is an American period drama television series created by Christopher Cantwell and Christopher C. Rogers. It aired on the cable network AMC in the United States from June 1, 2014, to October 14, 2017, spanning four seasons and 40 episodes. It depicts a fictiona…
  • en.wikipedia.org ↗ John von Neumann ( von NOY-mən; Hungarian: Neumann János Lajos [ˈnɒjmɒn ˈjaːnoʃ ˈlɒjoʃ]; December 28, 1903 – February 8, 1957) was a Hungarian and American mathematician, physicist, computer scientist and engineer. Von Neumann had perhaps the widest coverage of any mathematician …
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…

Sources

Spot something wrong? Report an issue