CT-VAM: A Cerebello-Thalamic-Inspired Vision-Action Model for Efficient Visuomotor Control

28d ago · Global · primary source: export.arxiv.org

A research team has proposed a compact vision-action model for robot control that separates high-level task understanding from low-level motor execution, drawing inspiration from the brain’s cerebello-thalamic pathways [1][2]. The model, called CT-VAM, is designed to function as a local execution policy that predicts action sequences from dual-view visual data, proprioceptive feedback, and a lightweight task condition [1][2]. The architecture introduces a component named TARS, or Thalamic Action Routing Stream, a stream-separated conditional attention decoder that independently routes action, visual, and task information to prevent dense sensory tokens from overwhelming compact task-relevant signals [2]. The researchers argue that raw language is primarily needed to specify task intent, not to be repeatedly processed during high-frequency low-level execution, a separation that could enable a cloud-edge paradigm where large models handle semantic reasoning while fast closed-loop control runs on local hardware [1][2]. With 68 million parameters, CT-VAM achieves success rates on the LIBERO benchmark that are competitive with substantially larger vision-language-action models, while reducing inference latency [1][2]. The system also incorporates flow-consistent inpainting for asynchronous chunk execution, supporting high-frequency control and demonstrating robust real-world deployment on resource-constrained robotic platforms [2]. The paper was submitted to the arXiv preprint repository on June 8, 2026 [1]. arXiv, which began operating in August 1991, is an open-access repository of electronic preprints that are moderated but not peer-reviewed, and it passed the two-million-article milestone by the end of 2021 [6]. The repository now receives approximately 24,000 submissions per month as of November 2024 [6]. Large language models, which underpin many modern vision-language-action systems, are neural networks trained on vast text corpora for tasks including generation, summarization, and translation, and are typically built on transformer architectures [8]. The CT-VAM work departs from that trend by minimizing reliance on language processing during real-time control, instead using a task condition that is lightweight enough for edge deployment [2].

research-paperregulationinfrastructureapplication

Background sources we checked (7)
  • arxiv.org ↗ Vision-language-action models have shown strong promise for robot manipulation, yet raw language is primarily needed to specify task intent rather than to be repeatedly processed during high-frequency low-level execution. Motivated by this separation, we propose a cerebello-thala…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository [...] # arXivLabs: Showcase [...] arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. [...] While the arXiv team is focused on our core miss…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …

Sources

Spot something wrong? Report an issue