NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation
A team of robotics researchers has introduced a framework that allows a robot hand to infer physical contact without dedicated tactile sensors, using only camera data and internal joint-position readings. The system, called NoContactNoWorries, fuses RGB-D vision with proprioception to generate a pseudo-tactile signal for in-hand manipulation tasks [1]. The work, posted to the arXiv preprint repository on June 23, 2026, addresses a persistent hardware bottleneck in dexterous manipulation. Tactile sensors, while valuable, present practical challenges in cost, fragility, and integration [2]. The researchers instead draw inspiration from human embodied perception, where visual information combines with an innate sense of body pose and movement to infer contact [1]. The NoContactNoWorries framework uses a transformer-based multimodal architecture to fuse RGB-D camera streams with the robot's proprioceptive data, outputting binary contact states [2]. This signal acts as a stand-in for tactile hardware, specifically for binary contact estimation, and is designed to feed downstream reinforcement learning agents that perform in-hand object reorientation [1]. The team trained a single contact prediction model on multiple objects and demonstrated that the inferred contact signal generalizes to novel objects, with experiments conducted in both simulation and on a real-world robot platform [2]. The preprint appears on arXiv, an open-access repository that has hosted over two million articles since its founding in 1991 and currently receives roughly 24,000 submissions per month [6]. The paper is accompanied by a project page and is accessible through the repository's standard abstract page, which also links to community-developed tools such as the Bibliographic Explorer and Connected Papers [5][4]. These tools are part of the arXivLabs framework, a formalized collaboration space that allows third-party developers to build experimental features on top of arXiv's article records while adhering to the repository's values of openness, community, excellence, and user data privacy [4].
tool-releaseresearch-paperapplication
Background sources we checked (7)
- arxiv.org ↗ Perceiving physical contact is fundamental to dexterous manipulation. While robots often rely on dedicated hardware tactile sensors, humans exhibit a remarkable ability to infer contact by integrating visual information with an innate sense of their body's pose and movement. Insp…
- info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
- blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
- info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
- en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
- en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
- en.wikipedia.org ↗ A large language model (LLM) is a type of machine learning model designed for natural language processing tasks such as language generation. LLMs are language models with many parameters, and are trained with self-supervised learning on a vast amount of text.…