EgoTactile: Learning Grasp Pressure for Everyday Objects from Egocentric Video

28d ago · Global · primary source: export.arxiv.org

A new benchmark called EgoTactile aims to estimate full-hand grasp pressure from egocentric video, addressing a gap in vision-based tactile sensing that has largely been limited to planar surfaces or fingertip contacts, according to a paper submitted on 8 Jun 2026 [1][2]. The benchmark pairs egocentric video with full-hand pressure supervision for diverse everyday objects and includes a bare-hand transfer subset to support generalization to natural, unconstrained scenarios [1][2]. The researchers note that existing methods often depend on intrusive hardware for dense tactile sensing, which limits their applicability in immersive virtual reality and robotic manipulation [2]. To establish a performance baseline, the team first developed EgoPressureFormer, a discriminative model [2]. They then introduced EgoPressureDiff, a conditional diffusion framework that adapts a large-scale pre-trained video diffusion backbone [2]. The framework incorporates a Physically-Informed Feature Rectification layer designed to inject semantic constraints, helping the system resolve visual-physical ambiguities and infer plausible contact patterns from partial observations [2]. The work appears on arXiv, an open-access repository for electronic preprints that has hosted more than two million articles since its launch in 1991 and currently receives about 24,000 submissions per month [6]. The paper was submitted to the Computer Vision and Pattern Recognition section [1]. In extensive experiments, EgoPressureDiff demonstrated superior performance on the benchmark and showed robust transferability to in-the-wild settings, according to the authors [2]. The project page is available at the EgoTactile website [2]. The release comes as arXiv continues to expand community-driven tools through its arXivLabs framework, which allows third-party collaborators to build features such as bibliographic explorers and code finders that integrate directly with abstract pages [5].

research-paperbenchmarktool-releasemodel-releaseproduct-launchapplication

Background sources we checked (7)
  • arxiv.org ↗ Estimating full-hand grasp pressure from egocentric video is critical for immersive VR and robotic manipulation, yet dense tactile sensing often relies on intrusive hardware. Existing vision-based methods predominantly rely on planar surfaces or fingertip contacts, failing to gen…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository [...] # arXivLabs: Showcase [...] arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. [...] While the arXiv team is focused on our core miss…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ A large language model (LLM) is a neural network trained on a vast amount of text for natural language processing tasks, especially language generation. LLMs can typically generate, summarize, translate, and analyze text in many contexts, and are a foundational technology behind …

Sources

Spot something wrong? Report an issue