Scene and Human in One World: Reconstruction in a Feedforward Pass

10d ago · Global · primary source: export.arxiv.org

A new computer-vision framework called SHOW can reconstruct both humans and their surrounding scenes in a unified metric space from a single moving camera, according to a preprint posted to arXiv on June 26, 2026 [1]. The method addresses long-standing challenges of scale ambiguity and human-scene misalignment that have hindered monocular dynamic-scene reconstruction [1]. The framework, whose name stands for Scene and Human in One World, performs the reconstruction in a single feedforward pass rather than treating human mesh recovery and scene reconstruction as separate pipelines [1]. The authors argue that parametric human models supply semantic structure and metric-scale priors, while scene geometry provides spatial context for localizing and aligning the human figure [1]. SHOW injects those human-derived priors into normalized point-map prediction, enabling metric-scale scene reconstruction from inherently scale-ambiguous monocular input [1]. In turn, the recovered scene geometry constrains human mesh estimation, encouraging spatially consistent human placement [1]. The model learns both human-aware geometric features and geometry-constrained human features through joint training [1]. Monocular reconstruction of dynamic scenes has historically been difficult because a single camera cannot natively resolve absolute scale, and occlusions frequently break the correspondence between the person and the background [1]. SHOW incorporates a promptable masking mechanism that lets the system flexibly select a target human while suppressing background distractions and occlusion interference [1]. The preprint reports that extensive experiments show improvements in metric-scale consistency, human-scene alignment, and reconstruction accuracy under challenging camera motion, occlusion, and cluttered backgrounds [1]. The work arrives during a period of rapid architectural change in computer vision. Convolutional neural networks, which learn features through filter optimization, were long the de-facto standard for image and video tasks [2]. More recently, transformer architectures—first described in 2017—have become dominant for many sequence-processing problems because of their superior handling of long-range dependencies [3][4]. The SHOW authors do not specify in the abstract which backbone architecture they employ, but the emphasis on a feedforward pass and joint feature learning is consistent with contemporary hybrid designs that blend convolutional and attention-based components [1][2][3]. The paper appeared on arXiv, the open-access repository that has hosted more than two million e-prints since its launch in 1991 and now receives roughly 24,000 submissions per month [8]. The abstract page includes links to community-built tools under the arXivLabs framework, a program launched in 2020 that lets third-party developers offer bibliographic explorers, code finders, and recommender systems directly on article pages [5][6][7].

safety-researchresearch-papertool-release

Background sources we checked (9)
  • en.wikipedia.org ↗ A convolutional neural network (CNN) is a type of feedforward neural network that learns features via filter (or kernel) optimization. This type of deep learning network has been applied to process and make predictions from many different types of data including text, images and …
  • en.wikipedia.org ↗ In artificial neural networks, recurrent neural networks (RNNs) are designed for processing sequential data, such as text, speech, and time series, where the order of elements is important. Unlike feedforward neural networks, which process inputs independently, RNNs utilize recur…
  • en.wikipedia.org ↗ Artificial neural networks (ANNs) are models created using machine learning to perform a number of tasks. While the computational implementations of ANNs relate to earlier discoveries in mathematics, their creation was inspired by biological neural circuitry. The first implementa…
  • info.arxiv.org ↗ arXiv Labs - arXiv info | arXiv e-print repository Skip to content # arXiv Labs Attention arXiv Users: arXiv Labs is pausing new proposals ## What are arXiv Labs? arXiv Labs are a way for the community to contribute new, useful features to arXiv. These integrations are avail…
  • info.arxiv.org ↗ arXivLabs: Showcase - arXiv info | arXiv e-print repository ... # arXivLabs: Showcase ... arXiv is surrounded by a community of researchers and developers working at the cutting edge of information science and technology. ... While the arXiv team is focused on our core mission—pr…
  • blog.arxiv.org ↗ arXivLabs: a space for community innovation – arXiv blog arXiv has launched a new, formalized framework enabling innovative collaborations with individuals and organizations. “Members of our community want to contribute tools that enhance the arXiv experience, and we val…
  • en.wikipedia.org ↗ arXiv (pronounced as "archive"—the X represents the Greek letter chi ⟨χ⟩) is an open-access repository of electronic preprints and postprints (known as e-prints) approved for posting after moderation, but not peer reviewed. It consists of scientific papers in the fields of mathem…
  • en.wikipedia.org ↗ 14 (fourteen) is the natural number following 13 and preceding 15.…
  • en.wikipedia.org ↗ LK-99 also called PCPOSOS, is a gray–black, polycrystalline compound, identified as a copper-doped lead‒oxyapatite. A team from Korea University led by Lee Sukbae (이석배) and Kim Ji-Hoon (김지훈) began studying this material as a potential superconductor in 1999, and in July 2023 publ…

Sources

Spot something wrong? Report an issue