Leveraging NeRF-Rendered Images for 3D Gaussian Splatting

28d ago · Global · primary source: export.arxiv.org

A new method combines two competing image-synthesis techniques to render street scenes with both high speed and high quality, according to a paper submitted to arXiv on 8 June 2026 [1][2]. The approach uses images generated by a neural radiance field to train a 3D Gaussian splatting model, inheriting the strengths of each. Neural radiance fields (NeRF) and 3D Gaussian splatting (3DGS) are two mainstream approaches for novel view synthesis, the task of creating images from new camera angles [1][2]. The techniques often show complementary performance: 3DGS demonstrates faster rendering speed, while NeRF demonstrates higher rendering quality [1][2]. 3D Gaussian splatting, a volume rendering technique originally introduced in the early 1990s, was revitalized in 2023 when a research group from Inria proposed a version offering real-time radiance field rendering [3]. Multiple works soon followed, including extensions for dynamic scenes [3]. The proposed method targets street scenes and utilizes a pre-trained street-specific NeRF method to produce training images for a target 3DGS method [1][2]. During 3DGS training, the NeRF-rendered images serve two purposes: removing transient objects from street-level input views and generating bird's-eye views as additional training perspectives [1][2]. The process incorporates a diffusion-based image enhancement step to improve the quality of the additional views [1][2]. Experimental results on one synthetic and two real datasets demonstrate that the method improves street-scene rendering while preserving the speed of 3DGS and the quality of NeRF [1][2]. The paper was submitted through arXivLabs, a framework that allows collaborators to develop and share new features on the arXiv website [1].

research-paper

Background sources we checked (5)
  • arxiv.org ↗ Neural radiance field (NeRF) and 3D Gaussian splatting (3DGS) are two mainstream approaches for novel view synthesis. They often show complementary performance, i.e., 3DGS demonstrating faster rendering speed and NeRF demonstrating higher rendering quality. Motivated by this, we …
  • en.wikipedia.org ↗ Gaussian splatting is a volume rendering technique that deals with the direct rendering of volume data without converting the data into surface or line primitives. The technique was originally introduced as splatting by Lee Westover in the early 1990s. This technique was revitali…
  • en.wikipedia.org ↗ Jiujiu Cabins (traditional Chinese: 九九山莊; simplified Chinese: 九九山庄) is an accommodation mountain lodge in Taiwan, located in Shei-Pa National Park, in Tai'an Township, Miaoli County, at an altitude of 2,699 metres (8,855 ft). It is named after the number 99 in its altitude. The l…
  • en.wikipedia.org ↗ Tianchi Lodge (traditional Chinese: 天池山莊; simplified Chinese: 天池山庄) is an accommodation mountain lodge in Taiwan, located at an altitude of 2,860 metres (9,380 ft), at kilometer 13.1 of the Nenggao Cross-Ridge Historic Trail. It is situated in a sheltered mountain valley on the w…
  • en.wikipedia.org ↗ Planet Nine is a hypothetical ninth planet in the outer region of the Solar System. Its gravitational effects could explain the peculiar clustering of orbits for a group of extreme trans-Neptunian objects (ETNOs)—bodies beyond Neptune that orbit the Sun at distances averaging mor…

Sources

Spot something wrong? Report an issue