Virtual Home Staging: Inverse Rendering and Editing an Indoor Panorama under Natural Illumination

Ji, Guanzhou; Sawyer, Azadeh O.; Narasimhan, Srinivasa G.

doi:10.1007/978-3-031-47969-4_26

Cited by 4 publications

References 47 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Virtual home staging and relighting from a single panorama under natural illumination

Ji,

Sawyer,

Narasimhan

2024

Machine Vision and Applications

View full text Add to dashboard Cite

Virtual staging technique can digitally showcase a variety of real-world scenes. However, relighting indoor scenes from a single image is challenging due to unknown scene geometry, material properties, and outdoor spatially-varying lighting. In this study, we use the High Dynamic Range (HDR) technique to capture an indoor panorama and its paired outdoor hemispherical photograph, and we develop a novel inverse rendering approach for scene relighting and editing. Our method consists of four key components: (1) panoramic furniture detection and removal, (2) automatic floor layout design, (3) global rendering with scene geometry, new furniture objects, and the real-time outdoor photograph, and (4) virtual staging with new camera position, outdoor illumination, scene texture, and electrical light. The results demonstrate that a single indoor panorama can be used to generate high-quality virtual scenes under new environmental conditions. Additionally, we contribute a new calibrated HDR (Cali-HDR) dataset that consists of 137 paired indoor and outdoor photographs. The animation for virtual rendered scenes is available here.

show abstract