Interacting with Neural Radiance Fields in Immersive Virtual Reality

Li, Ke; Rolff, Tim; Schmidt, Susanne; Bacher, Reinhard; Leemans, Wim; Steinicke, Frank

doi:10.1145/3544549.3583920

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2024

Publication Types

Select...

Other1

Article1

Relationship

Self Cite0

Independent2

Authors

Journals

Cited by 2 publications

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

Interactive Data Fusion of Neural Radiance Fields for Industrial Facility Inspection in Virtual Reality

Li,

Schmidt,

Rolff

et al. 2024

2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

View full text Add to dashboard Cite

Interactive Data Fusion of Neural Radiance Fields for Industrial Facility Inspection in Virtual Reality

Li,

Schmidt,

Rolff

et al. 2024

2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)

View full text Add to dashboard Cite

Integration of 3D Gaussian Splatting and Neural Radiance Fields in Virtual Reality Fire Fighting

Lian,

Liu,

Cao

et al. 2024

Remote Sensing

View full text Add to dashboard Cite

Neural radiance fields (NeRFs) and 3D Gaussian splatting have emerged as promising 3D reconstruction techniques recently. However, their application in virtual reality (VR), particularly in firefighting training, remains underexplored. We present an innovative VR firefighting simulation system based on 3D Gaussian Splatting technology. Leveraging these techniques, we successfully reconstruct realistic physical environments. By integrating the Unity3D game engine with head-mounted displays (HMDs), we created and presented immersive virtual fire scenes. Our system incorporates NeRF technology to generate highly realistic models of firefighting equipment. Users can freely navigate and interact with fire within the virtual fire scenarios, enhancing immersion and engagement. Moreover, by utilizing the Photon PUN2 networking framework, our system enables multi-user collaboration on firefighting tasks, improving training effectiveness and fostering teamwork and communication skills. Through experiments and surveys, it is demonstrated that the proposed VR framework enhances user experience and holds promises for improving the effectiveness of firefighting training.

show abstract

Interacting with Neural Radiance Fields in Immersive Virtual Reality

Cited by 2 publications

References 12 publications

Interactive Data Fusion of Neural Radiance Fields for Industrial Facility Inspection in Virtual Reality

Interactive Data Fusion of Neural Radiance Fields for Industrial Facility Inspection in Virtual Reality

Integration of 3D Gaussian Splatting and Neural Radiance Fields in Virtual Reality Fire Fighting

Contact Info

Product

Resources

About