Figure 1: a) Our setup featuring a depth sensor, thermal camera and head mounted display b) connected to a notebook for mobile operation. c) Real-time reconstruction of the staircase with an overlay of the thermal image. d) Mesh reconstructed from the structure of a room textured with the images of a thermal camera.
ABSTRACTFire fighting remains a dangerous profession despite many recent technological and organizational measures. Sensors and technical systems can augment the performance of fire fighters to increase safety and efficiency during operation. An important aspect in that context is the awareness of location, structure and thermal properties of the environment. This paper focuses on the design and development of a mobile system, which can reconstruct a 3d model of a building's interior structure in real-time and fuses the visualization with the image of a thermal camera. In addition the position and viewing direction of the fire fighter within the model is determined and a thermal map can be generated from the gathered data, which could help an operational commander to guide his men during a mission.First tests with our system in different situations showed good results, being able to reconstruct different larger scenes and create thermal maps thereof.