Physical Avatars in a Projector-Camera Tangible User Interface Enhance Quantitative Simulation Analysis and Engagement

Abstract

We present an augmented reality environment for the visualization of architectural daylighting simulations. The new visualizations focus the users' attention on the problematic aspects of a building design. Architectural design is a task particularly well suited for Tangible User Interfaces (TUIs). The user physically constructs a scale model of the building, a lighting simulation is then performed on this space, and then the simulation results are projected into the physical model by a set of calibrated projectors. A user study of an earlier version of the system revealed that users lacked accurate quantitative information about the propagation of natural light within architectural spaces and had difficulties identifying and reasoning about areas of overillumination, under-illumination, and glare. This was our motivation for two important additions to the system: physical avatar tokens within the physical scale model to specify areas of interest for glare and false color visualizations. We render viewpoints from the perspective of each avatar and indicate glare for each viewpoint. To provide users with an additional way to minimize glare and provide visual interest, we introduce new complex and interesting shading materials. These features illustrated in our tool create a more immersive and educational experience for novice and experienced designers.

Recent Advances in Projection Mapping Algorithms, Hardware and Applications

“…Such registration technology is also installed in a theme park ride where multiple projectors are precisely registered to non-planar surfaces and players can change the surface textures with gun-like input devices [MvBG * 12]. An interactive architectural daylight modeling is achieved with movable mockup walls, and projection-based lighting simulations [SYYC11,NC13]. When a user moves the walls, the system measures their poses by an overhead camera, and updates the projected lighting simulation.…”