Abstract. In this paper we explore the use of in-situ occlusion resolution in mixed physical/digital tabletop scenarios. We propose the extension of backprojected tabletops with interactive top-projection to turn the physical object's surface into peripheral displays. These displays are used to resolve occlusion insitu without the need to use additional tabletop display space and keeping the spatial perception of the occluded objects. We contribute a visualization concept and a set of interaction techniques for in-situ occlusion resolution and easy access to occluded objects. The techniques are implemented in a system named ProjecTop, which is evaluated in an quantitative user study. The study results highlight how top-projection can be beneficially used. We conclude with a set of design implications derived from the study's results.
Keywords. Interactive tabletops · occlusion awareness · hybrid interaction · peripheral displays · multitouch
IntroductionTabletop computers are going to play an important role in future offices due to dropping prices and technological advances. When integrated within the normal office furniture, their table like form factor affords the usage as normal table, e.g. additional materials like printed documents, laptops, books etc. are placed and used concurrently on its interactive surface.The presence of physical objects on tabletops poses several challenges: The first is that it considerably decreases the screen real-estate for interaction with digital objects. Not only the footprint of physical objects obstructs the display, but also casual arrangement of them on the surface makes the -still visible -display areas hard to use. This becomes even worse for tall physical objects (e.g. high stacks) that shadow even more display area from the user's perspective. A second important challenge is that Fig. 1. ProjecTop system visualizing the occluded digital objects the physical objects may partially or entirely occlude digital objects, resulting in losing awareness about occluded objects. Further, accessing them becomes cumbersome.Work is emerging to address parts of these problems: detecting the footprint of physical objects [2] and avoiding occlusion [1]. Other researchers address the problem by providing support for staying aware of and accessing digital objects [6,3,8]. The typical approach is that the occluded objects are transformed into icons or other content-wise reduced forms and visualized next to the occluding object. While this pioneering and motivating work established first design principles to mitigate the problem of physical occlusion in hybrid settings, it is not clear how these approaches extend to more cluttered workspaces where many physical objects consume considerable space on the tabletop display, which is the user's primary interaction surface.We go beyond existing work by extending the interaction and display spaces to the surface of the physical objects using additional top-projection facilities on a backprojected tabletop system to resolve occlusion. The tabletop...