Design by physical composition for complex tangible user interfaces

Abstract

In this paper, we present a novel approach to create devices with tangible user interfaces by physical composition. While the separation of the user interface from the application logic has a long tradition in software engineering, for products with tangible user interfaces there is no equivalent approach that realizes a true separation and flexible combination of interface components, underlying technology, and software parts. We propose a novel concept that is based on an inner Core for the basic technical and software platform of a product and an outer Shell that builds a flexible and exchangeable tangible user interface from passive components. Using vision-based tracking, we can realize a clear separation between the components. No wiring is necessary. This paper introduces our novel approach and presents a first working prototype as well as initial results from its application in a design workshop.

Sauron

“…Sauron's approach shares the greatest similarity with Döring's work-in-progress on embedding a camera and projector system into product mockups [5]. We extend their work by providing visibility analysis and automatic CAD model modification techniques.…”

“…In future work, we would like to explore more detailed simulation in the CAD environment. This could eliminate the physical registration phase by either generating and printing visual markers (and using sensing similar to [5]) in a contrasting material, or by predicting the position of the components in the camera's image and sending that information to the vision software.…”