Augmented Interactions: A Framework for Adding Expressive Power to GUI Widgets

Abstract

Abstract. The basic elements of WIMP interfaces have proven to be robust components for building interactive systems, but these standard interactors also have limitations. On many occasions, researchers have introduced augmented GUI elements that are capable of more expressive interactions and that are better suited to user tasks. Although many of these novel designs have been effective, augmented interactors are still invented in an ad-hoc fashion, and there is no systematic way of thinking about or designing augmentations. As a result, there is little understanding of the principles underlying augmentation, the relationships between different designs, or the possibilities for creating new interactors. In this paper we present a framework that specifies elemental interactions with WIMP components and identifies the possible ways in which augmentations can occur. We show the explanatory and generative power of the framework by analysing existing and novel augmented interactions.

Faceless Interaction—A Conceptual Examination of the Notion of Interface: Past, Present, and Future

“…The increasing interest and concern with the expressive aspect of artifacts and their interfaces shows that interaction can be understood as deeply involved with meaning making, something that has been explored lately both in HCI research and in design research (Brewster et al, 2009;Cechanowicz & Gutwin, 2009;Forlizzi & Battarbee, 2004;Krippendorff, 2006;McCarthy & Wright, 2004).…”

Dynamic Mashup Interfaces for Information Systems Using Widgets-as-a-Service

“…As future work, we would like to increase the number of application scenarios and validate the proposed architecture in other platforms through practical examples,. We also aim to improve the user's experience when managing widget-based graphical user interfaces [2].…”