Evaluating touching and pointing with a mobile terminal for physical browsing

Abstract

Physical browsing is a user interaction paradigm in which the user interacts with physical objects by using a mobile terminal to select the object for some action. The objects contain links to digital services and information related to the objects. The links are implemented with tags that are readable by the mobile terminal. We have built a system that supports selecting objects for interaction by touching and pointing at them. Our physical browsing system emulates passive sensor-equipped long-range RFID tags and a mobile terminal equipped with an RFID reader. We have compared different system configurations for touching and pointing. Additionally, we have evaluated other parameters of physical selection, such as conditions for choice of selection method. In our evaluation of the system, we found touching and pointing to be useful and complementary methods for selecting an object for interaction.

Using Augmented Reality and Internet of Things to improve accessibility of people with motor disabilities in the context of Smart Cities

“…Mobile payment can be achieved after inserting the memory card in users' mobile phone [27]. Evaluating touching and pointing with a mobile terminal for physical browsing [28] enables physical browsing via mobile phone. The built system supports browsing concepts like selecting objects for interaction by touching and pointing at them.…”

Facilitating peripheral interaction: design and evaluation of peripheral interaction for a gesture-based lighting control with multimodal feedback

“…Communicative gestures, described by Pavlovic et al [38], are used for the purpose of communicating, e.g., one's goal and can be used to communicate to a system that we want to select it. Pointing interaction styles as described in [14] could resemble the communicating of ''I want that one there'' [44,45] and have been shown by to lead to quick and accurate selection of targets in a 2D plane in the absence of visual guidance [14]. Being able to be aware of one's bodily position compared to the position of a system and using interaction styles that compliment this thus seems to benefit eyes-free interaction.…”

iCompose: context-aware physical user interface for application composition

“…Generally, physical browsing refers to an interaction technology for associating physical objects and digital information. In the ubiquitous computing domain, a physical browsing interface is usually based on a mobile device and allows resources in the environment to be chosen by means of scanning, pointing or touching [56,65]. For instance,the PERCI framework [8] integrates physical browsing interfaces with Web Services and addresses interoperability and multi-tag interaction issues.…”

“…Bluetooth or wifi). Physical browsing is preferred for selecting resources in ubiquitous environments because of its directness, simplicity and natural characteristics [2,8,49,56,65]. Another important reason for applying physical browsing is the fact that it paves the way for building user interfaces according to the direct manipulation paradigm [60], which is currently the prevailing design style for HCI.…”

“…The prototype relies on the user's mobile device as a tool for interacting with the application and controlling application composition. iCompose uses a physical browsing interface [65] to interact with ubiquitous resources and uses an asynchronous interaction style [57] and intelligent assistance paradigm [48]. iCompose comprises two interfaces that supplement each other: the physical and the graphical user interface on the mobile device.…”