Using the user's point of view for interaction on mobile devices

Abstract

RESUMENous présentons une technique d'interaction pour dispositifs mobiles (smartphone et tablette) basée sur le suivi du visage de l'utilisateur. Cette technique définit de nouvelles possibilités pour l'interaction en entrée et en sortie sur dispositifs mobiles. En sortie, le suivi de la tête peut permettre de contrôler le point de vue sur une scène 3D affichée à l'écran (Head-Coupled Perspective, HCP). Cette technique améliore l'interaction en sortie en offrant la perception de la profondeur et en permettant la visualisation d'un espace de travail plus grand (fenêtre virtuelle). En entrée, le suivi des mouvements de la tête définit une nouvelle modalité d'interaction qui ne requiert pas d'autres capteurs que la caméra du téléphone ou de la tablette. Dans cet article, nous explicitons les possibilités interactionnelles offertes par le suivi de la tête de l'utilisateur sur téléphones ou tablettes, particulièrement adapté au caractère mobile des dispositifs visés. Nous focalisons ensuite sur l'interaction en sortie en présentant plusieurs applications du HCP et en décrivant les résultats d'une expérimentation qualitative sur téléphone et tablette. ABSTRACTWe study interaction modalities for mobile devices (smartphones and tablets) that rely on a camera-based head tracking. This technique defines new possibilities for input and output interaction. For output, by computing the position of the device according to the user's head, it is for example possible to realistically control the viewpoint on a 3D scene (Head-Coupled Perspective, HCP). This technique improves the output interaction bandwidth by enhancing the depth perception and by allowing the visualization of large workspaces (virtual window). For input, head movement can be used as a means of interacting with a mobile device. Moreover such an input modality does not require any additional sensor except the built-in front-facing camera. In this paper, we classify the interaction possibilities offered by head tracking on smartphones and tablets. We then focus on the output interaction by introducing several applications of HCP on both smartphones and tablets and by presenting the results of a qualitative user experiment.

Constructing a 3D Multiple Mobile Medical Imaging System through Service Science, Management, Engineering and Design

“…However, user's point of view can be speculated not only by utilizing sensors' information, but also by face tracking. Thus, Francone and Nigay [24] computed the position of the device according to the user's head and use it to control the viewpoint on a 3D scene. However, the 360 degrees of the scene can be seen only when using sensors.…”

“…Francone and Nigay [24] allow users to interchange digital information among their portable computers, table and wall displays, as well as other physical objects through hyper-dragging. A proposed interaction technique of hyper-dragging is that users can easily share information like a picture or video by using a cursor to drag them to the physical place where they want to upload the information [25].…”

A comparison between tilt-input and facial tracking as input methods for mobile games

“…Similarly, Francone and Nigay [4] performed a study on mobile devices using facial tracking to mimic user perception.…”

“…There were two independent variables: input method (tilt-input, facial tracking) and life (1,2,3,4,5). The dependent variables were survival time, stars collected, and score.…”

Using relative head and hand-target features to predict intention in 3D moving-target selection

“…Head tracking, on the other hand, is readily available in most CAVE-like systems and has been successfully integrated in largedisplay [24], video-conference [38], mobile [37], surface [9] and floor-projected [32] interactive systems. In a real-life scenario, Stiefelhagen and Zhu [38] showed that head orientation contributed 68.9% to the overall gaze direction and could estimate attention focus with 88.7% accuracy.…”