Combining multi-touch input and device movement for 3D manipulations in mobile augmented reality environments

Abstract

Nowadays, handheld devices are capable of displaying augmented environments in which virtual content overlaps reality. To interact with these environments it is necessary to use a manipulation technique. The objective of a manipulation technique is to define how the input data modify the properties of the virtual objects. Current devices have multi-touch screens that can serve as input. Additionally, the position and rotation of the device can also be used as input creating both an opportunity and a design challenge. In this paper we compared three manipulation techniques which namely employ multi-touch, device position and a combination of both. A user evaluation on a docking task revealed that combining multitouch and device movement yields the best task completion time and efficiency. Nevertheless, using only the device movement and orientation is more intuitive and performs worse only in large rotations.

Analysis of Locally Coupled 3D Manipulation Mappings Based on Mobile Device Motion

“…Some of them demonstrate 3D object manipulation in augmented reality (AR). Henrysson et al (2005) and Marzo et al (2014) described a "grasping" metaphor in which, during the 2. http://www.google.com/atap/project-tango/ manipulation, the object remains fixed relative to the mobile device. A drawback of this approach is that it makes it difficult to rotate the manipulated object without translating it.…”

A study on improving close and distant device movement pose manipulation for hand-held augmented reality

“…Marzo et al [Marzo et al 2014] developed a hybrid method to solve the rotation issue of relative-DPR. Device movement is used to translate the VO while multi-touch is used to change the orientation and move the object near and far.…”

3D Character Customization for Non-Professional Users in Handheld Augmented Reality

“…Here, we focus on object selection and manipulation in mobile AR. Interaction techniques typically rely on camera-based input (e.g., [16,15], also in combination with touch input [3,26,35]), mid-air hand or finger input (e.g., [18,7,3]), tangible objects (e.g., [20,4,2,31]) or a combination thereof.…”

“…The user can therefore move the device around and to the desired location considering the relative positioning of the object to the camera. The combination of multi-touch and device movements was also investigated [26,35]. For rotation tasks, approaches commonly rely on constraint rotation around individual axes (e.g., [1,4,27,18] and some on free rotation by attaching the object to a hand or prop (e.g., [20,7].…”