Geometry-Aware Interactive AR Authoring Using a Smartphone in a Wearable AR Environment

Yu, Jeongmin; Jeon, Jinwoo; Park, Jin-Woo; Park, Gabyong; Kim, Hyung-Il; Woo, Woontack

doi:10.1007/978-3-319-58697-7_31

Cited by 6 publications

(5 citation statements)

References 9 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Physical surface touchscreen (Xiao et al, 2018;Plasson et al, 2020); 5. Manipulation using a smartphone as a proxy (Yu et al, 2017;Lee and Chu, 2018);…”

Section: Interactions Mainly Isomorphicmentioning

confidence: 99%

“…The user is then able to manipulate the content by moving the smartphone or using the touchscreen interactions. Yu et al (2017) use the smartphone as a pointer to select virtual object as if the user is manipulating a laser. The strong point of their works is the ubiquity of smartphones which makes the interfacing between the user and the mixed reality environment more flexible.…”

Section: Interactions Mainly Isomorphicmentioning

confidence: 99%

“…As mentioned previously, the article from Lee and Chu. (2018) and Yu et al (2017) use smartphones and their embedded sensors to complement mixed reality interactions. The other articles improve the hand interactions with a better hand tracking using external sensors such as depth cameras, with LeapMotion being the most popular, and Motion capture systems, such as OptiTrack (Figure 7).…”

Section: Devicesmentioning

confidence: 99%

See 2 more Smart Citations

Hand interaction designs in mixed and augmented reality head mounted display: a scoping review and classification

Nguyen,

Gouin-Vallerand,

Amiri

2023

Front. Virtual Real.

View full text Add to dashboard Cite

Mixed reality has made its first step towards democratization in 2017 with the launch of a first generation of commercial devices. As a new medium, one of the challenges is to develop interactions using its endowed spatial awareness and body tracking. More specifically, at the crossroad between artificial intelligence and human-computer interaction, the goal is to go beyond the Window, Icon, Menu, Pointer (WIMP) paradigm humans are mainly using on desktop computer. Hand interactions either as a standalone modality or as a component of a multimodal modality are one of the most popular and supported techniques across mixed reality prototypes and commercial devices. In this context, this paper presents scoping literature review of hand interactions in mixed reality. The goal of this review is to identify the recent findings on hand interactions about their design and the place of artificial intelligence in their development and behavior. This review resulted in the highlight of the main interaction techniques and their technical requirements between 2017 and 2022 as well as the design of the Metaphor-behavior taxonomy to classify those interactions.

show abstract

“…Physical surface touchscreen (Xiao et al, 2018;Plasson et al, 2020); 5. Manipulation using a smartphone as a proxy (Yu et al, 2017;Lee and Chu, 2018);…”

Section: Interactions Mainly Isomorphicmentioning

confidence: 99%

Section: Interactions Mainly Isomorphicmentioning

confidence: 99%

Section: Devicesmentioning

confidence: 99%

See 1 more Smart Citation

Hand interaction designs in mixed and augmented reality head mounted display: a scoping review and classification

Nguyen,

Gouin-Vallerand,

Amiri

2023

Front. Virtual Real.

View full text Add to dashboard Cite

show abstract

“…HMD-based AR can be applied to a wide variety of fields because when the HMD is worn, the object augmentation and manipulation can be performed at the same time by the user. In particular, various AR applications using HMD are expected to be used in teleconferencing, tele-education, military, maintenance, repair operation (MRO) and exhibition [3]. As such, Google Glass has pioneered the market for wearable AR devices by implementing a simple level of augmented reality functionality.…”

Section: Introductionmentioning

confidence: 99%

AR Pointer: Advanced Ray-Casting Interface Using Laser Pointer Metaphor for Object Manipulation in 3D Augmented Reality Environment

Byun

Park

et al. 2019

Applied Sciences

View full text Add to dashboard Cite

In this paper, we propose AR Pointer, a new augmented reality (AR) interface that allows users to manipulate three-dimensional (3D) virtual objects in AR environment. AR Pointer uses a built-in 6-degrees of freedom (DoF) inertial measurement unit (IMU) sensor in an off-the-shelf mobile device to cast a virtual ray that is used to accurately select objects. It is also implemented using simple touch gestures commonly used in smartphones for 3D object manipulation, so users can easily manipulate 3D virtual objects using the AR Pointer, without a long training period. To demonstrate the usefulness of AR Pointer, we introduce two use-cases, constructing an AR furniture layout and AR education. Then, we conducted two experiments, performance tests and usability tests, to represent the excellence of the designed interaction methods using AR Pointer. We found that AR Pointer is more efficient than other interfaces, achieving 39.4% faster task completion time in the object manipulation. In addition, the participants gave an average of 8.61 points (13.4%) on the AR Pointer in the usability test conducted through the system usability scale (SUS) questionnaires and 8.51 points (15.1%) on the AR Pointer in the fatigue test conducted through the NASA task load index (NASA-TLX) questionnaire. Previous AR applications have been implemented in a passive AR environment where users simply check and pop up the AR objects those are prepared in advance. However, if AR Pointer is used for AR object manipulation, it is possible to provide an immersive AR environment for the user who want/wish to actively interact with the AR objects.

show abstract

“…Yu et al [23] presented a system combining the HoloLens and a smartphone for placement of virtual objects with strong focus on geometry awareness and the technical aspects of mapping between real world and virtual world.…”

Section: Introductionmentioning

confidence: 99%

Put that Hologram there - Probing Mobile Interaction Experiences for a Vision of Mixed Material Public Spaces

Aslan

Dang

Schlagowski

et al. 2019

Proceedings of the 9th International Conference on the Internet of Things

View full text Add to dashboard Cite

show abstract

Geometry-Aware Interactive AR Authoring Using a Smartphone in a Wearable AR Environment

Cited by 6 publications

References 9 publications

Hand interaction designs in mixed and augmented reality head mounted display: a scoping review and classification

Hand interaction designs in mixed and augmented reality head mounted display: a scoping review and classification

AR Pointer: Advanced Ray-Casting Interface Using Laser Pointer Metaphor for Object Manipulation in 3D Augmented Reality Environment

Put that Hologram there - Probing Mobile Interaction Experiences for a Vision of Mixed Material Public Spaces

Contact Info

Product

Resources

About