The use of surrounding visual context in handheld AR

Abstract

The magic lens paradigm, a commonly used descriptor for handheld Augmented Reality (AR), presents the user with dual views: the augmented view (magic lens) that appears on the device, and the real view of the surroundings (what the user can see around the perimeter of the device). The augmented view is typically implemented by rendering the video captured by the rear-facing camera directly onto the device's screen. This results in dual perspectives-the real world being captured from the device's perspective rather than the user's perspective (what an observer would see looking through a transparent glass pane). These differences manifest themselves in misaligned and/or incorrectly scaled transparency resulting in the dual-view problem. This paper presents two user studies comparing (a) deviceperspective and (b) fixed Point-of-View (POV) userperspective magic lenses to analyze the effect of the dualview problem on the use of the surrounding visual context. The results confirm that the dual-view problem, a result of dual perspective, has a significant effect on the use of information from the surrounding visual context. The study also highlights that magnification and not the dual-view problem is the key factor explaining the correlation between magic lens size and the increased intensity of the magic lens type effect. From the results, we derive design guidelines for future magic lenses.

A survey of diminished reality: Techniques for visually concealing, eliminating, and seeing through real objects

“…In order to decrease the inconsistency, facing planes [42], arbitrary plane [35,36], non-planar [43,44], and simplified versions [85,86] of these methods have been developed. It has also been shown that users prefer this display method [87] and the efficiency of the search operation is improved in some cases [88,89].…”

Augmented paper maps: Design of POI markers and effects on group navigation

“…One is the dual-view problem in magic lens viewing [5], where users have to shift their attention between the mobile screen (magic lens) and the background augmented object. This causes difficulty in matching the mobile view with the background, as the mobile view appears at a different zoom level than the background object, hence posing cognitive difficulties to the user.…”

Use of Self-Reporting Questionnaires to Evaluate Augmented Paper Maps for Group Navigation

“…Other research has identified a range of issues concerning the use of AR and magic lens interaction. One is the dual-view problem in magic lens viewing [4], where users have to shift their attention between the mobile screen (magic lens) and the background augmented object. This causes difficulty in matching the mobile view with the background, as the mobile view appears at a different zoom level than the background object, hence posing cognitive difficulties to the user.…”