Binocular mobile augmented reality based on stereo camera tracking

Abstract

Mobile augmented reality (AR) applications have become feasible with the evolution of mobile hardware. For example, the advent of the smartphone allowed implementing real-time mobile AR, which triggered the release of various applications. Recently, rapid development of display technology, especially for stereoscopic displays, has encouraged researches to implement more immersive and realistic AR. In this paper, we present a framework of binocular augmented reality based on stereo camera tracking. Our framework was implemented on a smartphone and supports autostereoscopic display and video see-through display in which a smartphone can be docked. We modified edge-based 3-D object tracking in order to estimate poses of left and right cameras jointly; this guarantees consistent registration across left and right views. Then, virtual contents were overlaid onto camera images using estimated poses, and the augmented stereo images were distorted to be shown through a video seethrough display. The feasibility of the proposed framework is shown by experiments and demonstrations.

Harmonic rendering for visual coherence on mobile outdoor AR environment

“…There are several main research areas in AR technology, with camera and object tracking [19,20], registration [32], and image synthesis [18] being some of the most fundamental challenges [30]. Tracking and registration issues have been tackled in recent decades using many advanced devices, such as depth cameras, stereo cameras, and gyroscope sensors [3,17], but they remain open problems.…”

Application of Augmented Reality and Robotic Technology in Broadcasting: A Survey

“…Recently, edge feature-based tracking algorithm was used with binocular camera through ICP algorithm [22], which fits texture-less or noisy environment. Park, et al developed a binocular camera-based object tracking framework for mobile AR [23]. The calibration problem of See-through AR with binocular camera was studied, and "paired-eyes" technique was used to support the user to align virtual and real contents [24].…”

“…(ii) The time of flight technique to obtain depth information, as shown in Figure 4b. The TOF-based 3D camera projects laser light onto target surface and times the reflection time to measure distances of each point [23]. It works at a large range with a high accuracy.…”

GUEST EDITORIAL special issue on real-time perceptual-inspired imaging systems with computational science and aesthetics

“…The eleventh paper, entitled ''Binocular mobile augmented reality based on stereo camera tracking,'' by Park et al [14] presented an augmented reality framework for mobile stereo display. By modifying edge-based 3D object tracking, they obtained a joint camera pose estimation in stereo camera tracking that allows the precise registration of the real and the virtual worlds and consistent augmentation across both views.…”