MARIO: Mid-air Augmented Reality Interaction with Objects

Kim, Hanyuool; Takahashi, Ikuo; Yamamoto, Hiroki; Maekawa, Satoshi; Naemura, Takeshi

doi:10.1016/j.entcom.2014.10.008

Cited by 48 publications

(11 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Spatial structures of the real environment can be generated at ease to provide accurate geometries for detecting collisions between virtual and real objects. Examples of geometry‐based interactions include: a virtual car ‘drives’ on an uneven real desk [NLD11]; the Super Mario game played on real building blocks [KTY*13] and the Ball Pit game in HoloLens [Mic17], where Figures (a) and (b) illustrate the concept. Impressive as they are, the state‐of‐the‐art systems are still limited to basic and uniform geometry‐based virtual and real object interactions.…”

Section: Previous Workmentioning

confidence: 99%

Context‐Aware Mixed Reality: A Learning‐Based Framework for Semantic‐Level Interaction

Chen

Tang

John

et al. 2019

Computer Graphics Forum

View full text Add to dashboard Cite

Mixed reality (MR) is a powerful interactive technology for new types of user experience. We present a semantic‐based interactive MR framework that is beyond current geometry‐based approaches, offering a step change in generating high‐level context‐aware interactions. Our key insight is that by building semantic understanding in MR, we can develop a system that not only greatly enhances user experience through object‐specific behaviours, but also it paves the way for solving complex interaction design challenges. In this paper, our proposed framework generates semantic properties of the real‐world environment through a dense scene reconstruction and deep image understanding scheme. We demonstrate our approach by developing a material‐aware prototype system for context‐aware physical interactions between the real and virtual objects. Quantitative and qualitative evaluation results show that the framework delivers accurate and consistent semantic information in an interactive MR environment, providing effective real‐time semantic‐level interactions.

show abstract

Section: Previous Workmentioning

confidence: 99%

Context‐Aware Mixed Reality: A Learning‐Based Framework for Semantic‐Level Interaction

Chen

Tang

John

et al. 2019

Computer Graphics Forum

View full text Add to dashboard Cite

show abstract

“…The main limitation of their systems is that the users need to observe the scene through a glass, which introduces a distance and make direct touch interaction impossible. In [5,6], the authors developed optical imaging systems and techniques for anchoring real objects with mid-air contents and allow the users to manipulate mid-air information by simply moving the physical objects. Moreover, other possible ways for displaying mid-air information are anamorphic illusions [16] or stereo projection with 3D shutter glasses [17] that require the observer to be head-tracked.…”

Section: Related Work 21 Interaction In Spatial Augmented Realitymentioning

confidence: 99%

DroneSAR

Darbar¹,

Roo²,

Lainé³

et al. 2019

Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia

View full text Add to dashboard Cite

Figure 1: An example scenario of DroneSAR. (A) A physical house mock-up. (B) A drone is mounted with two white paper panels. (C) The house is augmented using projection, and the main menu composed of a set of virtual tools projected on the drone panel. (D) A user selected the 'measuring tool' application using a controller. Then, the user positions the drone at the desired location in the 3D space (i.e., on top of the house) and draws a line shown in blue color on the augmented house to measure its width. Finally, the measured length is displayed on the drone panel.

show abstract

“…Kim et al proposed MARIO [5] to display a mid-air image in front of viewers by using an AIP. They installed a light source horizontally and placed the AIP 45° above the display.…”

Section: Mid-air Imagingmentioning

confidence: 99%

Mid-air imaging technique for architecture in public space

Sano¹,

Koizumi²

2018

View full text Add to dashboard Cite

Mid-air imaging is promising for glasses-free mixed reality systems in which the viewer does not need to wear any special equipment. However, it is difficult to install an optical system in a public space because conventional designs expose the optical components and disrupt the field of view. In this paper, we propose an optical system that can form mid-air images in front of building walls. This is achieved by installing optical components overhead. It displays a vertical mid-air image that is easily visible in front of the viewer. Our contributions are formulating its field of view, measuring the luminance of mid-air images formed with our system by using a luminance meter, psychophysical experiments to measure the resolution of the mid-air images formed with our system, and selection of suitable materials for our system. As a result, we found that highly reflective materials, such as touch display, transparent acrylic board, and white porcelain tile, are not suitable for our system to form visible mid-air images. We prototyped two applications for proof of concept and observed user reactions to evaluate our system.

show abstract

MARIO: Mid-air Augmented Reality Interaction with Objects

Cited by 48 publications

References 14 publications

Context‐Aware Mixed Reality: A Learning‐Based Framework for Semantic‐Level Interaction

Context‐Aware Mixed Reality: A Learning‐Based Framework for Semantic‐Level Interaction

DroneSAR

Mid-air imaging technique for architecture in public space

Contact Info

Product

Resources

About