A mirror metaphor interaction system: touching remote real objects in an augmented reality environment

Abstract

We propose a real-world-oriented interface called the "Mirror Metaphor Interaction System". The display shows a mirror image from a camera facing a user, and the user can "touch" objects without making direct contact with the display. The "touched" object displays a menu or works directly. Objects can be placed in a remote room as well as in the user's room, and can also be moved around in a room. The user can therefore control equipment or interact with objects anywhere through the display of the system by combining images from local and remote places translucently. Our demonstration shows how the interface makes it easy to establish contact with movable objects in a remote room by "touching" them in the display.

Extended Remote Laboratories: A Systematic Review of the Literature From 2000 to 2022

“…The first publication on VRLs in the period 2000-2022 was published in 2001 [94], and the first on ARLs was published in 2003 [75]. The year with the most publications was 2012, with nine studies published: three on ARLs, and six on VRLs.…”

“…Objective Technologies used NTT Microsystem Integration Laboratories [75] Development of a system that allowed users to touch digital items and real-world movable objects visible through a display.…”

Gesture-Based Interaction in Domotic Environments: State of the Art and HCI Framework Inspired by the Diversity

“…As an attempt to design more intuitive interfaces in domotic environments, the system developed by Hosoya et al [14] uses a technique of real-time self-imaging on a translucent in order to improve feedback to the performer of the gestural interaction. The system developed by the authors visualizes the objects in a local or remote room on a screen and superimposes a translucent image of the user.…”

Augmented and Virtual Reality techniques for footwear

“…In addition, in order to capture the spatial coordinates of the user's hands, thumbs are provided with small markers in such a way that the virtual objects on the scene are selected according to the hand position. [Hosoya et al, 2003] proposed an interaction system in which the user could touch virtual objects rendered in a monitor using a marker mounted on his/her finger.…”