Three-Dimensional Aerial Image Interface, 3DAII

Abstract

In this paper, we introduce the three-dimensional aerial image interface, 3DAII. This interface reconstructs and aerially projects a three-dimensional object image, which can be simultaneously observed from various viewpoints or by multiple users with the naked eye. A pyramid reflector is used to reconstruct the object image, and a pair of parabolic mirrors is used to aerially project the image. A user can directly manipulate the three-dimensional object image by superimposing a user’s hand-finger or a rod on the image. A motion capture sensor detects the user’s hand-finger that manipulates the projected image, and the system immediately exhibits some reaction such as deformation, displacement, and discoloration of the object image, including sound effects. A performance test is executed to confirm the functions of 3DAII. The execution time of the end-tip positioning of a robotic arm has been compared among four operating devices: touchscreen, gamepad, joystick, and 3DAII. The results exhibit the advantages of 3DAII; we can directly instruct the movement direction and movement speed of the end-tip of the robotic arm, using the three-dimensional Euclidean vector outputs of 3DAII in which we can intuitively make the end-tip of the robotic arm move in three-dimensional space. Therefore, 3DAII would be one important alternative to an intuitive spatial user interface, e.g., an operation device of aerial robots, a center console of automobiles, and a 3D modelling system. A survey has been conducted to evaluate comfort and fatigue based on ISO/TS 9241-411 and ease of learning and satisfaction based on the USE questionnaire. We have identified several challenges related to visibility, workspace, and sensory feedback to users that we would like to address in the future.

An Object Model and Interaction Method for a Simulated Experience of Pottery on a Potter’s Wheel

“…We would like to confirm the operations of the proposed object model (layered cylinder model) (Sections 3.1 and 3.2) and the functions of prepared interaction method (a simple but similar method to actual hand-finger operations) (Section 3.3) for the simulated experience of pottery on a potter's wheel. Hence, the three-dimensional aerial image interface (3DAII) [1][2][3] developed in our laboratory was adopted as a testing platform ( Figure 7).…”

“…The 3DAII is an interactive interface in which a user can directly operate an aerially-projected 3D object image (see reference [3]). A pyramid reflector is used to reconstruct the 3D object image, and a pair of parabolic mirrors are used to aerially project the image (Figure 8).…”

“…When an observer looks into the pyramid from its side, he/she feels the presence of a 3D object inside the pyramid with depth and stereo feeling, although he/she watches only two-dimensional image/video. A design example of the pyramid reflector is shown in [3], and specifications of the pyramid reflector used in the testing platform are indicated in Table 2.…”

“…When an observer looks into the pyramid from its side, he/she feels the presence of a 3D object inside the pyramid with depth and stereo feeling, although he/she watches only two-dimensional image/video. A design example of the pyramid reflector is shown in [3], and specifications of the pyramid reflector used in the testing platform are indicated in Table 2. Two concave mirrors are set to face so as to make those rims coincide with each other, and then it is possible to show that an object close to the focal point of one concave mirror seems to be close to the focal point of the other concave mirror.…”

“…Next, as for the interaction method between a user and the model, we prepare a simple but similar method to actual hand-finger operations on pottery on a potter's wheel, in which the index finger movement takes care of the external surface and the total height, and the thumb movement makes the inner shape. Those are implemented in the three-dimensional aerial image interface (3DAII) [1][2][3] developed in our laboratory to build a simulated experience system. We confirm the operation of the proposed object model (layered cylinder model) and the functions of the prepared interaction method (a simple but similar method to actual hand-finger operations) through a preliminary evaluation of participants.…”