A kinetic and 3D image input device

Numazaki, Shunichi; Morshita, Akira; Umeki, Naoko; Ishikawa, M.; Doi, Miwako

doi:10.1145/286498.286723

Cited by 18 publications

(8 citation statements)

References 1 publication

Supporting

Mentioning

Contrasting

Order By: Relevance

“…1) that uses an innovative image processing technology to eliminate the background from a captured image and extract only an image of the target object by using light reflection principles [11]. Figure 2 shows the operating principles of the Motion Processor.…”

Section: Motion Processor Principlesmentioning

confidence: 99%

A real‐time vision‐based interface using Motion Processor and applications to robotics

Mihara

Yamauchi

Doi

2003

Systems & Computers in Japan

Self Cite

View full text Add to dashboard Cite

SUMMARYThe authors developed a new vision-based interface that detects gestures in real time to enable interaction between the user and computer. This vision-based interface consists of two elements: the "Motion Processor TM " and the "extraction of the region of interest (ROI)." The Motion Processor is a new image acquisition device. By illuminating the target object with near-infrared light and using image sensors to collect the reflected light, the Motion Processor can eliminate the background and collect shape, motion, and depth information of only the target object. In addition, the authors proposed a method of using the collected image depth information to quickly and stably extract the ROI and showed, according to evaluation experiments on a PC, that the region can be detected with high precision within 0.06 second. Real-time sensing of the shape and motion of a specific object from an image can be implemented by using the Motion Processor and this ROI extraction method, enabling this interface to function as a computer eye that can easily recognize a target object. The authors applied this real-time vision-based interface to the field of robotics and used it together with speech recognition on a single PC to create a prototype of a pet robot system that can respond to the user's gestures.

show abstract

Section: Motion Processor Principlesmentioning

confidence: 99%

A real‐time vision‐based interface using Motion Processor and applications to robotics

Mihara

Yamauchi

Doi

2003

Systems & Computers in Japan

Self Cite

View full text Add to dashboard Cite

show abstract

“…Other types of vision-based systems include HoloWall [13] and Motion Processor [14]. Both systems use a video camera with an optical infrared filter for recognition, and infrared lights are used to illuminate objects in front of the camera.…”

Section: Related Workmentioning

confidence: 99%

SmartSkin

Rekimoto

2002

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

499

View full text Add to dashboard Cite

This paper introduces a new sensor architecture for making interactive surfaces that are sensitive to human hand and finger gestures. This sensor recognizes multiple hand positions and shapes and calculates the distance between the hand and the surface by using capacitive sensing and a mesh-shaped antenna. In contrast to camera-based gesture recognition systems, all sensing elements can be integrated within the surface, and this method does not suffer from lighting and occlusion problems. This paper describes the sensor architecture, as well as two working prototype systems: a table-size system and a tablet-size system. It also describes several interaction techniques that would be difficult to perform without using this architecture.

show abstract

“…We use the Motion Processor hardware and software by Toshiba Corporation for gesture recognition [2]. It can obtain rough range data from the brightness of target objects illuminated by the infrared LEDs around the camera.…”

Section: System Configurationmentioning

confidence: 99%

Human-robot interface based on the mutual assistance between speech and vision

Yoshizaki

Kuno

Nakamura

2001

Proceedings of the 2001 Workshop on Perceptive User Interfaces

View full text Add to dashboard Cite

This paper presents a user interface for a service robot that can bring the objects asked by the user. Speech-based interface is appropriate for this application. However, it alone is not sufficient. The system needs a vision-based interface to recognize gestures as well. Moreover, it needs vision capabilities to obtain the real world information about the objects mentioned in the user's speech. For example, the robot needs to find the target object ordered by speech to carry out the task. This can be considered that vision assists speech. However, vision sometimes fails to detect the objects. Moreover, there are objects for which vision cannot be expected to work well. In these cases, the robot tells the current status to the user so that he/she can give advice by speech to the robot. This can be considered that speech assists vision through the user. This paper presents how the mutual assistance between speech and vision works and demonstrates promising results through experiments.

show abstract

A kinetic and 3D image input device

Abstract: Gesture recognition in real time can bridge a gap between humans and computers. Object segmentation from the background is a critical problem in the conventional gesture

Cited by 18 publications

References 1 publication

A real‐time vision‐based interface using Motion Processor and applications to robotics

A real‐time vision‐based interface using Motion Processor and applications to robotics

SmartSkin

Human-robot interface based on the mutual assistance between speech and vision

Contact Info

Product

Resources

About