No abstract

Hand shape is a natural and human-friendly interface for human-computer interaction. This paper proposes a realtime and 2D vision-based hand shape recognition method. The method is robust to hand pose changes because the hand pose is neutralized after recognizing a hand pose using distance transform, principal component analysis (PCA), and histogram analysis. Also, the context-based recognition method using shape decomposition can effectively recognize tiny changes of fingers. The method worked at 44.8 fps and had a recognition rate of 83% on average in the experiment with 800 images including 5 hand shapes and 16 hand poses.

No abstract

Hand shape recognition is a fundamental technique for implementing natural human-computer interaction. In this paper, we discuss a method for effectively detecting a hand region in Kinect-based hand shape recognition. Since Kinect is a camera that can capture color images and infrared images (or depth images) together, both images can be exploited for the process of detecting a hand region. That is, a hand region can be detected by finding pixels having skin colors or by finding pixels having a specific depth. Therefore, after analyzing the performance of each, we need a method of properly combining both to clearly extract the silhouette of hand region. This is because the hand shape recognition rate depends on the fineness of detected silhouette. Finally, through comparison of hand shape recognition rates resulted from different hand region detection methods in general environments, we propose a high-performance hand region detection method.

This paper proposes a user immersive augmented reality (AR) system which utilizes three kinds of computer vision technology: projector-camera-based spatial AR, hand-gesturebased user interaction, and mobile AR. The proposed system augments 2D virtual contents on a tabletop using the projectorcamera-based AR, and a user can interact with the augmented 2D contents by using natural hand gestures and a physical object by using smart phone. Also, the proposed system further enhances user-immersion by adopting the mobile AR, which augments 3D virtual contents on the physical object when user sees the object through smart phone's camera. This paper verifies the effectiveness of the proposed AR system through implementing a car driving application. Keywords-projector-camera system; mobile augmented reality; hand-gesture-based interface; object trackingI.