In this paper, we proposed a contents of Chinese characters learning based on gesture recognition using HMM(hidden markov model) algorithm. Input image of the system is obtained in 3-dimensional information from the TOF camera, and the method of gesture recognition is consisted of part of forecasting user's posture in two infrared images and part of recognizing gestures from continuous poses. In the communication between human and computer, this system provided convenience that user can manipulate it easily by not using any further equipment but action. Because this system raise immersion and interest by using two large display and various multimedia factor, it can maximize information transmission. The edutainment Chinese character contents proposed in this paper provide educational effect that use can master Chinese character naturally with interest, and it can be expected a synergy effect via content experience because it is based on gesture recognition.

In this paper, we propose a large scale entertainment system based on gesture recognition for learning Chinese character contents. The system is consisted of parts that forecast user's posture in two infrared images and part that recognize gestures from continuous poses. And we can divide and acquire in front side pose and side pose about one pose in each IR camera.This entertainment system is immersive in nature and convenient for its gestures based controlling system. Also, it can maximize information transmission because induce immersion and interest using two large size displays and various multimedia elements. The learning Chinese character contents can master Chinese character naturally because give interest to user and supply game and education at the same time. Therefore, it can expect synergy effect that can learn playing to user combining with large entertainment system based on gesture recognition.

No abstract

Normally vision-based 3D human pose recognition technology is used to method for convey human gesture in HCI(Human-Computer Interaction). 2D pose model based recognition method recognizes simple 2D human pose in particular environment. On the other hand, 3D pose model which describes 3D human body skeletal structure can recognize more complex 3D pose than 2D pose model in because it can use joint angle and shape information of body part. In this paper, we describe a development of interactive game contents using pose recognition interface that using 3D human body joint information. Our system was proposed for the purpose that users can control the game contents with body motion without any additional equipment. Poses are recognized comparing current input pose and predefined pose template which is consist of 14 human body joint 3D information. We implement the game contents with the our pose recognition system and make sure about the efficiency of our proposed system. In the future, we will improve the system that can be recognized poses in various environments robustly.

Electronic book is usually used for users who want to read the text book with multimedia contents like video and audio. Many electronic books have been proposed with new interactive technologies such as spectacular multimedia effect, but these books lack in analog sensitivity and have only one way-based information interaction, and consequently those are inefficient for users. To solve the problem, in this paper, we propose a touch based interactive electronic-book; named RealBook, which can improve the interaction skill of the conventional electronic books by applying computer vision technology with SURF algorithm. Our method can use analog sensitivity and fuse digital effects by using user-centric gestures recognition skill. In the near future, we will develop a more unique and interesting system by introducing various gestures for the interaction.