A Somatosensory Interaction System based on Kinect

Abstract

Abstract. The somatosensory interaction technique is one form of the perceptual user interface which is used in video game and virtual reality more and more widly. In this paper, a somatosensory interaction system based on Kinect is presented. Firstly, the user performances his action in front of a kinect, the sensing data from kinect is preprocessed and the main features of the action are extracted. Secondly, the performaced action is recognized by the matching algorithm based on Dynamic Time Warping Hidden Markov Model. Finally, the recognized motion is employed to interact with the virtual human and virtual environment. A series of experiments have been done to test the availablity of our system. Results show that the recognition rate is high enough to be used in virtual reality applications.