A Novel Music Player Controlling Design Based on Gesture Recognition

Abstract

This study has proposed a novel music player controlling method based on gesture recognition, which translating the gesture interacting signal into a controlling instruction for the music player. Firstly, utilizing the laptop's webcam to capture the image information, and then employing the image processing method to tackle it. The skin color detection was used to obtain the information of gesture candidates, and a background subtraction was introduced to eliminate the distributing information. Moreover, in order to ensure the rapid and effective implementation of music player proposed here, the barycenter of a gesture was calculated as one Recognized Reference Information (RRI); a ratio between the gesture's width and height was also selected as the other RRI; the comparison of these two RRI values was utilized to obtain a pattern signal of the gesture which was corresponding to the controlling instruction for the Music Player. Eventually, a Music Player was programmed and the pattern signal generated by gesture recognition was used to control the Music Player as willing to realize four basic functions: "play", "pause", "previous" and "next". A series of tests using our gesture recognition based Music Player was conducted under the condition with different kinds of complex backgrounds, and the results showed the satisfactory performance of our interactive designing.

Evaluating the utility of two gestural discomfort evaluation methods

“…As gesture recognition technologies mature and become more available, designed UE gestures are being increasingly utilized for human-machine interaction (HMI) [ 4 – 6 ]. Currently, applications of gesture-based interaction include machine/device control [ 7 , 8 ], data exploration in virtual reality [ 9 ], artistic creation [ 10 ], musical instrument playing [ 11 ], and games [ 12 – 15 ]. Gestures are also being utilized to evoke functions and commands during routine computer tasks, such as word processing [ 16 ] and web browsing [ 17 – 20 ], partly replacing the traditional keyboard and mouse-based input system.…”