Detection and tracking of pianist hands and fingers

Gorodnichy, Dmitry O.; Yogeswaran, Arjun

doi:10.1109/crv.2006.26

Cited by 24 publications

(15 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The method proposed by Gorodnichy and Yogeswaran attempts to solve the same problem as identified by Dawe; that is, Gorodnichy and Yogeswaran present a solution to allow current remote piano teaching systems to communicate fingering information [4]. There is one major limitation of Gorodnichy and Yogeswaran's method; the camera used is not an off-the-shelf webcam, but instead a more expensive video camera with high quality output and zoom functionality is required.…”

Section: Related Workmentioning

confidence: 97%

See 1 more Smart Citation

Key detection for a virtual piano teacher

Goodwin

Green

2013

2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013)

View full text Add to dashboard Cite

We propose a method for identifying a piano keyboard present in the video footage of a standard webcam with the goal of teaching chords, scales and suggested finger positions to a beginner pianist. Our keyboard identification method makes use of binary thresholding, Sobel operators and Hough transforms, as well as proposed algorithms specific to this application, to first find an area resembling a piano keyboard before narrowing the search to detect individual keys. Through the use of our method the keys of a piano keyboard were successfully identified from webcam video footage, with a tolerance to camera movement and occluded keys demonstrated. This result allowed the augmented reality style highlighting of individual keys, and the display of suggested fingering, for various chords and scales -which demonstrates the potential for our piano teacher program as a learning tool. The demo application achieved an average frame rate of 25.1 frames per second when run on a 2.20GHz dual-core laptop with 4GB RAM; a suitable rate for real-time use.

show abstract

Section: Related Workmentioning

confidence: 97%

“…Furthermore, there is a significant amount of existing work with an emphasis on finger detection and/or piano playing technique [1,2,[5][6][7][8][9][10][11]; however there are relatively few papers which look at keyboard detection in detail [3,4,12] -as is the primary technical focus of this paper.…”

Section: Related Workmentioning

confidence: 99%

Key detection for a virtual piano teacher

Goodwin

Green

2013

2013 28th International Conference on Image and Vision Computing New Zealand (IVCNZ 2013)

View full text Add to dashboard Cite

show abstract

“…Thus, an initialization and an extensive learning phase of the system is necessary for each user. Gorodnichy et al [14] get the hand templates through ground subtraction in the initialization phase, and then use deformable templates to track the hand which could be highly deformable. The methods exposed above rely heavily on complex image segmentation and pattern matching algorithms.…”

Section: Related Workmentioning

confidence: 99%

Transforming a Regular Screen Into a Touch Screen Using a Single Webcam

Zhang

Saboune

Saddik

2014

J. Display Technol.

View full text Add to dashboard Cite

Nowadays, touch screens are widely used in many commercial devices. In this paper, we present an inexpensive webcam-based touch screen system based on a simple and generic finger detection technique. Only a single webcam and a regular screen are used to achieve this goal. By using the scene geometry and the camera model, we can determine the position of the finger on the screen. The technique we propose is simple and works well under various surrounding environments while the detecting method suits many finger colors and shapes. Our approach can also be used for realtime applications. Experimental results and practical applications are provided to ascertain the proposed method.

show abstract

“…Different sizes have been used by different researchers depending up on the application, hardware etc., such as 320×240 by [68], 160×120 by [92].…”

Section: Dimension Unificationmentioning

confidence: 99%

Hand Gesture Recognition Systems: A Survey

Sarkar¹,

Sanyal²,

Majumder³

2013

IJCA

View full text Add to dashboard Cite

Gesture was the first mode of communication for the primitive cave men. Later on human civilization has developed the verbal communication very well. But still nonverbal communication has not lost its weightage. Such nonverbal communication are being used not only for the physically challenged people, but also for different applications in diversified areas, such as aviation, surveying, music direction etc. It is the best method to interact with the computer without using other peripheral devices, such as keyboard, mouse. Researchers around the world are actively engaged in development of robust and efficient gesture recognition system, more specially, hand gesture recognition system for various applications. The major steps associated with the hand gesture recognition system are; data acquisition, gesture modeling, feature extraction and hand gesture recognition. There are several sub-steps and methodologies associated with the above steps. Different researchers have followed different algorithm or sometimes have devised their own algorithm. The current research work reviews the work carried out in last twenty years and a brief comparison has been performed to analyze the difficulties encountered by these systems, as well as the limitation. Finally the desired characteristics of a robust and efficient hand gesture recognition system have been described. General TermsHand gesture recognition, comparison KeywordsData acquisition, gesture modeling, feature extraction, hand gesture recognition INTRODUCTIONGesture is a form of non-verbal communication using various body parts, mostly hand and face. Gesture is the oldest method of communication in human. Primitive men used to communicate the information of food/ prey for hunting, source of water, information about their enemy, request for help etc. within themselves through gestures. Still gestures are used widely for different applications on different domains. This includes human-robot interaction, sign language recognition, interactive games, vision-based augmented reality etc. Another major application of gestures is found in the aviation industry for placing the aircraft in the defined bay after landing, for making the passengers aware about the safety features by the airhostess. For communication by the people at a visible, but not audible distance (surveyors) and by the physically challenged people (mainly the deaf and dumb) gesture is the only method. With the advancement of human civilization, the difficulty of interpersonal communication, not only in terms of language, but also in terms of communication between common people and hearing impaired people is gradually being abolished. If development of sign language is the first step, then development of hand recognition system using computer vision is the second step. Several works have been carried out worldwide using Artificial Intelligence for different sign languages.Human-robot interaction [1] is another area where hand gesture recognition has been successfully used. The use of keyboard and mouse...

show abstract

Detection and tracking of pianist hands and fingers

Abstract: Abstract

Cited by 24 publications

References 11 publications

Key detection for a virtual piano teacher

Key detection for a virtual piano teacher

Transforming a Regular Screen Into a Touch Screen Using a Single Webcam

Hand Gesture Recognition Systems: A Survey

Contact Info

Product

Resources

About