Consumer electronics control system based on hand gesture moment invariants

Abstract

Almost all consumer electronic equipment today uses remote controls for user interfaces. However, the variety of physical shapes and functional commands that each remote control features also raises numerous problems: the difficulties in locating the required remote control, the confusion with the button layout, the replacement issue and so on. The consumer electronics control system using hand gestures is a new innovative user interface that resolves the complications of using numerous remote controls for domestic appliances. Based on one unified set of hand gestures, this system interprets the user hand gestures into pre-defined commands to control one or many devices simultaneously. The system has been tested and verified under both incandescent and fluorescent lighting conditions. The experimental results are very encouraging as the system produces real-time responses and highly accurate recognition towards various gestures. Disciplines Physical Sciences and Mathematics Publication DetailsThis article was originally published as Premaratne, P, and Nguyen, Q, Consumer electronics control system based on hand gesture moment invariants, IET Computer Vision, 1 (1) Consumer electronics control system based on hand gesture moment invariants P. Premaratne and Q. NguyenAbstract: Almost all consumer electronic equipment today uses remote controls for user interfaces. However, the variety of physical shapes and functional commands that each remote control features also raises numerous problems: the difficulties in locating the required remote control, the confusion with the button layout, the replacement issue and so on. The consumer electronics control system using hand gestures is a new innovative user interface that resolves the complications of using numerous remote controls for domestic appliances. Based on one unified set of hand gestures, this system interprets the user hand gestures into pre-defined commands to control one or many devices simultaneously. The system has been tested and verified under both incandescent and fluorescent lighting conditions. The experimental results are very encouraging as the system produces real-time responses and highly accurate recognition towards various gestures.

Fingertip-based Real Time Tracking and Gesture Recognition for Natural User Interfaces

“…A commonly used method to detect fingers and fingertips is the mathematical morphology and related solutions [18][19][20]. Some approaches use Hu invariant moments [21][22], others k-curvature algorithm [23], combined with template matching [11], [19]. Noise, scale, and hand direction have a significant impact on finding fingers and fingertips using skeleton [24] or dominant points [12] principles.…”

New Structural Similarity Measure for Image Comparison

“…If a metric is produced using this structural information, it will truly capture the structural information and will be a valid measure to evaluate the structural integrity thereby making comparing images more meaningful. Moment Invariants have been used extensively in identifying shapes or outlay of objects for many years [5,6]. An image reduced to 16x16 or larger using Wavelet decomposition can be used to generate moment invariants to identify the structural makeup of an image.…”

“…An image is normalized (divided by its own standard deviation) such that the two images being compared have unit standard deviation. An image reduced to an approximation level (usually larger than 16x16) and then edge detected using 'Canny' operator and first moment invariant (φ 1) is calculated for the entire approximation [5]. Then the approximation level is divided into four quadrants and the first and second moments (φ i1, φ i2) are calculated for each …”

Thinking head: Towards human centred robotics

“…The azimuth system uses a microphone-pair mounted in front of the users. The localization is based on Faller and Merinaa [7] which has been modified and adjusted to the thinking head setup.…”