Nouse ‘use your nose as a mouse’ perceptual vision technology for hands-free games and interfaces

A Prototype System for Controlling a Computer by Head Movements and Voice Commands

“…Regardless of the significant advances recently made in vision-based face detection, of which we acknowledge the following techniques as the ones contributing the most to the field: developed for automatic detection of faces [24] and eyes [14], 3D-face-model-based tracking [30] and robust sub-pixel precision nose tracking [12] should be specially acknowledged, the desired hands-free face-tracking-based cursor control has not been achieved yet.…”

FaceMouse: A Human-Computer Interface for Tetraplegic People

“…Unfortunately most of these systems are not enough reliable and robust to be usable by a seriously disabled user to pilot the mouse with precision. Moreover, in order to move, for example, the mouse pointer, these systems use a paradigm called "pointer paradigm" based on the idea that "what I look is what I want": the user must directly indicate the point of interest on the screen [7,8]. This task requires a precise control of the used part of the body (e.g, the head), but, unfortunately, many people with disabilities do not have this ability.…”

“…The used tracking algorithm discriminates among these proposals: there have been proposals for probabilistic algorithms [9,10], for algorithms based on the Kalman filter [11,12] and on template matching [7,8], and many others.…”

“…), but, in order to assure a tracking more robust, it should be univocally detectable, and invariant to rotations, translations, and scale changes. It has been demonstrated [8,15] that the features that better exhibit these characteristics are those represented by convex shapes and the only convex shape easily visible on human face is the nose tip. Assuming light conditions constant between two consecutive frames, normalized cross correlation [16,17] can be exploited to perform at time t the template matching with respect to the tem- Several improvements have been introduced to increase the reliability and robustness of the system.…”

Towards a Multi-camera Mouse-replacement Interface

“…These systems function as mouse-replacement software that allow users to control a computer mouse pointer with head movements. The movements of the user's head [6], nose [4,5,7] or other features [4] are converted into movements of the mouse pointer on the screen. To mimic the functionality of a left mouse click, a mouse replacement system typically evaluates the length of time that the pointer dwells over an icon, button, or menu item (or its surrounding region) and then issues a selection command.…”