Head mounted displays (HMDs) are convenient tools for presenting visual imagery. The usefulness of HMDs can be extended by integrating eye tracking and voice recognition with the HMD, creating a true hands-free interface. We have developed a low-cost eye tracking system for an HMD using commercially available hardware and easily configurable software developed in-house. This system, along with commercial speech recognition, allows us to control computer applications without the need for a keyboard or mouse.
We discuss the issues involved in controlling computer applications via gestures composed of both static symbols and dynamic motions. Each gesture is modeled from either static model information or a linear-in-parameters dynamic system. Recognition occurs in a real-time environment using a small amount of processing time and memory. We will examine which gestures are appropriate, how the gestures can be recognized, and which commands the gestures should control. The tracking method is detailed, along with its use in providing of coordinates for the gesture control a Powerpoint presentation.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.