Efficient Eye Blink Detection Method for disabled-helping domain

Abstract

Abstract-In this paper, we present a real time method based on some video and image processing algorithms for eye blink detection. The motivation of this research is the need of disabling who cannot control the calls with human mobile interaction directly without the need of hands. A Haar Cascade Classifier is applied for face and eye detection for getting eye and facial axis information. In addition, the same classifier is used based on Haar-like features to find out the relationship between the eyes and the facial axis for positioning the eyes. An efficient eye tracking method is proposed which uses the position of detected face. Finally, an eye blinking detection based on eyelids state (close or open) is used for controlling android mobile phones. The method is used with and without smoothing filter to show the improvement of detection accuracy. The application is used in real time for studying the effect of light and distance between the eyes and the mobile device in order to evaluate the accuracy detection and overall accuracy of the system. Test results show that our proposed method provides a 98% overall accuracy and 100% detection accuracy for a distance of 35 cm and an artificial light.

Developing a Novel Hands-Free Interaction Technique Based on Nose and Teeth Movements for Using Mobile Devices

“…Most of the existing systems focus on the interactions with desktop computer using different gestures [1], [2], [4], [5], [7], [8], [13], [21], BCI [28], [30], or person's breath [29]. There are a very few studies focusing on smartphone interaction [6], [23]. In [6], eye blink detection based on the eyelids state is used for only controlling the phone call functionality.…”

“…There is little research done till now using different facial components to enable users to interact with their smartphone. For example, a system is proposed in [6] for the disabled users so that they can make phone calls completely hands-free. This system presents a real time method based on some video and image processing algorithms for eye blink detection.…”

“…This system presents a real time method based on some video and image processing algorithms for eye blink detection. If the eyes are closed, it means the eyes blinked, and a call to a specific phone number will be made, otherwise no phone call will be made [6]. In another system [23], hand gestures are used to give commands to the mobile device.…”

“…People with different conditions like cerebral palsy, neurological injury or stroke, disability of the limbs, loss of arms due to accidents or other hand related disabilities are unable to interact with desktop computers and smartphones in the usual way [1], [4]- [6]. Research in the field of HCI has introduced various alternative means of interaction with mostly desktop computers through different facial components like nose, eyes, teeth, etc.…”

“…Among these, most of the articles focused on the nose and teeth for interaction with desktop computers [1], [2], [7] whereas, voice based interaction is used in some mouse operations [7]. Some other works focus on the use of eye movements to interact with desktop computers [4], [5], [8] and eye blinking to interact with smartphones [6]. An Android-based application has also been developed to use smartphone using only the movement of the human-face [9].…”