A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear

Futami, Kyosuke; Tabuchi, Yuki; Murao, Kazuya; Terada, Tsutomu

doi:10.1145/3487664.3487760

Cited by 2 publications

(4 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Many studies have been conducted that use infrared distance sensors in conjunction with eyeglasses. For recognizing the direction and movement of the eyeball, Futami et al [14] proposed a method by sensing the movement of the skin around the eye based on an infrared distance sensor attached to the inside of glasses. Using an infrared distance sensor attached to a position that detects a movement around the cheeks and outer corners of the eyes, Fukumoto et al [15] proposed a method to recognize a smile in multiple stages.…”

Section: Skin Movement Sensing Methods Using An Infrared Distance Sensormentioning

confidence: 99%

Augmenting Ear Accessories for Facial Gesture Input Using Infrared Distance Sensor Array

2022

Self Cite

View full text Add to dashboard Cite

Simple hands-free input methods using ear accessories have been proposed to broaden the range of scenarios in which information devices can be operated without hands. Although many previous studies use canal-type earphones, few studies focused on the following two points: (1) A method applicable to ear accessories other than canal-type earphones. (2) A method enabling various ear accessories with different styles to have the same hands-free input function. To realize these two points, this study proposes a method to recognize the user’s facial gesture using an infrared distance sensor attached to the ear accessory. The proposed method detects skin movement around the ear and face, which differs for each facial expression gesture. We created a prototype system for three ear accessories for the root of the ear, earlobe, and tragus. The evaluation results for nine gestures and 10 subjects showed that the F-value of each device was 0.95 or more, and the F-value of the pattern combining multiple devices was 0.99 or more, which showed the feasibility of the proposed method. Although many ear accessories could not interact with information devices, our findings enable various ear accessories with different styles to have eye-free and hands-free input ability based on facial gestures.

show abstract

Section: Skin Movement Sensing Methods Using An Infrared Distance Sensormentioning

confidence: 99%

Augmenting Ear Accessories for Facial Gesture Input Using Infrared Distance Sensor Array

2022

Self Cite

View full text Add to dashboard Cite

show abstract

“…Dual Blink [19] also has functions to physically induce user's blinks by hitting the eyelids with an air cannon. Futami et al [24,25] and Masai et al [35] proposed a method that recognizes gaze movements. In addition, some studies have shown that an infrared distance sensor is suitable for wearable devices that can be continuously used from multiple perspectives (e.g., power consumption) [19,22].…”

Section: Recognition Methods Of Skin Movement Using Infrared Distance...mentioning

confidence: 99%

“…One of the disadvantages of this method is that the recognition accuracy of the method decreases in situations where there is significant environmental sound [44]. Gaze movement is also used as an input method [2,3,24,25,35] because gaze can reflect the user's intention. There is also a method that uses movement of the head, for purposes such as turning pages when browsing [45] and operating the cursor (e.g., desktop devices [46], mobile devices [47]).…”

Section: Simple Hands-free Input Methodsmentioning

confidence: 99%

See 1 more Smart Citation

Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array

et al. 2022

View full text Add to dashboard Cite

With the spread of eyewear devices, people are increasingly using information devices in various everyday situations. In these situations, it is important for eyewear devices to have eye-based interaction functions for simple hands-free input at a low cost. This paper proposes a gaze movement recognition method for simple hands-free interaction that uses eyewear equipped with an infrared distance sensor. The proposed method measures eyelid skin movement using an infrared distance sensor inside the eyewear and applies machine learning to the time-series sensor data to recognize gaze movements (e.g., up, down, left, and right). We implemented a prototype system and conducted evaluations with gaze movements including factors such as movement directions at 45-degree intervals and the movement distance difference in the same direction. The results showed the feasibility of the proposed method. The proposed method recognized 5 to 20 types of gaze movements with an F-value of 0.96 to 1.0. In addition, the proposed method was available with a limited number of sensors, such as two or three, and robust against disturbance in some usage conditions (e.g., body vibration, facial expression change). This paper provides helpful findings for the design of gaze movement recognition methods for simple hands-free interaction using eyewear devices at a low cost.

show abstract

A Method to Recognize Eyeball Movement Gesture using Infrared Distance Sensor Array on Eyewear

Cited by 2 publications

References 13 publications

Augmenting Ear Accessories for Facial Gesture Input Using Infrared Distance Sensor Array

Augmenting Ear Accessories for Facial Gesture Input Using Infrared Distance Sensor Array

Exploring Gaze Movement Gesture Recognition Method for Eye-Based Interaction Using Eyewear with Infrared Distance Sensor Array

Contact Info

Product

Resources

About