Controlling a PC by Eye Movements: The MEMREC Project

Fejtová, Marcela; Fejt, Jan; Lhotska, Lenka

doi:10.1007/978-3-540-27817-7_114

Cited by 10 publications

(10 citation statements)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The third way is typing by gestures. I4control system [19] uses eyes to control a cursor moving over an alphabet and blinks are used to make selections. Eyes work like a joystick.…”

Section: Related Workmentioning

confidence: 99%

Efficient eye typing with 9-direction gaze estimation

Zhang

Yao

Cai

2017

Multimed Tools Appl

View full text Add to dashboard Cite

Abstract-Vision based text entry systems aim to help disabled people achieve text communication using eye movement. Most previous methods have employed an existing eye tracker to predict gaze direction and design an input method based upon that. However, these methods can result in eye tracking quality becoming easily affected by various factors and lengthy amounts of time for calibration. Our paper presents a novel efficient gaze based text input method, which has the advantage of low cost and robustness. Users can type in words by looking at an on-screen keyboard and blinking. Rather than estimate gaze angles directly to track eyes, we introduce a method that divides the human gaze into nine directions. This method can effectively improve the accuracy of making a selection by gaze and blinks. We build a Convolutional Neural Network (CNN) model for 9-direction gaze estimation. On the basis of the 9-direction gaze, we use a ninekey T9 input method which is widely used in candy bar phones. Bar phones were very popular in the world decades ago and have cultivated strong user habits and language models. To train a robust gaze estimator, we created a large-scale dataset with images of eyes sourced from 25 people. According to the results from our experiments, our CNN model is able to accurately estimate different people's gaze under various lighting conditions by different devices. In considering disable peoples needs, we removed the complex calibration process. The input methods can run in screen mode and portable off-screen mode. Moreover, The datasets used in our experiments are made available to the community to allow further experimentation.

show abstract

“…The third way is typing by gestures. I4control system [19] uses eyes to control a cursor moving over an alphabet and blinks are used to make selections. Eyes work like a joystick.…”

Section: Related Workmentioning

confidence: 99%

Efficient eye typing with 9-direction gaze estimation

Zhang

Yao

Cai

2017

Multimed Tools Appl

View full text Add to dashboard Cite

show abstract

“…Therefore, the homogeneous transformation matrix of the camera frame, with respect to the base frame in the initial and final configuration respectively , will be: (10) where is the rotation matrix of the frame {C} at the instant time t = 0 . The timing law (4) has been also assigned to β with β(t)| t=0 = 0 and β(t)| t=t f = β f in order to simultaneously translate (3)-(7) and rotate (8)-(10) the frame {C} in compliance with RCM constraint.…”

Section: Robot Controlmentioning

confidence: 99%

“…Unfortunately, such methods can result in the use of large amounts of screen coverage and further screen area would be needed to introduce zoom functionality. Blink detection, which was previously used in gaze typing [10], could be another method to capture user intention during camera control. However requiring the surgeon to close their eyes for a fixed amount of time could be dangerous for the patient.…”

Section: Introductionmentioning

confidence: 99%

Gaze contingent cartesian control of a robotic arm for laparoscopic surgery

Fujii

Salerno

Sriskandarajah

et al. 2013

2013 IEEE/RSJ International Conference on Intelligent Robots and Systems

View full text Add to dashboard Cite

This paper introduces a gaze contingent controlled robotic arm for laparoscopic surgery, based on gaze gestures. The method offers a natural and seamless communication channel between the surgeon and the robotic laparoscope. It offers several advantages in terms of reducing on-screen clutter and efficiently conveying visual intention. The proposed hands-free system enables the surgeon to be part of the robot control feedback loop, allowing user-friendly camera panning and zooming. The proposed platform avoids the limitations of using dwell-time camera control in previous gaze contingent camera control methods. The system represents a true hands-free setup without the need of obtrusive sensors mounted on the surgeon or the use of a foot pedal. Hidden Markov Models (HMMs) were used for real-time gaze gesture recognition. This method was evaluated with a cohort of 11 subjects by using the proposed system to complete a modified upper gastrointestinal staging laparoscopy and biopsy task on a phantom box trainer, with results demonstrating the potential clinical value of the proposed system.

show abstract

“…Gaze estimation has been an active research field for the past few years [ 1 – 3 ], and it is an important technique for severely handicapped people who cannot move the body or use speech to communicate [ 4 , 5 ]. Some studies [ 6 – 11 ] have been developing various eye gaze interfaces using different eye movement recording methods. Examples are infrared oculography (IROG) [ 6 – 8 ], limbus tracking, and video oculography (VOG) [ 9 – 11 ].…”

Section: Introductionmentioning

confidence: 99%

“…Some studies [ 6 – 11 ] have been developing various eye gaze interfaces using different eye movement recording methods. Examples are infrared oculography (IROG) [ 6 – 8 ], limbus tracking, and video oculography (VOG) [ 9 – 11 ].…”

Section: Introductionmentioning

confidence: 99%

Gaze Estimation Method Using Analysis of Electrooculogram Signals and Kinect Sensor

Sakurai

Yan

Tanno

et al. 2017

Computational Intelligence and Neuroscience

View full text Add to dashboard Cite

A gaze estimation system is one of the communication methods for severely disabled people who cannot perform gestures and speech. We previously developed an eye tracking method using a compact and light electrooculogram (EOG) signal, but its accuracy is not very high. In the present study, we conducted experiments to investigate the EOG component strongly correlated with the change of eye movements. The experiments in this study are of two types: experiments to see objects only by eye movements and experiments to see objects by face and eye movements. The experimental results show the possibility of an eye tracking method using EOG signals and a Kinect sensor.

show abstract

Controlling a PC by Eye Movements: The MEMREC Project

Cited by 10 publications

References 0 publications

Efficient eye typing with 9-direction gaze estimation

Efficient eye typing with 9-direction gaze estimation

Gaze contingent cartesian control of a robotic arm for laparoscopic surgery

Gaze Estimation Method Using Analysis of Electrooculogram Signals and Kinect Sensor

Contact Info

Product

Resources

About