EyeTAP: Introducing a multimodal gaze-based technique using voice inputs with a comparative analysis of selection techniques

Parisay, Mohsen; Poullis, Charalambos; Kersten-Oertel, Marta

doi:10.1016/j.ijhcs.2021.102676

Cited by 13 publications

(3 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This makes it challenging to locate the gaze position accurately and thus can trigger the Midas touch problem. The key to tackling the Midas touch problem is to analyse the eye movement metrics through the cognitive process and separate users' true intention from the unintentional activities [51,61,183,199]. The other applications that combine fixation and eye-opening/closing actions to select and manipulate objects can be further explored.…”

Section: Discussionmentioning

confidence: 99%

An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices

Lei

Khamis

et al. 2023

ACM Comput. Surv.

View full text Add to dashboard Cite

In recent years we have witnessed an increasing number of interactive systems on handheld mobile devices which utilise gaze as a single or complementary interaction modality. This trend is driven by the enhanced computational power of these devices, higher resolution and capacity of their cameras, and improved gaze estimation accuracy obtained from advanced machine learning techniques, especially in deep learning. As the literature is fast progressing, there is a pressing need to review the state of the art, delineate the boundary, and identify the key research challenges and opportunities in gaze estimation and interaction. This paper aims to serve this purpose by presenting an end-to-end holistic view in this area, from gaze capturing sensors, to gaze estimation workflows, to deep learning techniques, and to gaze interactive applications.

show abstract

Section: Discussionmentioning

confidence: 99%

An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices

Lei

Khamis

et al. 2023

ACM Comput. Surv.

View full text Add to dashboard Cite

show abstract

“…Miniotas et al (2006) combined voice control with the eye-control system to improve the accuracy of pointing at small target controls. The EyeTAP system proposed by Parisay et al (2020) replaced voice control with sound pulse recognition to render the system more robust under environmental noise disturbances. In addition, some researchers introduced special facial interactions, such as breathing and lip-speaking, into the eye-control system (Su et al, 2021;Onishi et al, 2022).…”

Section: Eye Interaction Movement Researchmentioning

confidence: 99%

Magilock: a reliable control triggering method in multi-channel eye-control systems

Ya-Feng,

Jia-Xin,

Jin

2024

Front. Hum. Neurosci.

View full text Add to dashboard Cite

Eye-tracking technology brings a different human-computer interaction experience to users because of its intuitive, natural, and hands-free operation characteristics. Avoiding the Midas touch problem and improving the accuracy of interaction are among the main goals of the research and development of eye-control systems. This study reviews the methods and limitations of research on avoiding the Midas touch problem. For typical control clicking operations with low fault tolerance, such as mode switching and state selection in an eye-control system, this study proposes Magilock, a more reliable control triggering method with a high success rate in multi-channel eye-control systems. Magilock adds a control pre-locked mechanism between the two interactive steps of eye-control channel positioning control and other interactive channel triggering controls in the multi-channel eye-control system. This effectively avoids incorrect control triggering caused by multi-channel coordination disorder and gaze-point drift. This study also conducted ergonomic experiments to explore the lock and unlock times of the control pre-locked mechanism in Magilock. Taking into account the experimental data and subjective evaluation of the participants, we recommend setting the lock time and the unlock time of Magilock to 200 ms.

show abstract

“…The purpose of the first evaluation was to study the ESPiM model. In this study, we used the unpublished datasets of our previous paper EyeTAP [35] in which we collected large amounts of infrared eye-tracking data.…”

Section: User Study 1: Fitts' Study (In-person)mentioning

confidence: 99%

IDEA: Index of Difficulty for Eye Tracking Applications - An Analysis Model for Target Selection Tasks

Parisay

Poullis

Kersten-Oertel

2021

Proceedings of the 16th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Application

View full text Add to dashboard Cite

Eye-strain is a common issue among computer users due to the prolonged periods they spend working in front of digital displays. This can lead to vision problems, such as irritation and tiredness of the eyes and headaches. We propose the Eye-Strain Probation Model (ESPiM), a computational model based on eye-tracking data that measures eye-strain on digital displays based on the spatial properties of the user interface and display area for a required period of time. As well as measuring eye-strain, ESPiM can be applied to compare (a) different user interface designs, (b) different display devices, and (c) different interaction techniques. Two user studies were conducted to evaluate the effectiveness of ESPiM. The first was conducted in the form of an in-person study with an infrared eye-tracking sensor with 32 participants. The second was conducted in the form of an online study with a video-based eye-tracking technique via webcams on users' computers with 13 participants. Our analysis showed significantly different eye-strain patterns based on the video gameplay frequency of participants. Further, we found distinctive patterns among users on a regular 9-to-5 routine versus those with more flexible work hours in terms of (a) error rates and (b) reported eye-strain symptoms.

show abstract

EyeTAP: Introducing a multimodal gaze-based technique using voice inputs with a comparative analysis of selection techniques

Cited by 13 publications

References 12 publications

An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices

An End-to-End Review of Gaze Estimation and its Interactive Applications on Handheld Mobile Devices

Magilock: a reliable control triggering method in multi-channel eye-control systems

IDEA: Index of Difficulty for Eye Tracking Applications - An Analysis Model for Target Selection Tasks

Contact Info

Product

Resources

About