Possibilities and challenges with eye tracking in video games and virtual reality applications

Sundstedt, Veronica; Navarro, Diego; Mautner, Julian

doi:10.1145/2988458.2988466

Cited by 15 publications

(3 citation statements)

References 62 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Eye-tracking has found applications in the field of video games in various ways. It has been utilized as an input mechanism for controlling games, as a tool for examining player behaviour after gameplay, and as a supplementary method to enhance existing interaction techniques [1]. Specifically, eyetracking technology has been applied in first-person shooter games to assist players in maintaining precise aim even when the target is in motion [2], as well as in the concept design of the first flight simulators to adjust the player's visual perspective [3].…”

Section: Flight Simulator Games Pilotsmentioning

confidence: 99%

Using Eye-Tracking for Adaptive Human-Machine Interfaces for Pilots: A Literature Review and Sample Cases

Xenos,

Mallas,

Minas

2024

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

This paper explores the potential of eye-tracking technology in adaptive human-machine interfaces for pilots in aviation. We argue that an interface able to adjust its layout and elements based on pilots’ real-time eye-tracking data can prevent errors and enhance their performance. The study presents a literature review on the use of eye-tracking for various pilot cases, including flight simulator games, drone pilots, and cockpit pilots. Results in most cases showed that eye-tracking has been employed to improve interactions, enhance spatial awareness, guide pilots’ gaze to relevant areas, and provide insights into pilots’ information processing and task load. The paper discusses two sample cases demonstrating the potential of eye-tracking in adaptive human-machine interfaces. In the first case, during challenging drone simulations, eye-tracking identified areas where an adaptive human-machine interface could aid navigation and reduce cognitive load. In the second one, based on real drone flights, when signal loss incidents occurred, eye-tracking data showed that the interface should adapt to pilots’ needs by providing critical information to help them to improve situational awareness. The paper concludes that eye-tracking technology has significant potential in adaptive human-machine interfaces for aviation, emphasising the importance of refining these technologies to meet pilots’ specific needs and enhance flight safety.

show abstract

Section: Flight Simulator Games Pilotsmentioning

confidence: 99%

Using Eye-Tracking for Adaptive Human-Machine Interfaces for Pilots: A Literature Review and Sample Cases

Xenos,

Mallas,

Minas

2024

J. Phys.: Conf. Ser.

View full text Add to dashboard Cite

show abstract

“…Siggraph Asia course on possibilities and challenges with eye-tracking in video games and VR applications Sundstedt et al (2016) o Review of eye-tracking in video games and VR applications. o Possibilities and challenges with gaze-based interaction.…”

Section: Eye-tracking and Vrmentioning

confidence: 99%

A review of current trends on visual perception studies in virtual and augmented reality

Garro

Sundstedt

Navarro

2020

SIGGRAPH Asia 2020 Courses

Self Cite

View full text Add to dashboard Cite

“…Their findings revealed that gaze and brain-computer interface inputs resulted in a decrease in player performance. In [27], Sundstedt et al discussed possibilities and challenges in video games and virtual reality applications. They reported that gaze interaction is novel in games and virtual reality applications and further research is needed to evaluate the possibilities.…”

Section: Gaze Control In Multimodal Contextsmentioning

confidence: 99%

User interaction in hands-free gaming: a comparative study of gaze-voice and touchscreen interface control

Uludağli¹,

Acartürk²

2018

Turk J Elec Eng & Comp Sci

View full text Add to dashboard Cite

The goal of the present study is to contribute to the research on the use of eye tracking in hands-free gaming.We report the results of an experimental study by using a platform game designed by the authors. The game allowed gaze-voice command control, as well touchscreen control of the interface by the player. We employed a set of performance measures and we measured player engagement as an indicator of user experience. The findings revealed that the players did not improve in game performance when they used the gaze-voice control compared to the touchscreen control. On the other hand, they exhibited stronger engagement, which indicates the potential of gaze-voice combination as an acceptable interaction method compared to touchscreen in mobile games.

show abstract

Possibilities and challenges with eye tracking in video games and virtual reality applications

Cited by 15 publications

References 62 publications

Using Eye-Tracking for Adaptive Human-Machine Interfaces for Pilots: A Literature Review and Sample Cases

Using Eye-Tracking for Adaptive Human-Machine Interfaces for Pilots: A Literature Review and Sample Cases

A review of current trends on visual perception studies in virtual and augmented reality

User interaction in hands-free gaming: a comparative study of gaze-voice and touchscreen interface control

Contact Info

Product

Resources

About