An Eye Tracking based Aircraft Helmet Mounted Display Aiming System

Li, Mengtang; Qiu, Quanlong; Zhu, Jie; Gou, Chao

doi:10.36227/techrxiv.18093233.v1

Cited by 1 publication

(1 citation statement)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…By leveraging advanced neural network architecture, we propose a deep learning-based method for accurate eye features extraction. A preliminary study was done by the authors in a previous preprint [24].…”

Section: Introductionmentioning

confidence: 99%

Eye Gaze Estimation Based on Stacked Hourglass Neural Network for Aircraft Helmet Aiming

Qiu

Zhu

Gou

et al. 2022

International Journal of Aerospace Engineering

Self Cite

View full text Add to dashboard Cite

Helmet-mounted display (HMD) systems allow aircraft pilots to aim at targets by using head postures. However, the direct use of helmet orientation to indicate the aiming direction ignores human eye movements, which are more flexible and efficient for interaction. Since the opaqueness of the helmet goggle blocks the sight of external cameras to capture facial or eye images of the pilots, and traditional eye feature extraction methods may fail when encountering conditions such as poor lighting, occlusion, and shaking, which are common on fighter aircrafts. In this work, an eye gaze based aiming solution that adapts to pilots wearing HMDs is proposed, and a deep learning-based method is proposed to extract eye features robustly. The prototype experiments demonstrate the ability to pick and aim at targets in real-time (60FPS) and are capable to accurately locate the target markers on a screen with an average error of fewer than 2 degrees. Conclusively, the proposed method performs the tasks of eye feature extraction on real-person imagery and the estimation of the 3D aiming direction for users with helmets, displaying competitive results with similar research.

show abstract

Section: Introductionmentioning

confidence: 99%