Does effective gaze behavior lead to enhanced performance in a complex error-detection cockpit task?

Brams, Stephanie; Hooge, Ignace T. C.; Ziv, Gal; Dauwe, Siska; Evens, Ken; Wolf, Tony De; Levin, Oron; Wagemans, Johan; Helsen, Werner

doi:10.1371/journal.pone.0207439

Cited by 23 publications

(25 citation statements)

References 75 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…While pilots can actively hide task-redundant instruments in trained routines (the exact method of scanning the instrument panel varies between pilots, but some basic features common to a "good" scan pattern are available), the reduction of complexity is much more difficult for teachers in the present study's assessment situation. Aircraft instruments are static, standardized, and a priority ranking in their importance can be made (Brams et al, 2018). On the other hand, teachers in our study had to observe several students simultaneously who acted dynamically and were asked to judge personal traits that are not readily identifiable -blinding out individual students might be much more complicated than instruments that are not required for the correct assessment (i.e., landing a plane).…”

Section: Teachers' Scanpaths Are Idiosyncratic and Driven By Expertisementioning

confidence: 99%

Identifying Expert and Novice Visual Scanpath Patterns and Their Relationship to Assessing Learning-Relevant Student Characteristics

2021

View full text Add to dashboard Cite

The paper addresses cognitive processes during a teacher's professional task of assessing learning-relevant student characteristics. We explore how eye-movement patterns (scanpaths) differ across expert and novice teachers during an assessment situation. In an eye-tracking experiment, participants watched an authentic video of a classroom lesson and were subsequently asked to assess five different students. Instead of using typically reported averaged gaze data (e.g., number of fixations), we used gaze patterns as an indicator for visual behavior. We extracted scanpath patterns, compared them qualitatively (common sub-pattern) and quantitatively (scanpath entropy) between experts and novices, and related teachers' visual behavior to their assessment competence. Results show that teachers' scanpaths were idiosyncratic and more similar to teachers of the same expertise group. Moreover, experts monitored all target students more regularly and made recurring scans to re-adjust their assessment. Lastly, this behavior was quantified using Shannon's entropy score. Results indicate that experts' scanpaths were more complex, involved more frequent revisits of all students, and that experts transferred their attention between all students with equal probability. Experts' visual behavior was also statistically related to higher judgment accuracy.

show abstract

Section: Teachers' Scanpaths Are Idiosyncratic and Driven By Expertisementioning

confidence: 99%

Identifying Expert and Novice Visual Scanpath Patterns and Their Relationship to Assessing Learning-Relevant Student Characteristics

2021

View full text Add to dashboard Cite

show abstract

“…However, some contradictory findings about the relationship between scan pattern systematicity and expertise can be found in the literature. For example, in a study comparing visual search in aircraft pilots with nonpilots while completing a cockpit task, no higher systematicity in visual scanning was observed in the pilots compared with the nonpilots (Brams et al, 2018). In general, the relationship between scan pattern systematicity and expertise is rarely analyzed, and it may be an important measure in various expertise domains (Brams et al, 2019).…”

Section: Systematic Scan Patterns As Indicators For Experience and Superior Perceptual-cognitive Skills In Radiologymentioning

confidence: 99%

“…We used entropy to indicate systematicity of the scan pattern, which was calculated according to the method of Allsop and Gray (2014). The method is based on a transition matrix indicating the chance that the participant's fixation will move from one specific AOI to another specific AOI in a particular order (see Allsop & Gray, 2014;Brams et al, 2018).…”

Section: Dependent Variables and Data Processingmentioning

confidence: 99%

Focal lung pathology detection in radiology: Is there an effect of experience on visual search behavior?

Brams

Ziv

Hooge

et al. 2020

Atten Percept Psychophys

Self Cite

View full text Add to dashboard Cite

In radiology, 60% to 80% of diagnostic errors are perceptual. The use of more efficient visual search behaviors is expected to reduce these errors. We collected eye-tracking data from participants with different levels of experience when interpreting chest X-rays during the completion of a pathology-detection task. Eye-tracking measures were assessed in the context of three existing visual search theories from the literature to understand the association between visual search behavior and underlying processes: the long-term working memory theory, the information-reduction hypothesis, and the holistic model of image perception. The most experienced participants (radiology residents) showed the highest level of performance, albeit their visual search behaviors did not differ from the intermediate group. This suggests that radiology residents better processed the represented information on the X-ray, using a visual search strategy similar to the intermediate group. Since similar visual search resulted in more information extraction in the radiology residents compared with the intermediates, we suggest that this result might support the long-term working memory theory. Furthermore, compared with novices, intermediates and radiology residents fixated longer on areas that were more important to avoid missing any pathology, which possibly confirms the information-reduction hypothesis. Finally, the larger distances between fixations observed in more experienced participants could support the holistic model of image perception. In addition, measures of generic skills were related to a lower time cost for switching between global and local information processing. Our findings suggest that the three theories may be complementary in chest X-ray interpretation. Therefore, a unified theory explaining perceptual-cognitive superiority in radiology is considered.

show abstract

“…Expert pilots tend to have more well defined scan patterns than novices (Kasarskis, Stehwien, Hickox, & Aretz, 2001), however, unlike in sports, chess and medicine, aviation experts tend to have shorter dwell times, and more eye movements, compared to novices or non-pilots (e.g. Bellenkes, Wickens, & Kramer, 1997;Brams et al, 2018;Kasarskis et al, 2001;Xiong et al, 2016). These inconsistencies could be an effect of task type.…”

Section: Eye Tracking Methodsmentioning

confidence: 99%

“…In fact, it was only recently that this theory was re-examined, with the authors finding expert pilots to have a greater proportion of fixations in-between main AOIs compared to non-pilots, and a shorter duration between the appearance of, and subsequent identification of, an error on one of the cockpit instruments. Both of these findings were put down to expert pilots having a larger visual span than novices (Brams et al, 2018). If expert pilots do have a larger perceptual span, they may have a disproportionate impediment when faced with using a HMD (VR) due to the restricted FOV issue previously mentioned.…”

Section: Perceptual Span and Expertisementioning

confidence: 97%

The interplay of eye movements and attention in a continuous flight related task

Ryan¹

View full text Add to dashboard Cite

Driven by global expansion and accessibility of air travel, over the next 20 years approximately 790,000 new pilots are expected to be recruited to meet demand (Boeing Technician and Pilot Outlook, 2018). With 3291 new pilots needed per month to meet this target, significant strain will be placed on the current training system-more trainers will be required, and new training facilities will need to be built. Another potential solution to this problem involves the modification of the current training procedure-for example, the development of advanced technology that can be used as an adjunct to standard training, such as virtual reality (VR). VR training has the advantage of being significantly cheaper, smaller, and thereby more accessible, compared to standard flight training simulators. This provides the opportunity for offsite training, with expert trainers being able to remotely access and assist their students. VR systems will soon be fully equipped with sophisticated eye tracking technology. A significant amount of information regarding the pilot's thought processes and the distribution of attention can be gleaned through the movement of the eyes. A current trend in human factors research is for novices to model the 'gold standard' gaze behaviour of experts. It is thought that if they train from the beginning to utilise the gaze strategies employed by experts, they could become more proficient in a shorter period of time. However, this whole theory relies on the fact that expert pilots physically move their eyes to every item they are attending to. While that may be true the majority of time (Just & Carpenter, 1980), it is now widely accepted that people can covertly attend to a stimulus in their peripheral vision (covert attention; Posner, 1980). Further, there is evidence that experts have an ability to spread their attention more widely than a novice, i.e. have a greater perceptual span. Therefore, an expert may be covertly attending to crucial information within their visual periphery, which standard eye tracking methods would not pick up. Although much has been looked into the relationship between expertise and xi

show abstract

Does effective gaze behavior lead to enhanced performance in a complex error-detection cockpit task?

Cited by 23 publications

References 75 publications

Identifying Expert and Novice Visual Scanpath Patterns and Their Relationship to Assessing Learning-Relevant Student Characteristics

Identifying Expert and Novice Visual Scanpath Patterns and Their Relationship to Assessing Learning-Relevant Student Characteristics

Focal lung pathology detection in radiology: Is there an effect of experience on visual search behavior?

The interplay of eye movements and attention in a continuous flight related task

Contact Info

Product

Resources

About