Eye tracking: the silver bullet of competency assessment in medical image interpretation?

Kok, Esther T.

doi:10.1007/s40037-019-0506-5

Cited by 4 publications

(2 citation statements)

References 12 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Although a high level of experience is assumed to be related to more accurate diagnoses, there is yet limited evidence that scroll-data or even eye-tracking metrics relate to observers’ diagnostic accuracy. However, such a relationship is required if those metrics are to be used for assessment or adaptive instruction (Kok 2019 ).…”

Section: Theoretical Backgroundmentioning

confidence: 99%

“…Errors in medical image interpretation can have significant impact on patient safety, so high-quality residency training programs are crucial for patient safety. Process measures are increasingly valued as additional sources of information about residents’ competence (Kok 2019 ), for example in the context of (formative) assessment and monitoring. Process measures such as computer-log data (time-stamped information on interactions with the computer, for example, scrolling, panning, windowing and zooming) and eye tracking data (time-stamped information on where a person looks, how long and in what order; Kok and Jarodzka 2016 ) provide information that goes beyond outcome variables, for example, about the efficiency of visual search and strategies use (Drew et al 2013 ; Manning et al 2006 ; Venjakob et al 2012 ; Van der Gijp et al 2017 ).…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Expertise development in volumetric image interpretation of radiology residents: what do longitudinal scroll data reveal?

Montfort

Kok

Vincken

et al. 2020

Adv in Health Sci Educ

View full text Add to dashboard Cite

The current study used theories on expertise development (the holistic model of image perception and the information reduction hypothesis) as a starting point to identify and explore potentially relevant process measures to monitor and evaluate expertise development in radiology residency training. It is the first to examine expertise development in volumetric image interpretation (i.e., CT scans) within radiology residents using scroll data collected longitudinally over five years of residency training. Consistent with the holistic model of image perception, the percentage of time spent on full runs, i.e. scrolling through more than 50% of the CT-scan slices (global search), decreased within residents over residency training years. Furthermore, the percentage of time spent on question-relevant areas in the CT scans increased within residents over residency training years, consistent with the information reduction hypothesis. Second, we examined if scroll patterns can predict diagnostic accuracy. The percentage of time spent on full runs and the percentage of time spent on question-relevant areas did not predict diagnostic accuracy. Thus, although scroll patterns over training years are consistent with visual expertise theories, they could not be used as predictors of diagnostic accuracy in the current study. Therefore, the relation between scroll patterns and performance needs to be further examined, before process measures can be used to monitor and evaluate expertise development in radiology residency training.

show abstract

Section: Theoretical Backgroundmentioning

confidence: 99%