Test–Retest Reliability of Virtual Reality Devices in Quantifying for Relative Afferent Pupillary Defect

Abstract

Background The swinging flashlight test (SFT) is one of the most prominent clinical tests for detecting the relative afferent pupillary defect (RAPD). A positive RAPD localizes the lesion to the affected afferent pupil pathway and is a critical part of any ophthalmic exam. Testing for an RAPD, however, can be challenging (especially when small), and there is significant intrarater and interrater variability. Methods Prior studies have shown that the pupillometer can improve the detection and measurement of RAPD. In our previous research, we have demonstrated an automatic SFT by utilizing virtual reality (VR), named VR-SFT. We applied our methods to two different brands of VR headsets and achieved comparable results by using a metric, called RAPD score, for differentiating between patients with and without (control) RAPD. We also performed a second VR-SFT on 27 control participants to compare their scores with their first assessments and measure test–retest reliability of VR-SFT. Results Even in the absence of any RAPD positive data, the intraclass correlation coefficient produces results between 0.44 and 0.83 that are considered of good to moderate reliability. The same results are echoed by the Bland–Altman plots, indicating low bias and high accuracy. The mean of the differences of measurements from test–retest ranges from 0.02 to 0.07 for different protocols and different devices. Conclusions As variability among various VR devices is an important factor that clinicians should consider, we discuss the test–retest reliability of VR-SFT and the variability among various assessments and between two devices. Translational Relevance Our study demonstrates the critical necessity of establishing test–retest reliability measures when bridging virtual reality technology into the clinical setting for relevant afferent pupillary defect.

The spaceflight contrast sensitivity hypothesis and its role to investigate the pathophysiology of spaceflight-associated neuro-ocular syndrome

“…The head-mounted device (including CS assessment) may also find future terrestrial applications to allow for more convenient, rapid, and frequent visual assessments, as well as for opportunities for at-home testing ( 17 ). Further research to establish test–retest reliability will also be essential when bringing this technology into the clinical setting ( 18 ).…”

Dynamic Visual Acuity, Vestibulo-Ocular Reflex, and Visual Field in National Football League (NFL) Officiating: Physiology and Visualization Engineering for 3D Virtual On-Field Training

“…The emergence of virtual reality technology has revolutionized many fields, including sports and medicine [ 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 ]. Research in virtual reality has found that decision making in sub-elite soccer officials between on-field and virtual reality were indistinguishable, suggesting virtual reality offers a representative training environment [ 28 ].…”

Topological state-space estimation of functional human brain networks

“…Intraclass correlation (ICC) has long been recognized as a vital reliability and reproducibility metric, especially for gauging similarity in paired data when the order of pairing is not preserved [96,106,107]. In brain imaging, it serves as a popular baseline for test-retest (TRT) reliability assessments, often in conjunction with the Dice coefficient [108][109][110][111][112].…”