Validity of scoring systems for the assessment of technical and non-technical skills in ophthalmic surgery—a systematic review

Wood, Thomas Charles; Maqsood, Sundas; Nanavaty, Mayank A.; Rajak, Saul

doi:10.1038/s41433-021-01463-8

Cited by 12 publications

(6 citation statements)

References 56 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…A recent systematic review of the literature found that there is currently no universally accepted standard competency assessment for open globe repair. 10 This assessment tool therefore fills a critical gap and serves three purposes: first, it will decrease subjectivity of the assessment OSCAR:OpenGlobe by defining for the assessor what behavior must be observed for each level of proficiency; second, the rubric clearly communicates to the learner what is expected to attain competence allowing self-directed learning; third, it provides a numerical system that allow for monitoring for improvement by the residency program director. Further, the grading sheet is simple and allows feedback in a timely fashion.…”

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

The Ophthalmology Surgical Competency Assessment Rubric (OSCAR) for Open Globe Surgical Management

Justin¹,

Soleimani²,

Zafar³

et al. 2022

OPTH

View full text Add to dashboard Cite

Background/Aims To produce an internationally developed rubric to assess surgical competency in open globe management. Methods An international expert panel of seven ophthalmologist educators developed a standardized competency-based rubric. The steps to perform an open globe repair were outlined. Based on a modified Dreyfus model, the experts agreed on the steps of surgery and certain global indices. They then assigned descriptors for the competency expected of a novice, beginner, advanced beginner, and competent surgeon. The tool was then vetted by another panel of ten ophthalmologists. The main outcome measure was the final version of the tool as agreed upon by the expert review panel. Results The steps of open globe repair and key global indices were established. Descriptive wording for each step and global indices for novice, beginner, advanced beginner, and competent surgery were listed. All the expert comments were integrated to establish face and content validity. Conclusion This standardized rubric to evaluate resident competency should be used globally in training programs to assess open globe repair surgical skills. Using a modified Dreyfus model, four different levels of training competency were defined allowing a non-biased, objective, numerical and simple assessment.

show abstract

Section: Discussionmentioning

confidence: 99%

“… 8 , 9 However, no ICO-OSCAR nor another surgical competency rubric for open globe surgical management has been developed. 10 The development of OSCARs is now led by the Ophthalmology Foundation, which supports the continuation of this important initiative.…”

Section: Introductionmentioning

confidence: 99%

The Ophthalmology Surgical Competency Assessment Rubric (OSCAR) for Open Globe Surgical Management

Justin¹,

Soleimani²,

Zafar³

et al. 2022

OPTH

View full text Add to dashboard Cite

show abstract

“…Although flight simulators are more expensive than cataract surgery simulations, realistic cataract surgery simulation is arguably more challenging to achieve given the wide-ranging permutations of ocular, patient, environmental and staffing factors. Furthermore, aviation has formally incorporated NTS into training, simulation and assessment due to its strong associations with safety enhancement [2,9,10]. Pilots risk multiple fatalities (including their own) through severe NTS failures, whereas NTS failures do not threaten the cataract surgeon's vision when undertaking complicated surgery [2,7].…”

Section: Training and Assessmentmentioning

confidence: 99%

Comparisons between cataract surgery and aviation

Wood

Maqsood

Sancha

et al. 2022

Eye

Self Cite

View full text Add to dashboard Cite

“…Contrary to traditional views that NTS were innate and therefore untrainable, studies have repeatedly shown that they can be taught, learned, assessed and refined through didactic teaching, e-learning and simulation [9]. Studies have also demonstrated strong correlations between a surgeon's NTS and TS abilities, however, there is a paucity of assessment tools focussed on NTS [10][11][12]. Furthermore, there remains little integration of NTS with training models and simulation in ophthalmic surgery [7].…”

Section: Introductionmentioning

confidence: 99%

Non-technical skills simulation-based training model for managing intraoperative posterior capsule rupture during cataract surgery

Wood

Maqsood

Saunders

et al. 2022

Eye

Self Cite

View full text Add to dashboard Cite

To develop and implement a simulation-based training model for the management of posterior capsule rupture (PCR) from a non-technical skills (NTS) perspective, and analyse changes in participant's NTS and technical skills (TS). METHODS: The simulation-based training model consisted of two identical PCR simulations with NTS stressors applied, separated by a predominantly NTS focussed training intervention. Participants' TS and NTS were evaluated by two blinded assessors using the Objective Structured Assessment of Technical Skill (OSATS) global rating scale and the HUman Factors in intraoperative Ophthalmic Emergencies Scoring System (HUFOES) respectively. Paired t-tests were used to establish the difference in mean HUFOES and OSATS scores between initial and repeat simulations; p < 0.05 indicated statistical significance. McGaghie's model of translational outcomes for simulation-based learning was used to establish the simulation model's educational status. RESULTS: Seventeen cataract surgeons of varying training grades participated in the simulation-based training model. NTS improved with statistical significance; mean HUFOES scores increased from 48.7 ± 16.6 to 59.2 ± 14.8 (p < 0.001). Mean OSATS scores increased without statistical significance from 16.0 ± 7.3 to 17.9 ± 8.3 (p = 0.07). This simulation model achieved Level 1 (internal acceptability) and Level 2 (contained effects) according to McGaghie's model. CONCLUSIONS: This novel simulation-based training model was designed to improve the NTS required for managing intraoperative PCR, through the provision of an interactive training session. Statistically significant improvements in participants' NTS in combination with statistically insignificant improvements in TS demonstrate that the simulation-based training model has specificity within the NTS domain.

show abstract

Validity of scoring systems for the assessment of technical and non-technical skills in ophthalmic surgery—a systematic review

Cited by 12 publications

References 56 publications

The Ophthalmology Surgical Competency Assessment Rubric (OSCAR) for Open Globe Surgical Management

The Ophthalmology Surgical Competency Assessment Rubric (OSCAR) for Open Globe Surgical Management

Comparisons between cataract surgery and aviation

Non-technical skills simulation-based training model for managing intraoperative posterior capsule rupture during cataract surgery

Contact Info

Product

Resources

About