Objective Assessment of Mastoidectomy Skills in the Operating Room

Abstract

Our assessment tool is a feasible and valid method of evaluating acquisition of mastoidectomy skills in the operating room. It can be integrated into surgical teaching in the operating room and yields information for direct formative feedback.

Developing a Tool to Assess Placement of Central Venous Catheters in Pediatrics Patients

“…[9][10][11][12][13][14][28][29][30] In surgical specialties, observation tools have been created with criteria for each stage of the operation, but they risk becoming cumbersome if too many elements are included. 28,29 In addition, the minute details of kinesthetic tasks do not tell the entire story of competency, and cognitive and communication elements must also be assessed. 31,32 The simulated scenarios used in this investigation enhanced the ability to evaluate the tool's performance by eliminating the anchor bias seen in live assessments.…”

“…2 Such tools have been developed for placement in adults, but applying these to the PCCM environment is difficult. [3][4][5][6][7][8] In addition, existing tools typically focus on the technical aspect of procedural competence [9][10][11][12][13] and rarely address the knowledge and communication elements of the procedure. 14 Simple checklist assessment tools may not adequately identify global performance, and subjective recall ratings are difficult to standardize across a cohort of raters due to interrater variability in the definition of competency.…”

Blinded Evaluation of Interrater Reliability of an Operative Competency Assessment Tool for Direct Laryngoscopy and Rigid Bronchoscopy

“…14 Previous work to develop surgical skills assessments has included OSATS tools in mastoidectomy, 15 sinus surgery, 16 and airway assessment 1 and is based on the work of Martin et al, 17 who described the use of surgical OSATS in 1997; however, widespread integration into resident surgical training is not yet mandated. After developing tools to objectively assess surgical performance of pediatric direct laryngoscopy and rigid bronchoscopy, we published an evaluation of the feasibility, validity, and interrater agreement of these in 2010.…”

“…15 A feasible assessment tool will ideally have a completion time of less than 5 minutes and maintain the possibility for the evaluator to complete it at an opportunity that is convenient. This pediatric laryngoscopy/bronchoscopy OSATS tool required only 3 to 5 minutes to complete for the 2-page version and 2 to 3 minutes for the 1-page version, and was able to be completed during or immediately after the surgical procedure.…”

Testing an objective structured assessment technical skills tool: A pilot study

“…The reliability coefficient for the task based checklist was 0.98 and 0.95 for the global rating scale. [18] Ishman et al developed and pilot tested an OSATS tool to conduct non-blind evaluations of 19 residents' in different postgraduate levels performing pediatric direct laryngoscopy and rigid bronchoscopy on live animals in a laboratory and in children in the operating room over a three year period. The authors developed two OSATS instruments using a checklist and a global rating scale.…”