Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents

Larson, Jennine L.; Williams, Reed G.; Ketchum, Janet; Boehler, Margaret L.; Dunnington, Gary L.

doi:10.1016/j.surg.2005.07.017

Cited by 195 publications

(89 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Other published methods of evaluating residents' surgical performance include end-of-rotation summary paper evaluations of broad parameters ranging from operative performance to conference attendance, 8 6-month summary assessments of general technical abilities, 9 extensive paper evaluations tailored to each individual type of operative procedure, 10 and Internet-based evaluation logs, either on a local website where a form can be accessed and kept in residents' departmental files, 11 or uploaded directly into New Innovations, 12 a company specializing in secure, centralized Internet databases for medical education programs. Compared with the present study, none of these evaluation formats are portable, completed immediately following the operation, or require a face-to-face 2-way interaction between faculty and residents involving a focused assessment plus an opportunity to enhance the educational experience.…”

Section: Discussionmentioning

confidence: 99%

Use of the QR Reader to Provide Real-Time Evaluation of Residents' Skills Following Surgical Procedures

Reynolds¹,

Barnhill²,

Sias³

et al. 2014

Journal of Graduate Medical Education

View full text Add to dashboard Cite

Background A portable electronic method of providing instructional feedback and recording an evaluation of resident competency immediately following surgical procedures has not previously been documented in obstetrics and gynecology. Objective This report presents a unique electronic format that documents resident competency and encourages verbal communication between faculty and residents immediately following operative procedures. Methods The Microsoft Tag system and SurveyMonkey platform were linked by a 2-D QR code using Microsoft QR code generator. Each resident was given a unique code (TAG) embedded onto an ID card. An evaluation form was attached to each resident's file in SurveyMonkey. Postoperatively, supervising faculty scanned the resident's TAG with a smartphone and completed the brief evaluation using the phone's screen. The evaluation was reviewed with the resident and automatically submitted to the resident's educational file. Results The evaluation system was quickly accepted by residents and faculty. Of 43 residents and faculty in the study, 38 (88%) responded to a survey 8 weeks after institution of the electronic evaluation system. Thirty (79%) of the 38 indicated it was superior to the previously used handwritten format. The electronic system demonstrated improved utilization compared with paper evaluations, with a mean of 23 electronic evaluations submitted per resident during a 6-month period versus 14 paper assessments per resident during an earlier period of 6 months. Conclusions This streamlined portable electronic evaluation is an effective tool for direct, formative feedback for residents, and it creates a longitudinal record of resident progress. Satisfaction with, and use of, this evaluation system was high.

show abstract

Section: Discussionmentioning

confidence: 99%

Use of the QR Reader to Provide Real-Time Evaluation of Residents' Skills Following Surgical Procedures

Reynolds¹,

Barnhill²,

Sias³

et al. 2014

Journal of Graduate Medical Education

View full text Add to dashboard Cite

show abstract

“…Currently non-global assessment tools that are available include the Surgical Procedure Feedback Rubric (SPR), Direct Observation of Procedural Skills (DOPS), OpRate, McGill Inanimate System for Training and Evaluation of Laparoscopic Skills (MISTELS), Procedure Based Assessment (PBA) Tool, Penn Assessment of Surgical Skills (PASS), Operative Performance Rating System (OPRS), Ottawa Surgical Competency Operating Room Evaluation (O-SCORE), and Resident Operative Case Tracking and Evaluation System (ROCTES) (Gofton, Dudek, Wood, Balaa, & Hamstra, 2012;Khan, Gorman, Gwozdziewicz, Sobani, & Gibson, 2013;Larson, Williams, Ketchum, Boehler, & Dunnington, 2005;Sarker, Maciocco, Zaman, & Kumar, 2010;Sehli, Esene, & Baeesa, 2016;Selvan et al, 2011;Toprak, Luhanga, Jones, Winthrop, & McEwen, 2016;M. C. Vassiliou et al, 2006;Wohaibi et al, 2007).…”

Section: Non-global Assessment Toolsmentioning

confidence: 99%

Assessing Surgical Residents; Challenges and Future Options

Sandher¹,

Gibber²

2017

MedEdPublish

View full text Add to dashboard Cite

Surgical education has changed significantly since the first formal program was established by William Halstead. Specifically, in the last ten years, surgical education has moved from the popular "See One, Do One, Teach One" model to a competency based model using distinct milestones. While these milestones and competencies have been successfully implemented in many fields, including Otolaryngology, there remains significant problems that need to be addressed. Specifically, the lack of assessment tools able to accurately measure whether trainee surgeons can perform steps or indeed an entire operation is a significant and underreported problem.

show abstract

“…OPRS, GRITS and OpRate reported routine implementation of the assessment tools in surgery residency programs, using scores to identify residents who required remediation, indicating that the intended use could be for summative assessment. The OPRS is used to establish benchmarks that residents should achieve prior to advancing to the next level of training [33]. There were no investigations determining pass/fail scores as a summative assessment or predicting patient outcomes from the assessment scores which may represent the quality of their performance.…”

Section: Consequencesmentioning

confidence: 99%

A systematic review of performance assessment tools for laparoscopic cholecystectomy

et al. 2015

View full text Add to dashboard Cite

show abstract

Feasibility, reliability and validity of an operative performance rating system for evaluating surgery residents

Cited by 195 publications

References 7 publications

Use of the QR Reader to Provide Real-Time Evaluation of Residents' Skills Following Surgical Procedures

Use of the QR Reader to Provide Real-Time Evaluation of Residents' Skills Following Surgical Procedures

Assessing Surgical Residents; Challenges and Future Options

A systematic review of performance assessment tools for laparoscopic cholecystectomy

Contact Info

Product

Resources

About