Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room

Niitsu, Hiroaki; Hirabayashi, Naoki; Yoshimitsu, Masanori; Mimura, Takashi; Taomoto, Junya; Sugiyama, Yoich; Murakami, Shigeru; Saeki, Shuji; Mukaida, Hidenori; Takiyama, Wataru

doi:10.1007/s00595-012-0313-7

Cited by 209 publications

(134 citation statements)

References 7 publications

Supporting

Mentioning

126

Contrasting

Unclassified

Order By: Relevance

“…The application of OSATS [7][8][9] Scale showed significant differences between the mean values obtained in the evaluation of skills by groups, it is interesting to note that the group A averaged markedly higher than in Group B on four of the six variables and the overall average favored the group A. Even so, each individual variable analyzed in both groups reached averages> 2.6 considering the results "satisfactory".…”

Section: ■ Discussionmentioning

confidence: 94%

“…The results of measurements obtained from the application of OSATS [7][8][9] Scale for estimation of developed surgical skills are shown in Table 2. There were no previous results than the minimum standards established in the research, both theoretical advantage as to the practical in either group (Table 3).…”

Section: ■ Resultsmentioning

confidence: 99%

“…This criterion established SATISFACTION parameter to our research. Surgical skills estimated by the scale of objective structured assessment of technical skills (OSATS) [7][8][9] in students, had six variables evaluated with values from one to five, setting 2.6 as a parameter of "satisfaction" for each variable, adding a total of 30 points, regarded as "satisfactory" all score above 16 points (Table 1).…”

Section: Discussionmentioning

confidence: 99%

See 2 more Smart Citations

Surgical model pig ex vivo for venous dissection teaching in medical schools

Tube

Spencer-Netto²,

Oliveira³

et al. 2017

Acta Cir. Bras.

View full text Add to dashboard Cite

Purpose: To investigate a method for development of surgical skills in medical students simulating venous dissection in surgical ex vivo pig model. Methods: Prospective, analytical, experimental, controlled study with four stages: selection, theoretical teaching, training and assessment. Sample of 312 students was divided into two groups: Group A -2nd semester students; Group B -students of 8th semester. The groups were divided into five groups of 12 students, trained two hours per week in the semester. They set up four models to three students in each skill station assisted by a monitor. Teaching protocol emergency procedures training were applied to venous dissection, test goal-discursive and OSATS scale. Results:The pre-test confirmed that the methodology has not been previously applied to the students. The averages obtained in the theoretical evaluation reached satisfactory parameters in both groups. The results of applying OSATS scale showed the best performance in group A compared to group B, however, both groups had satisfactory medium. Conclusion: The method was enough to raise a satisfactory level of skill both groups in venous dissection running on surgical swine ex vivo models.

show abstract

Section: ■ Discussionmentioning

confidence: 94%

Section: ■ Resultsmentioning

confidence: 99%

Section: Discussionmentioning

confidence: 99%

See 1 more Smart Citation

Surgical model pig ex vivo for venous dissection teaching in medical schools

Tube

Spencer-Netto²,

Oliveira³

et al. 2017

Acta Cir. Bras.

View full text Add to dashboard Cite

show abstract

“…Our literature review revealed 2 modern studies that had demonstrated reliable instruments for the evaluation of surgical residents. Niitsu and colleagues 16 assessed their residents' technical skills using the OSATS tool over a 3-year period. They noted a positive correlation between training year and a higher OSATS score.…”

Section: Discussionmentioning

confidence: 99%

Evaluating the reliability of surgical assessment methods in an orthopedic residency program

2015

View full text Add to dashboard Cite

“…The OSATS is widely accepted as the "gold standard" for formative surgical skill assessment, at least partly because of the significant correlation between OSATS scores and postgraduate residency year. 6 OSATS is not recommended for summative evaluation.…”

Section: Introductionmentioning

confidence: 99%

Assessing Wire Navigation Performance in the Operating Room

Taylor

Thomas

Karam

et al. 2016

Journal of Surgical Education

View full text Add to dashboard Cite

Objective-There are no widely accepted, objective, and reliable tools for measuring surgical skill in the operating room (OR). Ubiquitous video and imaging technology provide opportunities to develop metrics that meet this need. Hip fracture surgery is a promising area in which to develop these measures because hip fractures are common, the surgery is used as a milestone for residents, and it demands technical skill. The study objective is to develop meaningful, objective measures of wire navigation performance in the OR.Design-Resident surgeons wore a head-mounted video camera while performing surgical open reduction and internal fixation using a dynamic hip screw. Data collected from video included: duration of wire navigation, number of fluoroscopic images, and the degree of intervention by the surgeon's supervisor. To determine reliability of these measurements, four independent raters performed them for two cases. Raters independently measured the tip-apex distance (TAD), which reflects the accuracy of the surgical placement of the wire, on all 7 cases. Setting-University of Iowa Hospitals and Clinics in Iowa City, IA -a public tertiary academic center.Participants-Seven surgeries were performed by seven different orthopaedic residents. All ten raters were biomedical engineering graduate students.Results-The means and standard deviations for AP, lateral, and combined TAD measurements of the 10 raters were 2.7, 1.9, and 3.7 mm, respectively, and inter-rater reliability produced a Cronbach's Alpha of 0.97. The inter-rater reliability analysis for all 9 video-based measures produced a Cronbach's Alpha of 0.99.Conclusions-Several video-based metrics were consistent across the four video reviewers and are likely to be useful for performance assessment. The TAD measurement was less reliable than previous reports have suggested but remains a valuable metric of performance. Non-experts can reliably measure these values and they offer an objective assessment of OR performance.

show abstract

Using the Objective Structured Assessment of Technical Skills (OSATS) global rating scale to evaluate the skills of surgical trainees in the operating room

Cited by 209 publications

References 7 publications

Surgical model pig ex vivo for venous dissection teaching in medical schools

Surgical model pig ex vivo for venous dissection teaching in medical schools

Evaluating the reliability of surgical assessment methods in an orthopedic residency program

Assessing Wire Navigation Performance in the Operating Room

Contact Info

Product

Resources

About