2015
DOI: 10.1089/end.2015.0104
|View full text |Cite
|
Sign up to set email alerts
|

Crowd-Sourced Assessment of Technical Skills: Differentiating Animate Surgical Skill Through the Wisdom of Crowds

Abstract: Crowdsourcing surgical skills assessment yielded rapid inexpensive agreement with global performance scores given by expert surgeon graders. The crowdsourcing method may provide surgical educators and medical institutions with a boundless number of procedural skills assessors to efficiently quantify technical skills for use in trainee advancement and hospital quality improvement.

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
2
2
1

Citation Types

0
59
0

Year Published

2016
2016
2023
2023

Publication Types

Select...
5
3

Relationship

0
8

Authors

Journals

citations
Cited by 81 publications
(59 citation statements)
references
References 15 publications
0
59
0
Order By: Relevance
“…The Global Evaluative Assessment of Robotic Skills (GEARS) tool, developed by Goh et al. , has been applied to urological assessments on multiple occasions , and has the strongest validity argument supporting its use in the assessment of robotic skill. Its generic framework has allowed it to become a widely accepted method of assessment across multiple procedures and even across specialties .…”
Section: Resultsmentioning
confidence: 99%
See 1 more Smart Citation
“…The Global Evaluative Assessment of Robotic Skills (GEARS) tool, developed by Goh et al. , has been applied to urological assessments on multiple occasions , and has the strongest validity argument supporting its use in the assessment of robotic skill. Its generic framework has allowed it to become a widely accepted method of assessment across multiple procedures and even across specialties .…”
Section: Resultsmentioning
confidence: 99%
“…Notably, evidence supports its ability to discriminate amongst staff surgeons of differing case volume , as well as across a single surgeon's learning curve . The vast majority of literature using the GEARS score has found it to be a reliable assessment method . However, a study of robotic renal hilar dissection using oriented expert raters showing poor internal consistency , and Hung et al.…”
Section: Resultsmentioning
confidence: 99%
“…The crowd was biased toward being more critical of the top performing surgeons than the experts were. Turkers have also been asked to assess surgical skills in videos of live, porcine robot-assisted urinary bladder closures (16). In this study, Turkers agreed with expert scoring (alpha>0.90) and completed the task in less than 5 hours, more than 13 days faster than the surgeon graders (16).…”
Section: Crowdsourcing As Tool For Biomedical Researchmentioning
confidence: 99%
“…Turkers have also been asked to assess surgical skills in videos of live, porcine robot-assisted urinary bladder closures (16). In this study, Turkers agreed with expert scoring (alpha>0.90) and completed the task in less than 5 hours, more than 13 days faster than the surgeon graders (16). In a separate study, Turkers consistently generated the same rank order of lower scoring surgeons as the expert graders in reviewing videos of robotic-assisted radical prostatectomy (17).…”
Section: Crowdsourcing As Tool For Biomedical Researchmentioning
confidence: 99%
“…Crowdsourcing provides data that is inexpensive, rapid, and objective due to the huge size of participant pool [12][13][14]. Holst, et al, show that crowdsourcing can be used to obtain valid performance grading of videos of urologic residents and faculty at different levels on basic robotic skills tasks [15,16]. Moreover, Holst, et al, obtained these results in hours, making the use of crowdsourcing for competency assessment of technical skills more valuable.…”
Section: Research Articlementioning
confidence: 99%