The Quality of Open-Access Video-Based Orthopaedic Instructional Content for the Shoulder Physical Exam is Inconsistent

Abstract

Background: The internet has an increasing role in both patient and physician education. While several recent studies critically appraised the quality and accuracy of webbased written information available to patients, no studies have evaluated such parameters for open-access video content designed for provider use. Questions/Purposes: The primary goal of the study was to determine the accuracy of internet-based instructional videos featuring the shoulder physical examination. Methods: An assessment of quality and accuracy of said video content was performed using the basic shoulder examination as a surrogate for the Bbest-case scenario^due to its widely accepted components that are stable over time. Three search terms (Bshoulder,B examination,^and Bshoulder exam^) were entered into the four online video resources most commonly accessed by orthopaedic surgery residents (VuMedi, G9MD, Orthobullets, and YouTube). Videos were captured and independently reviewed by three orthopaedic surgeons. Quality and accuracy were assessed in accordance with previously published standards. Results: Of the 39 video tutorials reviewed, 61% were rated as fair or poor. Specific maneuvers such as the Hawkins test, O'Brien sign, and Neer impingement test were accurately demonstrated in 50, 36, and 27% of videos, respectively. Inter-rater reliability was excellent (mean kappa 0.80, range 0.79-0.81). Conclusion: Our results suggest that information presented in open-access video tutorials featuring the physical examination of the shoulder is inconsistent. Trainee exposure to such potentially inaccurate information may have a significant impact on trainee education.

A cross-sectional study on reliability and quality of YouTube® videos related to hallux valgus and evaluation of newly developed hallux valgus-specific survey tool

“…Authors have found the posted videos to be reliable as a source of information despite the fact that some videos are inaccurate. 36 Of the studies, 13 focused on orthopedic conditions, assessing the reliability and educational value of videos on HV, 19 – 21 rotator cuff surgery, 14 anterior cruciate ligament reconstruction, 22 , 29 meniscus surgery, 28 knee arthroplasty, 30 lower-limb amputation, 31 physical shoulder examination, 37 femoroacetabular impingement, 38 and knee arthrocentesis. 39 All studies focused on orthopedic conditions were agreed that online videos provided poor information.…”

Université de Montréal Objective and Structured Checklist for Assessment of Audiovisual Recordings of Surgeries/techniques (UM-OSCAARS): a validation study

“…Even though many high-quality videos are available, the quality of video clips is inconsistent and can be poor. 10,11 In a recent pilot study evaluating the impact of otology surgery videos on otolaryngology resident education, residents reported that they found that videos were highly useful and promoted self-efficacy and that they should be a high priority for a resident's surgical preparation. 3 In light of the increased use of videos in medical and surgical teaching, more high-quality medical learning videos must be made available.…”

The influence of online video learning aids on preparing postgraduate chiropractic students for an objective structured clinical examination

“…As these types of platforms are openly accessible to both content creators and consumers, the quality of the materials can sometimes be questionable. 3,25 Students in this study were provided with resources that had been developed with, and reviewed by, the lecturer associated with the unit. This provided some assurance as to the quality of the content and regulation over version control, attributes that may not be present in open-access forums.…”