Interobserver reliability in musculoskeletal ultrasonography: results from a "Teach the Teachers" rheumatologist course

Abstract

Objective: To assess the interobserver reliability of the main periarticular and intra-articular ultrasonographic pathologies and to establish the principal disagreements on scanning technique and diagnostic criteria between a group of experts in musculoskeletal ultrasonography. Methods: The shoulder, wrist/hand, ankle/foot, or knee of 24 patients with rheumatic diseases were evaluated by 23 musculoskeletal ultrasound experts from different European countries randomly assigned to six groups. The participants did not reach consensus on scanning method or diagnostic criteria before the investigation. They were unaware of the patients' clinical and imaging data. The experts from each group undertook a blinded ultrasound examination of the four anatomical regions. The ultrasound investigation included the presence/absence of joint effusion/synovitis, bony cortex abnormalities, tenosynovitis, tendon lesions, bursitis, and power Doppler signal. Afterwards they compared the ultrasound findings and re-examined the patients together while discussing their results. Results: Overall agreements were 91% for joint effusion/synovitis and tendon lesions, 87% for cortical abnormalities, 84% for tenosynovitis, 83.5% for bursitis, and 83% for power Doppler signal; k values were good for the wrist/hand and knee (0.61 and 0.60) and fair for the shoulder and ankle/foot (0.50 and 0.54). The principal differences in scanning method and diagnostic criteria between experts were related to dynamic examination, definition of tendon lesions, and pathological v physiological fluid within joints, tendon sheaths, and bursae. Conclusions: Musculoskeletal ultrasound has a moderate to good interobserver reliability. Further consensus on standardisation of scanning technique and diagnostic criteria is necessary to improve musculoskeletal ultrasonography reproducibility.

Development and evaluation of a novel ultrasound score for large joints in rheumatoid arthritis: One year of experience in daily clinical practice

“…Although US is considered to be a strongly observer-dependent modality, several studies demonstrate a moderate to good interreader agreement supporting utilization of this method to assess joint involvement in patients with RA (35,36). In order to verify interreader and intrareader agreement of the SOLAR score, a reliability study has been performed additionally.…”

Self‐directed learning of basic musculoskeletal ultrasound among rheumatologists in the United States

“…These events resulted in the development of rheumatology experts in MSUS imaging in Europe and Latin America (5). The MSUS reliability of some of these experts has been determined previously in Germany and Spain (6,7) in the "Train the Trainers" (6) and "Teach the Teachers" (7) exercises, finding good interobserver agreement for the wrist/hand and knee, with fair concordance for the shoulder and ankle/foot (7).…”

Equívocos diagnósticos envolvendo as tendinites: impacto médico, social, jurídico e econômico

“…Those experts disagreed in 16% of the cases of tenosynovitis, 16.5% of bursitis, and 19% of arthritis. 62 The highest level of disagreement was seen in tendinitis/ tenosynovitis.…”

“…The establishment of more rigorous standardized ultrasound scanning techniques and diagnostic criteria is urgently necessary to compare results adequately and reduce inter-operator interpretation variability. 62 …”