Inter‐rater agreement in radiographic canine hip dysplasia evaluation

Geissbühler, Urs; Drazovic, S.; Lang, Johann; Howard, Judith

doi:10.1136/vr.104053

Cited by 4 publications

(5 citation statements)

References 7 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on our review of the literature, there are no repeatability studies available for comparisons of radiographic grading of elbow dysplasia in dogs. However, according to repeatability studies of another prevalent radiographic screening method—the Fédération Cynologique Internationale (FCI) hip dysplasia scoring system—proportions of agreement have ranged from 46.3% to 71.3%, and Kappa values from .46 to .76 14–16 . Thus, the interobserver consistency of INC grade found in our study appears to be higher than what has been reported for hip dysplasia.…”

Section: Discussioncontrasting

confidence: 67%

The intra‐ and intertester repeatability of radiographic elbow incongruity grading is high in chondrodystrophic dog breeds

Pulkkinen

Reunanen

Hyytiäinen

et al. 2020

Vet Radiology Ultrasound

View full text Add to dashboard Cite

Elbow incongruity is a form of elbow dysplasia that causes osteoarthritis, pain, and lameness, and it is common in chondrodystrophic dog breeds. The objective of this retrospective secondary analysis study was to evaluate the intra-and interobserver repeatability of a novel radiographic incongruity grading system for assessing elbow incongruity in three chondrodystrophic dog breedsthe dachshund, Skye Terrier, and Glen of Imaal Terrier. We conducted an observer agreement study that included 220 mediolateral antebrachial radiographs from 110 dogs with the elbow in 90 • flexion. The radiographs were independently assessed by three observers at three time points, using a four-stepped grading scale. The proportion of agreement and Kappa coefficient were calculated. Both the intra-and interobserver proportions of agreement were substantial when three grades were required to be identical (.705-.777 and .609, respectively), and almost perfect for two identical grades (.991-1.000 and .991, respectively). Some differences in repeatability between breeds were noted; specifically, the intraobserver repeatability was higher in the dachshund, and the interobserver repeatability was lower in the Glen of Imaal Terrier. Our study showed that the radiographic imaging protocol and incongruity grading system have high repeatability when assessing elbow incongruity in chondrodystrophic dog breeds. K E Y W O R D Schondrodystrophic dog, elbow dysplasia, incongruity, reliability, validity

show abstract

Section: Discussioncontrasting

confidence: 67%

The intra‐ and intertester repeatability of radiographic elbow incongruity grading is high in chondrodystrophic dog breeds

Pulkkinen

Reunanen

Hyytiäinen

et al. 2020

Vet Radiology Ultrasound

View full text Add to dashboard Cite

show abstract

“…The DI is calculated using the distance between the acetabular and the femoral head centre divided by the radius of the femoral head. The FCI grading system has relatively poor interobserver agreement 13,14 although the reproducibility of the NA seems to be sufficient. 15 For the PennHIP method, a study was published and showed high within-and between-examiner repeatability.…”

Section: Introductionmentioning

confidence: 99%

Comparison of Reliability of Norberg Angle and Distraction Index as Measurements for Hip Laxity in Dogs

Klever¹,

Brühschwein²,

Wagner³

et al. 2020

Vet Comp Orthop Traumatol

View full text Add to dashboard Cite

Objective The main purpose of the study was to compare reliability of measurements for the evaluation of hip joint laxity in 59 dogs. Materials and Methods Measurement of the distraction index (DI) of the PennHIP method and the Norberg angle (NA) of the Fédération Cynologique Internationale (FCI) scoring scheme as well as scoring according to the FCI scheme and the Swiss scoring scheme were performed by three observers at different level of experience. For each dog, two radiographs were acquired with each method by the same operator to evaluate intraoperator-reliability. Results Intraoperator-reliability was slightly better for the NA compared with the DI with an intraclass correlation coefficient (ICC) of 0.962 and 0.892 respectively. The ICC showed excellent results in intraobserver-reliability and interobserver-reliability for both the NA (ICC 0.975; 0.969) and the DI (ICC 0.986; 0.972). Thus, the NA as well as the DI can be considered as reliable measurements. The FCI scheme and the Swiss scoring scheme provide similar reliability. While the FCI scheme seems to be slightly more reliable in experienced observers (Kappa FCI 0.687; Kappa Swiss 0.681), the Swiss scoring scheme had a noticeable better reliability for the unexperienced observer (Kappa FCI 0.465; Kappa Swiss 0.514). Clinical Significance The Swiss scoring scheme provides a structured guideline for the interpretation of hip radiographs and can thus be recommended to unexperienced observers.

show abstract

“…The FCI allows official reading of hips through visual image evaluation by a veterinarian scrutineer selected by local breed clubs; consequently, the quality of the scoring is subjective and may vary greatly [ 8 ]. This may justify the poor inter-observer agreement reported by some studies [ 9 , 11 ]. On the other hand, with respect to the FCI grading, NA measurement shows sufficient reproducibility, even among less-experienced examiners [ 26 , 27 ].…”

Section: Discussionmentioning

confidence: 96%

“…As a result of relying solely on a qualitative methodology to evaluate both hip congruency and osteoarthritis, there is some subjectivity, and the accuracy of the scoring varies with the training and expertise of the examiner [ 9 ]. Studies have shown low intra-observer and inter-observer agreement when it comes to the assessment of hip morphological characteristics and hip scoring according to FCI standards [ 10 , 11 , 12 ]. Thus, there is a demand for a more effective and reliable means to evaluate HD based on hip congruency and other joint conformation parameters.…”

Section: Introductionmentioning

confidence: 99%

Acetabular Coverage Area Occupied by the Femoral Head as an Indicator of Hip Congruency

Franco-Gonçalo

Silva

Leite³

et al. 2022

Animals

View full text Add to dashboard Cite

Accurate radiographic screening evaluation is essential in the genetic control of canine HD, however, the qualitative assessment of hip congruency introduces some subjectivity, leading to excessive variability in scoring. The main objective of this work was to validate a method-Hip Congruency Index (HCI)-capable of objectively measuring the relationship between the acetabulum and the femoral head and associating it with the level of congruency proposed by the Fédération Cynologique Internationale (FCI), with the aim of incorporating it into a computer vision model that classifies HD autonomously. A total of 200 dogs (400 hips) were randomly selected for the study. All radiographs were scored in five categories by an experienced examiner according to FCI criteria. Two examiners performed HCI measurements on 25 hip radiographs to study intra- and inter-examiner reliability and agreement. Additionally, each examiner measured HCI on their half of the study sample (100 dogs), and the results were compared between FCI categories. The paired t-test and the intraclass correlation coefficient (ICC) showed no evidence of a systematic bias, and there was excellent reliability between the measurements of the two examiners and examiners’ sessions. Hips that were assigned an FCI grade of A (n = 120), B (n = 157), C (n = 68), D (n = 38) and E (n = 17) had a mean HCI of 0.739 ± 0.044, 0.666 ± 0.052, 0.605 ± 0.055, 0.494 ± 0.070 and 0.374 ± 0.122, respectively (ANOVA, p < 0.01). Therefore, these results show that HCI is a parameter capable of estimating hip congruency and has the potential to enrich conventional HD scoring criteria if incorporated into an artificial intelligence algorithm competent in diagnosing HD.

show abstract

Inter‐rater agreement in radiographic canine hip dysplasia evaluation

Cited by 4 publications

References 7 publications

The intra‐ and intertester repeatability of radiographic elbow incongruity grading is high in chondrodystrophic dog breeds

The intra‐ and intertester repeatability of radiographic elbow incongruity grading is high in chondrodystrophic dog breeds

Comparison of Reliability of Norberg Angle and Distraction Index as Measurements for Hip Laxity in Dogs

Acetabular Coverage Area Occupied by the Femoral Head as an Indicator of Hip Congruency

Contact Info

Product

Resources

About