The Kenney–Doig scale is a histopathology categorization (grading) system often used as the standard for assessing endometrial disease and communicating prognostic fertility information for equine breeding prospects. We investigated how Kenney–Doig categories compared within the same institution and across different institutions to determine if observer variability may contribute to category frequencies. We conducted a retrospective analysis of all equine endometrial submission records between 1998 and 2018 at the Western College of Veterinary Medicine (WCVM) and Prairie Diagnostic Services (PDS). Of 726 biopsies, we found the following category distribution: 46 of 726 (6.3%) I, 307 of 726 (42.3%) IIA, 326 of 726 (44.9%) IIB, and 47 of 726 (6.5%) III. We also conducted a review of the literature and included 6 studies reporting Kenney–Doig category distributions. Chi-square analysis showed significant differences between the category distribution found at WCVM and PDS and the category distribution reported in the 6 studies. To account for differences in mare populations, individual category distributions were generated for 5 pathologists at the WCVM and PDS. The Fisher exact test among these 5 Kenney–Doig categories revealed significant differences in category tendencies, suggesting that observer variation affects the use of the scale. Our results suggest that there is a need for prospective inter-rater and intra-rater agreement studies of the repeatability of the Kenney–Doig scale.

Inter- and intra-rater variability negatively affects the reliability of various histopathology grading scales used as prognostic aids in human and veterinary medicine. The Kenney–Doig categorization (grading) scale, which is used to associate equine endometrial histologic lesions with prognostic estimation of a broodmare’s reproductive potential, has not been evaluated for inter- or intra-rater variability, to our knowledge. To assess whether the Kenney–Doig system produces reliable results among observers, 8 pathologists, all with American College of Veterinary Pathologists certification, were recruited to blindly categorize the same set of 63 digital equine endometrial biopsy slides as well as to re-evaluate anonymously 21 of 63 of these slides at a later time. Cohen kappa values for pairwise comparison of final Kenney–Doig categories were −0.05 to 0.46 (unweighted) and 0.08–0.64 (weighted), with an average Light kappa of 0.19 (unweighted) and 0.36 (weighted) across all 8 pathologists, 0.14 (unweighted) and 0.33 (weighted) for pathologists at different institutions, and 0.22 (unweighted) and 0.46 (weighted) for pathologists at the same institution. Intra-class correlations measuring intra-rater agreement were 0.12–0.77 with an average of 0.55 for all 8 pathologists. We found that only slight-to-moderate inter-rater agreement and poor-to-good intra-rater agreement was produced by 8 pathologists using the Kenney–Doig scale, suggesting that the system is subject to significant observer variability and care should be taken when communicating Kenney–Doig categories to submitting clinicians with emphasis on the quality of endometrial lesions present instead of the category and associated expected foaling rate.