Interobserver agreement of digital dermatitis M-scores for photographs of the hind feet of standing dairy cattle

Abstract

Digital dermatitis (DD) is the leading infectious cause of lameness in dairy cattle, and it affects their welfare and productivity worldwide. At the herd level, DD is often assessed while cows are standing in a milking parlor, and lesions are most commonly evaluated using the M-score. The objective of this study was to examine the interobserver agreement for M-scores of the feet of standing cattle, based on digital color photographs of dairy cattle hind feet. A total of 88 photographs and written descriptors of the M-score were sent to 11 scorers working at 10 different institutions in 5 countries. The scorers received no formal training immediately before scoring the photographs; however, all regularly used the M-score to score DD. The answers for 36 photographs were excluded from the analysis because the photograph either had more than 1 M-stage as mode or not all scorers assigned an M-score to it. The M-scores of the 11 scorers from 52 photographs were available for analysis. Interobserver agreement was tested using Gwet's agreement coefficient (AC1) and the mode was assumed correct. Overall, moderate agreement emerged for the M-score (AC1 = 0.48). For the individual M-stages, almost perfect agreement existed for M0 (AC1 = 0.99), M1 (AC1 = 0.92), and M3 (AC1 = 0.82), and substantial agreement for M2 (AC1 = 0.61), M4 (AC1 = 0.65), and M4.1 (AC1 = 0.71). This outcome indicates the degree of individual variation in M-scoring in this context by unstandardized, experienced European observers, particularly for the M2, M4, and M4.1 stages. Standardized training is likely to improve the consistency of M-scoring and thus the generalizability of future DD research results on this important endemic disease.

Reliability of a beef cattle locomotion scoring system for use in clinical practice

“…For this reason, all values have been provided so that readers can interpret as required. However, in the authors’ opinion, the intra‐observer and inter‐observer agreement across the 40 video clips is considered acceptable when compared with similar studies in the literature 5 16 21–23…”

The Agreement between Feline Pancreatic Lipase Immunoreactivity and DGGR-Lipase Assay in Cats—Preliminary Results

“…The AC 1 coefficient has been shown to be free from these paradoxes [ 18 , 19 ] and is therefore superior to Cohen’s κ coefficient [ 31 ]. However, despite the existence of strong analytical evidence against using Cohen’s κ [ 32 , 33 ], it holds firmly while the AC 1 coefficient has so far only been used in a few veterinary studies [ 34 , 35 , 36 , 37 , 38 , 39 , 40 ].…”

Digital Dermatitis in Dairy Cattle Is Still a Serious Problem in Western Europe

“…The chronic stages vary in presentation but normally have a crust and are not painful upon touch [21]. Lesions are most commonly seen at the skin-horn border on the plantar aspect of the interdigital cleft of the hind limbs and most times diagnosed well [22].…”