Reliability of the International Spinal Cord Injury Musculoskeletal Basic Data Set; methodological and statistical issue to avoid misinterpretation

Validity and reliability of three-dimensional scanning compared to conventional anthropometry for children and adolescents: methodological mistake

“…Regarding reliability, for quantitative variables intraclass correlation coefficient (ICC) and for qualitative variables weighted kappa should be used with caution. However, to assess validity, for quantitative variables interclass correlation coefficient (Pearson r) and for qualitative variables sensitivity, specificity,)positive predictive value, negative predictive value, likelihood ratio positive and likelihood ratio negative, as well as diagnostic accuracy and odds ratio, are among the most appropriate tests (2)(3)(4)(5)(6)(7)(8).…”

“…The concordance cell can be exactly the same, with no reliability at all. Finally, to correctly assess reliability, not only should both concordance and discordance cell be considered, but also the number of categories as well as prevalence of the concordance cells should also be taken into account (2)(3)(4)(5)(6)(7)(8).…”

Response to: Reliability Of the International Spinal Cord Injury Musculoskeletal Basic Data Set; Methodological and Statistical Issue to Avoid Misinterpretation

“…Firstly the fact that Kappa is affected by prevalence, exemplified in Figure 1 by Sabour and Ghassemi. 1 A skewed distribution between the two concordant pairs results in a lower kappa value (Figure 1a) despite having the same percentage/crude agreement of the two concordant and discordant pairs. We agree with this concern and was also mentioned it in the statistics section of the article.…”