Reliability of four different computerized cephalometric analysis programs: a methodological error

Methodological considerations in accuracy and reliability of qualitative echocardiography assessment of right ventricular size and function in neonates

“…Second, Kappa value also depends on the number of categories. 2,[4][5][6] Finally, the third important flaw is when the two raters have unequal marginal distributions of their responses. Therefore, the weighted Kappa would be a good choice to investigate intra-observer reliability.…”

“…In this letter, we discussed statistical approaches to reliability and important limitations of applying Kappa coefficient to assess reliability. [2][3][4][5][6] Any conclusion in reliability analyses needs to be supported by the methodological and statistical issues mentioned above. Otherwise, misinterpretation cannot be avoided.…”

“…Therefore, the weighted Kappa would be a good choice to investigate intra-observer reliability. 2,[4][5][6] Authors concluded that there is significant variability in qualitative assessment of RV size and function by trained evaluators, regardless of level of expertise attained. Also, the reliability of objective measures of RV hemodynamics requires prospective evaluation.In this letter, we discussed statistical approaches to reliability and important limitations of applying Kappa coefficient to assess reliability.…”

Methods and reliability of radiographic vertebral fracture detection in older men; methodological issues to avoid misinterpretation

“…Reliability (repeatability or reproducibility) is being assessed by different statistical tests such as Pearson r, least square and paired t test which all of them are among common mistakes in reliability [2]. Briefly, for quantitative variable Intra-class Correlation Coefficient (ICC) and for qualitative variables weighted kappa should be used with caution because kappa has its own limitation too [3,4,[7][8][9][10]. Two important weaknesses of k value to assess agreement of a qualitative variable are as follows: It depends upon the prevalence in each category which means it can be possible to have different kappa value having the same percentage for both concordant and discordant cells!…”

“…Otherwise, misdiagnosis and mismanagement of the patients cannot be avoided [3][4][5][6][7][8][9][10].…”