Comparing correlated kappas by resampling: Is one level of agreement significantly different from another?

McKenzie, Dean Philip; Mackinnon, Andrew; Péladeau, Normand; Onghena, Patrick; Bruce, Peter; Clarke, David M.; Harrigan, Susy; McGorry, Patrick D.

doi:10.1016/s0022-3956(96)00033-7

Cited by 85 publications

(64 citation statements)

References 41 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Because the NWD was common to both n coefficients, comparison of independent n coefficients may not be appropriate (19). Therefore, a method similar to that suggested for comparing correlated ns using the bootstrap technique was used (20). Bootstrap samples were drawn with replacement from each of the three sets of genes (NWD, Apc, and Muc2).…”

Section: Methodsmentioning

confidence: 99%

Dietary Induction of Colonic Tumors in a Mouse Model of Sporadic Colon Cancer

et al. 2008

View full text Add to dashboard Cite

A defined rodent ''new Western diet'' (NWD), which recapitulates intake levels of nutrients that are major dietary risk factors for human colon cancer, induced colonic tumors when fed to wild-type C57Bl/6 mice for 1.5 to 2 years from age 6 weeks (two-thirds of their life span). Colonic tumors were prevented by elevating dietary calcium and vitamin D 3 to levels comparable with upper levels consumed by humans, but tumorigenesis was not altered by similarly increasing folate, choline, methionine, or fiber, each of which was also at the lower levels in the NWD that are associated with risk for colon cancer. The NWD significantly altered profiles of gene expression in the flat colonic mucosa that exhibited heterogeneity among the mice, but unsupervised clustering of the data and novel statistical analyses showed reprogramming of colonic epithelial cells in the flat mucosa by the NWD was similar to that initiated by inheritance of a mutant Apc allele. The NWD also caused general down-regulation of genes encoding enzymes involved in lipid metabolism and the tricarboxylic acid cycle in colonic epithelial cells before tumor formation, which was prevented by the supplementation of the NWD with calcium and vitamin D 3 that prevented colon tumor development, demonstrating profound interaction among nutrients. This mouse model of dietary induction of colon cancer recapitulates levels and length of exposure to nutrients linked to relative risk for human sporadic colon cancer, which represents the etiology of >90% of colon cancer in the United States and other Western countries.

show abstract

Section: Methodsmentioning

confidence: 99%

Dietary Induction of Colonic Tumors in a Mouse Model of Sporadic Colon Cancer

et al. 2008

View full text Add to dashboard Cite

show abstract

“…Kappa values were interpreted using definitions outlined by Landis and Koch (1977) To examine if the level of education influenced the reliability, differences in Fleiss kappa values between Credentialed and Diploma therapists were compared. A bootstrap method with a 1000 samples was utilized and Fleiss kappa coefficients were calculated separately for the Credential and Diploma raters for each of these samples (McKenzie et al, 1996). The differences between the Fleiss kappa coefficients were determined.…”

Section: Discussionmentioning

confidence: 99%

Inter-rater reliability of the McKenzie System of Mechanical Diagnosis and Therapy in the examination of the knee

Willis

Rosedale

Rastogi

et al. 2016

Journal of Manual & Manipulative Therapy

View full text Add to dashboard Cite

Objective: The purpose of this thesis was to investigate the inter-rater reliability of the McKenzie System of Mechanical Diagnosis and Therapy (MDT) when classifying patients with musculoskeletal knee pain using clinical vignettes. Methods: This study was divided into two phases. First, ten clinicians experienced in the use of MDT were randomly recruited to write a total of 60 clinical vignettes based upon the initial assessment of past patients with knee pain. Second, six different MDT raters were recruited to rate 53 selected vignettes and reliability was determined using Fleiss Kappa. Results: There was "substantial agreement" among six MDT raters classifying the clinical vignettes into one of four categories (kappa=0.72). There was no statistically significant difference between therapists with different levels of training. Significance: These findings indicate that the McKenzie System of MDT is a reliable method of classifying patients presenting with musculoskeletal knee pain when using clinical vignettes.

show abstract

“…However, these measurements are apparently not independent and hence no usual g-sample inference tool nor the test procedure proposed in Section 2 can be directly applied. Donner et al (2000), McKenzie et al (1996) studied the comparison of two dependent (correlated) kappas. However, the categorical scales used in their studies were restricted to binary.…”

Section: Comparison Of G Dependent Agreementsmentioning

confidence: 99%

“…However, these kappas are apparently not independent and hence no usual k-sample inference tools can be directly applied. McKenzie et al (1996) studied the comparison of two kappa statistics obtained from each of two dependent 2 by 2 tables. Donner et al (2000) studied the test for the equality of two dependent kappa statistics.…”

Section: Introductionmentioning

confidence: 99%

Comparing More than Two Agreement Measures Using Marginal Association

2009

Communications for Statistical Applications and Methods

View full text Add to dashboard Cite

Oh (2009) has proposed a likelihood ratio test for comparing two agreements for dependent observations based on the concept of marginal homogeneity and marginal stochastic ordering. In this paper we consider the comparison of more than two agreement measures. Simple ordering and simple tree ordering among agreement measures are investigated. Some test procedures, including likelihood ratio test, are discussed.

show abstract

Comparing correlated kappas by resampling: Is one level of agreement significantly different from another?

Cited by 85 publications

References 41 publications

Dietary Induction of Colonic Tumors in a Mouse Model of Sporadic Colon Cancer

Dietary Induction of Colonic Tumors in a Mouse Model of Sporadic Colon Cancer

Inter-rater reliability of the McKenzie System of Mechanical Diagnosis and Therapy in the examination of the knee

Comparing More than Two Agreement Measures Using Marginal Association

Contact Info

Product

Resources

About