“…Initial certification and annual recertification to 70% reliability is required of all trained raters. Previous research has demonstrated that the CANS has adequate interrater and internal consistency reliability (Anderson, Lyons, Giles, Price, & Estle, 2003;Epstein, Jordan, Rhee, McClelland, & Lyons, 2009;Leon, Lyons, & Uziel-Miller, 2000;Leon, Uziel-Miller, Lyons, & Tracy, 1999;Lyons, Rawal, Yeh, & Leon, 2002;Lyons, Weiner, & Lyons, 2004). Findings from an audit comparing prospective screening with retrospective chart review, for example, found reliability above 70%, and comparison of 188 training participant ratings of test case vignette to those of the CANS developer resulted in average reliability using intraclass correlation of .76 (Lyons et al, 2004).…”