Schneier's cognitive compatibility theory proposed that cognitively complex raters should exhibit psychometricaily superior ratings when using a complex rating format such as a behaviorally anchored rating scale and should have a stronger preference for such a format than do cognitively simple raters. The cognitive compatibility theory was tested in four studies. In Experiments 1 and 2, students rated college instructors and professor vignettes, respectively. Results showed that rater cognitive complexity was unrelated to rating accuracy, halo error, acceptability of rating format, or confidence in ratings. In Experiment 3, police sergeants rated patrol officers, and the results showed that halo error and acceptability of formats were unrelated to cognitive complexity. In Experiment 4, student ratings of managerial performance and instructor effectiveness again showed no support for the cognitive compatibility theory. However, the data showed that raters' ability to generate dimensions was significantly related to halo error in instructors' ratings. Implications for Schneier's cognitive compatibility theory and future research with the method of generating performance dimensions are discussed in light of the present findings.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.