In this article we discuss, illustrate, and compare the relative efficacy of three recommended approaches for handling negative error variance estimates (i.e., Heywood cases): (a) setting the offending estimate to zero, (b) adopting a model parameterization that ensures positive error variance estimates, and (c) using models with equality constraints that ensure nonnegative (but possibly zero) error variance estimates. The three approaches are evaluated in two distinct situations: Heywood cases caused by lack of fit and misspecification error, and Heywood cases induced from sampling fluctuations. The results indicate that in the case of sampling fluctuations the simple approach of setting the offending estimate to zero works reasonably well. In the case of lack of fit and misspecification error, the theoretical difficulties that give rise to negative error variance estimates have no ready-made methodological solutions.
OverviewPsychologists and other behavioral scientists are using structural covariance analysis with increasing regularity (Bagozzi,
Increasingly behavioral researchers are soliciting cognitive responses in addition to standard attitudinal measures when attempting to assess the effects of persuasive communications. The coding of the elicited cognitive responses generally involves some sort of categorization, typically undertaken by independent judges, and the quality of the data is, to a large degree, evaluated in terms of some reliability coefficient which reflects the extent to which the independent judges agreed. The purpose of this paper is to present and illustrate a probabilistic model for assessing inter-judge reliability. The proposed probabilistic model allows one to (a) use formal test statistics to evaluate the extent and character of inter-judge reliability, (b) estimate the assignment error rates and their standard errors, and (c) test for simultaneous agreement for more than two judges. The probabilistic model is operationalized in terms of restricted latent class models.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.