This study is a partial replication of L. Hu and P. M. Bentler's (1999) fit criteria work. The purpose of this study was twofold: (a) to determine whether cut-off values vary according to which model is the true population model for a dataset and (b) to identify which of 13 fit indexes behave optimally by retaining all of the correct models while simultaneously rejecting all of the misspecified models in a manner invariant across sample size and data distribution. The authors found that for most indexes the results do not vary depending on which model serves as the correct model. Furthermore, the search for an optimal cut-off value led to a new discovery about the nature of McDonald's measure of centrality and the root mean square error of approximation. Unlike all other indexes considered in this study, the cut-off value of both indexes actually decreases for incorrect models as sample size increases. This may suggest that power calculations are more likely to be optimal when based on those indices.
We believe IS researchers can and should do a better of job of improving (assuring) the validity of their findings by minimizing nonresponse error. To demonstrate that there is, in fact, a problem, we first present the response rates reported in six well-regarded IS journals and summarize how nonresponse error was estimated and handled in published IS research. To illustrate how nonresponse error may bias findings in IS research, we calculate its impact on confidence intervals. After demonstrating the impact of nonresponse on research findings, we discuss three post hoc remedies and three preventative measures for the IS researcher to consider. The paper concludes with a general discussion about nonresponse and its implications for IS research practice. In our delimitations section, we suggest directions for further exploring external validity. Nonresponse in IS/Sivo et al.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.