Evaluation of Dimensionality in the Assessment of Internal Consistency Reliability: Coefficient Alpha and Omega Coefficients

Abstract

In the lead article, Davenport, Davison, Liou, & Love demonstrate the relationship among homogeneity, internal consistency, and coefficient alpha, and also distinguish among them. These distinctions are important because too often coefficient alpha—a reliability coefficient—is interpreted as an index of homogeneity or internal consistency. We argue that factor analysis should be conducted before calculating internal consistency estimates of reliability. If factor analysis indicates the assumptions underlying coefficient alpha are met, then it can be reported as a reliability coefficient. However, to the extent that items are multidimensional, alternative internal consistency reliability coefficients should be computed based on the parameter estimates of the factor model. Assuming a bifactor model evidenced good fit, and the measure was designed to assess a single construct, omega hierarchical—the proportion of variance of the total scores due to the general factor—should be presented. Omega—the proportion of variance of the total scores due to all factors—also should be reported in that it represents a more traditional view of reliability, although it is computed within a factor analytic framework. By presenting both these coefficients and potentially other omega coefficients, the reliability results are less likely to be misinterpreted.

Does Shared Decision Making Actually Occur in the Emergency Department? Looking at It from the Patients’ Perspective

“…The SDM‐Q‐9 was developed by taking the theoretical key steps of SDM and translating them into actionable items . Considerable refinements led to the final nine‐item tool, which has since undergone psychometric testing in different populations, such as oncology, neurology, and behavioral health, with generally favorable properties (for example, in the oncology population, total sum scores derived from the general factor showed good reliability in terms of omega coefficient = 0.90) …”

Exploring the Wisdom Structure: Validation of the Spanish New Short Three-Dimensional Wisdom Scale (3D-WS) and Its Explanatory Power on Psychological Health-Related Variables

“…This reliability value has the advantage of taking into account the strength of association between items and constructs as well as item-specific measurement errors, while providing a more realistic estimate of true reliability than other classical methods (McDonald, 1999). We also estimated the omega hierarchical (ω H ), as the proportion of reliable variance in total scores that can be attributed to the single general factor, and the omega hierarchical subscale (ω HS ), as the proportion of reliable variance associated with each factor once partitioning out variance associated with the single general factor (Reise, 2012; Green and Yang, 2015). The percentage of uncontaminated correlations (PUC) were also estimated, as the number of correlations between items from different factors divided by the total number of correlations, which indicates the proportion of correlations reflecting the general factor.…”

E-Commerce Drivers and Barriers and Their Impact on E-Customer Loyalty in Small and Medium-Sized Enterprises (Smes)

“…Reliability, in the current study, was determined on the basis of McDonald's omega coefficient (ω). An important assumption of Cronbach's alpha coefficient is that this test is essentially tau equivalent (Al-Tit, 2016; Green & Yang, 2015). In the case of violation of this assumption, Cronbach's alpha cannot be used to estimate reliability.…”