Abstract
Coefficient alpha (α) has been described as a lower bound for test reliability. However, previous research indicates that when certain assumptions are violated, α can either overestimate or underestimate reliability. Raykov (1997a) has shown how structural equation modeling (SEM) can be used to estimate reliability. This study has introduced method factors into the model in Raykov (1997a) to avoid a potential limitation of the SEM approach. Monte Carlo simulation shows that when certain assumptions are violated, either method (α or SEM) can show a substantial bias, though in the most extreme circumstances the bias of α estimates are larger than the bias of SEM-based reliability estimates. Circumstances that favor one method or the other are described and explored.
References
(1992). When true scores equal zero: A reply to Allen. Teaching of Psychology, 19, 111–112.
(1951). Coefficient alpha and the internal structure of a test. Psychometrika, 16, 297–334.
(1950). Theory of mental tests. New York, NY: Wiley.
(1953). Reliability formulas that do not assume experimental independence. Psychometrika, 18, 225–239.
(2006). Reliability. In , Educational measurement (pp. 65–110). Westport, CT: Praeger.
(1971). Statistical analysis of sets of congeneric tests. Psychometrika, 36, 109–133.
(1997). Effect of simultaneous violations of essential τ-equivalence and uncorrelated error on coefficient α . Applied Psychological Measurement, 21, 337–348.
(1968). Statistical theories of mental test scores. Reading, MA: Addison-Wesley.
(1995). Coefficient alpha: A basic introduction from the perspectives of classical test theory and structural equation modeling. Structural Equation Modeling, 2, 255–273.
(1967). Coefficient alpha and the reliability of composite measurements. Psychometrika, 32, 1–13.
(1997a). Estimation of composite reliability for congeneric measures. Applied Psychological Measurement, 21, 173–184.
(1997b). Scale reliability, Cronbach’s coefficient alpha, and violations of essential tau-equivalence with fixed congeneric components. Multivariate Behavioral Research, 32, 329–353.
(1998). Coefficient alpha and composite reliability with interrelated nonhomogeneous items. Applied Psychological Measurement, 22, 375–385.
(2001). Bias of coefficient α for fixed congeneric measure with correlated errors. Applied Psychological Measurement, 25, 69–76.
(2002). Reliability of scales with general structure: Point and interval estimation using a structural equation modeling approach. Structural Equation Modeling, 9, 195–212.
(1993). Coefficient alpha as an estimate of test reliability under violation of two assumptions. Educational and Psychological Measurement, 53, 33–49.
