The author declares that he has no competing interests.
Inappropriate and unacceptable disregard for structural equation model (SEM) testing can be traced back to: factor-analytic inattention to model testing, misapplication of the Wilkinson task force’s [Am Psychol 54:594-604, 1999] critique of tests, exaggeration of test biases, and uncomfortably-numerous model failures.
The arguments for disregarding structural equation model testing are reviewed and found to be misguided or flawed. The fundamental test-supporting observations are: a) that the null hypothesis of the χ2 structural equation model test is not nil, but notable because it contains substantive theory claims and consequences; and b) that the amount of covariance ill fit cannot be trusted to report the seriousness of model misspecifications. All covariance-based fit indices risk failing to expose model problems because the extent of model misspecification does not reliably correspond to the magnitude of covariance ill fit – seriously causally misspecified models can fit, or almost fit.
The only reasonable research response to evidence of non-chance structural equation model failure is to diagnostically investigate the reasons for failure. Unfortunately, many SEM-based theories and measurement scales will require reassessment if we are to clear the backlogged consequences of previous deficient model testing. Fortunately, it will be easier for researchers to respect evidence pointing toward required reassessments, than to suffer manuscript rejection and shame for disrespecting evidence potentially signaling serious model misspecifications.
Wilkinson L, The Task Force on Statistical Inference: Statistical Methods in Psychology Journals: Guidelines and Explanations. Am Psychol. 1999, 54: 594-604. CrossRef
SEMNET: The Structural Equation Modeling Discussion Network. http://www.aime.ua.edu/cgi-bin/wa?A0=SEMNET,
Joreskog K, Sorbom D: LISREL III: Estimation of Linear Structural Equation Systems by Maximum Likelihood Methods, User’s Guide. 1976, Chicago: National Educational Resources, Inc.
Entwisle DR, Hayduk LA, Reilly TW: Early Schooling: Cognitive and Affective Outcomes. 1982, Baltimore: Johns Hopkins University Press
Sorbom D: Karl Joreskog and LISREL: A personal story. Structural Equation Modeling: Present and Future. A Festschrift in Honor of Karl Joreskog. Edited by: Cudeck R, du Toit S, Sorbom D. 2001, Lincolnwood, IL: Scientific Software International, 3-10.
Hayduk LA, Glaser DN: Jiving the four-step, waltzing around factor analysis, and other serious fun. Struct Equ Model. 2000, 7: 1-35. 10.1207/S15328007SEM0701_01. CrossRef
Barrett P: Structural equation modelling: Adjudging model fit. Person Individ Differ. 2007, 42: 815-824. 10.1016/j.paid.2006.09.018. CrossRef
Hayduk LA, Cummings GG, Boadu K, Pazderka-Robinson H, Boulianne S: Testing! Testing! One, two, three – Testing the theory in structural equation models!. Person Individ Differ. 2007, 42: 841-850. 10.1016/j.paid.2006.10.001. CrossRef
Bollen KA: Structural Equations with Latent Variables. 1989, New York: Wiley-Interscience CrossRef
Hayduk LA: Structural Equation Modeling with LISREL: Essentials and Advances. 1987, Baltimore: Johns Hopkins University Press
Ledermann W: On the rank of the reduced correlation matrix in multiple-factor analysis. Psychometrica. 1937, 2: 85-93. 10.1007/BF02288062. CrossRef
Hayduk LA: Seeing perfectly fitting factor models that are causally misspecified: Understanding that close-fitting models can be worse. Educ Psychol Meas. 2014, 74: 905-926. 10.1177/0013164414527449. doi:10.1177/0013164414527449 CrossRef
Savalei V: The relationship between root mean square error of approximation and model misspecification in confirmatory factor analysis models. Educ Psychol Meas. 2012, 72 (6): 910-932. 10.1177/0013164412452564. CrossRef
Heene M, Hilbert S, Freudenthaler HH, Buhner M: Sensitivity of SEM fit indexes with respect to violations of uncorrelated errors. Struct Equ Model. 2012, 19: 36-50. 10.1080/10705511.2012.634710. CrossRef
Browne MW, Cudeck R: Alternative ways of assessing model fit. Soc Method Res. 1992, 21 (2): 230-258. 10.1177/0049124192021002005. CrossRef
Hu L, Bentler PM: Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Model. 1999, 6: 1-55. 10.1080/10705519909540118. CrossRef
Box GEP: Robustness in the strategy of scientific model building. Robustness in Statistics. Edited by: Launer RL, Wilkinson GN. 1979, New York: Academic Press, 201-236.
Box GEP, Draper NR: Empirical Model-Building and Response Surfaces. 1987, New York: John Wiley & Sons
Box GEP: Some problems of statistics and everyday life. J Amer Stat Assoc. 1979, 74: 1-4. CrossRef
Joreskog K, Sorbom D: LISREL 8 User’s Reference Guide. 1996, Chicago, IL: Scientific Software International, Inc.
Fan X, Thompson B, Wang L: Effects of sample size, estimation methods, and model specification on structural equation modeling fit indexes. Struct Equ Model. 1999, 6: 56-83. 10.1080/10705519909540119. CrossRef
Box GEP, Hill WJ: Discriminating among mechanistic models. Technometrics. 1967, 9: 57-71. 10.1080/00401706.1967.10490441. CrossRef
Box GEP: Science and statistics. J Amer Stat Assoc. 1976, 71: 791-799. 10.1080/01621459.1976.10480949. CrossRef
Benjamini Y, Hochberg Y: Controlling the false discovery rate: A practical and powerful approach to multiple testing. J Royal Stat Soc. 1995, 57 (Series B): 289-300.
Herting JR, Costner HL: Another perspective on “the proper number of factors” and the appropriate number of steps. Struct Equ Model. 2000, 7: 92-110. 10.1207/S15328007SEM0701_05. CrossRef
Satorra A, Bentler PM: Corrections to test statistics and standard errors in covariance structure analysis. Latent Variable Analysis in Developmental Research. Edited by: von Eye A, Clogg C. 1994, Newbury Park, Calif: Sage Publications, 285-305.
Muthen BO: Goodness of fit with categorical and other nonnormal variables. Testing Structural Equation Models. Edited by: Bollen KA, Long JS. 1993, Newbury Park, Calif: Sage Publications, 205-234.
Curran PJ, Bollen KA, Paxton P, Kirby J, Chen F: The noncentral chi-square distribution in misspecified structural equation models: Finite sample results from a Monte Carlo simulation. Multivar Behav Res. 2002, 37: 1-36. 10.1207/S15327906MBR3701_01. CrossRef
Browne MW, MacCallum RC, Kim CT, Andersen BL, Glaser R: When fit indices and residuals are incompatible. Psychol Meth. 2002, 7: 403-421. CrossRef
Hayduk LA, Pazderka-Robinson H, Cummings GG, Levers MD, Beres MA: Structural equation model testing and the quality of natural killer cell activity measurements. BMC Med Res Methodol. 2005, 5 (1): doi:10.1186/1471-2288-5-1
Hayduk LA: Personal Space: Understanding the Simplex Model. J Nonverbal Behav. 1994, 18 (3): 245-260. 10.1007/BF02170028. CrossRef
Hayduk LA, Stratkotter RF, Rovers MW: Sexual orientation and the willingness of Catholic seminary students to conform to church teachings. J Sci Stud Relig. 1997, 36 (3): 455-467. 10.2307/1387861. CrossRef
Hayduk LA, Pazderka-Robinson H, Cummings GG, Boadu K, Verbeek EL, Perks TA: The weird world, and equally weird measurement models: Reactive indicators and the validity revolution. Struct Equ Model. 2007, 14 (2): 280-310. 10.1080/10705510709336747. CrossRef
Hayduk LA, Pazderka-Robinson H: Fighting to understand the world causally: Three battles connected to the causal implications of structural equation models. Sage Handbook of Social Science Methodology. Edited by: Outhwaite W, Turner S. 2007, London: Sage Publications, 147-171.
- Shame for disrespecting evidence: the personal consequences of insufficient respect for structural equation model testing
Leslie A Hayduk
- BioMed Central
Neu im Fachgebiet AINS
Meistgelesene Bücher aus dem Fachgebiet AINS
Mail Icon II