The online version of this article (doi:10.1186/1471-2288-14-49) contains supplementary material, which is available to authorized users.
The authors have no competing interests.
JS and ML conceived the study. All authors designed the study. BEE planned and performed the simulations. All authors interpreted the data. All authors drafted the manuscript and approved the final version.
Analysis of variance (ANOVA), change-score analysis (CSA) and analysis of covariance (ANCOVA) respond differently to baseline imbalance in randomized controlled trials. However, no empirical studies appear to have quantified the differential bias and precision of estimates derived from these methods of analysis, and their relative statistical power, in relation to combinations of levels of key trial characteristics. This simulation study therefore examined the relative bias, precision and statistical power of these three analyses using simulated trial data.
126 hypothetical trial scenarios were evaluated (126 000 datasets), each with continuous data simulated by using a combination of levels of: treatment effect; pretest-posttest correlation; direction and magnitude of baseline imbalance. The bias, precision and power of each method of analysis were calculated for each scenario.
Compared to the unbiased estimates produced by ANCOVA, both ANOVA and CSA are subject to bias, in relation to pretest-posttest correlation and the direction of baseline imbalance. Additionally, ANOVA and CSA are less precise than ANCOVA, especially when pretest-posttest correlation ≥ 0.3. When groups are balanced at baseline, ANCOVA is at least as powerful as the other analyses. Apparently greater power of ANOVA and CSA at certain imbalances is achieved in respect of a biased treatment effect.
Across a range of correlations between pre- and post-treatment scores and at varying levels and direction of baseline imbalance, ANCOVA remains the optimum statistical method for the analysis of continuous outcomes in RCTs, in terms of bias, precision and statistical power.
Rosenberger WF, Lachin JM: Randomization in Clinical Trials: Theory and Practice. 2002, New York, NY: Wiley-Interscience CrossRef
Tu D, Shalay K, Pater J: Adjustment of treatment effect for covariates in clinical trials: statistical and regulatory issues. Drug Inf J. 2000, 34: 511-523.
Piantadosi S: Clinical Trials: a Methodologic Perspective. 2005, New York: Wiley, 2 CrossRef
Kernan WN, Makuch RM: Response. J Clin Epidemiol. 2001, 54: 105-10.1016/S0895-4356(00)00285-7. CrossRef
Taves DR: Faulty assumptions in Atkinson’s criteria for clinical trial design. J R Stat Soc. 2004, 167: 179-181. 10.1046/j.0964--1998.2003.00741.x. CrossRef
Rosenberger WF, Sverdlov O: Handling covariates in the design of clinical trials. Stat Sci. 2008, 23: 404-419. 10.1214/08-STS269. CrossRef
Ciolino JD, Martin RH, Zhao W, Hill MD, Jauch EC, Palesch YY: Measuring continuous baseline covariate imbalances in clinical trial data. Stat Methods Med Res. 2011, doi:10.1177/0962280211416038
Austin PC, Manca A, Zwarenstein M, Juurlink DN, Stanbrook MB: A substantial and confusing variation exists in handling of baseline covariates in randomized controlled trials: a review of trials published in leading medical journals. J Clin Epidemiol. 2010, 63: 142-153. 10.1016/j.jclinepi.2009.06.002. CrossRefPubMed
Matthews JNS: Introduction to Randomized Controlled Clinical Trials. 2006, Boca Raton, FL: Chapman & Hall/CRC, 2 CrossRef
Huitema B: The Analysis of Covariance and Alternatives: Statistical Methods for Experiments, Quasi-Experiments, and Single-Case Studies. 2011, Hoboken, NJ: Wiley, 2 CrossRef
Christensen E, Neuberger J, Crowe J, Altman DG, Popper H, Portmann B, Doniach D, Ranek L, Tygstrup N, Williams R: Beneficial effect of azathioprine and prediction of prognosis in primary biliary cirrhosis. Final results of an international trial. Gastroenterology. 1985, 89: 1084-1091. CrossRefPubMed
Cohen J: Statistical Power Analysis for the Behavioral Sciences. 1988, Hillsdale NJ: Lawrence Erlbaum, 2
Wei L, Zhang J: Analysis of data with imbalance in the baseline outcome variable for randomized clinical trials. Drug Inf J. 2001, 35: 1201-1214. 10.1177/009286150103500417. CrossRef
DHHS: Guidance for Industry E9: Statistical Principles for Clinical Trials. 1998, Rockville MD: Department of Health and Human Services
Chan A-W, Tetzlaff JM, Gøtzsche PC, Altman DG, Mann H, Berlin JA, Dickersin K, Hróbjartsson A, Schulz KF, Parulekar WR, Krleža-Jeric K, Laupacis A, Moher D: SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013, 346: e7586-10.1136/bmj.e7586. CrossRefPubMedPubMedCentral
Overall JE, Ashby B: Baseline corrections in experimental and quasi-experimental clinical trials. Neuropsychopharmacology. 1991, 4: 273-281. PubMed
- Bias, precision and statistical power of analysis of covariance in the analysis of randomized trials with baseline imbalance: a simulation study
Bolaji E Egbewale
- BioMed Central
Neu im Fachgebiet AINS
Meistgelesene Bücher aus dem Fachgebiet AINS
Mail Icon II