The online version of this article (doi:10.1186/1471-2288-14-114) contains supplementary material, which is available to authorized users.
The authors declare that they have no competing interest.
SM developed the concept and outline of this study; BF developed the code “rps.gen” in R statistical software. Both BF and SM conducted the statistical analysis. All authors contributed to the writing of the manuscript. All authors read and approved the final manuscript.
Randomised controlled trials (RCT) are highly influential upon medical decisions. Thus RCTs must not distort the truth. One threat to internal trial validity is the correct prediction of future allocations (selection bias). The Berger-Exner test detects such bias but has not been widely utilized in practice. One reason for this non-utilisation may be a lack of information regarding its test accuracy. The objective of this study is to assess the accuracy of the Berger-Exner test on the basis of relevant simulations for RCTs with dichotomous outcomes.
Simulated RCTs with various parameter settings were generated, using R software, and subjected to bias-free and selection bias scenarios. The effect size inflation due to bias was quantified. The test was applied in both scenarios and the pooled sensitivity and specificity, with 95% confidence intervals for alpha levels of 1%, 5%, and 20%, were computed. Summary ROC curves were generated and the relationships of parameters with test accuracy were explored.
An effect size inflation of 71% - 99% was established. Test sensitivity was 1.00 (95% CI: 0.99 – 1.00) for alpha level 1%, 5%, and 20%; test specificity was 0.94 (95% CI: 0.93 – 0.96); 0.82 (95% CI: 0.80 – 0.84), and 0.56 (95% CI: 0.54 – 0.58) for alpha 1%, 5%, and 20%, respectively. Test accuracy was best with the maximal procedure used with a maximum tolerated imbalance (MTI) = 2 as the randomisation method at alpha 1%.
The results of this simulation study suggest that the Berger-Exner test is generally accurate for identifying third-order selection bias.
Green S, Higgins J: Glossary. Cochrane handbook for systematic reviews of interventions 4.2. 5. 2009, [Updated May 2005]
Berger VW: Selection bias and covariate imbalances in randomised clinical trials. 2005, Chichester, UK: John Wiley & Sons, Ltd. CrossRef
Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. J Am Med Assoc. 1995, 273: 408-412. 10.1001/jama.1995.03520290060030. CrossRef
Egger M, Jüni P, Bartlett C, Holenstein F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7: 1- PubMed
Berger VW, Exner DV: Detecting selection bias in randomized clinical trials. Contr Clin Trials. 1999, 20: 319-327. 10.1016/S0197-2456(99)00014-8. CrossRef
Luabeya KK, Mpontshane N, Mackay M, Ward H, Elson I, Chhagan M, Tomkins A, Van den Broeck J, Bennish ML: Zinc or multiple micronutrient supplementation to reduce diarrhea and respiratory disease in South African children: a randomized controlled trial. PLoS One. 2007, 2: e541-10.1371/journal.pone.0000541. CrossRefPubMedPubMedCentral
Nava S, Grassi M, Fanfulla F, Domenighetti G, Carlucci A, Perren A, Dell'Orso D, Vitacca M, Ceriana P, Karakurt Z, Clini E: Non-invasive ventilation in elderly patients with acute hypercapnic respiratory failure: a randomised controlled trial. Age Ageing. 2011, 40: 444-450. 10.1093/ageing/afr003. CrossRefPubMed
Swaminathan S, Menon PA, Gopalan N, Perumal V, Santhanakrishnan RK, Ramachandran R, Chinnaiyan P, Iliayas S, Chandrasekaran P, Navaneethapandian PD, Elangovan T, Pho MT, Wares F, Paranji Ramaiyengar N: Efficacy of a six-month versus a 36-month regimen for prevention of tuberculosis in HIV-infected persons in India: a randomized clinical trial. PLoS One. 2012, 7: e47400-10.1371/journal.pone.0047400. CrossRefPubMedPubMedCentral
Ganderton L, Jenkins S, Gain K, Fowler R, Winship P, Lunt D, Gabbay E: Short term effects of exercise training on exercise capacity and quality of life in patients with pulmonary arterial hypertension: protocol for a randomised controlled trial. BMC Pulm Med. 2011, 11: 25-10.1186/1471-2466-11-25. CrossRefPubMedPubMedCentral
Deeks JJ: Systematic reviews of evaluations of diagnostic and screening tests. Systematic reviews in health care. Edited by: Egger M, Smith GD, Altman DG. 2001, London, UK: BMJ Publishing group, 248- CrossRef
Moher D, Cook DJ, Jadad AR, Tugwell P, Moher M, Jones A, Pham B, Klassen TP: Assessing the quality of reports of randomised trials: implications for the conduct of meta-analyses. Health Technol Assess. 1999, 3: 1-98.
Higgins JPT, Green S: Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. Table 8.5.d. 2011, The Cochrane Collaboration, Available from http://www.cochrane-handbook.org
Odgaard-Jensen J, Vist GE, Timmer A, Kunz R, Akl EA, Schünemann H, Briel M, Nordmann AJ, Pregno S, Oxman AD: Randomisation to protect against selection bias in healthcare trials. Cochrane Database Syst Rev. 2011, 4: MR000012- PubMed
Guyatt GH, Oxman AD, Vist G, Kunz R, Brozek J, Alonso-Coello P, Montori V, Akl EA, Djulbegovic B, Falck-Ytter Y, Norris SL, Williams JW, Atkins D, Meerpohl J, Schünemann HJ: GRADE guidelines: 4. Rating the quality of evidence–study limitations (risk of bias). J Clin Epidemiol. 2011, 64: 407-715. 10.1016/j.jclinepi.2010.07.017. CrossRefPubMed
- Accuracy of the Berger-Exner test for detecting third-order selection bias in randomised controlled trials: a simulation-based investigation
Vance W Berger
- BioMed Central
Neu im Fachgebiet AINS
Meistgelesene Bücher aus dem Fachgebiet AINS
Mail Icon II