Skip to main content
Erschienen in: Journal of Neuro-Oncology 3/2015

01.09.2015 | Topic Review

Randomized controlled trials and neuro-oncology: should alternative designs be considered?

verfasst von: Alireza Mansouri, Samuel Shin, Benjamin Cooper, Archita Srivastava, Mohit Bhandari, Douglas Kondziolka

Erschienen in: Journal of Neuro-Oncology | Ausgabe 3/2015

Einloggen, um Zugang zu erhalten

Abstract

Deficiencies in design and reporting of randomized controlled trials (RCTs) hinders interpretability and critical appraisal. The reporting quality of recent RCTs in neuro-oncology was analyzed to assess adequacy of design and reporting. The MEDLINE and EMBASE databases were searched to identify non-surgical RCTs (years 2005–2014, inclusive). The CONSORT and Jadad scales were used to assess the quality of design/reporting. Studies published in 2005–2010 were compared as a cohort against studies published in 2011–2014, in terms of general characteristics and reporting quality. A PRECIS-based scale was used to designate studies on the pragmatic-explanatory continuum. Spearman’s test was used to assess correlations. Regression analysis was used to assess associations. Overall 68 RCTs were identified. Studies were often chemotherapy-based (n = 41 studies) focusing upon high grade gliomas (46 %) and metastases (41 %) as the top pathologies. Multi-center trials (71 %) were frequent. The overall median CONSORT and Jadad scores were 34.5 (maximum 44) and 2 (maximum 5), respectively; these scores were similar in radiation and chemotherapy-based trials. Major areas of deficiency pertained to allocation concealment, implementation of methods, and blinding whereby less than 20 % of articles fulfilled all criteria. Description of intervention, random sequence generation, and the details regarding recruitment were also deficient; less than 50 % of studies fulfilled all criteria. Description of sample size calculations and blinding improved in later published cohorts. Journal impact factor was significantly associated with higher quality (p = 0.04). Large academic consortia, multi-center designs, ITT analysis, collaboration with biostatisticians, larger sample sizes, and studies with pragmatic objectives were more likely to achieve positive primary outcomes on univariate analysis; none of these variables were significant on multivariate analysis. Deficiencies in the quality of design/reporting of RCTs in neuro-oncology persist. Quality improvement is necessary. Consideration of alternative strategies should be considered.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
2.
Zurück zum Zitat Yusuf S, Collins R, Peto R (1984) Why do we need some large, simple randomized trials? Stat Med 3:409–422CrossRefPubMed Yusuf S, Collins R, Peto R (1984) Why do we need some large, simple randomized trials? Stat Med 3:409–422CrossRefPubMed
4.
Zurück zum Zitat Andrews DW, Scott CB, Sperduto PW, Flanders AE, Gaspar LE, Schell MC, Werner-Wasik M, Demas W, Ryu J, Bahary JP, Souhami L, Rotman M, Mehta MP, Curran WJ Jr (2004) Whole brain radiation therapy with or without stereotactic radiosurgery boost for patients with one to three brain metastases: phase III results of the RTOG 9508 randomised trial. Lancet 363:1665–1672. doi:10.1016/S0140-6736(04)16250-8 CrossRefPubMed Andrews DW, Scott CB, Sperduto PW, Flanders AE, Gaspar LE, Schell MC, Werner-Wasik M, Demas W, Ryu J, Bahary JP, Souhami L, Rotman M, Mehta MP, Curran WJ Jr (2004) Whole brain radiation therapy with or without stereotactic radiosurgery boost for patients with one to three brain metastases: phase III results of the RTOG 9508 randomised trial. Lancet 363:1665–1672. doi:10.​1016/​S0140-6736(04)16250-8 CrossRefPubMed
5.
Zurück zum Zitat Patchell RA, Tibbs PA, Walsh JW, Dempsey RJ, Maruyama Y, Kryscio RJ, Markesbery WR, Macdonald JS, Young B (1990) A randomized trial of surgery in the treatment of single metastases to the brain. New Engl J Med 322:494–500. doi:10.1056/NEJM199002223220802 CrossRefPubMed Patchell RA, Tibbs PA, Walsh JW, Dempsey RJ, Maruyama Y, Kryscio RJ, Markesbery WR, Macdonald JS, Young B (1990) A randomized trial of surgery in the treatment of single metastases to the brain. New Engl J Med 322:494–500. doi:10.​1056/​NEJM199002223220​802 CrossRefPubMed
6.
Zurück zum Zitat Tsao M, Xu W, Sahgal A (2012) A meta-analysis evaluating stereotactic radiosurgery, whole-brain radiotherapy, or both for patients presenting with a limited number of brain metastases. Cancer 118:2486–2493. doi:10.1002/cncr.26515 CrossRefPubMed Tsao M, Xu W, Sahgal A (2012) A meta-analysis evaluating stereotactic radiosurgery, whole-brain radiotherapy, or both for patients presenting with a limited number of brain metastases. Cancer 118:2486–2493. doi:10.​1002/​cncr.​26515 CrossRefPubMed
7.
Zurück zum Zitat Tsao MN, Lloyd N, Wong RK, Chow E, Rakovitch E, Laperriere N, Xu W, Sahgal A (2012) Whole brain radiotherapy for the treatment of newly diagnosed multiple brain metastases. Cochrane Database Syst Rev 4:CD003869. doi:10.1002/14651858.CD003869.pub3 Tsao MN, Lloyd N, Wong RK, Chow E, Rakovitch E, Laperriere N, Xu W, Sahgal A (2012) Whole brain radiotherapy for the treatment of newly diagnosed multiple brain metastases. Cochrane Database Syst Rev 4:CD003869. doi:10.​1002/​14651858.​CD003869.​pub3
8.
9.
Zurück zum Zitat Moher D, Jones A, Lepage L, Group C (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995CrossRefPubMed Moher D, Jones A, Lepage L, Group C (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995CrossRefPubMed
11.
Zurück zum Zitat Kunz R, Neumayer HH, Khan KS (2002) When small degrees of bias in randomized trials can mislead clinical decisions: an example of individualizing preventive treatment of upper gastrointestinal bleeding. Crit Care Med 30:1503–1507CrossRefPubMed Kunz R, Neumayer HH, Khan KS (2002) When small degrees of bias in randomized trials can mislead clinical decisions: an example of individualizing preventive treatment of upper gastrointestinal bleeding. Crit Care Med 30:1503–1507CrossRefPubMed
15.
16.
Zurück zum Zitat Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A (1989) Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA 262:2101–2107CrossRefPubMed Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A (1989) Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA 262:2101–2107CrossRefPubMed
17.
Zurück zum Zitat Moher D, Schulz KF, Altman DG, Group C (2001) The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc 91:437–442CrossRef Moher D, Schulz KF, Altman DG, Group C (2001) The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc 91:437–442CrossRef
18.
Zurück zum Zitat Jadad AR, Cook DJ, Browman GP (1997) A guide to interpreting discordant systematic reviews. Can Med Assoc J 156:1411–1416 Jadad AR, Cook DJ, Browman GP (1997) A guide to interpreting discordant systematic reviews. Can Med Assoc J 156:1411–1416
19.
Zurück zum Zitat Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K (2009) A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. Can Med Assoc J 180:47–57. doi:10.1503/cmaj.090523 CrossRef Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K (2009) A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. Can Med Assoc J 180:47–57. doi:10.​1503/​cmaj.​090523 CrossRef
20.
Zurück zum Zitat Mansouri A, CB, Shin S, Kondziolka D (2015) Randomized Controlled Trials and Neurosurgery: the ideal fit or should alternative methodologies be considered? J Neurosurg Mansouri A, CB, Shin S, Kondziolka D (2015) Randomized Controlled Trials and Neurosurgery: the ideal fit or should alternative methodologies be considered? J Neurosurg
21.
Zurück zum Zitat You B, Gan HK, Pond G, Chen EX (2012) Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials from registration to publication: a systematic review. J Clin Oncol 30:210–216. doi:10.1200/JCO.2011.37.0890 CrossRefPubMed You B, Gan HK, Pond G, Chen EX (2012) Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials from registration to publication: a systematic review. J Clin Oncol 30:210–216. doi:10.​1200/​JCO.​2011.​37.​0890 CrossRefPubMed
22.
Zurück zum Zitat Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR (1991) Publication bias in clinical research. Lancet 337:867–872CrossRefPubMed Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR (1991) Publication bias in clinical research. Lancet 337:867–872CrossRefPubMed
23.
26.
27.
Zurück zum Zitat Chan AY, Hooi LS (2000) Outcome of 85 lupus nephritis patients treated with intravenous cyclophosphamide: a single centre 10 year experience. Med J Malays 55:14–20 Chan AY, Hooi LS (2000) Outcome of 85 lupus nephritis patients treated with intravenous cyclophosphamide: a single centre 10 year experience. Med J Malays 55:14–20
28.
Zurück zum Zitat Schulz KF, Chalmers I, Hayes RJ, Altman DG (1995) Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273:408–412CrossRefPubMed Schulz KF, Chalmers I, Hayes RJ, Altman DG (1995) Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273:408–412CrossRefPubMed
29.
Zurück zum Zitat Pildal J, Hrobjartsson A, Jorgensen KJ, Hilden J, Altman DG, Gotzsche PC (2007) Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 36:847–857. doi:10.1093/ije/dym087 CrossRefPubMed Pildal J, Hrobjartsson A, Jorgensen KJ, Hilden J, Altman DG, Gotzsche PC (2007) Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 36:847–857. doi:10.​1093/​ije/​dym087 CrossRefPubMed
30.
31.
Zurück zum Zitat Feinstein AR (1995) Meta-analysis: statistical alchemy for the 21st century. J Clin Epidemiol 48:71–79CrossRefPubMed Feinstein AR (1995) Meta-analysis: statistical alchemy for the 21st century. J Clin Epidemiol 48:71–79CrossRefPubMed
32.
Zurück zum Zitat Huwiler-Muntener K, Juni P, Junker C, Egger M (2002) Quality of reporting of randomized trials as a measure of methodologic quality. JAMA 287:2801–2804CrossRefPubMed Huwiler-Muntener K, Juni P, Junker C, Egger M (2002) Quality of reporting of randomized trials as a measure of methodologic quality. JAMA 287:2801–2804CrossRefPubMed
33.
Zurück zum Zitat Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B, Radiation Therapy Oncology G (2004) Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ 328:22–24. doi:10.1136/bmj.328.7430.22 CrossRefPubMedPubMedCentral Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B, Radiation Therapy Oncology G (2004) Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ 328:22–24. doi:10.​1136/​bmj.​328.​7430.​22 CrossRefPubMedPubMedCentral
34.
Zurück zum Zitat Devereaux PJ, Choi PT, El-Dika S, Bhandari M, Montori VM, Schunemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH (2004) An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 57:1232–1236. doi:10.1016/j.jclinepi.2004.03.017 CrossRefPubMed Devereaux PJ, Choi PT, El-Dika S, Bhandari M, Montori VM, Schunemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH (2004) An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 57:1232–1236. doi:10.​1016/​j.​jclinepi.​2004.​03.​017 CrossRefPubMed
35.
Zurück zum Zitat Liberati A, Himel HN, Chalmers TC (1986) A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol 4:942–951CrossRefPubMed Liberati A, Himel HN, Chalmers TC (1986) A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol 4:942–951CrossRefPubMed
38.
Zurück zum Zitat Ioannidis JP, Cappelleri JC, Lau J (1998) Issues in comparisons between meta-analyses and large trials. JAMA 279:1089–1093CrossRefPubMed Ioannidis JP, Cappelleri JC, Lau J (1998) Issues in comparisons between meta-analyses and large trials. JAMA 279:1089–1093CrossRefPubMed
40.
Zurück zum Zitat Misakian AL, Bero LA (1998) Publication bias and research on passive smoking: comparison of published and unpublished studies. JAMA 280:250–253CrossRefPubMed Misakian AL, Bero LA (1998) Publication bias and research on passive smoking: comparison of published and unpublished studies. JAMA 280:250–253CrossRefPubMed
42.
Zurück zum Zitat Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ (2010) Sample size calculations: basic principles and common pitfalls. Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association—European Renal Association 25:1388–1393. doi:10.1093/ndt/gfp732 CrossRef Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ (2010) Sample size calculations: basic principles and common pitfalls. Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association—European Renal Association 25:1388–1393. doi:10.​1093/​ndt/​gfp732 CrossRef
43.
Zurück zum Zitat Wittes J (2002) Sample size calculations for randomized controlled trials. Epidemiol Rev 24:39–53CrossRefPubMed Wittes J (2002) Sample size calculations for randomized controlled trials. Epidemiol Rev 24:39–53CrossRefPubMed
44.
45.
Zurück zum Zitat Bhandari M, Richards RR, Sprague S, Schemitsch EH (2002) The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am 84:388–396CrossRefPubMed Bhandari M, Richards RR, Sprague S, Schemitsch EH (2002) The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am 84:388–396CrossRefPubMed
51.
Zurück zum Zitat Wheatley K, Clayton D (2003) Be skeptical about unexpected large apparent treatment effects: the case of an MRC AML12 randomization. Control Clin Trials 24:66–70CrossRefPubMed Wheatley K, Clayton D (2003) Be skeptical about unexpected large apparent treatment effects: the case of an MRC AML12 randomization. Control Clin Trials 24:66–70CrossRefPubMed
52.
Zurück zum Zitat Roche N, Reddel H, Martin R, Brusselle G, Papi A, Thomas M, Postma D, Thomas V, Rand C, Chisholm A, Price D, Respiratory Effectiveness G (2014) Quality standards for real-world research. Focus on observational database studies of comparative effectiveness. Ann Am Thorac Soc 11(Suppl 2):S99–104. doi:10.1513/AnnalsATS.201309-300RM CrossRefPubMed Roche N, Reddel H, Martin R, Brusselle G, Papi A, Thomas M, Postma D, Thomas V, Rand C, Chisholm A, Price D, Respiratory Effectiveness G (2014) Quality standards for real-world research. Focus on observational database studies of comparative effectiveness. Ann Am Thorac Soc 11(Suppl 2):S99–104. doi:10.​1513/​AnnalsATS.​201309-300RM CrossRefPubMed
53.
Metadaten
Titel
Randomized controlled trials and neuro-oncology: should alternative designs be considered?
verfasst von
Alireza Mansouri
Samuel Shin
Benjamin Cooper
Archita Srivastava
Mohit Bhandari
Douglas Kondziolka
Publikationsdatum
01.09.2015
Verlag
Springer US
Erschienen in
Journal of Neuro-Oncology / Ausgabe 3/2015
Print ISSN: 0167-594X
Elektronische ISSN: 1573-7373
DOI
https://doi.org/10.1007/s11060-015-1870-6

Weitere Artikel der Ausgabe 3/2015

Journal of Neuro-Oncology 3/2015 Zur Ausgabe

Leitlinien kompakt für die Neurologie

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Neurologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.