Skip to main content
Erschienen in: Journal of General Internal Medicine 8/2020

01.08.2020 | Original Research

Risk of Bias and Quality of Reporting in Colon and Rectal Cancer Systematic Reviews Cited by National Comprehensive Cancer Network Guidelines

verfasst von: C Wayant, BS, L Puljak, PhD, M Bibens, MS, M Vassar, PhD

Erschienen in: Journal of General Internal Medicine | Ausgabe 8/2020

Einloggen, um Zugang zu erhalten

Abstract

Introduction

Given the changing landscape of colorectal cancer, systematic reviews are likely to play a key role in advancing the understanding of prevention, diagnosis, and treatment.

Methods

We conducted a cross-sectional investigation of the risk of bias and reporting quality of systematic reviews referenced by colon and rectal cancer National Comprehensive Cancer Network (NCCN) guidelines. We used two widely accepted tools: Risk of Bias in Systematic reviews (ROBIS) and Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA).

Results

Using ROBIS, only 3 (4.8%) systematic reviews were judged with low risk of bias, 35 (55.6%) systematic reviews were judged with unclear risk of bias, and 25 (39.7%) systematic reviews were judged with high risk of bias. Across all systematic reviews, the individual bias domains at the highest risk of bias were domains 1 (protocol and eligibility criteria) and 2 (methods to identify and select studies). Across all studies, the median adherence to PRISMA was 74.1% (IQR 69.2–80.0%), corresponding to approximately 20 of 27 items.

Conclusions

Systematic reviews cited in NCCN guidelines for colon and rectal cancer are frequently at unclear or high risk of bias and do not report key systematic review items that are important for the critical appraisal of results.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Higgins JPT GS, ed. Cochrane Handbook for Systematic Reviews of Interventions: online version (5.1.0, March 2011). The Cochrane Collaboration. 2011. www.cochrane-handbook.org. Higgins JPT GS, ed. Cochrane Handbook for Systematic Reviews of Interventions: online version (5.1.0, March 2011). The Cochrane Collaboration. 2011. www.​cochrane-handbook.​org.
2.
Zurück zum Zitat Roberts D, Dalziel S. Antenatal corticosteroids for accelerating fetal lung maturation for women at risk of preterm birth. Cochrane Database Syst Rev. 2006;(3):CD004454. Roberts D, Dalziel S. Antenatal corticosteroids for accelerating fetal lung maturation for women at risk of preterm birth. Cochrane Database Syst Rev. 2006;(3):CD004454.
3.
Zurück zum Zitat Roundtree AK, Kallen MA, Lopez-Olivo MA, et al. Poor reporting of search strategy and conflict of interest in over 250 narrative and systematic reviews of two biologic agents in arthritis: a systematic review. J Clin Epidemiol. 2009;62(2):128–137.CrossRef Roundtree AK, Kallen MA, Lopez-Olivo MA, et al. Poor reporting of search strategy and conflict of interest in over 250 narrative and systematic reviews of two biologic agents in arthritis: a systematic review. J Clin Epidemiol. 2009;62(2):128–137.CrossRef
4.
Zurück zum Zitat Page MJ, Shamseer L, Altman DG, et al. Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLoS Med. 2016;13(5):e1002028.CrossRef Page MJ, Shamseer L, Altman DG, et al. Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLoS Med. 2016;13(5):e1002028.CrossRef
5.
Zurück zum Zitat Institute of Medicine Board on Health Care Services Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical Practice Guidelines We Can Trust. National Academies Press; 2011. Institute of Medicine Board on Health Care Services Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical Practice Guidelines We Can Trust. National Academies Press; 2011.
6.
Zurück zum Zitat Schünemann H, Brożek J, Guyatt G, Oxman A, ed. GRADE Handbook for Grading Quality of Evidence and Strength of Recommendations.; 2013. Schünemann H, Brożek J, Guyatt G, Oxman A, ed. GRADE Handbook for Grading Quality of Evidence and Strength of Recommendations.; 2013.
7.
Zurück zum Zitat Nissen T, Wayant C, Wahlstrom A, et al. Methodological quality, completeness of reporting and use of systematic reviews as evidence in clinical practice guidelines for paediatric overweight and obesity. Clin Obes. 2017;7(1):34–45.CrossRef Nissen T, Wayant C, Wahlstrom A, et al. Methodological quality, completeness of reporting and use of systematic reviews as evidence in clinical practice guidelines for paediatric overweight and obesity. Clin Obes. 2017;7(1):34–45.CrossRef
8.
Zurück zum Zitat Ross A, Rankin J, Beaman J, et al. Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder. PLoS One. 2017;12(8):e0181927.CrossRef Ross A, Rankin J, Beaman J, et al. Methodological quality of systematic reviews referenced in clinical practice guidelines for the treatment of opioid use disorder. PLoS One. 2017;12(8):e0181927.CrossRef
10.
Zurück zum Zitat Bailey CE, Hu C-Y, You YN, et al. Increasing disparities in the age-related incidences of colon and rectal cancers in the United States, 1975-2010. JAMA Surg. 2015;150(1):17–22.CrossRef Bailey CE, Hu C-Y, You YN, et al. Increasing disparities in the age-related incidences of colon and rectal cancers in the United States, 1975-2010. JAMA Surg. 2015;150(1):17–22.CrossRef
11.
Zurück zum Zitat Weinberg BA, Marshall JL, Salem ME. The Growing Challenge of Young Adults With Colorectal Cancer. Oncology . 2017;31(5):381–389.PubMed Weinberg BA, Marshall JL, Salem ME. The Growing Challenge of Young Adults With Colorectal Cancer. Oncology . 2017;31(5):381–389.PubMed
14.
Zurück zum Zitat Jagsi R, Huang G, Griffith K, et al. Attitudes toward and use of cancer management guidelines in a national sample of medical oncologists and surgeons. J Natl Compr Canc Netw. 2014;12(2):204–212.CrossRef Jagsi R, Huang G, Griffith K, et al. Attitudes toward and use of cancer management guidelines in a national sample of medical oncologists and surgeons. J Natl Compr Canc Netw. 2014;12(2):204–212.CrossRef
15.
Zurück zum Zitat Whiting P, Savović J, Higgins JPT, et al. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225–234.CrossRef Whiting P, Savović J, Higgins JPT, et al. ROBIS: A new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225–234.CrossRef
16.
Zurück zum Zitat Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–269, W64.CrossRef Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264–269, W64.CrossRef
17.
Zurück zum Zitat Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.CrossRef Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.CrossRef
19.
Zurück zum Zitat Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.CrossRef Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.CrossRef
20.
Zurück zum Zitat Wayant C, Puljak L, Bibens M, Vassar M. Protocol: Risk of bias and reporting quality in systematic reviews underpinning colorectal cancer guidelines. https://osf.io/a24bu/. Published April 29, 2019. . Wayant C, Puljak L, Bibens M, Vassar M. Protocol: Risk of bias and reporting quality in systematic reviews underpinning colorectal cancer guidelines. https://​osf.​io/​a24bu/​. Published April 29, 2019. .
21.
Zurück zum Zitat Wayant C, Scheckel C, Hicks C, et al. Evidence of selective reporting bias in hematology journals: A systematic review. PLoS One. 2017;12(6):e0178379.CrossRef Wayant C, Scheckel C, Hicks C, et al. Evidence of selective reporting bias in hematology journals: A systematic review. PLoS One. 2017;12(6):e0178379.CrossRef
22.
Zurück zum Zitat Raghav KPS, Mahajan S, Yao JC, et al. From Protocols to Publications: A Study in Selective Reporting of Outcomes in Randomized Trials in Oncology. J Clin Oncol. 2015;33(31):3583–3590.CrossRef Raghav KPS, Mahajan S, Yao JC, et al. From Protocols to Publications: A Study in Selective Reporting of Outcomes in Randomized Trials in Oncology. J Clin Oncol. 2015;33(31):3583–3590.CrossRef
23.
Zurück zum Zitat Chan A-W, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457–2465.CrossRef Chan A-W, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457–2465.CrossRef
25.
Zurück zum Zitat Propadalo I, Tranfic M, Vuka I, Barcot O, Pericic TP, Puljak L. In Cochrane reviews, risk of bias assessments for allocation concealment were frequently not in line with Cochrane’s Handbook guidance. J Clin Epidemiol. 2019;106:10–17.CrossRef Propadalo I, Tranfic M, Vuka I, Barcot O, Pericic TP, Puljak L. In Cochrane reviews, risk of bias assessments for allocation concealment were frequently not in line with Cochrane’s Handbook guidance. J Clin Epidemiol. 2019;106:10–17.CrossRef
27.
Zurück zum Zitat Babic A, Tokalic R, Amílcar Silva Cunha J, et al. Assessments of attrition bias in Cochrane systematic reviews are highly inconsistent and thus hindering trial comparability. BMC Med Res Methodol. 2019;19(1):76. Babic A, Tokalic R, Amílcar Silva Cunha J, et al. Assessments of attrition bias in Cochrane systematic reviews are highly inconsistent and thus hindering trial comparability. BMC Med Res Methodol. 2019;19(1):76.
Metadaten
Titel
Risk of Bias and Quality of Reporting in Colon and Rectal Cancer Systematic Reviews Cited by National Comprehensive Cancer Network Guidelines
verfasst von
C Wayant, BS
L Puljak, PhD
M Bibens, MS
M Vassar, PhD
Publikationsdatum
01.08.2020
Verlag
Springer International Publishing
Erschienen in
Journal of General Internal Medicine / Ausgabe 8/2020
Print ISSN: 0884-8734
Elektronische ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-020-05639-y

Weitere Artikel der Ausgabe 8/2020

Journal of General Internal Medicine 8/2020 Zur Ausgabe

Viewpoint

Pandemic Loss

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.