Skip to main content
Erschienen in: Digestive Diseases and Sciences 7/2022

24.06.2021 | Original Article

Regression and Random Forest Machine Learning Have Limited Performance in Predicting Bowel Preparation in Veteran Population

verfasst von: Jacob E. Kurlander, Akbar K. Waljee, Stacy B. Menees, Rachel Lipson, Alex N. Kokaly, Andrew J. Read, Karmel S. Shehadeh, Amy Cohn, Sameer D. Saini

Erschienen in: Digestive Diseases and Sciences | Ausgabe 7/2022

Einloggen, um Zugang zu erhalten

Abstract

Background

Inadequate bowel preparation undermines the quality of colonoscopy, but patients likely to be affected are difficult to identify beforehand.

Aims

This study aimed to develop, validate, and compare prediction models for bowel preparation inadequacy using conventional logistic regression (LR) and random forest machine learning (RFML).

Methods

We created a retrospective cohort of patients who underwent outpatient colonoscopy at a single VA medical center between January 2012 and October 2015. Candidate predictor variables were chosen after a literature review. We extracted all available predictor variables from the electronic medical record, and bowel preparation from the endoscopy database. The data were split into 70% training and 30% validation sets. Multivariable LR and RFML were used to predict preparation inadequacy as a dichotomous outcome.

Results

The cohort included 6,885 Veterans, of whom 964 (14%) had inadequate preparation. Using LR, the area under the receiver operating characteristic curve (AUC) for the validation cohort was 0.66 (95% CI 0.62, 0.69) and the Brier score, in which a lower score indicates better performance, was 0.11. Using RFML, the AUC for the validation cohort was 0.61 (95% CI 0.58, 0.65) and the Brier score was 0.12.

Conclusions

LR and RFML had similar performance in predicting bowel preparation, which was modest and likely insufficient for use in practice. Future research is needed to identify additional predictor variables and to test other machine learning algorithms. At present, endoscopy units should focus on universal strategies to enhance preparation adequacy.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat US Preventive Services Task Force, Davidson KW, Barry MJ, Mangione CM et al. Screening for colorectal cancer: US preventive services task force recommendation statement. JAMA. 2021;325:1965.CrossRef US Preventive Services Task Force, Davidson KW, Barry MJ, Mangione CM et al. Screening for colorectal cancer: US preventive services task force recommendation statement. JAMA. 2021;325:1965.CrossRef
3.
Zurück zum Zitat Johnson DA, Barkun AN, Cohen LB et al. Optimizing adequacy of bowel cleansing for colonoscopy: recommendations from the US Multi-Society Task Force on Colorectal Cancer. Gastrointest Endosc. 2014;80:543–562.CrossRef Johnson DA, Barkun AN, Cohen LB et al. Optimizing adequacy of bowel cleansing for colonoscopy: recommendations from the US Multi-Society Task Force on Colorectal Cancer. Gastrointest Endosc. 2014;80:543–562.CrossRef
4.
Zurück zum Zitat Kilgore TW, Abdinoor AA, Szary NM et al. Bowel preparation with split-dose polyethylene glycol before colonoscopy: a meta-analysis of randomized controlled trials. Gastrointest Endosc. 2011;73:1240–1245.CrossRef Kilgore TW, Abdinoor AA, Szary NM et al. Bowel preparation with split-dose polyethylene glycol before colonoscopy: a meta-analysis of randomized controlled trials. Gastrointest Endosc. 2011;73:1240–1245.CrossRef
5.
Zurück zum Zitat Sim JS, Koo JS. Predictors of inadequate bowel preparation and salvage options on colonoscopy. Clin Endosc. 2016;49:346–349.CrossRef Sim JS, Koo JS. Predictors of inadequate bowel preparation and salvage options on colonoscopy. Clin Endosc. 2016;49:346–349.CrossRef
6.
Zurück zum Zitat Woo DH, Kim KO, Jeong DE et al. Prospective analysis of factors associated with inadequate bowel preparation for colonoscopy in actual clinical practice. Intest Res. 2018;16:293.CrossRef Woo DH, Kim KO, Jeong DE et al. Prospective analysis of factors associated with inadequate bowel preparation for colonoscopy in actual clinical practice. Intest Res. 2018;16:293.CrossRef
7.
Zurück zum Zitat Rutherford CC, Calderwood AH. Update on bowel preparation for colonoscopy. Curr Treat Options Gastroenterol. 2018;16:165–181.CrossRef Rutherford CC, Calderwood AH. Update on bowel preparation for colonoscopy. Curr Treat Options Gastroenterol. 2018;16:165–181.CrossRef
8.
Zurück zum Zitat Lebwohl B, Kastrinos F, Glick M, et al. The impact of suboptimal bowel preparation on adenoma miss rates and the factors associated with early repeat colonoscopy. Gastrointest Endosc. 2011;73:1207–1214.CrossRef Lebwohl B, Kastrinos F, Glick M, et al. The impact of suboptimal bowel preparation on adenoma miss rates and the factors associated with early repeat colonoscopy. Gastrointest Endosc. 2011;73:1207–1214.CrossRef
9.
Zurück zum Zitat Froehlich F, Wietlisbach V, Gonvers J-J, Burnand B, Vader J-P. Impact of colonic cleansing on quality and diagnostic yield of colonoscopy: The European Panel of Appropriateness of Gastrointestinal Endoscopy European multicenter study. Gastrointest Endosc. 2005;61:378–384.CrossRef Froehlich F, Wietlisbach V, Gonvers J-J, Burnand B, Vader J-P. Impact of colonic cleansing on quality and diagnostic yield of colonoscopy: The European Panel of Appropriateness of Gastrointestinal Endoscopy European multicenter study. Gastrointest Endosc. 2005;61:378–384.CrossRef
10.
Zurück zum Zitat Rex DK, Imperiale TF, Latinovich DR, Bratcher LL. Impact of bowel preparation on efficiency and cost of colonoscopy. Am J Gastroenterol. 2002;97:1696–1700.CrossRef Rex DK, Imperiale TF, Latinovich DR, Bratcher LL. Impact of bowel preparation on efficiency and cost of colonoscopy. Am J Gastroenterol. 2002;97:1696–1700.CrossRef
11.
Zurück zum Zitat ASGE Standards of Practice Committee. Saltzman JR, Cash BD, Pasha SF, Early DS, Muthusamy VR, et al. Bowel preparation before colonoscopy. Gastrointest Endosc. 2015;81:781–794. ASGE Standards of Practice Committee. Saltzman JR, Cash BD, Pasha SF, Early DS, Muthusamy VR, et al. Bowel preparation before colonoscopy. Gastrointest Endosc. 2015;81:781–794.
12.
Zurück zum Zitat Chung YW, Han DS, Park KH et al. Patient factors predictive of inadequate bowel preparation using polyethylene glycol: a prospective study in Korea. J Clin Gastroenterol. 2009;43:448–452.CrossRef Chung YW, Han DS, Park KH et al. Patient factors predictive of inadequate bowel preparation using polyethylene glycol: a prospective study in Korea. J Clin Gastroenterol. 2009;43:448–452.CrossRef
13.
Zurück zum Zitat Ness RM, Manam R, Hoen H, Chalasani N. Predictors of inadequate bowel preparation for colonoscopy. Am J Gastroenterol. 2001;96:1797–1802.CrossRef Ness RM, Manam R, Hoen H, Chalasani N. Predictors of inadequate bowel preparation for colonoscopy. Am J Gastroenterol. 2001;96:1797–1802.CrossRef
14.
Zurück zum Zitat Nguyen DL, Wieland M. Risk factors predictive of poor quality preparation during average risk colonoscopy screening: the importance of health literacy. J Gastrointestin Liver Dis. 2010;19:369–372.PubMed Nguyen DL, Wieland M. Risk factors predictive of poor quality preparation during average risk colonoscopy screening: the importance of health literacy. J Gastrointestin Liver Dis. 2010;19:369–372.PubMed
15.
Zurück zum Zitat Dik VK, Moons LMG, Hüyük M et al. Predicting inadequate bowel preparation for colonoscopy in participants receiving split-dose bowel preparation: development and validation of a prediction score. Gastrointest Endosc 2015;81:665–672.CrossRef Dik VK, Moons LMG, Hüyük M et al. Predicting inadequate bowel preparation for colonoscopy in participants receiving split-dose bowel preparation: development and validation of a prediction score. Gastrointest Endosc 2015;81:665–672.CrossRef
16.
Zurück zum Zitat Hassan C, Fuccio L, Bruno M et al. A predictive model identifies patients most likely to have inadequate bowel preparation for colonoscopy. Clin Gastroenterol Hepatol. 2012;10:501–506.CrossRef Hassan C, Fuccio L, Bruno M et al. A predictive model identifies patients most likely to have inadequate bowel preparation for colonoscopy. Clin Gastroenterol Hepatol. 2012;10:501–506.CrossRef
17.
Zurück zum Zitat Modi R, Wang HS, Sharma GN et al. 911 Development of an online calculator to predict sub-optimal bowel preparation among patients scheduled for colonoscopy. Gastrointest Endosc. 2012;75:AB170.CrossRef Modi R, Wang HS, Sharma GN et al. 911 Development of an online calculator to predict sub-optimal bowel preparation among patients scheduled for colonoscopy. Gastrointest Endosc. 2012;75:AB170.CrossRef
19.
Zurück zum Zitat Waljee AK, Mukherjee A, Singal AG et al. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open 2013;3:002847.CrossRef Waljee AK, Mukherjee A, Singal AG et al. Comparison of imputation methods for missing laboratory data in medicine. BMJ Open 2013;3:002847.CrossRef
20.
Zurück zum Zitat Gaduputi V, Chandrala C, Tariq H, Sakam S, Dev A, Chilimuri S. Influence of perception of colorectal cancer risk and patient bowel preparation behaviors: a study in minority populations. Clin Exp Gastroenterol. 2015;8:69–75.PubMedPubMedCentral Gaduputi V, Chandrala C, Tariq H, Sakam S, Dev A, Chilimuri S. Influence of perception of colorectal cancer risk and patient bowel preparation behaviors: a study in minority populations. Clin Exp Gastroenterol. 2015;8:69–75.PubMedPubMedCentral
21.
Zurück zum Zitat Cheng R-W, Chiu Y-C, Wu K-L et al. Predictive factors for inadequate colon preparation before colonoscopy. Tech Coloproctology. 2015;19:111–115.CrossRef Cheng R-W, Chiu Y-C, Wu K-L et al. Predictive factors for inadequate colon preparation before colonoscopy. Tech Coloproctology. 2015;19:111–115.CrossRef
22.
Zurück zum Zitat Quan H, Li B, Couris CM et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–682.CrossRef Quan H, Li B, Couris CM et al. Updating and validating the Charlson comorbidity index and score for risk adjustment in hospital discharge abstracts using data from 6 countries. Am J Epidemiol. 2011;173:676–682.CrossRef
23.
Zurück zum Zitat Waljee AK, Higgins PDR, Singal AG. A primer on predictive models. Clin Transl Gastroenterol 2014;5:e44.CrossRef Waljee AK, Higgins PDR, Singal AG. A primer on predictive models. Clin Transl Gastroenterol 2014;5:e44.CrossRef
24.
Zurück zum Zitat Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement.
25.
Zurück zum Zitat Singal AG, Mukherjee A, Joseph Elmunzer B et al. Machine learning algorithms outperform conventional regression models in predicting development of hepatocellular carcinoma. Am J Gastroenterol. 2013;108:1723–1730.CrossRef Singal AG, Mukherjee A, Joseph Elmunzer B et al. Machine learning algorithms outperform conventional regression models in predicting development of hepatocellular carcinoma. Am J Gastroenterol. 2013;108:1723–1730.CrossRef
26.
Zurück zum Zitat Gulshan V, Peng L, Coram M et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016;316:2402–2410.CrossRef Gulshan V, Peng L, Coram M et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 2016;316:2402–2410.CrossRef
27.
Zurück zum Zitat Frizzell JD, Liang L, Schulte PJ et al. Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches. JAMA Cardiol. 2017;2:204–209.CrossRef Frizzell JD, Liang L, Schulte PJ et al. Prediction of 30-day all-cause readmissions in patients hospitalized for heart failure: comparison of machine learning and other statistical approaches. JAMA Cardiol. 2017;2:204–209.CrossRef
28.
Zurück zum Zitat Beam AL, Kohane IS. Big data and machine learning in health care. JAMA. 2018;319:1317–1318.CrossRef Beam AL, Kohane IS. Big data and machine learning in health care. JAMA. 2018;319:1317–1318.CrossRef
29.
Zurück zum Zitat van der Ploeg T, Austin PC, Steyerberg EW. Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints. BMC Med Res Methodol. 2014;14:137.CrossRef van der Ploeg T, Austin PC, Steyerberg EW. Modern modelling techniques are data hungry: a simulation study for predicting dichotomous endpoints. BMC Med Res Methodol. 2014;14:137.CrossRef
30.
Zurück zum Zitat Parmar R, Martel M, Rostom A, Barkun AN. Validated scales for colon cleansing: a systematic review. Am J Gastroenterol. 2016;111:197–204.CrossRef Parmar R, Martel M, Rostom A, Barkun AN. Validated scales for colon cleansing: a systematic review. Am J Gastroenterol. 2016;111:197–204.CrossRef
Metadaten
Titel
Regression and Random Forest Machine Learning Have Limited Performance in Predicting Bowel Preparation in Veteran Population
verfasst von
Jacob E. Kurlander
Akbar K. Waljee
Stacy B. Menees
Rachel Lipson
Alex N. Kokaly
Andrew J. Read
Karmel S. Shehadeh
Amy Cohn
Sameer D. Saini
Publikationsdatum
24.06.2021
Verlag
Springer US
Erschienen in
Digestive Diseases and Sciences / Ausgabe 7/2022
Print ISSN: 0163-2116
Elektronische ISSN: 1573-2568
DOI
https://doi.org/10.1007/s10620-021-07113-z

Weitere Artikel der Ausgabe 7/2022

Digestive Diseases and Sciences 7/2022 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.