Skip to main content
Erschienen in: European Radiology 5/2021

31.10.2020 | Magnetic Resonance

Diffusion and perfusion MRI radiomics obtained from deep learning segmentation provides reproducible and comparable diagnostic model to human in post-treatment glioblastoma

verfasst von: Ji Eun Park, Sungwon Ham, Ho Sung Kim, Seo Young Park, Jihye Yun, Hyunna Lee, Seung Hong Choi, Namkug Kim

Erschienen in: European Radiology | Ausgabe 5/2021

Einloggen, um Zugang zu erhalten

Abstract

Objectives

Deep learning-based automatic segmentation (DLAS) helps the reproducibility of radiomics features, but its effect on radiomics modeling is unknown. We therefore evaluated whether DLAS can robustly extract anatomical and physiological MRI features, thereby assisting in the accurate assessment of treatment response in glioblastoma patients.

Methods

A DLAS model was trained on 238 glioblastomas and validated on an independent set of 98 pre- and 86 post-treatment glioblastomas from two tertiary hospitals. A total of 1618 radiomics features from contrast-enhanced T1-weighted images (CE-T1w) and histogram features from apparent diffusion coefficient (ADC) and cerebral blood volume (CBV) mapping were extracted. The diagnostic performance of radiomics features and ADC and CBV parameters for identifying treatment response was tested using area under the curve (AUC) from receiver operating characteristics analysis. Feature reproducibility was tested using a 0.80 cutoff for concordance correlation coefficients.

Results

Reproducibility was excellent for ADC and CBV features (ICC, 0.82–0.99) and first-order features (pre- and post-treatment, 100% and 94.1% remained), but lower for texture (79.0% and 69.1% remained) and wavelet-transformed (81.8% and 74.9% remained) features of CE-T1w. DLAS-based radiomics showed similar performance to human-performed segmentations in internal validation (AUC, 0.81 [95% CI, 0.64–0.99] vs. AUC, 0.81 [0.60–1.00], p = 0.80), but slightly lower performance in external validation (AUC, 0.78 [0.61–0.95] vs. AUC, 0.65 [0.46–0.84], p = 0.23).

Conclusion

DLAS-based feature extraction showed high reproducibility for first-order features from anatomical and physiological MRI, and comparable diagnostic performance to human manual segmentations in the identification of pseudoprogression, supporting the utility of DLAS in quantitative MRI analysis.

Key Points

Deep learning-based automatic segmentation (DLAS) enables fast and robust feature extraction from diffusion- and perfusion-weighted MRI.
DLAS showed high reproducibility in first-order feature extraction from anatomical, diffusion, and perfusion MRI across two centers.
DLAS-based radiomics features showed comparable diagnostic accuracy to manual segmentations in post-treatment glioblastoma.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Wen PY, Chang SM, Van den Bent MJ, Vogelbaum MA, Macdonald DR, Lee EQ (2017) Response assessment in neuro-oncology clinical trials. J Clin Oncol 35:2439–2449CrossRef Wen PY, Chang SM, Van den Bent MJ, Vogelbaum MA, Macdonald DR, Lee EQ (2017) Response assessment in neuro-oncology clinical trials. J Clin Oncol 35:2439–2449CrossRef
2.
Zurück zum Zitat Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. Lancet Oncol 20:728–740CrossRef Kickingereder P, Isensee F, Tursunova I et al (2019) Automated quantitative tumour response assessment of MRI in neuro-oncology with artificial neural networks: a multicentre, retrospective study. Lancet Oncol 20:728–740CrossRef
3.
Zurück zum Zitat Parmar C, Velazquez ER, Leijenaar R et al (2014) Robust radiomics feature quantification using semiautomatic volumetric segmentation. Plos One 9 Parmar C, Velazquez ER, Leijenaar R et al (2014) Robust radiomics feature quantification using semiautomatic volumetric segmentation. Plos One 9
4.
Zurück zum Zitat Pavic M, Bogowicz M, Wurms X et al (2018) Influence of inter-observer delineation variability on radiomics stability in different tumor sites. Acta Oncol 57:1070–1074CrossRef Pavic M, Bogowicz M, Wurms X et al (2018) Influence of inter-observer delineation variability on radiomics stability in different tumor sites. Acta Oncol 57:1070–1074CrossRef
5.
Zurück zum Zitat Kumar V, Gu YH, Basu S et al (2012) Radiomics: the process and the challenges. Magn Reson Imaging 30:1234–1248CrossRef Kumar V, Gu YH, Basu S et al (2012) Radiomics: the process and the challenges. Magn Reson Imaging 30:1234–1248CrossRef
6.
Zurück zum Zitat Lambin P, Leijenaar RTH, Deist TM et al (2017) Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 14:749–762CrossRef Lambin P, Leijenaar RTH, Deist TM et al (2017) Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol 14:749–762CrossRef
7.
Zurück zum Zitat Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446CrossRef Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446CrossRef
8.
Zurück zum Zitat Park JE, Kim HS (2018) Radiomics as a quantitative imaging biomarker: practical considerations and the current standpoint in neuro-oncologic studies. Nucl Med Mol Imaging 52:99–108CrossRef Park JE, Kim HS (2018) Radiomics as a quantitative imaging biomarker: practical considerations and the current standpoint in neuro-oncologic studies. Nucl Med Mol Imaging 52:99–108CrossRef
9.
Zurück zum Zitat Menze BH, Jakab A, Bauer S et al (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34:1993–2024CrossRef Menze BH, Jakab A, Bauer S et al (2015) The multimodal brain tumor image segmentation benchmark (BRATS). IEEE Trans Med Imaging 34:1993–2024CrossRef
10.
Zurück zum Zitat Ellingson BM, Cloughesy TF, Zaw T et al (2012) Functional diffusion maps (fDMs) evaluated before and after radiochemotherapy predict progression-free and overall survival in newly diagnosed glioblastoma. Neuro Oncol 14:333–343CrossRef Ellingson BM, Cloughesy TF, Zaw T et al (2012) Functional diffusion maps (fDMs) evaluated before and after radiochemotherapy predict progression-free and overall survival in newly diagnosed glioblastoma. Neuro Oncol 14:333–343CrossRef
11.
Zurück zum Zitat Law M, Young RJ, Babb JS et al (2008) Gliomas: predicting time to progression or survival with cerebral blood volume measurements at dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging. Radiology 247:490–498CrossRef Law M, Young RJ, Babb JS et al (2008) Gliomas: predicting time to progression or survival with cerebral blood volume measurements at dynamic susceptibility-weighted contrast-enhanced perfusion MR imaging. Radiology 247:490–498CrossRef
12.
Zurück zum Zitat Kickingereder P, Burth S, Wick A et al (2016) Radiomic profiling of glioblastoma: identifying an imaging predictor of patient survival with improved performance over established clinical and radiologic risk models. Radiology 280:880–889CrossRef Kickingereder P, Burth S, Wick A et al (2016) Radiomic profiling of glioblastoma: identifying an imaging predictor of patient survival with improved performance over established clinical and radiologic risk models. Radiology 280:880–889CrossRef
13.
Zurück zum Zitat Bae S, Choi YS, Ahn SS et al (2018) Radiomic MRI phenotyping of glioblastoma: improving survival prediction. Radiology 289:797–806CrossRef Bae S, Choi YS, Ahn SS et al (2018) Radiomic MRI phenotyping of glioblastoma: improving survival prediction. Radiology 289:797–806CrossRef
15.
Zurück zum Zitat Kickingereder P, Gotz M, Muschelli J et al (2016) Large-scale radiomic profiling of recurrent glioblastoma identifies an imaging predictor for stratifying anti-angiogenic treatment response. Clin Cancer Res 22:5765–5771CrossRef Kickingereder P, Gotz M, Muschelli J et al (2016) Large-scale radiomic profiling of recurrent glioblastoma identifies an imaging predictor for stratifying anti-angiogenic treatment response. Clin Cancer Res 22:5765–5771CrossRef
16.
Zurück zum Zitat Louis DN, Perry A, Reifenberger G et al (2016) The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol 131:803–820CrossRef Louis DN, Perry A, Reifenberger G et al (2016) The 2016 World Health Organization classification of tumors of the central nervous system: a summary. Acta Neuropathol 131:803–820CrossRef
17.
Zurück zum Zitat Nolden M, Zelzer S, Seitel A et al (2013) The medical imaging interaction toolkit: challenges and advances : 10 years of open-source development. Int J Comput Assist Radiol Surg 8:607–620CrossRef Nolden M, Zelzer S, Seitel A et al (2013) The medical imaging interaction toolkit: challenges and advances : 10 years of open-source development. Int J Comput Assist Radiol Surg 8:607–620CrossRef
18.
Zurück zum Zitat Avants BB, Tustison NJ, Song G, Cook PA, Klein A, Gee JC (2011) A reproducible evaluation of ANTs similarity metric performance in brain image registration. Neuroimage 54:2033–2044CrossRef Avants BB, Tustison NJ, Song G, Cook PA, Klein A, Gee JC (2011) A reproducible evaluation of ANTs similarity metric performance in brain image registration. Neuroimage 54:2033–2044CrossRef
19.
Zurück zum Zitat Shinohara RT, Sweeney EM, Goldsmith J et al (2014) Statistical normalization techniques for magnetic resonance imaging. Neuroimage Clin 6:9–19 Shinohara RT, Sweeney EM, Goldsmith J et al (2014) Statistical normalization techniques for magnetic resonance imaging. Neuroimage Clin 6:9–19
20.
21.
Zurück zum Zitat Zwanenburg A, Leger S, Vallières M, Löck S (2016) Image biomarker standardisation initiative. arXiv preprint arXiv:1612.07003 Zwanenburg A, Leger S, Vallières M, Löck S (2016) Image biomarker standardisation initiative. arXiv preprint arXiv:1612.07003
22.
Zurück zum Zitat Weisskoff RM, Boxerman JL, Sorensen AG et al (1994) Simultaneous blood volume and permeability mapping using a single Gd-based contrast injection. In: Proceedings of the Society of Magnetic Resonance, Second Annual Meeting; 1994 Aug 6–12; San Francisco, Calif.; Berkeley, Calif: Society of Magnetic Resonance, 279 Weisskoff RM, Boxerman JL, Sorensen AG et al (1994) Simultaneous blood volume and permeability mapping using a single Gd-based contrast injection. In: Proceedings of the Society of Magnetic Resonance, Second Annual Meeting; 1994 Aug 6–12; San Francisco, Calif.; Berkeley, Calif: Society of Magnetic Resonance, 279
23.
Zurück zum Zitat Chung WJ, Kim HS, Kim N, Choi CG, Kim SJ (2013) Recurrent glioblastoma: optimum area under the curve method derived from dynamic contrast-enhanced T1-weighted perfusion MR imaging. Radiology 269:561–568CrossRef Chung WJ, Kim HS, Kim N, Choi CG, Kim SJ (2013) Recurrent glioblastoma: optimum area under the curve method derived from dynamic contrast-enhanced T1-weighted perfusion MR imaging. Radiology 269:561–568CrossRef
24.
Zurück zum Zitat Kim HS, Suh CH, Kim N, Choi CG, Kim SJ (2014) Histogram analysis of intravoxel incoherent motion for differentiating recurrent tumor from treatment effect in patients with glioblastoma: initial clinical experience. AJNR Am J Neuroradiol 35:490–497CrossRef Kim HS, Suh CH, Kim N, Choi CG, Kim SJ (2014) Histogram analysis of intravoxel incoherent motion for differentiating recurrent tumor from treatment effect in patients with glioblastoma: initial clinical experience. AJNR Am J Neuroradiol 35:490–497CrossRef
25.
Zurück zum Zitat Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302CrossRef Dice LR (1945) Measures of the amount of ecologic association between species. Ecology 26:297–302CrossRef
26.
Zurück zum Zitat Kursa MB (2014) Robustness of Random Forest-based gene selection methods. BMC Bioinformatics 15(1):8 Kursa MB (2014) Robustness of Random Forest-based gene selection methods. BMC Bioinformatics 15(1):8
27.
Zurück zum Zitat Loh WY (2011) Classification and regression trees. Wiley Interdisciplinary Reviews: Data Min Knowl Discov 1(1):14-23 Loh WY (2011) Classification and regression trees. Wiley Interdisciplinary Reviews: Data Min Knowl Discov 1(1):14-23
28.
Zurück zum Zitat Lin L, Dou Q, Jin YM et al (2019) Deep learning for automated contouring of primary tumor volumes by MRI for nasopharyngeal carcinoma. Radiology 291:677–686CrossRef Lin L, Dou Q, Jin YM et al (2019) Deep learning for automated contouring of primary tumor volumes by MRI for nasopharyngeal carcinoma. Radiology 291:677–686CrossRef
29.
Zurück zum Zitat Norman B, Pedoia V, Majumdar S (2018) Use of 2D U-Net convolutional neural networks for automated cartilage and meniscus segmentation of knee MR imaging data to determine relaxometry and morphometry. Radiology 288:177–185CrossRef Norman B, Pedoia V, Majumdar S (2018) Use of 2D U-Net convolutional neural networks for automated cartilage and meniscus segmentation of knee MR imaging data to determine relaxometry and morphometry. Radiology 288:177–185CrossRef
30.
Zurück zum Zitat Barboriak DP, Zhang Z, Desai P et al (2019) Interreader variability of dynamic contrast-enhanced MRI of recurrent glioblastoma: the multicenter ACRIN 6677/RTOG 0625 study. Radiology 290:467–476CrossRef Barboriak DP, Zhang Z, Desai P et al (2019) Interreader variability of dynamic contrast-enhanced MRI of recurrent glioblastoma: the multicenter ACRIN 6677/RTOG 0625 study. Radiology 290:467–476CrossRef
31.
Zurück zum Zitat Newitt DC, Zhang Z, Gibbs JE et al (2019) Test-retest repeatability and reproducibility of ADC measures by breast DWI: results from the ACRIN 6698 trial. J Magn Reson Imaging 49:1617–1628CrossRef Newitt DC, Zhang Z, Gibbs JE et al (2019) Test-retest repeatability and reproducibility of ADC measures by breast DWI: results from the ACRIN 6698 trial. J Magn Reson Imaging 49:1617–1628CrossRef
32.
Zurück zum Zitat Ellingson BM, Bendszus M, Boxerman J et al (2015) Consensus recommendations for a standardized brain tumor imaging protocol in clinical trials. Neuro Oncol 17:1188–1198CrossRef Ellingson BM, Bendszus M, Boxerman J et al (2015) Consensus recommendations for a standardized brain tumor imaging protocol in clinical trials. Neuro Oncol 17:1188–1198CrossRef
33.
Zurück zum Zitat Baessler B, Weiss K, Pinto Dos Santos D (2019) Robustness and reproducibility of radiomics in magnetic resonance imaging: a phantom study. Invest Radiol 54:221–228CrossRef Baessler B, Weiss K, Pinto Dos Santos D (2019) Robustness and reproducibility of radiomics in magnetic resonance imaging: a phantom study. Invest Radiol 54:221–228CrossRef
34.
Zurück zum Zitat Milletari F, Navab N, Ahmadi S-A (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV) (pp. 565-571). IEEE Milletari F, Navab N, Ahmadi S-A (2016) V-net: fully convolutional neural networks for volumetric medical image segmentation. In 2016 fourth international conference on 3D vision (3DV) (pp. 565-571). IEEE
35.
Zurück zum Zitat Estienne T, Lerousseau M, Vakalopoulou M et al (2020) Deep learning-based concurrent brain registration and tumor segmentation. Front Comput Neurosci 14:17CrossRef Estienne T, Lerousseau M, Vakalopoulou M et al (2020) Deep learning-based concurrent brain registration and tumor segmentation. Front Comput Neurosci 14:17CrossRef
36.
Zurück zum Zitat Zwanenburg A, Vallieres M, Abdalah MA et al (2020) The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 295:328–338CrossRef Zwanenburg A, Vallieres M, Abdalah MA et al (2020) The image biomarker standardization initiative: standardized quantitative radiomics for high-throughput image-based phenotyping. Radiology 295:328–338CrossRef
37.
Zurück zum Zitat Zhao B, Tan Y, Tsai WY et al (2016) Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep 6:23428CrossRef Zhao B, Tan Y, Tsai WY et al (2016) Reproducibility of radiomics for deciphering tumor phenotype with imaging. Sci Rep 6:23428CrossRef
Metadaten
Titel
Diffusion and perfusion MRI radiomics obtained from deep learning segmentation provides reproducible and comparable diagnostic model to human in post-treatment glioblastoma
verfasst von
Ji Eun Park
Sungwon Ham
Ho Sung Kim
Seo Young Park
Jihye Yun
Hyunna Lee
Seung Hong Choi
Namkug Kim
Publikationsdatum
31.10.2020
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 5/2021
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-020-07414-3

Weitere Artikel der Ausgabe 5/2021

European Radiology 5/2021 Zur Ausgabe

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Klinik aktuell Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.