Skip to main content
Erschienen in: European Radiology 9/2022

22.03.2022 | Imaging Informatics and Artificial Intelligence

Reproducibility of radiomics features from ultrasound images: influence of image acquisition and processing

verfasst von: Ming-De Li, Mei-Qing Cheng, Li-Da Chen, Hang-Tong Hu, Jian-Chao Zhang, Si-Min Ruan, Hui Huang, Ming Kuang, Ming-De Lu, Wei Li, Wei Wang

Erschienen in: European Radiology | Ausgabe 9/2022

Einloggen, um Zugang zu erhalten

Abstract

Objectives

To systematically assess the reproducibility of radiomics features from ultrasound (US) images during image acquisition and processing.

Materials and methods

A standardized phantom was scanned to obtain US images. Reproducibility of radiomics features from US images, also known as ultrasomics features, was explored via (a) intra-US machine: changing the US acquisition parameters including gain, focus, and frequency; (b) inter-US machine: comparing three different scanners; (c) changing segmentation locations; and (d) inter-platform: comparing features extracted by the Ultrasomics and PyRadiomics algorithm platforms. Reproducible ultrasomics features were selected based on coefficients of variation.

Results

A total of 108 US images from three scanners were obtained; 5253 ultrasomics features including seven categories of features were extracted and evaluated for each US image. From intra-US machine analysis, 37.0–38.8% of features showed good reproducibility. From inter-US machine analysis, 42.8% (2248/5253) of features exhibited good reproducibility. From segmentation location analysis, 55.7–57.6% of features showed good reproducibility. No significant difference in the normalized feature ranges was found between the 100 features extracted by the Ultrasomics and PyRadiomics platforms with the same algorithm (p = 0.563). A total of 1452 (27.6%) ultrasomics features were reproducible whenever intra-/inter-US machine or segmentation location were changed, most of which were wavelet and shearlet features.

Conclusions

Different acquisition parameters, US scanners, segmentation locations, and feature extraction platforms affected the reproducibility of ultrasomics features. Wavelet and shearlet features showed the best reproducibility across all procedures.

Key Points

Different acquisition parameters, US scanners, segmentation locations, and feature extraction platforms affected the reproducibility of ultrasomics features.
A total of 1452 (27.6%) ultrasomics features were reproducible whenever intra-/inter-US machine or segmentation location were changed.
Wavelet and shearlet features showed the best reproducibility across all procedures.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Aerts HJ, Velazquez ER, Leijenaar RT et al (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006CrossRef Aerts HJ, Velazquez ER, Leijenaar RT et al (2014) Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun 5:4006CrossRef
2.
Zurück zum Zitat Li W, Huang Y, Zhuang BW et al (2019) Multiparametric ultrasomics of significant liver fibrosis: a machine learning-based analysis. Eur Radiol 29:1496–1506CrossRef Li W, Huang Y, Zhuang BW et al (2019) Multiparametric ultrasomics of significant liver fibrosis: a machine learning-based analysis. Eur Radiol 29:1496–1506CrossRef
3.
Zurück zum Zitat Tomaszewski MR, Gillies RJ (2021) The biological meaning of radiomic features. Radiology 298:505–516 Tomaszewski MR, Gillies RJ (2021) The biological meaning of radiomic features. Radiology 298:505–516
4.
Zurück zum Zitat Baessler B, Weiss K, Pinto Dos Santos D (2019) Robustness and reproducibility of radiomics in magnetic resonance imaging: a phantom study. Invest Radiol 54:221–228 Baessler B, Weiss K, Pinto Dos Santos D (2019) Robustness and reproducibility of radiomics in magnetic resonance imaging: a phantom study. Invest Radiol 54:221–228
5.
Zurück zum Zitat Park JE, Park SY, Kim HJ, Kim HS (2019) Reproducibility and generalizability in radiomics modeling: possible strategies in radiologic and statistical perspectives. Korean J Radiol 20:1124–1137CrossRef Park JE, Park SY, Kim HJ, Kim HS (2019) Reproducibility and generalizability in radiomics modeling: possible strategies in radiologic and statistical perspectives. Korean J Radiol 20:1124–1137CrossRef
6.
Zurück zum Zitat Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef Gillies RJ, Kinahan PE, Hricak H (2016) Radiomics: images are more than pictures, they are data. Radiology 278:563–577CrossRef
7.
Zurück zum Zitat Berenguer R, Pastor-Juan MDR, Canales-Vázquez J et al (2018) Radiomics of CT features may be nonreproducible and redundant: influence of CT acquisition parameters. Radiology 288:407–415CrossRef Berenguer R, Pastor-Juan MDR, Canales-Vázquez J et al (2018) Radiomics of CT features may be nonreproducible and redundant: influence of CT acquisition parameters. Radiology 288:407–415CrossRef
8.
Zurück zum Zitat Larue RT, Defraene G, De Ruysscher D, Lambin P, van Elmpt W (2017) Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures. Br J Radiol 90:20160665CrossRef Larue RT, Defraene G, De Ruysscher D, Lambin P, van Elmpt W (2017) Quantitative radiomics studies for tissue characterization: a review of technology and methodological procedures. Br J Radiol 90:20160665CrossRef
9.
Zurück zum Zitat Traverso A, Wee L, Dekker A, Gillies R (2018) Repeatability and reproducibility of radiomic features: a systematic review. Int J Radiat Oncol Biol Phys 102:1143–1158CrossRef Traverso A, Wee L, Dekker A, Gillies R (2018) Repeatability and reproducibility of radiomic features: a systematic review. Int J Radiat Oncol Biol Phys 102:1143–1158CrossRef
10.
Zurück zum Zitat Kim H, Park CM, Lee M et al (2016) Impact of reconstruction algorithms on CT radiomic features of pulmonary tumors: analysis of intra- and inter-reader variability and inter-reconstruction algorithm variability. PLoS One 11:e0164924CrossRef Kim H, Park CM, Lee M et al (2016) Impact of reconstruction algorithms on CT radiomic features of pulmonary tumors: analysis of intra- and inter-reader variability and inter-reconstruction algorithm variability. PLoS One 11:e0164924CrossRef
11.
Zurück zum Zitat Midya A, Chakraborty J, Gönen M, Do RKG, Simpson AL (2018) Influence of CT acquisition and reconstruction parameters on radiomic feature reproducibility. J Med Imaging (Bellingham) 5:011020 Midya A, Chakraborty J, Gönen M, Do RKG, Simpson AL (2018) Influence of CT acquisition and reconstruction parameters on radiomic feature reproducibility. J Med Imaging (Bellingham) 5:011020
12.
Zurück zum Zitat Parmar C, Rios Velazquez E, Leijenaar R et al (2014) Robust radiomics feature quantification using semiautomatic volumetric segmentation. PLoS One 9:e102107CrossRef Parmar C, Rios Velazquez E, Leijenaar R et al (2014) Robust radiomics feature quantification using semiautomatic volumetric segmentation. PLoS One 9:e102107CrossRef
13.
Zurück zum Zitat Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446CrossRef Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446CrossRef
14.
Zurück zum Zitat Fornacon-Wood I, Mistry H, Ackermann CJ et al (2020) Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform. Eur Radiol 30:6241–6250 Fornacon-Wood I, Mistry H, Ackermann CJ et al (2020) Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform. Eur Radiol 30:6241–6250
15.
Zurück zum Zitat Mackin D, Fave X, Zhang L et al (2015) Measuring CT scanner variability of radiomics features. Invest Radiol 50:757–765CrossRef Mackin D, Fave X, Zhang L et al (2015) Measuring CT scanner variability of radiomics features. Invest Radiol 50:757–765CrossRef
16.
Zurück zum Zitat Buch K, Kuno H, Qureshi MM, Li B, Sakai O (2018) Quantitative variations in texture analysis features dependent on MRI scanning parameters: a phantom model. J Appl Clin Med Phys 19:253–264CrossRef Buch K, Kuno H, Qureshi MM, Li B, Sakai O (2018) Quantitative variations in texture analysis features dependent on MRI scanning parameters: a phantom model. J Appl Clin Med Phys 19:253–264CrossRef
17.
Zurück zum Zitat Leijenaar RT, Carvalho S, Velazquez ER et al (2013) Stability of FDG-PET radiomics features: an integrated analysis of test-retest and inter-observer variability. Acta Oncol 52:1391–1397CrossRef Leijenaar RT, Carvalho S, Velazquez ER et al (2013) Stability of FDG-PET radiomics features: an integrated analysis of test-retest and inter-observer variability. Acta Oncol 52:1391–1397CrossRef
18.
Zurück zum Zitat Kishimoto R, Kikuchi K, Koyama A et al (2019) Intra- and inter-operator reproducibility of US point shear-wave elastography in various organs: evaluation in phantoms and healthy volunteers. Eur Radiol 29:5999–6008 Kishimoto R, Kikuchi K, Koyama A et al (2019) Intra- and inter-operator reproducibility of US point shear-wave elastography in various organs: evaluation in phantoms and healthy volunteers. Eur Radiol 29:5999–6008
19.
Zurück zum Zitat Choi JI, Jung SE, Kim PN et al (2014) Quality assurance in ultrasound screening for hepatocellular carcinoma using a standardized phantom and standard clinical images: a 3-year national investigation in Korea. J Ultrasound Med 33:985–995CrossRef Choi JI, Jung SE, Kim PN et al (2014) Quality assurance in ultrasound screening for hepatocellular carcinoma using a standardized phantom and standard clinical images: a 3-year national investigation in Korea. J Ultrasound Med 33:985–995CrossRef
20.
Zurück zum Zitat Qian X, Lin Y, Zhao Y, Yue X, Lu B, Wang J (2017) Objective ventricle segmentation in brain CT with ischemic stroke based on anatomical knowledge. Biomed Res Int 2017:8690892CrossRef Qian X, Lin Y, Zhao Y, Yue X, Lu B, Wang J (2017) Objective ventricle segmentation in brain CT with ischemic stroke based on anatomical knowledge. Biomed Res Int 2017:8690892CrossRef
21.
Zurück zum Zitat Wu L, Zhao Y, Lin P et al (2021) Preoperative ultrasound radiomics analysis for expression of multiple molecular biomarkers in mass type of breast ductal carcinoma in situ. BMC Med Imaging 21:84–84CrossRef Wu L, Zhao Y, Lin P et al (2021) Preoperative ultrasound radiomics analysis for expression of multiple molecular biomarkers in mass type of breast ductal carcinoma in situ. BMC Med Imaging 21:84–84CrossRef
22.
Zurück zum Zitat van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77:e104–e107CrossRef van Griethuysen JJM, Fedorov A, Parmar C et al (2017) Computational radiomics system to decode the radiographic phenotype. Cancer Res 77:e104–e107CrossRef
23.
Zurück zum Zitat Lecler A, Savatovsky J, Balvay D et al (2017) Repeatability of apparent diffusion coefficient and intravoxel incoherent motion parameters at 3.0 Tesla in orbital lesions. Eur Radiol 27:5094–5103CrossRef Lecler A, Savatovsky J, Balvay D et al (2017) Repeatability of apparent diffusion coefficient and intravoxel incoherent motion parameters at 3.0 Tesla in orbital lesions. Eur Radiol 27:5094–5103CrossRef
24.
Zurück zum Zitat Madelin G, Babb J, Xia D, Regatte RR (2015) Repeatability of quantitative sodium magnetic resonance imaging for estimating pseudo-intracellular sodium concentration and pseudo-extracellular volume fraction in brain at 3 T. PLoS One 10:e0118692–e0118692CrossRef Madelin G, Babb J, Xia D, Regatte RR (2015) Repeatability of quantitative sodium magnetic resonance imaging for estimating pseudo-intracellular sodium concentration and pseudo-extracellular volume fraction in brain at 3 T. PLoS One 10:e0118692–e0118692CrossRef
25.
Zurück zum Zitat Hectors SJ, Wagner M, Besa C et al (2016) Intravoxel incoherent motion diffusion-weighted imaging of hepatocellular carcinoma: is there a correlation with flow and perfusion metrics obtained with dynamic contrast-enhanced MRI? J Magn Reson Imaging 44:856–864CrossRef Hectors SJ, Wagner M, Besa C et al (2016) Intravoxel incoherent motion diffusion-weighted imaging of hepatocellular carcinoma: is there a correlation with flow and perfusion metrics obtained with dynamic contrast-enhanced MRI? J Magn Reson Imaging 44:856–864CrossRef
26.
Zurück zum Zitat Aronhime S, Calcagno C, Jajamovich GH et al (2014) DCE-MRI of the liver: effect of linear and nonlinear conversions on hepatic perfusion quantification and reproducibility. J Magn Reson Imaging 40:90–98CrossRef Aronhime S, Calcagno C, Jajamovich GH et al (2014) DCE-MRI of the liver: effect of linear and nonlinear conversions on hepatic perfusion quantification and reproducibility. J Magn Reson Imaging 40:90–98CrossRef
27.
Zurück zum Zitat Putra JA (2018) Mammogram classification scheme using 2D-discrete wavelet and local binary pattern for detection of breast cancer. 1ST International Conference of Combinatorics, Graph Theory, and Network Topology Putra JA (2018) Mammogram classification scheme using 2D-discrete wavelet and local binary pattern for detection of breast cancer. 1ST International Conference of Combinatorics, Graph Theory, and Network Topology
28.
Zurück zum Zitat Shenbagavalli P, Thangarajan R (2018) Aiding the digital mammogram for detecting the breast cancer using shearlet transform and neural network. Asian Pac J Cancer Prev 19:2665–2671 Shenbagavalli P, Thangarajan R (2018) Aiding the digital mammogram for detecting the breast cancer using shearlet transform and neural network. Asian Pac J Cancer Prev 19:2665–2671
29.
Zurück zum Zitat Choe J, Lee SM, Do KH et al (2019) Deep learning-based image conversion of CT reconstruction kernels improves radiomics reproducibility for pulmonary nodules or masses. Radiology 292:365–373 Choe J, Lee SM, Do KH et al (2019) Deep learning-based image conversion of CT reconstruction kernels improves radiomics reproducibility for pulmonary nodules or masses. Radiology 292:365–373
30.
Zurück zum Zitat Lu L, Ehmke RC, Schwartz LH, Zhao B (2016) Assessing agreement between radiomic features computed for multiple CT imaging settings. PLoS One 11:e0166550CrossRef Lu L, Ehmke RC, Schwartz LH, Zhao B (2016) Assessing agreement between radiomic features computed for multiple CT imaging settings. PLoS One 11:e0166550CrossRef
31.
Zurück zum Zitat Yip SS, Aerts HJ (2016) Applications and limitations of radiomics. Phys Med Biol 61:R150–R166CrossRef Yip SS, Aerts HJ (2016) Applications and limitations of radiomics. Phys Med Biol 61:R150–R166CrossRef
32.
Zurück zum Zitat Hatt M, Tixier F, Pierce L, Kinahan PE, Le Rest CC, Visvikis D (2017) Characterization of PET/CT images using texture analysis: the past, the present… any future? Eur J Nucl Med Mol Imaging 44:151–165CrossRef Hatt M, Tixier F, Pierce L, Kinahan PE, Le Rest CC, Visvikis D (2017) Characterization of PET/CT images using texture analysis: the past, the present… any future? Eur J Nucl Med Mol Imaging 44:151–165CrossRef
33.
Zurück zum Zitat Huang Y, Liu GJ, Liao B et al (2015) Impact factors and the optimal parameter of acoustic structure quantification in the assessment of liver fibrosis. Ultrasound Med Biol 41:2360–2367CrossRef Huang Y, Liu GJ, Liao B et al (2015) Impact factors and the optimal parameter of acoustic structure quantification in the assessment of liver fibrosis. Ultrasound Med Biol 41:2360–2367CrossRef
34.
Zurück zum Zitat Hunter LA, Krafft S, Stingo F et al (2013) High quality machine-robust image features: identification in nonsmall cell lung cancer computed tomography images. Med Phys 40:121916CrossRef Hunter LA, Krafft S, Stingo F et al (2013) High quality machine-robust image features: identification in nonsmall cell lung cancer computed tomography images. Med Phys 40:121916CrossRef
35.
Zurück zum Zitat Razeghi O, Sim I, Roney CH et al (2020) Fully automatic atrial fibrosis assessment using a multilabel convolutional neural network. Circ Cardiovasc Imaging 13:e011512CrossRef Razeghi O, Sim I, Roney CH et al (2020) Fully automatic atrial fibrosis assessment using a multilabel convolutional neural network. Circ Cardiovasc Imaging 13:e011512CrossRef
Metadaten
Titel
Reproducibility of radiomics features from ultrasound images: influence of image acquisition and processing
verfasst von
Ming-De Li
Mei-Qing Cheng
Li-Da Chen
Hang-Tong Hu
Jian-Chao Zhang
Si-Min Ruan
Hui Huang
Ming Kuang
Ming-De Lu
Wei Li
Wei Wang
Publikationsdatum
22.03.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
European Radiology / Ausgabe 9/2022
Print ISSN: 0938-7994
Elektronische ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-022-08662-1

Weitere Artikel der Ausgabe 9/2022

European Radiology 9/2022 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.