Skip to main content
Erschienen in: Journal of Digital Imaging 2/2020

26.08.2019

Improving Image Resolution of Whole-Heart Coronary MRA Using Convolutional Neural Network

verfasst von: Hiroki Kobayashi, Ryohei Nakayama, Akiyoshi Hizukuri, Masaki Ishida, Kakuya Kitagawa, Hajime Sakuma

Erschienen in: Journal of Imaging Informatics in Medicine | Ausgabe 2/2020

Einloggen, um Zugang zu erhalten

Abstract

Whole-heart coronary magnetic resonance angiography (WHCMRA) permits the noninvasive assessment of coronary artery disease without radiation exposure. However, the image resolution of WHCMRA is limited. Recently, convolutional neural networks (CNNs) have obtained increased interest as a method for improving the resolution of medical images. The purpose of this study is to improve the resolution of WHCMRA images using a CNN. Free-breathing WHCMRA images with 512 × 512 pixels (pixel size = 0.65 mm) were acquired in 80 patients with known or suspected coronary artery disease using a 1.5 T magnetic resonance (MR) system with 32 channel coils. A CNN model was optimized by evaluating CNNs with different structures. The proposed CNN model was trained based on the relationship of signal patterns between low-resolution patches (small regions) and the corresponding high-resolution patches using a training dataset collected from 40 patients. Images with 512 × 512 pixels were restored from 256 × 256 down-sampled WHCMRA images (pixel size = 1.3 mm) with three different approaches: the proposed CNN, bicubic interpolation (BCI), and the previously reported super-resolution CNN (SRCNN). High-resolution WHCMRA images obtained using the proposed CNN model were significantly better than those of BCI and SRCNN in terms of root mean squared error, peak signal to noise ratio, and structure similarity index measure with respect to the original WHCMRA images. The proposed CNN approach can provide high-resolution WHCMRA images with better accuracy than BCI and SRCNN. The high-resolution WHCMRA obtained using the proposed CNN model will be useful for identifying coronary artery disease.
Literatur
2.
Zurück zum Zitat Wu W, Liu Z, He X: Learning-based super resolution using kernel partial least squares. Image and Vision Computing 29(6):394–406, 2011CrossRef Wu W, Liu Z, He X: Learning-based super resolution using kernel partial least squares. Image and Vision Computing 29(6):394–406, 2011CrossRef
3.
Zurück zum Zitat Xian Y, Yang X, Tian Y: Hybrid example-based single image super-resolution. In: International Symposium on Visual Computing, Vol. 9475, 2015, pp. 3–15 Xian Y, Yang X, Tian Y: Hybrid example-based single image super-resolution. In: International Symposium on Visual Computing, Vol. 9475, 2015, pp. 3–15
4.
Zurück zum Zitat Yang CY, Yang MH: Fast direct super-resolution by simple functions. In Proceedings of the IEEE International Conference on Computer Vision:561–568, 2013 Yang CY, Yang MH: Fast direct super-resolution by simple functions. In Proceedings of the IEEE International Conference on Computer Vision:561–568, 2013
5.
Zurück zum Zitat Hizukuri A, Nakayama R: Computer-aided diagnosis scheme for determining histological classification of breast lesions on ultrasonographic images using convolutional neural network. Diagnostics 8(3):1–9, 2018CrossRef Hizukuri A, Nakayama R: Computer-aided diagnosis scheme for determining histological classification of breast lesions on ultrasonographic images using convolutional neural network. Diagnostics 8(3):1–9, 2018CrossRef
6.
Zurück zum Zitat Kumar K, Rao ACS: Breast cancer classification of image using convolutional neural network. In 2018 4th International Conference on Recent Advances in Information Technology (RAIT):1–6, 2018 Kumar K, Rao ACS: Breast cancer classification of image using convolutional neural network. In 2018 4th International Conference on Recent Advances in Information Technology (RAIT):1–6, 2018
7.
Zurück zum Zitat Dmitriev K, Kaufman AE, Javed AA, Hruban RH, Fishman EK, Lennon AM, Saltz JH: Classification of pancreatic cysts in computed tomography images using a random forest and convolutional neural network ensemble. In: International Conference on Medical mage Computing and Computer-Assisted Intervention 10435, 2017, pp. 150–158 Dmitriev K, Kaufman AE, Javed AA, Hruban RH, Fishman EK, Lennon AM, Saltz JH: Classification of pancreatic cysts in computed tomography images using a random forest and convolutional neural network ensemble. In: International Conference on Medical mage Computing and Computer-Assisted Intervention 10435, 2017, pp. 150–158
8.
Zurück zum Zitat Halicek M, Lu G, Little JV, Wang X, Patel M, Griffith CC, El-Deiry MW, Chen AY, Fei B: Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. Journal of Biomedical Optics 22(6):060503–0601–4, 2017CrossRef Halicek M, Lu G, Little JV, Wang X, Patel M, Griffith CC, El-Deiry MW, Chen AY, Fei B: Deep convolutional neural networks for classifying head and neck cancer using hyperspectral imaging. Journal of Biomedical Optics 22(6):060503–0601–4, 2017CrossRef
9.
Zurück zum Zitat Dou Q, Chen H, Yu L, Zhao L, Qin J, Wang D, Mok VCT, Shi L, Heng PA: Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks. IEEE Transactions on Medical Imaging 35(5):1182–1195, 2016CrossRef Dou Q, Chen H, Yu L, Zhao L, Qin J, Wang D, Mok VCT, Shi L, Heng PA: Automatic detection of cerebral microbleeds from MR images via 3D convolutional neural networks. IEEE Transactions on Medical Imaging 35(5):1182–1195, 2016CrossRef
10.
Zurück zum Zitat Pereira S, Pinto A, Alves V, Silva CA: Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Transactions on Medical Imaging 35(5):1240–1251, 2016CrossRef Pereira S, Pinto A, Alves V, Silva CA: Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Transactions on Medical Imaging 35(5):1240–1251, 2016CrossRef
11.
Zurück zum Zitat Park J, Hwang D, Kim KY, Kang SK, Kim YK, Lee JS: Computed tomography super-resolution using deep convolutional neural network. Physics in Medicine and Biology 63(14):145011, 2018CrossRef Park J, Hwang D, Kim KY, Kang SK, Kim YK, Lee JS: Computed tomography super-resolution using deep convolutional neural network. Physics in Medicine and Biology 63(14):145011, 2018CrossRef
12.
Zurück zum Zitat Dong C, Loy CC, He K, Tang X: Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38(2):295–307, 2016CrossRef Dong C, Loy CC, He K, Tang X: Image super-resolution using deep convolutional networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 38(2):295–307, 2016CrossRef
13.
Zurück zum Zitat Dong C, Loy CC, He K, Tang X: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, 2014, pp. 184–199 Dong C, Loy CC, He K, Tang X: Learning a deep convolutional network for image super-resolution. In: European Conference on Computer Vision, 2014, pp. 184–199
14.
Zurück zum Zitat Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Shirai N, Ishida T: Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs. In Medical Imaging 2017: Image Processing. International Society for Optics and Photonics 10133:101331P1–101331P7, 2017 Umehara K, Ota J, Ishimaru N, Ohno S, Okamoto K, Suzuki T, Shirai N, Ishida T: Super-resolution convolutional neural network for the improvement of the image quality of magnified images in chest radiographs. In Medical Imaging 2017: Image Processing. International Society for Optics and Photonics 10133:101331P1–101331P7, 2017
15.
Zurück zum Zitat Magnotta VA, Friedman L: BIRN F: Measurement of signal-to-noise and contrast-to-noise in the fBIRN multicenter imaging study. Journal of Digital Imaging 19(2):140–147, 2006CrossRef Magnotta VA, Friedman L: BIRN F: Measurement of signal-to-noise and contrast-to-noise in the fBIRN multicenter imaging study. Journal of Digital Imaging 19(2):140–147, 2006CrossRef
16.
Zurück zum Zitat Dincer HA, Gokcay D: Evaluation of MRIS of the brain with respect to SNR, CNR and GWR in young versus old subjects. In Signal Processing and Communications Applications Conference (SIU):1079–1082, 2014 Dincer HA, Gokcay D: Evaluation of MRIS of the brain with respect to SNR, CNR and GWR in young versus old subjects. In Signal Processing and Communications Applications Conference (SIU):1079–1082, 2014
17.
Zurück zum Zitat Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4):600–612, 2004CrossRef Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing 13(4):600–612, 2004CrossRef
Metadaten
Titel
Improving Image Resolution of Whole-Heart Coronary MRA Using Convolutional Neural Network
verfasst von
Hiroki Kobayashi
Ryohei Nakayama
Akiyoshi Hizukuri
Masaki Ishida
Kakuya Kitagawa
Hajime Sakuma
Publikationsdatum
26.08.2019
Verlag
Springer International Publishing
Erschienen in
Journal of Imaging Informatics in Medicine / Ausgabe 2/2020
Print ISSN: 2948-2925
Elektronische ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-019-00264-6

Weitere Artikel der Ausgabe 2/2020

Journal of Digital Imaging 2/2020 Zur Ausgabe

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.