Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 3/2020

22.01.2020 | Original Article

Deep multi-scale feature fusion for pancreas segmentation from CT images

verfasst von: Zhanlan Chen, Xiuying Wang, Ke Yan, Jiangbin Zheng

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 3/2020

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Pancreas segmentation from computed tomography (CT) images is an important step in surgical procedures such as cancer detection and radiation treatment. While manual segmentation is time-consuming and operator-dependent, current computer-assisted segmentation methods are facing challenges posed by varying shapes and sizes. To address these challenges, this paper presents a multi-scale feature fusion (MsFF) model for accurate pancreas segmentation from CT images.

Methods

The proposed MsFF is built upon the well-recognized encoder–decoder framework. Firstly, in the encoder stage, the squeeze-and-excitation module is incorporated to enhance the learning of features by exploiting channel-wise independence. Secondly, a hierarchical fusion module is introduced to better utilize both low-level and high-level features to retain boundary information and make final predictions.

Results

The proposed MsFF is evaluated on the NIH pancreas dataset and outperforms the current state-of-the-art methods, by achieving a mean of 87.26% and 22.67% under the Dice Sorensen Coefficient and Volumetric Overlap Error, respectively.

Conclusion

The experimental results confirm that the incorporation of squeeze-and-excitation and hierarchical fusion modules contributes to a net gain in the performance of our proposed MsFF.
Literatur
1.
3.
Zurück zum Zitat Chu C, Oda M, Kitasaka T, Misawa K, Fujiwara M, Hayashi Y, Nimura Y, Rueckert D, Mori K (2013) Multi-organ segmentation based on spatially-divided probabilistic atlas from 3D abdominal CT images. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 165–172CrossRef Chu C, Oda M, Kitasaka T, Misawa K, Fujiwara M, Hayashi Y, Nimura Y, Rueckert D, Mori K (2013) Multi-organ segmentation based on spatially-divided probabilistic atlas from 3D abdominal CT images. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 165–172CrossRef
5.
Zurück zum Zitat Suzuki Y, Okada T, Hori M, Yokota F, Linguraru MG, Tomiyama N, Sato Y (2012) Automated segmentation and anatomical labeling of abdominal arteries based on multi-organ segmentation from contrast-enhanced CT data. In: Workshop on clinical image-based procedures. Springer, Berlin, pp 67–74CrossRef Suzuki Y, Okada T, Hori M, Yokota F, Linguraru MG, Tomiyama N, Sato Y (2012) Automated segmentation and anatomical labeling of abdominal arteries based on multi-organ segmentation from contrast-enhanced CT data. In: Workshop on clinical image-based procedures. Springer, Berlin, pp 67–74CrossRef
6.
Zurück zum Zitat Zhu Z, Xia Y, Shen W, Fishman E, Yuille A (2018) A 3d coarse-to-fine framework for volumetric medical image segmentation. In: 2018 International conference on 3D vision (3DV). IEEE, pp 682–690 Zhu Z, Xia Y, Shen W, Fishman E, Yuille A (2018) A 3d coarse-to-fine framework for volumetric medical image segmentation. In: 2018 International conference on 3D vision (3DV). IEEE, pp 682–690
7.
Zurück zum Zitat LeCun Y, Kavukcuoglu K, Farabet C (2010) Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE international symposium on circuits and systems. IEEE, pp 253–256 LeCun Y, Kavukcuoglu K, Farabet C (2010) Convolutional networks and applications in vision. In: Proceedings of 2010 IEEE international symposium on circuits and systems. IEEE, pp 253–256
8.
Zurück zum Zitat Yu F, Wang D, Shelhamer E, Darrell T (2018) Deep layer aggregation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2403–2412 Yu F, Wang D, Shelhamer E, Darrell T (2018) Deep layer aggregation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2403–2412
9.
Zurück zum Zitat Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) Deeplab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848CrossRef
10.
Zurück zum Zitat Roth HR, Lu L, Farag A, Shin H-C, Liu J, Turkbey EB, Summers RM (2015) Deeporgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 556–564 Roth HR, Lu L, Farag A, Shin H-C, Liu J, Turkbey EB, Summers RM (2015) Deeporgan: multi-level deep convolutional networks for automated pancreas segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 556–564
11.
Zurück zum Zitat Zhou Y, Xie L, Shen W, Wang Y, Fishman EK, Yuille AL (2017) A fixed-point model for pancreas segmentation in abdominal CT scans. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 693-701CrossRef Zhou Y, Xie L, Shen W, Wang Y, Fishman EK, Yuille AL (2017) A fixed-point model for pancreas segmentation in abdominal CT scans. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 693-701CrossRef
12.
Zurück zum Zitat Roth HR, Oda H, Hayashi Y, Oda M, Shimizu N, Fujiwara M, Misawa K, Mori K (2017) Hierarchical 3D fully convolutional networks for multi-organ segmentation. arXiv preprint arXiv:1704.06382 Roth HR, Oda H, Hayashi Y, Oda M, Shimizu N, Fujiwara M, Misawa K, Mori K (2017) Hierarchical 3D fully convolutional networks for multi-organ segmentation. arXiv preprint arXiv:​1704.​06382
13.
Zurück zum Zitat Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141 Hu J, Shen L, Sun G (2018) Squeeze-and-excitation networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7132–7141
14.
Zurück zum Zitat Schlemper J, Oktay O, Schaap M, Heinrich M, Kainz B, Glocker B, Rueckert D (2019) Attention gated networks: learning to leverage salient regions in medical images. Med Image Anal 53:197–207CrossRef Schlemper J, Oktay O, Schaap M, Heinrich M, Kainz B, Glocker B, Rueckert D (2019) Attention gated networks: learning to leverage salient regions in medical images. Med Image Anal 53:197–207CrossRef
15.
Zurück zum Zitat Byra M, Wu M, Zhang X, Jang H, Ma YJ, Chang EY, Shah S, Du J (2019) Knee menisci segmentation and relaxometry of 3D ultrashort echo time cones MR imaging using attention U-Net with transfer learning. Magn Reson Med 83:1109–1122CrossRef Byra M, Wu M, Zhang X, Jang H, Ma YJ, Chang EY, Shah S, Du J (2019) Knee menisci segmentation and relaxometry of 3D ultrashort echo time cones MR imaging using attention U-Net with transfer learning. Magn Reson Med 83:1109–1122CrossRef
16.
Zurück zum Zitat Cai J, Lu L, Xing F, Yang L (2018) Pancreas segmentation in CT and MRI images via domain specific network designing and recurrent neural contextual learning. arXiv preprint arXiv:1803.11303 Cai J, Lu L, Xing F, Yang L (2018) Pancreas segmentation in CT and MRI images via domain specific network designing and recurrent neural contextual learning. arXiv preprint arXiv:​1803.​11303
17.
Zurück zum Zitat Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166CrossRef Bengio Y, Simard P, Frasconi P (1994) Learning long-term dependencies with gradient descent is difficult. IEEE Trans Neural Netw 5(2):157–166CrossRef
18.
Zurück zum Zitat Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256 Glorot X, Bengio Y (2010) Understanding the difficulty of training deep feedforward neural networks. In: Proceedings of the thirteenth international conference on artificial intelligence and statistics, pp 249–256
19.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
20.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 234–241
21.
Zurück zum Zitat Dou Q, Chen H, Jin Y, Yu L, Qin J, Heng P-A (2016) 3D deeply supervised network for automatic liver segmentation from CT volumes. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 149–157CrossRef Dou Q, Chen H, Jin Y, Yu L, Qin J, Heng P-A (2016) 3D deeply supervised network for automatic liver segmentation from CT volumes. In: International conference on medical image computing and computer-assisted intervention. Springer, Berlin, pp 149–157CrossRef
22.
Zurück zum Zitat Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440 Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440
23.
25.
Zurück zum Zitat Yan K, Wang X, Kim J, Khadra M, Fulham M, Feng D (2019) A propagation-DNN: deep combination learning of multi-level features for MR prostate segmentation. Comput Methods Progr Biomed 170:11–21CrossRef Yan K, Wang X, Kim J, Khadra M, Fulham M, Feng D (2019) A propagation-DNN: deep combination learning of multi-level features for MR prostate segmentation. Comput Methods Progr Biomed 170:11–21CrossRef
Metadaten
Titel
Deep multi-scale feature fusion for pancreas segmentation from CT images
verfasst von
Zhanlan Chen
Xiuying Wang
Ke Yan
Jiangbin Zheng
Publikationsdatum
22.01.2020
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 3/2020
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-020-02117-y

Weitere Artikel der Ausgabe 3/2020

International Journal of Computer Assisted Radiology and Surgery 3/2020 Zur Ausgabe

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Screening-Mammografie offenbart erhöhtes Herz-Kreislauf-Risiko

26.04.2024 Mammografie Nachrichten

Routinemäßige Mammografien helfen, Brustkrebs frühzeitig zu erkennen. Anhand der Röntgenuntersuchung lassen sich aber auch kardiovaskuläre Risikopatientinnen identifizieren. Als zuverlässiger Anhaltspunkt gilt die Verkalkung der Brustarterien.

S3-Leitlinie zu Pankreaskrebs aktualisiert

23.04.2024 Pankreaskarzinom Nachrichten

Die Empfehlungen zur Therapie des Pankreaskarzinoms wurden um zwei Off-Label-Anwendungen erweitert. Und auch im Bereich der Früherkennung gibt es Aktualisierungen.

Fünf Dinge, die im Kindernotfall besser zu unterlassen sind

18.04.2024 Pädiatrische Notfallmedizin Nachrichten

Im Choosing-Wisely-Programm, das für die deutsche Initiative „Klug entscheiden“ Pate gestanden hat, sind erstmals Empfehlungen zum Umgang mit Notfällen von Kindern erschienen. Fünf Dinge gilt es demnach zu vermeiden.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.