Skip to main content
Erschienen in: International Journal of Computer Assisted Radiology and Surgery 10/2021

21.07.2021 | Original Article

Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates

verfasst von: Jiangchang Xu, Jiannan Liu, Dingzhong Zhang, Zijie Zhou, Xiaoyi Jiang, Chenping Zhang, Xiaojun Chen

Erschienen in: International Journal of Computer Assisted Radiology and Surgery | Ausgabe 10/2021

Einloggen, um Zugang zu erhalten

Abstract

Purpose

In cranio-maxillofacial surgery, it is of great clinical significance to segment mandible accurately and automatically from CT images. However, the connected region and blurred boundary in teeth and condyles make the process challenging. At present, the mandible is commonly segmented by experienced doctors using manually or semi-automatic methods, which is time-consuming and has poor segmentation consistency. In addition, existing automatic segmentation methods still have problems such as region misjudgment, low accuracy, and time-consuming.

Methods

For these issues, an automatic mandibular segmentation method using 3d fully convolutional neural network based on densely connected atrous spatial pyramid pooling (DenseASPP) and attention gates (AG) was proposed in this paper. Firstly, the DenseASPP module was added to the network for extracting dense features at multiple scales. Thereafter, the AG module was applied in each skip connection to diminish irrelevant background information and make the network focus on segmentation regions. Finally, a loss function combining dice coefficient and focal loss was used to solve the imbalance among sample categories.

Results

Test results showed that the proposed network obtained a relatively good segmentation result, with a Dice score of 97.588 ± 0.425%, Intersection over Union of 95.293 ± 0.812%, sensitivity of 96.252 ± 1.106%, average surface distance of 0.065 ± 0.020 mm and 95% Hausdorff distance of 0.491 ± 0.021 mm in segmentation accuracy. The comparison with other segmentation networks showed that our network not only had a relatively high segmentation accuracy but also effectively reduced the network's misjudgment. Meantime, the surface distance error also showed that our segmentation results were relatively close to the ground truth.

Conclusion

The proposed network has better segmentation performance and realizes accurate and automatic segmentation of the mandible. Furthermore, its segmentation time is 50.43 s for one CT scan, which greatly improves the doctor's work efficiency. It will have practical significance in cranio-maxillofacial surgery in the future.
Literatur
1.
Zurück zum Zitat Maschaa F, Winterb K, Pietzkaa S, Heufeldera M, Schramma A, Wilde F (2017) Accuracy of computer-assisted mandibular reconstructions using patient-specific implants in combination with CAD/CAM fabricated transfer keys. J Craniomaxillofac Surg 45(11):1884–1897CrossRef Maschaa F, Winterb K, Pietzkaa S, Heufeldera M, Schramma A, Wilde F (2017) Accuracy of computer-assisted mandibular reconstructions using patient-specific implants in combination with CAD/CAM fabricated transfer keys. J Craniomaxillofac Surg 45(11):1884–1897CrossRef
2.
Zurück zum Zitat Cristoforettia A, Stavolac LD, Fincatoc A, Mase M, Ravellib F, Nolloa G, Tessaroloa F (2019) Assessing the accuracy of computer-planned osteotomy guided by stereolithographic template: a methodological framework applied to the mandibular bone harvesting. Comput Biol Med 114:103435CrossRef Cristoforettia A, Stavolac LD, Fincatoc A, Mase M, Ravellib F, Nolloa G, Tessaroloa F (2019) Assessing the accuracy of computer-planned osteotomy guided by stereolithographic template: a methodological framework applied to the mandibular bone harvesting. Comput Biol Med 114:103435CrossRef
3.
Zurück zum Zitat Chen X, Xu L, Sun Y, Politis C (2016) A review of computer-aided oral and maxillofacial surgery: planning, simulation and navigation. Expert Rev Med Devices 13(11):1043–1051CrossRef Chen X, Xu L, Sun Y, Politis C (2016) A review of computer-aided oral and maxillofacial surgery: planning, simulation and navigation. Expert Rev Med Devices 13(11):1043–1051CrossRef
4.
Zurück zum Zitat Tang H, Chen X, Liu Y, Lu Z, You J, Yang M, Yao S, Zhao G, Xu Y, Chen T, Liu Y, Xie X (2019) Clinically applicable deep learning framework for organs at risk delineation in CT images. Nat Mach Intell 1:480–491CrossRef Tang H, Chen X, Liu Y, Lu Z, You J, Yang M, Yao S, Zhao G, Xu Y, Chen T, Liu Y, Xie X (2019) Clinically applicable deep learning framework for organs at risk delineation in CT images. Nat Mach Intell 1:480–491CrossRef
5.
Zurück zum Zitat Chuang Y, Doherty BM, Adluru N, Chung MK, Vorperian HK (2018) A novel registration-based semiautomatic mandible segmentation pipeline using computed tomography images to study mandibular development. J Comput Assist Tomogr 42:306–316CrossRef Chuang Y, Doherty BM, Adluru N, Chung MK, Vorperian HK (2018) A novel registration-based semiautomatic mandible segmentation pipeline using computed tomography images to study mandibular development. J Comput Assist Tomogr 42:306–316CrossRef
6.
Zurück zum Zitat Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J (2018) Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: practical feasibility and assessment of a new course of action. PLoS ONE 13(5):e0196378CrossRef Wallner J, Hochegger K, Chen X, Mischak I, Reinbacher K, Pau M, Zrnc T, Schwenzer-Zimmerer K, Zemann W, Schmalstieg D, Egger J (2018) Clinical evaluation of semi-automatic open-source algorithmic software segmentation of the mandibular bone: practical feasibility and assessment of a new course of action. PLoS ONE 13(5):e0196378CrossRef
7.
Zurück zum Zitat Gass T, Szekely G, Goksel O (2014) Simultaneous segmentation and multiresolution nonrigid atlas registration. IEEE Trans Image Process 23(7):2931–2943CrossRef Gass T, Szekely G, Goksel O (2014) Simultaneous segmentation and multiresolution nonrigid atlas registration. IEEE Trans Image Process 23(7):2931–2943CrossRef
8.
Zurück zum Zitat Pei Y, Yi Y, Ma G, Kim T, Guo Y, Xu T, Zha H (2018) Spatially consistent supervoxel correspondences of cone-beam computed tomography images. IEEE Trans Med Imag 37(10):2310–2321CrossRef Pei Y, Yi Y, Ma G, Kim T, Guo Y, Xu T, Zha H (2018) Spatially consistent supervoxel correspondences of cone-beam computed tomography images. IEEE Trans Med Imag 37(10):2310–2321CrossRef
9.
Zurück zum Zitat Fan Y, Beare R, Matthews H, Schneider P, Kilpatrick N, Clement J, Claes P, Penington A, Adamson C (2019) Marker-based watershed transform method for fully automatic mandibular segmentation from CBCT images. Dentomaxillofac Radiol 48(2):20180261CrossRef Fan Y, Beare R, Matthews H, Schneider P, Kilpatrick N, Clement J, Claes P, Penington A, Adamson C (2019) Marker-based watershed transform method for fully automatic mandibular segmentation from CBCT images. Dentomaxillofac Radiol 48(2):20180261CrossRef
10.
Zurück zum Zitat Taghizadeh E, Terrier A, Becce F, Farron A, Büchler P (2019) Automated CT bone segmentation using statistical shape modelling and local template matching. Comput Methods Biomech Biomed Engin 22(16):1303–1310CrossRef Taghizadeh E, Terrier A, Becce F, Farron A, Büchler P (2019) Automated CT bone segmentation using statistical shape modelling and local template matching. Comput Methods Biomech Biomed Engin 22(16):1303–1310CrossRef
11.
Zurück zum Zitat Xu J, Jing M, Wang S, Yang C, Chen X (2019) A review of medical image detection for cancers in digestive system based on artificial intelligence. Expert Rev Med Dev 16(10):877–889CrossRef Xu J, Jing M, Wang S, Yang C, Chen X (2019) A review of medical image detection for cancers in digestive system based on artificial intelligence. Expert Rev Med Dev 16(10):877–889CrossRef
12.
Zurück zum Zitat Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547–557CrossRef Ibragimov B, Xing L (2017) Segmentation of organs-at-risks in head and neck CT images using convolutional neural networks. Med Phys 44(2):547–557CrossRef
13.
Zurück zum Zitat Yan M, Guo J, Tian W, Yi Z (2018) Symmetric convolutional neural network for mandible segmentation. Knowl Based Syst 159:63–71CrossRef Yan M, Guo J, Tian W, Yi Z (2018) Symmetric convolutional neural network for mandible segmentation. Knowl Based Syst 159:63–71CrossRef
14.
Zurück zum Zitat Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, Ooijen PMAV (2019) Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. Phys Med Biol 64(17):175020CrossRef Qiu B, Guo J, Kraeima J, Glas HH, Borra RJH, Witjes MJH, Ooijen PMAV (2019) Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network. Phys Med Biol 64(17):175020CrossRef
15.
Zurück zum Zitat Gou S, Tong N, Qi S, Yang S, Chin R, Sheng K (2020) Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images. Phys Med Biol 65:245034CrossRef Gou S, Tong N, Qi S, Yang S, Chin R, Sheng K (2020) Self-channel-and-spatial-attention neural network for automated multi-organ segmentation on head and neck CT images. Phys Med Biol 65:245034CrossRef
16.
Zurück zum Zitat Yong M, Yu K, Zhang C, Li Z, Yang K (2018) Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3684–3692 Yong M, Yu K, Zhang C, Li Z, Yang K (2018) Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), pp 3684–3692
17.
Zurück zum Zitat Oktay, O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, McDonagh S, Hammerla NY, Kainz B, Glocker B, Rueckert D (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint, http://arxiv.org/abs/1804.03999 Oktay, O, Schlemper J, Folgoc LL, Lee M, Heinrich M, Misawa K, Mori K, McDonagh S, Hammerla NY, Kainz B, Glocker B, Rueckert D (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint, http://​arxiv.​org/​abs/​1804.​03999
18.
Zurück zum Zitat Lin T, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef Lin T, Goyal P, Girshick R, He K, Dollar P (2020) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327CrossRef
19.
Zurück zum Zitat Wu Y, He K (2020) Group normalization. Int J Comput Vision 128(3):742–755CrossRef Wu Y, He K (2020) Group normalization. Int J Comput Vision 128(3):742–755CrossRef
21.
Zurück zum Zitat Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef Shelhamer E, Long J, Darrell T (2015) Fully convolutional networks for semantic segmentation. IEEE Trans Pattern Anal Mach Intell 39(4):640–651CrossRef
22.
Zurück zum Zitat Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 234–241 Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. In: Proceedings of the international conference on medical image computing and computer-assisted intervention, Springer, Cham, pp 234–241
23.
Zurück zum Zitat Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of the IEEE fourth international conference on 3D vision, pp 565–571 Milletari F, Navab N, Ahmadi SA (2016) V-Net: fully convolutional neural networks for volumetric medical image segmentation. In: Proceedings of the IEEE fourth international conference on 3D vision, pp 565–571
24.
Zurück zum Zitat Raith S, Wolff S, Steiner T, Modabber A, Weber M, Hölzle F, Fischer H (2017) Planning of mandibular reconstructions based on statistical shape models. Int J Comput Assist Radiol Surg 15:1457–1465 Raith S, Wolff S, Steiner T, Modabber A, Weber M, Hölzle F, Fischer H (2017) Planning of mandibular reconstructions based on statistical shape models. Int J Comput Assist Radiol Surg 15:1457–1465
25.
Zurück zum Zitat Zhu X, Han J, Zhou Z, Min X, Zhang Q, Liu J, Zhai G (2019) Improving accuracy of jaw reconstruction based on gender differences. J Oral Maxillofac Surg 78:662.e1-662.e13CrossRef Zhu X, Han J, Zhou Z, Min X, Zhang Q, Liu J, Zhai G (2019) Improving accuracy of jaw reconstruction based on gender differences. J Oral Maxillofac Surg 78:662.e1-662.e13CrossRef
Metadaten
Titel
Automatic mandible segmentation from CT image using 3D fully convolutional neural network based on DenseASPP and attention gates
verfasst von
Jiangchang Xu
Jiannan Liu
Dingzhong Zhang
Zijie Zhou
Xiaoyi Jiang
Chenping Zhang
Xiaojun Chen
Publikationsdatum
21.07.2021
Verlag
Springer International Publishing
Erschienen in
International Journal of Computer Assisted Radiology and Surgery / Ausgabe 10/2021
Print ISSN: 1861-6410
Elektronische ISSN: 1861-6429
DOI
https://doi.org/10.1007/s11548-021-02447-5

Weitere Artikel der Ausgabe 10/2021

International Journal of Computer Assisted Radiology and Surgery 10/2021 Zur Ausgabe

PET kann infarktgefährdete Koronararterien entdecken

04.06.2024 Koronare Herzerkrankung Nachrichten

Der Nachweis aktiver Plaques mittels 18F-Natriumfluorid-PET hilft nicht nur, infarktgefährdete Patienten, sondern auch infarktgefährdete Koronararterien zu erkennen. Von einer gezielten Behandlung vulnerabler Plaques ist man trotzdem weit entfernt.

Mammakarzinom: Brustdichte beeinflusst rezidivfreies Überleben

26.05.2024 Mammakarzinom Nachrichten

Frauen, die zum Zeitpunkt der Brustkrebsdiagnose eine hohe mammografische Brustdichte aufweisen, haben ein erhöhtes Risiko für ein baldiges Rezidiv, legen neue Daten nahe.

„Übersichtlicher Wegweiser“: Lauterbachs umstrittener Klinik-Atlas ist online

17.05.2024 Klinik aktuell Nachrichten

Sie sei „ethisch geboten“, meint Gesundheitsminister Karl Lauterbach: mehr Transparenz über die Qualität von Klinikbehandlungen. Um sie abzubilden, lässt er gegen den Widerstand vieler Länder einen virtuellen Klinik-Atlas freischalten.

Klinikreform soll zehntausende Menschenleben retten

15.05.2024 Klinik aktuell Nachrichten

Gesundheitsminister Lauterbach hat die vom Bundeskabinett beschlossene Klinikreform verteidigt. Kritik an den Plänen kommt vom Marburger Bund. Und in den Ländern wird über den Gang zum Vermittlungsausschuss spekuliert.

Update Radiologie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.