Skip to main content
Erschienen in: Oral Radiology 1/2021

01.01.2021 | Original Article

Tooth detection and classification on panoramic radiographs for automatic dental chart filing: improved classification by multi-sized input data

verfasst von: Chisako Muramatsu, Takumi Morishita, Ryo Takahashi, Tatsuro Hayashi, Wataru Nishiyama, Yoshiko Ariji, Xiangrong Zhou, Takeshi Hara, Akitoshi Katsumata, Eiichiro Ariji, Hiroshi Fujita

Erschienen in: Oral Radiology | Ausgabe 1/2021

Einloggen, um Zugang zu erhalten

Abstract

Objectives

Dental state plays an important role in forensic radiology in case of large scale disasters. However, dental information stored in dental clinics are not standardized or electronically filed in general. The purpose of this study is to develop a computerized system to detect and classify teeth in dental panoramic radiographs for automatic structured filing of the dental charts. It can also be used as a preprocessing step for computerized image analysis of dental diseases.

Methods

One hundred dental panoramic radiographs were employed for training and testing an object detection network using fourfold cross-validation method. The detected bounding boxes were then classified into four tooth types, including incisors, canines, premolars, and molars, and three tooth conditions, including nonmetal restored, partially restored, and completely restored, using classification network. Based on the visualization result, multisized image data were used for the double input layers of a convolutional neural network. The result was evaluated by the detection sensitivity, the number of false-positive detection, and classification accuracies.

Results

The tooth detection sensitivity was 96.4% with 0.5 false positives per case. The classification accuracies for tooth types and tooth conditions were 93.2% and 98.0%. Using the double input layer network, 6 point increase in classification accuracy was achieved for the tooth types.

Conclusions

The proposed method can be useful in automatic filing of dental charts for forensic identification and preprocessing of dental disease prescreening purposes.
Literatur
1.
Zurück zum Zitat Shanbhag VKL. Significance of dental records in personal identification in forensic sciences. J Forensic Sci Med. 2016;2:39–433.CrossRef Shanbhag VKL. Significance of dental records in personal identification in forensic sciences. J Forensic Sci Med. 2016;2:39–433.CrossRef
2.
Zurück zum Zitat Wood Forensic dental identification in mass disasters. the current status. J California Dent Assoc. 2014;42:379–83. Wood Forensic dental identification in mass disasters. the current status. J California Dent Assoc. 2014;42:379–83.
3.
Zurück zum Zitat Sable G, Rindhe D. A review of dental biometrics from teeth featre extraction and matching techniques. Int J Sci Res. 2014;3:2720–2. Sable G, Rindhe D. A review of dental biometrics from teeth featre extraction and matching techniques. Int J Sci Res. 2014;3:2720–2.
4.
Zurück zum Zitat Lin PL, Huang PY, Huang PW, Hsu HC, Chen CC. Teeth segmentation of dental periapical radiographs based on local singularity analysis. Comput Method Prog Biomed. 2014;113:433–45.CrossRef Lin PL, Huang PY, Huang PW, Hsu HC, Chen CC. Teeth segmentation of dental periapical radiographs based on local singularity analysis. Comput Method Prog Biomed. 2014;113:433–45.CrossRef
5.
Zurück zum Zitat Hosntalab M, Zoroofi RA, Tehrani-Fard AA, Shirani G. Classification and numbering of teeth in multi-slice CT images using wavelet-Fourier descriptor. Int J CARS. 2010;5:237–49.CrossRef Hosntalab M, Zoroofi RA, Tehrani-Fard AA, Shirani G. Classification and numbering of teeth in multi-slice CT images using wavelet-Fourier descriptor. Int J CARS. 2010;5:237–49.CrossRef
6.
Zurück zum Zitat Miki Y, Muramatsu C, Hayashi T, Zhou X, Hara T, Katsumata A, et al. Classification of teeth in cone-beam CT using deep convolutional neural network. Comput Biol Med. 2017;80:24–9.CrossRef Miki Y, Muramatsu C, Hayashi T, Zhou X, Hara T, Katsumata A, et al. Classification of teeth in cone-beam CT using deep convolutional neural network. Comput Biol Med. 2017;80:24–9.CrossRef
7.
Zurück zum Zitat Miki Y, Muramatsu C, Hayashi T, Zhou X, Hara T, Katsumata A, et al. Tooth labeling in cone-beam CT using deep convolutional neural network for forensic identification. Proc SPIE Med Imaging 2017;10134:101343E1–6. Miki Y, Muramatsu C, Hayashi T, Zhou X, Hara T, Katsumata A, et al. Tooth labeling in cone-beam CT using deep convolutional neural network for forensic identification. Proc SPIE Med Imaging 2017;10134:101343E1–6.
8.
Zurück zum Zitat Tian S, Dai N, Zhang B, Yuan F, Yu Q, Cheng X. Automatic classification and segmentation of teeth on 3D dental model using hierarchical deep learning networks. IEEE Access. 2019;7:84817–28.CrossRef Tian S, Dai N, Zhang B, Yuan F, Yu Q, Cheng X. Automatic classification and segmentation of teeth on 3D dental model using hierarchical deep learning networks. IEEE Access. 2019;7:84817–28.CrossRef
9.
Zurück zum Zitat Cui Z, Li C, Wang W. ToothNet: automatic tooth instance segmentation and identification from cone beam CT images. CVPR 2019:6368–77. Cui Z, Li C, Wang W. ToothNet: automatic tooth instance segmentation and identification from cone beam CT images. CVPR 2019:6368–77.
10.
Zurück zum Zitat Wirtz A, Mirashi SG, Wesarg S. Automatic teeth segmentation in panoramic X-ray images using a coupled shape model in combination with a neural network. MICCAI 2018. LNCS 2018;11073:712–719. Wirtz A, Mirashi SG, Wesarg S. Automatic teeth segmentation in panoramic X-ray images using a coupled shape model in combination with a neural network. MICCAI 2018. LNCS 2018;11073:712–719.
11.
Zurück zum Zitat Tuzoff DV, Tuzova LN, Bornstein MM, Krasnov AS, Kharchenko MA, Nikolenko SI, et al. Tooth detection and numbering in panoramic radiographs using convolutional neural networks. Dentomaxillofacial Rad. 2019;48:20180051.CrossRef Tuzoff DV, Tuzova LN, Bornstein MM, Krasnov AS, Kharchenko MA, Nikolenko SI, et al. Tooth detection and numbering in panoramic radiographs using convolutional neural networks. Dentomaxillofacial Rad. 2019;48:20180051.CrossRef
12.
Zurück zum Zitat Muramatsu C, Matsumoto T, Hayashi T, Hara T, Katsumata A, Zhou X, et al. Automated measurement of mandibular cortical width on dental panoramic radiographs. Int J CARS. 2013;8:877–85.CrossRef Muramatsu C, Matsumoto T, Hayashi T, Hara T, Katsumata A, Zhou X, et al. Automated measurement of mandibular cortical width on dental panoramic radiographs. Int J CARS. 2013;8:877–85.CrossRef
14.
Zurück zum Zitat Szegedy C, Liu W, Jai Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. IEEE Conf Comput Vis Pat Recog (CVPR) 2015. Szegedy C, Liu W, Jai Y, Sermanet P, Reed S, Anguelov D, et al. Going deeper with convolutions. IEEE Conf Comput Vis Pat Recog (CVPR) 2015.
15.
Zurück zum Zitat Krizhevski A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural network. Adv Neural Inf Process Syst NIPS. 2013;25:1106–14. Krizhevski A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural network. Adv Neural Inf Process Syst NIPS. 2013;25:1106–14.
16.
Zurück zum Zitat He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. arXiv:1512.03385. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. arXiv:1512.03385.
17.
Zurück zum Zitat Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. arXiv:1610.02391. Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: visual explanations from deep networks via gradient-based localization. arXiv:1610.02391.
Metadaten
Titel
Tooth detection and classification on panoramic radiographs for automatic dental chart filing: improved classification by multi-sized input data
verfasst von
Chisako Muramatsu
Takumi Morishita
Ryo Takahashi
Tatsuro Hayashi
Wataru Nishiyama
Yoshiko Ariji
Xiangrong Zhou
Takeshi Hara
Akitoshi Katsumata
Eiichiro Ariji
Hiroshi Fujita
Publikationsdatum
01.01.2021
Verlag
Springer Singapore
Erschienen in
Oral Radiology / Ausgabe 1/2021
Print ISSN: 0911-6028
Elektronische ISSN: 1613-9674
DOI
https://doi.org/10.1007/s11282-019-00418-w

Weitere Artikel der Ausgabe 1/2021

Oral Radiology 1/2021 Zur Ausgabe

Newsletter

Bestellen Sie unseren kostenlosen Newsletter Update Zahnmedizin und bleiben Sie gut informiert – ganz bequem per eMail.