Skip to main content
Erschienen in: Journal of Medical Systems 3/2018

01.03.2018 | Image & Signal Processing

Image-based Analysis of Emotional Facial Expressions in Full Face Transplants

verfasst von: Merve Bedeloglu, Çagdas Topcu, Arzu Akgul, Ela Naz Döger, Refik Sever, Ozlenen Ozkan, Omer Ozkan, Hilmi Uysal, Ovunc Polat, Omer Halil Çolak

Erschienen in: Journal of Medical Systems | Ausgabe 3/2018

Einloggen, um Zugang zu erhalten

Abstract

In this study, it is aimed to determine the degree of the development in emotional expression of full face transplant patients from photographs. Hence, a rehabilitation process can be planned according to the determination of degrees as a later work. As envisaged, in full face transplant cases, the determination of expressions can be confused or cannot be achieved as the healthy control group. In order to perform image-based analysis, a control group consist of 9 healthy males and 2 full-face transplant patients participated in the study. Appearance-based Gabor Wavelet Transform (GWT) and Local Binary Pattern (LBP) methods are adopted for recognizing neutral and 6 emotional expressions which consist of angry, scared, happy, hate, confused and sad. Feature extraction was carried out by using both methods and combination of these methods serially. In the performed expressions, the extracted features of the most distinct zones in the facial area where the eye and mouth region, have been used to classify the emotions. Also, the combination of these region features has been used to improve classifier performance. Control subjects and transplant patients’ ability to perform emotional expressions have been determined with K-nearest neighbor (KNN) classifier with region-specific and method-specific decision stages. The results have been compared with healthy group. It has been observed that transplant patients don’t reflect some emotional expressions. Also, there were confusions among expressions.
Literatur
1.
Zurück zum Zitat Bedeloglu, M., The Analysis of Emotional Expression Development of Face Transplant Patients by Using Image Processing Algorithms, MsC Thesis, Akdeniz University, 2016. Bedeloglu, M., The Analysis of Emotional Expression Development of Face Transplant Patients by Using Image Processing Algorithms, MsC Thesis, Akdeniz University, 2016.
2.
Zurück zum Zitat Bedeloglu, M., Topcu, C., Döger, E.N., Akgul, A., Sever, S., Ozkan, O., Ozkan, O., Uysal, H., Polat, O., Colak, O.H., Image based Analysis of Emotional Expression Developmetn in Facial Transplant Patient, TIPTEKNO2015, ss.1–4, 15–18 October 2015, Muğla, Turkey, 2015. Bedeloglu, M., Topcu, C., Döger, E.N., Akgul, A., Sever, S., Ozkan, O., Ozkan, O., Uysal, H., Polat, O., Colak, O.H., Image based Analysis of Emotional Expression Developmetn in Facial Transplant Patient, TIPTEKNO2015, ss.1–4, 15–18 October 2015, Muğla, Turkey, 2015.
3.
Zurück zum Zitat Shan C., Gong S., McOwan P.W., Robust facial expression recognition using local binary patterns. ICIP 2005. IEEE International Conference on (Vol. 2, pp. II-370). IEEE, 2005, September, 2005. Shan C., Gong S., McOwan P.W., Robust facial expression recognition using local binary patterns. ICIP 2005. IEEE International Conference on (Vol. 2, pp. II-370). IEEE, 2005, September, 2005.
4.
Zurück zum Zitat Tian, Y.L., Kanade, T., and Cohn, J.F., Facial expression analysis. Handbook of face recognition. Springer, New York, pp. 247–275, 2005.CrossRef Tian, Y.L., Kanade, T., and Cohn, J.F., Facial expression analysis. Handbook of face recognition. Springer, New York, pp. 247–275, 2005.CrossRef
5.
Zurück zum Zitat Tian, Y.L., Evaluation of face resolution for expression analysis. Computer Vision and Pattern Recognition Workshop. CVPRW'04. Conference on (pp. 82–82). IEEE, 2004, June, 2004. Tian, Y.L., Evaluation of face resolution for expression analysis. Computer Vision and Pattern Recognition Workshop. CVPRW'04. Conference on (pp. 82–82). IEEE, 2004, June, 2004.
6.
Zurück zum Zitat Ekman, P., and Rosenberg, E.L., What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system (FACS). Oxford University Press, USA, 1997. Ekman, P., and Rosenberg, E.L., What the face reveals: Basic and applied studies of spontaneous expression using the facial action coding system (FACS). Oxford University Press, USA, 1997.
7.
Zurück zum Zitat Nagarajan, R., Hariharan, M., and Satiyan, M., Luminance Sticker Based Facial Expression Recognition Using Discrete Wavelet Transform for Physically Disabled Persons. J. Med. Syst. 36(4):2225–2234, 2012.CrossRefPubMed Nagarajan, R., Hariharan, M., and Satiyan, M., Luminance Sticker Based Facial Expression Recognition Using Discrete Wavelet Transform for Physically Disabled Persons. J. Med. Syst. 36(4):2225–2234, 2012.CrossRefPubMed
9.
Zurück zum Zitat Chao, W., Gabor wavelet transform and its application. Wei-lun Chao R989420 73. Chao, W., Gabor wavelet transform and its application. Wei-lun Chao R989420 73.
10.
Zurück zum Zitat Meshgini, S., Aghagolzadeh, A., and Seyedarabi, H., Face recognition using gabor filter bank, kernel principle component analysis and support vector machine. International Journal of Computer Theory and Engineering. 4(5):767–771, 2012.CrossRef Meshgini, S., Aghagolzadeh, A., and Seyedarabi, H., Face recognition using gabor filter bank, kernel principle component analysis and support vector machine. International Journal of Computer Theory and Engineering. 4(5):767–771, 2012.CrossRef
12.
Zurück zum Zitat Shen, L., Bai, L., and Fairhurst, M., Gabor wavelets and general discriminant analysis for face identification and verification. Image Vis. Comput. 25(5):553–563, 2007.CrossRef Shen, L., Bai, L., and Fairhurst, M., Gabor wavelets and general discriminant analysis for face identification and verification. Image Vis. Comput. 25(5):553–563, 2007.CrossRef
13.
Zurück zum Zitat Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R., Real time face detection and facial expression recognition: Development and applications to human computer interaction. Computer Vision and Pattern Recognition Workshop, 2003. CVPRW'03. Conference on (Vol. 5, pp. 53–53). IEEE, 2003, June, 2003. Bartlett, M.S., Littlewort, G., Fasel, I., Movellan, J.R., Real time face detection and facial expression recognition: Development and applications to human computer interaction. Computer Vision and Pattern Recognition Workshop, 2003. CVPRW'03. Conference on (Vol. 5, pp. 53–53). IEEE, 2003, June, 2003.
18.
Zurück zum Zitat Singh, R., Vatsa, M., and Noore, A., Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition. Pattern Recognition, Part Special issue: Feature Generation and Machine Learning for Robust Multimodal Biometrics. 41(3):880–893, 2008. https://doi.org/10.1016/j.patcog.2007.06.022.CrossRef Singh, R., Vatsa, M., and Noore, A., Integrated multilevel image fusion and match score fusion of visible and infrared face images for robust face recognition. Pattern Recognition, Part Special issue: Feature Generation and Machine Learning for Robust Multimodal Biometrics. 41(3):880–893, 2008. https://​doi.​org/​10.​1016/​j.​patcog.​2007.​06.​022.CrossRef
19.
Zurück zum Zitat Zhang, W., Shan, S., Gao, W., Chen, X., Zhang, H., Local gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition. Tenth IEEE International Conference on Computer Vision. ICCV 2005, 1:786–91 Vol. 1. doi:10.1109/ICCV.2005.147, 2005. Zhang, W., Shan, S., Gao, W., Chen, X., Zhang, H., Local gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition. Tenth IEEE International Conference on Computer Vision. ICCV 2005, 1:786–91 Vol. 1. doi:10.1109/ICCV.2005.147, 2005.
20.
Zurück zum Zitat Neth, D., and Martinez, A.M., A computational shape-based model of anger and sadness justifies a configural representation of faces. Vis. Res. 50:1693–1711, 2010.CrossRefPubMedPubMedCentral Neth, D., and Martinez, A.M., A computational shape-based model of anger and sadness justifies a configural representation of faces. Vis. Res. 50:1693–1711, 2010.CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Ekman, P., Basic Emotions. In: Dalgleish, T., and Power, T. (Eds.), The Handbook of Cognition and Emotion. John Wiley & Sons, Ltd., Sussex, pp. 45–60, 1999. Ekman, P., Basic Emotions. In: Dalgleish, T., and Power, T. (Eds.), The Handbook of Cognition and Emotion. John Wiley & Sons, Ltd., Sussex, pp. 45–60, 1999.
22.
Zurück zum Zitat Duchenne, B., Mécanisme de la physionomie humaine, ou analyse électrophysiologique de L'expression des passions. Bailliere, Paris, 1862.CrossRef Duchenne, B., Mécanisme de la physionomie humaine, ou analyse électrophysiologique de L'expression des passions. Bailliere, Paris, 1862.CrossRef
23.
Zurück zum Zitat Ekman, P., and Friesen, W.V., Constants Accross Cultures in the Face and Emotion. J. Pers. Soc. Psychol. 17(2):124–129, 1971.CrossRefPubMed Ekman, P., and Friesen, W.V., Constants Accross Cultures in the Face and Emotion. J. Pers. Soc. Psychol. 17(2):124–129, 1971.CrossRefPubMed
24.
Metadaten
Titel
Image-based Analysis of Emotional Facial Expressions in Full Face Transplants
verfasst von
Merve Bedeloglu
Çagdas Topcu
Arzu Akgul
Ela Naz Döger
Refik Sever
Ozlenen Ozkan
Omer Ozkan
Hilmi Uysal
Ovunc Polat
Omer Halil Çolak
Publikationsdatum
01.03.2018
Verlag
Springer US
Erschienen in
Journal of Medical Systems / Ausgabe 3/2018
Print ISSN: 0148-5598
Elektronische ISSN: 1573-689X
DOI
https://doi.org/10.1007/s10916-018-0895-8

Weitere Artikel der Ausgabe 3/2018

Journal of Medical Systems 3/2018 Zur Ausgabe