Skip to main content
Erschienen in: Journal of Endocrinological Investigation 10/2023

01.04.2023 | Original Article

Facial expression of patients with Graves’ orbitopathy

verfasst von: C. Lei, M. Qu, H. Sun, J. Huang, J. Huang, X. Song, G. Zhai, H. Zhou

Erschienen in: Journal of Endocrinological Investigation | Ausgabe 10/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Patients with Graves’ orbitopathy (GO) have characteristic facial expressions that are different from those of healthy individuals due to the combination of somatic and psychiatric symptoms. However, the facial expressions of GO patients have not yet been described and analyzed systematically. Thus, the present study aimed to present the facial expressions of GO patients and explore their applications in clinical practice.

Methods

Facial image and clinical data of 943 GO patients were included, and 126 patients answered quality of life (GO-QOL) questionnaires. Each patient was labeled for one facial expression. Then, a portrait was drawn for every facial expression. Logistic and linear regression was performed to analyze the correlation between facial expression and clinical indicators, including QOL, disease activity and severity. The VGG-19 network model was utilized to discriminate facial expressions automatically.

Results

Two groups, i.e., the non-negative emotion (neutral, happy) and the negative emotion (disgust, angry, fear, sadness, surprise), and seven expressions of GO patients were systematically analyzed. Facial expression was statistically associated with GO activity (P = 0.002), severity (P < 0.001), QOL visual functioning subscale scores (P = 0.001), and QOL appearance subscale score (P = 0.012). The deep learning model achieved satisfactory results (accuracy 0.851, sensitivity 0.899, precision 0.899, specificity 0.720, F1 score 0.899, and AUC 0.847).

Conclusions

As a novel clinical sign, facial expression holds the potential to be incorporated into GO assessment system in the future. The discrimination model may assist clinicians in real-life patient care.
Literatur
2.
Zurück zum Zitat Taylor PN et al (2020) New insights into the pathogenesis and nonsurgical management of Graves orbitopathy. Nat Rev Endocrinol 16(2):104–116CrossRefPubMed Taylor PN et al (2020) New insights into the pathogenesis and nonsurgical management of Graves orbitopathy. Nat Rev Endocrinol 16(2):104–116CrossRefPubMed
3.
Zurück zum Zitat Dalm V, Paridaens D, Peeters RP (2018) Graves’ orbitopathy: the ongoing search for new treatment strategies. Lancet Diabetes Endocrinol 6(4):261–263CrossRefPubMed Dalm V, Paridaens D, Peeters RP (2018) Graves’ orbitopathy: the ongoing search for new treatment strategies. Lancet Diabetes Endocrinol 6(4):261–263CrossRefPubMed
5.
Zurück zum Zitat Neag EJ, Smith TJ (2022) 2021 update on thyroid-associated ophthalmopathy. J Endocrinol Invest 45(2):235–259CrossRefPubMed Neag EJ, Smith TJ (2022) 2021 update on thyroid-associated ophthalmopathy. J Endocrinol Invest 45(2):235–259CrossRefPubMed
6.
Zurück zum Zitat Salvador AF, de Lima KA, Kipnis J (2021) Neuromodulation by the immune system: a focus on cytokines. Nat Rev Immunol 21(8):526–541CrossRefPubMed Salvador AF, de Lima KA, Kipnis J (2021) Neuromodulation by the immune system: a focus on cytokines. Nat Rev Immunol 21(8):526–541CrossRefPubMed
7.
Zurück zum Zitat Estcourt S, Quinn AG, Vaidya B (2011) Quality of life in thyroid eye disease: impact of quality of care. Eur J Endocrinol 164(5):649–655CrossRefPubMed Estcourt S, Quinn AG, Vaidya B (2011) Quality of life in thyroid eye disease: impact of quality of care. Eur J Endocrinol 164(5):649–655CrossRefPubMed
8.
Zurück zum Zitat Wickwar S et al (2015) The psychosocial and clinical outcomes of orbital decompression surgery for thyroid eye disease and predictors of change in quality of life. Ophthalmology 122(12):2568–76.e1CrossRefPubMed Wickwar S et al (2015) The psychosocial and clinical outcomes of orbital decompression surgery for thyroid eye disease and predictors of change in quality of life. Ophthalmology 122(12):2568–76.e1CrossRefPubMed
9.
Zurück zum Zitat Bartalena L et al (2021) The 2021 European Group on Graves’ orbitopathy (EUGOGO) clinical practice guidelines for the medical management of Graves’ orbitopathy. Eur J Endocrinol 185(4):G43-g67CrossRefPubMed Bartalena L et al (2021) The 2021 European Group on Graves’ orbitopathy (EUGOGO) clinical practice guidelines for the medical management of Graves’ orbitopathy. Eur J Endocrinol 185(4):G43-g67CrossRefPubMed
10.
Zurück zum Zitat Trimarchi F, Martino E, Bartalena L (2020) Graves’ orbitopathy represented as feature of a state of mind. J Endocrinol Invest 43(9):1343–1344CrossRefPubMed Trimarchi F, Martino E, Bartalena L (2020) Graves’ orbitopathy represented as feature of a state of mind. J Endocrinol Invest 43(9):1343–1344CrossRefPubMed
11.
Zurück zum Zitat Terwee CB et al (1998) Development of a disease specific quality of life questionnaire for patients with Graves’ ophthalmopathy: the GO-QOL. Br J Ophthalmol 82(7):773–779CrossRefPubMedPubMedCentral Terwee CB et al (1998) Development of a disease specific quality of life questionnaire for patients with Graves’ ophthalmopathy: the GO-QOL. Br J Ophthalmol 82(7):773–779CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Pers Soc Psychol 17(2):124–129CrossRefPubMed Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Pers Soc Psychol 17(2):124–129CrossRefPubMed
13.
Zurück zum Zitat Ekman P, Hager JC (2002) Facial action coding system, 2nd edn. Research Nexus eBook, Salt Lake City Ekman P, Hager JC (2002) Facial action coding system, 2nd edn. Research Nexus eBook, Salt Lake City
14.
Zurück zum Zitat Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. CoRR, 2014. abs/1409.1556. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. CoRR, 2014. abs/1409.1556.
15.
Zurück zum Zitat Zhou B et al (2016) Learning deep features for discriminative localization. IEEE Conf Comput Vis Pattern Recogn (CVPR) 2015:2921–2929 Zhou B et al (2016) Learning deep features for discriminative localization. IEEE Conf Comput Vis Pattern Recogn (CVPR) 2015:2921–2929
16.
Zurück zum Zitat Jeon J, et al (2016) A real-time facial expression recognizer using deep neural network. In: Proceedings of the 10th International Conference on Ubiquitous Information Management and Communication p. 1–4 Jeon J, et al (2016) A real-time facial expression recognizer using deep neural network. In: Proceedings of the 10th International Conference on Ubiquitous Information Management and Communication p. 1–4
17.
Zurück zum Zitat Ali MR et al (2021) Facial expressions can detect Parkinson’s disease: preliminary evidence from videos collected online. NPJ Digit Med 4(1):129CrossRefPubMedPubMedCentral Ali MR et al (2021) Facial expressions can detect Parkinson’s disease: preliminary evidence from videos collected online. NPJ Digit Med 4(1):129CrossRefPubMedPubMedCentral
18.
Zurück zum Zitat de la Torre-Luque A et al (2022) Relationships between social withdrawal and facial emotion recognition in neuropsychiatric disorders. Prog Neuropsychopharmacol Biol Psychiatry 113:110463CrossRefPubMed de la Torre-Luque A et al (2022) Relationships between social withdrawal and facial emotion recognition in neuropsychiatric disorders. Prog Neuropsychopharmacol Biol Psychiatry 113:110463CrossRefPubMed
19.
Zurück zum Zitat Coulter I et al (2007) Psychological implications of Graves’ orbitopathy. Eur J Endocrinol 157(2):127–131CrossRefPubMed Coulter I et al (2007) Psychological implications of Graves’ orbitopathy. Eur J Endocrinol 157(2):127–131CrossRefPubMed
20.
Zurück zum Zitat JM RJFD (1997) The psychology of facial expression. Cambridge University Press, Cambridge JM RJFD (1997) The psychology of facial expression. Cambridge University Press, Cambridge
21.
Zurück zum Zitat Bruscolini A et al (2018) Quality of life and neuropsychiatric disorders in patients with Graves’ Orbitopathy: current concepts. Autoimmun Rev 17(7):639–643CrossRefPubMed Bruscolini A et al (2018) Quality of life and neuropsychiatric disorders in patients with Graves’ Orbitopathy: current concepts. Autoimmun Rev 17(7):639–643CrossRefPubMed
22.
Zurück zum Zitat Zeng P et al (2019) Evaluation of the Graves’ orbitopathy-specific quality of life questionnaire in the mainland Chinese population. J Ophthalmol 2019:7602419CrossRefPubMedPubMedCentral Zeng P et al (2019) Evaluation of the Graves’ orbitopathy-specific quality of life questionnaire in the mainland Chinese population. J Ophthalmol 2019:7602419CrossRefPubMedPubMedCentral
23.
Zurück zum Zitat Wang Y et al (2018) A single-center retrospective study of factors related to the effects of intravenous glucocorticoid therapy in moderate-to-severe and active thyroid-associated ophthalmopathy. BMC Endocr Disord 18(1):13CrossRefPubMedPubMedCentral Wang Y et al (2018) A single-center retrospective study of factors related to the effects of intravenous glucocorticoid therapy in moderate-to-severe and active thyroid-associated ophthalmopathy. BMC Endocr Disord 18(1):13CrossRefPubMedPubMedCentral
24.
Zurück zum Zitat Chng CL, Seah LL, Khoo DH (2012) Ethnic differences in the clinical presentation of Graves’ ophthalmopathy. Best Pract Res Clin Endocrinol Metab 26(3):249–258CrossRefPubMed Chng CL, Seah LL, Khoo DH (2012) Ethnic differences in the clinical presentation of Graves’ ophthalmopathy. Best Pract Res Clin Endocrinol Metab 26(3):249–258CrossRefPubMed
25.
Zurück zum Zitat Lee THB, Sundar G (2020) Quality of life in thyroid eye disease: a systematic review. Ophthalmic Plast Reconstr Surg 36(2):118–126CrossRefPubMed Lee THB, Sundar G (2020) Quality of life in thyroid eye disease: a systematic review. Ophthalmic Plast Reconstr Surg 36(2):118–126CrossRefPubMed
26.
Zurück zum Zitat Fayers T, Dolman PJ (2011) Validity and reliability of the TED-QOL: a new three-item questionnaire to assess quality of life in thyroid eye disease. Br J Ophthalmol 95(12):1670–1674CrossRefPubMed Fayers T, Dolman PJ (2011) Validity and reliability of the TED-QOL: a new three-item questionnaire to assess quality of life in thyroid eye disease. Br J Ophthalmol 95(12):1670–1674CrossRefPubMed
27.
Zurück zum Zitat Bartalena L, Wiersinga WM (2020) Proposal for standardization of primary and secondary outcomes in patients with active. moderate-to-severe Graves’ orbitopathy. Eur Thyroid J 9(Suppl 1):3–16CrossRefPubMedPubMedCentral Bartalena L, Wiersinga WM (2020) Proposal for standardization of primary and secondary outcomes in patients with active. moderate-to-severe Graves’ orbitopathy. Eur Thyroid J 9(Suppl 1):3–16CrossRefPubMedPubMedCentral
28.
Zurück zum Zitat Cao J et al (2022) The risk factors for Graves’ ophthalmopathy. Graefes Arch Clin Exp Ophthalmol 260(4):1043–1054CrossRefPubMed Cao J et al (2022) The risk factors for Graves’ ophthalmopathy. Graefes Arch Clin Exp Ophthalmol 260(4):1043–1054CrossRefPubMed
29.
Zurück zum Zitat Wickwar S et al (2018) Patients’ expectations for the functional and psychosocial outcomes of orbital decompression surgery for thyroid eye disease: a qualitative study. Psychol Health Med 23(4):475–484CrossRefPubMed Wickwar S et al (2018) Patients’ expectations for the functional and psychosocial outcomes of orbital decompression surgery for thyroid eye disease: a qualitative study. Psychol Health Med 23(4):475–484CrossRefPubMed
30.
Zurück zum Zitat Wiersinga WM (2012) Quality of life in Graves’ ophthalmopathy. Best Pract Res Clin Endocrinol Metab 26(3):359–370CrossRefPubMed Wiersinga WM (2012) Quality of life in Graves’ ophthalmopathy. Best Pract Res Clin Endocrinol Metab 26(3):359–370CrossRefPubMed
31.
Zurück zum Zitat Barrett LF et al (2019) Emotional expressions reconsidered: challenges to inferring emotion from human facial movements. Psychol Sci Public Interest 20(1):1–68CrossRefPubMedPubMedCentral Barrett LF et al (2019) Emotional expressions reconsidered: challenges to inferring emotion from human facial movements. Psychol Sci Public Interest 20(1):1–68CrossRefPubMedPubMedCentral
32.
Zurück zum Zitat Gavrilescu M, Vizireanu N (2019) Predicting depression, anxiety, and stress levels from videos using the facial action coding system. Sensors 19:17CrossRef Gavrilescu M, Vizireanu N (2019) Predicting depression, anxiety, and stress levels from videos using the facial action coding system. Sensors 19:17CrossRef
33.
Zurück zum Zitat Polli E et al (2012) Facial action coding system (FACS): an instrument for the objective evaluation of facial expression and its potential applications to the study of schizophrenia. Riv Psichiatr 47(2):126–138PubMed Polli E et al (2012) Facial action coding system (FACS): an instrument for the objective evaluation of facial expression and its potential applications to the study of schizophrenia. Riv Psichiatr 47(2):126–138PubMed
34.
Zurück zum Zitat Song X et al (2021) Artificial intelligence CT screening model for thyroid-associated ophthalmopathy and tests under clinical conditions. Int J Comput Assist Radiol Surg 16(2):323–330CrossRefPubMed Song X et al (2021) Artificial intelligence CT screening model for thyroid-associated ophthalmopathy and tests under clinical conditions. Int J Comput Assist Radiol Surg 16(2):323–330CrossRefPubMed
35.
Zurück zum Zitat Lin C et al (2021) Detection of active and inactive phases of thyroid-associated ophthalmopathy using deep convolutional neural network. BMC Ophthalmol 21(1):39CrossRefPubMedPubMedCentral Lin C et al (2021) Detection of active and inactive phases of thyroid-associated ophthalmopathy using deep convolutional neural network. BMC Ophthalmol 21(1):39CrossRefPubMedPubMedCentral
36.
Zurück zum Zitat Yoo H et al (2020) Validation of a deep learning algorithm for the detection of malignant pulmonary nodules in chest radiographs. JAMA Netw Open 3(9):e2017135CrossRefPubMedPubMedCentral Yoo H et al (2020) Validation of a deep learning algorithm for the detection of malignant pulmonary nodules in chest radiographs. JAMA Netw Open 3(9):e2017135CrossRefPubMedPubMedCentral
37.
Zurück zum Zitat Lin S et al (2020) Feasibility of using deep learning to detect coronary artery disease based on facial photo. Eur Heart J 41(46):4400–4411CrossRefPubMed Lin S et al (2020) Feasibility of using deep learning to detect coronary artery disease based on facial photo. Eur Heart J 41(46):4400–4411CrossRefPubMed
Metadaten
Titel
Facial expression of patients with Graves’ orbitopathy
verfasst von
C. Lei
M. Qu
H. Sun
J. Huang
J. Huang
X. Song
G. Zhai
H. Zhou
Publikationsdatum
01.04.2023
Verlag
Springer International Publishing
Erschienen in
Journal of Endocrinological Investigation / Ausgabe 10/2023
Elektronische ISSN: 1720-8386
DOI
https://doi.org/10.1007/s40618-023-02054-y

Weitere Artikel der Ausgabe 10/2023

Journal of Endocrinological Investigation 10/2023 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Blutdrucksenkung könnte Uterusmyome verhindern

Frauen mit unbehandelter oder neu auftretender Hypertonie haben ein deutlich erhöhtes Risiko für Uterusmyome. Eine Therapie mit Antihypertensiva geht hingegen mit einer verringerten Inzidenz der gutartigen Tumoren einher.

„Jeder Fall von plötzlichem Tod muss obduziert werden!“

17.05.2024 Plötzlicher Herztod Nachrichten

Ein signifikanter Anteil der Fälle von plötzlichem Herztod ist genetisch bedingt. Um ihre Verwandten vor diesem Schicksal zu bewahren, sollten jüngere Personen, die plötzlich unerwartet versterben, ausnahmslos einer Autopsie unterzogen werden.

Hirnblutung unter DOAK und VKA ähnlich bedrohlich

17.05.2024 Direkte orale Antikoagulanzien Nachrichten

Kommt es zu einer nichttraumatischen Hirnblutung, spielt es keine große Rolle, ob die Betroffenen zuvor direkt wirksame orale Antikoagulanzien oder Marcumar bekommen haben: Die Prognose ist ähnlich schlecht.

Schlechtere Vorhofflimmern-Prognose bei kleinem linken Ventrikel

17.05.2024 Vorhofflimmern Nachrichten

Nicht nur ein vergrößerter, sondern auch ein kleiner linker Ventrikel ist bei Vorhofflimmern mit einer erhöhten Komplikationsrate assoziiert. Der Zusammenhang besteht nach Daten aus China unabhängig von anderen Risikofaktoren.

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.