Skip to main content
Erschienen in: Aesthetic Plastic Surgery 6/2023

25.08.2023 | Original Articles

How Brow Rotation Affects Emotional Expression Utilizing Artificial Intelligence

verfasst von: Agnes Zhu, Thanapoom Boonipat, Sai Cherukuri, Jason Lin, Uldis Bite

Erschienen in: Aesthetic Plastic Surgery | Ausgabe 6/2023

Einloggen, um Zugang zu erhalten

Abstract

Background

It is well known that brow position affects emotional expression. However, there is little literature on how and to what degree this change in emotional expression happens. Previous studies on this topic have utilized manual rating; this method of study remains small and labor intensive. Our objective is to correlate manual brow rotations with emotional outcomes using artificial intelligence to objectively determine how specific brow manipulations affected human expression.

Methods

We included 53 brow-lift patients in this study. Pre-operative patients’ brows were rotated to − 20, − 10, +10, and +20 degrees in respect to the central axis of their existing brow using PIXLR, a cloud-based set of image editing tools and utilities. These images were analyzed using FaceReader, a validated software package that uses computer vision technology for facial expression recognition. The primary facial emotion and intensity of facial action units (0 = no action unit detected to 4 = most intense action unit detected) generated by the software were recorded.

Results

265 total images [5 images (pre-operative, − 20 degree brow rotation, − 10, +10, and +20) per patient] were analyzed using FaceReader. The primary emotion detected in the majority of images was neutral. The percentage of disgust in patients’ expressions, as detected by FaceReader, increased with increased positive brow rotation (1.76% disgust detected at − 20 degrees, 2.09% at − 10 degrees, 2.65% at neutral, 2.61% at +10 degrees, and 2.95% at +20 degrees). In contrast, the percentage of sadness in patients’ expressions decreased with increased positive brow rotation (29.92% sadness detected at − 20 degrees, 21.5% at − 10 degrees, 11.42% at neutral, 15.75% at +10 degrees, and 12.86% at +20 degrees).
Our facial action unit analysis corresponded with primary emotion analysis. The intensity of the inner brow raiser decreased with increased positive brow rotation 8.54% at − 20 degrees, 4.21% at − 10 degrees, 1.48% at neutral, 0.84% at +10 degrees, and 0.76% at +20 degrees). The intensity of the outer brow raiser increased with increased positive brow rotation (0.97% at − 20 degrees, 0.45% at − 10 degrees, 1.12% at neutral, 5.45% at +10 degrees, and 11.19% at +20 degrees).

Conclusion

We demonstrated that increasing the degree of brow rotation correlated positively with the percentage of disgust and inversely with the percentage of sadness detected by FaceReader. This study demonstrated how different manipulated brow positions affected emotional outcomes using artificial intelligence. Physicians can use these findings to better understand how brow-lifts can affect the perceived emotion of their patients.

Level of Evidence III

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors www.​springer.​com/​00266.
Literatur
1.
Zurück zum Zitat Berkowitz RL, Jacobs DI, Gorman PJ (2005) Brow fixation with the endotine forehead device in endoscopic brow lift. Plast Reconstr Surg 116(6):1761–1767CrossRefPubMed Berkowitz RL, Jacobs DI, Gorman PJ (2005) Brow fixation with the endotine forehead device in endoscopic brow lift. Plast Reconstr Surg 116(6):1761–1767CrossRefPubMed
2.
3.
Zurück zum Zitat Chajchir A (1994) Endoscopic subperiosteal forehead lift. Aesthetic Plast Surg 18(3):269–274CrossRefPubMed Chajchir A (1994) Endoscopic subperiosteal forehead lift. Aesthetic Plast Surg 18(3):269–274CrossRefPubMed
4.
Zurück zum Zitat Pelle-Ceravolo M, Angelini M (2017) Transcutaneous brow shaping: a straightforward and precise method to lift and shape the eyebrows. Aesthetic Surg J 37(8):863–875CrossRef Pelle-Ceravolo M, Angelini M (2017) Transcutaneous brow shaping: a straightforward and precise method to lift and shape the eyebrows. Aesthetic Surg J 37(8):863–875CrossRef
5.
Zurück zum Zitat Guyuron B (2001) Corrugator supercilii resection through blepharoplasty incision. Plast Reconstr Surg 107(2):604–605CrossRefPubMed Guyuron B (2001) Corrugator supercilii resection through blepharoplasty incision. Plast Reconstr Surg 107(2):604–605CrossRefPubMed
6.
Zurück zum Zitat Viterbo F, Auersvald A, O’Daniel TG (2019) Gliding brow lift (GBL): a new concept. Aesthetic Plast Surg 43(6):1536–1546CrossRefPubMed Viterbo F, Auersvald A, O’Daniel TG (2019) Gliding brow lift (GBL): a new concept. Aesthetic Plast Surg 43(6):1536–1546CrossRefPubMed
7.
Zurück zum Zitat Trepsat F (2003) Periorbital rejuvenation combining fat grafting and blepharoplasties. Aesthetic Plast Surg 27(4):243–253CrossRefPubMed Trepsat F (2003) Periorbital rejuvenation combining fat grafting and blepharoplasties. Aesthetic Plast Surg 27(4):243–253CrossRefPubMed
8.
Zurück zum Zitat Gunter JP, Antrobus SD (1997) Aesthetic analysis of the eyebrows. Plast Reconstr Surg 99(7):1808–1816CrossRefPubMed Gunter JP, Antrobus SD (1997) Aesthetic analysis of the eyebrows. Plast Reconstr Surg 99(7):1808–1816CrossRefPubMed
9.
Zurück zum Zitat Freund RM, Nolan WB 3rd (1996) Correlation between brow lift outcomes and aesthetic ideals for eyebrow height and shape in females. Plast Reconstr Surg 97(7):1343–1348CrossRefPubMed Freund RM, Nolan WB 3rd (1996) Correlation between brow lift outcomes and aesthetic ideals for eyebrow height and shape in females. Plast Reconstr Surg 97(7):1343–1348CrossRefPubMed
10.
Zurück zum Zitat Matarasso A, Terino EO (1994) Forehead-brow rhytidoplasty: reassessing the goals. Plast Reconstr Surg 93(7):1378–1389CrossRefPubMed Matarasso A, Terino EO (1994) Forehead-brow rhytidoplasty: reassessing the goals. Plast Reconstr Surg 93(7):1378–1389CrossRefPubMed
11.
Zurück zum Zitat Schreiber JE, Singh NK, Klatsky SA (2005) Beauty Lies in the “Eyebrow” of the Beholder: A Public Survey of Eyebrow Aesthetics. Aesthetic Surg J 25(4):348–352CrossRef Schreiber JE, Singh NK, Klatsky SA (2005) Beauty Lies in the “Eyebrow” of the Beholder: A Public Survey of Eyebrow Aesthetics. Aesthetic Surg J 25(4):348–352CrossRef
12.
Zurück zum Zitat Westmore M (1974) Facial cosmetics in conjunction with surgery. Paper presented at: Aesthetic Plastic Surgical Society Meeting; May 7, 1974; Vancouver, British Columbia. Westmore M (1974) Facial cosmetics in conjunction with surgery. Paper presented at: Aesthetic Plastic Surgical Society Meeting; May 7, 1974; Vancouver, British Columbia.
13.
Zurück zum Zitat Knoll BI, Attkiss KJ, Persing JA (2008) The influence of forehead, brow, and periorbital aesthetics on perceived expression in the youthful face. Plast Reconstr Surg 121(5):1793–1802CrossRefPubMed Knoll BI, Attkiss KJ, Persing JA (2008) The influence of forehead, brow, and periorbital aesthetics on perceived expression in the youthful face. Plast Reconstr Surg 121(5):1793–1802CrossRefPubMed
14.
Zurück zum Zitat Baker SB, Dayan JH, Crane A, Kim S (2007) The influence of brow shape on the perception of facial form and brow aesthetics. Plast Reconstr Surg 119(7):2240–2247CrossRefPubMed Baker SB, Dayan JH, Crane A, Kim S (2007) The influence of brow shape on the perception of facial form and brow aesthetics. Plast Reconstr Surg 119(7):2240–2247CrossRefPubMed
16.
Zurück zum Zitat Kirkpatrick SW, Bell FE, Johnson C, Perkins J, Sullivan LA (1996) Interpretation of facial expressions of emotion: the influence of eyebrows. Genet Soc Gen Psychol Monogr 122(4):405–423PubMed Kirkpatrick SW, Bell FE, Johnson C, Perkins J, Sullivan LA (1996) Interpretation of facial expressions of emotion: the influence of eyebrows. Genet Soc Gen Psychol Monogr 122(4):405–423PubMed
17.
Zurück zum Zitat Calder AJ, Burton AM, Miller P, Young AW, Akamatsu S (2001) A principal component analysis of facial expressions. Vision Res 41(9):1179–1208CrossRefPubMed Calder AJ, Burton AM, Miller P, Young AW, Akamatsu S (2001) A principal component analysis of facial expressions. Vision Res 41(9):1179–1208CrossRefPubMed
18.
Zurück zum Zitat Boonipat T, Lin J, Bite U (2021) Detection of baseline emotion in brow lift patients using artificial intelligence. Aesthetic Plast Surg 45(6):2742–2748CrossRefPubMed Boonipat T, Lin J, Bite U (2021) Detection of baseline emotion in brow lift patients using artificial intelligence. Aesthetic Plast Surg 45(6):2742–2748CrossRefPubMed
19.
Zurück zum Zitat van der Schalk J, Hawk ST, Fischer AH, Doosje B (2011) Moving faces, looking places: Validation of the Amsterdam Dynamic Facial Expression Set (ADFES). Emotion 11(4):907–920. van der Schalk J, Hawk ST, Fischer AH, Doosje B (2011) Moving faces, looking places: Validation of the Amsterdam Dynamic Facial Expression Set (ADFES). Emotion 11(4):907–920.
20.
Zurück zum Zitat Bishop CM (1995) Neural Networks for Pattern Recognition. Oxford University Press, Inc.CrossRef Bishop CM (1995) Neural Networks for Pattern Recognition. Oxford University Press, Inc.CrossRef
21.
Zurück zum Zitat Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685CrossRef Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685CrossRef
22.
Zurück zum Zitat van der Schalk J, Hawk ST, Fischer AH, Doosje B (2011) Moving faces, looking places: validation of the amsterdam dynamic facial expression Set (ADFES). Emotion 11(4):907–920CrossRefPubMed van der Schalk J, Hawk ST, Fischer AH, Doosje B (2011) Moving faces, looking places: validation of the amsterdam dynamic facial expression Set (ADFES). Emotion 11(4):907–920CrossRefPubMed
23.
Zurück zum Zitat Klassen AF, Cano SJ, Schwitzer JA, Scott AM, Pusic AL (2015) FACE-Q scales for health-related quality of life, early life impact, satisfaction with outcomes, and decision to have treatment: development and validation. Plast Reconstr Surg 135(2):375–386CrossRefPubMed Klassen AF, Cano SJ, Schwitzer JA, Scott AM, Pusic AL (2015) FACE-Q scales for health-related quality of life, early life impact, satisfaction with outcomes, and decision to have treatment: development and validation. Plast Reconstr Surg 135(2):375–386CrossRefPubMed
24.
Zurück zum Zitat Ching S, Thoma A, McCabe RE, Antony MM (2003) Measuring outcomes in aesthetic surgery: a comprehensive review of the literature. Plast Reconstr Surg 111(1):469–480CrossRefPubMed Ching S, Thoma A, McCabe RE, Antony MM (2003) Measuring outcomes in aesthetic surgery: a comprehensive review of the literature. Plast Reconstr Surg 111(1):469–480CrossRefPubMed
25.
Zurück zum Zitat Boonipat T, Asaad M, Lin J, Glass GE, Mardini S, Stotland M (2020) Using artificial intelligence to measure facial expression following facial reanimation surgery. Plast Reconstr Surg 146(5):1147–1150CrossRefPubMed Boonipat T, Asaad M, Lin J, Glass GE, Mardini S, Stotland M (2020) Using artificial intelligence to measure facial expression following facial reanimation surgery. Plast Reconstr Surg 146(5):1147–1150CrossRefPubMed
26.
Zurück zum Zitat Boonipat T, Hebel N, Zhu A, Lin J, Shapiro D (2022) Using artificial intelligence to analyze emotion and facial action units following facial rejuvenation surgery. J Plast Reconstr Aesthet Surg 75(9):3628–3651CrossRefPubMed Boonipat T, Hebel N, Zhu A, Lin J, Shapiro D (2022) Using artificial intelligence to analyze emotion and facial action units following facial rejuvenation surgery. J Plast Reconstr Aesthet Surg 75(9):3628–3651CrossRefPubMed
27.
Zurück zum Zitat Dorante MI, Kollar B, Obed D, Haug V, Fischer S, Pomahac B (2020) Recognizing emotional expression as an outcome measure after face transplant. JAMA Netw Open 3(1):e1919247CrossRefPubMedPubMedCentral Dorante MI, Kollar B, Obed D, Haug V, Fischer S, Pomahac B (2020) Recognizing emotional expression as an outcome measure after face transplant. JAMA Netw Open 3(1):e1919247CrossRefPubMedPubMedCentral
28.
Zurück zum Zitat Ahmadi N, Niazmand M, Ghasemi A, Mohaghegh S, Motamedian SR (2023) Applications of machine learning in facial cosmetic surgeries: a scoping review. Aesthet Plastic Surg 2023:1–17 Ahmadi N, Niazmand M, Ghasemi A, Mohaghegh S, Motamedian SR (2023) Applications of machine learning in facial cosmetic surgeries: a scoping review. Aesthet Plastic Surg 2023:1–17
29.
Zurück zum Zitat Eldaly AS, Avila FR, Torres-Guzman RA et al (2022) Simulation and artificial intelligence in rhinoplasty: a systematic review. Aesthetic Plast Surg 46(5):2368–2377CrossRefPubMed Eldaly AS, Avila FR, Torres-Guzman RA et al (2022) Simulation and artificial intelligence in rhinoplasty: a systematic review. Aesthetic Plast Surg 46(5):2368–2377CrossRefPubMed
30.
Zurück zum Zitat Gibstein AR, Chen K, Nakfoor B et al (2020) Facelift surgery turns back the clock: artificial intelligence and patient satisfaction quantitate value of procedure type and specific techniques. Aesthetic Surg J 41(9):987–999CrossRef Gibstein AR, Chen K, Nakfoor B et al (2020) Facelift surgery turns back the clock: artificial intelligence and patient satisfaction quantitate value of procedure type and specific techniques. Aesthetic Surg J 41(9):987–999CrossRef
31.
32.
Zurück zum Zitat Boonipat T, Yan M, Bite U (2023) Artificial intelligence for evaluation of emotions behind face masks. Plast Reconstr Surg 151(2):354e–356eCrossRefPubMed Boonipat T, Yan M, Bite U (2023) Artificial intelligence for evaluation of emotions behind face masks. Plast Reconstr Surg 151(2):354e–356eCrossRefPubMed
Metadaten
Titel
How Brow Rotation Affects Emotional Expression Utilizing Artificial Intelligence
verfasst von
Agnes Zhu
Thanapoom Boonipat
Sai Cherukuri
Jason Lin
Uldis Bite
Publikationsdatum
25.08.2023
Verlag
Springer US
Erschienen in
Aesthetic Plastic Surgery / Ausgabe 6/2023
Print ISSN: 0364-216X
Elektronische ISSN: 1432-5241
DOI
https://doi.org/10.1007/s00266-023-03615-5

Weitere Artikel der Ausgabe 6/2023

Aesthetic Plastic Surgery 6/2023 Zur Ausgabe

Vorsicht, erhöhte Blutungsgefahr nach PCI!

10.05.2024 Koronare Herzerkrankung Nachrichten

Nach PCI besteht ein erhöhtes Blutungsrisiko, wenn die Behandelten eine verminderte linksventrikuläre Ejektionsfraktion aufweisen. Das Risiko ist umso höher, je stärker die Pumpfunktion eingeschränkt ist.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Deutlich weniger Infektionen: Wundprotektoren schützen!

08.05.2024 Postoperative Wundinfektion Nachrichten

Der Einsatz von Wundprotektoren bei offenen Eingriffen am unteren Gastrointestinaltrakt schützt vor Infektionen im Op.-Gebiet – und dient darüber hinaus der besseren Sicht. Das bestätigt mit großer Robustheit eine randomisierte Studie im Fachblatt JAMA Surgery.

Chirurginnen und Chirurgen sind stark suizidgefährdet

07.05.2024 Suizid Nachrichten

Der belastende Arbeitsalltag wirkt sich negativ auf die psychische Gesundheit der Angehörigen ärztlicher Berufsgruppen aus. Chirurginnen und Chirurgen bilden da keine Ausnahme, im Gegenteil.

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.