nach oben

European Archives of Oto-Rhino-Laryngology

Erschienen in:

24.10.2023 | Laryngology

ChatGPT performance in laryngology and head and neck surgery: a clinical case-series

verfasst von: Jerome R. Lechien, Bianca M. Georgescu, Stephane Hans, Carlos M. Chiesa-Estomba

Erschienen in: European Archives of Oto-Rhino-Laryngology | Ausgabe 1/2024

Einloggen, um Zugang zu erhalten

Abstract

Objectives

To study the performance of ChatGPT in the management of laryngology and head and neck (LHN) cases.

Methods

History and clinical examination of patients consulting at the Otolaryngology-Head and Neck Surgery department were presented to ChatGPT, which was interrogated for differential diagnosis, management, and treatment. The ChatGPT performance was assessed by two blinded board-certified otolaryngologists using the following items of a composite score and the Ottawa Clinic Assessment Tool: differential diagnosis; additional examination; and treatment options. The complexity of clinical cases was evaluated with the Amsterdam Clinical Challenge Scale test.

Results

Forty clinical cases were submitted to ChatGPT, accounting for 14 (35%), 12 (30%), and 14 (35%) easy, moderate and difficult cases, respectively. ChatGPT indicated a significant higher number of additional examinations compared to practitioners (p = 0.001). There was a significant agreement between practitioners and ChatGPT for the indication of some common examinations (audiometry, ultrasonography, biopsy, gastrointestinal endoscopy or videofluoroscopy). ChatGPT never indicated some important additional examinations (PET–CT, voice quality assessment, or impedance-pH monitoring). ChatGPT reported highest performance in the proposition of the primary (90%) or the most plausible differential diagnoses (65%), and the therapeutic options (60–68%). The ChatGPT performance in the indication of additional examinations was lowest.

Conclusions

ChatGPT is a promising adjunctive tool in LHN practice, providing extensive documentation about disease-related additional examinations, differential diagnoses, and treatments. The ChatGPT is more efficient in diagnosis and treatment, rather than in the selection of the most adequate additional examination.

Nur mit Berechtigung zugänglich

Pernencar C, Saboia I, Dias JC (2022) How far can conversational agents contribute to IBD patient health care—a review of the literature. Front Public Health 10:862432. https://doi.org/10.3389/fpubh.2022.862432CrossRefPubMedPubMedCentral

Hill-Yardin EL, Hutchinson MR, Laycock R, Spencer SJ (2023) A Chat(GPT) about the future of scientific publishing. Brain Behav Immun 110:152–154. https://doi.org/10.1016/j.bbi.2023.02.022CrossRefPubMed

Choi JH, Hickman KE, Monahan A, Schwarcz D (2023) ChatGPT goes to law school? Minnesota Legal Studies Research Paper No. 23-03

Gupta R, Park JB, Bisht C, Herzog I, Weisberger J, Chao J, Chaiyasate K, Lee ES (2023) Expanding cosmetic plastic surgery research using ChatGPT. Aesthet Surg J. https://doi.org/10.1093/asj/sjad069CrossRefPubMedPubMedCentral

Salvagno M, Taccone FS, Gerli AG (2023) Can artificial intelligence help for scientific writing? Crit Care 27(1):75. https://doi.org/10.1186/s13054-023-04380-2CrossRefPubMedPubMedCentral

Gercama AJ, de Haan M, van der Vleuten CPM (2000) Reliability of the Amsterdam Clinical Challenge Scale (ACCS): a new instrument to assess the level of difficulty of patient cases in medical education. Med Educ 34(7):519–524CrossRefPubMed

Braun LT, Lenzer B, Fischer MR, Schmidmaier R (2019) Complexity of clinical cases in simulated learning environments: proposalfor a scoring system. GMS J Med Educ. 36(6):Doc80. https://doi.org/10.3205/zma001288CrossRefPubMedPubMedCentral

Rekman J, Hamstra SJ, Dudek N, Wood T, Seabrook C, Gofton W (2016) A new instrument for assessing resident competence in surgical clinic: the ottawa clinic assessment tool. J Surg Educ 73(4):575–582. https://doi.org/10.1016/j.jsurg.2016.02.003CrossRefPubMed

https://futureoflife.org/open-letter/pause-giant-ai-experiments/

10.

Fine B, Dhanoa D (2014) Imaging appropriateness criteria: why Canadian family physicians should care. Can Fam Physician 60(3):217–218PubMedPubMedCentral

11.

Kang SK, Gold HT (2023) How to perform economic evaluation in implementation studies: imaging-specific considerations and comparison of financial models. J Am Coll Radiol 20(3):292–298. https://doi.org/10.1016/j.jacr.2022.11.018CrossRefPubMed

12.

Hellings PW, Fokkens WJ, Orlandi R, Adriaensen GF, Alobid I, Baroody FM et al (2023) The EUFOREA pocket guide for chronic rhinosinusitis. Rhinology 61(1):85–89. https://doi.org/10.4193/Rhin22.344CrossRefPubMed

13.

Yoshiyasu Y, Wu F, Dhanda AK, Gorelik D, Takashima M, Ahmed OG (2023) GPT-4 accuracy and completeness against international consensus statement on allergy and rhinology: rhinosinusitis. Int Forum Allergy Rhinol. https://doi.org/10.1002/alr.23201CrossRefPubMed

14.

Dejonckere PH, Bradley P, Clemente P, Cornut G, Crevier-Buchman L, Friedrich G, Van De Heyning P, Remacle M, Woisard V, Committee on Phoniatrics of the European Laryngological Society (ELS) (2001) A basic protocol for functional assessment of voice pathology, especially for investigating the efficacy of (phonosurgical) treatments and evaluating new assessment techniques. Guideline elaborated by the Committee on Phoniatrics of the European Laryngological Society (ELS). Eur Arch Otorhinolaryngol 258(2):77–82. https://doi.org/10.1007/s004050000299CrossRefPubMed

15.

Stachler RJ, Francis DO, Schwartz SR, Damask CC, Digoy GP, Krouse HJ, McCoy SJ, Ouellette DR, Patel RR, Reavis CCW, Smith LJ, Smith M, Strode SW, Woo P, Nnacheta LC (2018) Clinical practice guideline: hoarseness (dysphonia) (update). Otolaryngol Head Neck Surg 158(1 suppl):S1–S42. https://doi.org/10.1177/0194599817751030CrossRefPubMed

16.

Stuck BA, Beule A, Damm M, Gudziol H, Hüttenbrink KB, Landis BN, Renner B, Sommer JU, Uecker FC, Vent J, Hummel T, Committee on Olfaction and Gustation of the German Society of Otorhinolaryngology, Head and Neck Surgery (2014) Position paper “chemosensory testing for expert opinion in smell disorders.” Laryngorhinootologie 93(5):327–329. https://doi.org/10.1055/s-0033-1364034CrossRefPubMed

17.

Lechien JR, Vaezi MF, Chan WW, Allen J, Karkos PD, Saussez S, Altman K, Amin MR, Ayad T, Barillari MR et al. (2023) The Dubai definition and diagnostic criteria of laryngopharyngeal reflux: the IFOS Consensus. Laryngoscope

18.

Chiesa-Estomba CM, Lechien JR, Vaira LA, Brunet A, Cammaroto G, Mayo-Yanez M, Sanchez-Barrueco A, Saga-Gutierrez C (2023) Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information support. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-023-08104-8CrossRefPubMed

19.

Hoch CC, Wollenberg B, Lüers JC, Knoedler S, Knoedler L, Frank K, Cotofana S, Alfertshofer M (2023) ChatGPT’s quiz skills in different otolaryngology subspecialties: an analysis of 2576 single-choice and multiple-choice board certification preparation questions. Eur Arch Otorhinolaryngol. https://doi.org/10.1007/s00405-023-08051-4CrossRefPubMedPubMedCentral

20.

Millstein J, Agarwal A (2023) What can doctors and patients do with ChatGPT? | Expert Opinion. Philadelphia Inquirer

21.

Chaix B, Bibault JE, Pienkowski A, Delamon G, Guillemassé A, Nectoux P, Brouard B (2019) When chatbots meet patients: one-year prospective study of conversations between patients with breast cancer and a chatbot. JMIR Cancer 5(1):e12856. https://doi.org/10.2196/12856CrossRefPubMedPubMedCentral

Titel: ChatGPT performance in laryngology and head and neck surgery: a clinical case-series
verfasst von: Jerome R. Lechien
Bianca M. Georgescu
Stephane Hans
Carlos M. Chiesa-Estomba
Publikationsdatum: 24.10.2023
Verlag: Springer Berlin Heidelberg
Erschienen in: European Archives of Oto-Rhino-Laryngology / Ausgabe 1/2024
Print ISSN: 0937-4477
Elektronische ISSN: 1434-4726
DOI: https://doi.org/10.1007/s00405-023-08282-5

Neu im Fachgebiet HNO

Betalaktam-Allergie: praxisnahes Vorgehen beim Delabeling

16.05.2024 Pädiatrische Allergologie Nachrichten

Die große Mehrheit der vermeintlichen Penicillinallergien sind keine. Da das „Etikett“ Betalaktam-Allergie oft schon in der Kindheit erworben wird, kann ein frühzeitiges Delabeling lebenslange Vorteile bringen. Ein Team von Pädiaterinnen und Pädiatern aus Kanada stellt vor, wie sie dabei vorgehen.

Eingreifen von Umstehenden rettet vor Erstickungstod

15.05.2024 Fremdkörperaspiration Nachrichten

Wer sich an einem Essensrest verschluckt und um Luft ringt, benötigt vor allem rasche Hilfe. Dass Umstehende nur in jedem zweiten Erstickungsnotfall bereit waren, diese zu leisten, ist das ernüchternde Ergebnis einer Beobachtungsstudie aus Japan. Doch es gibt auch eine gute Nachricht.

Real-World-Daten sprechen eher für Dupilumab als für Op.

14.05.2024 Rhinosinusitis Nachrichten

Zur Behandlung schwerer Formen der chronischen Rhinosinusitis mit Nasenpolypen (CRSwNP) stehen seit Kurzem verschiedene Behandlungsmethoden zur Verfügung, darunter Biologika, wie Dupilumab, und die endoskopische Sinuschirurgie (ESS). Beim Vergleich der beiden Therapieoptionen war Dupilumab leicht im Vorteil.

Schwindelursache: Massagepistole lässt Otholiten tanzen

14.05.2024 Benigner Lagerungsschwindel Nachrichten

Wenn jüngere Menschen über ständig rezidivierenden Lagerungsschwindel klagen, könnte eine Massagepistole der Auslöser sein. In JAMA Otolaryngology warnt ein Team vor der Anwendung hochpotenter Geräte im Bereich des Nackens.

Update HNO

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert – ganz bequem per eMail.

Newsletter bestellen

Springer Medizin

Abstract

Objectives

Methods

Results

Conclusions

Bitte loggen Sie sich ein, um Zugang zu diesem Inhalt zu erhalten

Weitere Artikel der Ausgabe 1/2024

Management of patients with chronic rhinosinusitis with nasal polyps in Spain: learnings from a nationwide survey of otorhinolaryngologists

Exploring the anti-inflammatory potential of topical hyaluronic acid for vocal fold injury in a rat model

Comments on “A randomized controlled study evaluating the head-lift exercise in head and neck cancer patients with radiation-induced dysphagia: effect on swallowing function and health-related quality of life over 12 months”

Endoscopic trans-sphenoidal pituitary surgery does not impact postoperative nasal quality of life

Correction: The influence of intraoperative auditory brainstem responses on vibroplasty coupling-quality and analysis of the impact of different fixation steps on the coupling

Treatment efficacy of 532-nm diode laser glottoplasty in patients with sulcus vocalis: a prospective study