Skip to main content
Erschienen in: European Archives of Oto-Rhino-Laryngology 5/2018

13.02.2018 | Miscellaneous

Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology

verfasst von: Jacob Melchiors, Mikael Johannes Vuokko Henriksen, Frederik G. Dikkers, Javier Gavilán, J. Pieter Noordzij, Marvin P. Fried, Daniel Novakovic, Johannes Fagan, Birgitte W. Charabi, Lars Konge, Christian von Buchwald

Erschienen in: European Archives of Oto-Rhino-Laryngology | Ausgabe 5/2018

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Proper training and assessment of skill in flexible pharyngo-laryngoscopy are central in the education of otorhinolaryngologists. To facilitate an evidence-based approach to curriculum development in this field, a structured analysis of what constitutes flexible pharyngo-laryngoscopy is necessary. Our aim was to develop an assessment tool based on this analysis.

Methods

We conducted an international Delphi study involving experts from twelve countries in five continents. Utilizing reiterative assessment, the panel defined the procedure and reached consensus (defined as 80% agreement) on the phrasing of an assessment tool.

Results

Fifty panelists completed the Delphi process. The median age of the panelists was 44 years (range 33–64 years). Median experience in otorhinolaryngology was 15 years (range 6–35 years). Twenty-five were specialized in laryngology, 16 were head and neck surgeons, and nine were general otorhinolaryngologists. An assessment tool was created consisting of twelve distinct items.

Conclusion
The gathering of validity evidence for assessment of core procedural skills within Otorhinolaryngology is central to the development of a competence-based education. The use of an international Delphi panel allows for the creation of an assessment tool which is widely applicable and valid. This work allows for an informed approach to technical skills training for flexible pharyngo-laryngoscopy and as further validity evidence is gathered allows for a valid assessment of clinical performance within this important skillset.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Garcia M (1854) Observations on the human voice. Proc R Soc Lond 7:399–410CrossRef Garcia M (1854) Observations on the human voice. Proc R Soc Lond 7:399–410CrossRef
3.
Zurück zum Zitat Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gray ST, Shrime MG et al (2014) Subspecialty emergency room as alternative model for otolaryngologic care: implications for emergency health care delivery. Am J Otolaryngol Head Neck Surg 35:758–765 Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gray ST, Shrime MG et al (2014) Subspecialty emergency room as alternative model for otolaryngologic care: implications for emergency health care delivery. Am J Otolaryngol Head Neck Surg 35:758–765
4.
Zurück zum Zitat Couch ME (2010) Cummings otolaryngology—head and neck surgery, Fifth Edit. Cummings Otolaryngology Head and Neck Surgery. Copyright © 2010, 2005, 1998, 1993, 1986 by Mosby, Inc. All Rights Reserved, pp 93–107 Couch ME (2010) Cummings otolaryngology—head and neck surgery, Fifth Edit. Cummings Otolaryngology Head and Neck Surgery. Copyright © 2010, 2005, 1998, 1993, 1986 by Mosby, Inc. All Rights Reserved, pp 93–107
5.
Zurück zum Zitat Paul BC, Rafii B, Achlatis S, Amin MR, Branski RC (2012) Morbidity and patient perception of flexible laryngoscopy. Ann Otol Rhinol Laryngol 121(11):708–713CrossRefPubMed Paul BC, Rafii B, Achlatis S, Amin MR, Branski RC (2012) Morbidity and patient perception of flexible laryngoscopy. Ann Otol Rhinol Laryngol 121(11):708–713CrossRefPubMed
6.
Zurück zum Zitat Ongkasuwan J, Yung KC, Courey MS (2012) The physiologic impact of transnasal flexible endoscopy. Laryngoscope 122(6):1331–1334CrossRefPubMed Ongkasuwan J, Yung KC, Courey MS (2012) The physiologic impact of transnasal flexible endoscopy. Laryngoscope 122(6):1331–1334CrossRefPubMed
7.
Zurück zum Zitat Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gliklich RE, Shrime MG et al (2015) Otolaryngology-specific emergency room as a model for resident training. Laryngoscope 125(1):99–104CrossRefPubMed Sethi RKV, Kozin ED, Remenschneider AK, Lee DJ, Gliklich RE, Shrime MG et al (2015) Otolaryngology-specific emergency room as a model for resident training. Laryngoscope 125(1):99–104CrossRefPubMed
9.
Zurück zum Zitat Nasca TJ, Philibert I, Brigham T, Flynn TC (2012) The next GME accreditation system—rationale and benefits. N Engl J Med 366(11):1051–1056CrossRefPubMed Nasca TJ, Philibert I, Brigham T, Flynn TC (2012) The next GME accreditation system—rationale and benefits. N Engl J Med 366(11):1051–1056CrossRefPubMed
10.
11.
Zurück zum Zitat Ghaderi I, Manji F, Park YS, Juul D, Ott M, Harris I et al (2015) Technical skills assessment toolbox. Ann Surg 261(2):251–262CrossRefPubMed Ghaderi I, Manji F, Park YS, Juul D, Ott M, Harris I et al (2015) Technical skills assessment toolbox. Ann Surg 261(2):251–262CrossRefPubMed
12.
Zurück zum Zitat Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(22):741–749CrossRef Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(22):741–749CrossRef
13.
Zurück zum Zitat Cook D, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119(2):166.e7–166.e16CrossRef Cook D, Beckman TJ (2006) Current concepts in validity and reliability for psychometric instruments: theory and application. Am J Med 119(2):166.e7–166.e16CrossRef
14.
Zurück zum Zitat Stefanidis D, Arora S, Parrack DM, Hamad GG, Capella J, Grantcharov T et al (2012) Research priorities in surgical simulation for the 21st century. Am J Surg 203(1):49–53CrossRefPubMedPubMedCentral Stefanidis D, Arora S, Parrack DM, Hamad GG, Capella J, Grantcharov T et al (2012) Research priorities in surgical simulation for the 21st century. Am J Surg 203(1):49–53CrossRefPubMedPubMedCentral
15.
Zurück zum Zitat Robinson HF, Dennick R (2015) Teaching laryngeal endoscopy skills to speech and language therapists. Curr Opin Otolaryngol Head Neck Surg 23(3):197–201CrossRefPubMed Robinson HF, Dennick R (2015) Teaching laryngeal endoscopy skills to speech and language therapists. Curr Opin Otolaryngol Head Neck Surg 23(3):197–201CrossRefPubMed
16.
Zurück zum Zitat Herrmann IF, Domagk D, Strahl M, Arens C (2016) The transnasal videopanendoscopy (ViP): diagnostics of the upper aerodigestive tract using an anatomically correct model from the model to the patient. Eur Arch Otorhinolaryngol 273(3):749–754CrossRefPubMed Herrmann IF, Domagk D, Strahl M, Arens C (2016) The transnasal videopanendoscopy (ViP): diagnostics of the upper aerodigestive tract using an anatomically correct model from the model to the patient. Eur Arch Otorhinolaryngol 273(3):749–754CrossRefPubMed
17.
Zurück zum Zitat Laeeq K, Pandian V, Skinner M, Masood H, Stewart CM, Weatherly R et al (2010) Learning curve for competency in flexible laryngoscopy. Laryngoscope. 120(10):1950–1953CrossRefPubMed Laeeq K, Pandian V, Skinner M, Masood H, Stewart CM, Weatherly R et al (2010) Learning curve for competency in flexible laryngoscopy. Laryngoscope. 120(10):1950–1953CrossRefPubMed
18.
Zurück zum Zitat Brook CD, Platt MP, Russell K, Grillone G, Aliphas A, Noordzij JP (2015) Time to competency, reliability of flexible transnasal laryngoscopy by training level: A Pilot Study. Otolaryngol Head Neck Surg 152(5):843–850CrossRefPubMed Brook CD, Platt MP, Russell K, Grillone G, Aliphas A, Noordzij JP (2015) Time to competency, reliability of flexible transnasal laryngoscopy by training level: A Pilot Study. Otolaryngol Head Neck Surg 152(5):843–850CrossRefPubMed
19.
Zurück zum Zitat Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Inf Manag 42(1):15–29CrossRef Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Inf Manag 42(1):15–29CrossRef
20.
Zurück zum Zitat de Villiers MR, de Villiers PJT, Kent AP (2005) The Delphi technique in health sciences education research. Med Teach 27(7):639–643CrossRefPubMed de Villiers MR, de Villiers PJT, Kent AP (2005) The Delphi technique in health sciences education research. Med Teach 27(7):639–643CrossRefPubMed
21.
Zurück zum Zitat Murry JW, Hammons JO. Delphi (1995) A versatile methodology for conducting qualitative research. Rev High Educ 18(4):423–436CrossRef Murry JW, Hammons JO. Delphi (1995) A versatile methodology for conducting qualitative research. Rev High Educ 18(4):423–436CrossRef
22.
Zurück zum Zitat Keeney S, Hasson F, McKenna H (2006) Consulting the Oracle: ten lessons from using the Delphi techniques in nursing research. J Adv Nurs 53(2):205–212CrossRefPubMed Keeney S, Hasson F, McKenna H (2006) Consulting the Oracle: ten lessons from using the Delphi techniques in nursing research. J Adv Nurs 53(2):205–212CrossRefPubMed
23.
Zurück zum Zitat Streiner DL, Norman GR, Cairney J (2015) Health measurement scales, vol 9. Oxford University Press, OxfordCrossRef Streiner DL, Norman GR, Cairney J (2015) Health measurement scales, vol 9. Oxford University Press, OxfordCrossRef
24.
Zurück zum Zitat Walsh CM, Ling SC, Khanna N, Cooper MA, Grover SC, May G et al (2014) Gastrointestinal endoscopy competency assessment tool: development of a procedure-specific assessment tool for colonoscopy. Gastrointest Endosc 79(5):798–807.e5CrossRefPubMed Walsh CM, Ling SC, Khanna N, Cooper MA, Grover SC, May G et al (2014) Gastrointestinal endoscopy competency assessment tool: development of a procedure-specific assessment tool for colonoscopy. Gastrointest Endosc 79(5):798–807.e5CrossRefPubMed
25.
Zurück zum Zitat Madani A, Watanabe Y, Vassiliou M, Feldman LS, Duh QY, Singer MC et al (2016) Defining competencies for safe thyroidectomy: an international Delphi consensus. Surg (United States) 159(1):86–101 Madani A, Watanabe Y, Vassiliou M, Feldman LS, Duh QY, Singer MC et al (2016) Defining competencies for safe thyroidectomy: an international Delphi consensus. Surg (United States) 159(1):86–101
26.
Zurück zum Zitat Maertens H, Aggarwal R, Macdonald S, Vermassen F, Van Herzeele I, Brodmann M et al (2016) Transatlantic multispecialty consensus on fundamental endovascular skills: results of a Delphi Consensus Study. Eur J Vasc Endovasc Surg 51(1):141–149CrossRefPubMed Maertens H, Aggarwal R, Macdonald S, Vermassen F, Van Herzeele I, Brodmann M et al (2016) Transatlantic multispecialty consensus on fundamental endovascular skills: results of a Delphi Consensus Study. Eur J Vasc Endovasc Surg 51(1):141–149CrossRefPubMed
27.
Zurück zum Zitat Downing S, Yudkowsky R (2009) Assessment in health professions education. Routledge, New York Downing S, Yudkowsky R (2009) Assessment in health professions education. Routledge, New York
28.
Zurück zum Zitat Ilgen JS, Ma IWY, Hatala R, Cook D (2015) A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ 49:161–173CrossRefPubMed Ilgen JS, Ma IWY, Hatala R, Cook D (2015) A systematic review of validity evidence for checklists versus global rating scales in simulation-based assessment. Med Educ 49:161–173CrossRefPubMed
31.
Zurück zum Zitat Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9):63–67CrossRef Miller GE (1990) The assessment of clinical skills/competence/performance. Acad Med 65(9):63–67CrossRef
32.
Zurück zum Zitat Melchiors J, Todsen T, Nilsson P, Kohl AP, Bøttger M, Charabi B et al (2016) Self-directed simulation-based training of emergency cricothyroidotomy: a route to lifesaving skills. Eur Arch Otorhinolaryngol 273(12):4623–4628CrossRefPubMed Melchiors J, Todsen T, Nilsson P, Kohl AP, Bøttger M, Charabi B et al (2016) Self-directed simulation-based training of emergency cricothyroidotomy: a route to lifesaving skills. Eur Arch Otorhinolaryngol 273(12):4623–4628CrossRefPubMed
33.
Zurück zum Zitat Mcgaghie WC (2015) Mastery learning: it is time for medical education to join the 21st Century. Acad Med 90(11):1438–1441CrossRefPubMed Mcgaghie WC (2015) Mastery learning: it is time for medical education to join the 21st Century. Acad Med 90(11):1438–1441CrossRefPubMed
34.
Zurück zum Zitat Lineberry M, Soo Park Y, Cook D, Yudkowsky R (2015) Making the case for mastery learning assessments. Acad Med 90(11):1CrossRef Lineberry M, Soo Park Y, Cook D, Yudkowsky R (2015) Making the case for mastery learning assessments. Acad Med 90(11):1CrossRef
35.
Zurück zum Zitat Melchiors J, Todsen T, Nilsson P, Wennervaldt K, Charabi B, Bøttger M et al (2015) Preparing for emergency: a valid, reliable assessment tool for emergency cricothyroidotomy skills. Otolaryngol Head Neck Surg 152(2):260–265CrossRefPubMed Melchiors J, Todsen T, Nilsson P, Wennervaldt K, Charabi B, Bøttger M et al (2015) Preparing for emergency: a valid, reliable assessment tool for emergency cricothyroidotomy skills. Otolaryngol Head Neck Surg 152(2):260–265CrossRefPubMed
Metadaten
Titel
Diagnostic flexible pharyngo-laryngoscopy: development of a procedure specific assessment tool using a Delphi methodology
verfasst von
Jacob Melchiors
Mikael Johannes Vuokko Henriksen
Frederik G. Dikkers
Javier Gavilán
J. Pieter Noordzij
Marvin P. Fried
Daniel Novakovic
Johannes Fagan
Birgitte W. Charabi
Lars Konge
Christian von Buchwald
Publikationsdatum
13.02.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
European Archives of Oto-Rhino-Laryngology / Ausgabe 5/2018
Print ISSN: 0937-4477
Elektronische ISSN: 1434-4726
DOI
https://doi.org/10.1007/s00405-018-4904-9

Weitere Artikel der Ausgabe 5/2018

European Archives of Oto-Rhino-Laryngology 5/2018 Zur Ausgabe

Update HNO

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert – ganz bequem per eMail.