Skip to main content
Erschienen in: Surgical Endoscopy 11/2015

01.11.2015

Computer-assessed performance of psychomotor skills in endoscopic otolaryngology surgery: construct validity of the Dundee Endoscopic Psychomotor Otolaryngology Surgery Trainer (DEPOST)

verfasst von: Peter D. Ross, Richard Steven, Dong Zhang, Heng Li, Eric W. Abel

Erschienen in: Surgical Endoscopy | Ausgabe 11/2015

Einloggen, um Zugang zu erhalten

Abstract

Background

This study was undertaken to introduce and establish the value of the Dundee Endoscopic Psychomotor Otolaryngology Surgery Trainer (DEPOST) as a customisable, objective real-time scoring system for trainee assessment. The construct validity of the system was assessed by comparing the performance of experienced otolaryngologists with that of otolaryngology trainees, junior doctors and medical students.

Methods

Forty two subjects (13 Consultants, 8 senior trainees, 13 junior trainees and 8 junior doctors/medical students) completed a single test on DEPOST. The test involved using a 30° rigid endoscope and a probe with position sensor, to identify a series of lights in a complex 3-dimensional model. The system scored subjects for time, success rate, and economy of movement (distance travelled). An analysis of variance and correlation analysis were used for the data analysis, with statistical significance set at 0.05.

Results

Increasing experience led to significantly improved performance with the DEPOST (p < 0.01). Senior trainees’ results were significantly better than those of consultant otolaryngologists in success rate and time (p < 0.05 & p < 0.05). Consultants were the most efficient in their movement (p = 0.051)

Conclusions

The system provides an accurate and customisable assessment of endoscopic skill in otolaryngologists. The DEPOST system has construct validity, with master surgeons and senior trainees completing the tasks more accurately without sacrificing execution time, success rate or efficiency of movement.
Literatur
3.
Zurück zum Zitat McGreevy JM (2005) The aviation paradigm and surgical education. J Am Coll Surg 201:110–117CrossRefPubMed McGreevy JM (2005) The aviation paradigm and surgical education. J Am Coll Surg 201:110–117CrossRefPubMed
4.
Zurück zum Zitat Tansley P, Kakar S, Withey S, Butler P (2007) Visuospatial and technical ability in the selection and assessment of higher surgical trainees in the London Deanery. Ann R Coll Surg Engl 89:591–595PubMedCentralCrossRefPubMed Tansley P, Kakar S, Withey S, Butler P (2007) Visuospatial and technical ability in the selection and assessment of higher surgical trainees in the London Deanery. Ann R Coll Surg Engl 89:591–595PubMedCentralCrossRefPubMed
5.
Zurück zum Zitat Frances NK, Hanna GB, Cuschieri A (2001) Reliability of the advanced dundee endoscopic psychomotor tester for bimanual tasks. Arch Surg 136(1):40–44CrossRef Frances NK, Hanna GB, Cuschieri A (2001) Reliability of the advanced dundee endoscopic psychomotor tester for bimanual tasks. Arch Surg 136(1):40–44CrossRef
6.
Zurück zum Zitat Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A, Fried MP (2005) Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg 131(3):217–221CrossRefPubMed Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A, Fried MP (2005) Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg 131(3):217–221CrossRefPubMed
7.
Zurück zum Zitat Weghorst S, Airola C, Oppenheimer P, Edmond CV, Patience T, Heskamp D, Miller J (1998) Validation of the madigan ESS simulator. Stud Health Technol Inform 50:399–405PubMed Weghorst S, Airola C, Oppenheimer P, Edmond CV, Patience T, Heskamp D, Miller J (1998) Validation of the madigan ESS simulator. Stud Health Technol Inform 50:399–405PubMed
8.
Zurück zum Zitat Hanna GB, Drew T, Clinch P, Hunter B, Shimi S, Dunkley MP, Cuschieri A (1996) A microrpocessor-controlled psychomotor tester for minimal access surgery. Surg Endoscopy 10:965–969CrossRef Hanna GB, Drew T, Clinch P, Hunter B, Shimi S, Dunkley MP, Cuschieri A (1996) A microrpocessor-controlled psychomotor tester for minimal access surgery. Surg Endoscopy 10:965–969CrossRef
9.
Zurück zum Zitat Francis NK, Hanna GB, Cuschieri A (2002) The performance of master surgeons on the advanced dundee endoscopic psychomotor tester. Contrast validity study. Arch Surg 137(7):841–844CrossRefPubMed Francis NK, Hanna GB, Cuschieri A (2002) The performance of master surgeons on the advanced dundee endoscopic psychomotor tester. Contrast validity study. Arch Surg 137(7):841–844CrossRefPubMed
10.
Zurück zum Zitat Macmillan AIM, Cuschieri A (1999) Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. Am J Surg 177(3):274–277CrossRefPubMed Macmillan AIM, Cuschieri A (1999) Assessment of innate ability and skills for endoscopic manipulations by the Advanced Dundee Endoscopic Psychomotor Tester: predictive and concurrent validity. Am J Surg 177(3):274–277CrossRefPubMed
11.
Zurück zum Zitat Schijven MP, Jakimowicz J, Schot C (2002) The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance. Surg Endosc 16(6):943–948CrossRefPubMed Schijven MP, Jakimowicz J, Schot C (2002) The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance. Surg Endosc 16(6):943–948CrossRefPubMed
12.
Zurück zum Zitat Breatnach E, Abbott GC, Fraser RG (1984) Dimensions of the normal human trachea. Am J Roentgenol 141:903–906CrossRef Breatnach E, Abbott GC, Fraser RG (1984) Dimensions of the normal human trachea. Am J Roentgenol 141:903–906CrossRef
13.
Zurück zum Zitat Meskers CGM, Fraterman H, van der Helm FC, Vermeulen HM, Rozing PM (1999) Calibration of the “Flock of Birds’’ electromagnetic tracking device. J Biomech 32:629–633CrossRefPubMed Meskers CGM, Fraterman H, van der Helm FC, Vermeulen HM, Rozing PM (1999) Calibration of the “Flock of Birds’’ electromagnetic tracking device. J Biomech 32:629–633CrossRefPubMed
14.
Zurück zum Zitat Ramsey PG, Carline JD, Inui TS, Larson EB, LoGerfo JP, Norcini JJ, Wenrich MD (1991) Changes over time in the knowledge base of practicing internists. JAMA 266:1103–1107CrossRefPubMed Ramsey PG, Carline JD, Inui TS, Larson EB, LoGerfo JP, Norcini JJ, Wenrich MD (1991) Changes over time in the knowledge base of practicing internists. JAMA 266:1103–1107CrossRefPubMed
15.
Zurück zum Zitat Stolley PD, Becker MH, Lasagna L, McEvilla JD, Sloane LM (1972) The relationship between physician characteristics and prescribing appropriateness. Med Care 10:17–28CrossRefPubMed Stolley PD, Becker MH, Lasagna L, McEvilla JD, Sloane LM (1972) The relationship between physician characteristics and prescribing appropriateness. Med Care 10:17–28CrossRefPubMed
16.
Zurück zum Zitat Waljee JF, Greenfield LJ, Dimick JB, Birkmeyer JD (2006) Surgeon age and operative mortality in the United States. Ann Surg 244(3):353–362PubMedCentralPubMed Waljee JF, Greenfield LJ, Dimick JB, Birkmeyer JD (2006) Surgeon age and operative mortality in the United States. Ann Surg 244(3):353–362PubMedCentralPubMed
17.
Zurück zum Zitat Duclos A, Peix J, Colin C, Kraimps J, Menegaux F, Pattou F (2012) Influence of experience on performance of individual surgeons in thyroid surgery: prospective cross sectional multicentre study. BMJ 34:344 Duclos A, Peix J, Colin C, Kraimps J, Menegaux F, Pattou F (2012) Influence of experience on performance of individual surgeons in thyroid surgery: prospective cross sectional multicentre study. BMJ 34:344
18.
Zurück zum Zitat Abel EW, Zhuo Y, Ross PD, White PS (2013) Automatic glare removal in endoscopic imaging. Surg Endosc 28(2):584–591CrossRefPubMed Abel EW, Zhuo Y, Ross PD, White PS (2013) Automatic glare removal in endoscopic imaging. Surg Endosc 28(2):584–591CrossRefPubMed
19.
Zurück zum Zitat White PS, Nassif R, Saleh H, Drew T (2004) Pilot study of a device for measuring instrument forces during endoscopic sinus surgery. Acta Otolaryngol 124(2):176–178CrossRefPubMed White PS, Nassif R, Saleh H, Drew T (2004) Pilot study of a device for measuring instrument forces during endoscopic sinus surgery. Acta Otolaryngol 124(2):176–178CrossRefPubMed
20.
Zurück zum Zitat Joice P, Ross PD, Wang D, Abel EW, White PS (2012) Measurement of osteotomy force during endoscopic sinus surgery. Allergy Rhinol (Providence) 3(2):e61–e65CrossRef Joice P, Ross PD, Wang D, Abel EW, White PS (2012) Measurement of osteotomy force during endoscopic sinus surgery. Allergy Rhinol (Providence) 3(2):e61–e65CrossRef
21.
Zurück zum Zitat Ross PD, Joice P, Nassif RG, White PS (2010) Surgical instrument force exerted during endoscopic sinus surgery: differences within the ethmoid sinus complex. Am J Rhinol Allergy 24(1):76–80CrossRefPubMed Ross PD, Joice P, Nassif RG, White PS (2010) Surgical instrument force exerted during endoscopic sinus surgery: differences within the ethmoid sinus complex. Am J Rhinol Allergy 24(1):76–80CrossRefPubMed
22.
Zurück zum Zitat Sheedy MB, Bergin M, Wylie G, Ross P, Dove R, Bird P (2012) Development of a surgical instrument for measuring forces applied to the ossicles of the middle ear. Aust Phys Eng Sci Med 35(4):503–510CrossRef Sheedy MB, Bergin M, Wylie G, Ross P, Dove R, Bird P (2012) Development of a surgical instrument for measuring forces applied to the ossicles of the middle ear. Aust Phys Eng Sci Med 35(4):503–510CrossRef
Metadaten
Titel
Computer-assessed performance of psychomotor skills in endoscopic otolaryngology surgery: construct validity of the Dundee Endoscopic Psychomotor Otolaryngology Surgery Trainer (DEPOST)
verfasst von
Peter D. Ross
Richard Steven
Dong Zhang
Heng Li
Eric W. Abel
Publikationsdatum
01.11.2015
Verlag
Springer US
Erschienen in
Surgical Endoscopy / Ausgabe 11/2015
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-014-4036-2

Weitere Artikel der Ausgabe 11/2015

Surgical Endoscopy 11/2015 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.