Skip to main content
Erschienen in: World Journal of Surgery 2/2014

01.02.2014

An Objective Evaluation of a Multi-Component, Competitive, Selection Process for Admitting Surgeons into Higher Surgical Training in a National Setting

verfasst von: Anthony G. Gallagher, Gerald C. O’Sullivan, Paul C. Neary, Sean M. Carroll, Gerald Leonard, Brendan P. Bunting, Oscar Traynor

Erschienen in: World Journal of Surgery | Ausgabe 2/2014

Einloggen, um Zugang zu erhalten

Abstract

Background

Changing work practices make it imperative that surgery selects candidates for training who demonstrate the spectrum of abilities that best facilitate learning and development of attributes that, by the end of their training, approximate the characteristics of a consultant surgeon.

Aims

The aim of our study was to determine the relative merits of components of a program used for competitive selection of trainees into higher surgical training (HST) in general surgery.

Methods

Applicants (N = 98, males 69, mean age 31 years [range 29–40]) to the Royal College of Surgeons in Ireland program for HST in general surgery between 2006 and 2008 were assessed. Clinical, basic surgical training, logbook, research performance, and reference scores were evaluated. A total of 51 candidates were shortlisted and completed a further objective assessment of their technical skills and interview performances.

Results

Shortlisted candidates performed better (p < 0.003) on all assessed parameters. Compared with candidates who were not selected for HST, those who were selected (N = 31) significantly outperformed on individual assessments and overall (p < 0.0001). Logistic regression analysis showed that clinical, technical skills, and research assessments, but not interview, predicted (92.2 %) HST selection outcomes.

Conclusions

Candidates selected for the national HST program in Ireland consistently outperformed those who were not. The assessments reliably and consistently distinguished between candidates, and all of the assessed parameters (except interview) contributed to a highly predictive selection model. This is the largest reported dataset from an objective, transparent, and fair assessment program for selection of the next generation of surgeons.
Literatur
1.
Zurück zum Zitat Gallagher AG, O’Sullivan GC (2011) Fundamentals of surgical simulation: principles and practices. Springer, London Gallagher AG, O’Sullivan GC (2011) Fundamentals of surgical simulation: principles and practices. Springer, London
2.
Zurück zum Zitat Bell RH Jr, Biester TW, Tabuenca A et al (2009) Operative experience of residents in US general surgery programs: a gap between expectation and experience. Ann Surg 249:719–724PubMedCrossRef Bell RH Jr, Biester TW, Tabuenca A et al (2009) Operative experience of residents in US general surgery programs: a gap between expectation and experience. Ann Surg 249:719–724PubMedCrossRef
3.
Zurück zum Zitat Pellegrini CA (2006) Surgical education in the United States: navigating the white waters. Ann Surg 244:335–342PubMedCrossRef Pellegrini CA (2006) Surgical education in the United States: navigating the white waters. Ann Surg 244:335–342PubMedCrossRef
4.
Zurück zum Zitat Darzi A, Smith S, Taffinder N (1999) Assessing operative skill. Needs to become more objective. BMJ 318(7188):887–888PubMedCrossRef Darzi A, Smith S, Taffinder N (1999) Assessing operative skill. Needs to become more objective. BMJ 318(7188):887–888PubMedCrossRef
5.
Zurück zum Zitat Beall DP (1999) The ACGME institutional requirements: what residents need to know. JAMA 281:2352CrossRef Beall DP (1999) The ACGME institutional requirements: what residents need to know. JAMA 281:2352CrossRef
6.
Zurück zum Zitat Pickersgill T (2001) The European working time directive for doctors in training. BMJ 323:1266PubMedCrossRef Pickersgill T (2001) The European working time directive for doctors in training. BMJ 323:1266PubMedCrossRef
7.
Zurück zum Zitat Bulstrode C, Pearson C, Hunt V (1998) Appointing doctors. Skills Unit Oxford, Oxford Bulstrode C, Pearson C, Hunt V (1998) Appointing doctors. Skills Unit Oxford, Oxford
8.
9.
Zurück zum Zitat Morris PJ (2003) Postgraduate medical education and training board (PMETB). Bull R Coll Surg Engl 85(5):148–151CrossRef Morris PJ (2003) Postgraduate medical education and training board (PMETB). Bull R Coll Surg Engl 85(5):148–151CrossRef
10.
Zurück zum Zitat Cuschieri A (1995) Whither minimal access surgery: tribulations and expectations. Am J Surg 169:9–19PubMedCrossRef Cuschieri A (1995) Whither minimal access surgery: tribulations and expectations. Am J Surg 169:9–19PubMedCrossRef
11.
Zurück zum Zitat Gallagher AG, Smith CD, Bowers SP et al (2003) Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures. J Am Coll Surg 197:479–488PubMedCrossRef Gallagher AG, Smith CD, Bowers SP et al (2003) Psychomotor skills assessment in practicing surgeons experienced in performing advanced laparoscopic procedures. J Am Coll Surg 197:479–488PubMedCrossRef
12.
Zurück zum Zitat Chipman JG, Schmitz CC (2009) Using objective structured assessment of technical skills to evaluate a basic skills simulation curriculum for first-year surgical residents. J Am Coll Surg 209(364–370):e362 Chipman JG, Schmitz CC (2009) Using objective structured assessment of technical skills to evaluate a basic skills simulation curriculum for first-year surgical residents. J Am Coll Surg 209(364–370):e362
13.
Zurück zum Zitat Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296PubMedCentralPubMed Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296PubMedCentralPubMed
14.
Zurück zum Zitat Gallagher AG, Lederman AB, McGlade K et al (2004) Discriminative validity of the minimally invasive surgical trainer in virtual reality (MIST-VR) using criteria levels based on expert performance. Surg Endosc 18:660–665PubMedCrossRef Gallagher AG, Lederman AB, McGlade K et al (2004) Discriminative validity of the minimally invasive surgical trainer in virtual reality (MIST-VR) using criteria levels based on expert performance. Surg Endosc 18:660–665PubMedCrossRef
15.
Zurück zum Zitat Peters JH, Fried GM, Swanstrom LL et al (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27PubMedCrossRef Peters JH, Fried GM, Swanstrom LL et al (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27PubMedCrossRef
16.
Zurück zum Zitat Gallagher AG, Neary P, Gillen P et al (2008) Novel method for assessment and selection of trainees for higher surgical training in general surgery. Aust N Z J Surg 78:282–290CrossRef Gallagher AG, Neary P, Gillen P et al (2008) Novel method for assessment and selection of trainees for higher surgical training in general surgery. Aust N Z J Surg 78:282–290CrossRef
17.
Zurück zum Zitat Carroll SM, Kennedy AM, Traynor O et al (2009) Objective assessment of surgical performance and its impact on a national selection programme of candidates for higher surgical training in plastic surgery. J Plast Reconstr Aesthet Surg 62:1543–1549PubMedCrossRef Carroll SM, Kennedy AM, Traynor O et al (2009) Objective assessment of surgical performance and its impact on a national selection programme of candidates for higher surgical training in plastic surgery. J Plast Reconstr Aesthet Surg 62:1543–1549PubMedCrossRef
18.
Zurück zum Zitat Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef Gallagher AG, Ritter EM, Satava RM (2003) Fundamental principles of validation, and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef
19.
Zurück zum Zitat Irish Surgical Postgraduate Training Committee (2011). Standardised selection process for higher surgical training: guide to the marking system (B). Royal College of Surgeons in Ireland Irish Surgical Postgraduate Training Committee (2011). Standardised selection process for higher surgical training: guide to the marking system (B). Royal College of Surgeons in Ireland
20.
Zurück zum Zitat Halsted WS (1904) The training of the surgeon. Bull Johns Hopkins Hosp xv:267–275 Halsted WS (1904) The training of the surgeon. Bull Johns Hopkins Hosp xv:267–275
21.
22.
Zurück zum Zitat Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef Martin JA, Regehr G, Reznick R et al (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84:273–278PubMedCrossRef
23.
Zurück zum Zitat Gallagher AG, Satava RM (2002) Virtual reality as a metric for the assessment of laparoscopic psychomotor skills: learning curves and reliability measures. Surg Endosc 16:1746–1752PubMedCrossRef Gallagher AG, Satava RM (2002) Virtual reality as a metric for the assessment of laparoscopic psychomotor skills: learning curves and reliability measures. Surg Endosc 16:1746–1752PubMedCrossRef
24.
Zurück zum Zitat Beard JB, Marriott J, Purdie H et al (2011) Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess 15:1–162 Beard JB, Marriott J, Purdie H et al (2011) Assessing the surgical skills of trainees in the operating theatre: a prospective observational study of the methodology. Health Technol Assess 15:1–162
25.
Zurück zum Zitat Räder SB, Jørgensen E, Bech B et al (2011) Use of performance curves in estimating number of procedures required to achieve proficiency in coronary angiography. Catheter Cardiovasc Interv 78:387–393PubMed Räder SB, Jørgensen E, Bech B et al (2011) Use of performance curves in estimating number of procedures required to achieve proficiency in coronary angiography. Catheter Cardiovasc Interv 78:387–393PubMed
26.
Zurück zum Zitat McPhee J, Wr Robinson, Eslami M et al (2011) Surgeon case volume, not institution case volume, is the primary determinant of in-hospital mortality after elective open abdominal aortic aneurysm repair. J Vasc Surg 53:591–599PubMedCrossRef McPhee J, Wr Robinson, Eslami M et al (2011) Surgeon case volume, not institution case volume, is the primary determinant of in-hospital mortality after elective open abdominal aortic aneurysm repair. J Vasc Surg 53:591–599PubMedCrossRef
27.
28.
Zurück zum Zitat McClusky DA 3rd, Ritter EM, Lederman AB et al (2005) Correlation between perceptual, visuo-spatial, and psychomotor aptitude to duration of training required to reach performance goals on the MIST-VR surgical simulator. Am Surg 71:13–20 (discussion 20–11)PubMed McClusky DA 3rd, Ritter EM, Lederman AB et al (2005) Correlation between perceptual, visuo-spatial, and psychomotor aptitude to duration of training required to reach performance goals on the MIST-VR surgical simulator. Am Surg 71:13–20 (discussion 20–11)PubMed
29.
Zurück zum Zitat Ritter EM, McClusky DA 3rd, Gallagher AG et al (2006) Perceptual, visuospatial, and psychomotor abilities correlate with duration of training required on a virtual-reality flexible endoscopy simulator. Am J Surg 192:379–384PubMedCrossRef Ritter EM, McClusky DA 3rd, Gallagher AG et al (2006) Perceptual, visuospatial, and psychomotor abilities correlate with duration of training required on a virtual-reality flexible endoscopy simulator. Am J Surg 192:379–384PubMedCrossRef
30.
Zurück zum Zitat Conway JM, Jako RA, Goodman DF (1995) A meta-analysis of interrater and internal consistency reliability of selection interviews. J Appl Psychol 80:565–579CrossRef Conway JM, Jako RA, Goodman DF (1995) A meta-analysis of interrater and internal consistency reliability of selection interviews. J Appl Psychol 80:565–579CrossRef
31.
Zurück zum Zitat Latham GP, Saari LM, Pursell ED et al (1980) The situational interview. J Appl Psychol 65:422–442CrossRef Latham GP, Saari LM, Pursell ED et al (1980) The situational interview. J Appl Psychol 65:422–442CrossRef
32.
Zurück zum Zitat Crawford ME (2005) Commentary: reassuring evidence on competency based selection. BMJ 330:714PubMedCrossRef Crawford ME (2005) Commentary: reassuring evidence on competency based selection. BMJ 330:714PubMedCrossRef
Metadaten
Titel
An Objective Evaluation of a Multi-Component, Competitive, Selection Process for Admitting Surgeons into Higher Surgical Training in a National Setting
verfasst von
Anthony G. Gallagher
Gerald C. O’Sullivan
Paul C. Neary
Sean M. Carroll
Gerald Leonard
Brendan P. Bunting
Oscar Traynor
Publikationsdatum
01.02.2014
Verlag
Springer US
Erschienen in
World Journal of Surgery / Ausgabe 2/2014
Print ISSN: 0364-2313
Elektronische ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-013-2302-4

Weitere Artikel der Ausgabe 2/2014

World Journal of Surgery 2/2014 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.