Skip to main content
Erschienen in: Surgical Endoscopy 8/2020

09.06.2020 | 2020 SAGES Oral

The Fundamentals of Endoscopic Surgery (FES) skills test: factors associated with first-attempt scores and pass rate

verfasst von: Matthew Lineberry, Yoon Soo Park, Sara A. Hennessy, E. Matthew Ritter

Erschienen in: Surgical Endoscopy | Ausgabe 8/2020

Einloggen, um Zugang zu erhalten

Abstract

Background

The Fundamentals of Endoscopic Surgery (FES) program became required for American Board of Surgery certification as part of the Flexible Endoscopy Curriculum (FEC) for residents graduating in 2018. This study expands prior psychometric investigation of the FES skills test.

Methods

We analyzed de-identified first-attempt skills test scores and self-reported demographic characteristics of 2023 general surgery residents who were required to pass FES.

Results

The overall pass rate was 83%. “Loop Reduction” was the most difficult sub-task. Subtasks related to one another only modestly (Spearman’s ρ ranging from 0.11 to 0.42; coefficient α = .55). Both upper and lower endoscopic procedural experience had modest positive association with scores (ρ = 0.14 and 0.15) and passing. Examinees who tested on the GI Mentor Express simulator had lower total scores and a lower pass rate than those tested on the GI Mentor II (pass rates = 73% vs. 85%). Removing an Express-specific scoring rule that had been applied eliminated these differences.
Gender, glove size, and height were closely related. Women scored lower than men (408- vs. 489-point averages) and had a lower first-attempt pass rate (71% vs. 92%). Glove size correlated positively with score (ρ = 0.31) and pass rate. Finally, height correlated positively with score (r = 0.27) and pass rate. Statistically controlling for glove size and height did not eliminate gender differences, with men still having 3.2 times greater odds of passing.

Conclusions

FES skills test scores show both consistencies with the assessment’s validity argument and several remarkable findings. Subtasks reflect distinct skills, so passing standards should perhaps be set for each subtask. The Express simulator-specific scoring penalty should be removed. Differences seen by gender are concerning. We argue those differences do not reflect measurement bias, but rather highlight equity concerns in surgical technology, training, and practice.

Graphic abstract

Literatur
1.
Zurück zum Zitat Hazey JW, Marks JM, Mellinger JD, Trus TL, Chand B, Delaney CP et al (2014) Why Fundamentals of Endoscopic Surgery (FES)? Surg Endosc 28(3):701–703CrossRefPubMed Hazey JW, Marks JM, Mellinger JD, Trus TL, Chand B, Delaney CP et al (2014) Why Fundamentals of Endoscopic Surgery (FES)? Surg Endosc 28(3):701–703CrossRefPubMed
2.
Zurück zum Zitat Hunter JE, Hunter RF (1984) Validity and utility of alternative predictors of job performance. Psychol Bull 96(1):72–98CrossRef Hunter JE, Hunter RF (1984) Validity and utility of alternative predictors of job performance. Psychol Bull 96(1):72–98CrossRef
3.
Zurück zum Zitat Schmidt FL, Hunter JE (1998) The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol Bull 124(2):262–274CrossRef Schmidt FL, Hunter JE (1998) The validity and utility of selection methods in personnel psychology: practical and theoretical implications of 85 years of research findings. Psychol Bull 124(2):262–274CrossRef
4.
Zurück zum Zitat Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P et al (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28(3):704–711CrossRefPubMed Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P et al (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28(3):704–711CrossRefPubMed
5.
Zurück zum Zitat Mueller CL, Kaneva P, Fried GM, Feldman LS, Vassiliou MC (2014) Colonoscopy performance correlates with scores on the FESTM manual skills test. Surg Endosc 28(11):3081–3085CrossRefPubMed Mueller CL, Kaneva P, Fried GM, Feldman LS, Vassiliou MC (2014) Colonoscopy performance correlates with scores on the FESTM manual skills test. Surg Endosc 28(11):3081–3085CrossRefPubMed
6.
Zurück zum Zitat Lineberry M (2019) Validity and quality. In: Yudkowsky R, Park YS, Downing SM (eds) Assessment in health professions education, 2nd edn. Routledge, New York, pp 17–32CrossRef Lineberry M (2019) Validity and quality. In: Yudkowsky R, Park YS, Downing SM (eds) Assessment in health professions education, 2nd edn. Routledge, New York, pp 17–32CrossRef
7.
Zurück zum Zitat Sackett PR, Zedeck S, Fogli L (1988) Relations between measures of typical and maximum job performance. J Appl Psychol 73(3):482–486CrossRef Sackett PR, Zedeck S, Fogli L (1988) Relations between measures of typical and maximum job performance. J Appl Psychol 73(3):482–486CrossRef
8.
Zurück zum Zitat Stark S, Chernyshenko OS, Chan K-Y, Lee WC, Drasgow F (2001) Effects of the testing situation on item responding: cause for concern. J Appl Psychol 86(5):943–953CrossRefPubMed Stark S, Chernyshenko OS, Chan K-Y, Lee WC, Drasgow F (2001) Effects of the testing situation on item responding: cause for concern. J Appl Psychol 86(5):943–953CrossRefPubMed
9.
Zurück zum Zitat Lineberry M, Ritter EM (2017) Psychometric properties of the Fundamentals of Endoscopic Surgery (FES) skills examination. Surg Endosc 31(12):5219–5227CrossRefPubMed Lineberry M, Ritter EM (2017) Psychometric properties of the Fundamentals of Endoscopic Surgery (FES) skills examination. Surg Endosc 31(12):5219–5227CrossRefPubMed
10.
Zurück zum Zitat Mueller CL, Kaneva P, Fried GM, Mellinger JD, Marks JM, Dunkin BJ et al (2016) Validity evidence for a new portable, lower-cost platform for the fundamentals of endoscopic surgery skills test. Surg Endosc 30(3):1107–1112CrossRefPubMed Mueller CL, Kaneva P, Fried GM, Mellinger JD, Marks JM, Dunkin BJ et al (2016) Validity evidence for a new portable, lower-cost platform for the fundamentals of endoscopic surgery skills test. Surg Endosc 30(3):1107–1112CrossRefPubMed
11.
Zurück zum Zitat Stark S, Chernyshenko OS, Drasgow F (2004) Examining the effects of differential item functioning and differential test functioning on selection decisions: when are statistically significant effects practically important? J Appl Psychol 89(3):497–508CrossRefPubMed Stark S, Chernyshenko OS, Drasgow F (2004) Examining the effects of differential item functioning and differential test functioning on selection decisions: when are statistically significant effects practically important? J Appl Psychol 89(3):497–508CrossRefPubMed
12.
Zurück zum Zitat Zhuang Z, Bradtmiller B (2005) Head-and-face anthropometric survey of U.S. respirator users. J Occup Environ Hyg 2(11):567–576CrossRefPubMed Zhuang Z, Bradtmiller B (2005) Head-and-face anthropometric survey of U.S. respirator users. J Occup Environ Hyg 2(11):567–576CrossRefPubMed
13.
Zurück zum Zitat Bose D, Segui-Gomez M, Crandall JR (2011) Vulnerability of female drivers involved in motor vehicle crashes: an analysis of US population at risk. Am J Public Health 101(12):2368–2373PubMedPubMedCentralCrossRef Bose D, Segui-Gomez M, Crandall JR (2011) Vulnerability of female drivers involved in motor vehicle crashes: an analysis of US population at risk. Am J Public Health 101(12):2368–2373PubMedPubMedCentralCrossRef
14.
Zurück zum Zitat Munafo J, Diedrick M, Stoffregen TA (2017) The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 235(3):889–901CrossRefPubMed Munafo J, Diedrick M, Stoffregen TA (2017) The virtual reality head-mounted display Oculus Rift induces motion sickness and is sexist in its effects. Exp Brain Res 235(3):889–901CrossRefPubMed
15.
Zurück zum Zitat Criado PC (2019) Invisible women: data bias in a world designed for men. Abrams Press, New York Criado PC (2019) Invisible women: data bias in a world designed for men. Abrams Press, New York
16.
Zurück zum Zitat Shergill AK, McQuaid KR, Rempel D (2009) Ergonomics and GI endoscopy. Gastrointest Endosc 70(1):145–153CrossRefPubMed Shergill AK, McQuaid KR, Rempel D (2009) Ergonomics and GI endoscopy. Gastrointest Endosc 70(1):145–153CrossRefPubMed
17.
Zurück zum Zitat Cohen DL, Naik JR, Tamariz LJ, Madanick RD (2008) The perception of gastroenterology fellows towards the relationship between hand size and endoscopic training. Dig Dis Sci 53(7):1902–1909CrossRefPubMed Cohen DL, Naik JR, Tamariz LJ, Madanick RD (2008) The perception of gastroenterology fellows towards the relationship between hand size and endoscopic training. Dig Dis Sci 53(7):1902–1909CrossRefPubMed
18.
Zurück zum Zitat Austin K, Schoenberger H, Sesto M, Gaumnitz E, Teo Broman A, Saha S (2019) Musculoskeletal injuries are commonly reported among gastroenterology trainees: results of a national survey. Dig Dis Sci 64(6):1439–1447CrossRefPubMed Austin K, Schoenberger H, Sesto M, Gaumnitz E, Teo Broman A, Saha S (2019) Musculoskeletal injuries are commonly reported among gastroenterology trainees: results of a national survey. Dig Dis Sci 64(6):1439–1447CrossRefPubMed
19.
Zurück zum Zitat Shergill AK, McQuaid KR (2019) Ergonomic endoscopy: an oxymoron or realistic goal? Gastrointest Endosc 90(6):966–970CrossRefPubMed Shergill AK, McQuaid KR (2019) Ergonomic endoscopy: an oxymoron or realistic goal? Gastrointest Endosc 90(6):966–970CrossRefPubMed
20.
Zurück zum Zitat Yeo HL, Dolan PT, Mao J, Sosa JA (2020) Association of demographic and program factors with American Board of Surgery qualifying and certifying examinations pass rates. JAMA Surg 155(1):22–30CrossRefPubMed Yeo HL, Dolan PT, Mao J, Sosa JA (2020) Association of demographic and program factors with American Board of Surgery qualifying and certifying examinations pass rates. JAMA Surg 155(1):22–30CrossRefPubMed
21.
Zurück zum Zitat Meyerson SL, Sternbach JM, Zwischenberger JB, Bender EM (2017) The effect of gender on resident autonomy in the operating room. J Surg Educ 74(6):e111–e118CrossRefPubMed Meyerson SL, Sternbach JM, Zwischenberger JB, Bender EM (2017) The effect of gender on resident autonomy in the operating room. J Surg Educ 74(6):e111–e118CrossRefPubMed
22.
Zurück zum Zitat Meyerson SL, Odell DD, Zwischenberger JB, Schuller M, Williams RG, Bohnen JD et al (2019) The effect of gender on operative autonomy in general surgery residents. Surgery 166(5):738–743CrossRefPubMed Meyerson SL, Odell DD, Zwischenberger JB, Schuller M, Williams RG, Bohnen JD et al (2019) The effect of gender on operative autonomy in general surgery residents. Surgery 166(5):738–743CrossRefPubMed
23.
Zurück zum Zitat Hoops H, Heston A, Dewey E, Spight D, Brasel K, Kiraly L (2019) Resident autonomy in the operating room: does gender matter? Am J Surg 217(2):301–305CrossRefPubMed Hoops H, Heston A, Dewey E, Spight D, Brasel K, Kiraly L (2019) Resident autonomy in the operating room: does gender matter? Am J Surg 217(2):301–305CrossRefPubMed
24.
Zurück zum Zitat Cooney CM, Aravind P, Scott Hultman C, Weber RA, Brooke S, Cooney DS et al (2019) Gender bias in plastic surgery resident assessment: a survey of 8,149 cases. Plast Reconstr Surg Glob Open 7(5S):8–9PubMedCentralCrossRef Cooney CM, Aravind P, Scott Hultman C, Weber RA, Brooke S, Cooney DS et al (2019) Gender bias in plastic surgery resident assessment: a survey of 8,149 cases. Plast Reconstr Surg Glob Open 7(5S):8–9PubMedCentralCrossRef
26.
Zurück zum Zitat Hyde JS (2016) Sex and cognition: gender and cognitive functions. Curr Opin Neurobiol 38:53–56CrossRefPubMed Hyde JS (2016) Sex and cognition: gender and cognitive functions. Curr Opin Neurobiol 38:53–56CrossRefPubMed
27.
Zurück zum Zitat Kass SJ, Ahlers RH, Dugger M (1998) Eliminating gender differences through practice in an applied visual spatial task. Hum Perform 11(4):337–349CrossRef Kass SJ, Ahlers RH, Dugger M (1998) Eliminating gender differences through practice in an applied visual spatial task. Hum Perform 11(4):337–349CrossRef
28.
Zurück zum Zitat Prinz A, Bolz M, Findl O (2005) Advantage of three dimensional animated teaching over traditional surgical videos for teaching ophthalmic surgery: a randomised study. Br J Ophthalmol 89(11):1495–1499PubMedPubMedCentralCrossRef Prinz A, Bolz M, Findl O (2005) Advantage of three dimensional animated teaching over traditional surgical videos for teaching ophthalmic surgery: a randomised study. Br J Ophthalmol 89(11):1495–1499PubMedPubMedCentralCrossRef
29.
Zurück zum Zitat Ali A, Subhi Y, Ringsted C, Konge L (2015) Gender differences in the acquisition of surgical skills: a systematic review. Surg Endosc 29(11):3065–3073CrossRefPubMed Ali A, Subhi Y, Ringsted C, Konge L (2015) Gender differences in the acquisition of surgical skills: a systematic review. Surg Endosc 29(11):3065–3073CrossRefPubMed
30.
Zurück zum Zitat Ritter EM, Lineberry M, Hashimoto DA, Gee D, Guzzetta AA, Scott DJ et al (2018) Simulation-based mastery learning significantly reduces gender differences on the Fundamentals of Endoscopic Surgery performance exam. Surg Endosc 32(12):5006–5011CrossRefPubMed Ritter EM, Lineberry M, Hashimoto DA, Gee D, Guzzetta AA, Scott DJ et al (2018) Simulation-based mastery learning significantly reduces gender differences on the Fundamentals of Endoscopic Surgery performance exam. Surg Endosc 32(12):5006–5011CrossRefPubMed
31.
Zurück zum Zitat Spencer SJ, Steele CM, Quinn DM (1999) Stereotype threat and women’s math performance. J Exp Soc Psychol 35(1):4–28CrossRef Spencer SJ, Steele CM, Quinn DM (1999) Stereotype threat and women’s math performance. J Exp Soc Psychol 35(1):4–28CrossRef
32.
Zurück zum Zitat Nguyen H-HD, Ryan AM (2008) Does stereotype threat affect test performance of minorities and women? A meta-analysis of experimental evidence. J Appl Psychol 93(6):1314–1334CrossRefPubMed Nguyen H-HD, Ryan AM (2008) Does stereotype threat affect test performance of minorities and women? A meta-analysis of experimental evidence. J Appl Psychol 93(6):1314–1334CrossRefPubMed
33.
Zurück zum Zitat Theobald J, Gaglani S, Haynes MR (2015) The association between confidence and accuracy among users of a mobile web platform for medical education. Ann Intern Med 162(5):395–396CrossRefPubMed Theobald J, Gaglani S, Haynes MR (2015) The association between confidence and accuracy among users of a mobile web platform for medical education. Ann Intern Med 162(5):395–396CrossRefPubMed
35.
Zurück zum Zitat Fonseca AL, Reddy V, Yoo PS, Gusberg RJ, Longo WE (2016) Senior surgical resident confidence in performing flexible endoscopy: what can we do differently? J Surg Educ 73(2):311–316CrossRefPubMed Fonseca AL, Reddy V, Yoo PS, Gusberg RJ, Longo WE (2016) Senior surgical resident confidence in performing flexible endoscopy: what can we do differently? J Surg Educ 73(2):311–316CrossRefPubMed
36.
Zurück zum Zitat Cook DA, Lineberry M (2016) Consequences validity evidence: evaluating the impact of educational assessments. Acad Med 91(6):785–795CrossRefPubMed Cook DA, Lineberry M (2016) Consequences validity evidence: evaluating the impact of educational assessments. Acad Med 91(6):785–795CrossRefPubMed
37.
Zurück zum Zitat Lineberry M (2019) Assessment affecting learning. In: Yudkowsky R, Park YS, Downing SM (eds) Assessment in health professions education, 2nd edn. Routledge, New York, pp 257–271CrossRef Lineberry M (2019) Assessment affecting learning. In: Yudkowsky R, Park YS, Downing SM (eds) Assessment in health professions education, 2nd edn. Routledge, New York, pp 257–271CrossRef
38.
Zurück zum Zitat Austin JT, Villanova P (1992) The criterion problem: 1917–1992. J Appl Psychol 77(6):836–874CrossRef Austin JT, Villanova P (1992) The criterion problem: 1917–1992. J Appl Psychol 77(6):836–874CrossRef
Metadaten
Titel
The Fundamentals of Endoscopic Surgery (FES) skills test: factors associated with first-attempt scores and pass rate
verfasst von
Matthew Lineberry
Yoon Soo Park
Sara A. Hennessy
E. Matthew Ritter
Publikationsdatum
09.06.2020
Verlag
Springer US
Erschienen in
Surgical Endoscopy / Ausgabe 8/2020
Print ISSN: 0930-2794
Elektronische ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-020-07690-6

Weitere Artikel der Ausgabe 8/2020

Surgical Endoscopy 8/2020 Zur Ausgabe

Update Chirurgie

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

S3-Leitlinie „Diagnostik und Therapie des Karpaltunnelsyndroms“

Karpaltunnelsyndrom BDC Leitlinien Webinare
CME: 2 Punkte

Das Karpaltunnelsyndrom ist die häufigste Kompressionsneuropathie peripherer Nerven. Obwohl die Anamnese mit dem nächtlichen Einschlafen der Hand (Brachialgia parästhetica nocturna) sehr typisch ist, ist eine klinisch-neurologische Untersuchung und Elektroneurografie in manchen Fällen auch eine Neurosonografie erforderlich. Im Anfangsstadium sind konservative Maßnahmen (Handgelenksschiene, Ergotherapie) empfehlenswert. Bei nicht Ansprechen der konservativen Therapie oder Auftreten von neurologischen Ausfällen ist eine Dekompression des N. medianus am Karpaltunnel indiziert.

Prof. Dr. med. Gregor Antoniadis
Berufsverband der Deutschen Chirurgie e.V.

S2e-Leitlinie „Distale Radiusfraktur“

Radiusfraktur BDC Leitlinien Webinare
CME: 2 Punkte

Das Webinar beschäftigt sich mit Fragen und Antworten zu Diagnostik und Klassifikation sowie Möglichkeiten des Ausschlusses von Zusatzverletzungen. Die Referenten erläutern, welche Frakturen konservativ behandelt werden können und wie. Das Webinar beantwortet die Frage nach aktuellen operativen Therapiekonzepten: Welcher Zugang, welches Osteosynthesematerial? Auf was muss bei der Nachbehandlung der distalen Radiusfraktur geachtet werden?

PD Dr. med. Oliver Pieske
Dr. med. Benjamin Meyknecht
Berufsverband der Deutschen Chirurgie e.V.

S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“

Appendizitis BDC Leitlinien Webinare
CME: 2 Punkte

Inhalte des Webinars zur S1-Leitlinie „Empfehlungen zur Therapie der akuten Appendizitis bei Erwachsenen“ sind die Darstellung des Projektes und des Erstellungswegs zur S1-Leitlinie, die Erläuterung der klinischen Relevanz der Klassifikation EAES 2015, die wissenschaftliche Begründung der wichtigsten Empfehlungen und die Darstellung stadiengerechter Therapieoptionen.

Dr. med. Mihailo Andric
Berufsverband der Deutschen Chirurgie e.V.