Skip to main content
Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 7/2021

15.03.2021 | Reports of Original Investigations

Investigating faculty assessment of anesthesia trainees and the failing-to-fail phenomenon: a randomized controlled trial

verfasst von: Zeev Friedman, MD, M. Dylan Bould, MB, ChB, MRCP, FRCA, Med, Clyde Matava, MB, ChB, MMed, Fahad Alam, MD, MHSc, FRCPC

Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Ausgabe 7/2021

Einloggen, um Zugang zu erhalten

Abstract

Purpose

A growing body of evidence has shown that supervisors may “fail to fail” trainees even when they have judged their performance unsatisfactory. This has significant implications for the implementation of a nationwide competency-based education model of residency training. The objective of this study was to determine the incidence of “failing to fail” clearly underperforming residents.

Methods

Study participants were recruited via an email invitation sent to all departments of anesthesia at each of the hospitals affiliated with the University of Toronto. They were randomized into a high-stakes (assessment would affect the resident’s progress) or low-stakes (assessment would not affect the resident’s progress) group and asked to assess the performance (fail or pass grade) of a struggling resident. Participants assessed a video depicting an actor managing a scripted simulation scenario. It contained several critical clinical mistakes constituting a clear fail performance. The purpose of the study was only disclosed following the assessment.

Results

Of the 288 email invitations sent (144 in each group), 158 (54%) participants completed the study, with 93 in the high-stakes group and 65 in the low-stakes group. Twenty-eight participants (17.7%) failed to issue a failing grade, including 23.1% (15/65) in the high-stakes group and 13.9% (13/93) in the low-stakes group (P = 0.14).

Conclusions

Though often discussed, this is the first study to quantitatively show that the “failing-to-fail” phenomenon likely occurs during residency training performance evaluations. Passing underperforming learners can potentially affect patient safety and result in severe personal consequences to the learner. The results indicate the need for better performance assessment training for faculty members.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Halpern SD, Detsky AS. Graded autonomy in medical education–managing things that go bump in the night. N Engl J Med 2014; 370: 1086-9.CrossRef Halpern SD, Detsky AS. Graded autonomy in medical education–managing things that go bump in the night. N Engl J Med 2014; 370: 1086-9.CrossRef
2.
Zurück zum Zitat Royal College of Physicians and Surgeons of Canada. Competence by Design: Reshaping Canadian Medical Education 2014: 99-105. Available from URL: file:///C:/Users/cja/Downloads/royal-college-competency-by-design-ebook-e.pdf (accessed January 2021). Royal College of Physicians and Surgeons of Canada. Competence by Design: Reshaping Canadian Medical Education 2014: 99-105. Available from URL: file:///C:/Users/cja/Downloads/royal-college-competency-by-design-ebook-e.pdf (accessed January 2021).
3.
Zurück zum Zitat Speer AJ, Solomon DJ, Fincher RM. Grade inflation in internal medicine clerkships: results of a national survey. Teach Learn Med 2000; 12: 112-6.CrossRef Speer AJ, Solomon DJ, Fincher RM. Grade inflation in internal medicine clerkships: results of a national survey. Teach Learn Med 2000; 12: 112-6.CrossRef
4.
Zurück zum Zitat Dudek NL, Marks MB, Regehr G. Failure to fail: the perspectives of clinical supervisors. Acad Med 2005; 80(10 Suppl): S84-7.CrossRef Dudek NL, Marks MB, Regehr G. Failure to fail: the perspectives of clinical supervisors. Acad Med 2005; 80(10 Suppl): S84-7.CrossRef
7.
Zurück zum Zitat Rutkowski K. Failure to fail: assessing nursing students’ competence during practice placements. Nurs Stand 2007; 22: 35-40.CrossRef Rutkowski K. Failure to fail: assessing nursing students’ competence during practice placements. Nurs Stand 2007; 22: 35-40.CrossRef
8.
Zurück zum Zitat Roman BJ, Trevino J. An approach to address grade inflation in a psychiatry clerkship. Acad Psychiatry 2006; 30: 110-5.CrossRef Roman BJ, Trevino J. An approach to address grade inflation in a psychiatry clerkship. Acad Psychiatry 2006; 30: 110-5.CrossRef
9.
Zurück zum Zitat Schmahmann JD, Neal M, MacMore J. Evaluation of the assessment and grading of medical students on a neurology clerkship. Neurology 2008; 70: 706-12.CrossRef Schmahmann JD, Neal M, MacMore J. Evaluation of the assessment and grading of medical students on a neurology clerkship. Neurology 2008; 70: 706-12.CrossRef
11.
Zurück zum Zitat Scholes J, Albarran J. Failure to fail: facing the consequences of inaction. Nurs Crit Care 2005; 10: 113-5.CrossRef Scholes J, Albarran J. Failure to fail: facing the consequences of inaction. Nurs Crit Care 2005; 10: 113-5.CrossRef
12.
Zurück zum Zitat Cleland JA, Knight LV, Rees CE, Tracey S, Bond CM. Is it me or is it them? Factors that influence the passing of underperforming students. Med Educ 2008; 42: 800-9.CrossRef Cleland JA, Knight LV, Rees CE, Tracey S, Bond CM. Is it me or is it them? Factors that influence the passing of underperforming students. Med Educ 2008; 42: 800-9.CrossRef
13.
Zurück zum Zitat Morgan PJ, Lam-McCulloch J, Herold-McIlroy J, Tarshis J. Simulation performance checklist generation using the Delphi technique. Can J Anesth 2007; 54: 992-7.CrossRef Morgan PJ, Lam-McCulloch J, Herold-McIlroy J, Tarshis J. Simulation performance checklist generation using the Delphi technique. Can J Anesth 2007; 54: 992-7.CrossRef
14.
Zurück zum Zitat Corbin JM, Strauss A. Grounded theory research: procedures, canons, and evaluative criteria. Qual Sociol 1990; 13: 3-21.CrossRef Corbin JM, Strauss A. Grounded theory research: procedures, canons, and evaluative criteria. Qual Sociol 1990; 13: 3-21.CrossRef
15.
Zurück zum Zitat Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007; 39: 175-91.CrossRef Faul F, Erdfelder E, Lang AG, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods 2007; 39: 175-91.CrossRef
16.
Zurück zum Zitat Fazio SB, Papp KK, Torre DM, Defer TM. Grade inflation in the internal medicine clerkship: a national survey. Teach Learn Med 2013; 25: 71-6.CrossRef Fazio SB, Papp KK, Torre DM, Defer TM. Grade inflation in the internal medicine clerkship: a national survey. Teach Learn Med 2013; 25: 71-6.CrossRef
17.
Zurück zum Zitat Roman BJ, Trevino J. An approach to address grade inflation in a psychiatry clerkship. Acad Psychiatry 2006; 30: 110-5.CrossRef Roman BJ, Trevino J. An approach to address grade inflation in a psychiatry clerkship. Acad Psychiatry 2006; 30: 110-5.CrossRef
18.
Zurück zum Zitat Yepes-Rios M, Dudek N, Duboyce R, Curtis J, Allard RJ, Varpio L. The failure to fail underperforming trainees in health professions education: A BEME systematic review: BEME guide No. 42. Med Teach 2016; 38: 1092-9. Yepes-Rios M, Dudek N, Duboyce R, Curtis J, Allard RJ, Varpio L. The failure to fail underperforming trainees in health professions education: A BEME systematic review: BEME guide No. 42. Med Teach 2016; 38: 1092-9.
19.
Zurück zum Zitat LeBlanc VR. Review article: simulation in anesthesia: state of the science and looking forward. Can J Anesth 2012; 59: 193-202.CrossRef LeBlanc VR. Review article: simulation in anesthesia: state of the science and looking forward. Can J Anesth 2012; 59: 193-202.CrossRef
20.
Zurück zum Zitat Birkmeyer JD, Finks JF, O’Reilly A, et al. Surgical skill and complication rates after bariatric surgery. N Engl J Med 2013; 369: 1434-42.CrossRef Birkmeyer JD, Finks JF, O’Reilly A, et al. Surgical skill and complication rates after bariatric surgery. N Engl J Med 2013; 369: 1434-42.CrossRef
21.
Zurück zum Zitat Bensfield LA, Olech MJ, Horsley TL. Simulation for high-stakes evaluation in nursing. Nurse Educ 2012; 37: 71-4.CrossRef Bensfield LA, Olech MJ, Horsley TL. Simulation for high-stakes evaluation in nursing. Nurse Educ 2012; 37: 71-4.CrossRef
22.
Zurück zum Zitat Boulet JR. Summative assessment in medicine: the promise of simulation for high-stakes evaluation. Acad Emerg Med 2008; 15: 1017-24.CrossRef Boulet JR. Summative assessment in medicine: the promise of simulation for high-stakes evaluation. Acad Emerg Med 2008; 15: 1017-24.CrossRef
Metadaten
Titel
Investigating faculty assessment of anesthesia trainees and the failing-to-fail phenomenon: a randomized controlled trial
verfasst von
Zeev Friedman, MD
M. Dylan Bould, MB, ChB, MRCP, FRCA, Med
Clyde Matava, MB, ChB, MMed
Fahad Alam, MD, MHSc, FRCPC
Publikationsdatum
15.03.2021
Verlag
Springer International Publishing
Erschienen in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Ausgabe 7/2021
Print ISSN: 0832-610X
Elektronische ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-021-01971-x

Weitere Artikel der Ausgabe 7/2021

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 7/2021 Zur Ausgabe

Mit dem Seitenschneider gegen das Reißverschluss-Malheur

03.06.2024 Urologische Notfallmedizin Nachrichten

Wer ihn je erlebt hat, wird ihn nicht vergessen: den Schmerz, den die beim Öffnen oder Schließen des Reißverschlusses am Hosenschlitz eingeklemmte Haut am Penis oder Skrotum verursacht. Eine neue Methode für rasche Abhilfe hat ein US-Team getestet.

Schlaganfall: frühzeitige Blutdrucksenkung im Krankenwagen ohne Nutzen

31.05.2024 Apoplex Nachrichten

Der optimale Ansatz für die Blutdruckkontrolle bei Patientinnen und Patienten mit akutem Schlaganfall ist noch nicht gefunden. Ob sich eine frühzeitige Therapie der Hypertonie noch während des Transports in die Klinik lohnt, hat jetzt eine Studie aus China untersucht.

Reanimation bei Kindern – besser vor Ort oder während Transport?

29.05.2024 Reanimation im Kindesalter Nachrichten

Zwar scheint es laut einer Studie aus den USA und Kanada bei der Reanimation von Kindern außerhalb einer Klinik keinen Unterschied für das Überleben zu machen, ob die Wiederbelebungsmaßnahmen während des Transports in die Klinik stattfinden oder vor Ort ausgeführt werden. Jedoch gibt es dabei einige Einschränkungen und eine wichtige Ausnahme.

Nicht Creutzfeldt Jakob, sondern Abführtee-Vergiftung

29.05.2024 Hyponatriämie Nachrichten

Eine ältere Frau trinkt regelmäßig Sennesblättertee gegen ihre Verstopfung. Der scheint plötzlich gut zu wirken. Auf Durchfall und Erbrechen folgt allerdings eine Hyponatriämie. Nach deren Korrektur kommt es plötzlich zu progredienten Kognitions- und Verhaltensstörungen.

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.