nach oben

Canadian Journal of Anesthesia/Journal canadien d'anesthésie

Erschienen in:

10.05.2023 | Reports of Original Investigations

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education

verfasst von: Clyde T. Matava, MBCHb, MMed, MHSC, Fahad Alam, MD, MHSC, Alayne Kealey, MD, Lisa A. Bahrey, MD, Graham A. McCreath, BSc, Catharine M. Walsh, MD, MEd, PhD

Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Ausgabe 6/2023

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Competency-based medical education (CBME) relies on frequent workplace-based assessments of trainees, providing opportunities for conscious and implicit biases to reflect in these assessments. We aimed to examine the influence of resident and faculty gender on performance ratings of residents within a CBME system.

Methods

This retrospective cohort study took place from August 2017 to January 2021 using resident assessment data from two workplace-based assessments: the Anesthesia Clinical Encounter Assessment (ACEA) and Entrustable Professional Activities (EPAs). Self-reported gender data were also extracted. The primary outcome—gender-based differences in entrustment ratings of residents on the ACEA and EPAs—was evaluated using mixed-effects logistic regression, with differences reported through odds ratios and confidence intervals (α = 0.01). Gender-based differences in the receipt of free-text comments on the ACEA and EPAs were also explored.

Results

In total, 14,376 ACEA and 4,467 EPA assessments were analyzed. There were no significant differences in entrustment ratings on either assessment tool between men and women residents. Regardless of whether assessments were completed by men or women faculty, entrustment rates between men and women residents were not significantly different for any postgraduate year level. Additionally, men and women residents received strengths-related and actions-related comments on both assessments at comparable frequencies, irrespective of faculty gender.

Conclusion

We found no gender-based differences in entrustment ratings for both the ACEA and EPAs, which suggests an absence of resident gender bias within this CBME system. Given considerable heterogeneity in rater leniency, future work would be strengthened by using rater leniency-adjusted scores rather than raw scores.

Nur mit Berechtigung zugänglich

University of Toronto Anesthesiology and Pain Medicine. What is an entrustable professional activity (EPA) for anesthesia?—Dr Lisa Bahrey explains, 2017. Available from URL: https://www.youtube.com/watch?v=HS5BUiAMKW8 (accessed March 2023).

College of Physicians and Surgeons of Ontario. COVID-19 updates. Available from URL: http://www.cpso.on.ca (accessed March 2023).

Kealey A, Alam F, Bahrey LA, Matava CT, McCreath GA, Walsh CM. Validity evidence for the Anesthesia Clinical Encounter Assessment (ACEA) tool to support competency-based medical education. Br J Anaesth 2022; 128: 691–9. https://doi.org/10.1016/j.bja.2021.12.012CrossRefPubMed

Friedman Z, Bould MD, Matava C, Alam F. Investigating faculty assessment of anesthesia trainees and the failing-to-fail phenomenon: a randomized controlled trial. Can J Anesth 2021; 68: 1000–7. https://doi.org/10.1007/s12630-021-01971-xCrossRefPubMed

Dubois DG, Lingley AJ, Ghatalia J, McConnell MM. Validity of entrustment scales within anesthesiology residency training. Can J Anesth 2021; 68: 53–63. https://doi.org/10.1007/s12630-020-01823-0CrossRefPubMed

Bailey K, West NC, Matava C. Competency-based medical education: are Canadian pediatric anesthesiologists ready? Cureus 2022; 14: e22344. https://doi.org/10.7759/cureus.22344

Schumacher DJ, Cate OT, Damodaran A, et al. Clarifying essential terminology in entrustment. Med Teach 2021; 43: 737–44. https://doi.org/10.1080/0142159x.2021.1924365CrossRefPubMed

Weller JM, Coomber T, Chen Y, Castanelli DJ. Key dimensions of innovations in workplace-based assessment for postgraduate medical education: a scoping review. Br J Anaesth 2021; 127: 689–703. https://doi.org/10.1016/j.bja.2021.06.038CrossRefPubMed

Edmunds LD, Ovseiko PV, Shepperd S, et al. Why do women choose or reject careers in academic medicine? A narrative review of empirical evidence. Lancet 2016; 388: 2948–58. https://doi.org/10.1016/s0140-6736(15)01091-0CrossRefPubMed

Welten VM, Dabekaussen KF, Davids JS, Melnitchouk N. Promoting female leadership in academic surgery: disrupting systemic gender bias. Acad Med 2022; 97: 961–6. https://doi.org/10.1097/acm.0000000000004665CrossRefPubMed

Bosco L, Lorello GR, Flexman AM, Hastie MJ. Women in anaesthesia: a scoping review. Br J Anaesth 2020; 124: e134-–7. https://doi.org/10.1016/j.bja.2019.12.021CrossRefPubMed

10.

Dayal A, O'Connor DM, Qadri U, Arora VM. Comparison of male vs female resident milestone evaluations by faculty during emergency medicine residency training. JAMA Intern Med 2017; 177: 651–7. https://doi.org/10.1001/jamainternmed.2016.9616CrossRefPubMedPubMedCentral

11.

Galvin SL, Parlier AB, Martino E, Scott KR, Buys E. Gender bias in nurse evaluations of residents in obstetrics and gynecology. Obstet Gynecol 2015; 126: 7S–12. https://doi.org/10.1097/aog.0000000000001044CrossRefPubMed

12.

Brienza RS, Huot S, Holmboe ES. Influence of gender on the evaluation of internal medicine residents. J Womens Health (Larchmt) 2004; 13: 77–83. https://doi.org/10.1089/154099904322836483CrossRefPubMed

13.

Klein R, Julian KA, Snyder ED, et al. Gender bias in resident assessment in graduate medical education: review of the literature. J Gen Intern Med 2019; 34: 712–9. https://doi.org/10.1007/s11606-019-04884-0CrossRefPubMedPubMedCentral

14.

Loeppky C, Babenko O, Ross S. Examining gender bias in the feedback shared with family medicine residents. Educ Prim Care 2017; 28: 319–24. https://doi.org/10.1080/14739879.2017.1362665CrossRefPubMed

15.

Mueller AS, Jenkins TM, Osborne M, Dayal A, O'Connor DM, Arora VM. Gender differences in attending physicians' feedback to residents: a qualitative analysis. J Grad Med Educ 2017; 9: 577–85. https://doi.org/10.4300/jgme-d-17-00126.1CrossRefPubMedPubMedCentral

16.

Ringdahl EN, Delzell JE, Kruse RL. Evaluation of interns by senior residents and faculty: is there any difference? Med Educ 2004; 38: 646–51. https://doi.org/10.1111/j.1365-2929.2004.01832.xCrossRefPubMed

17.

Billick M, Rassos J, Ginsburg S. Dressing the part: gender differences in residents' experiences of feedback in internal medicine. Acad Med 2022; 97: 406–13. https://doi.org/10.1097/acm.0000000000004487CrossRefPubMed

18.

Thackeray EW, Halvorsen AJ, Ficalora RD, Engstler GJ, McDonald FS, Oxentenko AS. The effects of gender and age on evaluation of trainees and faculty in gastroenterology. Am J Gastroenterol 2012; 107: 1610–4. https://doi.org/10.1038/ajg.2012.139CrossRefPubMed

19.

Spring J, Abrahams C, Ginsburg S, et al. Impact of gender on clinical evaluation of trainees in the intensive care unit. ATS Sch 2021; 2: 442–51. https://doi.org/10.34197/ats-scholar.2021-0048oc

20.

Padilla EP, Stahl CC, Jung SA, et al. Gender differences in entrustable professional activity evaluations of general surgery residents. Ann Surg 2022; 275: 222–9. https://doi.org/10.1097/sla.0000000000004905CrossRefPubMed

21.

Zuckerbraun NS, Levasseur K, Kou M, et al. Gender differences among milestone assessments in a national sample of pediatric emergency medicine fellowship programs. AEM Educ Train 2021; 5: e10543. https://doi.org/10.1002/aet2.10543

22.

Royal College of Physicians and Surgeons of Canada. Access to copyright-protected CBD documents. Available from URL: https://www.royalcollege.ca/rcsite/documents/cbd/epa-observation-templates-e (accessed November 2022).

23.

von Elm E, Altman DG, Egger M, et al. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Bull World Health Organ 2007; 85: 867–72. https://doi.org/10.2471/blt.07.045120CrossRef

24.

Cook TD. Advanced statistics: up with odds ratios! A case for odds ratios when outcomes are common. Acad Emerg Med 2002; 9: 1430–4. https://doi.org/10.1111/j.1553-2712.2002.tb01616.xCrossRefPubMed

25.

Bates D, Mächler M, Bolker BM, Walker SC. Fitting linear mixed-effects models using lme4. J Stat Softw 2015; 67: 1–48. https://doi.org/10.48550/arXiv.1406.5823

26.

Hindman BJ, Dexter F, Kreiter CD, Wachtel RE. Determinants, associations, and psychometric properties of resident assessments of anesthesiologist operating room supervision. Anesth Analg 2013; 116: 1342–51. https://doi.org/10.1213/ane.0b013e31828d7218CrossRefPubMed

27.

Dexter F, Hadlandsmyth K, Pearson AC, Hindman BJ. Reliability and validity of performance evaluations of pain medicine clinical faculty by residents and fellows using a supervision scale. Anesth Analg 2020; 131: 909–16. https://doi.org/10.1213/ane.0000000000004779CrossRefPubMed

28.

Dexter F, Ledolter J, Wong CA, Hindman BJ. Association between leniency of anesthesiologists when evaluating certified registered nurse anesthetists and when evaluating didactic lectures. Health Care Manag Sci 2020; 23: 640–8. https://doi.org/10.1007/s10729-020-09518-0CrossRefPubMed

29.

Dexter F, Ledolter J, Hindman BJ. Measurement of faculty anesthesiologists' quality of clinical supervision has greater reliability when controlling for the leniency of the rating anesthesia resident: a retrospective cohort study. Can J Anesth 2017; 64: 643–55. https://doi.org/10.1007/s12630-017-0866-4CrossRefPubMed

30.

Dexter F, Bayman EO, Wong CA, Hindman BJ. Reliability of ranking anesthesiologists and nurse anesthetists using leniency-adjusted clinical supervision and work habits scores. J Clin Anesth 2020; 61: 109639. https://doi.org/10.1016/j.jclinane.2019.109639

31.

Frank JR, Snell LS, Cate OT, et al. Competency-based medical education: theory to practice. Med Teach 2010; 32: 638–45. https://doi.org/10.3109/0142159x.2010.501190CrossRefPubMed

32.

Sarosi GA Jr, Klingensmith M. Entrustable professional activities, a tool for addressing sex bias and the imposter syndrome? Ann Surg 2022; 275: 230–1. https://doi.org/10.1097/sla.0000000000005189CrossRefPubMed

33.

Zdravkovic M, Osinova D, Brull SJ, et al. Perceptions of gender equity in departmental leadership, research opportunities, and clinical work attitudes: an international survey of 11 781 anaesthesiologists. Br J Anaesth 2020; 124: e160–70. https://doi.org/10.1016/j.bja.2019.12.022CrossRefPubMed

34.

Gonzalez LS, Fahy BG, Lien CA. Gender distribution in United States anaesthesiology residency programme directors: trends and implications. Br J Anaesth 2020; 124: e63–9. https://doi.org/10.1016/j.bja.2019.12.010CrossRefPubMed

35.

Aliaño M, Franco G, Gilsanz F. Gender differences in Anaesthesiology. At what point do we find ourselves in Spain? Results from a Spanish survey [Spanish]. Rev Esp Anestesiol Reanim (Engl Ed) 2020; 67: 374–80. https://doi.org/10.1016/j.redar.2019.10.012

36.

Brown O, Mou T, Lim SI, et al. Do gender and racial differences exist in letters of recommendation for obstetrics and gynecology residency applicants? Am J Obstet Gynecol 2021; 225: e1–11. https://doi.org/10.1016/j.ajog.2021.08.033CrossRef

37.

Branfield Day L, Miles A, Ginsburg S, Melvin L. Resident perceptions of assessment and feedback in competency-based medical education: a focus group study of one internal medicine residency program. Acad Med 2020; 95: 1712–7. https://doi.org/10.1097/acm.0000000000003315CrossRefPubMed

38.

Rojek AE, Khanna R, Yim JW, et al. Differences in narrative language in evaluations of medical students by gender and under-represented minority status. J Gen Intern Med 2019; 34: 684–91. https://doi.org/10.1007/s11606-019-04889-9CrossRefPubMedPubMedCentral

Titel: The influence of resident and faculty gender on assessments in anesthesia competency-based medical education
verfasst von: Clyde T. Matava, MBCHb, MMed, MHSC
Fahad Alam, MD, MHSC
Alayne Kealey, MD
Lisa A. Bahrey, MD
Graham A. McCreath, BSc
Catharine M. Walsh, MD, MEd, PhD
Publikationsdatum: 10.05.2023
Verlag: Springer International Publishing
Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Ausgabe 6/2023
Print ISSN: 0832-610X
Elektronische ISSN: 1496-8975
DOI: https://doi.org/10.1007/s12630-023-02454-x

Neu im Fachgebiet AINS

Mehr Frauen im OP – weniger postoperative Komplikationen

21.05.2024 Allgemeine Chirurgie Nachrichten

Ein Frauenanteil von mindestens einem Drittel im ärztlichen Op.-Team war in einer großen retrospektiven Studie aus Kanada mit einer signifikanten Reduktion der postoperativen Morbidität assoziiert.

Delir bei kritisch Kranken – Antipsychotika versus Placebo

16.05.2024 Delir Nachrichten

Um die Langzeitfolgen eines Delirs bei kritisch Kranken zu mildern, wird vielerorts auf eine Akuttherapie mit Antipsychotika gesetzt. Eine US-amerikanische Forschungsgruppe äußert jetzt erhebliche Vorbehalte gegen dieses Vorgehen. Denn es gibt neue Daten zum Langzeiteffekt von Haloperidol bzw. Ziprasidon versus Placebo.

Eingreifen von Umstehenden rettet vor Erstickungstod

15.05.2024 Fremdkörperaspiration Nachrichten

Wer sich an einem Essensrest verschluckt und um Luft ringt, benötigt vor allem rasche Hilfe. Dass Umstehende nur in jedem zweiten Erstickungsnotfall bereit waren, diese zu leisten, ist das ernüchternde Ergebnis einer Beobachtungsstudie aus Japan. Doch es gibt auch eine gute Nachricht.

Darf man die Behandlung eines Neonazis ablehnen?

08.05.2024 Gesellschaft Nachrichten

In einer Leseranfrage in der Zeitschrift Journal of the American Academy of Dermatology möchte ein anonymer Dermatologe bzw. eine anonyme Dermatologin wissen, ob er oder sie einen Patienten behandeln muss, der eine rassistische Tätowierung trägt.

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

hier abonnieren

Die Highlights vom Kongress des American College of Cardiology 2024

Springer Medizin

The influence of resident and faculty gender on assessments in anesthesia competency-based medical education