Skip to main content
Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 2/2021

10.11.2020 | Reports of Original Investigations

Resident competencies before and after short intensive care unit rotations: a multicentre pilot observational study

verfasst von: Dominique Piquette, MD, PhD, FRCPC, Alberto Goffi, MD, Christie Lee, MD, MSc, FRCPC, Ryan Brydges, PhD, Catharine M. Walsh, MD, PhD, FRCPC, Briseida Mema, MD, MEd, FRCPC, Chris Parshuram, MBChB, DPhil, FRACP

Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Ausgabe 2/2021

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Residency programs need to understand the competencies developed by residents during an intensive care unit (ICU) rotation, so that curricula and assessments maximize residents’ learning. The primary study objective was to evaluate the feasibility for training programs and acceptability by residents of conducting a multi-competency assessment during a four-week ICU rotation.

Methods

We conducted a prospective, multicentre observational pilot study in three ICUs. During weeks 1 and 4 of an ICU rotation, we conducted repeated standardized assessments of non-critical care specialty residents’ competencies in cognitive reasoning (script concordance test [SCT]), procedural skills (objective structured assessment of technical skills [OSATS]-global rating scale], and communication skills through a written test, two procedural simulations, and a simulated encounter with a “family member”. The feasibility outcomes included program costs, the proportion of enrolled residents able to complete at least one three-station assessment during their four-week ICU rotation, and acceptability of the assessment for the trainees.

Results

We enrolled 63 (69%) of 91 eligible residents, with 58 (92%) completing at least one assessment. The total cost to conduct 90 assessments was CAD 33,800. The majority of participants agreed that the assessment was fair and that it measured important clinical abilities. For the 32 residents who completed two assessments, the mean (standard deviation) cognitive reasoning and procedural skill scores increased between weeks 1 and 4 [SCT difference, 3.1 (6.5), P = 0.01; OSATS difference for bag-mask ventilation and central line insertion, 0.4 (0.5) and 0.6 (0.8), respectively; both P ≤ 0.001]. Nevertheless, the communication scores did not change significantly.

Conclusions

A monthly multi-competency assessment for specialty residents rotating in the ICU is likely feasible for most programs with appropriate resources, and generally acceptable for residents. Specialty residents’ cognitive reasoning and procedural skills may improve during a four-week ICU rotation, whereas communication skills may not.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Hoffman KG, Donaldson JF. Contextual tensions of the clinical environment and their influence on teaching and learning. Med Educ 2004; 38: 448-54.CrossRefPubMed Hoffman KG, Donaldson JF. Contextual tensions of the clinical environment and their influence on teaching and learning. Med Educ 2004; 38: 448-54.CrossRefPubMed
3.
Zurück zum Zitat Piquette D, Moulton CA, LeBlanc VR. Balancing care and teaching during clinical activities: 2 contexts, 2 strategies. J Crit Care 2015; 30: 678-84.CrossRefPubMed Piquette D, Moulton CA, LeBlanc VR. Balancing care and teaching during clinical activities: 2 contexts, 2 strategies. J Crit Care 2015; 30: 678-84.CrossRefPubMed
4.
Zurück zum Zitat Piquette D, Moulton CA, LeBlanc VR. Creating learning momentum through overt teaching interactions during real acute care episodes. Adv Health Sci Educ Theory Pract 2015; 20: 903-14.CrossRefPubMed Piquette D, Moulton CA, LeBlanc VR. Creating learning momentum through overt teaching interactions during real acute care episodes. Adv Health Sci Educ Theory Pract 2015; 20: 903-14.CrossRefPubMed
5.
Zurück zum Zitat Bannister SL, Dolson MS, Lingard L, Keegan DA. Not just trust: factors influencing learners’ attempts to perform technical skills on real patients. Med Educ 2018; 52: 605-19.CrossRefPubMed Bannister SL, Dolson MS, Lingard L, Keegan DA. Not just trust: factors influencing learners’ attempts to perform technical skills on real patients. Med Educ 2018; 52: 605-19.CrossRefPubMed
6.
Zurück zum Zitat Holmboe E, Ginsburg S, Bernabeo E. The rotational approach to medical education: time to confront our assumptions? Med Educ 2011; 45: 69-80.CrossRefPubMed Holmboe E, Ginsburg S, Bernabeo E. The rotational approach to medical education: time to confront our assumptions? Med Educ 2011; 45: 69-80.CrossRefPubMed
7.
Zurück zum Zitat Piquette D, Moulton CA, LeBlanc VR. Model of interactive clinical supervision in acute care environments. Balancing patient care and teaching. Ann Am Thorac Soc 2015; 12: 498-504.CrossRefPubMed Piquette D, Moulton CA, LeBlanc VR. Model of interactive clinical supervision in acute care environments. Balancing patient care and teaching. Ann Am Thorac Soc 2015; 12: 498-504.CrossRefPubMed
8.
Zurück zum Zitat Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Residents’ procedural experience does not ensure competence: a research synthesis. J Grad Med Educ 2017; 9: 201-8.CrossRefPubMedPubMedCentral Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Residents’ procedural experience does not ensure competence: a research synthesis. J Grad Med Educ 2017; 9: 201-8.CrossRefPubMedPubMedCentral
9.
Zurück zum Zitat Ottestad E, Boulet JR, Lighthall GK. Evaluating the management of septic shock using patient simulation. Crit Care Med 2007; 35: 769-75.CrossRefPubMed Ottestad E, Boulet JR, Lighthall GK. Evaluating the management of septic shock using patient simulation. Crit Care Med 2007; 35: 769-75.CrossRefPubMed
10.
Zurück zum Zitat Schroedl CJ, Corbridge TC, Cohen ER, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care 2012; 27(219): e7-13. Schroedl CJ, Corbridge TC, Cohen ER, et al. Use of simulation-based education to improve resident learning and patient care in the medical intensive care unit: a randomized trial. J Crit Care 2012; 27(219): e7-13.
11.
Zurück zum Zitat Singer BD, Corbridge TC, Schroedl CJ, et al. First-year residents outperform third-year residents after simulation-based education in critical care medicine. Simul Healthc 2013; 8: 67-71.CrossRefPubMedPubMedCentral Singer BD, Corbridge TC, Schroedl CJ, et al. First-year residents outperform third-year residents after simulation-based education in critical care medicine. Simul Healthc 2013; 8: 67-71.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ 2015; 49: 560-75.CrossRefPubMed Cook DA, Brydges R, Ginsburg S, Hatala R. A contemporary approach to validity arguments: a practical guide to Kane’s framework. Med Educ 2015; 49: 560-75.CrossRefPubMed
14.
Zurück zum Zitat Charlin B, Gagnon R, Lubarsky S, et al. Assessment in the context of uncertainty using the script concordance test: more meaning for scores. Teach Learn Med 2010; 22: 180-6.CrossRefPubMed Charlin B, Gagnon R, Lubarsky S, et al. Assessment in the context of uncertainty using the script concordance test: more meaning for scores. Teach Learn Med 2010; 22: 180-6.CrossRefPubMed
15.
Zurück zum Zitat Hatala R, Cook DA, Brydges R, Hawkins R. Constructing a validity argument for the objective structured assessment of technical skills (OSATS): a systematic review of validity evidence. Adv Health Sci Educ Theory Pract 2015; 20: 1149-75.CrossRefPubMed Hatala R, Cook DA, Brydges R, Hawkins R. Constructing a validity argument for the objective structured assessment of technical skills (OSATS): a systematic review of validity evidence. Adv Health Sci Educ Theory Pract 2015; 20: 1149-75.CrossRefPubMed
16.
Zurück zum Zitat Hodges B, McIlroy JH. Analytic global OSCE ratings are sensitive to level of training. Med Educ 2003; 37: 1012-6.CrossRefPubMed Hodges B, McIlroy JH. Analytic global OSCE ratings are sensitive to level of training. Med Educ 2003; 37: 1012-6.CrossRefPubMed
17.
Zurück zum Zitat Dory V, Gagnon R, Vanpee D, Charlin B. How to construct and implement script concordance tests: insights from a systematic review. Med Educ 2012; 46: 552-63.CrossRefPubMed Dory V, Gagnon R, Vanpee D, Charlin B. How to construct and implement script concordance tests: insights from a systematic review. Med Educ 2012; 46: 552-63.CrossRefPubMed
19.
Zurück zum Zitat Lubarsky S, Charlin B, Cook DA, Chalk C, van der Vleuten CP. Script concordance testing: a review of published validity evidence. Med Educ 2011; 45: 329-38.CrossRefPubMed Lubarsky S, Charlin B, Cook DA, Chalk C, van der Vleuten CP. Script concordance testing: a review of published validity evidence. Med Educ 2011; 45: 329-38.CrossRefPubMed
20.
Zurück zum Zitat Lubarsky S, Dory V, Duggan P, Gagnon R, Charlin B. Script concordance testing: from theory to practice: AMEE guide no. 75. Med Teach 2013; 35: 184-93.CrossRefPubMed Lubarsky S, Dory V, Duggan P, Gagnon R, Charlin B. Script concordance testing: from theory to practice: AMEE guide no. 75. Med Teach 2013; 35: 184-93.CrossRefPubMed
21.
Zurück zum Zitat Lubarsky S, Gagnon R, Charlin B. Scoring the script concordance test: not a black and white issue. Med Educ 2013; 47: 1159-61.CrossRefPubMed Lubarsky S, Gagnon R, Charlin B. Scoring the script concordance test: not a black and white issue. Med Educ 2013; 47: 1159-61.CrossRefPubMed
23.
Zurück zum Zitat Friendly M. A fourfold display for 2 by 2 by k tables. Technical Report 217: Psychology Department, York University; 1994. Friendly M. A fourfold display for 2 by 2 by k tables. Technical Report 217: Psychology Department, York University; 1994.
24.
Zurück zum Zitat Cao S, Ladowski S, Goffi A, et al. What do non-critical care residents actually learn during an intensive care unit rotation: time to find out! Can J Anesth 2019; 66: 874-6.CrossRefPubMed Cao S, Ladowski S, Goffi A, et al. What do non-critical care residents actually learn during an intensive care unit rotation: time to find out! Can J Anesth 2019; 66: 874-6.CrossRefPubMed
25.
Zurück zum Zitat LeBlanc VR, Tabak D, Kneebone R, Nestel D, MacRae H, Moulton CA. Psychometric properties of an integrated assessment of technical and communication skills. Am J Surg 2009; 197: 96-101.CrossRefPubMed LeBlanc VR, Tabak D, Kneebone R, Nestel D, MacRae H, Moulton CA. Psychometric properties of an integrated assessment of technical and communication skills. Am J Surg 2009; 197: 96-101.CrossRefPubMed
26.
Zurück zum Zitat Moulton CA, Tabak D, Kneebone R, Nestel D, MacRae H, LeBlanc VR. Teaching communication skills using the integrated procedural performance instrument (IPPI): a randomized controlled trial. Am J Surg 2009; 197: 113-8.CrossRefPubMed Moulton CA, Tabak D, Kneebone R, Nestel D, MacRae H, LeBlanc VR. Teaching communication skills using the integrated procedural performance instrument (IPPI): a randomized controlled trial. Am J Surg 2009; 197: 113-8.CrossRefPubMed
27.
Zurück zum Zitat Hojat M, Xu G. A visitor’s guide to effect sizes: statistical significance versus practical (clinical) importance of research findings. Adv Health Sci Educ Theory Pract 2004; 9: 241-9.CrossRefPubMed Hojat M, Xu G. A visitor’s guide to effect sizes: statistical significance versus practical (clinical) importance of research findings. Adv Health Sci Educ Theory Pract 2004; 9: 241-9.CrossRefPubMed
28.
Zurück zum Zitat Curtis JR, Back AL, Ford DW, et al. Effect of communication skills training for residents and nurse practitioners on quality of communication with patients with serious illness: a randomized trial. JAMA 2013; 310: 2271-81.CrossRefPubMedPubMedCentral Curtis JR, Back AL, Ford DW, et al. Effect of communication skills training for residents and nurse practitioners on quality of communication with patients with serious illness: a randomized trial. JAMA 2013; 310: 2271-81.CrossRefPubMedPubMedCentral
29.
Zurück zum Zitat Cook DA, Beckman TJ. Reflections on experimental research in medical education. Adv Health Sci Educ Theory Pract 2010; 15: 455-64.CrossRefPubMed Cook DA, Beckman TJ. Reflections on experimental research in medical education. Adv Health Sci Educ Theory Pract 2010; 15: 455-64.CrossRefPubMed
30.
Zurück zum Zitat Larsen DP, Butler AC, Roediger HL 3rd. Test-enhanced learning in medical education. Med Educ 2008; 42: 959-66.CrossRefPubMed Larsen DP, Butler AC, Roediger HL 3rd. Test-enhanced learning in medical education. Med Educ 2008; 42: 959-66.CrossRefPubMed
32.
Zurück zum Zitat Park AJ, Barber MD, Bent AE, et al. Assessment of intraoperative judgment during gynecologic surgery using the script concordance test. Am J Obstet Gynecol 2010; 203(240): e1-6. Park AJ, Barber MD, Bent AE, et al. Assessment of intraoperative judgment during gynecologic surgery using the script concordance test. Am J Obstet Gynecol 2010; 203(240): e1-6.
33.
Zurück zum Zitat McGaghie WC, Harris IB. Learning theory foundations of simulation-based mastery learning. Simul Healthc 2018; 13: S15-20.CrossRefPubMed McGaghie WC, Harris IB. Learning theory foundations of simulation-based mastery learning. Simul Healthc 2018; 13: S15-20.CrossRefPubMed
34.
Zurück zum Zitat McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med 2011; 86: 706-11.CrossRefPubMedPubMedCentral McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad Med 2011; 86: 706-11.CrossRefPubMedPubMedCentral
35.
Zurück zum Zitat McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Med Educ 2010; 44: 50-63.CrossRefPubMed McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003-2009. Med Educ 2010; 44: 50-63.CrossRefPubMed
36.
Zurück zum Zitat McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. Revisiting ‘a critical review of simulation-based medical education research: 2003-2009’. Med Educ 2016; 50: 986-91.CrossRefPubMed McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. Revisiting ‘a critical review of simulation-based medical education research: 2003-2009’. Med Educ 2016; 50: 986-91.CrossRefPubMed
Metadaten
Titel
Resident competencies before and after short intensive care unit rotations: a multicentre pilot observational study
verfasst von
Dominique Piquette, MD, PhD, FRCPC
Alberto Goffi, MD
Christie Lee, MD, MSc, FRCPC
Ryan Brydges, PhD
Catharine M. Walsh, MD, PhD, FRCPC
Briseida Mema, MD, MEd, FRCPC
Chris Parshuram, MBChB, DPhil, FRACP
Publikationsdatum
10.11.2020
Verlag
Springer International Publishing
Erschienen in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Ausgabe 2/2021
Print ISSN: 0832-610X
Elektronische ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-020-01850-x

Weitere Artikel der Ausgabe 2/2021

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 2/2021 Zur Ausgabe

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.