Skip to main content
Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 12/2017

06.10.2017 | Reports of Original Investigations

The effect of simulator fidelity on acquiring non-technical skills: a randomized non-inferiority trial

verfasst von: Yuqi Gu, BSc, MD, FRCPC, Tobias Witter, MD, FRCPC, Patty Livingston, MD, FRCPC, MEd, Purnima Rao, BSc, MD, FRCPC, Terry Varshney, MDCM, FRCPC, Tom Kuca, BSc, MD, FRCPC, M. Dylan Bould, MB, ChB, MRCP, FRCA, MEd

Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Ausgabe 12/2017

Einloggen, um Zugang zu erhalten

Abstract

Introduction

As simulator fidelity (i.e., realism) increases from low to high, the simulator more closely resembles the real environment, but it also becomes more expensive. It is generally assumed that the use of high-fidelity simulators results in better learning; however, the effect of fidelity on learning non-technical skills (NTS) is unknown. This was a non-inferiority trial comparing the efficacy of high- vs low-fidelity simulators on learning NTS.

Methods

Thirty-six postgraduate medical trainees were recruited for the trial. During the pre-test phase, the trainees were randomly assigned to manage a scenario using either a high-fidelity simulator (HFS) or a low-fidelity simulator (LFS), followed by expert debriefing. All trainees then underwent a video recorded post-test scenario on a HFS, and the NTS were assessed between the two groups. The primary outcome was the overall post-test Ottawa Global Rating Scale (OGRS), while controlling for overall pre-test OGRS scores. Non-inferiority between the LFS and HFS was based on a non-inferiority margin of greater than 1.

Results

For our primary outcome, the mean (SD) post-test overall OGRS score was not significantly different between the HFS and LFS groups after controlling for pre-test overall OGRS scores [3.8 (0.9) vs 4.0 (0.9), respectively; mean difference, 0.2; 95% confidence interval, −0.4 to 0.8; P = 0.48]. For our secondary outcomes, the post-test total OGRS score was not significantly different between the HFS and LFS groups after controlling for pre-test total OGRS scores (P = 0.33). There were significant improvements in mean overall (P = 0.01) and total (P = 0.003) OGRS scores from pre-test to post-test. There were no significant associations between postgraduate year (P = 0.82) and specialty (P = 0.67) on overall OGRS performance.

Conclusion

This study suggests that low-fidelity simulators are non-inferior to the more costly high-fidelity simulators for teaching NTS to postgraduate medical trainees.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Leblanc VR. Review article: Simulation in anesthesia: state of the science and looking forward. Can J Anesth 2012; 59: 193-202.CrossRefPubMed Leblanc VR. Review article: Simulation in anesthesia: state of the science and looking forward. Can J Anesth 2012; 59: 193-202.CrossRefPubMed
2.
Zurück zum Zitat Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: an ethical imperative. Acad Med 2003; 78: 783-8.CrossRefPubMed Ziv A, Wolpe PR, Small SD, Glick S. Simulation-based medical education: an ethical imperative. Acad Med 2003; 78: 783-8.CrossRefPubMed
3.
Zurück zum Zitat Cook DA, Brydges R, Hamstra SJ, et al. Comparative effectiveness of technology-enhanced simulation versus other instructional methods: a systematic review and meta-analysis. Simul Healthc 2012; 7: 308-20.CrossRefPubMed Cook DA, Brydges R, Hamstra SJ, et al. Comparative effectiveness of technology-enhanced simulation versus other instructional methods: a systematic review and meta-analysis. Simul Healthc 2012; 7: 308-20.CrossRefPubMed
4.
Zurück zum Zitat Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011; 306: 978-88.PubMed Cook DA, Hatala R, Brydges R, et al. Technology-enhanced simulation for health professions education: a systematic review and meta-analysis. JAMA 2011; 306: 978-88.PubMed
5.
Zurück zum Zitat Price JW, Price JR, Pratt DD, Collins JB, McDonald J. High-fidelity simulation in anesthesiology training: a survey of Canadian anesthesiology residents’ simulator experience. Can J Anesth 2010; 57: 134-42.CrossRefPubMed Price JW, Price JR, Pratt DD, Collins JB, McDonald J. High-fidelity simulation in anesthesiology training: a survey of Canadian anesthesiology residents’ simulator experience. Can J Anesth 2010; 57: 134-42.CrossRefPubMed
6.
Zurück zum Zitat Kurrek MM, Devitt JH. The cost for construction and operation of a simulation centre. Can J Anesth 1997; 44: 1191-5.CrossRefPubMed Kurrek MM, Devitt JH. The cost for construction and operation of a simulation centre. Can J Anesth 1997; 44: 1191-5.CrossRefPubMed
7.
Zurück zum Zitat Zendejas B, Wang AT, Brydges R, Hamstra SJ, Cook DA. Cost: the missing outcome in simulation-based medical education research: a systematic review. Surgery 2013; 153: 160-76.CrossRefPubMed Zendejas B, Wang AT, Brydges R, Hamstra SJ, Cook DA. Cost: the missing outcome in simulation-based medical education research: a systematic review. Surgery 2013; 153: 160-76.CrossRefPubMed
8.
Zurück zum Zitat Maran NJ, Glavin RJ. Low- to high-fidelity simulation - a continuum of medical education? Med Educ 2003; 37(Suppl 1): 22-8.CrossRefPubMed Maran NJ, Glavin RJ. Low- to high-fidelity simulation - a continuum of medical education? Med Educ 2003; 37(Suppl 1): 22-8.CrossRefPubMed
9.
Zurück zum Zitat Norman G, Dore K, Grierson L. The minimal relationship between simulation fidelity and transfer of learning. Med Educ 2012; 46: 636-47.CrossRefPubMed Norman G, Dore K, Grierson L. The minimal relationship between simulation fidelity and transfer of learning. Med Educ 2012; 46: 636-47.CrossRefPubMed
10.
Zurück zum Zitat Flin RH, Crichton M, O’Connor P. Safety at the sharp end: a guide to non-technical skills. Farnham: Ashgate Publishing Ltd.; 2013 . Flin RH, Crichton M, O’Connor P. Safety at the sharp end: a guide to non-technical skills. Farnham: Ashgate Publishing Ltd.; 2013 .
11.
Zurück zum Zitat Riem N, Boet S, Bould MD, Tavares W, Naik VN. Do technical skills correlate with non-technical skills in crisis resource management: a simulation study. Br J Anaesth 2012; 109: 723-8.CrossRefPubMedPubMedCentral Riem N, Boet S, Bould MD, Tavares W, Naik VN. Do technical skills correlate with non-technical skills in crisis resource management: a simulation study. Br J Anaesth 2012; 109: 723-8.CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Fletcher GC, McGeorge P, Flin RH, Glavin RJ, Maran NJ. The role of non-technical skills in anaesthesia: a review of current literature. Br J Anaesth 2002; 88: 418-29.CrossRefPubMed Fletcher GC, McGeorge P, Flin RH, Glavin RJ, Maran NJ. The role of non-technical skills in anaesthesia: a review of current literature. Br J Anaesth 2002; 88: 418-29.CrossRefPubMed
13.
Zurück zum Zitat Yee B, Naik VN, Joo HS, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology 2005; 103: 241-8.CrossRefPubMed Yee B, Naik VN, Joo HS, et al. Nontechnical skills in anesthesia crisis management with repeated exposure to simulation-based education. Anesthesiology 2005; 103: 241-8.CrossRefPubMed
14.
Zurück zum Zitat Finan E, Bismilla Z, Whyte HE, Leblanc V, McNamara PJ. High-fidelity simulator technology may not be superior to traditional low-fidelity equipment for neonatal resuscitation training. J Perinatol 2012; 32: 287-92.CrossRefPubMed Finan E, Bismilla Z, Whyte HE, Leblanc V, McNamara PJ. High-fidelity simulator technology may not be superior to traditional low-fidelity equipment for neonatal resuscitation training. J Perinatol 2012; 32: 287-92.CrossRefPubMed
15.
Zurück zum Zitat Cheng A, Hunt EA, Donoghue A, et al. Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial. JAMA Pediatr 2013; 167: 528-36.CrossRefPubMed Cheng A, Hunt EA, Donoghue A, et al. Examining pediatric resuscitation education using simulation and scripted debriefing: a multicenter randomized trial. JAMA Pediatr 2013; 167: 528-36.CrossRefPubMed
16.
Zurück zum Zitat Kim J, Neilipovitz D, Cardinal P, Chiu M. A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as “CRM simulator study IB”). Simul Healthc 2009; 4: 6-16.CrossRefPubMed Kim J, Neilipovitz D, Cardinal P, Chiu M. A comparison of global rating scale and checklist scores in the validation of an evaluation tool to assess performance in the resuscitation of critically ill patients during simulated emergencies (abbreviated as “CRM simulator study IB”). Simul Healthc 2009; 4: 6-16.CrossRefPubMed
17.
Zurück zum Zitat Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med 2006; 34: 2167-74.CrossRefPubMed Kim J, Neilipovitz D, Cardinal P, Chiu M, Clinch J. A pilot study using high-fidelity simulation to formally evaluate performance in the resuscitation of critically ill patients: The University of Ottawa Critical Care Medicine, High-Fidelity Simulation, and Crisis Resource Management I Study. Crit Care Med 2006; 34: 2167-74.CrossRefPubMed
18.
Zurück zum Zitat Arora S, Ahmed M, Paige J, et al. Objective structured assessment of debriefing: bringing science to the art of debriefing in surgery. Ann Surg 2012; 256: 982-8.CrossRefPubMed Arora S, Ahmed M, Paige J, et al. Objective structured assessment of debriefing: bringing science to the art of debriefing in surgery. Ann Surg 2012; 256: 982-8.CrossRefPubMed
19.
Zurück zum Zitat Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977; 33: 159-74.CrossRefPubMed
20.
Zurück zum Zitat Clarke S, Horeczko T, Carlisle M, et al. Emergency medicine resident crisis resource management ability: a simulation-based longitudinal study. Med Educ Online 2014; 19: 25771.CrossRef Clarke S, Horeczko T, Carlisle M, et al. Emergency medicine resident crisis resource management ability: a simulation-based longitudinal study. Med Educ Online 2014; 19: 25771.CrossRef
21.
Zurück zum Zitat Hamstra SJ, Brydges R, Hatala R, Zendejas B, Cook DA. Reconsidering fidelity in simulation-based training. Acad Med 2014; 89: 387-92.CrossRefPubMed Hamstra SJ, Brydges R, Hatala R, Zendejas B, Cook DA. Reconsidering fidelity in simulation-based training. Acad Med 2014; 89: 387-92.CrossRefPubMed
22.
Zurück zum Zitat Farmer E, Van Rooij J, Riemersma J, Moraal J, Jorna P. Handbook of simulator-based training. Farnham: Ashgate Publishing; 1999 . Farmer E, Van Rooij J, Riemersma J, Moraal J, Jorna P. Handbook of simulator-based training. Farnham: Ashgate Publishing; 1999 .
23.
Zurück zum Zitat Rudolph JW, Simon R, Raemer DB. Which reality matters? Questions on the path to high engagement in healthcare simulation. Simul Healthc 2007; 2: 161-3.CrossRefPubMed Rudolph JW, Simon R, Raemer DB. Which reality matters? Questions on the path to high engagement in healthcare simulation. Simul Healthc 2007; 2: 161-3.CrossRefPubMed
24.
Zurück zum Zitat Dieckmann P, Gaba D, Rall M. Deepening the theoretical foundations of patient simulation as social practice. Simul Healthc 2007; 2: 183-93.CrossRefPubMed Dieckmann P, Gaba D, Rall M. Deepening the theoretical foundations of patient simulation as social practice. Simul Healthc 2007; 2: 183-93.CrossRefPubMed
25.
Zurück zum Zitat Skelton T, Nshimyumuremyi I, Mukwesi C, Whynot S, Zolpys L, Livingston P. Low-cost simulation to teach anesthetists’ non-technical skills in Rwanda. Anesth Analg 2016; 123: 474-80.CrossRefPubMed Skelton T, Nshimyumuremyi I, Mukwesi C, Whynot S, Zolpys L, Livingston P. Low-cost simulation to teach anesthetists’ non-technical skills in Rwanda. Anesth Analg 2016; 123: 474-80.CrossRefPubMed
Metadaten
Titel
The effect of simulator fidelity on acquiring non-technical skills: a randomized non-inferiority trial
verfasst von
Yuqi Gu, BSc, MD, FRCPC
Tobias Witter, MD, FRCPC
Patty Livingston, MD, FRCPC, MEd
Purnima Rao, BSc, MD, FRCPC
Terry Varshney, MDCM, FRCPC
Tom Kuca, BSc, MD, FRCPC
M. Dylan Bould, MB, ChB, MRCP, FRCA, MEd
Publikationsdatum
06.10.2017
Verlag
Springer US
Erschienen in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Ausgabe 12/2017
Print ISSN: 0832-610X
Elektronische ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-017-0973-2

Weitere Artikel der Ausgabe 12/2017

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 12/2017 Zur Ausgabe

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.