Skip to main content
Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie 10/2020

13.07.2020 | Reports of Original Investigations

Logging in: a comparative analysis of electronic health records versus anesthesia resident-driven logbooks

verfasst von: Ryan McGinn, MD, MSc, Alexander J. Lingley, MSc, Daniel I. McIsaac, MD, MPH, Christopher Pysyk, MD, Meghan C. McConnell, PhD, Gregory L. Bryson, MD, Daniel Dubois, MD

Erschienen in: Canadian Journal of Anesthesia/Journal canadien d'anesthésie | Ausgabe 10/2020

Einloggen, um Zugang zu erhalten

Abstract

Purpose

Resident logbooks (RLBs) documenting clinical case exposure are widespread in medical education despite evidence of poor accuracy. Electronic health records (e.g., anesthesia information management systems [AIMS]) may provide advantages for auditing longitudinal case exposure. We evaluated the agreement between AIMS and RLBs for tracking case exposure during anesthesiology residency.

Methods

We performed a historical cohort study with anesthesiology residents (2011–2018, all of whom used a RLB contemporaneously with AIMS) working in a multisite academic health sciences network. The primary outcome was total case-load logging; secondary outcomes were volumes for seven surgical specialties (general, gynecology, neuro, orthopedic, thoracic, urology, and vascular surgery). Correlation of case numbers tracked by AIMS vs RLB was assessed using Pearson correlation; agreement was determined using Bland–Altman plots and intraclass correlation coefficients (ICC).

Results

Data from 27 anesthesiology residents were collected. Overall, mean (standard deviation) case numbers were generally greater with AIMS vs RLB [649 (103) vs 583 (191); P = 0.049). Total case volumes between systems had moderate correlation (r = 0.50) and agreement (intraclass correlation coefficient [ICC], 0.42; 95% CI, 0.34 to 0.59). Bland–Altman plots showed variable agreement between AIMS and RLB data [mean (SD) bias = 66 (166) cases]. For general, gynecology, neuro, orthopedic, thoracic, urology, and vascular surgery, there was a range of poor to moderate agreement (ICC, 0.23–0.57) between AIMS and RLB.

Conclusion

For anesthesiology resident case-logging, the number of cases logged in an AIMS was higher with lower variance compared with RLBs. Anesthesia information management systems vs RLB data showed low–moderate correlation and agreement. Given the additional time and resources required for RLBs, AIMS may be a superior method for tracking cases where available.
Literatur
1.
Zurück zum Zitat Fraser AB, Stodel EJ, Chaput AJ. Curriculum reform for residency training: competence, change, and opportunities for leadership. Can J Anesth 2016; 63: 875-84.CrossRef Fraser AB, Stodel EJ, Chaput AJ. Curriculum reform for residency training: competence, change, and opportunities for leadership. Can J Anesth 2016; 63: 875-84.CrossRef
2.
Zurück zum Zitat Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach 2010; 32: 676-82.CrossRef Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach 2010; 32: 676-82.CrossRef
5.
Zurück zum Zitat Schuttpelz-Brauns K, Narciss E, Schneyinck C, et al. Twelve tips for successfully implementing logbooks in clinical training. Med Teach 2016; 38: 564-9.CrossRef Schuttpelz-Brauns K, Narciss E, Schneyinck C, et al. Twelve tips for successfully implementing logbooks in clinical training. Med Teach 2016; 38: 564-9.CrossRef
6.
Zurück zum Zitat Witt A, Iglesias S, Ashbury T. Evaluation of Canadian family practice anesthesia training programs: can the resident logbook help? Can J Anesth 2012; 59: 968-73.CrossRef Witt A, Iglesias S, Ashbury T. Evaluation of Canadian family practice anesthesia training programs: can the resident logbook help? Can J Anesth 2012; 59: 968-73.CrossRef
7.
Zurück zum Zitat Chou S, Lockyer J, Cole G, McLaughlin K. Assessing postgraduate trainees in Canada: are we achieving diversity in methods? Med Teach 2009; 31: e58-63.CrossRef Chou S, Lockyer J, Cole G, McLaughlin K. Assessing postgraduate trainees in Canada: are we achieving diversity in methods? Med Teach 2009; 31: e58-63.CrossRef
8.
Zurück zum Zitat Luke C, Kadzombe E, Armstrong A, Gorman D, Horner J. An evaluation of a logbook for trainees in accident and emergency medicine in the United Kingdom. Arch Emerg Med 1991; 8: 130-4.CrossRef Luke C, Kadzombe E, Armstrong A, Gorman D, Horner J. An evaluation of a logbook for trainees in accident and emergency medicine in the United Kingdom. Arch Emerg Med 1991; 8: 130-4.CrossRef
9.
Zurück zum Zitat Raghoebar-Krieger HM, Sleijfer D, Bender W, Stewart RE, Popping R. The reliability of logbook data of medical students: an estimation of interobserver agreement, sensitivity and specificity. Med Educ 2001; 35: 624-31.CrossRef Raghoebar-Krieger HM, Sleijfer D, Bender W, Stewart RE, Popping R. The reliability of logbook data of medical students: an estimation of interobserver agreement, sensitivity and specificity. Med Educ 2001; 35: 624-31.CrossRef
10.
Zurück zum Zitat Simpao AF, Pruitt EY, Cook-Sather SD, Gurnaney HG, Rehman MA. The reliability of manual reporting of clinical events in an anesthesia information management system (AIMS). J Clin Monit Comput 2012; 26: 437-9.CrossRef Simpao AF, Pruitt EY, Cook-Sather SD, Gurnaney HG, Rehman MA. The reliability of manual reporting of clinical events in an anesthesia information management system (AIMS). J Clin Monit Comput 2012; 26: 437-9.CrossRef
11.
Zurück zum Zitat Wanderer JP, Charnin J, Driscoll WD, Bailin MT, Baker K. Decision support using anesthesia information management system records and accreditation council for graduate medical education case logs for resident operating room assignments. Anesth Analg 2013; 117: 494-9.CrossRef Wanderer JP, Charnin J, Driscoll WD, Bailin MT, Baker K. Decision support using anesthesia information management system records and accreditation council for graduate medical education case logs for resident operating room assignments. Anesth Analg 2013; 117: 494-9.CrossRef
12.
Zurück zum Zitat Galvez JA, Rothman BS, Doyle CA, Morgan S, Simpao AF, Rehman MA. A narrative review of meaningful use and anesthesia information management systems. Anesth Analg 2015; 121: 693-706.CrossRef Galvez JA, Rothman BS, Doyle CA, Morgan S, Simpao AF, Rehman MA. A narrative review of meaningful use and anesthesia information management systems. Anesth Analg 2015; 121: 693-706.CrossRef
16.
Zurück zum Zitat Wheeler K, Baxter A, Boet S, Pysyk C, Bryson GL. Performance feedback in anesthesia: a post-implementation survey. Can J Anesth 2017; 64: 681-2.CrossRef Wheeler K, Baxter A, Boet S, Pysyk C, Bryson GL. Performance feedback in anesthesia: a post-implementation survey. Can J Anesth 2017; 64: 681-2.CrossRef
17.
Zurück zum Zitat Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep 1966; 19: 3-11.CrossRef Bartko JJ. The intraclass correlation coefficient as a measure of reliability. Psychol Rep 1966; 19: 3-11.CrossRef
18.
Zurück zum Zitat Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1: 307-10.CrossRef Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986; 1: 307-10.CrossRef
19.
Zurück zum Zitat Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979; 86: 420-8.CrossRef Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull 1979; 86: 420-8.CrossRef
20.
Zurück zum Zitat Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016; 15: 155-63.CrossRef Koo TK, Li MY. A Guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med 2016; 15: 155-63.CrossRef
21.
Zurück zum Zitat Yamamoto S, Tanaka P, Madsen MV, Macario A. Analysis of resident case logs in an anesthesiology residency program. A A Case Rep 2016; 6: 257-62.CrossRef Yamamoto S, Tanaka P, Madsen MV, Macario A. Analysis of resident case logs in an anesthesiology residency program. A A Case Rep 2016; 6: 257-62.CrossRef
22.
Zurück zum Zitat Cadish LA, Fung V, Lane FL, Campbell EG. Surgical case logging habits and attitudes: a multispecialty survey of residents. J Surg Educ 2016; 73: 474-81.CrossRef Cadish LA, Fung V, Lane FL, Campbell EG. Surgical case logging habits and attitudes: a multispecialty survey of residents. J Surg Educ 2016; 73: 474-81.CrossRef
Metadaten
Titel
Logging in: a comparative analysis of electronic health records versus anesthesia resident-driven logbooks
verfasst von
Ryan McGinn, MD, MSc
Alexander J. Lingley, MSc
Daniel I. McIsaac, MD, MPH
Christopher Pysyk, MD
Meghan C. McConnell, PhD
Gregory L. Bryson, MD
Daniel Dubois, MD
Publikationsdatum
13.07.2020
Verlag
Springer International Publishing
Erschienen in
Canadian Journal of Anesthesia/Journal canadien d'anesthésie / Ausgabe 10/2020
Print ISSN: 0832-610X
Elektronische ISSN: 1496-8975
DOI
https://doi.org/10.1007/s12630-020-01761-x

Weitere Artikel der Ausgabe 10/2020

Canadian Journal of Anesthesia/Journal canadien d'anesthésie 10/2020 Zur Ausgabe

Sind Frauen die fähigeren Ärzte?

30.04.2024 Gendermedizin Nachrichten

Patienten, die von Ärztinnen behandelt werden, dürfen offenbar auf bessere Therapieergebnisse hoffen als Patienten von Ärzten. Besonders gilt das offenbar für weibliche Kranke, wie eine Studie zeigt.

Akuter Schwindel: Wann lohnt sich eine MRT?

28.04.2024 Schwindel Nachrichten

Akuter Schwindel stellt oft eine diagnostische Herausforderung dar. Wie nützlich dabei eine MRT ist, hat eine Studie aus Finnland untersucht. Immerhin einer von sechs Patienten wurde mit akutem ischämischem Schlaganfall diagnostiziert.

Bei schweren Reaktionen auf Insektenstiche empfiehlt sich eine spezifische Immuntherapie

Insektenstiche sind bei Erwachsenen die häufigsten Auslöser einer Anaphylaxie. Einen wirksamen Schutz vor schweren anaphylaktischen Reaktionen bietet die allergenspezifische Immuntherapie. Jedoch kommt sie noch viel zu selten zum Einsatz.

Hinter dieser Appendizitis steckte ein Erreger

23.04.2024 Appendizitis Nachrichten

Schmerzen im Unterbauch, aber sonst nicht viel, was auf eine Appendizitis hindeutete: Ein junger Mann hatte Glück, dass trotzdem eine Laparoskopie mit Appendektomie durchgeführt und der Wurmfortsatz histologisch untersucht wurde.

Update AINS

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.