Skip to main content
Hauptrubriken
CME Facharzt-Training Webinare Zeitschriften Bücher e.Medpedia Podcast
Service
Jobbörse Info & Hilfe
Fachgebiete
Anästhesiologie Allgemeinmedizin Arbeitsmedizin Augenheilkunde Chirurgie Dermatologie Gynäkologie und Geburtshilfe HNO Innere Medizin Kardiologie Neurologie Onkologie und Hämatologie Orthopädie und Unfallchirurgie Pädiatrie Pathologie Psychiatrie Radiologie Rechtsmedizin Urologie Zahnmedizin
Themen
Typ-2-Diabetes und Adipositas Klimawandel und Gesundheit Neues aus dem Markt COVID-19 Praxis und Beruf Seltene Erkrankungen GOÄ & EBM Panorama
Sammlungen
Kasuistiken Algorithmen & Infografiken Blickdiagnosen Arthropedia FlapFinder (für Dermatochirurgen) Videos Kongressberichterstattung Medizin für Apothekerinnen und Apotheker Für Ärztinnen und Ärzte in Weiterbildung Für Medizinstudierende

Die Highlights vom Kongress des American College of Cardiology 2024

Im April diskutierten die Herz-Kreislauf-Spezialisten aus der ganzen Welt auf dem  Kongress des American College of Cardiology (ACC) u.a. neue Therapieansätze bei akutem Myokardinfarkt, koronarer Herzerkrankung, kardiogenem Schock oder Aortenklappenstenose. In unserem Kongress-Dossier haben wir für Sie Berichte über die „Late-Breaking Trials“ und andere wichtige Studien zusammengestellt. 
Erweiterte Suche
Anmelden
nach oben
Journal of General Internal Medicine
Erschienen in: Journal of General Internal Medicine 14/2022

04.04.2022 | Original Research

Developing the Expected Entrustment Score: Accounting for Variation in Resident Assessment

verfasst von: Daniel P. Schauer, MD, MSc, Benjamin Kinnear, MD, MEd, Matthew Kelleher, MD, MEd, Dana Sall, MD, MEd, Daniel J. Schumacher, MD, PhD, MEd, Eric J. Warm, MD

Erschienen in: Journal of General Internal Medicine | Ausgabe 14/2022

Einloggen, um Zugang zu erhalten

Abstract

Background

Clinical competency committees (CCCs) and residency program leaders may find it difficult to interpret workplace-based assessment (WBA) ratings knowing that contextual factors and bias play a large role.

Objective

We describe the development of an expected entrustment score for resident performance within the context of our well-developed Observable Practice Activity (OPA) WBA system.

Design

Observational study

Participants

Internal medicine residents

Main Measure

Entrustment

Key Results

Each individual resident had observed entrustment scores with a unique relationship to the expected entrustment scores. Many residents’ observed scores oscillated closely around the expected scores. However, distinct performance patterns did emerge.

Conclusions

We used regression modeling and leveraged large numbers of historical WBA data points to produce an expected entrustment score that served as a guidepost for performance interpretation.
Literatur
1.
Lockyer J, Carraccio C, Chan MK, Hart D, Smee S, Touchie C, et al. Core principles of assessment in competency-based medical education. Medical teacher. 2017 Jun;39(6):609-16.CrossRefPubMed
2.
van der Vleuten CP, Schuwirth LW, Driessen EW, Govaerts MJ, Heeneman S. 12 tips for programmatic assessment. Medical teacher. 2014 Nov 20:1-6.
3.
Downing SM, Yudkowsy R. Assessment in health professions education. New York, NY: Routledge; 2009.CrossRef
4.
Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32(8):676-82.CrossRefPubMed
5.
Downing SM, Haladyna TM. Validity threats: overcoming interference with proposed interpretations of assessment data. Med Educ. 2004 Mar;38(3):327-33.CrossRefPubMed
6.
Downing SM. Threats to the validity of clinical teaching assessments: what about rater error? Medical education. 2005 Apr;39(4):353-5.CrossRefPubMed
7.
McManus IC, Thompson M, Mollon J. Assessment of examiner leniency and stringency (‘hawk-dove effect’) in the MRCP(UK) clinical examination (PACES) using multi-facet Rasch modelling. BMC Med Educ. 2006;6:42.CrossRefPubMed
8.
Kogan JR, Hess BJ, Conforti LN, Holmboe ES. What drives faculty ratings of residents’ clinical skills? The impact of faculty’s own clinical skills. Acad Med. 2010 Oct;85(10 Suppl):S25-8.CrossRefPubMed
9.
Kogan JR, Conforti L, Bernabeo E, Iobst W, Holmboe E. Opening the black box of clinical skills assessment via observation: a conceptual model. Medical education. 2011 Oct;45(10):1048-60.CrossRefPubMed
10.
Kogan JR, Conforti LN, Iobst WF, Holmboe ES. Reconceptualizing variable rater assessments as both an educational and clinical care problem. Academic medicine : journal of the Association of American Medical Colleges. 2014 May;89(5):721-7.CrossRef
11.
Albanese MA. Challenges in using rater judgements in medical education. J Eval Clin Pract. 2000 Aug;6(3):305-19.CrossRefPubMed
12.
Williams RG, Klamen DA, McGaghie WC. Cognitive, social and environmental sources of bias in clinical performance ratings. Teach Learn Med. 2003 Fall;15(4):270-92.CrossRefPubMed
13.
Kelleher M, Kinnear B, Sall D, Schumacher D, Schauer DP, Warm EJ, et al. A reliability analysis of entrustment-derived workplace-based assessments. Acad Med. 2020 Apr;95(4):616-22.CrossRefPubMed
14.
Downing S. YR. Assessment in health professions education: Routledge; 2009.CrossRef
15.
Yeates P, O’Neill P, Mann K, Eva K. Seeing the same thing differently: mechanisms that contribute to assessor differences in directly-observed performance assessments. Adv Health Sci Educ Theory Pract. 2013 Aug;18(3):325-41.CrossRefPubMed
16.
Feldman M, Lazzara EH, Vanderbilt AA, DiazGranados D. Rater training to support high-stakes simulation-based assessments. J Contin Educ Health Prof. 2012 Fall;32(4):279-86.CrossRefPubMed
17.
Holmboe ES, Hawkins RE, Huot SJ. Effects of training in direct observation of medical residents’ clinical competence: a randomized trial. Ann Intern Med. 2004 Jun 1;140(11):874-81.CrossRefPubMed
18.
Cook DA, Dupras DM, Beckman TJ, Thomas KG, Pankratz VS. Effect of rater training on reliability and accuracy of mini-CEX scores: a randomized, controlled trial. J Gen Intern Med. 2009 Jan;24(1):74-9.CrossRefPubMed
19.
Holmboe ES, Ward DS, Reznick RK, Katsufrakis PJ, Leslie KM, Patel VL, et al. Faculty development in assessment: the missing link in competency-based medical education. Acad Med. 2011 Apr;86(4):460-7.CrossRefPubMed
20.
Govaerts MJ, van der Vleuten CP, Schuwirth LW, Muijtjens AM. Broadening perspectives on clinical performance assessment: rethinking the nature of in-training assessment. Adv Health Sci Educ Theory Pract. 2007 May;12(2):239-60.CrossRefPubMed
21.
Holmboe ES, Sherbino J, Englander R, Snell L, Frank JR, Collaborators I. A call to action: the controversy of and rationale for competency-based medical education. Medical teacher. 2017 Jun;39(6):574-81.CrossRefPubMed
22.
Baker K. Determining resident clinical performance: getting beyond the noise. Anesthesiology. 2011 Oct;115(4):862-78.CrossRefPubMed
23.
Wanderer JP, de Oliveira Filho GR, Rothman BS, Sandberg WS, McEvoy MD. Implementation and evaluation of the z-score system for normalizing residency evaluations. Anesthesiology. 2018 Jan;128(1):144-58.CrossRefPubMed
24.
Warm EJ, Mathis BR, Held JD, Pai S, Tolentino J, Ashbrook L, et al. Entrustment and mapping of observable practice activities for resident assessment. J Gen Intern Med. 2014 Aug;29(8):1177-82.CrossRefPubMed
25.
Warm EJ, Held JD, Hellmann M, Kelleher M, Kinnear B, Lee C, et al. Entrusting observable practice activities and milestones over the 36 months of an internal medicine residency. Acad Med. 2016 Oct;91(10):1398-405.CrossRefPubMed
26.
Reinstein I, Hill J, Cook DA, Lineberry M, Pusic MV. Multi-level longitudinal learning curve regression models integrated with item difficulty metrics for deliberate practice of visual diagnosis: groundwork for adaptive learning. Adv Health Sci Educ Theory Pract. 2021 Aug;26(3):881-912.CrossRefPubMed
27.
Hatala R, Gutman J, Lineberry M, Triola M, Pusic M. How well is each learner learning? Validity investigation of a learning curve-based assessment approach for ECG interpretation. Adv Health Sci Educ Theory Pract. 2019 Mar;24(1):45-63.CrossRefPubMed
28.
Howard NM, Cook DA, Hatala R, Pusic MV. Learning curves in health professions education simulation research: a systematic review. Simul Healthc. 2021 Apr 1;16(2):128-35.CrossRefPubMed
29.
Hodwitz K, Kuper A, Brydges R. Realizing one’s own subjectivity: assessors’ perceptions of the influence of training on their conduct of workplace-based assessments. Acad Med. 2019 Dec;94(12):1970-9.CrossRefPubMed
30.
Hodges B. Assessment in the post-psychometric era: learning to love the subjective and collective. Med Teach. 2013 Jul;35(7):564-8.CrossRefPubMed
31.
Ten Cate O, Regehr G. The power of subjectivity in the assessment of medical trainees. Acad Med. 2019 Mar;94(3):333-7.CrossRefPubMed
32.
Warm EJ, Kinnear B, Kelleher M, Sall D, Holmboe E. Transforming resident assessment: an analysis using Deming’s system of profound knowledge. Academic Medicine. 2019;94(2):195-201.CrossRefPubMed
33.
Ten Cate O, Schwartz A, Chen HC. Assessing trainees and making entrustment decisions: on the nature and use of entrustment-supervision scales. Acad Med. 2020 Nov;95(11):1662-9.CrossRefPubMed
Metadaten
Titel
Developing the Expected Entrustment Score: Accounting for Variation in Resident Assessment
verfasst von
Daniel P. Schauer, MD, MSc
Benjamin Kinnear, MD, MEd
Matthew Kelleher, MD, MEd
Dana Sall, MD, MEd
Daniel J. Schumacher, MD, PhD, MEd
Eric J. Warm, MD
Publikationsdatum
04.04.2022
Verlag
Springer International Publishing
Erschienen in
Journal of General Internal Medicine / Ausgabe 14/2022
Print ISSN: 0884-8734
Elektronische ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-022-07492-7

Weitere Artikel der Ausgabe 14/2022

Journal of General Internal Medicine 14/2022 Zur Ausgabe

Concise Research Report

Association of Sex and Ethnoracial Identities with Attrition from Medical School

Original Research

Incidence and Predictors of Primary Nonadherence to Sodium Glucose Co-transporter 2 Inhibitors and Glucagon-Like Peptide 1 Agonists in a Large Integrated Healthcare System

Original Research

Association of State-Imposed Restrictions on Gabapentin with Changes in Prescribing in Medicare

Original Research

Prevalent Multimorbidity Combinations Among Middle-Aged and Older Adults Seen in Community Health Centers

Healing Arts

Seeing Christina’s World

Original Research

Association Between Provider-Sponsored Health Plan Ownership and Health Insurance Marketplace Plan Quality

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Kostenlos registrieren

Neu im Fachgebiet Innere Medizin

„Überwältigende“ Evidenz für Tripeltherapie beim metastasierten Prostata-Ca.

22.05.2024 Prostatakarzinom Nachrichten

Patienten mit metastasiertem hormonsensitivem Prostatakarzinom sollten nicht mehr mit einer alleinigen Androgendeprivationstherapie (ADT) behandelt werden, mahnt ein US-Team nach Sichtung der aktuellen Datenlage. Mit einer Tripeltherapie haben die Betroffenen offenbar die besten Überlebenschancen.

So sicher sind Tattoos: Neue Daten zur Risikobewertung

22.05.2024 Melanom Nachrichten

Das größte medizinische Problem bei Tattoos bleiben allergische Reaktionen. Melanome werden dadurch offensichtlich nicht gefördert, die Farbpigmente könnten aber andere Tumoren begünstigen.

CAR-M-Zellen: Warten auf das große Fressen

22.05.2024 Onkologische Immuntherapie Nachrichten

Auch myeloide Immunzellen lassen sich mit chimären Antigenrezeptoren gegen Tumoren ausstatten. Solche CAR-Fresszell-Therapien werden jetzt für solide Tumoren entwickelt. Künftig soll dieser Prozess nicht mehr ex vivo, sondern per mRNA im Körper der Betroffenen erfolgen.

Frühzeitige HbA1c-Kontrolle macht sich lebenslang bemerkbar

22.05.2024 Typ-2-Diabetes Nachrichten

Menschen mit Typ-2-Diabetes von Anfang an intensiv BZ-senkend zu behandeln, wirkt sich positiv auf Komplikationen und Mortalität aus – und das offenbar lebenslang, wie eine weitere Nachfolgeuntersuchung der UKPD-Studie nahelegt.

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.

Newsletter bestellen
Bildnachweise