Skip to main content
Erschienen in: Journal of General Internal Medicine 6/2022

09.09.2021 | Original Research

Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial

verfasst von: Daniella Meeker, PhD, Mark W. Friedberg, MD, MPP, Tara K. Knight, PhD, Jason N. Doctor, PhD, Dina Zein, MHA, Nancy Cayasso-McIntosh, MPH, Noah J. Goldstein, PhD, Craig R. Fox, PhD, Jeffrey A. Linder, MD, MPH, Stephen D. Persell, MD, MPH, Stanley Dea, MD, Paul Giboney, MD, Hal F. Yee, MD, PhD, The Behavioral Economics and eConsult Steering Committee

Erschienen in: Journal of General Internal Medicine | Ausgabe 6/2022

Einloggen, um Zugang zu erhalten

ABSTRACT

Background

Since the advent of COVID-19, accelerated adoption of systems that reduce face-to-face encounters has outpaced training and best practices. Electronic consultations (eConsults), structured communications between PCPs and specialists regarding a case, have been effective in reducing face-to-face specialist encounters. As the health system rapidly adapts to multiple new practices and communication tools, new mechanisms to measure and improve performance in this context are needed.

Objective

To test whether feedback comparing physicians to top performing peers using co-specialists’ ratings improves performance.

Design

Cluster-randomized controlled trial

Participants

Eighty facility-specialty clusters and 214 clinicians

Intervention

Providers in the feedback arms were sent messages that announced their membership in an elite group of “Top Performers” or provided actionable recommendations with feedback for providers that were “Not Top Performers.”

Main Measures

The primary outcomes were changes in peer ratings in the following performance dimensions after feedback was received: (1) elicitation of information from primary care practitioners; (2) adherence to institutional clinical guidelines; (3) agreement with peer’s medical decision-making; (4) educational value; (5) relationship building.

Key Results

Specialists showed significant improvements on 3 of the 5 consultation performance dimensions: medical decision-making (odds ratio 1.52, 95% confidence interval 1.08–2.14, p<.05), educational value (1.86, 1.17–2.96) and relationship building (1.63, 1.13–2.35) (both p<.01).

Conclusions

The pandemic has shed light on clinicians’ commitment to professionalism and service as we rapidly adapt to changing paradigms. Interventions that appeal to professional norms can help improve the efficacy of new systems of practice. We show that specialists’ performance can be measured and improved with feedback using aspirational norms.

Trial Registration

Anhänge
Nur mit Berechtigung zugänglich
Literatur
2.
Zurück zum Zitat Forrest CB, Glade GB, Baker AE, Bocian A, von Schrader S, Starfield B. Coordination of specialty referrals and physician satisfaction with referral care. Arch Pediatr Adolesc Med. 2000;154(5):499-506.CrossRef Forrest CB, Glade GB, Baker AE, Bocian A, von Schrader S, Starfield B. Coordination of specialty referrals and physician satisfaction with referral care. Arch Pediatr Adolesc Med. 2000;154(5):499-506.CrossRef
3.
Zurück zum Zitat Liddy C, Afkham A, Drosinis P, Joschko J, Keely E. Impact of and Satisfaction with a New eConsult Service: A Mixed Methods Study of Primary Care Providers. J Am Board Fam Med. 2015;28(3):394-403.CrossRef Liddy C, Afkham A, Drosinis P, Joschko J, Keely E. Impact of and Satisfaction with a New eConsult Service: A Mixed Methods Study of Primary Care Providers. J Am Board Fam Med. 2015;28(3):394-403.CrossRef
4.
Zurück zum Zitat Keely E, Canning S, Saloojee N, Afkham A, Liddy C. Improving Access to Gastroenterologist Using eConsultation: A Way to Potentially Shorten Wait Times. J Can Assoc Gastroenterol. 2018;1(3):124-128.CrossRef Keely E, Canning S, Saloojee N, Afkham A, Liddy C. Improving Access to Gastroenterologist Using eConsultation: A Way to Potentially Shorten Wait Times. J Can Assoc Gastroenterol. 2018;1(3):124-128.CrossRef
5.
Zurück zum Zitat Schettini P, Shah KP, O’Leary CP, et al. Keeping care connected: e-Consultation program improves access to nephrology care. J Telemed Telecare. Published online January 1, 2017:1357633X17748350. Schettini P, Shah KP, O’Leary CP, et al. Keeping care connected: e-Consultation program improves access to nephrology care. J Telemed Telecare. Published online January 1, 2017:1357633X17748350.
6.
Zurück zum Zitat Gleason N, Prasad PA, Ackerman S, et al. Adoption and impact of an eConsult system in a fee-for-service setting. Healthc (Amst). 2017;5(1-2):40-45.CrossRef Gleason N, Prasad PA, Ackerman S, et al. Adoption and impact of an eConsult system in a fee-for-service setting. Healthc (Amst). 2017;5(1-2):40-45.CrossRef
7.
Zurück zum Zitat Lee MS, Ray KN, Mehrotra A, Giboney P, Yee HF Jr, Barnett ML. Primary Care Practitioners’ Perceptions of Electronic Consult Systems: A Qualitative Analysis. JAMA Intern Med. 2018;178(6):782-789.CrossRef Lee MS, Ray KN, Mehrotra A, Giboney P, Yee HF Jr, Barnett ML. Primary Care Practitioners’ Perceptions of Electronic Consult Systems: A Qualitative Analysis. JAMA Intern Med. 2018;178(6):782-789.CrossRef
8.
Zurück zum Zitat Naseriasl M, Adham D, Janati A. E-referral Solutions: Successful Experiences, Key Features and Challenges- a Systematic Review. Mater Sociomed. 2015;27(3):195-199.CrossRef Naseriasl M, Adham D, Janati A. E-referral Solutions: Successful Experiences, Key Features and Challenges- a Systematic Review. Mater Sociomed. 2015;27(3):195-199.CrossRef
9.
Zurück zum Zitat Barnett ML, Yee HF Jr, Mehrotra A, Giboney P. Los Angeles Safety-Net Program eConsult System Was Rapidly Adopted And Decreased Wait Times To See Specialists. Health Aff . 2017;36(3):492-499.CrossRef Barnett ML, Yee HF Jr, Mehrotra A, Giboney P. Los Angeles Safety-Net Program eConsult System Was Rapidly Adopted And Decreased Wait Times To See Specialists. Health Aff . 2017;36(3):492-499.CrossRef
11.
Zurück zum Zitat Hefzy EM, Wegdan AA, Abdel Wahed WY. Hospital outpatient clinics as a potential hazard for healthcare associated infections. J Infect Public Health. 2016;9(1):88-97.CrossRef Hefzy EM, Wegdan AA, Abdel Wahed WY. Hospital outpatient clinics as a potential hazard for healthcare associated infections. J Infect Public Health. 2016;9(1):88-97.CrossRef
13.
Zurück zum Zitat Pham HH, O’Malley AS, Bach PB, Saiontz-Martinez C, Schrag D. Primary care physicians’ links to other physicians through Medicare patients: the scope of care coordination. Ann Intern Med. 2009;150(4):236-242.CrossRef Pham HH, O’Malley AS, Bach PB, Saiontz-Martinez C, Schrag D. Primary care physicians’ links to other physicians through Medicare patients: the scope of care coordination. Ann Intern Med. 2009;150(4):236-242.CrossRef
14.
Zurück zum Zitat Garrick TR, Stotland NL. How to write a psychiatric consultation. Am J Psychiatry. 1982;139(7):849-855.CrossRef Garrick TR, Stotland NL. How to write a psychiatric consultation. Am J Psychiatry. 1982;139(7):849-855.CrossRef
15.
Zurück zum Zitat Tran C, Archibald D, Humphrey-Murto S, Liddy C, Keely E. What makes a high-quality electronic consultation (eConsult)? A nominal group study. J Telemed Telecare. Published online February 4, 2019:1357633X18822885. Tran C, Archibald D, Humphrey-Murto S, Liddy C, Keely E. What makes a high-quality electronic consultation (eConsult)? A nominal group study. J Telemed Telecare. Published online February 4, 2019:1357633X18822885.
16.
Zurück zum Zitat O’Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med. 2011;171(1):56-65.CrossRef O’Malley AS, Reschovsky JD. Referral and consultation communication between primary care and specialist physicians: finding common ground. Arch Intern Med. 2011;171(1):56-65.CrossRef
17.
Zurück zum Zitat Liddy C, Abu-Hijleh T, Joschko J, Archibald D, Keely E. eConsults and Learning Between Primary Care Providers and Specialists. Fam Med. 2019;51(7):567-573.CrossRef Liddy C, Abu-Hijleh T, Joschko J, Archibald D, Keely E. eConsults and Learning Between Primary Care Providers and Specialists. Fam Med. 2019;51(7):567-573.CrossRef
18.
Zurück zum Zitat Janssen M, Sagasser MH, Laro EAM, de Graaf J, Scherpbier-de Haan ND. Learning intraprofessional collaboration by participating in a consultation programme: what and how did primary and secondary care trainees learn? BMC Med Educ. 2017;17(1):125.CrossRef Janssen M, Sagasser MH, Laro EAM, de Graaf J, Scherpbier-de Haan ND. Learning intraprofessional collaboration by participating in a consultation programme: what and how did primary and secondary care trainees learn? BMC Med Educ. 2017;17(1):125.CrossRef
19.
Zurück zum Zitat Meijer LJ, de Groot E, Blaauw-Westerlaken M, Damoiseaux RAMJ. Intraprofessional collaboration and learning between specialists and general practitioners during postgraduate training: a qualitative study. BMC Health Serv Res. 2016;16(a):376.CrossRef Meijer LJ, de Groot E, Blaauw-Westerlaken M, Damoiseaux RAMJ. Intraprofessional collaboration and learning between specialists and general practitioners during postgraduate training: a qualitative study. BMC Health Serv Res. 2016;16(a):376.CrossRef
20.
Zurück zum Zitat Thaler RH, Sunstein CR. Nudge: Improving Decisions about Health, Wealth and Happiness.; 2009. Thaler RH, Sunstein CR. Nudge: Improving Decisions about Health, Wealth and Happiness.; 2009.
21.
Zurück zum Zitat Goldstein NJ, Cialdini RB, Griskevicius V. A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels. J Consum Res. 2008;35(3):472-482.CrossRef Goldstein NJ, Cialdini RB, Griskevicius V. A Room with a Viewpoint: Using Social Norms to Motivate Environmental Conservation in Hotels. J Consum Res. 2008;35(3):472-482.CrossRef
22.
Zurück zum Zitat Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001;285(22):2871-2879.CrossRef Kiefe CI, Allison JJ, Williams OD, Person SD, Weaver MT, Weissman NW. Improving quality improvement using achievable benchmarks for physician feedback: a randomized controlled trial. JAMA. 2001;285(22):2871-2879.CrossRef
24.
Zurück zum Zitat Walther JB. Computer-Mediated Communication: Impersonal, Interpersonal, and Hyperpersonal Interaction. Communic Res. 1996;23(1):3-43.CrossRef Walther JB. Computer-Mediated Communication: Impersonal, Interpersonal, and Hyperpersonal Interaction. Communic Res. 1996;23(1):3-43.CrossRef
25.
Zurück zum Zitat Eskreis-Winkler L, Milkman KL, Gromet DM, Duckworth AL. A large-scale field experiment shows giving advice improves academic outcomes for the advisor. Proc Natl Acad Sci U S A. 2019;116(30):14808-14810.CrossRef Eskreis-Winkler L, Milkman KL, Gromet DM, Duckworth AL. A large-scale field experiment shows giving advice improves academic outcomes for the advisor. Proc Natl Acad Sci U S A. 2019;116(30):14808-14810.CrossRef
26.
27.
Zurück zum Zitat Meeker D, Linder JA, Fox CR, et al. Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices: A Randomized Clinical Trial. JAMA. 2016;315(6):562-570.CrossRef Meeker D, Linder JA, Fox CR, et al. Effect of Behavioral Interventions on Inappropriate Antibiotic Prescribing Among Primary Care Practices: A Randomized Clinical Trial. JAMA. 2016;315(6):562-570.CrossRef
28.
Zurück zum Zitat Bond AM, Volpp KG, Emanuel EJ, et al. Real-time Feedback in Pay-for-Performance: Does More Information Lead to Improvement? J Gen Intern Med. 2019;34(9):1737-1743.CrossRef Bond AM, Volpp KG, Emanuel EJ, et al. Real-time Feedback in Pay-for-Performance: Does More Information Lead to Improvement? J Gen Intern Med. 2019;34(9):1737-1743.CrossRef
30.
Zurück zum Zitat Englis BG, Solomon MR. To be and not to be: Lifestyle imagery, reference groups, and the clustering of America. J Advert. 1995;24(1):13-28.CrossRef Englis BG, Solomon MR. To be and not to be: Lifestyle imagery, reference groups, and the clustering of America. J Advert. 1995;24(1):13-28.CrossRef
31.
Zurück zum Zitat Berger J, Heath C. Where Consumers Diverge from Others: Identity Signaling and Product Domains. J Consum Res. 2007;34(2):121-134.CrossRef Berger J, Heath C. Where Consumers Diverge from Others: Identity Signaling and Product Domains. J Consum Res. 2007;34(2):121-134.CrossRef
32.
Zurück zum Zitat Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.CrossRef Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.CrossRef
33.
Zurück zum Zitat Soni SM, Giboney P, Yee HF Jr. Development and Implementation of Expected Practices to Reduce Inappropriate Variations in Clinical Practice. JAMA. 2016;315(20):2163-2164.CrossRef Soni SM, Giboney P, Yee HF Jr. Development and Implementation of Expected Practices to Reduce Inappropriate Variations in Clinical Practice. JAMA. 2016;315(20):2163-2164.CrossRef
34.
Zurück zum Zitat Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. Wiley; 2010. Donner A, Klar N. Design and Analysis of Cluster Randomization Trials in Health Research. Wiley; 2010.
35.
Zurück zum Zitat Davidow SL, Sheth J, Sixta CS, Thomas-Hemak L. Closing the Referral Loop: Improving Ambulatory Referral Management, Electronic Health Record Connectivity, and Care Coordination Processes. J Ambul Care Manage. 2018;41(4):240-249.CrossRef Davidow SL, Sheth J, Sixta CS, Thomas-Hemak L. Closing the Referral Loop: Improving Ambulatory Referral Management, Electronic Health Record Connectivity, and Care Coordination Processes. J Ambul Care Manage. 2018;41(4):240-249.CrossRef
36.
Zurück zum Zitat Patel MP, Schettini P, O’Leary CP, Bosworth HB, Anderson JB, Shah KP. Closing the Referral Loop: an Analysis of Primary Care Referrals to Specialists in a Large Health System. J Gen Intern Med. 2018;33(5):715-721.CrossRef Patel MP, Schettini P, O’Leary CP, Bosworth HB, Anderson JB, Shah KP. Closing the Referral Loop: an Analysis of Primary Care Referrals to Specialists in a Large Health System. J Gen Intern Med. 2018;33(5):715-721.CrossRef
38.
Zurück zum Zitat EHRN. Epic Health Research Network. Accessed October 28, 2020. https://www.ehrn.org/articles/as-office-visits-fall-telehealth-takes-hold/ EHRN. Epic Health Research Network. Accessed October 28, 2020. https://​www.​ehrn.​org/​articles/​as-office-visits-fall-telehealth-takes-hold/​
40.
Zurück zum Zitat COVID-19 E-Consult Resources. Published March 24, 2020. Accessed May 23, 2021. https://econsulttoolkit.com/econsult-covid-19-resources/ COVID-19 E-Consult Resources. Published March 24, 2020. Accessed May 23, 2021. https://​econsulttoolkit.​com/​econsult-covid-19-resources/​
Metadaten
Titel
Effect of Peer Benchmarking on Specialist Electronic Consult Performance in a Los Angeles Safety-Net: a Cluster Randomized Trial
verfasst von
Daniella Meeker, PhD
Mark W. Friedberg, MD, MPP
Tara K. Knight, PhD
Jason N. Doctor, PhD
Dina Zein, MHA
Nancy Cayasso-McIntosh, MPH
Noah J. Goldstein, PhD
Craig R. Fox, PhD
Jeffrey A. Linder, MD, MPH
Stephen D. Persell, MD, MPH
Stanley Dea, MD
Paul Giboney, MD
Hal F. Yee, MD, PhD
The Behavioral Economics and eConsult Steering Committee
Publikationsdatum
09.09.2021
Verlag
Springer International Publishing
Erschienen in
Journal of General Internal Medicine / Ausgabe 6/2022
Print ISSN: 0884-8734
Elektronische ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-021-07002-1

Weitere Artikel der Ausgabe 6/2022

Journal of General Internal Medicine 6/2022 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Erhöhte Mortalität bei postpartalem Brustkrebs

07.05.2024 Mammakarzinom Nachrichten

Auch für Trägerinnen von BRCA-Varianten gilt: Erkranken sie fünf bis zehn Jahre nach der letzten Schwangerschaft an Brustkrebs, ist das Sterberisiko besonders hoch.

Hypertherme Chemotherapie bietet Chance auf Blasenerhalt

07.05.2024 Harnblasenkarzinom Nachrichten

Eine hypertherme intravesikale Chemotherapie mit Mitomycin kann für Patienten mit hochriskantem nicht muskelinvasivem Blasenkrebs eine Alternative zur radikalen Zystektomie darstellen. Kölner Urologen berichten über ihre Erfahrungen.

Ein Drittel der jungen Ärztinnen und Ärzte erwägt abzuwandern

07.05.2024 Medizinstudium Nachrichten

Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.

Vorhofflimmern bei Jüngeren gefährlicher als gedacht

06.05.2024 Vorhofflimmern Nachrichten

Immer mehr jüngere Menschen leiden unter Vorhofflimmern. Betroffene unter 65 Jahren haben viele Risikofaktoren und ein signifikant erhöhtes Sterberisiko verglichen mit Gleichaltrigen ohne die Erkrankung.

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.