Introduction
Objective
Methods
Study setting
Data collection
Creation of wait time reports
Statistical analysis
Quantitative analysis
Qualitative analysis
Results
Quantitative analysis
Characteristic | Nb (%) | Minimum | 25th Pctlc | Mediand | 75th Pctle | Maximumf | Ph |
---|---|---|---|---|---|---|---|
Referral Site: | |||||||
• Mount Sinai Downtown Academic FHTa | 4242 (59.4) | 1.0 | 21.0 | 42.0 | 78.0 | 760.0 | < 0.01 |
• Sherman Health and Wellness Community FHT | 2899 (40.6) | 1.0 | 25.0 | 43.0 | 83.0 | 561.0 | |
Sex: | |||||||
• Female | 4501 (63.0) | 1.0 | 22.0 | 43.0 | 79.0 | 760.0 | 0.34 |
• Male | 2640 (37.0) | 1.0 | 21.0 | 41.0 | 83.0 | 616.0 | |
Age group of patient referrals (years) | |||||||
• 0–19 | 410 (5.7) | 1.0 | 25.0 | 46.0 | 84.0 | 400.0 | < 0.01 |
• 20–44 | 2012 (28.2) | 1.0 | 24.0 | 43.0 | 83.0 | 561.0 | |
• 45–64 | 2428 (34.0) | 1.0 | 22.0 | 42.0 | 81.0 | 760.0 | |
• 65 + | 2291 (32.1) | 1.0 | 20.0 | 40.0 | 77.0 | 616.0 | |
Urgency of Referralg | |||||||
• Routine | 4471 (62.6) | 1.0 | 23.0 | 43.0 | 81.0 | 616.0 | < 0.01 |
• Urgent | 296 (4.1) | 1.0 | 6.0 | 13.0 | 29.5 | 469.0 | |
• Urgency Missing on Referral | 2374 (33.2) | - | - | - | - | - | |
Season/Year of referral | |||||||
• Winter 2016 | 760 | 1.0 | 20.5 | 38.0 | 77.0 | 746.0 | < 0.01 |
• Spring 2016 | 943 | 1.0 | 21.0 | 41.0 | 84.0 | 441.0 | |
• Summer 2016 | 802 | 1.0 | 25.0 | 47.5 | 86.0 | 760.0 | |
• Fall 2016 | 789 | 1.0 | 21.0 | 45.0 | 82.0 | 454.0 | |
• Winter 2017 | 843 | 1.0 | 19.0 | 36.0 | 71.0 | 407.0 | |
• Spring 2017 | 1055 | 1.0 | 22.0 | 41.0 | 78.0 | 451.0 | |
• Summer 2017 | 978 | 1.0 | 26.0 | 46.0 | 82.0 | 458.0 | |
• Fall 2017 | 971 | 1.0 | 24.0 | 44.0 | 84.0 | 532.0 | |
Income quintile before taxes | |||||||
• 1 (Lowest) | 748 (11.0) | 1.0 | 21.0 | 41.0 | 73.5 | 458.0 | 0.16 |
• 2 | 942 (13.8) | 1.0 | 22.0 | 43.0 | 79.0 | 491.0 | |
• 3 | 939 (13.8) | 1.0 | 23.0 | 45.0 | 88.0 | 760.0 | |
• 4 | 1815 (26.6) | 1.0 | 22.0 | 42.0 | 80.0 | 746.0 | |
• 5 (Highest) | 2371 (34.8) | 1.0 | 22.0 | 43.0 | 83.0 | 616.0 | |
Material and social deprivation index | |||||||
• 1 (Least) | 1401 (26.6) | 1.0 | 22.0 | 45.0 | 88.0 | 561.0 | 0.06 |
• 2 | 1138 (21.6) | 1.0 | 22.0 | 41.0 | 77.0 | 616.0 | |
• 3 | 1369 (26.0) | 1.0 | 21.0 | 42.0 | 78.0 | 760.0 | |
• 4 | 676 (12.8) | 1.0 | 21.0 | 42.0 | 80.0 | 432.0 | |
• 5 (Most) | 683 (13.0) | 1.0 | 22.0 | 42.0 | 78.0 | 458.0 |
Specialty | Number of Referrals | %a | Minimum | 25th Pctlb | Medianc | 75th Pctld | Maximume |
---|---|---|---|---|---|---|---|
All Specialities | 7141 | 100 | 1.0 | 22.0 | 42.0 | 80.0 | 760.0 |
Dermatology | 1405 | 19.7 | 1.0 | 18.0 | 34.0 | 63.0 | 746.0 |
Gastroenterology | 1040 | 14.6 | 1.0 | 21.0 | 41.0 | 82.0 | 616.0 |
ENT | 673 | 9.4 | 2.0 | 21.0 | 35.0 | 64.0 | 561.0 |
Ob/Gyn | 584 | 8.2 | 1.0 | 30.0 | 52.0 | 87.0 | 458.0 |
Urology | 321 | 4.5 | 3.0 | 36.0 | 75.0 | 112.0 | 551.0 |
Ophthalmology | 309 | 4.33 | 1.0 | 18.0 | 38.0 | 62.0 | 451.0 |
Immunology | 288 | 4.0 | 3.0 | 35.0 | 70.0 | 111.5 | 213.0 |
Orthopedic Surgery | 269 | 3.8 | 1.0 | 15.0 | 37.0 | 71.0 | 760.0 |
General Surgery | 241 | 3.4 | 1.0 | 16.0 | 41.0 | 71.0 | 323.0 |
Rheumatology | 221 | 3.1 | 1.0 | 35.0 | 62.0 | 99.0 | 228.0 |
Neurology | 209 | 2.9 | 1.0 | 31.0 | 51.0 | 100.0 | 407.0 |
Endocrinology | 201 | 2.8 | 1.0 | 29.0 | 54.0 | 97.0 | 469.0 |
Cardiology | 182 | 2.5 | 1.0 | 21.0 | 38.0 | 79.0 | 215.0 |
Plastic Surgery | 175 | 2.5 | 1.0 | 37.0 | 59.0 | 100.0 | 259.0 |
Psychiatry | 170 | 2.4 | 2.0 | 22.0 | 40.5 | 63.0 | 400.0 |
Sports Medicine | 129 | 1.8 | 2.0 | 15.0 | 24.0 | 37.0 | 441.0 |
Hematology | 92 | 1.3 | 3.0 | 26.5 | 56.5 | 97.5 | 237.0 |
Urogynecology | 92 | 1.3 | 2.0 | 32.0 | 51.5 | 96.0 | 452.0 |
Sleep Clinic | 87 | 1.2 | 2.0 | 22.0 | 46.0 | 88.0 | 400.0 |
Nephrology | 73 | 1.0 | 3.0 | 16.0 | 22.0 | 52.0 | 388.0 |
Respirology | 71 | 1.0 | 8.0 | 26.0 | 50.0 | 77.0 | 216.0 |
Vascular Surgery | 56 | 0.6 | 5.0 | 23.5 | 48.0 | 76.5 | 161.0 |
Physiatry | 48 | 0.7 | 1.0 | 53.0 | 70.0 | 100.5 | 219.0 |
Pediatrics | 44 | 0.6 | 1.0 | 14.0 | 32.0 | 48.0 | 114.0 |
Genetics | 43 | 0.6 | 9.0 | 58.0 | 101.0 | 186.0 | 532.0 |
Geriatrics | 21 | 0.3 | 8.0 | 24.0 | 42.0 | 55.0 | 399.0 |
Oncology | 21 | 0.3 | 8.0 | 15.0 | 23.0 | 52.0 | 121.0 |
Internal Medicine | 19 | 0.3 | 2.0 | 9.0 | 19.0 | 58.0 | 219.0 |
Pain Clinic | 19 | 0.3 | 1.0 | 40.0 | 75.0 | 165.0 | 546.0 |
Neurosurgery | 17 | 0.2 | 14.0 | 31.0 | 49.0 | 104.0 | 439.0 |
Hepatology | 11 | 0.2 | 10.0 | 32.0 | 79.0 | 156.0 | 159.0 |
Infectious Disease | 9 | 0.1 | 18.0 | 27.0 | 40.0 | 47.0 | 227.0 |
Palliative Care | 1 | 0.01 | 21.0 | 21.0 | 21.0 | 21.0 | 21.0 |
Qualitative analysis
MSHa FPsb N (%) | Vaughan FPs N (%) | MSH Specialists N (%) | |
---|---|---|---|
# Attended Focus Group | 10 | 4 | 6 |
# Completed Questionnaire | 8 (80.0%) | 4 (100%) | 5 (83.3%) |
Gender | |||
Male | 2 (25.0%) | 1 (25.0%) | 5 (100%) |
Female | 6 (75.0%) | 3 (75.0%) | 0 (0.0%) |
Age (years) | |||
31–40 | 2 (25.0%) | 4 (100%) | 1 (20.0%) |
41–50 | 2 (25.0%) | 0 (0.0%) | 1 (20.0%) |
> 50 | 4 (50.0%) | 0 (0.0%) | 3 (60.0%) |
# Years in Practice | |||
Mean | 23.8 | 4.5 | 14.2 |
Range | 4–38 | 3–6 | 4–25 |
Mean # Years at Current Location | 21.1 | 4.0 | 14.0 |
Practice Type | |||
Academic | 7 (87.5%) | 1 (25.0%) | 5 (100%) |
Community | 0 (0.0%) | 3 (75.0%) | 0 (0.0%) |
Combined | 1 (12.5%) | 0 (0.0%) | 0 (0.0%) |
THEMES | Sub Themes from Primary Care Providers | Sub Themes from Specialists |
---|---|---|
GENERAL IMPRESSIONS | Wait time data is viewed positively by primary care providers (PCPsa) and is seen to have value 1. Official registry/access to specialist wait time data seen as very useful | Specialists have interest in wait time data 1. Some clinics/specialists have never seen their own data or that or colleagues 2. Website with specialist by region, updated every month by clinics/specialist seen as useful particularly for PCPs |
CLINICAL UTILITY | Majority of primary care providers perceive wait time data to have significant clinical utility • Knowledge of wait-times increases PCP (& patient) specialist choices • Choosing specialist within closest geographical convenience for patient • Choosing specialist with shortest wait times • Helps to manage patient expectations • Useful for improving patient care • Useful for urgent referrals • Potentially increases patients’ timely access to care—patients don’t have to suffer unnecessarily for long periods | There was variable perception about` the clinical utility of wait time data for specialists 1. Review of data may lead to clinical improvements • Provides feedback and could reveal inefficiencies rather than capacity issues which would allow for redistribution of resources for some specialties • If specialists are aware of data they may be motivated to find resolutions (competitive response) • Would allow specialists to provide alternatives for patients when full • No standardization exists to triaging patients, therefore a review of the triage practices of those specialists with shorter wait times could be helpful for all 2. Review of data has little or no impact/clinical utility for clinics/specialists • Even if aware, specialists may not be able to change wait times (e.g. Surgeons are limited by how may surgeries they can perform per day) • Data would not change practice or how patients are booked • Some data (e.g. surgical oncology) already exists at system level yet no changes have been effected, thus specialists question impact of additional data |
PERCEIVED BENEFITS & VALUE OF DATA | Data is perceived to have value for both PCPs and specialists because it increases awareness 1. Data increases PCP access to knowledge & information regarding specialists (SPs) • Some PCPs currently find specialists by informal methods i.e. asking colleagues who they refer to or asking patients who they friends have been referred to – official registry is useful to have • Useful resource when new to the city or newer to practice • Organized & accessible—some PCPs are currently find specialists via ad hoc means, i.e. asking colleagues who they refer to or patients who they friends have been referred to 2. Data allows specialists/clinics to become aware of their own wait times • If specialists are aware of data they may find internal resolutions or workarounds • Acknowledgement that specialists may not be able to change wait times even with greater awareness Wait time data has systemic relevance 1. Relevance is seen for local, regional and provincial administration bodies (department chiefs, hospital CEOs, standards committees, LHINsb, HQOc) 2. Provincial wait time data would highlight inequality in Ontario which may lead to improvements | Data increases awareness—availability of data allows specialists/clinics to become aware of their own wait times 1. Urgent wait times are often of importance to specialists because of targets set by clinic – most specialists don’t know if they are meeting these 2. Data may highlight disconnect between perception (self-reported wait times) and reality 3. Sub-specialization wait time data provides more detail of where bottlenecks might be 4. Data provides a comparator with other specialties in region even if clinics/specialists are limited in resolutions 5. Valuable information, particularly for non-surgical specialists (e.g. Ortho surgeons have Wait 1 & 2 Data provincially monitored and sent back—non surgical ortho data may be lacking) The systemic relevance of additional wait time data is not clear for all specialists 1. Some data (e.g. surgical/oncology) already exists at system level, yet no changes have been effected, thus specialists question the impact of additional data 2. Some specialists acknowledge systemic relevance for department chiefs, hospital CEOs, standards committees LHINs and administrative bodies such as HQO • Primarily useful for department chiefs with regards to bottleneck identification |
PERCEIVED CHALLENGES/LIMITATIONS | Data does not provide information related to quality of referral and variances in wait times 1. Quality or cannot be discerned 2. Data provides no contextual information which may account for outliers Wait time data may not change referral patterns—some PCPs report having “favourites” who they already refer to and accessing wait time data may be There may be unintended consequence of making data available 1. Wait times for some specialists could increase if a real-time or a dynamic, updatable interface is not embedded in the design 2. Alienation of some specialists, particularly those with longer wait times | Data does not reflect variance with regards to referrals 1. Factors influencing referrals and wait time data include • Patient preference • PCP preference • Type of problem or diagnosis • Appropriateness/quality of referral |
RECOMMENDATIONS | Presentation of wait time data for PCPs can be improved by increasing clarity, accessibility and user friendliness for PCPs 1. Increase clarity • Group data for easier or quicker identification e.g. wait times below or above 50 days • Cluster by sub-specialty (e.g. separate ob & gyn wait times as difference exists) 2. Sort data by shortest wait times and/or geography 3. Provide filters (i.e. if platform is interactive) so PCPs can choose specialist based on own criteria (e.g. geography, affiliation, urgent/non urgent referral etc.) which may change case by case 4. PCPs prefer data to be made available to them via easy to access means • Link in the EMR • Email • Easy access at point of care important Wait time data that is updated regularly is seen as important 1. Real time interface and updates if possible was seen as ideal 2. The most popular interval for receiving updates was quarterly followed by every 6 months 3. An opt out option for PCPs who no longer wish to receive updates is important Although benchmarks are key for establishing a standard of care, setting these for specialist referrals may be controversial & challenging to achieve 1. Benchmarks may be unrealistic • May be unrealistic because of geography and location of specialists—may set up unreasonable expectation • There are too many specialties & sub-specialties for benchmarks • Specialists in Ontario are at capacity so they can’t accommodate patients any faster 2. Benchmarks may inherently place judgement, blame & stress on specialists 3. Rather than benchmarks, it is better to look at similar healthcare systems doing better and find ways of mirroring or learning from them Public reporting of wait times may be inevitable in the future but may cause challenges (e.g. patients wanting to choose a different specialist than recommended) and further strain the health care system For next steps, consider an implementation trial exploring actual utility of wait time date by PCPs and also patient behavior | Additional, more robust data may be of interest to both specialists and PCPs 1. Contextualized comparison data (to help explain anomalies or outliers) is important 2. Data should include communication wait times from specialist to PCP (i.e. letter from specialist to PCP) as this is important for adhering to standards 3. Including the type of referrals accepted by may be educational for PCPs Quarterly updates of accessible wait time data could allow specialists to review and plan 1. Nominal reporting should be by group/clinic consensus 2. Data should be easily accessible e.g. email or presentation in specialty group meeting 3. Platforms with access barriers e.g. passwords would prevent or limit use of information Mixed views exist about establishing benchmarks 1. While benchmarks are seen by some as arbitrary because they depend on sub-specialty or diagnosis, they are also seen as important for setting standards and improving healthcare systems Public availability all wait time data is OK (and some exists already but should include education for patients so the public better understands clinic variances Next steps 1. Consider a block randomization trial—releasing data to a few to see if this has impact on actual wait time 2. Evaluation of what constitutes urgent referrals are needed as PCPs have a low criteria for “urgent” • Important for PCPs to ask the right questions and know when referral is valid—impacts wait times |
“A non-urgent referral doesn’t mean that it can wait a year to be seen. It just means they don’t have to be seen tomorrow. But if they are having significant sinus symptoms, and I’ve done everything in my arsenal to help them, do they need to be seen tomorrow for sinus symptoms? No. But I also don’t want them to wait 4 months to see somebody and suffer for 4 months needlessly if they could see somebody within 2 weeks. So that would be super helpful information in my opinion.” (Family Physician)
“I think it’s amazing. It seems like this would be really useful to be out there both for like a [specialty named] association, for government, for LHINs [Local Health Integration Network]. I’ve never seen data like this. So I think it would be incredibly useful.” (Specialist)
“When you’re looking at a process, it’s either inefficient or it’s a capacity problem. And at least from the [specialty named] side of things, there are some reasonable evidence based on a glance of the distribution that it’s an inefficiency problem. So certain people are holding up the line, and certain people are not. And they’re not being redistributed that way. But that’s the way referrals have been made in Ontario for the last 200 years. And so that’s why I think there’s a lot more push now to create programs like a rapid assessment clinic. A lot of groups now are sort of first-come, first-serve, depending on individual practitioner wait times.[…]So I guess the way I look at it is that it just confirms a lot of people’s suspicion that within this is probably not a capacity issue right now, it’s probably an inefficiency of distribution issue.” (Specialist)
“It could be perceived that Dr. X with a wait time of 190 days is bad. But it might be that, you know, they are the only person who does that. Or b) they have… they’re doing a really good job, and a lot of people want to go to them, and they don’t want to go anywhere else, and they want to wait.”