Background
Self-management programs are widely recommended to empower participants, increase their confidence, teach skills and techniques, and improve their interaction with the health care system to enable better management of chronic conditions [
1]. A number of governments have adopted the Chronic Disease Self-Management Program (CDSMP), which was developed and validated by the Stanford Patient Education Research Centre as part of population-based long-term chronic disease management strategies [
2,
3]. For example, the Department of Health in the UK has invested $36 million (US) in the Expert Patient Programme (EPP), an adaptation of the CDSMP for delivery to 100,000 patients by 2012 [
4]. In Australia, the CDSMP and other patient programs are being delivered through the Sharing Health Care Initiative, with large demonstration projects across a variety of settings [
5]. In the US, the CDSMP has been implemented within a large health maintenance organization [
6]. Most Canadian provinces and territories fund community-based programs for patients in self-management education using versions of the CDSMP [
7]. There is significant interest in the potential for the CDSMP to improve health outcomes and reduce health care use, ultimately lowering health care costs and creating a healthier society [
2,
4,
7].
One of the main tenets of the CDSMP is that confident, knowledgeable patients practicing self-management will experience improved health status and utilize fewer health care resources [
8‐
10]. However, there is a paucity of data supporting the claim of reduced health care utilization. A recent meta-analysis by Brady and colleagues found that about half of the CDSMP studies reported some health care utilization data (number of physician visits, number of emergency department (ED) visits, number of times hospitalized, and number of days or nights in the hospital) and all but one used self-report measures [
11]. Only Ritter et al [
12], in a RCT of 216 subjects evaluating the CDSMP used computerized medical records from a health maintenance organization to determine health care utilization. The meta-analysis included 8,688 participants (2,902 enrolled in randomized controlled trials (RCTs) and 5,779 in longitudinal studies). Of the 23 studies, only 9 of them counted physician visits, 8 measured days hospitalized and 7 hospitalizations at 4 or 6 months post-intervention respectively. Only 4 studies measured health care utilization at 9 or 12 months. Overall, changes were minimal with no significant effect sizes at 4 or 6 months or 9 or12 months post-intervention for physician visits, ED visits or hospitalizations. There was a small but statistically significant decrease in days hospitalized, at 4 or 6 months that did not persist at 9 or 12 months. Recently, Ory and colleagues identified significant reductions in self-reported ED visits at 12 months which were not observed for self-reported hospitalizations [
13]. Brady and colleagues suggested in their meta-analysis that administrative claims data would provide a more definitive examination of the impact of the CDSMP on health care utilization given that self-reported measures of health care utilization are subject to recall bias [
14]. To date, no study has evaluated the impact of the CDSMP on health care utilization using administrative claims data.
We recently conducted an evaluation of a telehealth version of the Stanford chronic disease self-management program (tele-CDSMP) to determine if it would lead to improvements in self-efficacy, health behaviours, and health status for older adults with chronic disease living in rural and remote areas in Northern Ontario, Canada [
15]. Participants had a self-reported physician diagnosis of chronic lung disease, heart disease, stroke, or chronic arthritis. Individuals with diabetes and hypertension were included if they also had one of the above diagnoses. The tele-CDSMP was an adaptation of the CDSMP delivered via telehealth. The lay leaders were recruited from five communities with populations greater than 40,000 inhabitants. At least 2 of the 3 lay leaders per team had one of the chronic diseases targeted in the study and the other was either a health care professional or other professional. The leaders linked via videoconferencing, using the Ontario Telemedicine Network infrastructure, to participants recruited from 13 communities ranging in population from approximately 1,400 to 18,000 inhabitants. The highly interactive course used the content of the CDSMP, and included a) guided mastery of skills through weekly action planning and feedback of progress, b) modeling of self-management behaviors and problem-solving strategies, and c) social persuasion through group support and guidance for individual self-management efforts [
16]
]. The CDSMP taught the following content to participants in six weekly 2-hour sessions: how to develop an exercise program, cognitive symptom management, breathing exercises, problem solving, communication skills (with family, friends, and health care providers), use of medication, and dealing with the emotions of chronic illness (anger and depression). Participants experienced significant improvements in self-efficacy, a number of health behaviors (exercise, cognitive symptom management, communication with physicians) and health status variables (social role function, psychological well-being, energy, health distress and self-rated health).
The aim of the current study was to determine the extent to which health care utilization (physician visits, ED visits, hospitalizations) as measured by administrative data claims was reduced following the tele-CDSMP. Specifically, the objectives were 1) to describe patterns of health care utilization (number of physician visits, ED visits and hospitalizations) 6, 12 and 18 months prior to participating in the tele-CDSMP with the same time intervals following initial participation; and 2) to examine the extent to which health care utilization was reduced in the 12-month period following completion of the tele-CDSMP compared to the 12-month period prior to the program.
Results
Of the 106 participants who provided permission for data linkage, only one could not be matched to the HCN provided. Of the remaining 105 individuals, one person had a large number of ED visits over the 18 month period. Reasons for visits were not related to chronic disease so it was decided that this outlier should be excluded leaving a total sample of 104 for analysis. The mean age of the linked cohort was 65.3 years and over three-quarters were female. The average number of chronic conditions was 2.2 and over 80% of the cohort had arthritis, 54.8% heart disease and 37.5% lung disease.
Using the self-report data we compared the tele-CDSMP participants with linked administrative data for health care utilization to the non-respondents (Table
1). There were no statistically significant differences between the groups for self-efficacy or among any of the health behavior or health status variables. However, participants were significantly younger, had higher incomes, and were also more likely to be married compared to non-respondents.
Table 1
Comparison of linked tele-CDSMP cohort versus non-linked
Age* | | 65.3 (8.9) | 68.4 (9.8) |
Gender | | | |
| Female | 80 (76.9%) | 80 (74.8%) |
| Male | 24 (23.1%) | 27 (25.2%) |
Marital Status* | | | |
| Married | 58 (55.8%) | 48 (44.9%) |
| Single | 6 (5.8%) | 8 (7.5%) |
| Separated | 4 (3.8%) | 1 (0.9%) |
| Divorced | 9 (8.7%) | 16 (15.0%) |
| Widowed | 27 (26.0%) | 34 (31.8%) |
Income*+
| | | |
| < 20,000 | 21 (20.2%) | 24 (22.4%) |
| 20 – 39,000 | 32 (30.8%) | 39 (36.4% |
| 40 – 59,000 | 32 (30.5%) | 16 (15.0%) |
| 60 – 79,000 | 5 (4.8%) | 9 (8.4%) |
| ≥ 80,000 | 9 (8.7%) | 4 (3.7%) |
Education | | | |
| Less than high school | 34 (32.4%) | 42 (39.3%) |
| High school diploma | 33 (31.7%) | 34 (31.8%) |
| Post-secondary degree | 32 (30.8%) | 28 (26.2%) |
| Graduate degree | 5 (4.8%) | 3 (2.8%) |
Co-morbidity | | | |
| Lung disease | 39 (37.5%) | 28 (26.2%) |
| Heart disease | 57 (54.8%) | 50 (46.2%) |
| Arthritis | 87 (83.7%) | 73 (68.2%) |
| Stroke | 13 (12.5%) | 6 (0.06%) |
| Diabetes | 33 (31.7%) | 26 (24.3%) |
Self-efficacy score | | 6.5 (1.7) | 6.7 (1.8) |
Health Behaviours | | | |
| Aerobic exercise behaviour (min/week) | 127.6 (116.1) | 136.1 (114.2) |
| Stretching exercise behaviour (min/week) | 55.4 (67.9) | 47.7 (59.6) |
| Cognitive symptom management score | 1.7 (0.9) | 1.6 (1.0) |
| Communication with physicians score | 3.2 (1.2) | 3.1 (1.6) |
Health Status | | | |
| Self-rated health | 3.3 (1.1) | 3.3 (1.1) |
| Stanford HAQ disability scale | 0.4 (0.4) | 0.4 (0.4) |
| Social/Role Activities Limitation score | 1.4 (1.1) | 1.3 (1.1) |
| Pain Severity | 66.0 (18.5) | 64.5 (20.8) |
| Mood Assessment Scale | 8.1 (6.1) | 7.9 (5.9) |
| Health distress | 1.6 (1.2) | 1.8 (1.3) |
The median number of total physician visits among the tele-CDSMP linked cohort 6, 12 and 18 months prior to the program were 4 (IQR = 2-7), 8 (IQR = 5-12), and 12 (IQR = 8-18), compared to 4 (IQR = 2–7), 8 (IQR 5–13) and 12 (IQR 8–18) post program, respectively (see Table
2). The median number of ED visits 6, 12 and 18 months prior to the program were 0 (IQR = 0-2), 1 (IQR = 0-3), and 2 (IQR = 0-4), compared to 0 (IQR = 0-1), 1 (IQR = 0-3) and 1 (IQR = 0-5) post program, respectively. Overall, there were no statistically significant differences pre and post program in any of the health care utilization variables at 6, 12 or 18 months. Compared to the matched general population, the CDSMP participants had significantly higher health care use.
Table 2
Health care utilization 6, 12 and 18 months prior to and 6, 12 and 18 months after participation in a tele-CDSMP, as measured by administrative data
All physician
| | | | | | |
Mean (SD) | 4.8 (4.1) | 4.9 (3.9) | 9.3 (6.9) | 9.7 (6.9) | 13.5 (9.5) | 14.1 (9.7) |
Median (IQR) | 4 (2–7) | 4 (2–7) | 8 (5–12) | 8 (5–13) | 12 (8–18) | 12 (8–18) |
General practitioner
| | | | | | |
Mean (SD) | 3.3 (3.0) | 3.2 (2.6) | 6.5 (5.1) | 6.4 (5.1) | 9.4 (7.1) | 9.3 (7.2) |
Median (IQR) | 3 (1–5) | 3 (1–4) | 5 (3–9) | 6 (3–8) | 8 (5–11) | 8 (5–12) |
Specialist
| | | | | | |
Mean (SD) | 1.5 (2.0) | 1.7 (2.4) | 2.8 (3.3) | 3.3 (3.5) | 4.1 (4.6) | 4.8 (4.8) |
Median (IQR) | 1 (0–2) | 1 (0–3) | 2 (1–4) | 2 (1–5) | 3 (1–5) | 3 (1–7) |
Emergency
| | | | | | |
Mean (SD) | 1.3 (2.9) | 1.0 (1.7) | 2.2 (3.5) | 2.0 (2.8) | 3.2 (4.9) | 3.1 (4.4) |
Median (IQR) | 0 (0–2) | 0 (0–1) | 1 (0–3) | 1 (0–3) | 2 (0–4) | 1 (0–5) |
Hospitalizations
| | | | | | |
Mean (SD) | 0.1 (0.4) | 0.2 (0.4) | 0.1 (0.5) | 0.3 (0.7) | 0.3 (0.5) | 0.4 (0.8) |
Median (IQR) | 0 (0–0) | 0 (0–0) | 0 (0–0) | 0 (0–0) | 0 (0–0) | 0 (0–0) |
In the block models for covariate selection, sex, marital status, aerobic exercise score, cognitive symptom management, and self-rated health were identified as significant covariates to be included in the final GEE models (see Table
3). In the GEE models, an interaction effect was identified with age. Thus models were stratified by age based on the median (≤66 and > 66 years).
Table 3
Variables selected from block modeling
Age
| 1.0 (1.0- 1.0) | 0.1 | 1.0 (1.0-1.0) | 0.1 | 1.0 (1.0-1.0) | 0.5 | 1.0 (0.9-1.0) | 0.09 |
Sex
| | | | | | | | |
Female | Reference | | Reference | | Reference | | Reference | |
Male | 1.6 (1.1-2.3) | 0.1 | 0.1 (1.0-1.0) | 0.09 | 1.0 (1.0-1.0) | 0.48 | 1.0 (0.9-1.0) | 0.09 |
Marital Status
| | | | | | | | |
Married | Reference | | Reference | | Reference | | Reference | |
Single | 0.6 (0.3-1.5) | 0.3 | 0.5 (0.2-1.5) | 0.2 | 0.8 (0.3-2.6) | 0.7 | 0.09 (0.003-2.6) | 0.2 |
Separated | 0.8 (0.4-1.7) | 0.6 | 0.6 (0.2-1.6) | 0.3 | 1.2 (0.5-3.1) | 0.7 | 1.4 (0.6-3.6) | 0.5 |
Divorced | 1.3 (0.8-2.1) | 0.4 | 1.4 (0.8-2.4) | 0.3 | 1.1 (0.5-2.5) | 0.8 | 0.7 (0.3-2.0) | 0.5 |
Widowed | 1.4 (1.0-2.0) | 0.08 | 1.6 (1.0-2.4) | 0.03 | 1.1 (0.6-2.0) | 0.7 | 1.2 (0.6-2.4) | 0.6 |
Aerobic Exercise Score
| 1.0 (1.0-1.0) | 0.007 | 1.0 (1.0-1.0) | 0.05 | 1.0 (1.0-1.0) | 0.02 | 1.0 (1.0-1.0) | 0.008 |
Cognitive Symptom Management
| 0.9 (0.8-1.0) | .08 | 0.9 (0.8-1.1) | 0.3 | 0.8 (0.6-1.0) | 0.05 | 1.2 (0.9-1.6) | 0.2 |
Self-rated Health
| 1.0 (0.9-1.3) | 0.6 | 1.0 (0.8-1.3) | 0.8 | 1.1 (0.8-1.5) | 0.6 | 1.6 (1.1-2.3) | 0.02 |
Table
4 shows the health care use patterns for individuals ≤ 66 years of age compared with those > 66 years. For those individuals ≤ 66 years, there was a 34% increase in physician visits one year post program (OR 1.3, 95% CI 1.1-1.6, p = 0.003), and no significant difference in ED visits (OR 1.1, 95% CI 0.8-1.6, p > 0.05; see Table
5). The tele-CDSMP did not have a significant impact on physician visits for individuals > 66 years; however, there was a trend towards significance with a 41% reduction in ED visits during the year following the program (p = 0.08).
Table 4
Health care utilization 6, 12 and 18 months prior to and 6, 12 and 18 months after participation in a tele-CDSMP stratified by age
All Physician visits | | | | | | |
<= 66 | 4.8 (3.7) | 5.3 (4.1) | 9.2 (6.0) | 10.2 (7.2) | 12.9 (8.4) | 14.8 (9.7) |
> 66 | 4.9 (4.5) | 4.6 (3.8) | 9.4 (7.7) | 9.1 (6.7) | 14.1 (10.5) | 13.3 (9.8) |
GP/FP visits | | | | | | |
<= 66 | 3.1 (2.7) | 3.3 (2.6) | 6.1 (4.8) | 6.5 (5.2) | 8.9 (7.0) | 9.6 (7.4) |
> 66 | 3.5 (3.3) | 3.1 (2.5) | 6.8 (5.5) | 6.2 (5.0) | 9.9 (7.3) | 8.9 (7.1) |
Specialist visits | | | | | | |
<= 66 | 1.7 (2.0) | 2.0 (2.5) | 3.1 (3.2) | 3.6 (3.6) | 4.1 (3.8) | 5.2 (4.8) |
>66 | 1.3 (2.1) | 1.5 (2.3) | 2.5 (3.5) | 2.9 (3.3) | 4.1 (5.2) | 4.3 (4.8) |
ED visits | | | | | | |
<= 66 | 0.9 (1.9) | 1.3 (2.1) | 2.0 (3.3) | 2.2 (3.2) | 3.2 (5.0) | 3.4 (4.7) |
> 66 | 1.7 (3.7) | 0.8 (1.6) | 2.3 (3.7) | 1.7 (2.3) | 3.1 (4.8) | 2.9 (4.2) |
Hospitalizations | | | | | | |
<= 66 | 0.1 (0.5) | 0.2 (0.4) | 0.1 (0.5) | 0.3 (0.6) | 0.2 (0.5) | 0.4 (0.7) |
> 66 | 0.1 (0.4) | 0.1 (0.4) | 0.2 (0.5) | 0.3 (0.8) | 0.3 (0.5) | 0.4 (0.9) |
Table 5
The Impact of the tele-health program on health care utilization using generalized estimating equation models adjusting for covariates
Physician Visits* | 1.3 | 1.1- 1.6 | 0.003 | 0.9 | 0.7-1.2 | 0.6 |
GP/FP Visits | 1.3 | 1.0-1.6 | 0.02 | 0.9 | 0.7-1.1 | 0.2 |
Specialist Visits | 1.5 | 1.1-2.0 | 0.006 | 1.04 | 0.6-1.7 | 0.3 |
ED visits* | 1.1 | 0.8-1.6 | 0.6 | 0.6 | 0.3-1.7 | 0.08 |
Discussion
Our results are consistent with the recent meta-analysis of evaluations of the CDSMP by Brady and colleagues [
11], as in our unadjusted analyses we found no significant differences for visits to physicians, EDs or hospitalizations using administrative data before versus after participation in the tele-CDSMP. Based on the interaction with age, further exploration with a larger sample is needed. After adjustment for covariates, we found that the younger group with chronic conditions (age 66 years or less) had a statistically significant increase in physician visits post intervention, while for the older group (>66 years) there was a trend towards reduced ED visits 12 months after participation in the tele-CDSMP. A possible explanation is that the CDSMP encourages participants to assume a more active role in managing their health condition, and that ‘management’ is construed as consultation with health care practitioners. The CDSMP is consistent with the shift to a more “patient-centered” approach to health care, where provider-patient relations change from being ‘directive’ to ‘shared’ through joint definition of problems, treatment goals and management strategies, which may result in more or better quality visits [
22‐
25]. Also, in countries with universal health care there may be less incentive for patients to reduce the number of visits. For example, those with more common chronic conditions who have a steady pattern of service use may find little room, or need, for change especially when this is linked to codes of professional practice or payment on the supply side. While there is universal access to health care in Ontario, physician payment is based on fee-for-service. Structured physician visits may be particularly true for the older patients with chronic conditions as they tend to have regularly scheduled follow-up visits for example for medication refills or blood pressure checks and hence no differences in physician visits were seen for this age group in our study. The trend toward decreased ED visit use among the older age group needs to be confirmed in future studies. It could be postulated that the CDSMP has had the desired effect and taught these participants how better to manage and cope with their condition and thus reduce the need for visits to the emergency department. This is supported by the fact that in the main study evaluating the tele-CDSMP, as well as in the current study, significant improvements in self-efficacy, health behaviors and health status were observed after participation in the program [
15].
Recently, Hamar and colleagues examined the impact of a chronic disease management program on hospital admissions and readmissions for persons with heart disease or diabetes in Australia [
26]. The intervention consisted of personalized online health support, involving health assessments, health action plans, education, and health behavior tracking for a period of 18 months. In addition, nurses provided phone calls to participants who had been identified as needing more intensive support. This study showed decreased hospitalizations during the 12 and 18 month period for participants while enrolled in the program for both the diabetes and heart disease cohort, with the latter group also showing significant reductions with respect to readmissions. While we did not find significant reductions in hospitalizations post tele-CDSMP, there are some important and relevant differences to highlight. Participants in Hamar et al.’s study [
26] had higher baseline hospitalization rates compared to our cohort and also comprised a larger proportion of persons with heart disease. Compared to the Stanford CDSMP, the intervention was more intensive and comprehensive in that it targeted vulnerable individuals who might have needed more support with additional follow-up calls from nurses.
Strengths and limitations of this study are noted below. The main strength of this study was the use of administrative data to determine health care utilization, which is not subject to recall bias. A study of seniors in Ontario examining agreement between self-reported and routinely collected health-care utilization data has shown both over and under-reporting of self-reported use of health services [
27]. Another strength of the study was the use of GEE to examine the impact of the CDSMP, as previous studies on health care use relied on descriptive statistics. Using GEE analysis, we are able to account for clustered observations. While our study has generated some interesting hypotheses for future research the findings need to be confirmed,and the limitations highlighted. The study participants were from rural and remote communities in Canada and even though there is universal access to health care, the availability of services in these regions, e.g. access to specialists, is less than in urban centers [
28] which may influence patterns of health care utilization. Another limitation is the small sample size for the multivariate regression with a stratified sample, perhaps due to the fact that individuals were being re-contacted one year after they participated in the initial study. The respondents were slightly younger and of higher income than the group who did not consent, which may influence the observed pattern of health care utilization and thus the generalizability of results to all older rural populations, since higher income is associated with lower health care utilization [
29]. Additionally, differences in ED visits by age group were identified using post-hoc analyses and needs to be confirmed in future studies. Finally, we do not know the length of time since chronic disease diagnosis.
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
SJ took primary responsibility for the design of the study, the acquisition, analysis and interpretation of data, and drafting and revising the article. She gave final approval of the version to be published. She accepts full responsibility for the work and the conduct of the study, had access to the data, and controlled the decision to publish. SG took primary responsibility for the design of the study, the acquisition, analysis and interpretation of data, and drafting and revising the article. GH, NS, and MZ provided advice and direction for the study design and contributed to data interpretation. They revised the article critically for important intellectual content. WL provided advice and direction for the study design, statistical analyses and contributed to data interpretation. She revised the article critically for important intellectual content. MM provided advice and direction for the study design and contributed to data analysis and interpretation. He revised the article critically for important intellectual content. All authors read and approved the manuscript.