Background
The rationale for commissioning community pulmonary rehabilitation programmes is based on the results of randomised controlled trials (RCTs) in which rehabilitation has been shown to be effective and cost-effective in increasing exercise tolerance, reducing symptoms, improving quality of life and reducing hospital admissions [1‐3].
Randomised controlled trials provide the “gold standard” for assessing effectiveness due to their high internal validity [4]. Only an RCT can properly allow for all confounders, both known and unknown, and a properly delivered RCT will minimise important sources of bias. This is in contrast to observational studies in which selection bias is often problematic, and in which it is very difficult to adjust for unknown confounders [5]. Guidance from the National Institute of Health and Clinical Excellence (NICE) and similar bodies on the effectiveness and cost-effectiveness of both drugs and complex interventions, including rehabilitation, is therefore based largely on the results of RCTs where these results are available [6].
Anzeige
However, it is not necessarily true that a randomised controlled trial has high external validity, in the sense that we cannot automatically expect to see the same effect size (or the same cost-effectiveness) when we deliver the intervention in a routine setting as was observed in the trial. There are a number of possible reasons for this: adherence to the intervention protocol may be less strict in the routine setting, and inclusion criteria for participants are likely to be more pragmatic. A trial typically attracts dedicated funding, whereas a programme that is delivered as part of usual health service provision must compete for scarce resources, particularly the time and commitment of clinicians and therapists. Lastly, the very nature of being observed in a trial can result in different behaviour by both patients and clinicians and therefore potentially a different outcome (the “Hawthorne effect”) [7].
In this study we compared the outcomes of pulmonary rehabilitation delivered in a randomised controlled clinical trial, with a similar programme delivered in a routine clinical setting. Our null hypothesis was that there was no difference in the change in outcome before and after the intervention in the clinical trial, compared with the before-after change in the routine clinical setting. A secondary aim was to evaluate uptake and dropout rates in both the BreathingSpace and randomised trial setting.
Methods
We used a retrospective cohort study design and compared baseline characteristics and before-after change in outcomes between two groups: the community-based pulmonary rehabilitation intervention arm of the Waterhouse et al. randomised controlled trial that took place in the city of Sheffield, South Yorkshire, between 2004 and 2005 [8] and the group of patients who undertook pulmonary rehabilitation in the “BreathingSpace” community rehabilitation programme in the neighbouring town of Rotherham, South Yorkshire, between 2007 and 2008 [9]. Ethics approval for the BreathingSpace Evaluation and for the trial were granted by the Rotherham NHS Local Research Ethics Committee and South Sheffield NHS Local Research Ethics Committee respectively [8, 9].
Interventions
Both the trial and the BreathingSpace rehabilitation programmes were delivered in community venues and consisted of a total of 12 or 16 sessions delivered by support workers who were trained and supervised by experienced therapists. Classes were delivered over six weeks in the trial and over eight weeks in BreathingSpace. BreathingSpace had relatively broad inclusion criteria for participation, and included non-COPD patients, whilst the trial intervention was limited to patients with a specific diagnosis of COPD and MRC grade 3 (or worse) dyspnoea. Table 1 summarises the characteristics of the rehabilitation programmes delivered in the trial and in BreathingSpace and their inclusion criteria. More details are available [8, 9]. Overall the main differences between the two programmes are those that might typically be found when comparing a randomised trial intervention and a community programme outside the context of a trial, in that although the trial was designed as a “pragmatic” trial and the trial protocol and report stresses that “access to the sessions was designed to follow usual clinical practice, reflecting ‘real life’ conditions” [8], the intervention did have more restrictive inclusion criteria (MRC severity grade of 3 or greater) and a more standardised intervention (“Programmes were identical in each venue, with exercises following a protocol and a core syllabus for each of the educational aspects” [8]).
Table 1
Intervention protocols for randomised trial and BreathingSpace
Randomised trial intervention protocol | BreathingSpace community rehabilitation programme | |
|---|---|---|
Duration of programme | Twice weekly 2 hour classes for 6 weeks (total 12 hours) | Twice weekly 90 minute classes for 8 weeks (total 12 hours) |
Delivery of programme | Delivered by physiotherapist and support worker, assessments performed by research team | Delivered by trained support workers supervised by physiotherapist or occupational therapist |
Content of programme | 1 hour of review, warm-up, exercise and cool-down; 1 hour for education; participants being encouraged to exercise between formal classes. Exercise diary kept between sessions and individualised exercise booklet provided at the end of the course. | 1 hour of warm-up, exercise and cool-down; 30 minutes for education; participants being encouraged to exercise and keep an exercise diary between formal classes. |
Inclusion/exclusion criteria | Diagnosis of COPD by respiratory physician, using GOLD guidelines | Diagnosed respiratory condition confirmed with spirometry; |
Medical Research Council (MRC) grade 3 or worse dyspnoea despite optimal medical care | Experiencing breathlessness in day to day life despite optimal respiratory medication | |
Clinically stable at least 4 weeks before commencing rehabilitation. | No cardiac event in the past 3 months and any known cardiac condition well controlled and stable. |
Anzeige
Data collection and analysis
We obtained data for the intervention arm of the randomised controlled trial from the published trial report [8] and for BreathingSpace from an audit and evaluation project [9]. This included data on patient eligibility, recruitment and retention rates, baseline characteristics and post-rehabilitation follow-up data. Post-rehabilitation outcomes were measured immediately after completion of the rehabilitation programmes in both settings to maximise retention and minimise missing data at that point. Since the trial was restricted to patients with MRC breathlessness grades from 3–5 only and BreathingSpace recruited patients at all grades, to ensure comparability we restricted our primary analysis to patients from both programmes with MRC breathlessness grades from 3–5. We repeated the analyses including all patients to determine whether restricting the programme to more severe grades was likely to have an impact of overall effectiveness.
Whilst the trial cohort included all those who were randomised to the community rehabilitation programme and attended for follow up data collection, the BreathingSpace cohort included all those who had follow up data collected following the rehabilitation programme irrespective of their attendance for the programme, but excluding those who did not take up an offer of rehabilitation. We compared the following baseline characteristics: mean age, proportion male participants, mean body mass index, mean FEV1 (Forced expiratory volume in 1 second) mean FEV1 as a proportion of predicted, mean FVC (Forced Vital Capacity ie the volume of air that can forcibly be blown out after full inspiration), mean FVC as a proportion of predicted, mean relaxed vital capacity, mean FEV1/FVC and proportion in each MRC breathlessness grade [10]. We also compared baseline mean CRQ (Chronic Respiratory Disease Questionnaire) symptom severity [11], mean domain specific SF-36v2 (measuring quality of life defined in terms of physical functioning, role-physical, bodily pain, general health, vitality, social functioning, role-emotional, mental health, physical component summary, mental component summary), and overall SF-36v2 score (an summary measure of quality of life across all domains [12] and mean EQ-5D-3 L (a standardised measure of health status developed by the EuroQol Group which provides a simple, generic measure of health) [13]. These measures have all been widely used to evaluate self-reported outcomes of pulmonary rehabilitation [14] as they measure both symptoms in four domains (CRQ domains with range 1–7 for both individual and mean domain responses) and quality of life (domains of SF-36 with range 0–100; SF-6D and EQ-5D-3 L with range 0 (death) to 1 (perfect/full health)). Minimal clinically important differences for these outcome measures were defined, as for the randomised trial [8] as 0.5 points for CRQ domains, 5 points for SF-36 dimensions, 0.04 points for SF-6D score and 0.07 points for EQ-5D score.
We compared the following outcome measures, where outcomes were defined in terms of the difference in each measure before and after the rehabilitation intervention: CRQ symptoms (dyspnoea, fatigue, emotion, mastery), SF-36v2 domains, SF-36v2 overall score), and EQ-5D-3 L.
The primary objective was to evaluate whether the before/after mean difference was different between the two settings. We used the individual patient data from the community rehabilitation arm of the trial and the clinical outcomes data collected by the BreathingSpace programme patients to calculate mean before and after differences.
For baseline characteristics we tested for differences between the trial and BreathingSpace using unpaired t-tests for continuous measures, and a Chi-square test for measures expressed as proportions. For outcomes we tested for differences in the before-after differences using unpaired t-tests. We considered differences between the trial and BreathingSpace statistically significant if p < 0.05.
We also report the difference in mean before-after differences in outcomes between the trial community rehabilitation intervention arm and BreathingSpace, along with 95% confidence intervals.
Results
Recruitment and retention
In the clinical trial, out of 1041 patients assessed, 448 (43%) were considered suitable for the programme and 326 of those (73%) gave informed consent to randomisation. Of the 162 randomised to community re7habilitation, 111 (69%) attended the initial assessment of whom 76 had data at baseline and immediately post-rehabilitation. Subsequently, these participants attended about two-thirds of sessions (mean 62.53% (sd 7.3%); range 0-100%). Less than half (47%) of those randomised to community rehabilitation, who all had met eligibility criteria and given informed consent to participation, both attended and completed the programme.
In comparison, in BreathingSpace, out of the first 643 patients attending for assessment, 491 (76%) were assessed as suitable for rehabilitation and 393 (80%) of those agreed to attend. Audit data from the rehabilitation programme subsequently showed that only 45% (608/1355) of rehabilitation attendees attended more than 13 sessions and 37% (314/1355) attended less than eight sessions [15]. Only 451 rehabilitation participants provided symptom and quality of life data at baseline (Table 2) and the tables show the number of patients who provided data for specific outcome measures at both baseline (Tables 3 and 4) and post-rehabilitation (Tables 5 and 6). The different numbers of participants on which the results are based in Tables 2 to 6 (varying from 71 to 111 for the trial and from 451 to 308 for BreathingSpace) reflect differences in the completeness of data with respect to the different outcomes measured.
Table 2
Baseline clinical characteristics (at pre-rehabilitation assessment)
Randomised trial – community setting intervention group | BreathingSpace – all participants | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
n | Mean | SD | Min | Max | n | Mean | SD | Min | Max | P-value for difference between groups | |
Age (years) | 111 | 68.7 | 8.3 | 49 | 86 | 451 | 69.7 | 8.9 | 45 | 92 | 0.3 |
Body mass index (kg/m2) | 111 | 25.4 | 5.6 | 14.0 | 44.0 | 421 | 27.5 | 6.5 | 12.5 | 66.2 | 0.001* |
FEV1 (litres) | 111 | 1.1 | 0.4 | 0.3 | 2.6 | 416 | 1.2 | 0.5 | 0.3 | 3.0 | 0.03* |
Actual FEV1 as a proportion of predicted FEV1 (%) | 111 | 45.1 | 16.3 | 16.8 | 89.8 | 417 | 48.3 | 16.6 | 15.0 | 117.0 | 0.07 |
FVC (litres) | 111 | 2.7 | 0.9 | 1.2 | 5.3 | 415 | 2.4 | 0.8 | 0.9 | 6.5 | 0.002* |
Actual FVC as a proportion of predicted FVC (%) | 111 | 86.7 | 19.3 | 50.8 | 137.5 | 412 | 79.4 | 18.1 | 28.0 | 136.0 | <0.001* |
Relaxed vital capacity (litres) | 111 | 2.7 | 0.9 | 1.4 | 5.1 | 398 | 2.5 | 0.8 | 0.7 | 6.1 | 0.04* |
FEV1/FVC | 111 | 0.4 | 0.1 | 0.2 | 1.0 | 412 | 0.5 | 0.1 | 0.2 | 0.9 | <0.001* |
n
|
%
|
n
|
%
| ||||||||
Gender
| |||||||||||
Female | 49 | 44 | 219 | 49 | 0.5 | ||||||
Male | 62 | 56 | 231 | 51 | |||||||
Total
|
111
|
100
|
450
|
100
| |||||||
MRC breathlessness grade
| |||||||||||
1 | - | - | 8 | 2 | <0.001* | ||||||
2 | - | - | 68 | 16 | |||||||
3 | 38 | 34 | 169 | 40 | |||||||
4 | 37 | 33 | 132 | 32 | |||||||
5 | 36 | 32 | 41 | 10 | |||||||
Total
|
111
|
100
|
418
|
100
| |||||||
Table 3
Baseline self-reported symptoms and quality of life measures (at pre-rehabilitation assessment) including only participants MRC grade ≥3
Randomised trial – community setting intervention group | BreathingSpace – participants MRC ≥3 | ||||||
|---|---|---|---|---|---|---|---|
n | Mean | SD | n | Mean | SD | P-value for difference in means | |
CRQ symptoms
| |||||||
Dyspnoea | 75 | 3.2 | 0.9 | 329 | 2.9 | 1.0 | 0.002* |
Fatigue | 75 | 3.3 | 1.2 | 329 | 3.4 | 1.3 | 0.73 |
Emotion | 75 | 4.4 | 1.3 | 329 | 4.4 | 1.4 | 0.92 |
Mastery | 75 | 4.3 | 1.4 | 329 | 4.5 | 1.4 | 0.40 |
SF-36v2 domains
| |||||||
Physical functioning | 75 | 32.0 | 20.3 | 335 | 31.8 | 23.4 | 0.95 |
Role-physical | 76 | 36.6 | 22.0 | 333 | 36.7 | 27.4 | 0.98 |
Bodily pain | 74 | 58.2 | 27.9 | 313 | 54.4 | 29.7 | 0.30 |
General health | 74 | 35.6 | 18.7 | 304 | 33.1 | 19.5 | 0.30 |
Vitality | 75 | 38.7 | 18.6 | 306 | 37.7 | 21.2 | 0.68 |
Social functioning | 76 | 49.7 | 30.8 | 313 | 52.6 | 33.0 | 0.47 |
Role-emotional | 76 | 58.1 | 29.8 | 304 | 56.3 | 34.0 | 0.65 |
Mental health | 76 | 65.1 | 21.5 | 310 | 66.4 | 20.5 | 0.63 |
PCS (Physical component summary) | 71 | 32.2 | 7.4 | 291 | 31.2 | 9.7 | 0.32 |
MCS (Mental component summary) | 71 | 42.3 | 12.2 | 291 | 43.7 | 13.1 | 0.38 |
SF-6D
| 71 | 0.61 | 0.11 | 291 | 0.59 | 0.12 | 0.10 |
EQ-5D-3 L
| 76 | 0.56 | 0.27 | 291 | 0.50 | 0.21 | 0.09 |
Table 4
Baseline self-reported symptoms and quality of life measures (at pre-rehabilitation assessment) – including BreathingSpace patients MRC grade < 3
Randomised trial – community setting intervention group | BreathingSpace – all participants | ||||||
|---|---|---|---|---|---|---|---|
n | Mean | SD | n | Mean | SD | P-value for difference in means | |
CRQ symptoms
| |||||||
Dyspnoea | 75 | 3.2 | 0.9 | 481 | 2.9 | 1.1 | 0.02* |
Fatigue | 75 | 3.3 | 1.2 | 481 | 3.5 | 1.3 | 0.2 |
Emotion | 75 | 4.4 | 1.3 | 481 | 4.5 | 1.3 | 0.6 |
Mastery | 75 | 4.3 | 1.4 | 481 | 4.5 | 1.4 | 0.2 |
SF-36v2 domains
| |||||||
Physical functioning | 75 | 32.0 | 20.3 | 443 | 32.0 | 23.2 | 1.0 |
Role-physical | 76 | 36.6 | 22.0 | 442 | 36.7 | 26.7 | 1.0 |
Bodily pain | 74 | 58.2 | 27.9 | 413 | 53.6 | 29.2 | 0.2 |
General health | 74 | 35.6 | 18.7 | 401 | 33.4 | 20.0 | 0.4 |
Vitality | 75 | 38.7 | 18.6 | 404 | 37.9 | 20.8 | 0.7 |
Social functioning | 76 | 49.7 | 30.8 | 413 | 53.1 | 32.7 | 0.4 |
Role-emotional | 76 | 58.1 | 29.8 | 404 | 55.6 | 34.1 | 0.5 |
Mental health | 76 | 65.1 | 21.5 | 408 | 66.4 | 20.5 | 0.6 |
PCS (Physical component summary) | 71 | 32.2 | 7.4 | 385 | 31.0 | 9.7 | 0.3 |
MCS (Mental component summary) | 71 | 42.3 | 12.2 | 385 | 43.7 | 13.1 | 0.4 |
SF-6D
| 71 | 0.61 | 0.11 | 381 | 0.60 | 0.12 | 0.6 |
EQ-5D-3 L
| 76 | 0.56 | 0.27 | 385 | 0.53 | 0.23 | 0.4 |
Table 5
Impact of rehabilitation programme on respiratory symptoms and quality of life - including only participants MRC > =3
Randomised trial – community setting intervention group | BreathingSpace – participants MRC > =3Mean after-before difference | |||||||
|---|---|---|---|---|---|---|---|---|
n | Mean before-after difference | SD | n | Mean before-after difference | SD | Difference in mean before-after differences (95% CI) | P-value for difference in mean before-after differences | |
CRQ symptoms
| ||||||||
Dyspnoea
|
74
|
0.29
|
1.18
|
329
|
0.55
|
1.20
|
0.26 (−0.04, 0.56)
|
0.09
|
Fatigue
|
75
|
0.58
|
1.12
|
329
|
0.51
|
1.21
|
−0.07 (−0.36, 0.21)
|
0.61
|
Emotion
|
74
|
0.39
|
0.98
|
329
|
0.34
|
1.15
|
−0.05 (−0.31, 0.21)
|
0.70
|
Mastery
|
75
|
0.36
|
1.08
|
329
|
0.27
|
1.24
|
−0.09 (−0.37, 0.19)
|
0.53
|
SF-36v2 domains
| ||||||||
Physical functioning
|
79
|
0.87
|
17.6
|
333
|
5.81
|
20.4
|
4.94 (0.36, 9.53)
|
0.03*
|
Role-physical
|
79
|
8.25
|
24.6
|
331
|
7.30
|
27.0
|
−0.95 (−7.27, 5.36)
|
0.77
|
Bodily pain
|
78
|
1.29
|
25.8
|
277
|
2.93
|
26.3
|
1.64 (−5.07, 8.35)
|
0.63
|
General health
|
77
|
3.93
|
15.7
|
263
|
3.17
|
17.0
|
−0.76 (−4.94, 3.42)
|
0.72
|
Vitality
|
79
|
8.15
|
16.8
|
269
|
7.59
|
21.4
|
−0.55 (−5.18, 4.08)
|
0.81
|
Social functioning
|
80
|
12.7
|
29.5
|
277
|
8.35
|
32.7
|
−4.31 (−12.04, 3.42)
|
0.27
|
Role-emotional
|
79
|
5.17
|
31.0
|
268
|
7.91
|
34.8
|
2.74 (−5.44, 10.93)
|
0.51
|
Mental health
|
80
|
5.81
|
15.7
|
274
|
4.76
|
19.5
|
−1.05 (−5.31, 3.20)
|
0.62
|
PCS (Physical component summary)
|
73
|
0.98
|
6.49
|
249
|
1.31
|
7.76
|
0.33 (−1.48, 2.13)
|
0.72
|
MCS (Mental component summary)
|
73
|
5.38
|
10.4
|
249
|
3.95
|
12.8
|
−1.43 (−4.35, 1.49)
|
0.34
|
SF-6D
|
72
|
0.014
|
0.10
|
245
|
0.030
|
0.11
|
0.016 (−0.010, 0.043)
|
0.23
|
EQ-5D-3 L
|
80
|
0.066
|
0.28
|
249
|
0.044
|
0.15
|
−0.022 (−0.086, 0.042)
|
0.51
|
Table 6
Impact of rehabilitation programme on respiratory symptoms and quality of life– including BreathingSpace patients MRC grade 1-2
Randomised trial – community setting intervention group | BreathingSpace – all participants | |||||||
|---|---|---|---|---|---|---|---|---|
n | Mean before-after difference | SD | n | Mean before-after difference | SD | Difference in mean before-after differences (95% CI) | P-value for difference in mean before-after differences | |
CRQ symptoms
| ||||||||
Dyspnoea
|
74
|
0.29
|
1.18
|
481
|
0.61
|
1.25
|
0.32 (0.03, 0.62)
|
0.03*
|
Fatigue
|
75
|
0.58
|
1.12
|
481
|
0.48
|
1.22
|
−0.10 (−0.38, 0.18)
|
0.31
|
Emotion
|
74
|
0.39
|
0.98
|
481
|
0.36
|
1.15
|
−0.03 (−0.27, 0.22)
|
0.79
|
Mastery
|
75
|
0.36
|
1.08
|
481
|
0.32
|
1.20
|
−0.04 (−0.31, 0.23)
|
0.86
|
SF-36v2 domains
| ||||||||
Physical functioning
|
79
|
0.87
|
17.6
|
438
|
5.47
|
20.1
|
4.61 (0.16, 9.06)
|
0.08
|
Role-physical
|
79
|
8.25
|
24.6
|
437
|
7.36
|
26.6
|
−0.9 (−7.04, 5.24)
|
0.57
|
Bodily pain
|
78
|
1.29
|
25.8
|
356
|
2.55
|
26.3
|
1.25 (−5.30, 7.80)
|
0.71
|
General health
|
77
|
3.93
|
15.7
|
337
|
3.29
|
16.5
|
−0.64 (−4.68, 3.40)
|
0.78
|
Vitality
|
79
|
8.15
|
16.8
|
345
|
6.75
|
20.5
|
−1.4 (−5.82, 3.03)
|
0.42
|
Social functioning
|
80
|
12.7
|
29.5
|
356
|
7.97
|
31.7
|
−4.69 (−12.16, 2.79)
|
0.11
|
Role-emotional
|
79
|
5.17
|
31.0
|
346
|
7.77
|
32.9
|
2.6 (−5.26, 10.46)
|
0.38
|
Mental health
|
80
|
5.81
|
15.7
|
351
|
4.65
|
18.7
|
−1.16 (−5.23, 2.92)
|
0.48
|
PCS (Physical component summary)
|
73
|
0.98
|
6.49
|
317
|
1.11
|
7.5
|
0.13 (−1.61, 1.87)
|
0.84
|
MCS (Mental component summary)
|
73
|
5.38
|
10.4
|
317
|
3.78
|
12.1
|
−1.59 (−4.39, 1.20)
|
0.24
|
SF-6D
|
72
|
0.014
|
0.10
|
308
|
0.029
|
0.11
|
0.015 (−0.011, 0.040)
|
0.30
|
EQ-5D-3 L
|
80
|
0.066
|
0.28
|
317
|
0.039
|
0.14
|
−0.027 (−0.090, 0.036)
|
0.42
|
Anzeige
Baseline characteristics
There were no significant differences in either the mean age or the gender distribution between the trial intervention arm and BreathingSpace (Table 2). The community participants had higher body mass indices but had significantly better lung function. This is consistent with the smaller proportion at MRC Grade 5 in the BreathingSpace (10% versus 32%) and is due at least in part to the different inclusion criteria of the trial and BreathingSpace. BreathingSpace accepts patients with MRC grades 1 and 2 breathlessness, whereas these participants were excluded from the trial. Despite these differences, patient reported symptoms and quality of life measures were similar in the two populations (Tables 3 and 4).
Respiratory symptoms and quality of life outcomes
Pre-rehabilitation and post-rehabilitation outcomes were collected for 329 BreathingSpace participants and 80 trial participants (Tables 5 and 6). Both groups improved with similar changes seen in the trial and BreathingSpace. The differences in mean before-after differences in outcomes between the trial community rehabilitation intervention arm and BreathingSpace were all small, and smaller than the clinically important difference. Confidence intervals for the differences in differences contained zero (the null value) for all outcomes except the Physical Functioning domain, where participants in BreathingSpace improved more than those in the trial (Table 5). However, this finding should be viewed with caution given that the overall Physical component summary improvement and overall SF-36 improvements were similar between groups. Repeating the analyses including 152 Breathing Space patients with MRC Grades 1–2 (a total of 481 patients) in the Breathing Space cohort gave similar results (Table 6).
Discussion
The primary objective was to evaluate whether the before/after mean differences in outcomes seen at BreathingSpace were different to those reported in the intervention arm of the trial. Despite some differences between BreathingSpace participants and research participants in clinical status at baseline, patient reported symptoms and quality of life measures were similar in the two populations. Improvements in both symptoms and quality of life were of the same order of magnitude in both programmes despite the different contexts, setting and scale of the two intervention programmes. In particular, the inclusion of patients with less clinically severe disease (less than MRC Grade 3) does not appear to have reduced the overall effectiveness, a finding consistent with previous evaluations [16]. In both the clinical trial and the larger scale programme, a high proportion of those originally assessed, and who might have potentially benefited, either did not start or did not complete the programme. This suggests that the barriers to participation and completion of rehabilitation are not only due to the additional constraints of involvement in a trial but also occur in “real world” non-research settings. There is no clear consensus or evidence base to support any particular threshold for regarding attendance as adequate before an individual can be said to have received an adequate “dose” of rehabilitation in this context. The relationship between attendance and outcomes will be confounded by other factors that will influence both attendance and outcomes, particularly changes in health status. We suspect that poor attendance could be causally associated with both poorer health (participants not well enough to attend) and with better health (participants feeling well enough to take up other normal activities and responsibilities and therefore choosing not to attend) so interpreting whether (and why) better attendance might predict better or worse outcomes requires further research.
This analysis is based on a comparison of a group of patients recruited to a clinical trial of community-based pulmonary rehabilitation and a group of patients receiving community-based pulmonary rehabilitation in clinical practice. The first group were exposed to pulmonary rehabilitation as part of a Sheffield based randomised trial, funded by the Health Technology Appraisal Programme (NIHR HTA programme). The second group were exposed to rehabilitation as part of a large community programme based in the purpose-built “BreathingSpace” facility in the neighbouring town of Rotherham. The content and delivery of both programmes was based on a similar interpretation of the evidence base for COPD rehabilitation programmes at that time [1]. This provides a unique opportunity to compare the impact of rehabilitation seen in a controlled trial with the impact achieved in a routine community setting. However, whilst we have assumed that as both groups were identified from geographically adjacent populations and both identified as suitable for community-based pulmonary rehabilitation, they represent similar populations, there is always the potential for patients included in research studies being selected to be different from the patients that take up the intervention in clinical practice.
Anzeige
The other main weaknesses of this analysis are those associated with any secondary analysis, in that the data available for analysis are limited to those that were collected for the original analyses. Potentially useful missing information included measures of baseline differences such as the presence or absence of co-morbidities, smoking status and information on other relevant clinical measures such as walking distance and health care service use. However from the data that were collected, we are reasonably confident that we are comparing similar populations who received similar programmes.
Some studies that have compared the results of randomised trials and observational studies have found that they generate similar results [17]. Although a number of studies have considered the rationale for expecting differences between trials and observational studies, none to date have considered the empirical evidence for a difference in the clinical effectiveness of a specific complex intervention such as pulmonary rehabilitation, when replicated in a non-research setting.
Other authors have shown that the effect sizes observed in randomised trials can be quite different to those observed in non-randomised studies of the same intervention [18]. This is not surprising given the problems of internal validity (i.e. bias and confounding) that are inherent in non-randomised studies. Our question is somewhat different and relates to the external validity of a randomised trial. Can we expect to see the same outcomes in the routine clinical setting that we saw in the trial? Based on the results we present for pulmonary rehabilitation we conclude that, outcomes similar to those achieved in clinical trials can be achieved in the “real world”.
Conclusions
We conclude that the before-after changes in outcomes seen in a “real world” community rehabilitation programme are similar in magnitude to those seen in the intervention arm of a clinical trial. However, the relatively low participation and completion rates that are observed in the context of trials, and which might be thought to be specific to the trial setting (due for example to the requirements of an onerous consent process) also exist in “real world” programmes. The barriers to participation in any pulmonary rehabilitation programme, trial or otherwise, that are indicated by these findings need to be addressed if the potential benefits of rehabilitation for a larger number of people with chronic lung disease are to be maximised.
Anzeige
Acknowledgements
The RCT was funded by the Health Technology Assessment programme and the BreathingSpace Evaluation by NHS Rotherham. This analysis was funded by the COPD Theme programme of the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care for South Yorkshire (NIHR CLAHRC SY). The views and opinions expressed are those of the authors, and not necessarily those of the NHS, the NIHR or the Department of Health. NIHR CLAHRC SY would also like to acknowledge the participation and resources of our partner organisations. Further details can be found at http://www.clahrc-sy.nihr.ac.uk.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Competing interests
AG, GS, OR and GB were involved in the delivery of BreathingSpace programmes. RL was principal investigator for the NIHR-funded pulmonary rehabilitation trial and has received payment for Board membership (Novartis, GSK) and received grants and payment or expenses for presentations and meetings (GSK, Novartis, Boehringer, Nycomed, Astra Zeneca).
Authors’ contributions
EG, MS, AG and GB conceived the study, and participated in its design and coordination. MS and MH carried out the statistical analyses and EG wrote the first draft of the manuscript. RL, OR, GB and GM also provided information about the interventions and data collection process in both settings. All authors contributed to the interpretation of the findings and to drafting the manuscript. All authors read and approved the final manuscript.