Methods
The GEPAT-SMART study (Greece Epidemiological Project on Adherence and Temperature Using RebiSMART®) was a multicentre, prospective, observational study carried out at 9 sites in Greece (Greek registry of non-interventional clinical trials id: 200136, date of registration: February 18th, 2013 [
8]). The recruitment period lasted from February 2013 to February 2014. The last patient follow-up ended on April 2015. The study was carried out in accordance with the Declaration of Helsinki and applicable national regulatory requirements and was approved by local ethics committees at each study site [ethics committee of the Papageorgiou Hospital of Thessaloniki (reference number 161/20.9.2012), ethics committee of the AHEPA Hospital (reference number 32/5.12.2012), ethics committee of the University Hospital of Ioannina (reference number 754/12.11.2012), ethics committee of the University Hospital of Patras (reference number 83/7.2.2013), ethics committee of the 401 Army Hospital of Athens (reference number 15/2012), ethics committee of the University Hospital of Larissa (reference number 19/13.11.2012), ethics committee of the Papanikolaou Hospital of Thessaloniki (reference number 11/3.10.2012), ethics committee of the Evangelismos Hospital (reference number 345/13.12.12), ethics committee of the Attiko Hospital (reference number 10/5.10.2012)]. Patients were enrolled after written informed consent had been obtained.
Participants
Inclusion criteria were 1) RRMS diagnosis (revised McDonald criteria (2010)), 2) Rebif® multi-dose injected by RebiSmart® prescribed according to the approved Summary of Product Characteristics (SmPC) within six (6) weeks prior to their enrolment into the study, 3) capable to handle RebiSmart®, 4) willing and capable to comply will all study requirements and procedures, 5) 18 to 65 years old and 6) Expanded Disability Scale Score (EDSS) < 6 at enrollment.
Exclusion criteria were 1) presence of any contraindication mentioned in the locally approved SmPC, 2) severe relapse within 30 days before study treatment commencement, 3) visual or physical impairment precluding them from self-injecting with RebiSmart®, 4) MS therapy within 6 months prior to study, 5) current or past (within the last 2 years prior to study enrolment) history of alcohol or drug abuse, 6) participation in another clinical trial during the last 30 days prior to study treatment commencement. Female subjects who were pregnant or breast-feeding were also excluded. Female patients with childbearing potential had to utilize a highly effective method of contraception for the duration of the study.
Administration of the study drug
All patients were provided with a RebiSmart® device (Merck, Darmstadt, Germany) for self-administration of serum-free Rebif® 44 μg or 22 μg sc three times weekly (tiw) for 12 months or until early discontinuation (ED). RebiSmart® is a CE-certified medical device. The dose of Rebif® was titrated over the first 4 weeks in accordance with the drug labeling information; the final dose was at the discretion of the treating physician and based on the recommendations in the drug labeling information.
Patient assessments
Following a pre-study evaluation visit, patients attended the study site at Study Day 1 (baseline), Month 6, and Month 12. At the baseline visit, all patients provided written informed consent and information on demographics, medical history, concomitant diseases, and MS history, including the number and characteristics of relapses in the past 12 months, was collected. At each post-baseline visit, the investigators recovered adherence data from the autoinjector. Reasons for missed injections were recorded in a patient diary. Relapse assessment, EDSS score, MS-related concomitant medication, vital signs, on-going therapy with Rebif® (including dose), and adverse events (AEs) were also recorded.
Study endpoints
The primary endpoint was the monthly, seasonal and annual adherence rate over the 12-month study treatment. Adherence rate was defined as 100 × number of injections actually administered divided by the expected number of injections over the defined time period (month, season, year), as captured by RebiSmart®. Secondary endpoints were: 1) reasons for missed injections, 2) proportion of patients free of relapses at month 12, 3) mean number of relapses at 12 months, 4) proportion of patients without progression of 3-month confirmed disability, at 12 months. Disability progression was defined as worsening by at least 0.5 EDSS points from baseline, 5) proportion of patients who discontinued prematurely the study treatment and the reasons for discontinuation. All (Serious) Adverse Events [(S)AEs] and Adverse Drug Reactions [(S)ADRs] were also recorded, 6) Patient evaluation of RebiSmart® based on a Convenience Questionnaire.
The following criteria were to be met for establishing an MS relapse: 1) Neurological abnormality, either newly appearing or re-appearing, at least 30 days after the onset of a preceding clinical event, with > = 24 h duration, 2) absence of fever (temperature > 37.5C) or known infection and 3) objective neurological impairment, correlating with the patient’s reported symptoms, defined as either increase in at least one of the functional systems of the EDSS domain or increase of the total EDSS score. Severity of relapses was described as mild, moderate, or severe according to the Activities of Daily Living criteria [
9]. AEs were classified according to MedDRA v14.0 [
10].
Sample size
The calculation of the sample size was based on the primary endpoint of the study. Due to the lack of literature data regarding the seasonal and monthly adherence, the adherence over the 12-month treatment period was used. According to available data the expected adherence during the study period was expected to be approximately 70% and the standard deviation 15% [
11]. Therefore, 70 patients would be required to estimate the mean adherence rate with accuracy of less than ± 4%.
Statistical analyses
This manuscript was development according to the STROBE (STrengthening the Reporting of OBservational studies in Epidemiology) guideline for reporting observational studies [
12]. Descriptive statistics were calculated for all study variables. Summary statistics for categorical variables were presented as the number and percent of subjects in each category.
Seasonal and monthly variance of the adherence level was analyzed by One Way Analysis of Variance (ANOVA). Pre- and post-treatment relapse rate was compared by the Wilcoxon signed-rank test. Pearson’s r was used to study correlation between variables. The level of significance was set to 5% (two-sided). Descriptive statistics were used for AEs and SAEs. Adverse events where handled according to the study protocol.
Statistical analyses sets were performed in the following sets:
-
Full analysis set (FAS): all recruited subjects who fulfilled the inclusion/exclusion criteria.
-
Per-protocol set (PPS): all FAS subjects who completed all study visits.
-
Safety set: all study patients who actually received at least one dose of treatment for MS following informed consent.
No replacement policy existed in this study for drop-out patients and missing data.
Discussion
To our knowledge, this is the first prospective study to assess yearly, seasonal and monthly adherence to, and efficacy, safety, and tolerability of Rebif® for RRMS administered with an electronic autoinjector. In a previous study seasonal adherence to the interferons and glatiramer acetate had been studied retrospectively, by means of patient-administered questionnaire [
7]. Here, adherence data was objectively captured by the autoinjector electronically and therefore not subject to patient reporting errors [
2,
13].
In our study cumulative 12-month adherence to Rebif® was very high (97.93 ± 5.704, FAS), confirming the findings of a previous 12-month and of two 12-week user trials with the same autoinjector [
2,
11,
14], (97.0 ± 7.3% cumulative 12-month adherence [
2], 90.3% of patients with > 90% adherence [
14], and 88.2% of patients having administered ≥80% of scheduled injections, with 67% administering all scheduled injections [
11] respectively). The use of an intramuscular IFN b-1a autoinjector in another study resulted in monthly compliance rates of 87.5–96.2%, supporting the notion that an autoinjector may contribute to high compliance [
15].
Interestingly, the COMPLIANCE study investigators [
7], which took place in Spain, where weather conditions are similar to Greece’s, reported findings seemingly opposite to ours, namely that seasons had a considerable impact on adherence. The authors comment in the discussion that they found a correlation between summer months and non-adherence, however they acknowledge that this association was not statistically significant. Furthermore, 81% of their patients reported that seasons did not affect their adherence. Hence, the data in the COMPLIANCE study support our finding that seasons do not affect adherence.
Thirty one patients (48%) missed at least one injection during the study period. The main reasons for non-adherence (Table
5) are in agreement with previous reports [
2,
5,
16]. RebiSmart® was evaluated by study participants as easy to use and convenient (Fig.
5). The lower score was given to the item “it has easy connection needle” and this might be an aspect of the device that can be improved.
Treatment with Rebif® was efficacious; 87% of the per-protocol population were relapse free at month 12, which compares favorably with the rates of 66.8% at 48 weeks and 53.3% at 96 weeks with the same serum-free Rebif® formulation administered manually or with a mechanical autoinjector [
16,
17]. Mean number of relapses was significantly lower at month 12 compared to the pre-treatment year. These numbers are consistent with those recently reported for RebiSmart® [
2], yet lower compared to the ARR obtained for Rebif® in a series of recent clinical trials where the latter was used a comparator (Rebif® vs Alemtuzumab in CARE-MS-I and CARE-MS-II where ARR for Rebif® was 0.39 ± 0.907 and 0.52 ± 1.01 respectively [
18,
19] and Rebif® vs Ocrelizumab in OPERA-I and OPERA-II where ARR for Rebif® was 0.29 ± 0.72 and 0.29 ± 0.73 respectively [
20]. The mean number of relapses in the 12 months pre-treatment was also higher in these studies: 1.33 ± 0.64 and 1.34 ± 0.73 in OPERA-I and II [
20], 1.8 ± 0.8 and 1.5 ± 0.75 in CARE_MS I and II respectively [
18,
19]. These differences in the study populations, as well as in the design of the trials, might account for the lower post-treatment relapse rate that we have observed. On the other hand, in the SMART trial, which recruited a similar patient population in terms of pre-treatment relapses, the one-year pre- and post- treatment ARR was comparable [
2].
3-month confirmed disability progression at the end of the study period was observed in 10 patients (21%), while in 19 (40%) patients EDSS remained stable and in 18 (39%) it improved. Overall, in the PPS mean EDSS change of 0.17 ± 1.13 was not significant. It is notable that the change in EDSS from baseline was not related to the 12-month either pre- or post-treatment relapses (Fig.
3), while the mean number of relapses in the 12-month pre- and post- treatment period did not differ significantly among patients in whom EDSS had progressed, remained stable or improved at the end of the study (Fig.
4). Albeit there was a trend towards a higher mean number of relapses in the 12-month post-treatment period in those with EDSS progression, this difference did not reach statistical significance. It should be noted that these correlation analyses are post-hoc and should be treated with caution, as they are statistically under-powered.
Despite the relatively short observation period, these findings add to the on-going debate on the relation between relapses and disability in MS. Relapses and disability progression are two important clinical characteristics of MS. Relapses are the clinical expression of inflammatory insults localized at different parts of the central nervous system, whereas disability progression is the phenotypic expression of ongoing demyelination, axonal loss and gliosis [
21]. In an earlier study of 1844 patients who had MS for 11 ± 10 years, it was found that once a certain clinical threshold is reached (namely, 4 on the EDSS), the progression of disability is not further affected by relapses. This, according to the authors, suggests that there is a dissociation between the pathophysiological mechanisms underpinning relapses and disability progression [
21]. A more recent observational study of 162 MS patients treated with interferon beta for at least 2 years, found that compared to patients with no relapses in the first 2 years, those with 1 or ≥ 2 relapses were more likely to exhibit early sustained disability progression (Hazard Ratio for 1 relapse: 3.4,
p = 0.05; Hazard Ratio for ≥2 relapses: 4.3,
p < 0.001). However, there was no statistically significant difference between patients that had 1 or ≥ 2 relapses [
22]. Finally, a real world evidence study comparing alemtuzumab, interferon beta, fingolimod, or natalizumab in terms of relapses and disability progression showed that despite the fact that alemtuzumab was associated with a lower ARR than Rebif® (0.19 [95% CI 0.14–0.23] vs 0.53 [0.46–0.61],
p < 0.0001), it was associated with similar probabilities of both disability accumulation (hazard ratio 0.66 [95% CI 0.36–1.22],
p = 0.37) and disability improvement as Rebif® (0.98 [0.65–1.49],
p = 0.93) at 5 years [
23]. Our results favor those studies that support a dissociation between relapses and disability progression, calling for more research on the pathophysiological mechanisms underpinning this phenomenon and on the appropriate treatment strategies.
A limitation of our study is its relatively small size. However, it is the only study that we are aware of, in which seasonal adherence to interferon treatment for MS is evaluated by means of an autoinjector, rather than by patient-administered questionnaires. This increases the objectivity of the measurements. Furthermore, the sample size for this study was calculated based on the primary endpoint, namely 12-month adherence, due to the lack of published data regarding the seasonal and monthly adherence. As, according to our findings, 12-month, seasonal and monthly adherence are similar and have higher mean values and lower standard deviations than what was assumed during sample size calculations, the recruited number of patients was adequate to also estimate seasonal and monthly adherence.
The very high adherence rate that we have observed could have been confounded by factors such as higher educational level, occupation or willingness to participate in a clinical study. While the latter is a common factor in all studies, our sample was balanced in terms of educational level (high school – university), social status (married or not) and occupation (public/private sector). Furthermore, we did not observe any discrepancies in the adherence rates, which was high in all these subgroups.
While the observational design of the study and its 12-month duration are suitable for evaluating adherence (primary endpoint), they are less relevant to the efficacy measurements (relapse rate and disability progression), which were however secondary endpoints and should be interpreted with caution. Nevertheless, the results that we have obtained on relapse rate are consistent with those published in the literature, while our finding that pre- and post-treatment relapses are not related to disability progression or improvement at 12-months adds to the on-going discussion on the matter.