A systematic review on the effectiveness of complementary and alternative medicine for chronic non-specific low-back pain
verfasst von:
Sidney M. Rubinstein, Marienke van Middelkoop, Ton Kuijpers, Raymond Ostelo, Arianne P. Verhagen, Michiel R. de Boer, Bart W. Koes, Maurits W. van Tulder
The purpose of this systematic review was to assess the effects of spinal manipulative therapy (SMT), acupuncture and herbal medicine for chronic non-specific LBP. A comprehensive search was conducted by an experienced librarian from the Cochrane Back Review Group (CBRG) in multiple databases up to December 22, 2008. Randomised controlled trials (RCTs) of adults with chronic non-specific LBP, which evaluated at least one clinically relevant, patient-centred outcome measure were included. Two authors working independently from one another assessed the risk of bias using the criteria recommended by the CBRG and extracted the data. The data were pooled when clinically homogeneous and statistically possible or were otherwise qualitatively described. GRADE was used to determine the quality of the evidence. In total, 35 RCTs (8 SMT, 20 acupuncture, 7 herbal medicine), which examined 8,298 patients, fulfilled the inclusion criteria. Approximately half of these (2 SMT, 8 acupuncture, 7 herbal medicine) were thought to have a low risk of bias. In general, the pooled effects for the studied interventions demonstrated short-term relief or improvement only. The lack of studies with a low-risk of bias, especially in regard to SMT precludes any strong conclusions; however, the principal findings, which are based upon low- to very-low-quality evidence, suggest that SMT does not provide a more clinically beneficial effect compared with sham, passive modalities or any other intervention for treatment of chronic low-back pain. There is evidence, however, that acupuncture provides a short-term clinically relevant effect when compared with a waiting list control or when acupuncture is added to another intervention. Although there are some good results for individual herbal medicines in short-term individual trials, the lack of homogeneity across studies did not allow for a pooled estimate of the effect. In general, these results are in agreement with other recent systematic reviews on SMT, but in contrast with others. These results are also in agreement with recent reviews on acupuncture and herbal medicine. Randomized trials with a low risk of bias and adequate sample sizes are direly needed.
The online version of this article (doi:10.1007/s00586-010-1356-3) contains supplementary material, which is available to authorized users.
Introduction
Low-back pain (LBP) is a common and disabling disorder in western society, which represents a great financial burden in the form of direct costs resulting from loss of work and medical expenses, as well as indirect costs [28, 29, 76]. Effective and adequate treatment is an important issue for patients, clinicians and policy makers. In addition to traditional interventions for LBP, such as medication, exercise or behavioural therapy, therapies collectively called complementary and alternative medicine (CAM) are commonly used. This includes, for example, spinal manipulative therapy (SMT), acupuncture and herbal medicine. The effectiveness of these therapies for the treatment of chronic non-specific LBP is not without dispute; therefore, a systematic review was conducted in order to assess the effectiveness of CAM therapies for the treatment of chronic non-specific LBP.
Methods
Criteria for considering studies for this review
Types of studies
Only randomised controlled trials (RCT) on SMT, acupuncture and herbal medicine were considered.
Types of participants
A study must have fulfilled the following criteria: (1) RCT with at least 1 day of follow-up; (2) adult (≥18 years of age) subjects with chronic (≥12 weeks) non-specific LBP (including discopathy or any other non-specific degenerative pathology, such as degeneration or osteoarthritis); (3) evaluated at least one main clinically-relevant outcome measure (i.e. pain, functional status, recovery, or sick-leave) using a valid instrument; and (4) fulfilled the operational definition of the therapy evaluated. In addition, the unique contribution of the CAM therapy must have been able to be discerned, which excludes studies with a multi-modal treatment in which the comparison was another type of intervention.
The following studies were excluded: (1) those in which specific spinal conditions were examined, specifically radiculopathies confirmed by radiodiagnostic procedures (i.e. MRI, CT), electrodiagnosis (i.e. EMG), positive Lasegue’s or any other study in which subjects with clear neurological deficits were included, spondylolisthesis, vertebral spinal stenosis, ankylosing spondylitis, scoliosis, or coccydynia; (2) post-partum LBP or pelvic pain due to pregnancy; (3) post-operative studies; (4) primary or secondary prevention studies; and (5) abstracts or non-published studies.
Types of interventions
The operational definitions as defined in the individual Cochrane reviews were maintained. SMT is defined as any hands-on treatment and includes both manipulation and mobilization [3]. Acupuncture is defined according to traditional acupuncture theory, and the needles were required to be inserted in classical meridian points, extra points or ah-shi points (painful points) [31]. Studies were excluded if the acupuncture treatment did not involve needling, such as acupressure or laser acupuncture. Herbal medicine is defined as all or part of a plant that was used for medicinal purposes, administered orally (ingestion) or applied topically. This excludes plant substances that were smoked, individual chemicals that were derived from plants or synthetic chemicals that were based on constituents of plants [32].
Types of outcome measures
Primary outcomes
The following self-reported measures were assessed: pain, back-specific functional status, perceived recovery (e.g. subjective overall improvement, proportion of patients recovered) and lost days at work (e.g. return to work status, number of days off work or with sick-leave). Physiological variables, such as spinal flexibility and number of degrees of straight leg raising were not assessed since it is believed that these outcomes correlate poorly with the clinical status of the patient.
Search methods for identification of studies
Existing Cochrane reviews for the three interventions were screened for studies fulfilling the inclusion criteria. The searches were updated from the last date that the literature was searched from these individual reviews.
Anzeige
Electronic searches
The primary search was conducted by an experienced librarian from the Cochrane Back Review Group (CBRG) in MEDLINE, EMBASE, CINAHL, CENTRAL (the Cochrane Central Register of Controlled Trials) and PEDro up to December 22, 2008.
Searching other resources
References from the relevant studies were also screened and experts approached in order to identify additional primary studies not previously identified. The language was limited to English, Dutch and German. The search strategy outlined by the CBRG was followed. The full search strategy is available upon request from the primary author.
Data collection and analysis
Selection of studies
Two reviewers (SMR, MM) working independently of one another examined all citations from the electronic search, and full articles were obtained for those citations thought to fulfil the inclusion criteria. A third reviewer was consulted (MWvT), if consensus was not reached.
Assessment of risk of bias of included studies
Two reviewers working independently of one another assessed the risk of bias and performed data extraction. Risk of bias was assessed using the criteria list advised by the CBRG, which consists of 11-items evaluating internal validity. Items were scored as positive if they did fulfil the criteria, negative when bias was likely or marked as inconclusive if there was insufficient information. Differences in the scoring and data extraction were discussed during a consensus meeting. A study with a low risk of bias was defined as fulfilling six or more of the validity items. Studies with a fatal flaw were excluded from the meta-analyses: pre-defined as studies with a drop-out rate higher than 50% at the first follow-up measurement or statistically significant and clinically important baseline differences for the principal outcome measures that were not accounted for in the analyses. This definition is consistent with an earlier Cochrane review [31].
Data extraction
An a priori list of items was used for the data extraction, consisting of both descriptive data (e.g. study population, type of intervention) and quantitative data regarding the primary and secondary outcome measures. When the measure of variation was missing for the follow-up measurements, baseline measures were used. Data were not extracted when no measure of variation was presented anywhere in the study (3 older RCTs with a high risk of bias [22, 49, 53]). Missing outcome data were requested for three studies [37, 52, 77] and received from the corresponding authors for two [52, 77]. In one RCT with multiple interventions, two different forms of exercise (i.e. general exercise plus motor exercise) were combined in order to create a single pair-wise comparison [26]. In another study, data were averaged for morning and evening pain, although there was a negligible difference between the two sets of data [15]. Data investigating the effect of different dosages of herbal medicine versus a placebo were also combined to form a single pair-wise comparison [17, 18].
Statistical analysis
Comparison therapies were combined into the following main clusters of presumed effectiveness: (1) no treatment or waiting list control, (2) sham, placebo, or passive modalities, (3) CAM (SMT, acupuncture, or herbal medicine) plus any intervention versus any intervention alone and (4) any other intervention (e.g. specific exercises, standard care). Regardless of eventual heterogeneity, the following stratified analyses were planned a priori: (1) the intervention (SMT, acupuncture, herbal medicine); (2) outcome (pain, functional status, perceived recovery); (3) time of follow-up (defined as short-term: 1 month; intermediate: 3 and 6 months; long-term: 12 months); and (4) risk of bias (low vs. high risk of bias). Lost days at work or number of days with sick-leave were not examined as an outcome because too few studies consistently recorded this [15, 38, 52, 61]. Sensitivity analyses were conducted in order to examine heterogeneity, which was tested by the Q-test (chi-square) and I2. In addition, the type of contrast intervention was also examined in sensitivity analyses. Adverse effects were not assessed because this was sparsely and inconsistently reported.
Effect size calculations
A mean weighted difference (MWD) was used for pain. Scales were converted to 100-points, where necessary. In all but one study, pain was measured using a VAS or numerical rating scale. The one exception was an acupuncture study [40], which measured pain according to the von Korff Chronic Pain Grade scale [75]. A number of different instruments were used to measure functional status [i.e. Roland-Morris Disability Questionnaire (RMDQ) [5, 63], Oswestry Disability Index (ODI) [5], Hannover Functional Ability Questionnaire (HFAQ) [41, 48], the Pain Disability Index (PDI) [66] and the Aberdeen LBP scale [79]]; therefore, standardized mean differences (SMD) were calculated. A negative effect size indicated that CAM was more beneficial than the comparison therapy, i.e. it improved function or diminished pain. For dichotomous outcomes, a risk ratio (RR) was calculated and the event was defined as the number of subjects recovered. A random-effects model was used for all modelling. Funnel plots were to be examined for publication bias; however, the few number of studies identified per outcome did not make this feasible. For each treatment comparison, an effect size and a 95% confidence interval (CI) were calculated. All analyses were conducted in Review Manager 5.0.
Quality of the evidence
GRADE (Grades of Recommendation, Assessment, Development and Evaluation) was used to evaluate the overall quality of the evidence and the strength of the recommendations [4]. Quality of the evidence for a specific outcome is based upon five principal measures: (1) limitations (due to for example, study design), (2) consistency of results, (3) directness (e.g. generalizability of the findings), (4) precision (e.g. sufficient data) and (5) other considerations, such as reporting bias. The overall quality is considered to be high when RCTs with a low risk of bias provide consistent, generalizable and precise results for a particular outcome [30]. Single studies were considered to be inconsistent and imprecise and provide “low” or “very low quality evidence” depending upon whether it was associated with a low or high risk of bias, respectively, and there were no other limitations.
The following levels of evidence were applied and defined:
High quality
Further research is very unlikely to change the level of evidence and recommendations based upon consistent findings from at least two RCTs with low risk of bias and generalizable to the population in question. There are sufficient data with narrow confidence intervals. There are no known or suspected reporting biases.
Moderate quality
Further research is likely to have an important impact on confidence in the estimate of effect and may change the estimate; one of the factors is not met.
Low quality
Further research is very likely to have an important impact on confidence in the estimate of effect and is likely to change it; two of the factors are not met.
Very low quality
Great uncertainty about the estimate; three of the factors are not met.
No evidence
No evidence from RCTs.
Clinical relevance
Findings were determined to be clinically relevant based upon the size of the effect only. A cut-off point of 25 points (0–100 scale) was considered to represent the minimally clinically important change (MCIC) for pain [70]. An effect was considered clinically significant when the lower limit of the 95% CI was greater than this MCIC. For the SMD, effect sizes were defined as <0.2 for small, ≥0.2 to 0.8 for moderate and >0.8 for large effects [23].
Results
Description of studies
Results of the search
In total, 373 potentially relevant titles and abstracts were identified in the search update for the three interventions and screened for potential inclusion from the CBRG register (Fig. 1). This represents new studies not previously identified in the existing Cochrane reviews. After reviewing the full text from 48 citations, 19 new publications were identified, representing 14 new studies on CAM published since the respective Cochrane reviews.
Fig. 1
Selection process for articles on complementary and alternative medicine (CAM)
×
Included studies
Spinal manipulative therapy
Studies were searched in the CBRG register from January 2000, which resulted in the identification of 209 new studies potentially fulfilling the inclusion criteria. After reviewing the full text of 22 articles, 12 articles were included [13, 14, 16, 26, 33‐35, 37, 52, 59, 60, 77] representing eight RCTs fulfilling the inclusion criteria [16, 26, 35, 37, 52, 59, 60, 77]. Multiple publications were identified for Gudavalli et al. [13, 14, 37] and Muller et al. [33, 34, 60]. The long-term study for Muller and Giles [60] was used in subsequent referencing, while the principal study from Gudavalli et al. [37] was referenced. None of the 39 RCTs from the Cochrane review fulfilled the inclusion criteria; thus, all included publications on SMT were published in the last decade [3]. All of the earlier publications, which included chronic LBP, examined a mixed population, except for two studies. These were also excluded because one study examined a post-surgical population [68], while the other study [62] examined just one SMT treatment in the “manipulation” arm of the trial which also included weekly injections. In total, 1,393 patients were examined in the eight RCTs identified. Sample sizes ranged from 30 to 323 [median 178 (IQR 97–240)]. Treatment consisted of manipulative, mobilization, or muscle energy techniques and was conducted by physical or manual therapists in most studies [26, 35, 59], chiropractors [33, 34, 37, 60, 77] or osteopaths [16, 52].
Acupuncture
Studies were searched in the CBRG register from January 2003, which resulted in the identification of 133 new studies potentially fulfilling the inclusion criteria. After reviewing the full text of 26 articles, seven RCTs were found to fulfil the inclusion criteria [11, 40, 42, 43, 60, 64, 78], one of which is included with another intervention (SMT) and also represents the long-term follow-up of an earlier study included in the Cochrane review [60]. Of the 35 RCTs included in the Cochrane review [31], 15 publications representing 14 RCTs fulfilled the inclusion criteria [15, 22, 24, 33, 34, 36, 38, 46, 49, 50, 53, 57, 58, 67, 79]. Multiple publications were identified for Brinkhaus et al. [9‐11], Haake et al. [39, 40], Mendelson et al. [56, 57] and Muller and Giles [33, 34, 60] which represent protocols and preliminary or earlier findings. The most prominent of these publications are cited. In total, 20 RCTs were included and 5,590 patients were examined. Sample sizes ranged from 17 to 3,093 [median 56 (IQR 50–110)].
Herbal medicine
Studies were searched in the CBRG register from January 2005, which resulted in the identification of 31 new studies potentially fulfilling the inclusion criteria. After reviewing the titles and abstracts, no new studies were included. Of the ten RCTs included in the Cochrane Review, [32] seven RCTs fulfilled the inclusion criteria [17‐21, 27, 45]. In total, 1,315 patients were examined. Sample sizes ranged from 88 to 320 [median 197 (IQR 118–228)]. Five RCTs compared herbal medicine, consisting of willow bark [17], a capsicum plaster [27, 45], or Harpagophytum [18, 21] to a placebo. Two RCTs compared herbal medicine, consisting of willow bark [19], or Harpagophytum [20] to a COX-2 inhibitor (Rofecoxib).
Criteria items: A Was the method of randomization adequate? B Was the treatment allocation concealed? C Were the groups similar at baseline regarding the most important prognostic indicators? D Was the patient blinded to the intervention? E Was the care provider blinded to the intervention? F Was the outcome assessor blinded to the intervention? G Were co-interventions avoided or similar? H Was the compliance acceptable in all groups? I Was the drop-out rate described and acceptable? J Was the timing of the outcome assessment similar in all groups? K Were all randomized participants analysed in the group to which they were allocated?
aOnly 41 and 27% of the participants responded at the 6-week and 12-month follow-up measurements, respectively
bITT analysis was conducted only at the first follow-up measurement (at 4 weeks); subsequent analyses were “per-protocol”
cMuller et al. is the long-term follow-up to Giles et al.; 52% drop-out during treatment in the acupuncture group, 51 and 44% of the data available for the medication group at 9 weeks and 12 months, respectively; Overall, just 60 and 54% of the data were available for the follow-up measurements
dITT analysis at 1 month; subsequent measurements did not include all subjects
eThe two groups were fundamentally different at baseline with respect to all principal outcome measures, which was not corrected for in the analyses
fCo-interventions might have influenced the results: 76 and 66.7% of the patients were followed for the short-term and intermediate follow-ups
gSmall difference in pain baseline measure; important difference in RDQ for the acupuncture and control group
Spinal manipulative therapy
Two studies were considered to have a low risk of bias [26, 52]. Two studies were excluded from the meta-analyses because of a fatal flaw [16, 60]. In the study by Chown et al. [16], overall, only 41 and 27% of the participants responded at the 6-week- and 12-month follow-up measurements, respectively. In the study by Muller and Giles [60], drop-out at the first follow-up period was 49% for medication and 52% for acupuncture [60].
Acupuncture
Eight studies were considered to have a low risk of bias [11, 15, 40, 42, 50, 58, 64, 79]. In total, two studies were considered to have fatal flaws, one of which is described above [36, 60]. Another study was considered to have a fatal flaw because the two groups examined were fundamentally different at baseline for all the major outcome variables [36].
Herbal medicine
All seven studies included in this review were considered to have a low risk of bias [17‐21, 27, 45]. Thus, in total, 17 RCTs (2 SMT [26, 52], 8 acupuncture [11, 15, 40, 42, 50, 58, 64, 79], 7 herbal medicine [17‐21, 27, 45]) were thought to have a low risk of bias. The most prevalent methodological shortcomings, which were identified in well over half of the studies, were the lack of description on the allocation procedure and use of co-interventions or whether compliance with the protocol was considered acceptable. Most studies conducted intention-to-treat analyses, which could be defined here as a complete case analysis. For virtually all studies, missing data were not imputed. In most of the SMT studies, neither the patient or care provider was blinded, as opposed to acupuncture and herbal medicine.
Effects of interventions
Spinal manipulative therapy
In total, six RCTs without a fatal flaw (2 with a low risk of bias) were included which examined the effects of SMT versus sham SMT [52], ineffectual or passive modalities [35, 59], SMT plus an intervention versus the intervention alone [52] and versus any other intervention [26, 35, 37, 77]. Data were available for pain [26, 35, 37, 52, 59, 77], and functional status, consisting of the ODI [35, 59] and RMDQ [26, 37, 52, 77]. One RCT examined perceived recovery, but analysed it as a continuous outcome [26]. A summary of the effect estimates can be found in Table 2. In addition, figures pertaining to the meta-analyses are available for all the studied interventions in Appendix 3 of Electronic Supplementary Material.
Table 2
Summary effect estimates for spinal manipulative therapy
Outcome or subgroup
Studies
Participants
Statistical method
Effect estimate
1. Spinal manipulative therapy versus no treatment or waiting list control
No studies were identified
2. Spinal manipulative therapy versus sham/placebo/passive modalities
2.1 Pain
3
Mean difference (IV, Random, 95% CI)
Subtotals only
2.1.1 Pain at 1 month
2
177
Mean difference (IV, Random, 95% CI)
−4.32 [−25.36, 16.73]
2.1.2 Pain at 3 months
2
177
Mean difference (IV, Random, 95% CI)
1.81 [−7.13, 10.75]
2.1.3 Pain at 6 months
3
225
Mean difference (IV, Random, 95% CI)
−0.41 [−15.05, 14.23]
2.1.4 Pain at 12 months
1
102
Mean difference (IV, Random, 95% CI)
5.20 [−9.56, 19.96]
2.2 Disability
3
Std. Mean difference (IV, Random, 95% CI)
Subtotals only
2.2.1 Disability at 1 month
2
177
Std. Mean Difference (IV, Random, 95% CI)
−0.36 [−0.66, −0.06]
2.2.2 Disability at 3 months
2
177
Standard mean difference (IV, Random, 95% CI)
0.13 [−0.19, 0.45]
2.2.3 Disability at 6 months
3
225
Standard mean difference (IV, Random, 95% CI)
0.06 [−0.26, 0.39]
2.2.4 Disability at 12 months
1
102
Standard mean difference (IV, Random, 95% CI)
0.13 [−0.30, 0.57]
2.3 Recovery
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
3. Spinal manipulative therapy + intervention versus intervention alone
3.1 Pain
1
Mean Difference (IV, Random, 95% CI)
Subtotals only
3.1.1 Pain at 1 month
1
59
Mean difference (IV, Random, 95% CI)
−8.80 [−21.43, 3.83]
3.1.2 Pain at 3 months
1
52
Mean difference (IV, Random, 95% CI)
−14.20 [−26.89, −1.51]
3.1.3 Pain at 6 months
1
47
Mean difference (IV, Random, 95% CI)
−4.90 [−18.68, 8.88]
3.1.4 Pain at 12 months
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
3.2 Disability
1
Standard mean difference (IV, Random, 95% CI)
Subtotals only
3.2.1 Disability at 1 month
1
59
Std. Mean Difference (IV, Random, 95% CI)
−0.27 [−0.84, 0.29]
3.2.2 Disability at 3 months
1
52
Standard mean difference (IV, Random, 95% CI)
0.04 [−0.55, 0.63]
3.2.3 Disability at 6 months
1
47
Standard mean difference (IV, Random, 95% CI)
−0.19 [−0.80, 0.43]
3.2.4 Disability at 12 months
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
3.3 Recovery
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
4. Spinal manipulative therapy versus any other intervention
4.1 Pain
4
Mean difference (IV, Random, 95% CI)
Subtotals only
4.1.1 Pain at 1 month
2
265
Mean difference (IV, Random, 95% CI)
−3.28 [−5.73, −0.82]
4.1.2 Pain at 3 months
4
580
Mean difference (IV, Random, 95% CI)
−1.91 [−5.37, 1.55]
4.1.3 Pain at 6 months
3
524
Mean difference (IV, Random, 95% CI)
1.04 [−10.50, 12.58]
4.1.4 Pain at 12 months
3
530
Mean difference (IV, Random, 95% CI)
−0.32 [−4.92, 4.29]
4.2 Disability
4
Standard mean difference (IV, Random, 95% CI)
Subtotals only
4.2.1 Disability at 1 month
2
226
Standard mean difference (IV, Random, 95% CI)
−0.49 [−1.41, 0.43]
4.2.2 Disability at 3 months
4
579
Standard mean difference (IV, Random, 95% CI)
−0.20 [−0.54, 0.14]
4.2.3 Disability at 6 months
3
528
Standard mean difference (IV, Random, 95% CI)
−0.05 [−0.34, 0.24]
4.2.4 Disability at 12 months
3
529
Standard mean difference (IV, Random, 95% CI)
0.04 [−0.15, 0.23]
4.3 Recovery
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
Versus no treatment or waiting list control
No studies examined this contrast.
Versus sham, placebo or passive modalities
In total, 3 RCTs (1 with a low risk of bias [52]) were identified, which compared SMT to care consisting of an educational booklet [35], sham manipulation [52] and ultrasound [59]. For pain, data could be pooled for two studies at 3 months only providing very low-quality evidence (serious limitations, indirect, imprecise), which demonstrated no significant effect (MWD 1.81, 95% CI −7.13 to 10.75) [35, 52]. Only one study measured the long-term effects, which demonstrated no significant effect (very low quality evidence) [35]. The only study with a low risk of bias demonstrated no significant effect at the short-term or intermediate follow-up (low quality evidence) [52]. For functional status, data could be pooled at all follow-up measurements. A moderate, significant effect was observed at 1 month from two RCTs [52, 59] providing very low-quality evidence (serious limitations, indirect, imprecise) in favour of SMT (SMD −0.36, 95% CI −0.66 to −0.06); however, the only study with a low risk of bias demonstrated no significant effect (low quality evidence) [52]. At all other follow-up measurements, no significant effect was observed, also when examined for risk of bias. No studies reported recovery.
SMT plus an intervention versus intervention alone
One RCTs (with a low risk of bias [52]) was identified, which examined the effects of SMT when added to usual care. This study demonstrated significant pain relief at 3 months in favour of SMT (MWD −14.20, 95% CI −26.89 to −1.51) [low quality evidence (indirect, imprecise)]. No other significant association was found. For functional status, no significant effect was found at any interval (low quality evidence).
Versus any other intervention
In total, four RCTs (1 with a low risk of bias [26]) were identified, which included interventions, such as exercise [26, 35, 37] and treatment in a hospital outpatient pain clinic [77]. Data could be pooled for pain at every follow-up measurement, except 6 months. A small, significant, but not clinically relevant effect was observed at 1 month from two RCTs [37, 77] with a high risk of bias in favour of SMT (MWD −3.28, 95% CI −5.73 to −0.82) [low quality evidence (serious limitations, indirect)]. At 3 and 12 months, no significant effect was observed [very low quality evidence (serious limitations, indirect, inconsistent)]. For functional status, there was substantial heterogeneity at the short-term and intermediate follow-up. Three RCTs reported data for the long-term follow up, but the effect was non-significant (very low quality evidence) [26, 35, 37]. In a sensitivity analysis, the effects of SMT on pain and functional status were examined in those studies which compared SMT to exercise only [26, 35, 37]. A small significant, but not clinically relevant effect was seen for pain relief at 1 month in favour of SMT (1 RCT; MWD −6.00; 95% CI −11.50 to −0.50) (very low quality evidence). No significant effect was seen for functional status at any of the follow-up measurements (very low quality evidence). The only study with a low risk of bias demonstrated no significant effect on pain relief or functional improvement at any of the intermediate or long-term follow-up measurements (data were not collected for the short-term follow-up) (low quality evidence) [26].
Versus other types of SMT
No studies examined this contrast.
Acupuncture
In total, 18 RCTs without a fatal flaw (8 with a low risk of bias) were identified which examined the effects of acupuncture versus waiting list control [22, 67, 78], sham acupuncture [11, 40, 42, 50, 57], placebo including TENS [15, 46, 49, 53], acupuncture plus another intervention versus the intervention alone [38, 50, 58, 78, 79], versus any other intervention [40] and other types of acupuncture [24, 43, 64]. Data were available which examined pain [11, 15, 22, 40, 42, 43, 46, 49, 50, 53, 57, 58, 64, 67, 78, 79]. In one RCT data were not extracted because pain was reported as the number of words describing the intensity or unpleasantness of the pain, and functional status was defined both gonometrically and as number of activities causing less than 50% pain [67]. In another study the LBP rating scale was used [55], which is a 130-point combination outcome measure, consisting of back and leg pain and a disability and physical impairment index and therefore, was not clear how this would translate to the other functional scales. Ten RCTs were identified, which examined functional status [11, 40, 42, 43, 49, 50, 53, 58, 67, 78], as measured by the RMDQ [42, 43, 58], HFAQ [40] and PDI [11, 50]. Four RCTs (all with a high risk of bias) examined recovery [15, 22, 46, 67], but the data were deemed unreliable in all but one study [15] due to for example, a large percentage of drop-outs [46], and also noted elsewhere [31] concerning the study by Thomas and Lundberg [67]. A summary of the effect estimates can be found in Table 3.
Table 3
Summary effect estimates for acupuncture
Outcome or subgroup
Studies
Participants
Statistical method
Effect estimate
5 Acupuncture versus no treatment or waiting list control
5.1 Pain
1
214
Mean difference (IV, Random, 95% CI)
−24.10 [−31.52, −16.68]
5.1.1 Pain at 1 month
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
5.1.2 Pain at 3 months
1
214
Mean difference (IV, Random, 95% CI)
−24.10 [−31.52, −16.68]
5.1.3 Pain at 6 months
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
5.1.4 Pain at 12 months
0
0
Mean Difference (IV, Random, 95% CI)
Not estimable
5.2 Disability
1
214
Standard mean difference (IV, Random, 95% CI)
−0.61 [−0.90, −0.33]
5.2.1 Disability at 1 month
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
5.2.2 Disability at 3 months
1
214
Std. Mean Difference (IV, Random, 95% CI)
−0.61 [−0.90, −0.33]
5.2.3 Disability at 6 months
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
5.2.4 Disability at 12 months
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
5.3 Recovery
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
6 Acupuncture versus sham/placebo/passive modalities
6.1 Pain
6
Mean difference (IV, Random, 95% CI)
Subtotals only
6.1.1 Pain at 1 month
4
918
Mean difference (IV, Random, 95% CI)
−5.88 [−11.20, −0.55]
6.1.2 Pain at 3 months
4
1076
Mean difference (IV, Random, 95% CI)
−7.27 [−12.66, −1.89]
6.1.3 Pain at 6 months
3
989
Mean difference (IV, Random, 95% CI)
−3.26 [−6.28, −0.23]
6.1.4 Pain at 12 months
2
290
Mean difference (IV, Random, 95% CI)
−4.74 [−10.50, 1.02]
6.2 Disability
3
Standard mean difference (IV, Random, 95% CI)
Subtotals only
6.2.1 Disability at 1 month
1
745
Standard mean difference (IV, Random, 95% CI)
−0.18 [−0.32, −0.04]
6.2.2 Disability at 3 months
3
1044
Standard mean difference (IV, Random, 95% CI)
−0.28 [−0.41, −0.16]
6.2.3 Disability at 6 months
2
962
Standard mean difference (IV, Random, 95% CI)
−0.27 [−0.40, −0.15]
6.2.4 Disability at 12 months
2
290
Standard mean difference (IV, Random, 95% CI)
−0.22 [−0.46, 0.03]
6.3 Recovery
2
Risk ratio (M-H, Random, 95% CI)
Subtotals only
6.3.1 Recovery at 1 month
2
90
Risk ratio (M-H, Random, 95% CI)
1.92 [0.41, 9.09]
6.3.2 Recovery at 3 months
1
50
Risk ratio (M-H, Random, 95% CI)
3.53 [0.91, 13.62]
6.3.3 Recovery at 6 months
2
83
Risk ratio (M-H, Random, 95% CI)
1.82 [0.72, 4.61]
6.3.4 Recovery at 12 months
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
7 Acupuncture + intervention versus intervention alone
7.1 Pain
3
Mean difference (IV, Random, 95% CI)
Subtotals only
7.1.1 Pain at 1 month
2
99
Mean difference (IV, Random, 95% CI)
−9.80 [−14.93, −4.67]
7.1.2 Pain at 3 months
3
185
Mean difference (IV, Random, 95% CI)
−16.91 [−25.18, −8.64]
7.1.3 Pain at 6 months
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
7.1.4 Pain at 12 months
1
86
Mean Difference (IV, Random, 95% CI)
−14.00 [−21.83, −6.17]
7.2 Disability
4
Standard mean difference (IV, Random, 95% CI)
Subtotals only
7.2.1 Disability at 1 month
2
99
Standard mean difference (IV, Random, 95% CI)
−1.04 [−1.46, −0.61]
7.2.2 Disability at 3 months
4
2824
Standard mean difference (IV, Random, 95% CI)
−0.66 [−0.74, −0.58]
7.2.3 Disability at 6 months
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
7.2.4 Disability at 12 months
1
131
Standard mean difference (IV, Random, 95% CI)
−0.28 [−0.66, 0.09]
7.3 Recovery
1
Risk ratio (M-H, Random, 95% CI)
Subtotals only
7.3.1 at 1 month
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
7.3.2 at 3 months
1
56
Risk ratio (M-H, Random, 95% CI)
5.90 [1.96, 17.70]
7.3.3 at 6 months
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
7.3.4 at 12 months
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
8 Acupuncture versus any other intervention
8.1 Pain
1
Mean difference (IV, Random, 95% CI)
Subtotals only
8.1.1 Pain at 1 month
1
731
Mean difference (IV, Random, 95% CI)
−8.50 [−11.04, −5.96]
8.1.2 Pain at 3 months
1
734
Mean difference (IV, Random, 95% CI)
−9.40 [−12.13, −6.67]
8.1.3 Pain at 6 months
1
741
Mean difference (IV, Random, 95% CI)
−12.10 [−15.25, −8.95]
8.1.4 Pain at 12 months
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
8.2 Disability
1
Standard mean difference (IV, Random, 95% CI)
Subtotals only
8.2.1 Disability at 1 month
1
731
Standard mean difference (IV, Random, 95% CI)
−0.53 [−0.67, −0.38]
8.2.2 Disability at 3 months
1
734
Standard mean difference (IV, Random, 95% CI)
−0.64 [−0.79, −0.49]
8.2.3 Disability at 6 months
1
741
Standard mean difference (IV, Random, 95% CI)
−0.76 [−0.91, −0.61]
8.2.4 Disability at 12 months
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
8.3 Recovery
0
0
Risk ratio (M-H, Random, 95% CI)
Not estimable
Versus no treatment or waiting list control
Only one study (with a low risk of bias [11]) was identified for which data could be extracted and interpreted. A large significant effect was observed at 8 weeks for pain relief in favour of acupuncture (MWD −24.10, 95% CI −31.52 to −16.68) and for functional status (SMD −0.61, 95% CI −0.90 to −0.33) (low quality evidence).
Versus sham, placebo or passive modalities
In total, seven RCTs (5 with a low risk of bias [11, 15, 40, 42, 50]) were identified [11, 15, 40, 42, 46, 50, 57]. It was not possible to pool data due to an extreme outlier, which demonstrated a large significant and clinically relevant effect (MWD −42.30, 95% CI −53.29 to −31.31 at 1 month follow-up) (low quality evidence) [42]. This was a small study (n = 19), which examined sham acupuncture in elderly subjects. In a subsequent post hoc analysis, it was decided to exclude this study, which allowed data to be pooled at all follow-up measurements. For pain relief, a small, significant, but not clinically relevant effect was observed at the short-term and intermediate follow-ups in favour of acupuncture (MWD −5.88, 95% CI −11.20 to −0.55; −7.27 95% CI −12.66 to −1.89; −3.26, 95% CI −6.28 to −0.23, respectively) [moderate quality evidence (serious imprecision)]. Similarly, a significant, but small clinical effect was observed for functional status at the short-term and intermediate follow-up measurements (SMD −0.18, 95% CI −0.32 to −0.04; −0.28, 95% CI −0.41 to −0.16; −0.27, 95% CI −0.40 to −0.15, respectively) [low quality evidence (serious imprecision, inconsistent)]. In total, three RCTs examined recovery for the short-term and intermediate follow-up measurements [15, 40, 46]; however, one of these studies presented the data as a continuous outcome [40]. Only one of these studies was thought to have a low risk of bias, which demonstrated no significant effect at any of these follow-up measurements (low quality evidence) [15].
Acupuncture plus an intervention versus intervention alone
In total, five RCTs (3 with a low risk of bias [50, 58, 79]) were identified, which examined the therapeutic effects of acupuncture in addition to another therapy (physiotherapy [50], standard medical care [38, 58, 78], and exercise [79]). A significant, but not clinically relevant effect was observed for pain relief at 1, 3 and 12 months, but not 6 months (for which there was no data) (MWD −9.80, 95% CI −14.93 to −4.67; −16.91, 95% CI −25.18 to −8.64; −14.00, 95% CI −21.83 to −6.17, respectively) [low quality evidence (indirect, imprecise)]. A strong, significant clinically relevant effect was observed for functional status at 1 and 3 months in favour of acupuncture (SMD −1.04, 95% CI −1.46 to −0.61; −0.66, 95% CI −0.74 to −0.58, respectively) [low quality evidence (indirect, imprecise)]. A significant effect was observed for recovery at 3 months in one study with a high risk of bias in favour of acupuncture (RR 5.90; 95% CI 1.96–17.70) (very low quality evidence) [38]. This was a study which examined the effects of acupuncture in exclusively male subjects who had failed traditional medical or surgical therapy. The long-term follow-up measurement was highly variable and therefore, not presented.
Versus any other intervention
Only one study (with a low risk of bias [40]) examined the effects of acupuncture versus another intervention, namely standard care, consisting of treatment by a physician or physiotherapist and comprised a “multimodal treatment program”. Patients in the acupuncture group were allowed “rescue medication” for acute episodes consisting of a short course of NSAIDs (no more than 2 days per week). A statistically, but not clinically relevant effect was observed for pain at the short-term and intermediate follow-ups (MWD −8.50, 95% CI −11.04 to −5.96; −9.40, 95% CI −12.13 to −6.67; −12.10, 95% CI −15.25 to −8.95, respectively) (low quality evidence). In contrast, a moderate statistically significant and clinically relevant effect was observed for functional status at the short-term and intermediate follow-ups in favour of acupuncture (SMD −0.53, 95% CI −0.67 to −0.38; −0.64, 95% CI −0.79 to −0.49; −0.76, 95% CI −0.91 to −0.61, respectively) (low quality evidence). Recovery was examined but analysed as a continuous variable.
Versus other types of acupuncture
One small study (n = 35) (with a high risk of bias) examined the effect of standard acupuncture versus superficial (acupuncture sensation de qi) and deep needling at trigger points in patients 65 years of age and older (very low quality evidence) [43]. There were no significant differences between the groups at the end of either of two treatment phases. Another study (n = 61) (with a low risk of bias) examined the effect of auricular electroacupuncture to conventional manual auricular acupuncture (low quality evidence) [64]. Electroacupuncture resulted in significantly and clinically more pain relief and functional improvement at the short and intermediate phase compared with manual acupuncture. Another study examined the effects of an ancient versus regular needling technique, but it was unclear whether the assessment was conducted immediately following treatment or at 2 months [24].
Herbal medicine
In total, seven RCTs (all with a low risk of bias and without a fatal flaw) were included in the analyses [17‐21, 27, 45]. A summary of the effect estimates can be found in Table 4.
Table 4
Summary effect estimates for herbal medicine
Outcome or subgroup
Studies
Participants
Statistical Method
Effect Estimate
9 Herbal medicine versus no treatment or waiting list control
No studies were identified
10 Herbal medicine versus sham/placebo/passive modalities
10.1 Pain
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
10.2 Disability
0
0
Standard mean difference (IV, Random, 95% CI)
Not estimable
10.3 Recovery
5
Risk ratio (M-H, Random, 95% CI)
Subtotals only
10.3.1 Recovery at 1 month
5
841
Risk ratio (M-H, Random, 95% CI)
1.92 [1.31, 2.81]
11 Herbal medicine + intervention versus intervention alone
No studies were identified
12 Herbal medicine versus any other intervention
12.1 Pain
2
271
Mean difference (IV, Random, 95% CI)
−2.56 [−8.38, 3.25]
12.1.1 Pain at 1 month
2
271
Mean difference (IV, Random, 95% CI)
−2.56 [−8.38, 3.25]
12.2 Disability
0
0
Mean difference (IV, Random, 95% CI)
Not estimable
12.3 Recovery
2
Risk ratio (M-H, Random, 95% CI)
Subtotals only
12.3.1 Recovery at 1 month
2
271
Risk ratio (M-H, Random, 95% CI)
0.88 [0.70, 1.10]
Versus no treatment or waiting list control
No studies examined this contrast.
Versus sham, placebo or passive modalities
In total, five RCTs examined this contrast, consisting of placebo tablets or plasters [17, 18, 21, 27, 45]. The principal outcome measure was perceived recovery at 1 month. Three of the studies defined recovery as the number of patients pain-free and who had not used Tramadol in the last week of the trial [17, 18, 21]. Data could not be pooled due to heterogeneity; therefore, in a post hoc analysis data were examined by the specific type of herbal medicine.
Harpagophytum versus placebo
In total, two RCTs were identified, which demonstrated a non-significant effect in favour of the herbal medicine for short-term recovery (RR 3.02, 95% CI 0.51–17.91) [moderate quality evidence (indirect; imprecise)] [18, 21].
Capsicum plaster (cayenne pepper) versus placebo
In total, two RCTs were identified, which demonstrated a small, significant effect in favour of the herbal medicine for short-term recovery (RR 1.59, 95% CI 1.37–1.85) [moderate quality evidence (limitations)] [27, 45].
Willow bark (salix alba) versus placebo
One RCT was identified, which demonstrated a strong, significant effect in favour of the herbal medicine for short-term recovery (RR 6.75, 95% CI 2.49–18.28) (low quality evidence) [17].
Herbal medicine plus an intervention versus intervention alone
No studies examined this contrast.
Versus any other intervention
In total, two RCTs examined this contrast, which compared herbal medicine to COX-2 inhibitors (Rofecoxib) [19, 20]. The outcomes, pain and perceived recovery, were examined at 1 month only. No data were available for the intermediate or long-term follow-up. Data could not be pooled for the group due to heterogeneity; therefore, data were analysed per specific type of herbal medicine.
Willow bark (salix alba) versus Rofecoxib
One RCT was identified, which demonstrated a small, significant effect in favour of the herbal medicine for pain relief (MWD) −6.00, 95% CI −11.45 to −0.55), but a non-significant effect in favour of Rofecoxib for recovery (RR 0.87, 95% CI (0.69 to 1.10) (low quality evidence) [19].
Harpagophytum versus Rofecoxib
One RCT was identified, which demonstrated no significant effect for pain relief (MD 0.00, 95% CI −3.09 to 3.09) or for recovery (RR 1.00, 95% CI 0.38–2.61) (low quality evidence) [20].
Discussion
The lack of studies with a low risk of bias, especially in regard to SMT precludes any strong conclusions; however, the principal findings, which are based upon low- to very low-quality evidence, suggest that SMT does not provide a more clinically beneficial effect compared with sham, passive modalities or any other intervention for treatment of chronic LBP. There is evidence, however, that acupuncture provides a short-term clinically relevant effect when compared with a waiting list control or when acupuncture is added to another intervention. Although there are some good results for individual herbal medicines in short-term individual trials, the lack of homogeneity across studies did not allow for a pooled estimate of the effect. In general, these results are in agreement with other recent systematic reviews on SMT [2, 25], but in contrast with others [12, 51, 74]. These results are also in agreement with recent reviews on acupuncture [1, 31, 54] and herbal medicine [32].
Perhaps some criticism might be levelled at our definition of chronic LBP. To our knowledge, this is the first review to exclusively examine subjects suffering LBP for more than 3 months. Previous reviews, especially for spinal manipulation, have included studies with a mixed population, e.g. sub-acute and chronic, in many cases, limiting the analysis to those studies in which the majority had chronic LBP [3, 12]. Furthermore, data for exclusively chronic LBP were not presented. This decision had definite consequences for the number of studies included in this review because a large majority of studies investigating SMT, and to a lesser extent acupuncture, examined mixed populations. This decision was not taken lightly. In our estimation, the inclusion of studies investigating exclusively chronic LBP allows for a better estimation of the effect of these interventions. However, this also meant excluding some studies with a low risk of bias, which have demonstrated a positive effect of CAM [69]. At best and based upon the findings from this review, CAM therapies tend to have a short-term effect; therefore, studies which investigated a mixed population might overestimate these effects because patients with a shorter duration of LBP might be more likely to respond to treatment. This is consistent with the observation that longer duration of pain is a consistent predictor of a worse outcome for numerous musculoskeletal complaints [6, 7, 44, 47, 65, 71‐73].
Anzeige
Principal limitations include the relatively few studies with a low risk of bias, which was most notable for SMT. By comparison, we identified four times as many studies for acupuncture, while all the studies for herbal medicine had a low risk of bias. Nevertheless, despite the fact that the quality of studies has improved in the past decade, less than half of all studies included in this review were considered to meet the minimum requirement. Another important limitation was the type of data used, that is, we examined the mean and standard deviations for the individual interventions at the various time measurements without regard to (small) baseline differences between the different interventions. Optimally, it would have been best to examine within mean changes, but in many cases, these data were not available. It is unclear what this difference in the analysis would have meant to the overall results and conclusions; however, we did “eyeball” these differences before extracting the data. It is also open for debate whether our definition of a fatal flaw is suitable and appropriate and whether these studies should be excluded from the meta-analyses. This exclusion was added as a buffer in order to prevent a biased assessment. Although a sensitivity analysis could have been conducted in order to determine to what extent these studies had on the overall effect, sensitivity analyses are by definition post hoc and therefore, also subject to potential bias. Based upon our assessment, two of the three studies found to have a fatal flaw, also had a high risk of bias [16, 36] and presented data as a median and interquartile range, presumably due to the skewness of the study data [36, 60]. Whether this definition finds universal recognition remains to be discussed and is a subject for future study. In addition, there was a limited amount of data for the primary outcome variables. This is particularly cogent for recovery. As a result, our analyses were limited to pain and functional status. The limited amount of data also made it difficult to discern whether different types of SMT (e.g. high-velocity low amplitude techniques, such as used by most chiropractors, or mobilization techniques, such as used by manual therapists or osteopaths), different types of acupuncture (e.g. electroacupuncture or manually-stimulated acupuncture, or Western vs. Chinese acupuncture) or dosages of herbal medicine are more effective than another. Finally, studies were excluded if the unique contribution of CAM could not be discerned. This means pragmatic studies, which include multiple therapies and might more closely resemble clinical treatment, were excluded. The effect of one such recent study with a low risk of bias, which included SMT among other interventions (i.e. exercise) in one of the treatment arms, demonstrated a small significant effect on pain relief and a moderate effect on functional improvement compared with a physician consultation alone [61]. While these studies are vital to our understanding, they risk being excluded from future systematic reviews.
A major strength of this review is an overview of the effects of CAM for the treatment of chronic LBP. Ideally, we would have liked to have compared the different CAM interventions with one another; however, these studies are lacking. In fact, only one study directly examined the effect of SMT versus acupuncture and versus medication (NSAIDs); however, this study had a fatal flaw [60]. Alternatively, we wanted to conduct indirect comparisons with the various CAM therapies; however, there was too much heterogeneity between studies to make for a useful analysis.
While this review suggests a lack of benefit associated with SMT for chronic LBP, this is not necessarily an indictment of its efficacy. A recent study, which examined the effects of manipulation in addition to other interventions in patients with acute and subacute LBP, concluded that outcomes are improved when patients are matched to an intervention according to their signs and symptoms as opposed to being randomly assigned to a particular therapy [8]. Perhaps this indicates the need for a new generation of clinical trials, in which sub-grouping of the participants is taken into account.
Authors’ conclusions
In conclusion, overall, the lack of studies with a low risk of bias precludes any strong recommendations, particularly with regard to SMT. Randomized trials with a low risk of bias and adequate sample sizes are direly needed.
Recommendations
Future efforts should focus on improving the quality of studies by considering the quality items discussed in this report. Furthermore, researchers should better define non-specific LBP so that the studied populations are as homogenous as possible and consider classification schemes in which subjects are randomized to individual therapies for which they are likely to respond.
Acknowledgments
This work was funded by the Dutch National Health Insurance Council.
Conflict of interest statement
None.
Open Access
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Anzeige
Open AccessThis is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Mit e.Med Orthopädie & Unfallchirurgie erhalten Sie Zugang zu CME-Fortbildungen der Fachgebiete, den Premium-Inhalten der dazugehörigen Fachzeitschriften, inklusive einer gedruckten Zeitschrift Ihrer Wahl.
Extreme Arbeitsverdichtung und kaum Supervision: Dr. Andrea Martini, Sprecherin des Bündnisses Junge Ärztinnen und Ärzte (BJÄ) über den Frust des ärztlichen Nachwuchses und die Vorteile des Rucksack-Modells.
Bewegungs-, Dehnungs- und Entspannungsübungen im Wasser lindern die Beschwerden von Patientinnen mit Fibromyalgie besser als das Üben auf trockenem Land. Das geht aus einer spanisch-brasilianischen Vergleichsstudie hervor.
Darauf haben viele Praxen gewartet: Das Zi hat eine Liste von Praxisverwaltungssystemen veröffentlicht, die von Nutzern positiv bewertet werden. Eine gute Grundlage für wechselwillige Ärztinnen und Psychotherapeuten.
Mit dem demographischen Wandel versorgt auch die Chirurgie immer mehr betagte Menschen. Von Entwicklungen wie Fast-Track können auch ältere Menschen profitieren und bei proximaler Humerusfraktur können selbst manche 100-Jährige noch sicher operiert werden.
Update Orthopädie und Unfallchirurgie
Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.
