Skip to main content

An overview of systematic reviews of complementary and alternative therapies for fibromyalgia using both AMSTAR and ROBIS as quality assessment tools

Abstract

Background

Fibromyalgia (FM) is a chronic, debilitating pain disorder. Dissatisfaction with conventional medicine can lead people with FM to turn to complementary and alternative medicine (CAM). Two previous overviews of systematic reviews of CAM for FM have been published, but they did not assessed for risk of bias in the review process.

Methods

Five databases Medline, Embase, AMED (via OVID), Web of Science and Central were searched from their inception to December 2015. Reference lists were hand-searched. We had two aims: the first was to provide an up-to-date and rigorously conducted synthesis of systematic reviews of CAM literature on FM; the second was to evaluate the quality of the available systematic review evidence using two different tools: AMSTAR (Shea et al. BMC Med Res Methodol 15; 7:10, 2007) and a more recently developed tool ROBIS (Whiting et al. J Clin Epidemiol 69:225-34, 2016) specifically designed to assess risk of bias in systematic reviews. Any review that assessed one of eight CAM therapies for participants diagnosed with FM was considered. The individual studies had to be randomised controlled trials where the intervention was compared to placebo, treatment as usual or waitlist controls to be included. The primary outcome measure was pain, and the secondary outcome measure was adverse events.

Results

We identified 15 reviews that met inclusion criteria. There was low-quality evidence that acupuncture improves pain compared to no treatment or standard treatment, but good evidence that it is no better than sham acupuncture. The evidence for homoeopathy, spinal manipulation and herbal medicine was limited.

Conclusions

Overall, five reviews scored 6 or above using the AMSTAR scale and the inter-rater agreement was good (83.6%), whereas seven reviews achieved a low risk of bias rating using ROBIS and the inter-rater agreement was fair (60.0%). No firm conclusions were drawn for efficacy of either spinal manipulation or homoeopathy for FM. There is limited evidence for topical Capsicum, but further research is required. There is some evidence to support the effectiveness of acupuncture for FM, but further high-quality trials are needed to investigate its benefits, harms and mechanisms of action, compared with no or standard treatment.

Systematic review registration

PROSPERO CRD42016035846.

Peer Review reports

Background

Description of the condition

Fibromyalgia (FM) is a chronic pain disorder characterised by widespread pain [1]. It has been described as a ‘central sensitization syndrome’ caused by biological abnormalities in the central nervous system [2] and is often associated with other conditions such as irritable bowel syndrome and depression.

The recently revised FM diagnostic criteria (2011), approved by the American College of Rheumatology (ACR), use a FM Symptom Scale by combining the Widespread Pain Index (WPI) and Symptom Severity Scale (SS) (Wolfe et al. 2011 [3]). The WPI assesses 19 general body areas for pain occurring in the preceding 2 weeks. The severity of the person’s fatigue, unrefreshed waking, cognitive symptoms and general somatic symptoms are rated by the SS for a score ranging from 0 to 12 [3].

FM is reported to affect between 1 and 4% of the population [4]. The use of the new criteria has reduced the gender ratio form 7:1 to 2:1 female to male ratio, which is similar to other chronic pain conditions [5].

FM can develop at any age, including childhood, and there does not appear to be any variation in prevalence with regard to country, culture or ethnic group. Surprisingly, there does not appear to be any variation in industrialised/non-industrialised countries [6].

Conventional treatments

Medication is currently the main form of treatment; there is strong evidence of an effect for several drugs like antidepressants (e.g. amitriptyline) and muscle relaxants (e.g. cyclobenzaprine) [7, 8]. However, adverse effects of medication are frequently experienced [9,10,11,12]. FM is difficult to treat within primary care, and people with FM often turn to complementary and alternative medicine (CAM) therapies; therefore, it is a condition that has received much attention from CAM researchers [13]. Prior research has found that around 90% of people with FM have used at least one form of CAM to manage their symptoms [14,15,16,17].

Description of the interventions

CAM has been defined as ‘…diagnosis, treatment and/or prevention which complements mainstream medicine by contributing to a common whole, by satisfying a demand not met by orthodoxy or by diversifying the conceptual frameworks of medicine’ (Ernst et al.) ([18], p. 506). This review focuses on eight common CAMs which have featured in several CAM surveys [19,20,21]: acupuncture, hypnotherapy, homoeopathy, osteopathy, chiropractic, herbal medicine, reflexology and aromatherapy (see Appendix 1 for further details on each therapy).

Why it is important to do this overview

There are two main aims within this overview. The first is to update the synthesis of reviews of CAM literature on FM and establish what evidence is currently available with regard to the efficacy of several CAM practices used in its treatment. As systematic reviews (SR) are often considered the least biased source of evidence to evaluate the efficacy of a particular intervention, this overview will focus on SRs for FM.

The second aim is to provide a robust assessment of the evidence in this area using two complementary quality assessment tools: AMSTAR [22] and ROBIS [23].

Previous overviews of reviews

Taking a look at previous overviews from the last 5 years, in 2012, Terry et al.’s [1] overview of reviews of CAM for FM identified five systematic reviews. The reviews found some evidence of beneficial effects for acupuncture, homoeopathy, hydrotherapy and massage, whilst no evidence for therapeutic effects for chiropractic treatment of FM symptoms. However, no quality assessment of the individual reviews was performed.

In 2015, Launche et al. [24] also published a synthesis of CAM for FM reviews. The AMSTAR scale [22] was used to assess the quality of the review. In contrast to our overview, Lauche et al. [24] did not restrict the type of CAM, whereas we restricted to the most common CAMs. In addition, we wanted to apply a more rigorous risk of bias assessment to the systematic reviews identified; AMSTAR focuses on the methodological quality of the reviews rather than risk of bias, so we wanted to compensate for that.

In our overview, all eligible systematic reviews of FM were assessed using both the AMSTAR scale [22] and the ROBIS tool [23]. This will provide an up-to-date and rigorous overview of evidence of CAM for FM.

Methods

This systematic overview was conducted following a predetermined written protocol registered on the PROSPERO database: registration number, CRD42016035846. To be considered eligible for this overview, reviews were required to meet the following criteria:

  • Type of reviews—all systematic reviews of randomised controlled trials (RCTs) were included. Quasi-experimental studies were included only if they were assessed alongside RCTs and were in the minority. Systematic reviews of quasi-experimental studies are at higher risk of bias due to lack of random assignment, but we did not want to exclude reviews if the majority of included studies were RCTs. All systematic reviews were included with or without a meta-analysis. The reviews must have searched more than one database and reviewed at least one included CAM treatment for FM. However, reviews that assessed several CAM in the same review were considered if they included at least two of the eight relevant CAMS.

  • Type of participant—reviews that included RCTs using human subjects diagnosed with FM using standard diagnostic criteria (e.g. ACR criteria) were eligible. No restrictions regarding age, gender, condition duration or intensity were applied.

  • Type of intervention—reviews of effects of any of the following eight CAM therapies were included: acupuncture, hypnotherapy, homoeopathy, osteopathy, chiropractic, herbal medicine, reflexology and aromatherapy. Reviews that included multiple CAM therapies were also included, as long as the CAM therapies were not used in combination. Reviews of complex systems of combinations of a range of therapeutic modalities such as Traditional Chinese medicine (TCM) were excluded as it would be too difficult to establish the separate effects of the individual aspects of this combined approach.

    Reviews that only assessed CAM therapies used as an adjunct therapy to conventional medicine were excluded. CAMs that were used in conjunction with other interventions frequently recommended by mainstream healthcare practitioners to treat FM (exercise, patient education, cognitive/behavioural therapies and hydrotherapy) were also excluded. If reviews had also included some trials using additional medication/exercise, these were included, but those particular trials were excluded from the analysis (both narrative and meta-analysis).

  • Type of comparator —placebo, no treatment, treatment-as-usual or waitlist control groups were permissible as the comparator.

  • Type of outcome —any review that included studies that reported validated measures of pain (e.g. tender point count on palpation, pain intensity, or assessed using a standardised pain measure such as a visual analogue scale (VAS), McGill Pain Questionnaire (MPQ) [25] and Chronic Pain Grade Scale [26]). Other outcomes extracted were adverse events.

Excluded reviews:

Any reviews that included participants with co-morbidities (e.g. cancer, drug addiction) were excluded. See Table 4 in Appendix 2 for excluded reviews.

The following databases were searched from their inception to December 2015: Medline, Embase and AMED (via Ovid), Web of Science and Central via Cochrane library, using a combination of MeSH and key word terms (see Appendix 3 for the search strategy). Conference abstracts/protocols were searched using Web of Science, and authors were contacted to establish progress of their work (see Table 5 in Appendix 2). Reviews had to be published to be included. All titles and abstracts retrieved from the search were assessed for eligibility against the predetermined inclusion criteria by two reviewers (RP, VL). Any review appearing to meet the inclusion criteria based on the abstract was retrieved as a full document. The full-text articles were read in their entirety to assess eligibility by two reviewers (RP, VL) and decisions on inclusion and exclusion recorded (see Fig. 1 for flow diagram). Any disagreements were discussed with a third author (RC). Excluded reviews were recorded alongside reasons (see Table 4 in Appendix 2). Reference lists of all full-text articles were hand-searched for additional studies. We only included English language papers as we did not have access to the translation skills of someone trained in using the ROBIS tool to be able to cross-check the ROBIS tool effectively. Authors of any abstracts/protocols were contacted to establish the status of review.

Fig. 1
figure 1

Flow diagram

Data extracted

Two reviewers (RP, VL) independently extracted data and summarised the review in a characteristic table (see Table 1). Data was extracted from full-text reviews using a standardised data extraction form. The extraction form was piloted prior to starting the overview and refined. Disagreements were resolved through discussion with a third reviewer (RC). Information was extracted from each included review on author, date of review, country, list of studies included in the individual review, intervention and comparator summary, number of participants, diagnosis criteria, meta-analysis results or summary of main between-group results, whether a sensitivity or subgroup analysis was conducted, risk of bias assessment and adverse events.

Table 1 Characteristics and results of the included reviews

We extracted the mean and standard deviation (SD) of continuous variables and any between-group statistical analyses. We reported the standard mean difference (SMD) and 95% confidence intervals (CI) and results of any tests of heterogeneity reported in the relevant meta-analyses. If ‘pain’ was measured alongside another outcome (e.g. discomfort) and recorded as a single variable, we would extract the data and highlight this in the table and text.

Data synthesis

Due to the expected overlap of studies and heterogeneity between reviews (particularly with regard to interventions and comparator arms), we conducted a narrative synthesis of the findings rather than pooling of meta-analyses from the included reviews.

Assessment of methodological quality/bias of the included reviews

The quality of each systematic review was assessed using both the frequently used and validated AMSTAR tool [22, 27] alongside the newly developed ROBIS tool [23]. AMSTAR is an 11-item tool that has been used frequently to check the quality of a systematic review and determine whether the most important elements are reported (http://www.robis-tool.info). It consists of a series of questions with four possible answers. Each question is not evenly weighted so and although an overall score is sometimes reported, this is not what the tool is intended for. It is frequently used in Cochrane overviews and by the Scottish Intercollegiate Guidelines Network (SIGN). It is intended for reviews that address questions of effectiveness that include just randomised controlled trials (RCTs). However, AMSTAR does not cover some quality items, and each item is not weighted the same; thus, we felt it important to also use the newly developed ROBIS tool.

The aim of the ROBIS tool is to evaluate the level of bias present within a systematic review (http://amstar.ca/About_Amstar.php). This tool assesses the level of bias across four domains: study eligibility criteria, identification and selection of studies, data collection and study appraisal and synthesis and findings. Each domain has signalling questions and a judgment of concerns about risk of bias of the domain (low, high or unclear—see Table 6 in Appendix 4). In the final phase, the reviewer makes a judgment about the overall risk of bias. In contrast to AMSTAR, ROBIS has a wider application and is intended for assessing effectiveness, diagnostic test accuracy, prognosis and aetiology. It has an optional phase to assess the applicability of the review to the research question of interest.

Two reviewers (RP, VL) independently assessed each review using both tools. Both reviewers had limited experience of using the ROBIS tool, so a third reviewer who helped develop the tool (PD) was asked to also complete the ratings. Meta-analyses were checked by a statistician experienced in meta-analyses (CP). The inter-rater reliability of overall ratings using each instrument (AMSTAR and ROBIS) was calculated also using the unweighted kappa statistic and percentage agreement. We interpreted cut-offs for Kappa values as <0.20 = poor agreement, 0.21 to 0.40 = fair, 0.41 to 0.60 = moderate, 0.61 to 0.80 = good and 0.81 to 1.00 = very good agreement.

Deviation from the protocol

In our protocol [PROSPERO CRD42016035846], we said we would not apply any language restrictions; however, it was decided that we would only include English language papers as the ROBIS tool would be a complex tool to ask someone to extract data with.

Results

Results of the literature search

The search strategy yielded 568 potentially relevant papers for inclusion. After 125 duplicate titles were removed, 443 remained. Once screened, 98 papers were identified as potentially eligible and full-text copies were retrieved and reviewed by the two reviewers (RP, VL) (see Fig. 1 for flow diagram). From these papers, 15 were included in this overview, and the reasons for excluding articles are presented in Table 4 in Appendix 2. Results of the included studies are presented in Table 1. The summarised AMSTAR scores are presented in Table 2, and the summarised ROBIS scores are presented in Table 3. The justification statements for ROBIS are presented in Table 6 in Appendix 4.

Table 2 AMSTAR
Table 3 Tabular presentation for ROBIS results

The 15 included reviews were published between 2003 and 2014 and originated from seven countries. The included systematic reviews investigated the following therapies: homoeopathy (n = 2), acupuncture (n = 7), chiropractic (n = 1), herbal medicine (n = 1) and multiple CAMs (n = 4).

Results of each CAM therapy

Homoeopathy

Two individual reviews of homoeopathy for FM were identified [28, 29]. Four multiple CAM reviews [30,31,32,33,34] also assessed homoeopathy. Perry et al. [28] included four RCTs [35,36,37,38] (three of which were placebo-controlled [35,36,37]). Their results suggested that homoeopathy was better than the control interventions in alleviating the symptoms of FM. However, none of the trials were without flaws. Using the Jadad scale [39] to assess the quality of the studies, two [35, 36] achieved a score of 3, one [37] achieved 4 and one [38] just 2 out of a possible 5. Blinding issues, small sample size, and lack of washout between crossover period were mentioned as some of the problems identified.

The review and meta-analysis by Boehm et al. [29] identified the same four RCTs and one controlled clinical trial (CCT) [40] (alongside ten case reports, three observational studies). A meta-analysis of three RCTs [36,37,38] (n = 139) revealed effects of homoeopathy on tender point count (SMD = −0.42; 95% CI −0.78 to −0.05, P = 0.03, I 2 = 0%), compared to placebo. Tender points are pain points or localised areas of tenderness around joints and are used to diagnose FM [41]. Also, a meta-analysis of two RCTs and one CCT [36, 38, 40] (n = 97) favoured homoeopathy in pain intensity using a 100-mm VAS (SMD = −0.54: 95% CI −0.97 to −0.10, P = 0.02; I 2 = 42%), compared to placebo. As this latter meta-analysis also included the results from the non-RCT, caution is needed in interpreting these results. Homoeopathy had no effect on the McGill Pain (MPQ) sensory scores (SMD = −0.08, 95% CI −0.51 to 0.34, P = 0.70, I 2 = 0%) when pooling two RCTs [37, 38]. Using the Cochrane Risk of Bias tool [42], two trials had a low risk of selection bias [37, 38], whilst the two randomised crossover trials [35, 36] did not report methods of randomization or allocation concealment. Only two trials reported adequate blinding of participants and personnel [36, 37], and all trials but one [40] reported adequate blinding of outcome assessment. Risk of attrition, reporting or other bias was low in most trials. Thus far, the effectiveness of homoeopathy as a symptomatic treatment for FM remains unproven.

Acupuncture

We identified seven systematic reviews [43,44,45,46,47,48,49] that assessed acupuncture for FM alongside the four multiple CAM reviews [30,31,32,33,34]. One of the earlier reviews was conducted by Mayhew and Ernst [43] and included five RCTs [50,51,52,53,54] (n = 316) of various forms of acupuncture versus sham acupuncture (non-stimulation of acupuncture point or stimulation at traditional needle location). A meta-analysis was not performed, but the authors reported that three of the five included studies [51,52,53] found an effect of acupuncture. These effects were, however, mostly short-lived and, therefore, of debatable value [43]. Of the remaining two trials that did not favour acupuncture, one [54] was considered well designed and of good methodological quality using the Jadad scale [39].

Langhorst et al.’s [44] pooled analysis included seven studies [50,51,52, 54,55,56,57] (n = 242) and found strong evidence for the reduction of pain (SMD −0.25; 95% CI −0.49 to −0.02; P = 0.04, I 2 = 1%) at post-treatment compared to sham or simulated acupuncture. The methodological quality was assessed by the 11-item van Tulder score [58]). Sensitivity analyses demonstrated a significant effect on pain at post-treatment in studies with high risk of bias whereas the effect on pain at post-treatment in studies of low risk of bias did not demonstrate an effect.

Martin-Sanchez et al. [45] found, from a pooled analysis of four studies [51, 52, 54, 55] (n = 257), a SMD between acupuncture and sham groups from baseline of 0.02 (95% CI −0.24 to 0.28) with regard to pain intensity, but with wide confidence intervals which included the null value. Between-study homogeneity was in evidence (P = 0.41, I 2 = 0%) for this comparison. No assessment of quality or risk of bias was reported.

The meta-analyses conducted by Yang et al. (2014) [46] were inaccurate as they used the control group twice in the same analyses for two studies [53, 55]. Thus, we chose not to report the results from the meta-analyses here.

Cao et al. (2013) [47] found that acupuncture had no better effect than sham acupuncture with regard to pain relief in people with FM, as shown in pooled analysis of seven arms from five trials [52, 54, 55, 57, 59]. The change in VAS score was reported as SMD −0.09 (95% CI −0.32 to 0.14, P = 0.44 I 2 = 2%) and the VAS results at post-treatment were SMD −0.22, (95% CI −0.51 to 0.07, P = 0.13, I 2 = 26%). However, a pooled analysis of four trials [60,61,62,63] showed acupuncture was better than antidepressants in reducing VAS pain scores: SMD −0.60 (95% CI −0.93 to −0.27, P = 0.0004, I 2 = 22%). The small sample size, scarcity of studies for each comparison, and lack of an ideal sham weakens the level of evidence and its clinical implications. The only analyses we have reported here was that conducted on studies that compared acupuncture alone which did not incorporate mixed therapies in the meta-analyses. Two out of the 16 trials were evaluated as low risk of bias [55, 63], four [50, 54, 62, 63] were rated as having unclear risk of bias, whilst the other ten trials were evaluated as high risk of bias. Nine trials described randomization [51, 54, 55, 59,60,61,62, 64, 65], and six trials reported adequate allocation concealment [50, 51, 55, 59, 60, 64]. Three trials blinded both patients and outcome assessors [51, 55, 63]. Five trials reported the number of dropouts [51, 57, 63,64,65], and none of these trials used intention-to-treat analysis.

Deare et al.’s [48] Cochrane review identified eight RCTs and one quasi-RCT [66]. This is one of the most up-to-date systematic reviews on acupuncture. Pain severity (VAS 100 mm) showed a reduction in pain for those treated with real acupuncture compared with no acupuncture at the end of treatment (mean difference (MD) −22.40 points on a 100-point VAS scale; 95% CI −40.98 to −3.82, P = 0.02, favouring acupuncture). This was based on just one study [67]. Pain severity using pooled analysis of six studies of the VAS, numerical rating scale (NRS), the Westhaven Yale Multi-dimensional Pain Inventory (MPI) [68] and MPQ found no difference between groups in reducing pain ((N = 286) SMD −0.14; 95% CI −0.53 to 0.24, P = 0.48, I 2 = 54%). A short-term benefit of acupuncture over antidepressants was found in one study [66]; VAS = −17.3 on a 100-point scale; 95% CI −24.1 to −10.5. All studies except one were at low risk of selection bias; five were at risk of selective reporting bias (favouring either treatment group); two were subject to attrition bias (favouring acupuncture); three were subject to performance bias (favouring acupuncture) and one to detection bias (favouring acupuncture). Using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) tool [42], they established there was low- to moderate-level evidence that compared with no treatment and standard therapy, acupuncture improved pain and stiffness in people with FM. There was moderate-level evidence that the effect of acupuncture does not differ from sham acupuncture in reducing pain. Electro-acupuncture was better than manual acupuncture for pain and stiffness reduction, although the effects were not maintained at 6 months follow-up.

Spinal manipulation (chiropractic/osteopathy)

There was just one review of chiropractic for FM consisting of three RCTs [69,70,71] and one quasi-RCT [72] conducted by Ernst in 2009 [73]. The reporting of the studies in this review was generally poor; just two reported statistical analysis of which neither found an effect of chiropractic treatment on pain. One quasi-experimental study [72] reported a 34% pain reduction versus 26% reduction in control group using a 100-mm VAS (but no further analysis was reported). However, both arms were in combination with exercise and drugs. All the trials were rated as low methodological quality according to the Jadad scale [39] (either scoring 1 or 2 out of 5). The current trial evidence is insufficient to conclude that chiropractic treatment is an effective treatment for FM.

Baronowsky et al.’s (2009) [31] review of multiple CAM therapies included one study of osteopathy [74] which reported that the osteopathy group did better than the control group in pain threshold in three tender points; again, analysis was not reported.

Herbal medicine

There was just one review on herbal medicine for FM conducted in 2013 by de Souza Nascimento [75]. This review reported on eight studies of different types of herbal medicine. One multiple CAM review also assessed herbal medicine [32]. The results from both these reviews vary depending on which herbal extract is used. No meta-analysis was conducted due to heterogeneity of the interventions.

One study [76] using topical Capsicum (chilli pepper) found an improvement in myalgia score, pressure pain threshold, and Fibromyalgia Impact Questionnaire (FIQ). Another study [77] found an improvement in sensitivity and pain. Size of effects/P values were not reported in either study. One RCT [78] found that nabilone was similar to amitriptyline on pain scores and one [79] found a decrease in pain in nabilone group. Again, actual results were not reported.

024-oil pain neutralizer, which contains camphor, eucalyptus oil, aloe vera oil, peppermint oil, lemon and orange oil, was investigated in two studies [80, 81]. Only one [80] reported on pain and found an improvement in night pain rating and tender point count. Meta-050 (a combination of reduced iso-alpha-acids from hops, rosemary, and oleanolic acid) was also only assessed in one open study [82] and found after 8 weeks, both pain and stiffness were moderately improved. The methodological quality of all included trials was evaluated by using Jadad scale [39] and two studies were rated as good quality [76, 79], four studies moderate [77, 78, 80, 81] and two studies low [82, 83]. In addition, risk of bias was assessed by the Cochrane Risk of Bias tool. Most studies were low for section bias. Five of eight studies were double-blind [77,78,79,80,81]; thus, these studies had a low risk of performance bias and low detection bias. No detailed evidence of selective reporting was found in any of the eight studies.

Multiple CAM Reviews

Four systematic reviews [30,31,32,33,34] assessed several CAM therapies within the same paper. We were only interested in some of these therapies, so we have selected the CAMs that were relevant to our review objectives and reported them in the relevant sections above.

Adverse events

Poor reporting of adverse events (AEs) is a frequent criticism of CAM research [84]. However, nine [30, 32, 43, 44, 46,47,48,49, 75] of the 15 reviews report on adverse events. A range of adverse events were reported, depending on which CAM was utilised. With regard to acupuncture, AEs were often either exacerbations of existing symptoms or unpleasantness of the intervention itself. Mild bruising, soreness, typically discomfort at site of needle and nausea were reported. In contrast, palpitations, fainting, dry mouth, fatigue and constipation were AEs associated with anti-depressant medication that was used as treatment as usual in some groups. De Silva et al. [32] found that in one homoeopathic study, allergic reactions were reported. AEs were well reported in de Souza Nascimento et al’s. [75] review of herbal remedies. Transient, burning and pricking, skin irritation, dizziness, nausea, dry mouth, drowsiness, constipation and insomnia were some of the side effects associated with herbal medicines.

Quality of included reviews

Results of AMSTAR

A summary of the AMSTAR results can be found in Table 2. Nine reviews reported using two data extractors and achieving study consensus. Just one review did not report conducting a risk of bias assessment [45], and two [29, 45] did not apply the quality assessment appropriately in light of the findings. Only one included an ‘excluded studies’ table [48]. Seven reviews [28, 29, 44, 45, 47,48,49] included detailed characteristics of the included studies; the majority had some form of table, but not every review reported on participant details. Details on the intervention and outcomes were generally better reported in most reviews. The methods used to combine the studies were reported and appropriate in 11 reviews. Four assessed likelihood of publication bias (through funnel plots) [44, 46, 48, 53]. None of the reviews stated conflict of interest of the individual studies. Overall, five reviews scored 6 or above on the AMSTAR scale [28, 44, 46,47,48]. The inter-rater agreement was good (Ƙ = 0.70), with 83.6% agreement between the two raters (RP, VL).

Results of ROBIS

The ROBIS tool is divided into four domains (see Table 3 for summary of results and Appendix 1 for full results). With regard to domain 1, which assessed any concerns regarding specification of study eligibility criteria, nine reviews [28, 33, 34, 43,44,45,46,47,48, 75] achieved a low risk of bias rating overall. Domain 3 assessed concerns regarding methods used to collect data and appraise studies, and seven studies achieved a low risk of bias rating [28, 29, 33, 34, 44, 47, 48, 75]. With regard to domain 4, which assessed concerns regarding the synthesis and findings, there was more variation in the scores; six were assessed as high [29, 33, 34, 45, 46, 49, 75], four unclear [28, 30, 32, 73] and five scored low [31, 43, 44, 47, 48]. The reviews that did not conduct a meta-analysis were hard to assess using ROBIS. The final section provides a rating for the overall risk of bias of the reviews; seven achieved a low rating [28, 32, 43, 44, 47, 48, 75], six a high rating [29, 30, 33, 34, 45, 46, 49] and two were rated as unclear [31, 73]. The inter-rater agreement was fair (Ƙ = 0.32), with 60.0% agreement between the two raters (RP, VL).

Discussion

Summary of the main results

Homoeopathy

Two individual reviews and four multiple CAM reviews assessed homoeopathy for FM. The most recent review [29] included the same RCTs as Perry et al. [28] but also included 13 observational studies. This achieved 5/11 on Amstar and was considered high risk of bias by ROBIS. Perry et al. [28] was a more robust review with a low risk of bias rating by ROBIS and scoring 6 (high quality) on AMSTAR. Although there was some positive effects demonstrated, more research is needed before homoeopathy can be considered a viable alternative treatment for FM.

Acupuncture

From the seven acupuncture reviews and four multiple CAM reviews, the most robust evidence regarding acupuncture comes from Deare et al.’s [48] Cochrane review. This achieved a positive response on 10/11 on the AMSTAR components and was judged to be of low risk of bias on each of the five ROBIS domains. They concluded that there was low-quality evidence that acupuncture improves pain compared to no treatment or standard treatment, but good quality evidence that it is no better than sham acupuncture. This is an interesting and unexpected result as it implies that acupuncture is equivalent to placebo but more effective than standard care (antidepressants). However, the sham conditions varied from sham needling to acupuncture in a non-acupuncture place, which might indicate there were blinding issues in some of these sham groups. Alternatively, it could indicate there is a genuine placebo response to sham acupuncture. As this is one of the most recent and robust reviews, its conclusions carry more weight than the other reviews on acupuncture.

Spinal manipulation

One review of chiropractic [73] was identified and scored 3/11 on AMSTAR and assessed as high risk of bias on ROBIS. There were several problems with the individual RCTs; thus, the results were inconclusive. One multiple CAM review [31] assessed osteopathy and indicated the results favour osteopathy over standard care alone. However, this review was rated as unclear on ROBIS and scored 3 on AMSTAR.

Herbal medicine

The one herbal medicine review [75] and one multiple CAM review [32] both indicated some evidence for topical Capsicum. 024-oil and nabilone also reported positive results for pain. However, as nabilone is made up of cannabinoid extract, it may not be considered a preferred treatment option for some people with FM. de Souza Nascimento et al. [75] only scored 4/11 on AMSTAR but achieved a low risk of bias score when using ROBIS which indicates different interpretations/assessments of quality when using the two tools.

Overall completeness and applicability of evidence

With regard to the eight CAMs we were interested in, our overview is in agreement with Lauche et al.’s [24] work which suggested that acupuncture had the best evidence of effectiveness for FM, conflicting results for chiropractic and inconclusive results for homoeopathy and phytotherapy (herbal medicine). In addition, some reviews that we identified were missing from Lauche’s overview [29, 46, 47, 49]. It is unclear from their inclusion/exclusion criteria why these four reviews would have been excluded. Thus, our overview provides a more up-to-date overview of the selected CAMs.

Our overview also drew similar conclusions to Terry et al.’s [1]. They also found some evidence of beneficial effects arising from both acupuncture and homoeopathy for the treatment of FM symptoms, whilst no evidence for therapeutic effects from chiropractic interventions was found.

Quality of the evidence

To date, AMSTAR is one of the main scales for assessing quality of a systematic review. It is quick and easy to complete, and there was good inter-rater reliability (kappa = 0.70, agreement 83.6%). In general, there was consistency between ROBIS and AMSTAR. Five reviews [28, 44, 46,47,48] achieved a high overall rating (scores >6) with the AMSTAR scale (although AMSTAR is not designed to have a final score). These five reviews also all scored low risk of bias on ROBIS. There were discrepancies on rating for three reviews; Mayhew and Ernst [43] achieved a low risk of bias but scored just 3 on AMSTAR, Yang et al. [46] achieved a high risk of bias but scored 6 on AMSTAR and de Souza Nascimento et al. [75] achieved a low risk of bias score on ROBIS but scored 4 on AMSTAR.

If a meta-analysis was included, this made rating domain 4 of the ROBIS tool easier to complete. Narrative syntheses were much harder to rate on this particular domain. There is little information in the ROBIS guidance document on how to score the signalling questions where no quantitative synthesis has been done or where the small number of studies included in the quantitative synthesis does not permit exploration of the data with regard to heterogeneity, robustness of the finding and quality. De Silva et al. [32] was an interesting review. Despite scoring high or unclear for domains 1–4 they still achieved a low score overall; this was because they did not overemphasise their findings and were able to critique their shortcomings of the review process. This highlights one of the strengths of ROBIS.

Potential bias in the overview process

One author evaluated their own work [RP: 28] and one of the developers of ROBIS (PD) was involved in the applying ROBIS to assess the included reviews. Another of the developers of ROBIS (RC) was involved in the write up of the report. Although the search strategy was comprehensive, it is possible that some relevant reviews may not have been identified. In addition, a limitation of the overview is that several of the included reviews would be considered out of date (more than 5.5 years) [85]. Some reviews were excluded, due to language restrictions we imposed. This was due to requiring a trained person in the ROBIS tool to complete the assessment. This meant two potential reviews were excluded due to language [86, 87] (see Table 4 in Appendix 2). Despite these issues we believe the systematic approach to this overview minimises bias. Difficulties in using ROBIS may have led to errors in interpretation; lower inter-rater reliability was achieved than when using AMSTAR. In addition, CAM papers tend to be published in lower impact journals and often restricted by word count. Earlier reviews did not tend to score so highly on either tool probably because reporting criteria have changed over time.

Conclusions

Authors’ conclusions

Implications for CAM practice

Of all the CAM interventions included, acupuncture received the most positive assessment in terms of effectiveness. This was the conclusion from the most recent Cochrane review [48]. This review was rated as good quality using AMSTAR and low risk of bias using ROBIS. Further well-conducted trials on herbal extracts such as Capsicum, nabilone and 0il-24 would also be beneficial.

Implications for future research

There is clearly a need for larger and more methodologically sound RCTs to be conducted on the effectiveness of some CAM therapies for FM. Acupuncture, in particular, had several trials investigating its efficacy for FM. Future trials could adopt the following RCT design: to compare drug plus sham acupuncture versus placebo drug plus CAM intervention. This would enable the sham condition to be tested properly.

Both reviews assessing herbal medicine [32, 75] indicated some evidence for topical Capsicum but more research is needed. More research is also needed before homoeopathy can be considered a viable alternative treatment for FM.

Overall conclusions

Overall, no firm conclusions were drawn for either spinal manipulation or homoeopathy for FM. There is limited evidence for topical Capsicum to alleviate symptoms of FM, but more research is needed. There is some evidence to support the effectiveness of acupuncture for FM, and further high-quality trials are needed to investigate its benefits, harms and mechanisms of action, compared with no or standard treatment before this can be considered a viable alternative treatment for FM.

Abbreviations

ACR:

American College of Rheumatology

AMSTAR:

Assessing the methodological quality of systematic reviews

CAM:

Complementary and alternative medicine

CCT:

Controlled clinical trial

CI:

Confidence interval

FM:

Fibromyalgia

GRADE:

Grading of Recommendations Assessment, Development and Evaluation

MD:

Mean difference

MPQ:

McGill Pain Questionnaire

RCT:

Randomised controlled trial

SD:

Standard deviation

SIGN:

Scottish Intercollegiate Guidelines Network

SMD:

Standard mean difference

SS:

Symptom severity scale

TCM:

Traditional Chinese medicine

VAS:

Visual analogue scale

WPI:

Widespread Pain Index

References

  1. Terry R, Perry R, Ernst E. An overview of systematic reviews of complementary and alternative medicine for fibromyalgia. Clin Rheumatol. 2012;31(1):55–66.

    Article  PubMed  Google Scholar 

  2. Ngian GS, Guymer EK, Littlejohn GO. The use of opioids in fibromyalgia. Int J Rheum Dis. 2011;14(1):6–11.

    Article  PubMed  Google Scholar 

  3. Wolfe F, Clauw DJ, Fitzcharles MA, Goldenberg DL, Katz RS, Mease P, Russell AS, Russell IJ, Winfield JB, Yunus MB. The American College of Rheumatology preliminary diagnostic criteria for fibromyalgia and measurement of symptom severity. Arthritis Care Res. 2010;62(5):600–10.

    Article  Google Scholar 

  4. Branco JC, Bannwarth B, Failde I, Abello Carbonell J, Blotman F, Spaeth M, Saraiva F, Nacci F, Thomas E, Caubère JP, Le Lay K, Taieb C, Matucci-Cerinic M. Prevalence of fibromyalgia: a survey in five European countries. Semin Arthritis Rheum. 2010;39(6):448–53.

    Article  PubMed  Google Scholar 

  5. Vincent A, Lahr BD, Wolfe F, Clauw DJ, Whipple MO, Oh TH, Barton DL, St Sauver J. Prevalence of fibromyalgia: a population-based study in Olmsted County, Minnesota utilizing the Rochester Epidemiology Project. Arthritis Care Res. 2013;65(5):786–92.

    Article  Google Scholar 

  6. McBeth J, Jones K. Epidemiology of chronic musculoskeletal pain. Best Pract Res Clin Rheumatol. 2007;21(3):403–25.

    Article  PubMed  Google Scholar 

  7. Moore RA, Derry S, Aldington D, Cole P, Wiffen PJ. Amitriptyline for neuropathic pain in adults. Cochrane Database Syst Rev. 2015;(7):CD008242.

  8. Tofferi JK, Jackson JL, O’Malley PG. Treatment of fibromyalgia with cyclobenzaprine: a meta-analysis. Arthritis Rheum. 2004;51(1):9–13.

    Article  CAS  PubMed  Google Scholar 

  9. Carville SF, Arendt-Nielsen S, Bliddal H, Blotman F, Branco JC, Buskilla D, da Silva JAP, et al. EULAR evidence-based recommendations for the management of fibromyalgia syndrome. Ann Rheum Dis. 2007;67(4):536–41.

    Article  PubMed  Google Scholar 

  10. Klement A, Häuser W, Brückle W, Eidmann U, Felde E, Herrmann M, et al. Allgemeine Behandlungsgrundsätze, Versorgungskoordination und Patientenschulung beim Fibromyalgie syndrom und chronischen Schmerzen inmehreren Körperregionen (General principles of therapy, coordination of medical care and patient education in fibromyalgia syndrome and chronic widespread pain). Schmerz. 2008;22:283–94.

    Article  CAS  PubMed  Google Scholar 

  11. Hauser W, Thieme K, Turk DC. Guidelines on the management of fibromyalgia syndrome—a systematic review. Eur J Pain. 2010;14:5–10.

    Article  PubMed  Google Scholar 

  12. Boomershine CS, Crofford LJ. Symptom-based approach to pharmacologic management of fibromyalgia. Nat Rev Rheumatol. 2009;5:191–9.

    Article  PubMed  Google Scholar 

  13. Poiro-Boisset M, Esdaile JM, Fitzcharles MA. Alternative medicine use in fibromyalgia syndrome. Arthritis Care Res. 1996;9:13–7.

    Article  Google Scholar 

  14. Rossy LA, Bucklew SP, Dorr N, Hagglund KJ, Thayer JF, McIntosh MJ, Hewett JE, Johnson JC. A meta-analysis of fibromyalgia treatment interventions. Ann Behavioural Med. 1999;21(2):180–91.

    Article  CAS  Google Scholar 

  15. Ernst E, Pittler MH, Wider B, Boddy K, editors. The desktop guide to complementary and alternative medicine: an evidence based approach. 2nd ed. Edinburgh: Mosby; 2006.

    Google Scholar 

  16. Ernst E, Pittler MH, Wider B, Boddy K, editors. Complementary medicine for pain management: an evidence based approach. 2007.

    Google Scholar 

  17. Ernst E. Complementary treatments in rheumatic diseases. Rhuem Dis Clin North Am. 2008;34(2):455–67.

    Article  Google Scholar 

  18. Ernst E, Resch KL, Mills S, Hill R, Mitchell A, Willoughby M, White A. Complementary medicine—a definition. Br J Gen Pract. 1995;45:506.

    PubMed Central  Google Scholar 

  19. White AR, Resch KL, Ernst E. Complementary medicine: use and attitudes among GPs. Fam Pract. 1997;14(4):302–6.

    Article  CAS  PubMed  Google Scholar 

  20. Perry R, Dowrick C. Complementary medicine and general practice: an urban perspective. Complement Ther Med. 2000;8(2):71–5.

    Article  CAS  PubMed  Google Scholar 

  21. Perry R, Dowrick C, Ernst E. Complementary medicine and general practice in an urban setting: a decade on. Prim Health Care Res Dev. 2014;15(3):262–7.

    Article  PubMed  Google Scholar 

  22. Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Whiting P, Savović J, Higgings JP, Caldwell DM, Reeves BC, Shea B, Davies P, Kleijnen J, Churchill R, ROBIS group. ROBIS: a new tool to assess risk of bias in systematic reviews was developed. J Clin Epidemiol. 2016;69:225–34.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Lauche R, Cramer H, Dobos G, Langhorst J, Schmidt S. A systematic review and meta-analysis of mindfulness-based stress reduction for the fibromyalgia syndrome. J Psychosom Res. 2013;75(6):500–10.

    Article  PubMed  Google Scholar 

  25. Melzack R. The McGill Pain Questionnaire: major properties and scoring methods. Pain. 1975;1:277–99.

    Article  CAS  PubMed  Google Scholar 

  26. Dixon D, Pollard B, Johnston M. What does the chronic pain questionnaire measure? Pain. 2007;130:249–53.

    Article  PubMed  Google Scholar 

  27. Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, Henry DA, Boers M. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62:1013–20.

    Article  PubMed  Google Scholar 

  28. Perry R, Terry R, Ernst E. A systematic review of homoeopathy for the treatment of fibromyalgia. Clin Rheumatol. 2010;29(5):457–64.

    Article  PubMed  Google Scholar 

  29. Boehm K, Raak C, Cramer H, Lauche R, Ostermann T. Homeopathy in the treatment of fibromyalgia—a comprehensive literature-review and meta-analysis. Complement Ther Med. 2014;22(4):731–42.

    Article  PubMed  Google Scholar 

  30. Holdcraft LC, Assefi N, Buchwald D. Complementary and alternative medicine in fibromyalgia and related syndromes. Best Pract Res Clin Rheumatol. 2003;17(4):667–83.

    Article  PubMed  Google Scholar 

  31. Baronowsky J, Klose P, Musial F, Haeuser W, Dobos G, Langhorst J. Qualitative systematic review of randomised controlled trials on complementary and alternative medicine treatments in fibromyalgia. Rhuematol Int. 2009;30:1–21.

    Article  Google Scholar 

  32. De Silva V, El-Metwally A, Ernst E, Lewith G, Macfarlane GJ. Evidence for the efficacy of complementary and alternative medicines in the management of fibromyalgia: a systematic review. Rheumatology. 2010;49(6):1063–8.

    Article  PubMed  Google Scholar 

  33. Terhorst L, Schneider MJ, Kim KH, Goozdich LM, Stilley CS. Complementary and alternative medicine in the treatment of pain in fibromyalgia: a systematic review of randomized controlled trials. J Manipulative Physiol Ther. 2011;34(7):483–96.

    Article  PubMed  Google Scholar 

  34. Terhorst L, Schneider M. Complementary and alternative medicine in the treatment of pain in fibromyalgia: a systematic review of randomized controlled trials. Portland: From International Research Congress on Integrative Medicine and Health 2012; 2012.

    Google Scholar 

  35. Fisher P. An experimental double-blind clinical trial method in homeopathy. Use of a limited range of remedies to treat fibrositis. Br Homeopath J. 1986;75(3):142.

    Article  Google Scholar 

  36. Fisher P, Greenwood G, Huskisson EC, Turner P, Belon P. Effects of homeopathic treatment on fibrositis (primary fibromyalgia). Br Med J. 1989;299:365–6.

    Article  CAS  Google Scholar 

  37. Bell IR, Lewis II DA, Brooks AJ. Improved clinical status in fibromyalgia patients treated with individualised homeopathic medicines versus placebo. Rhuematology. 2004;43(5):577–82.

    Article  CAS  Google Scholar 

  38. Relton C, Smith C, Raw J, Walters C, Adelbajo AO, Thomas KJ, Young TA. Healthcare provided by a homeopath as an adjunct to usual care for fibromyalgia (FMS): results of a pilot randomised controlled trial. Homeopathy. 2009;98:77–82.

    Article  PubMed  Google Scholar 

  39. Jadad AR, Moore RA, Carroll D, et al. Assessing the quality of reports of randomized controlled trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–2.

    Article  CAS  PubMed  Google Scholar 

  40. Egocheaga J, Del Valle M. Use of antihomotoxic drug therapy for the management of symptoms associated to fibromyalgia. Rev Soc Esp Dolor. 2004;11:4–8.

    Google Scholar 

  41. Bennett RM, Goldenberg DL. Fibromyalgia, myofascial pain, tender points and trigger points: splitting or lumping? Arthritis Res Ther. 2011;13(3):117.

  42. Higgins J, Green S. Cochrane handbook for systematic reviews of interventions. Chichester: Wiley; 2011.

  43. Mayhew, Ernst. Acupuncture for fibromyalgia—a systematic review of randomized clinical trials. Rheumatology (Oxford). 2007;46(5):801–4.

    Article  CAS  Google Scholar 

  44. Langhorst J, Klose P, Musial F, Irnich D, Häuser W. Efficacy of acupuncture in fibromyalgia syndrome—a systematic review with a meta-analysis of controlled clinical trials. Rheumatology (Oxford). 2010;49(4):778–88.

    Article  Google Scholar 

  45. Martin-Sanchez E, Torralba E, Díaz-Domínguez E, Barriga A, Martin JL. Efficacy of acupuncture for the treatment of fibromyalgia: systematic review and meta-analysis of randomized trials. Open Rheumatol J. 2009;16(3):25–9.

    Article  Google Scholar 

  46. Yang B, Yi G, Hong W, Bo C, Wang Z, Liu Y, Xue Z, Li Y. Efficacy of acupuncture on fibromyalgia syndrome: a meta-analysis. J Tradit Chin Med. 2014;34(4):381–91.

    Article  PubMed  Google Scholar 

  47. Cao H, Li X, Han M, Liu J. Acupoint stimulation for fibromyalgia: a systematic review of randomised controlled trials. Evidence based complementary and alternative medicine. 2013;2013):362831.

    Google Scholar 

  48. Deare JC, Zheng Z, Xue CC, Liu JP, Shang J, Scott SW, Littlejohn G. Acupuncture for treating fibromyalgia. Cochrane Database Syst Rev. 2013;5:CD007070.

    PubMed Central  Google Scholar 

  49. Daya S. The efficacy of acupuncture in the treatment of fibromyalgia syndrome. J Acupunct Assoc Charter Physiother. 2007;(3):35–46.

    Google Scholar 

  50. Sprott H. Efficiency of acupuncture in patients with fibromyalgia. Clin Bull Myofascial Surg. 1998;3(1):37–43.

    Article  Google Scholar 

  51. Deluze C, Bosia L, Zirbs A, Chantraine A, Vischer TL. Electroacupuncture in fibromyalgia: results of a controlled trial. BMJ. 1992;305(6864):1249–52.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  52. Martin DP, Sletten CD, Williams BA, Berger IH. Improvement in fibromyalgia symptoms with acupuncture: results of a randomized controlled trial. Mayo Clin Proc. 2006;81(6):749–57.

    Article  PubMed  Google Scholar 

  53. Guo X, Jia J. Comparison of therapeutic effects on fibromyalgia syndrome between dermal-neurological electric stimulation and electric acupuncture. Chines J Clin Rehab. 2005;9:171–3.

    Google Scholar 

  54. Assefi N, Sherman K, Jacobsen C, Goldberg J, Smith W, Buchwald D. A randomised clinical trial of acupuncture compared with sham acupuncture in fibromyalgia. Ann Int Med. 2005;143:10–21.

    Article  PubMed  Google Scholar 

  55. Harris RE, Tian X, Williams DA, et al. Treatment of fibromyalgia with formula acupuncture: investigation of needle placement, needle stimulation, and treatment frequency. J Altern Complement Med. 2005;11:663–71.

    Article  PubMed  Google Scholar 

  56. Harris RE, Zubieta JK, Scott DJ, Napadow V, Gracely RH, Clauw DJ. Traditional Chinese acupuncture and placebo (sham) acupuncture are differentiated by their effects on μ-opioid receptors (MORs). Neuroimage. 2009;47(3):1077–85.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  57. Lautenschlager J, Schnorrenberger CC, Muller W. Acupuncture with general fibromyalgia syndrome. Dtsch Zschr Akup. 1989;32:122–8.

    Google Scholar 

  58. van Tulder MW, Furlan A, Bombardier C, et al. Updated method guidelines for systematic reviews in the Cochrane Collaboration Back Review Group. Spine. 2003;28:1290–9.

    PubMed  Google Scholar 

  59. Harris RE, Sundgren PC, Pang Y, Hsu M, Petrou M, Kim SH, et al. Dynamic levels of glutamate within the insula are associated with improvements in multiple pain domains in fibromyalgia. Arthritis Rheumatism. 2008;58(3):903–7.

    Article  CAS  PubMed  Google Scholar 

  60. Liu SJ. Clinical study on treating fibromyalgia syndrome with acupuncture and point injection [M.S. thesis] Hubei University of Traditional Chinese Medicine; 2012.

  61. Ruan YD, Wei WZ, Hong XT, Yang XH. Clinical observation of moxibustion for fibromyalgia. Proceedings of the 11th Acupuncture Symposium of Guangdong Province; 2010.

  62. Hadianfard MJ, Parizi MH. A randomized clinical trial of fibromyalgia treatment with acupuncture compared with fluoxetine. Iran Red Crescent Med J. 2012;14(10):631–40.

    CAS  PubMed  PubMed Central  Google Scholar 

  63. Yao QP. Clinical study on fibromyalgia syndrome with the acupuncture of stimulating Du channel and smoothing other channels and collaterals [M.S. thesis] Heilongjiang University of Traditional Chinese Medicine; 2006.

  64. Jiang F, Liu JB. An observation on clinical efficacy in fibromyalgia syndrome. Chin J Rheumatol. 2004;8:750–2.

    Google Scholar 

  65. Targino RA, Imamura M, Kaziyama HH, et al. A randomized controlled trial of acupuncture added to usual treatment for fibromyalgia. J Rehabil Med. 2008;40:582–8.

    Article  PubMed  Google Scholar 

  66. Guo Y, Sun YZ. Clinical study on treatment of fibromyalgia syndrome with penetrating needling at the back. Zhongguo Zhen Jui. 2005;25(2):98–100.

    Google Scholar 

  67. Itoh K, Kitakoji H. Effects of acupuncture to treat fibromyalgia: a preliminary randomised controlled trial. Chin Med. 2010;5:11.

    Article  PubMed  PubMed Central  Google Scholar 

  68. Kerns RD, Turk DC, Rudy TE. The West Haven-Yale Multidimensional Pain Inventory (WHYMPI). Pain. 1985;23(4):345–56.

    Article  CAS  PubMed  Google Scholar 

  69. Blunt KL, Rajwani MH, Guerriero RC. The effectiveness of chiropractic management of fibromyalgia patients: a pilot study. J Manipul Physiol Ther. 1997;20:389–99.

    CAS  Google Scholar 

  70. Wise P, Walsh M, Littlejohn G. Efficacy of chiropractic treatment on fibromyalgia syndrome: a randomized controlled trial. Eur J Chiropract. 2002;49:198–9.

    Google Scholar 

  71. Panton LB, Figueroa A, Kingsley JD, Hornbuckle L, Wilson J, StJohn N, et al. Effects of resistance training and chiropractic treatment in women with fibromyalgia. J Alt Comp Med. 2009;15(3):321–8.

    Article  Google Scholar 

  72. Tyers S, Smith RB. A comparison of cranial electrotherapy stimulation alone or with chiropractic therapies in the treatment of fibromyalgia. Am Chiropractor. 1997;23:39–41.

    Google Scholar 

  73. Ernst E. Chiropractic treatment for fibromyalgia: a systematic review. Clin Rheumatol. 2009;28(10):1175–8.

    Article  PubMed  Google Scholar 

  74. Gamber RG, Shores JH, Russo DP, Jimenez C, Rubin BR. Osteopathic manipulative treatment in conjunction with medication relieves pain associated with fibromyalgia syndrome: results of a randomized clinical pilot project. J Am Osteopath Assoc. 2002;102(6):321–5.

    PubMed  Google Scholar 

  75. de Souza Nascimento S, Desantana JM, Nampo FK, et al. Efficacy and safety of medicinal plants or related natural products for fibromyalgia: a systematic review. Evid Based Complement Alternat Med. 2013;2013:10.

    Article  Google Scholar 

  76. Casanueva B, Rodero B, Quintial C, Llorca J, González-Gay MA. Short-term efficacy of topical capsaicin therapy in severely affected fibromyalgia patients. Rheumatol Int. 2013;33(10):2665–70.

    Article  CAS  PubMed  Google Scholar 

  77. McCarty DJ, Csuka M, McCarthy G, Trotter D. Treatment of pain due to fibromyalgia with topical capsaicin: a pilot study. Semin Arth Rheum. 1994;23:41–7.

    Article  Google Scholar 

  78. Ware MA, Fitzcharles MA, Joseph L, Shir Y. The effects of nabilone on sleep in fibromyalgia: results of a randomized controlled trial. Anesth Analg. 2010;110(2):604–10.

    Article  CAS  PubMed  Google Scholar 

  79. Skrabek RQ, Galimova L, Ethans K, Perry D. Nabilone for the treatment of pain in fibromyalgia. J Pain. 2008;9(2):164–73.

    Article  CAS  PubMed  Google Scholar 

  80. Ko GD, Hum A, Traises G, Berbrayer D. Effects of topical 024 essential oils on patients with fibromyalgia syndrome: a randomised, controlled pilot study. J Musculoskeltal pain. 2007;15(1):11–9.

    Article  Google Scholar 

  81. Rutledge DN, Jones CJ. Effects of topical essential oil on exercise volume after a 12-week exercise program for women with fibromyalgia: a pilot study. J Altern Complement Med. 2007;13(10):1099–106.

    Article  PubMed  Google Scholar 

  82. Lister RE. An open, pilot study to evaluate the potential benefits of coenzyme Q10 combined with Ginkgo biloba extract in fibromyalgia syndrome. J Int Med Res. 2002;30(2):195–9.

    Article  CAS  PubMed  Google Scholar 

  83. Lakaczer D, Darland G, Tripp, et al. A pilot trail evaluating Meta050, a propriety combination of reduced iso-alpha acids, rosemary extract and oleanolic acid in patients with arthritis and fibromyalgia. Phytother Res. 2005;19(10):864–69.

    Article  Google Scholar 

  84. Ernst E. ‘First, do no harm’ with complementary and alternative medicine. Trends Pharmacol Sci. 2007;28(2):48–50.

    Article  CAS  PubMed  Google Scholar 

  85. Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D. How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007;147(4):224–33.

    Article  PubMed  Google Scholar 

  86. Langhorst J, Häuser W, Bernardy K, Lucius H, Settan M, Winkelmann A, Musial F. Komplementäre und alternative Verfahren beim Fibromyalgiesyndrom. Systematische Übersicht, Metaanalyse und Leitlinie. Schwerpunkt, Schmerz. 2012;26:311–7.

    Article  CAS  Google Scholar 

  87. Lauche R, Cramer H, Klose P, Dobos G, Langhorst J. Komplementäre Therapien in den Leitlinien für die Behandlung des Fibromyalgiesyndroms – Update 2012. Forsch Komplementmed. 2012;19:280–3.

    Article  PubMed  Google Scholar 

  88. Collins English Dictionary. Glasgow: Harper Collins Publishers; 2012.

  89. Vincent C, Furham A. Complementary medicine: a research perspective. Chichester: Wiley; 1997.

  90. Sullivan JT. Surgery before anesthesia. Am Soc Anesthesiol Newsletter. 1996;60(9):8–10.

    Google Scholar 

  91. White A. Western medical acupuncture: a definition. Acupunct Med. 2009;27(1):33–5.

    Article  PubMed  Google Scholar 

  92. Hahnemann S. The Organon. New Dehli: Homeopathic Publications; 1842.

    Google Scholar 

  93. Breuer GS, Orbach H, Elkayam O, Berkun Y, Paran D, Mates M, Nesher G. Perceived efficacy among patients of various methods of complementary alternative medicine for rheumatologic disease. Clin Exp Rheumatol. 2005;23:693–6.

    CAS  PubMed  Google Scholar 

  94. Kunz K, Kunz, B. The complete guide to foot reflexology (Revised), Reflexology Research Project. Albuquerque; 1993.

  95. Micozzi MS. Fundamentals of complementary and alternative medicine. New York, Churchill Livingstone; 1996.

  96. Singh BB, Wu WS, Hwang SH, et al. Effectiveness of acupuncture in the treatment of fibromyalgia. Altern Ther Health Med. 2006;12(2):34–41.

    PubMed  Google Scholar 

  97. Sandberg M, Lundeberg T, Gerdle B. Manual acupuncture in fibromyalgia: a long-term pilot study. J Musculoskelet Pain. 1999;7(3):39–58.

    Article  Google Scholar 

  98. Cao JY, Li Y. Combination of acupuncture and antidepressant medications in treating of 56 cases of fibromyalgia. Chin Arch Trad Chi Med. 2003;21:813–7.

  99. Liu Q, Li F. Clinical observation of acupuncture for 30 cases of fibromyalgia. Anthol Med. 2002;21(2):183-4.

  100. Wang CM. Clinical treatment of acupuncture and semiconductor laser irradiation on fibromyalgia symptoms 28 cases. Shi Yong Zhong Yi Nei Ke Xue Za Zhi. 2008;22(1):58.

    CAS  Google Scholar 

  101. Guo AS, Li AH. Clinical observation on therapeutic effect of elec-acupuncture combining TDP irradiation on fibromyalgia syndrome 36 cases. Jiao Tong Yi Xue. 2010;24(4):410–1.

    Google Scholar 

  102. Wang SP, Wang XF, Zhang DX, et al. Clinical observation on therapeutic effect of acupuncture treatment based on syndrome differentiation of meridians on fibromyalgia syndrome. Zhong Guo Zhen Jiu. 2002;22(12):807–9.

    Google Scholar 

  103. Feldman D, Mariano E. Treatment of fibromyalgia with acupuncture: a randomized, controlled trial of 16 weeks duration (abstract 91). American College of Rheumatology meeting. November 2001

  104. MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, Moher D. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT Statement. PLoS Med. 2010;7(6):e1000261.

    Article  PubMed  PubMed Central  Google Scholar 

  105. Berman BM, Ezzo J, Hadhazy V, Swyers JP. Is acupuncture effective in the treatment of fibromyalgia? Fam Pract. 1999;48(3):213–8.

    CAS  Google Scholar 

  106. Schneider M, Vernon H, Ko G, Lawson G, Perera J. Chiropractic management of fibromyalgia syndrome: a systematic review of the literature. J Manipulative Physiol Ther. 2009;32(1):25–40.

    Article  PubMed  Google Scholar 

  107. Sim J, Adams N. Systematic review of randomized controlled trials of nonpharmacological interventions for fibromyalgia. Clin J Pain. 2002;18(5):324–36.

    Article  PubMed  Google Scholar 

  108. Robert Hardy-Pickering R, Adams N, Sim J, Roe B, Wallymahmed A. The use of complementary and alternative therapies for fibromyalgia. Phys Ther Rev. 12(3):249-60.

  109. Boyd A, Bleakley C, Gill C, McDonough S, Hurley DA, Bell P, McVeigh JG, Hannon-Fletcher M. Herbal medicinal products or preparations for neuropathic pain and fibromyalgia. Cochrane Database Syst Rev. 2013;(5):CD010528.

  110. Jones GT, Paudyal P, Macfarlane G, Arthritis Research UK Working Group on Complementary and Musculoskeletal Research Collaboration (Epidemiology Group). A systematic review of evidence for the effectiveness of practitioner-based complementary and alternative therapies in the management of fibromyalgia. 2012. p. 966. ABSTRACT NUMBER.

    Google Scholar 

Download references

Acknowledgements

None mentioned

Funding

None needed

Availability of data and materials

Not relevant

Authors’ contributions

RP designed the review, wrote and ran the search; assessed titles and abstracts for inclusion and data extraction; and led the write-up of the review. VL assessed titles and abstracts for inclusion, completed the data extraction, and contributed to the paper. PD assessed ROBIS on 15 reviews and contributed to the paper. CP checked the calculations of all meta-analyses included in the review and contributed to the paper. AN helped format the paper and contributed to the paper. RC helped with the initial idea of the review and contributed to the paper. All authors read and approved the final manuscript.

Competing interests

Rachel Perry was an author on one of the papers under review (Perry et al. 2010 [28]) and completed the data extraction and risk of bias on her review. However, the data extraction was also completed by Verity Leach and risk of bias was assessed by Philippa Davies who were both independent to this particular review. Philippa Davies and Rachel Churchill were involved in the development of ROBIS.

Consent for publication

All authors have approved the manuscript for submission.

Ethics approval and consent to participate

Not relevant

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rachel Perry.

Appendices

Appendix 1

Description of CAM therapies

Acupuncture is the insertion of the tips of needles into the skin at specific points for the purpose of treating various disorders by stimulating nerve impulses. Originally Chinese, this method of treatment is practised in many parts of the world [88]. It aims to restore balance to enable the chi to free flow around the meridians. Each meridian is associated with a particular organ [89]. Western medical acupuncture has evolved from these ideas and is more about stimulating the nervous system (http://www.nhs.uk/Conditions/hypnotherapy/Pages/Introduction.aspx). Acupuncture is one of the more established CAM therapies within primary care, and it is an important CAM to review [21].

Hypnotherapy is a form of induced sleep which was originally used to diminish pain during surgery but soon became redundant with the advent of anaesthesia [90]. It is used to create subconscious change in a patient in the form of new responses, thoughts, attitudes, behaviours or feelings. It is often used in treating anxiety states, stopping addictions and reducing pain [91].

Homoeopathy is based on the principle of like cures like [92]. The remedies are prepared by dilution and energised through succession. Several aspects of the treatment (e.g. long, empathetic consultation and a high degree of individualising the remedies) might make it particularly attractive to patients with FM [93].

Osteopathy is a way of detecting, treating and preventing health problems by moving, stretching and massaging a person’s muscles and joints (http://www.nhs.uk/conditions/Osteopathy/Pages/Introduction.aspx).

Chiropractors uses less leverage and quicker manipulations than osteopathy, also uses soft tissue massage, exercise, corsets, splints and supports (http://www.nhs.uk/conditions/chiropractic/pages/introduction.aspx). The mechanical technique of either form of spinal manipulation might make it less attractive to FM sufferers as the pain tends to be throughout the body and manipulation may worsen this pain.

Herbal medicine is the use of plant extracts/materials for food medicine and health promotion. Medicinal plants have multiple actions; some of which are toxic. As humans, we are raised in a diet of herbs and plants so the suggestion is that we are better adapted to them than synthetic drugs. The plants are used in a variety of ways: dried fresh, infusion or decoctions [88].

Reflexology is a specialist foot massage which concentrates on specific zones on your foot relating them to major organ systems within the body. Blocks or disturbances within the connecting energy system allow for disease to build up, and these channels need unblocking [94].

Aromatherapy is the use of essential oil or aromatic essences massage into the skin, inhaled or occasionally ingested. The oils are extracted from the petals, leaves, stem or bark of the plant [95].

Appendix 2

Table 4 Excluded reviews
Table 5 Table of reviews in progress

Appendix 3

MEDLINE search terms

1. systematic review.ti,ab.

2. meta-analysis.pt.

3. meta-analysis.ti,ab.

4. systematic literature review.ti,ab.

5. review.pt.

6. evidence synthesis.ti,ab.

7. 1 or 2 or 3 or 4 or 5 or 6

8. exp Fibromyalgia/

9. (chronic adj widespread adj pain).ti,ab.

10. fibrositis.ti,ab.

11. fibromyal*.ti,ab.

12. fibromylagia.ti,ab.

13. 8 or 9 or 10 or 11 or 12

14. homeopathy.ti,ab.

15. homeopathic.ti,ab.

16. homeop*.ti,ab.

17. homoeopathy.ti,ab.

18. homoeopath*.ti,ab.

19. homoop*.ti,ab.

20. exp Homeopathy/

21. 14 or 15 or 16 or 17 or 18 or 19 or 20

22. acupuncture therapy.ti,ab.

23. electroacupuncture.ti,ab.

24. acupuncture*.ti,ab.

25. acupoint.ti,ab.

26. meridian.ti,ab.

27. moxibustion.ti,ab.

28. exp acupuncture/

29. 22 or 23 or 24 or 25 or 26 or 27 or 28

30. (spin* adj3 manipulation*).ti,ab.

31. (osteopath* adj manipul*).ti,ab.

32. (high adj3 velocit* thrust).ti,ab.

33. (spin* adj3 adjust*).ti,ab.

34. (sham adj3 manipulation*).ti,ab.

35. exp Manipulation, Chiropractic/

36. exp Manipulation, Spinal/

37. exp Manipulation, Osteopathic/

38. chiropract*.ti,ab.

39. osteopath*.ti,ab.

40. 30 or 31 or 32 or 33 or 34 or 35 or 36 or 37 or 38 or 39

41. exp Hypnosis/

42. (hypno* or autogenic* or mesmer* or guided ima*).ti,ab.

43. 41 or 42

44. reflexolog*.ti,ab.

45. reflexolog* treatment*.ti,ab.

46. foot massage*.ti,ab.

47. zone therap*.ti,ab.

48. 44 or 45 or 46 or 47

49. (herbal* or medical herbal* or TCM).ti,ab.

50. exp Drugs, Chinese Herbal/

51. exp Phytotherapy/

52. 49 or 50 or 51

57. 13 or 21 or 29 or 40 or 43 or 48 or 52

58. 7 and 13 and 57

Appendix 4

Table 6 Summary of the ROBIS domains

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Perry, R., Leach, V., Davies, P. et al. An overview of systematic reviews of complementary and alternative therapies for fibromyalgia using both AMSTAR and ROBIS as quality assessment tools. Syst Rev 6, 97 (2017). https://doi.org/10.1186/s13643-017-0487-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s13643-017-0487-6

Keywords