Back to Journals » Journal of Pain Research » Volume 11
Appropriateness of sham or placebo acupuncture for randomized controlled trials of acupuncture for nonspecific low back pain: a systematic review and meta-analysis
Received 28 September 2017
Accepted for publication 29 November 2017
Published 28 December 2017 Volume 2018:11 Pages 83—94
DOI https://doi.org/10.2147/JPR.S152743
Checked for plagiarism Yes
Review by Single anonymous peer review
Peer reviewer comments 4
Editor who approved publication: Professor E Alfonso Romero-Sandoval
Yan Xiang,1 Jinyuan He,2 Rui Li1
1Department of Teaching, School of Acupuncture and Moxibustion and Tuina, Beijing University of Chinese Medicine, Beijing, China; 2Department of Cardiothoracic Surgery, The Third Affiliated Hospital of Sun Yat-sen University, Guangzhou, China
Objectives: To establish whether sham acupuncture (SA) or placebo acupuncture (PA) is more efficacious for reducing low back pain (LBP) than other routine treatments and to discuss whether SA or PA is appropriate for randomized controlled trials of acupuncture for LBP.
Methods: Six databases were searched on 31 May 2017. We included only randomized controlled trials of adults with LBP and lower back myofascial pain syndrome. The studies had at least two control arms: a sham-controlled acupuncture arm and a routine care or waiting list arm (people who did not receive acupuncture until the end of treatment). Trials were combined using meta-analysis methods when the data allowed statistical pooling. Pooled effect sizes were calculated by random effects models.
Results: This review identified 7 trials (1768 participants); all were included in the meta-analysis. We found statistically significant differences in pain reduction post-intervention between SA or PA and routine care or a waiting list, with a standardized mean difference of −0.36 (95% CI −0.54 to −0.18; I2 statistic=16%; participants=624; studies=6) for the Visual Analog Scale and −0.35 (95% CI −0.49 to −0.20; I2 statistic=0%; participants=736; studies=1) for the Chronic Pain Grade Scale; however, no significant difference was observed between SA or PA and routine care or no treatment for post-intervention function.
Conclusion: Compared with routine care or a waiting list, SA or PA was more efficacious for pain relief post-intervention. Concluding that SA or PA is appropriate for acupuncture research would be premature. Guidelines evaluating SA or PA control methods are needed to determine the specific effect of acupuncture over placebo.
Keywords: acupuncture, alternative medicine, backaches, pain management, placebos, controlled clinical trial, lumbago
Introduction
Nonspecific low back pain (LBP) is among the most common health complaints; it is the leading cause of years lived with disability worldwide and sixth in terms of overall disease burden (disability-adjusted life-years).1 Although LBP is usually a self-limiting and benign disease, a large variety of therapeutic interventions are available to treat it.2
Acupuncture, based on the concepts of traditional Chinese medicine (TCM), is one of the oldest and most popular complementary or alternative treatment methods. Although it is one of the most commonly used interventions to treat LBP, acupuncture has mixed support. Despite a 2005 Cochrane review that reported the existence of some evidence supporting acupuncture for chronic LBP,3 a conclusion supported by another systematic review,4 the National Institute for Health and Care Excellence (NICE) in the UK removed acupuncture from their LBP guidelines in early 2016, citing a lack of evidence to indicate that it was more effective than sham treatment.5
Sham acupuncture (SA), also called placebo acupuncture (PA), performed away from the acupuncture points established by TCM or without stimulation and manipulation to avoid eliciting “De Qi” sensations or using a non-penetrating technique, is used as control in scientific studies to determine the efficacy of acupuncture.6,7 However, in China, wrist-ankle acupuncture and abdomen acupuncture, both with shallow needling, are the primary treatments for LBP. It might be argued that the superficial or minimal acupuncture might stimulate C fibers in the skin to trigger some kind of analgesic effect.8,9 Of those sham-controlled clinical trials, several of them found no significant differences between real acupuncture and SA/PA in pain relief for LBP.10–14 As a result, controversy persists regarding whether acupuncture for LBP works primarily by the placebo effect. Meanwhile, some investigators argued that using SA/PA as a control is problematic because SA/PA might not meet the criteria of being physiologically inert.15,16
Regardless, no systematic review and meta-analysis to date has addressed whether SA/PA has effects for LBP. We, therefore, performed a systematic review and meta-analysis of acupuncture for the treatment of LBP to determine whether SA/PA was more efficacious in reducing LBP than routine care and to discuss whether SA/PA is appropriate for use in randomized controlled trials (RCTs) of acupuncture for LBP.
Methods
Criteria for considering studies for this review
Types of studies
We included only RCTs, which provide the highest level of evidence to assess the effects of interventions. Moreover, the studies had at least two control arms: a sham-controlled acupuncture arm and a routine care or waiting list (people who did not receive acupuncture until the end of treatment) or no treatment arm. Articles published in English or Chinese without region restriction were included.
Types of participants
We included studies which recruited adults (>18 years) with LBP or myofascial pain syndrome in the lower back. RCTs that included subjects with LBP caused by specific pathological entities such as infection, metastatic disease, neoplasm, osteoarthritis, rheumatoid arthritis, inflammatory processes, radicular syndrome, or fractures were excluded. Patients with LBP associated with sciatica as the major symptom, pregnancy, post-partum status, and post-operative LBP were also excluded. Patients with acute, sub-acute (≤12 weeks), or chronic LBP (>12 weeks) were included.
Types of interventions
We included studies in which acupuncture points were stimulated by needle insertion (with or without electroacupuncture), accompanied by a definite sensation of De Qi. The studies in which methods of stimulating acupuncture points by acupressure, transcutaneous electrical nerve stimulation, or infrared light for verum acupuncture were excluded. Bee venom acupuncture and ear acupuncture were excluded. Trials comparing two techniques of acupuncture were excluded. Trials assessing the efficacy of acupuncture as an adjunct treatment to other therapies compared to SA/PA as an adjunct treatment to other therapies were included.
Types of outcome measures
RCTs were included if they used at least one of the following two outcome measures considered salient in the field of LBP:
- Pain intensity (e.g., Visual Analog Scale [VAS]);
- Back-specific functional status (e.g., Roland–Morris Disability Questionnaire [RMDQ]).
The primary outcome was pain intensity. The secondary outcome measure was back-specific functional status.
Search methods for identification of studies
Electronic searches
We searched the following databases:
- Cochrane Central Register of Controlled Trials (CENTRAL; the Cochrane Library, to Issue 5 of 12 May 2017) on 31 May 2017
- PubMed (1980 to May 2017) on 31 May 2017
- EMBASE (Ovid SP, 1980 to May 2017) on 31 May 2017
- China National Knowledge Infrastructure, the Wan Fang and the Wei Pu databases up to 31 May 2017
Keywords, free words, and MeSH terms including “acupuncture” OR “acupuncture therapy” OR “acupuncture points” AND “low back pain” OR “lower back pain” OR “backache” OR “lumbago” were used.
Searching other resources
Keywords of the references of all pertinent publications were traced, including systematic reviews and meta-analyses, to identify citations omitted by the electronic search.
Data collection and analysis
Selection of studies
For this review, one author generated the electronic search strategies in the CENTRAL, PubMed, EMBASE, and Chinese databases and downloaded the citations. Two authors independently applied the aforementioned inclusion criteria to identify trials. Any disagreements between them were resolved by consensus with a third review author acting as an arbiter. The authors of recent original studies were contacted to obtain more information when needed.
Data extraction and management
Two authors independently extracted data on the study characteristics, study population, duration of symptoms, treatment type, frequency and duration of the intervention, outcome measurements, and type of comparisons. A standard extraction form was used. Discrepancies were reassessed and consensus was reached by discussion. If necessary, a third author reviewed the data to reach consensus.
Assessment of risk of bias in included studies
Two authors independently assessed the risk of bias of each included trial using the criteria recommended in The Cochrane Handbook for Systematic Reviews of Interventions.17 Six domains of bias were assessed: selection bias, performance bias, detection (or measurement) bias, attrition bias, reporting bias, and other bias (registered or not, ethics approval obtained or not, participants gave the informed consent or not, etc.). For each study, we scored each criterion as “high risk”, “low risk”, or “unclear”. Any disagreements were resolved by consensus and a third author was consulted if disagreements persisted. We also used the risk of bias assessment of the included trials for grading the quality of the evidence.
Measures of treatment effect
The analyses compared SA/PA to no treatment or routine care. For continuous measures, the use of weighted mean differences was preferred to analyze the results when the outcome measures were identical. Standardized mean differences (SMD) were used when different instruments were used for the same outcome measurements.18,19
Unit of analysis time frame
We extracted data from the outcomes measured immediately following the end of the sessions for up to 1 week after the end of the sessions.
Missing data management
When data were missing, attempts were made to obtain information by contacting the study authors.
Assessment of heterogeneity
Random effects models were used for all meta-analyses. This method is recommended by the CBN Group Editorial Board because the assumptions underlying the random effects model are better suited to the statistical combination of trials in this field.20
Assessment of reporting biases
Publication bias was assessed using funnel plots generated using RevMan (version: 5.3.5 [Java 7 64 bit]) Analysis Software.21 We used the method of independent visual inspection by two review authors. A third review author was consulted in cases of disagreement.
Data synthesis
We entered all quantitative results into RevMan (version: 5.3.5 [Java 7 64 bit]) Analyses Software.21 A meta-analysis was considered when homogeneity existed in terms of population, comparison group, and outcome. The magnitude of the effect size was categorized as follows: 0.2 indicates a small effect, 0.5 a moderate effect, and 0.8 a large effect.22
The GRADE approach was utilized to assess the quality of the evidence. This grading method for each outcome considered risk of bias, inconsistency of results, indirectness of evidence, imprecision, and publication bias.23
Subgroup analysis and assessment of heterogeneity
Assessments not planned in this review were subgroup or meta-regression analyses and sensitivity analysis.
Results
Description of studies
Results of the search
The flow of studies is illustrated in Figure 1 study flow diagram. In this review, we identified seven trials for inclusion.10,11,13,14,24
Figure 1 Study flow diagram. |
Included studies
In total, we included 7 trials (1768 participants). Four studies were conducted in Germany (1139 participants),10,13,24,25 one was conducted in the USA (323 participants),11 one was conducted in Spain (206 participants),14 and one was conducted in China (100 participants).26
Most patients included in these trials had chronic nonspecific LBP. The control groups included conventional treatment, standard therapy, routine care, and waiting list.
The type of SA/PA varied among the included trials: four studies used a superficial insertion method at non-acupuncture points,10,13,24,25 one used a toothpick in a needle guide tube,11 and one penetrated at nonspecific acupuncture points that were then punctured following the usual procedure.14 The sham needles in the final study differed from regular needles in that they had blunt and retractable tips, although true acupuncture points were treated.26
Details of each included trial are presented in Table 1.
Risk of bias in included studies
Some degree of publication bias was suggested (Figure 2), which may be attributed in part to the small number of studies. A summary of the risk of bias for each article is shown in Figure 3.
Figure 3 Summary of risks of bias. Note: +, yes; -, no; ?, unclear. |
Figure 3 provides an overview of the methodological quality assessment of the included studies. Three of the trials had a low risk of bias.11,14,24 Two studies had a high risk of bias.25,26 The remaining two studies had an unclear risk of bias.10,13 All studies fully or partially fulfilled the categories of allocation concealment, selective outcome, incomplete outcome data, and other sources of bias. The two trials at high risk of bias were deemed as such because of the lack of blinding of participants and personnel.
Effects of interventions
The studies compared SA/PA to routine care or waiting list. Based on the current evidence, SA/PA was clearly more effective than routine care or waiting list for pain relief post-intervention, with an SMD of −0.36 (95% CI −0.54 to −0.18; I2 statistic=16%) in VAS and −0.35 (95% CI −0.49 to −0.20; I2 statistic=0%) in Chronic Pain Grade Scale (CPGS; Figure 4).
Five of the seven included trials measured functional disability outcomes, with two using the RMDQ, two using the Pain Disability Index (PDI), and one using the Oswestry Disability Index (ODI). No significant difference was observed between SA/PA and routine care or no treatment as measured immediately after the end of the sessions (RMDQ: SMD of 0.11; 95% CI −0.78 to 1.00; I2 statistic=94%; PDI: SMD of −0.42; 95% CI −0.90 to 0.05; I2 statistic=66%; ODI: SMD of −0.30; 95% CI −0.69 to 0.10; Figure 5).
A summary of the findings for the main comparison is presented in Table 2.
Subgroup analysis
We added the subgroup analysis of VAS post-intervention, though we did not plan it in the protocol, because control groups in the included studies contained routine care and waiting list. Thus, we made the subgroup routine care versus waiting list. The results are consistent with pain differences in favor of SA/PA in both the routine care (mean difference [MD] −6.98 [95% CI −12.37, −1.59]) and waiting list subgroups (MD −13.70 [95% CI −20.32, −7.08]; Figure 6). The total MD and 95% CI were −9.66 (−13.84, −5.84) in favor of SA/PA. A similar finding was shown in chronic LBP subgroup for VAS (Figure 7). But there were no differences found in acute and chronic LBP subgroups for RMDQ (Figure 8).
Figure 6 Subgroup of VAS post-intervention routine care versus waiting list. Abbreviations: IV, inverse variance; Std, standard; VAS, Visual Analog Scale. |
Figure 7 Subgroup of VAS – acute LBP versus chronic LBP. Abbreviations: IV, inverse variance; LBP, low back pain; VAS, Visual Analog Scale. |
Figure 8 Subgroup of RMDQ – acute LBP versus chronic LBP. Abbreviations: IV, inverse variance; LBP, low back pain; RMDQ, Roland–Morris Disability Questionnaire. |
Discussion
Summary of main results
Seven RCTs comprising a total of 1768 patients were included in this systematic review and meta-analysis. Moderately significant evidence was obtained for the effectiveness of SA/PA for pain intensity as measured at the end of the treatments for LBP management. However, the review demonstrates scant support for the superior effectiveness of SA/PA compared with routine care or waiting list for back-specific functional status at the end of the treatments.
Overall completeness and applicability of evidence
We did not find a large effect size in the meta-analysis of continuous outcomes for pain intensity. All meta-analyses of continuous outcomes were performed using SMD values because the included trials used different measurement instruments for the outcomes of interest (pain and function). The disadvantage of using SMD values is that clinicians and patients are unlikely to relate to this way of presenting results. No serious adverse events were observed in these trials; the most common adverse event was increased pain after the massage sessions.
Quality of the evidence
In this review, we found two trials with unclear allocation of concealment bias and one trial with unclear selective reporting bias, suggesting that some studies may have exaggerated estimates of the intervention effect size compared with large trials. Two trials did not blind participants and personnel, suggesting that blinding patients and health-care providers was the most challenging methodological step in clinical trials of acupuncture, notwithstanding the recently improved methodological quality of the included RCTs.
Potential biases in the review process
Acupuncture is not a standardized therapy, and many variables may affect its potential effect on LBP, such as the needling technique, duration, frequency and number of sessions, points treated, manipulation, stimulus intensity, acupuncturists’ experience, patient heterogeneity, and confounding variables, such as co-interventions or the emotional effect of counseling by the acupuncturists.
SA/PA includes several forms. In this review, one type is a superficial insertion into non-acupuncture points and nonspecific acupuncture points.10,13,14,24–26 Another type uses a non-penetration method, with sham needles having blunt and retractable tips.11
For the points treated, some studies used a fixed protocol for all patients while others used a flexible set of points selected for each patient. Since both the methods are considered valid, this systematic review analyzed them together.
Limitations of this meta-analysis include the heterogeneity of the participants, because we included people with both acute and chronic nonspecific LBP, though we had subgroups. If there had been more literature, the evidence of the results would be more convincing with analyzing the types of LBP (acute, subacute, and chronic) separately, as they have different clinical approaches and disease trajectories. Additionally, the small number of studies for each SA/PA technique is another limitation. Furthermore, while no regions were excluded, the number of non-English-language journals indexed in electronic databases such as MEDLINE and EMBASE is limited. Should additional relevant trials be identified, this review will be updated.
Conclusion
Implications for practice
Notably, SA/PA was originally developed for use in acupuncture trials to determine the specific effects of needling. In clinical trials, procedures similar to real acupuncture may bias the results,27 and the sham or placebo control should be indistinguishable from the active treatment and yet be physiologically inert. Without meeting both criteria, it may not be appropriate to regard some procedures as sham or placebo controls within systematic reviews. While this review found evidence that SA/PA is more efficacious than routine care or waiting list in terms of pain relief at the end of the treatments, no evidence existed for improved function.
Additionally, variations of acupuncture must be considered. Based on TCM theory, all acupuncture procedures (e.g., points used, method of stimulation, and number of treatment sessions) must be performed according to individual differences; thus, acupuncture modalities vary among studies and are difficult to master and unify.28 Therefore, studies that examine the specific sham or placebo techniques used, including needle placement, needle insertion, acupuncture points or non-acupuncture points or nonspecific acupuncture points, and the acupuncturists’ experience are required, so as to differ distinguish from the real acupuncture. Furthermore, future research should focus on the standardization of outcome measures and the duration and frequency of sessions.
Besides, because acupuncture functions as a somatosensory-guided mind-body therapy, SA/PA could similarly enhance bodily sensations around the treatment site and induce potential effects related to endogenous pain modulation in the brain.27–29
Thus, we should avoid prematurely concluding that SA/PA is appropriate for acupuncture research. Moreover, guidelines should be developed to assess acupuncture sham–placebo control methods to address the specific effect of acupuncture over placebo.
Implications for research
To provide homogeneous information for future reviews, trial authors are encouraged to use the Consolidated Standards of Reporting Trials (CONSORT) statement as a model for reporting their trials (www.consort-statement.org) and the Standards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) criteria30 to report the interventions. From the available trials we included in this meta-analysis, superficial stimulation appears a more promising treatment for LBP than routine care in relieving pain post-intervention. Further studies to assess the superiority of SA/PA are required, as are those with larger sample sizes and those that assess the role of session length by including two (or more) levels of this variable; moreover, the experience of the therapist should also be considered by including practitioners with different levels of experience and training.
Acknowledgment
Prospero registration number: CRD42017070122.
Disclosure
The authors report no conflicts of interest in this work.
References
Maher C, Underwood M, Buchbinder R. Non-specific low back pain. Lancet. 2017;389(10070):736–747. | ||
Furlan AD, Yazdi F, Tsertsvadze A, et al. Acupuncture for (sub)acute non-specific low-back pain(Protocol). Cochrane Database Syst Rev. 2011(8):CD009265. | ||
Furlan AD, Van Tulder MW, Cherkin D, et al. Acupuncture and dry-needling for low back pain. Cochrane Database Syst Rev. 2005(1): CD001351. | ||
Liu L, Skinner M, McDonough S, Mabire L, Baxter GD. Acupuncture for low back pain: an overview of systematic reviews. EvidBased ComplementAlternatMed. 2015;2015:328196. | ||
Wise J. NICE recommends exercise and not acupuncture for low back pain. BMJ. 2016;352:i1765. | ||
Carlos Lopes-Júnior L, Cruz LA, Leopoldo VC, Campos FR, Almeida AM, Silveira RC. Effectiveness of traditional Chinese acupuncture versus sham acupuncture: a systematic review. Rev Latino-Americana de Enfermagem. 2016;24:1–12. | ||
Zhang LL, Chu Q, Wang S, Lai H, Xie BB. Is sham acupuncture as effective as traditional Chinese acupuncture? It’s too early to say. Chin J Integ Med. 2016;22(7):483–489. | ||
Price DD, Staud R, Robinson ME, Mauderli AP, Cannon R, Vierck CJ. Enhanced temporal summation of second pain and its central modulation in fibromyalgia patients. Pain. 2002;99(1–2):49–59. | ||
Staud R, Cannon RC, Mauderli AP, Robinson ME, Price DD, Vierck CJ Jr. Temporal summation of pain from mechanical stimulation of muscle tissue in normal controls and subjects with fibromyalgia syndrome. Pain. 2003;102(1–2):87–95. | ||
Brinkhaus B, Witt CM, Jena S, et al. Acupuncture in patients with chronic low back pain: a randomized controlled trial. ArchInternMed. 2006;166(4):450–457. | ||
Cherkin DC, Sherman KJ, Avins AL, et al. A randomized trial comparing acupuncture, simulated acupuncture, and usual care for chronic low back pain. ArchInternMed. 2009;169(9):858–866. | ||
Cho YJ, Song YK, Cha YY, et al. Acupuncture for chronic low back pain: a multicenter, randomized, patient-assessor blind, sham-controlled clinical trial. Spine. 2013;38(7):549–557. | ||
Leibing E, Leonhardt U, Köster G, et al. Acupuncture treatment of chronic low-back pain – A randomized, blinded, placebo-controlled trial with 9-month follow-up. Pain. 2002;96(1–2):189–196. | ||
Vas J, Aranda JM, Modesto M, et al. Acupuncture in patients with acute low back pain: A multicentre randomized controlled clinical trial. Pain. 2012;153(9):1883–1889. | ||
Tough EA, White AR, Richards SH, Lord B, Campbell JL. Developing and validating a sham acupuncture needle. Acupunct Med. 2009;27(3):118–122. | ||
Madsen MV, Gotzsche PC, Hrobjartsson A. Acupuncture treatment for pain: systematic review of randomized clinical trials with acupuncture, placebo acupuncture, and no acupuncture groups. BMJ. 2009;338:a3115. | ||
Higgins JP, Altman DG, Gøtzsche PC, et al; Cochrane Bias Methods Group; Cochrane Statistical Methods Group. The cochrane collaboration’s tool for assessing risk of bias in randomized trials. BMJ. 2011;343:d5928. | ||
Whitehead A, Whitehead J. A general parametric approach to the meta-analysis of randomized clinical trials. Stat Med. 1991;10(11):1665–1677. | ||
Normand SL. Meta-analysis: formulating, evaluating, combining,and reporting. Stat Med. 1999;18(3):321–359. | ||
Furlan AD, Malmivaara A, Chou R, et al; Editorial Board of the Cochrane Back, Neck Group. 2015 updated method guideline for systematic reviews in the cochrane back and neck group. Spine (Phila Pa 1976). 2015;40(21):1660–1673. | ||
Review Manager (RevMan) [Computer program]. Version 5.3. Copenhagen: The Nordic Cochrane Center TCC; 2014. | ||
Cohen J, Cohen J, Cohen D ea. Statistical power analysis for the behavioral science. J Am Stat Assoc. 1988;84(363):19–74. | ||
Schünemann H, Brożek J, Guyatt G, Oxman A. Handbook for grading the quality of evidence and the strength of recommendations using the GRADE approach. Updated October 2013. The Cochrane Collaboration;2013. | ||
Haake M, Müller HH, Schade-Brittinger C, et al. German Acupuncture Trials (GERAC) for chronic low back pain: Randomized, multicenter, blinded, parallel-group trial with 3 groups. Arch Intern Med. 2007;167(17):1892–1898. | ||
Molsberger AF, Mau J, Pawelec DB, Winkler J. Does acupuncture improve the orthopedic management of chronic low back pain–a randomized, blinded, controlled trial with 3 months follow up. Pain. 2002;99(3):579–587. | ||
Yuan Q, Liu L, Ma J, Wu W, Ye M, Zhang Y. A clinical study of acupuncture therapy for treatment of chronic nonspecific low back pain. J Trad Chin Orthop Trauma. 2016;28(6):12–17. | ||
Appleyard I, Lundeberg T, Robinson N. Should systematic reviews assess the risk of bias from sham–placebo acupuncture control procedures? Eur J Integ Med. 2014;6(2):234–243. | ||
Ji M, Wang X, Chen M, Shen Y, Zhang X, Yang J. The efficacy of acupuncture for the treatment of sciatica: asystematic review and meta-analysis. EvidBased ComplementAlternMed. 2015;2015:192808. | ||
Lund I, Lundeberg T. Are minimal, superficial or sham acupuncture procedures acceptable as inert placebo controls? Acupunct Med. 2006;24(1):13–15. | ||
Dorsher PT. The 2001 STRICTA recommendations for reporting acupuncture research: a review with implications for improving controlled clinical trial design. J Alternat Complem Med. 2009;15(2):147–151. |
© 2017 The Author(s). This work is published and licensed by Dove Medical Press Limited. The full terms of this license are available at https://www.dovepress.com/terms.php and incorporate the Creative Commons Attribution - Non Commercial (unported, v3.0) License. By accessing the work you hereby accept the Terms. Non-commercial uses of the work are permitted without any further permission from Dove Medical Press Limited, provided the work is properly attributed. For permission for commercial use of this work, please see paragraphs 4.2 and 5 of our Terms.