Skip to main content
Erschienen in: Trials 1/2013

Open Access 01.12.2013 | Research

“Spin” in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes

verfasst von: Suzanne Lockyer, Rob Hodgson, Jo C Dumville, Nicky Cullum

Erschienen in: Trials | Ausgabe 1/2013

Einloggen, um Zugang zu erhalten

Abstract

Background

Spin in the reporting of randomized controlled trials, where authors report research in a way that potentially misrepresents results and mislead readers, has been demonstrated in the broader medical literature. We investigated spin in wound care trials with (a) no statistically significant result for the primary outcome and (b) no clearly specified primary outcome.

Methods

We searched the Cochrane Wounds Group Specialised Register of Trials for randomized controlled trials (RCTs). Eligible studies were: Parallel-group RCTs of interventions for foot, leg or pressure ulcers published in 2004 to 2009 (inclusive) with either a clearly identified primary outcome for which there was a statistically non-significant result (Cohort A) or studies that had no clear primary outcome (Cohort B).
We extracted general study details. For both Cohorts A and B we then assessed for the presence of spin. For Cohort A we used a pre-defined process to assess reports for spin. For Cohort B we aimed to assess spin by recording the number of positive treatment effect claims made. We also compared the number of statistically significant and non-significant results reported in the main text and the abstract looking specifically for spin in the form of selective outcome reporting.

Results

Of the 71 eligible studies, 28 were eligible for Cohort A; of these, 71% (20/28) contained spin. Cohort B contained 43 studies; of these, 86% (37/43) had abstracts that claimed a favorable treatment claim. Whilst 74% (32/43) of main text results in Cohort B included at least one statistically non-significant result, this was not reflected in the abstract where only 28% contained (12/43) at least one statistically non-significant result.

Conclusions

Spin is a frequent phenomenon in reports of RCTs of wound treatments. Studies without statistically significant results for the primary outcome used spin in 71% of cases. Furthermore, 33% (43/132) of reports of wound RCTs did not specify a primary outcome and there was evidence of spin and selective outcome reporting in the abstracts of these. Readers should be wary of only reading the abstracts of reports of RCTs of wound treatments since they are frequently misleading regarding treatment effects.
Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Moher D, Jones A, Lepage L, CONSORT Group: Use of the CONSORT statement and quality of reports of randomised trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed Moher D, Jones A, Lepage L, CONSORT Group: Use of the CONSORT statement and quality of reports of randomised trials: a comparative before-and-after evaluation. JAMA. 2001, 285: 1992-1995. 10.1001/jama.285.15.1992.CrossRefPubMed
2.
Zurück zum Zitat Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral Hopewell S, Dutton S, Yu LM, Chan AW, Altman DG: The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral
3.
Zurück zum Zitat Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2005, 291: 2457-2465.CrossRef Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials. JAMA. 2005, 291: 2457-2465.CrossRef
4.
Zurück zum Zitat Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS ONE. 2008, 3: e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan A, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PloS ONE. 2008, 3: e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral
5.
Zurück zum Zitat Boutron I, Dutton S, Ravaud P, Altman D: Reporting and interpretation of Randomized Controlled Trials with statistically non-significant results for primary outcomes. JAMA. 2010, 303: 2058-2064. 10.1001/jama.2010.651.CrossRefPubMed Boutron I, Dutton S, Ravaud P, Altman D: Reporting and interpretation of Randomized Controlled Trials with statistically non-significant results for primary outcomes. JAMA. 2010, 303: 2058-2064. 10.1001/jama.2010.651.CrossRefPubMed
6.
Zurück zum Zitat Vera-Badillo R, Shapiro R, Ocana A, Amir E, Tannock I: Reporting of end points of efficacy and toxicity in randomized contro, linical trials for women with breast cancer. Ann Oncol. 2013, 24: 1238-1244. 10.1093/annonc/mds636.CrossRefPubMed Vera-Badillo R, Shapiro R, Ocana A, Amir E, Tannock I: Reporting of end points of efficacy and toxicity in randomized contro, linical trials for women with breast cancer. Ann Oncol. 2013, 24: 1238-1244. 10.1093/annonc/mds636.CrossRefPubMed
7.
Zurück zum Zitat Vedula S, Goldman S, Rona I, Greene T, Dickersin K: Implementation of a publication strategy in the context of reporting biases. A case study based on new documents of Neurontin litigation. Trials. 2012, 13: 136-10.1186/1745-6215-13-136.CrossRefPubMedPubMedCentral Vedula S, Goldman S, Rona I, Greene T, Dickersin K: Implementation of a publication strategy in the context of reporting biases. A case study based on new documents of Neurontin litigation. Trials. 2012, 13: 136-10.1186/1745-6215-13-136.CrossRefPubMedPubMedCentral
12.
Zurück zum Zitat Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review. BMJ. 2009, 338: b354-10.1136/bmj.b354.CrossRefPubMedPubMedCentral Jefferson T, Di Pietrantonj C, Debalini MG, Rivetti A, Demicheli V: Relation of study quality, concordance, take home message, funding, and impact in studies of influenza vaccines: systematic review. BMJ. 2009, 338: b354-10.1136/bmj.b354.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Rattinger G, Bero L: Factors Associated with Results and Conclusions of Trials of Thiazolidinediones. PLoS ONE. 2009, 4: e5826-10.1371/journal.pone.0005826.CrossRefPubMedPubMedCentral Rattinger G, Bero L: Factors Associated with Results and Conclusions of Trials of Thiazolidinediones. PLoS ONE. 2009, 4: e5826-10.1371/journal.pone.0005826.CrossRefPubMedPubMedCentral
14.
15.
Zurück zum Zitat Yank V, Rennie D, Bero LA: Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ. 2007, 335: 1202-1205. 10.1136/bmj.39376.447211.BE.CrossRefPubMedPubMedCentral Yank V, Rennie D, Bero LA: Financial ties and concordance between results and conclusions in meta-analyses: retrospective cohort study. BMJ. 2007, 335: 1202-1205. 10.1136/bmj.39376.447211.BE.CrossRefPubMedPubMedCentral
16.
Zurück zum Zitat McCulloch P: The EU’s system for regulating medical devices. BMJ. 2012, 345: e7126-10.1136/bmj.e7126.CrossRefPubMed McCulloch P: The EU’s system for regulating medical devices. BMJ. 2012, 345: e7126-10.1136/bmj.e7126.CrossRefPubMed
17.
Zurück zum Zitat Dumville JC, Petherick ES, O’Meara S, Raynor P, Cullum N: How is research evidence used to support claims made in advertisements for wound care products?. J Clin Nurs. 2009, 18: 1422-1429. 10.1111/j.1365-2702.2008.02293.x.CrossRefPubMed Dumville JC, Petherick ES, O’Meara S, Raynor P, Cullum N: How is research evidence used to support claims made in advertisements for wound care products?. J Clin Nurs. 2009, 18: 1422-1429. 10.1111/j.1365-2702.2008.02293.x.CrossRefPubMed
18.
Zurück zum Zitat Bradley M, Cullum N, Nelson EA, Petticrew M, Sheldon T, Torgerson D: Systematic reviews of wound care management: (2) dressings and topical agents used in the healing of chronic wounds. Health Technol Assess. 1999, 3: 1-35.PubMed Bradley M, Cullum N, Nelson EA, Petticrew M, Sheldon T, Torgerson D: Systematic reviews of wound care management: (2) dressings and topical agents used in the healing of chronic wounds. Health Technol Assess. 1999, 3: 1-35.PubMed
19.
Zurück zum Zitat Gottrup F, Apelqvist J, Price P, European Wound Management Association Patient Outcome Group: Outcomes in controlled and comparative studies on non-healing wounds: recommendations to improve the quality of evidence in wound management. J Wound Care. 2010, 19: 237-268.CrossRefPubMed Gottrup F, Apelqvist J, Price P, European Wound Management Association Patient Outcome Group: Outcomes in controlled and comparative studies on non-healing wounds: recommendations to improve the quality of evidence in wound management. J Wound Care. 2010, 19: 237-268.CrossRefPubMed
20.
Zurück zum Zitat The Standards of Reporting Trials Group: A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. JAMA. 1994, 272: 1926-1931. 10.1001/jama.1994.03520240054041.CrossRef The Standards of Reporting Trials Group: A proposal for structured reporting of randomized controlled trials. The Standards of Reporting Trials Group. JAMA. 1994, 272: 1926-1931. 10.1001/jama.1994.03520240054041.CrossRef
21.
Zurück zum Zitat PASW Statistics 18: Release Version 18.0.0. 2009, Chicago, IL, USA: SPSS, Inc PASW Statistics 18: Release Version 18.0.0. 2009, Chicago, IL, USA: SPSS, Inc
22.
Zurück zum Zitat Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D: The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009, 62: 387-392. 10.1016/j.jclinepi.2008.05.013.CrossRefPubMed Berwanger O, Ribeiro RA, Finkelsztejn A, Watanabe M, Suzumura EA, Duncan BB, Devereaux PJ, Cook D: The quality of reporting of trial abstracts is suboptimal: survey of major general medical journals. J Clin Epidemiol. 2009, 62: 387-392. 10.1016/j.jclinepi.2008.05.013.CrossRefPubMed
23.
Zurück zum Zitat Altwairgi AK, Booth CM, Hopman WM, Baetz TD: Discordance between conclusions stated in the abstract and conclusions in the article: analysis of published randomized controlled trials of systemic therapy in lung cancer. J Clin Oncol. 2012, 30: 3552-3557. 10.1200/JCO.2012.41.8319.CrossRefPubMed Altwairgi AK, Booth CM, Hopman WM, Baetz TD: Discordance between conclusions stated in the abstract and conclusions in the article: analysis of published randomized controlled trials of systemic therapy in lung cancer. J Clin Oncol. 2012, 30: 3552-3557. 10.1200/JCO.2012.41.8319.CrossRefPubMed
24.
Zurück zum Zitat Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomised controlled trials in journals and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomised controlled trials in journals and conference abstracts: explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral
25.
Zurück zum Zitat Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habits of internists. J Gen Intern Med. 2000, 15: 881-884. 10.1046/j.1525-1497.2000.00202.x.CrossRefPubMedPubMedCentral Saint S, Christakis DA, Saha S, Elmore JG, Welsh DE, Baker P, Koepsell TD: Journal reading habits of internists. J Gen Intern Med. 2000, 15: 881-884. 10.1046/j.1525-1497.2000.00202.x.CrossRefPubMedPubMedCentral
Metadaten
Titel
“Spin” in wound care research: the reporting and interpretation of randomized controlled trials with statistically non-significant primary outcome results or unspecified primary outcomes
verfasst von
Suzanne Lockyer
Rob Hodgson
Jo C Dumville
Nicky Cullum
Publikationsdatum
01.12.2013
Verlag
BioMed Central
Erschienen in
Trials / Ausgabe 1/2013
Elektronische ISSN: 1745-6215
DOI
https://doi.org/10.1186/1745-6215-14-371

Weitere Artikel der Ausgabe 1/2013

Trials 1/2013 Zur Ausgabe