The online version of this article (doi:10.1186/1471-2288-13-79) contains supplementary material, which is available to authorized users.
The authors declare that they have no competing interests.
RWS conceived of the study, participated in the study design and data extraction, entered the data in the Access database, participated in the analysis and interpretation of results, and drafted the manuscript. LH participated in the study design, data extraction, analysis and interpretation of results. AE participated in the study design, data extraction, and interpretation of results. JT participated in the study design and data extraction. KD participated in data extraction and interpretation of results. All authors read, edited, and approved the final manuscript.
The inclusion of randomized controlled trials (RCTs) reported in conference abstracts in systematic reviews is controversial, partly because study design information and risk of bias is often not fully reported in the abstract. The Association for Research in Vision and Ophthalmology (ARVO) requires trial registration of abstracts submitted for their annual conference as of 2007. Our goal was to assess the feasibility of obtaining study design information critical to systematic reviews, but not typically included in conference abstracts, from the trial registration record.
We reviewed all conference abstracts presented at the ARVO meetings from 2007 through 2009, and identified 496 RCTs; 154 had a single matching registration record in ClinicalTrials.gov. Two individuals independently extracted information from the abstract and the ClinicalTrials.gov record, including study design, sample size, inclusion criteria, masking, interventions, outcomes, funder, and investigator name and contact information. Discrepancies were resolved by consensus. We assessed the frequencies of reporting variables appearing in the abstract and the trial register and assessed agreement of information reported in both sources.
We found a substantial amount of study design information in the ClinicalTrials.gov record that was unavailable in the corresponding conference abstract, including eligibility criteria associated with gender (83%; 128/154); masking or blinding of study participants (53%, 82/154), persons administering treatment (30%, 46/154), and persons measuring the outcomes (40%, 61/154)); and number of study centers (58%; 90/154). Only 34% (52/154) of abstracts explicitly described a primary outcome, but a primary outcome was included in the “Primary Outcome” field in the ClinicalTrials.gov record for 82% (126/154) of studies. One or more study interventions were reported in each abstract, but agreed exactly with those reported in ClinicalTrials.gov only slightly more than half the time (88/154, 56%). We found no contact information for study investigators in the abstract, but this information was available in less than one quarter of ClinicalTrial.gov records (17%; 26/154).
RCT design information not reported in conference abstracts is often available in the corresponding ClinicalTrials.gov registration record. Sometimes there is conflicting information reported in the two sources and further contact with the trial investigators may still be required.
IOM (Institute of Medicine): Knowing What Works in Health Care: a Roadmap for the Nation. Committee on Reviewing Evidence to Identify Highly Effective Clinical Services. 2011, Washington DC: The National Academic Press
Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: 10.1002/14651858.MR000005.pub3. Art. No.: MR000005
Hopewell S, McDonald S, Clarke MJ, Egger M: Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007, 2: 10.1002/14651858.MR000010.pub3. Art. No.:MR000010
Hopewell S, Eisinga A, Clarke M: Better reporting of randomized trials in biomedical journal and conference abstracts. J Information Science. 2008, 34: 162-173. CrossRef
Dundar Y, Dodd S, Williamson P, Walley T, Dickson R: Searching for and use of conference abstracts in health technology assessments: Policy and practice. Int J Technol Assess Health Care. 2006, 22: 283-287. PubMed
Egger M, Juni P, Bartlett C, Holensteing F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7 (Issue 1): 1-76. PubMed
Association for Research in Vision and Ophthalmology Statement on Registering Clinical Trials: http://www.arvo.org/About_ARVO/Policies/Statement_on_Registering_Clinical_Trials,
Training Manual for Handsearchers, US Cochrane Center: [ http://us.cochrane.org/sites/us.cochrane.org/files/uploads/pdf/Handsearcher%20Training%20Manual.pdf]
Dwan K, Altman DG, Cresswell L, Blundell M, Gamble CL, Williamson PR: Comparison of protocols and registry entries to published reports for randomised controlled trials. Cochrane Database Syst Rev. 2011, 10.1002/14651858.MR000031.pub2. Art. No.: MR000031, Issue 1 CrossRef
Millette K, Roseman M, Thombs BD: Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosomatic Research. 2011, 70: 205-217. 10.1016/j.jpsychores.2010.09.015. CrossRef
Dundar Y, Dodd S, Williamson P, Dickson R, Walley T: Case study of the comparison of data from conference abstracts and full-text articles in health technology assessment of rapidly evolving technologies: Does it make a difference?. Int J Tech Assess Health Care. 2006, 22: 288-294.
Prasad S, Lee DJ, Yuan JC-C, Barao VAR, Shyamsundeer N, Sukotjo C: Discrepancies between abstracts presented at International Association for Dental Research annual sessions from 2004 to 2005 and full-text publications. International J Dentistry. 2012, 10.1155/2012/859561. 859561
Snedeker KG, Campbell M, Totton SC, Guthrie A, Sargeant JM: Comparison of outcomes and other variables between conference abstracts and subsequent peer-reviewed papers involving pre-harvest or abbatoir-level interventions against foodborne pathogens. Prev Vet Med. 2010, 9: 67-76. CrossRef
Weizman AV, Griesman J, Bell CM: The use of research abstracts in formulary decision making by the Joint Oncology Drug Review of Canada. Appl Health Econ Policy. 2010, 8: 387-391. 10.2165/11530510-000000000-00000. CrossRef
Cochrane Handbook of Systematic Reviews of Interventions: [ http://handbook.cochrane.org/]
Relevo R, Balshem H: Finding evidence for comparing medical interventions: AHRQ and the Effective Health Care Program. J Clin Epidem. 2011, 64: 168-1177. CrossRef
Hoehner C, Soares J, Parra DC, Ribeiro IC, Pratt M, Bracco M, Hallal PC, Bownson RC: Physical activity interventions in Latin America: What value might be added by including conference abstracts in a literature review?. J Physical Activity and Health. 2010, 7 (Suppl 2): S265-S278.
- ClinicalTrials.gov registration can supplement information in abstracts for systematic reviews: a comparison study
Roberta W Scherer
- BioMed Central
Neu im Fachgebiet AINS
Meistgelesene Bücher aus dem Fachgebiet AINS
Mail Icon II