Skip to main content
Erschienen in: Systematic Reviews 1/2013

Open Access 01.12.2013 | Commentary

Methodological developments in searching for studies for systematic reviews: past, present and future?

verfasst von: Carol Lefebvre, Julie Glanville, L Susan Wieland, Bernadette Coles, Alison L Weightman

Erschienen in: Systematic Reviews | Ausgabe 1/2013

Abstract

The Cochrane Collaboration was established in 1993, following the opening of the UK Cochrane Centre in 1992, at a time when searching for studies for inclusion in systematic reviews was not well-developed. Review authors largely conducted their own searches or depended on medical librarians, who often possessed limited awareness and experience of systematic reviews. Guidance on the conduct and reporting of searches was limited. When work began to identify reports of randomized controlled trials (RCTs) for inclusion in Cochrane Reviews in 1992, there were only approximately 20,000 reports indexed as RCTs in MEDLINE and none indexed as RCTs in Embase. No search filters had been developed with the aim of identifying all RCTs in MEDLINE or other major databases. This presented The Cochrane Collaboration with a considerable challenge in identifying relevant studies.
Over time, the number of studies indexed as RCTs in the major databases has grown considerably and the Cochrane Central Register of Controlled Trials (CENTRAL) has become the best single source of published controlled trials, with approximately 700,000 records, including records identified by the Collaboration from Embase and MEDLINE. Search filters for various study types, including systematic reviews and the Cochrane Highly Sensitive Search Strategies for RCTs, have been developed. There have been considerable advances in the evidence base for methodological aspects of information retrieval. The Cochrane Handbook for Systematic Reviews of Interventions now provides detailed guidance on the conduct and reporting of searches. Initiatives across The Cochrane Collaboration to improve the quality inter alia of information retrieval include: the recently introduced Methodological Expectations for Cochrane Intervention Reviews (MECIR) programme, which stipulates 'mandatory’ and 'highly desirable’ standards for various aspects of review conduct and reporting including searching, the development of Standard Training Materials for Cochrane Reviews and work on peer review of electronic search strategies. Almost all Cochrane Review Groups and some Cochrane Centres and Fields now have a Trials Search Co-ordinator responsible for study identification and medical librarians and other information specialists are increasingly experienced in searching for studies for systematic reviews.
Prospective registration of clinical trials is increasing and searching trials registers is now mandatory for Cochrane Reviews, where relevant. Portals such as the WHO International Clinical Trials Registry Platform (ICTRP) are likely to become increasingly attractive, given concerns about the number of trials which may not be registered and/or published. The importance of access to information from regulatory and reimbursement agencies is likely to increase. Cross-database searching, gateways or portals and improved access to full-text databases will impact on how searches are conducted and reported, as will services such as Google Scholar, Scopus and Web of Science. Technologies such as textual analysis, semantic analysis, text mining and data linkage will have a major impact on the search process but efficient and effective updating of reviews may remain a challenge.
In twenty years’ time, we envisage that the impact of universal social networking, as well as national and international legislation, will mean that all trials involving humans will be registered at inception and detailed trial results will be routinely available to all. Challenges will remain, however, to ensure the discoverability of relevant information in diverse and often complex sources and the availability of metadata to provide the most efficient access to information. We envisage an ongoing role for information professionals as experts in identifying new resources, researching efficient ways to link or mine them for relevant data and managing their content for the efficient production of systematic reviews.
Hinweise

Competing interests

CL declares that, within the past five years, she has received reimbursements from the publishers of The Cochrane Library (John Wiley and Sons) towards travel expenses to attend conferences and deliver presentations about The Cochrane Library. She has not received any fees, other funding, or salary from John Wiley and Sons. She declares that, as an independent information specialist, she derives income from consultancy and teaching in information retrieval for evidence synthesis, including some of the topics addressed in this paper. Whilst employed at the UK Cochrane Centre, she was responsible for projects that contributed a significant proportion of the records to the Cochrane Central Register of Controlled Trials (CENTRAL). JG declares that she has received funding from The Cochrane Collaboration as a member of two consortia. As part of one consortium she managed the production of an annotated bibliography of research on identifying unpublished study data and in the second consortium she is managing the production of a search filter to identify reports of RCTs in Embase. She has not received any fees, other funding, or salary from The Cochrane Collaboration or their publishers, John Wiley and Sons. She derives income from consultancy and teaching in systematic reviewing and information retrieval for evidence synthesis, including some of the topics addressed in this paper. LSW declares that, whilst she was employed at the US Cochrane Center, she co-ordinated the project for re-tagging MEDLINE records and processed Cochrane handsearch records and Specialized Register records, which constituted a significant proportion of the records included in the Cochrane Central Register of Controlled Trials (CENTRAL). BC and AW declare that they have no competing interests.

Authors’ contributions

CL was responsible for the conception and design of the paper; drafted the original outline of the paper; drafted the sections on the past and the present and revised the paper critically for important intellectual content. JG approved the original outline of the paper; drafted the sections on the future and revised the paper critically for important intellectual content. LSW approved the original outline of the paper; revised the paper critically for important intellectual content and identified relevant references. BC approved the original outline of the paper and created the EndNote Library and the Bibliography. AW approved the original outline of the paper and revised the paper critically for important intellectual content. All authors read and approved the final manuscript.
Abkürzungen
AHRQ
US Agency for Healthcare Research & Quality
AMSTAR
a measurement tool to assess systematic reviews
CENTRAL
Cochrane Central Register of Controlled Trials
CONSORT
CONsolidated Standards Of Reporting Trials
CRD
UK Centre for Reviews and Dissemination
EU
European Union
FDA
US Food and Drug Administration
ICTRP
WHO International Clinical Trials Registry Platform
MECIR
'Methodological Expectations of Cochrane Intervention Reviews
MeSH
Medical Subject Heading
NICE
UK National Institute for Health and Care Excellence
NLM
US National Library of Medicine
PICO
'Population, Intervention, Comparison, Outcome
PRESS
Peer Review of Electronic Search Strategies checklist
PRISMA
'Preferred Reporting Items for Systematic Reviews and Meta-Analyses
RCT
Randomized controlled trial
SRDR
Systematic Review Data Repository
SuRe Info
'Summarized Research in Information retrieval for health technology assessment
TSC
Trials Search Co-ordinator
WHO
World Health Organization.

The situation in 1992/1993

The Cochrane Collaboration was established in 1993, with roots in the opening of the UK Cochrane Centre in October 1992. Other than the Information Specialist employed at the UK Cochrane Centre (CL), there were no Trials Search Co-ordinators (TSCs) employed within The Cochrane Collaboration in the early 1990s. The term TSC, now generally used across The Cochrane Collaboration for the information specialists who identify relevant studies for inclusion in Cochrane Reviews, did not exist. Authors relied on their own skills and expertise in searching to identify reports of studies or on the skills of medical librarians, who often had limited awareness of systematic reviews and the specific searching approaches required. There was little training for, or awareness amongst, medical librarians regarding the role, importance and complexity of systematic reviews and little focus on searching for adverse events, economic evaluations, non-randomized designs or qualitative studies. There was very limited guidance for the authors of Cochrane Reviews or Cochrane Review Group staff with respect to the conduct or reporting of searches.
When work began at the UK Cochrane Centre in 1992 to identify reports of randomized controlled trials (RCTs) for inclusion in Cochrane Reviews, approximately 20,000 reports were indexed as RCTs in MEDLINE. Randomized Controlled Trial had only been introduced into MEDLINE as a Publication Type term in 1991 and at that time there was no indexing term at all for quasi-randomized studies. In Embase, there were no indexing terms whatsoever for RCTs or quasi-randomized studies. No filters had been designed specifically to identify all RCTs in MEDLINE or any of the other major databases (irrespective of other study characteristics). This presented a tremendous challenge for a newly-established organization such as The Cochrane Collaboration in terms of efficient identification of relevant studies [1, 2].

Information retrieval methods: celebrating the first 20 years of The Cochrane Collaboration

In December 1992, a meeting was held with Elsevier which led to the introduction of RCT as an indexing term into Embase in 1993 [3] and a commitment by Elsevier to improve the indexing of clinical trials [4]. This was followed in December 1993 by a conference hosted by the US National Library of Medicine (NLM) which led to agreement to 're-tag’ RCTs in MEDLINE (the MEDLINE re-tagging project). This project resulted in more than 125,000 reports of randomized and quasi-randomized trials, not already indexed as such in MEDLINE, being identified, re-tagged in MEDLINE and included in the Cochrane Central Register of Controlled Trials (CENTRAL).
In 1995, a new indexing term for quasi-randomized trials (Controlled Clinical Trial) was introduced into MeSH [5]. The Cochrane Central Register of Controlled Trials (CENTRAL) was launched in 1996 (under its original name of The Cochrane Controlled Trials Register), as part of the newly published Cochrane Library[6]. CENTRAL was referred to in its early days as 'likely to be the best single source of published trials for inclusion in systematic reviews and meta-analyses’ [7]. In 1996, Elsevier agreed that reports of trials identified from Embase could be included in CENTRAL (the Embase project). CENTRAL developed rapidly over the next few years [6]. The contributions of the MEDLINE re-tagging project [6, 8] and the Embase project [3] now form the basis of CENTRAL, which is the single largest source of reports of trials, with 700,000 records drawn from MEDLINE, Embase, Cochrane groups and other sources [9].
Considerable progress has been made in searching across a range of areas important to the systematic review process. Some examples include the identification of information on adverse effects of interventions [1014]; diagnostic test studies [1517]; economic evaluation [1821]; studies of prognosis [2224] and causation [2427]; non-randomized studies related to interventions [28] and qualitative studies [2933]. Progress has also been made in the identification of systematic reviews, as sources of potential studies [3437].
With respect to RCTs, filters aimed at identifying all RCTs in MEDLINE, irrespective of other study characteristics, began to be developed by members of The Cochrane Collaboration in the early 1990s [2]. They were revised using objective methods of search strategy design (textual analysis) in 2006 [38] and subsequently kept up to date in the 'Searching for Studies’ chapter of The Cochrane Handbook for Systematic Reviews of Interventions[39].
The proliferation of search filters across a range of methodological areas, and their ease of access through incorporation in services such as Ovid and PubMed, has led to the development of the InterTASC Information Specialists’ Sub-Group (ISSG) Search Filter Resource. This offers critical appraisals and summaries of search filters together with references to comparative testing data [40, 41]. Given the growing interest in identifying information beyond particular types of study, such as age groups, geographic areas and ethnic groups, the ISSG Search Filter Resource has recently been expanded to incorporate these topics. Examination of the conduct and reporting of searches for Cochrane Reviews [42, 43] has led to structured approaches to peer review of search strategies (for example, the Peer Review of Electronic Search Strategies (PRESS) checklist) [4447].
In addition to the advances in the identification of studies from bibliographic databases outlined above, methodological work has been undertaken on the value of searching the 'grey literature’ which has been defined as 'information produced and distributed at all levels by government, academics, business and industry in electronic and print formats not controlled by commercial publishing i.e. where publishing is not the primary activity of the producing body’ [48, 49]. Related research has assessed the value of handsearching for trials [5052] and examined the characteristics associated with full publication of meeting abstracts [53]. Alternative search techniques such as 'pearl-growing’/'snowballing’ from known key references and checking reference lists have also been explored [54, 55].
Keeping up-to-date in methodological advances has been facilitated by the advent and development of the Cochrane Methodology Register, published in The Cochrane Library. Updating of this resource is currently on hold pending decisions regarding its future within The Cochrane Collaboration. The recently-launched Summarized Research in Information Retrieval for Health Technology Assessment (SuRe Info) provides research-based information regarding the latest developments in the information retrieval aspects of producing systematic reviews and health technology assessments [56]. It provides critical appraisals and summaries of current methods papers and general overviews of the state of the evidence across a range of topics relevant to information retrieval for systematic reviews.
The guidance in Chapter 6 of The Cochrane Handbook for Systematic Reviews of Interventions entitled 'Searching for Studies’ started life in 1994 as an internal Cochrane document produced by Kay Dickersin and Carol Lefebvre entitled 'Establishing and Maintaining Registers of RCTs’. The document provided limited guidance with respect to the conduct and reporting of searches. This subsequently became incorporated into the Handbook and now provides detailed guidance for authors of Cochrane Reviews and Cochrane Review Group staff, including TSCs, Managing Editors, Co-ordinating Editors and Editors [39]. It is also used by other evidence synthesis organizations and provided a model for the Campbell Collaboration’s Guide to Information Retrieval for Campbell Systematic Reviews [57]. The Handbook is revised and updated in consultation with the information retrieval community of The Cochrane Collaboration, that is, the Cochrane Information Retrieval Methods Group and TSCs. Standard Training Materials have been produced and have been updated in the light of the standards recently introduced under the Cochrane Methodological Expectations of Cochrane Intervention Reviews programme (MECIR) [58].
In 2013, almost all Cochrane Review Groups and some Cochrane Centres and Fields have a dedicated TSC – usually a qualified librarian/information specialist with experience of searching the medical literature. These TSCs carry out a vital role in study identification within their respective groups, although the nature of their contributions varies considerably according to resources and other factors. There is also far greater awareness amongst medical librarians and other information specialists regarding the role of systematic reviews and how to search for studies for inclusion in systematic reviews.

Focus on the future: the next five to ten years

Information and data sources

Prospective registration of clinical trials, already encouraged by initiatives including that of the International Committee of Medical Journal Editors (ICMJE) [59], should increase as a result of pressure from a range of consumer, legal and professional sources [60, 61]. The use of data from trials registers within Cochrane Reviews will grow as a result of MECIR, which requires that trials registers and repositories of results, where relevant to the topic, be searched through ClinicalTrials.gov, the ICTRP and other sources as appropriate [58].
The challenges around identifying data from unpublished studies will be better understood and become more quantifiable as a result of research in this area, such as the project on searching for unpublished trials funded in 2011 by the Cochrane Methods Infrastructure Funding initiative [62]. Despite the introduction of new registers such as the EU Clinical Trials Register, the single portal approach offered by the ICTRP is likely to become increasingly attractive as a means to search across a range of registers from one site [63]. There is already concern about the number of trials which may not be registered and/or published and which prove difficult to retrieve, as in the case of Tamiflu [64, 65]. Identifying unpublished data or trial reports may well focus on increased efforts to utilize sources such as regulatory agency data (for example, the European Medicines Agency, the US Food and Drug Administration (FDA)) and reports from agencies such as the National Institute for Health and Care Excellence (NICE) in the UK. There is also likely to be increased pressure for access to clinical study reports produced by manufacturers despite resistance from certain manufacturers [66, 67]. Obtaining data from clinical study reports will have a considerable impact on the production of systematic reviews due to the extensive nature of the documents and lack of standardization across manufacturers [68]. The Cochrane Register of Studies is an internal data repository and data management tool within The Cochrane Collaboration. It will be further developed and integrated with CENTRAL, to serve as a 'meta-register’ or repository for Specialized Registers (registers of studies and/or reports of studies relevant to a specific Cochrane group) and all other trial records submitted by Cochrane groups. This integration will introduce time efficiencies in identifying which reports are associated with which studies.
Increasingly, search interfaces (as can be seen currently with Ovid and Web of Knowledge) will offer cross-database searching options. These have the potential to improve the efficiency of database searching by reducing redundancy associated with searching multiple databases separately (and the need for de-duplication). Reassurances will be required, however, that searches are being conducted and interpreted correctly in the individual databases, that is, that the results retrieved by a cross-database search are equivalent to the results of searching the databases individually. The availability of full-text databases of journal articles and other documents will also create new opportunities to access larger quantities of text for searching than has been the case previously. The increasing availability of gateways, or portals, such as Science.gov, which offers access to science information and research results from a number of US federal agencies, albeit via a relatively unsophisticated search interface, will enable wider searching of the grey literature [69]. Options for incorporating citation searching within reviews are increasing through resources such as Scopus and Web of Science and are freely accessible via Google Scholar. The ability to download records from the latter increases its attractiveness as a tool for systematic reviewers, despite the current lack of sophistication in the search interface.

Search strategies and techniques

Following search approaches used within public health, such as for NICE guidance [70] and diagnostic test accuracy reviews [71], we may see more use of multi-faceted search techniques using several combinations of concepts to capture a review topic, rather than single PICO-style (Population, Intervention, Comparison, Outcome) search strategies or variants of PICO, particularly with more complex review questions. Search strategies may increasingly be developed using textual analysis techniques for individual subject search strategies [72]. These approaches will use freely accessible off-the-shelf software such as PubMed PubReMiner or commercially available statistical software packages such as SimStat/WordStat to identify highly-discriminating search terms from pre-defined sets of relevant records.
Use of semantic analysis or text mining software will increase, in the place of, or as an adjunct to, Boolean searching and/or textual analysis, and also in the context of the design of methodological search filters [73]. This will mean that searches will be conducted based on the meaning of words and concepts within a set of records, rather than simply the presence of these terms or concepts. Semantic analysis will help with complex review questions or 'hard to capture’ topics, such as those addressed in public health. The semantic analysis approach may be used to interrogate large result sets to retrieve records likely to be relevant to a query in decreasing order of probability of relevance [74]. This may involve two-step searching approaches (gathering search results using very sensitive Boolean searches then interrogating those results using semantic analysis software) or semantic analysis may be built into internet search portals. With growing use of data linkage it will become increasingly possible to mine the internet from key references to find related and citing works. The challenge currently, however, is in searching ever richer resources with interfaces which are far from sophisticated and which do not facilitate complex searches or offer search facilities, such as saving searches or downloading records.
These developments will present challenges for the peer review of the search process including search strategies and the current Cochrane pilot study on peer review may require rapid evolution. The impact of the increasingly diverse options for trial discovery via data linkage and the growth in portals will have considerable impact on reporting the search process with respect to transparency and reproducibility. Documentation will become increasingly crucial as the internet becomes ever more organic. The requirement to demonstrate search effectiveness will continue but may become more complex to achieve. Reference management software will become standard, especially for de-duplication of multiple database searches and massive result sets arising from text mining approaches, but may become merged with semantic analysis software.
Self-audit of the search process and search strategies will become more common as awareness of, and familiarity with, techniques such as capture-recapture (that is, estimating the number of relevant records by conducting two sample searches and comparing the number of relevant records identified in the first search that were then also identified by the second search) [75, 76] and relative recall [77] grows. Self-audit will also be influenced by an increase in more formal audit approaches undertaken by the commissioners or funders of reviews. Techniques such as relative recall will be used to make judgements about which databases need to be searched and how comprehensive the search strategies need to be for each database, to help address the perennial question of 'when is enough enough’ [7880]. Concerns over the generalizability and reliability of these approaches, however, are likely to remain.

Updating reviews and evolution of information retrieval methods

The challenges associated with updating reviews may be mitigated to some extent by techniques such as searches based on previously 'included’ studies (for example, citation searches of the 'largest’/'newest’ studies [81]) and 'horizon-scanning’ for 'trials that would make a difference’ [82]. Increased data linkage may make the updating process more streamlined and current. The further development of trials registers and increased pressure for trial registration should also make it easier to identify 'important’ trials as they reach completion.
Information retrieval methods for Cochrane Reviews will continue to benefit from research conducted outside of The Cochrane Collaboration by organizations involved in systematic reviews, meta-analyses, health technology assessment and other evidence syntheses and will be informed by processes and standards produced by other organizations such as the Agency for Healthcare Research and Quality (AHRQ) [83], the Centre for Reviews and Dissemination [84], the US Institute of Medicine [85] and the National Institute for Health and Care Excellence (NICE) [70] as well as by initiatives for assessing methodological quality or standardizing reporting such as AMSTAR (A Measurement Tool to Assess Systematic Reviews) [86, 87], PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses [88, 89] and CONSORT (Consolidated Standards of Reporting Trials) [90, 91]. In turn, the major revision of The Cochrane Handbook for Systematic Reviews of Interventions, scheduled for publication in 2014, has the potential to continue to have considerable influence both within and beyond The Cochrane Collaboration. In future, emerging technologies will enable the information in the Handbook to be presented and utilized in more imaginative and accessible ways.
The quality of information retrieval aspects of Cochrane Reviews will be enhanced by further implementation, expansion and revision of the MECIR standards [58], in the light of feedback based on early implementation, audit results, the initiation of standards for review protocols and updates and other quality improvement measures. As a result of MECIR standards and other guidance, such as that developed by the US Institute of Medicine [85], multidisciplinary working involving a librarian or other information specialist trained in performing systematic reviews to plan the search process and the search strategies is likely to become more prevalent, along with the use of an independent librarian or other information specialist for peer review of the study identification elements of reviews.
This greater involvement is being supported by the increased training which is available for librarians and information specialists in a wide range of aspects of information retrieval in the context of evidence synthesis.

Focus on the future: 2033 and beyond

In making any assessments as to the possible situation in twenty years’ time, we should be mindful of the words attributed to Niels Bohr, the Danish physicist (1885–1962): 'Prediction is very difficult, especially about the future’ [92]. In twenty years’ time, we envisage that universal social networking (or its successors) as well as national and international legislation will mean that all trials involving humans will be registered at inception. In addition, details of ongoing and completed trials will be accessible to all, irrespective of whether or not they have been published in the scientific literature, in a manner suitable for synthesis in systematic reviews and for other purposes. Registration of trials will become universal, in part, because information about trials will be broadcast by active trial participants who will publicize their experiences. Some compromise between commercial interests and public interests will have been reached so that far more detailed trial results will be available than we see at present, perhaps held in a common format in a single international clinical trials results register. This would build on the progress already made in creating and developing ClinicalTrials.gov [93] and the ICTRP [94]. The ClinicalTrials.gov dataset is already being used by The Cochrane Collaboration in the Cochrane Register of Studies and systems are being developed to add value to ClinicalTrials.gov, such as by downloading study results into a spreadsheet format ready for analysis [95]. All data from clinical trials required for systematic reviews and meta-analyses will be available in a single international clinical trials data repository, building on the progress already made in creating and developing the Systematic Review Data Repository (SRDR) [96]. Challenges will remain, however, in ensuring the discoverability of relevant information in these diverse and often complex sources and in developing the metadata needed to provide the most efficient access to information to answer specific questions reliably.

Conclusions

Considerable progress has been made in the field of information retrieval within the context of systematic reviews over the last twenty years, as outlined above. There will, however, be many challenges as well as opportunities in the years ahead. We envisage that, in twenty years’ time, there will still be a role for experts in identifying new resources, researching efficient ways to link or mine them for relevant data and managing their content for the efficient production of systematic reviews. Whether these experts will be referred to as Trials Search Co-ordinators, Information Specialists or something else entirely in 2033, remains to be seen.

Authors’ information

CL is an independent information specialist. She was a founding member of the UK Cochrane Centre (UKCC), where she was employed as the Senior Information Specialist from its inception, in 1992, until June 2012. She has an MSc in Library and Information Studies. She is a founding Co-Convenor of the Cochrane Information Retrieval Methods Group and a member of the Cochrane Methods Executive. She was a member of the Trials Search Co-ordinators Executive until 2012. JG is an Associate Director of York Health Economics Consortium at the University of York, York, UK. She has worked on systematic reviews since 1993 when she was one of the founding members of the Centre for Reviews and Dissemination, the sister organization to the UK Cochrane Centre. She has a Postgraduate Diploma in Librarianship and Information Studies and an MSc in Information Processing. She is a Co-Convenor of the Cochrane Information Retrieval Methods Group, has previously chaired the Cochrane Library Users’ Group and has provided extensive training in the use of The Cochrane Library over many years. She is a co-author of Cochrane Reviews and a peer reviewer for Cochrane Diagnostic Test Accuracy reviews. LSW is a Research Associate at the Center for Evidence-Based Medicine, Brown University, RI, US. She has a PhD in Epidemiology. She worked at the New England Cochrane Center, Providence Office in 2001–2002 and the US Cochrane Center from 2003–2005. She is the TSC for the Cochrane Complementary Medicine Field. BC has worked for Cardiff University since 1987 and is Site Librarian at the Cancer Research Wales Library in Cardiff, UK. She has an MSc in Health Information Management and became involved in systematic reviewing when the Cochrane Prostatic Diseases and Urological Cancers Group was established in 1998. She has recently been appointed as an Assistant TSC for this Group. She has been the Co-ordinator of the Cochrane Information Retrieval Methods Group since 2006. She is a co-author of 10 Cochrane Reviews and teaches a wide variety of courses for National Health Service staff in the UK. AW is the Associate Director for Research & Academic Engagement, Information Services and Director of the Support Unit for Research Evidence (SURE) at Cardiff University, UK. She has a Postgraduate Diploma in Librarianship, an MA in Library and Information Science and a PhD in Microbiology. She is a Co-Convenor of the Cochrane Information Retrieval Methods Group and a Cochrane Review author. She has more than 15 years' experience as a systematic reviewer and a particular interest and expertise in reviewing and developing systematic review techniques for complex public health topics.

Acknowledgements

With respect to CENTRAL, we are grateful to: Update Software, the original designers, developers and publishers of CENTRAL; John Wiley and Sons, the current publishers of CENTRAL; staff, past and present, at the UK Cochrane Centre and the US Cochrane Center who contributed records to CENTRAL through the MEDLINE re-tagging project; staff, past and present, at the UK Cochrane Centre who contributed records to CENTRAL through the Embase project; all TSCs and others who have submitted records for publication in CENTRAL; staff, past and present, at the US Cochrane Center for processing handsearch records and Specialized Register records for publication in CENTRAL; handsearchers for reading the records to identify reports of trials; all those who contributed in other ways to the building and development of CENTRAL; the funders of the organizations involved in this work; staff, past and present, of the US National Library of Medicine and Elsevier who collaborated with us with respect to the inclusion of MEDLINE and Embase records, respectively, in CENTRAL. We should like to acknowledge members of the Cochrane Information Retrieval Methods Group and others for the various achievements described in this paper. We should also like to thank Ruth Foxlee (TSC, Cochrane Wounds Group and Information Specialist, Cochrane Editorial Unit) and Becky Skidmore (Medical Research Analyst, the Society of Obstetricians and Gynaecologists of Canada) as peer reviewers of this manuscript and Mike Clarke (All Ireland Hub for Trials Methodology Research, Queen’s University Belfast, Northern Ireland) as Guest Editor for their helpful comments and suggestions regarding this manuscript.
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Competing interests

CL declares that, within the past five years, she has received reimbursements from the publishers of The Cochrane Library (John Wiley and Sons) towards travel expenses to attend conferences and deliver presentations about The Cochrane Library. She has not received any fees, other funding, or salary from John Wiley and Sons. She declares that, as an independent information specialist, she derives income from consultancy and teaching in information retrieval for evidence synthesis, including some of the topics addressed in this paper. Whilst employed at the UK Cochrane Centre, she was responsible for projects that contributed a significant proportion of the records to the Cochrane Central Register of Controlled Trials (CENTRAL). JG declares that she has received funding from The Cochrane Collaboration as a member of two consortia. As part of one consortium she managed the production of an annotated bibliography of research on identifying unpublished study data and in the second consortium she is managing the production of a search filter to identify reports of RCTs in Embase. She has not received any fees, other funding, or salary from The Cochrane Collaboration or their publishers, John Wiley and Sons. She derives income from consultancy and teaching in systematic reviewing and information retrieval for evidence synthesis, including some of the topics addressed in this paper. LSW declares that, whilst she was employed at the US Cochrane Center, she co-ordinated the project for re-tagging MEDLINE records and processed Cochrane handsearch records and Specialized Register records, which constituted a significant proportion of the records included in the Cochrane Central Register of Controlled Trials (CENTRAL). BC and AW declare that they have no competing interests.

Authors’ contributions

CL was responsible for the conception and design of the paper; drafted the original outline of the paper; drafted the sections on the past and the present and revised the paper critically for important intellectual content. JG approved the original outline of the paper; drafted the sections on the future and revised the paper critically for important intellectual content. LSW approved the original outline of the paper; revised the paper critically for important intellectual content and identified relevant references. BC approved the original outline of the paper and created the EndNote Library and the Bibliography. AW approved the original outline of the paper and revised the paper critically for important intellectual content. All authors read and approved the final manuscript.
Literatur
1.
Zurück zum Zitat Wilczynski NL, Walker CJ, McKibbon KA, Haynes RB: Assessment of methodologic search filters in MEDLINE. Proc Annu Symp Comput Appl Med Care. 1993, 601-605. Wilczynski NL, Walker CJ, McKibbon KA, Haynes RB: Assessment of methodologic search filters in MEDLINE. Proc Annu Symp Comput Appl Med Care. 1993, 601-605.
3.
Zurück zum Zitat Lefebvre C, Eisinga A, McDonald S, Paul N: Enhancing access to reports of randomized trials published world-wide – the contribution of EMBASE records to the Cochrane central register of controlled trials (CENTRAL) in The Cochrane Library. Emerg Themes Epidemiol. 2008, 5: 13-CrossRefPubMedPubMedCentral Lefebvre C, Eisinga A, McDonald S, Paul N: Enhancing access to reports of randomized trials published world-wide – the contribution of EMBASE records to the Cochrane central register of controlled trials (CENTRAL) in The Cochrane Library. Emerg Themes Epidemiol. 2008, 5: 13-CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat PROFILE: Excerpta Medica Newsl. 1994, 11: 2- PROFILE: Excerpta Medica Newsl. 1994, 11: 2-
5.
Zurück zum Zitat Lefebvre C: Identification of randomized controlled trials using MEDLINE: the situation in 1993. An Evidence-based Health Care System: the Case for Clinical Trials Registries. Edited by: Armstrong C. 1994, Bethesda: National Insitutes of Health, Office of Medical Applications of Research, 23-28. Lefebvre C: Identification of randomized controlled trials using MEDLINE: the situation in 1993. An Evidence-based Health Care System: the Case for Clinical Trials Registries. Edited by: Armstrong C. 1994, Bethesda: National Insitutes of Health, Office of Medical Applications of Research, 23-28.
6.
Zurück zum Zitat Dickersin K, Manheimer E, Wieland S, Robinson KA, Lefebvre C, McDonald S: Development of The Cochrane Collaboration’s CENTRAL register of controlled clinical trials. Eval Health Prof. 2002, 25: 38-64.CrossRefPubMed Dickersin K, Manheimer E, Wieland S, Robinson KA, Lefebvre C, McDonald S: Development of The Cochrane Collaboration’s CENTRAL register of controlled clinical trials. Eval Health Prof. 2002, 25: 38-64.CrossRefPubMed
8.
Zurück zum Zitat Wieland LS, Robinson KA, Dickersin K: Understanding why evidence from randomised clinical trials may not be retrieved from Medline: comparison of indexed and non-indexed records. BMJ. 2012, 344: d7501-doi: 10.1136/bmj.d7501CrossRefPubMed Wieland LS, Robinson KA, Dickersin K: Understanding why evidence from randomised clinical trials may not be retrieved from Medline: comparison of indexed and non-indexed records. BMJ. 2012, 344: d7501-doi: 10.1136/bmj.d7501CrossRefPubMed
10.
Zurück zum Zitat Golder S, Loke Y: The performance of adverse effects search filters in MEDLINE and EMBASE. Health Info Libr J. 2012, 29: 141-151.CrossRefPubMed Golder S, Loke Y: The performance of adverse effects search filters in MEDLINE and EMBASE. Health Info Libr J. 2012, 29: 141-151.CrossRefPubMed
11.
Zurück zum Zitat Golder S, Loke Y: The contribution of different information sources for adverse effects data. Int J Technol Assess Health Care. 2012, 28: 133-137.CrossRefPubMed Golder S, Loke Y: The contribution of different information sources for adverse effects data. Int J Technol Assess Health Care. 2012, 28: 133-137.CrossRefPubMed
12.
13.
Zurück zum Zitat Golder S, Loke Y, Zorzela L: Some improvements are apparent in identifying adverse effects in systematic reviews from 1994 to 2011. Clin Epidemiol. 2013, 66: 253-260.CrossRef Golder S, Loke Y, Zorzela L: Some improvements are apparent in identifying adverse effects in systematic reviews from 1994 to 2011. Clin Epidemiol. 2013, 66: 253-260.CrossRef
14.
Zurück zum Zitat Golder S, Loke Y, McIntosh HM: Poor reporting and inadequate searches were apparent in systematic reviews of adverse effects. J Clin Epidemiol. 2008, 61: 440-448.CrossRefPubMed Golder S, Loke Y, McIntosh HM: Poor reporting and inadequate searches were apparent in systematic reviews of adverse effects. J Clin Epidemiol. 2008, 61: 440-448.CrossRefPubMed
15.
Zurück zum Zitat Beynon R, Leeflang MM, McDonald S, Eisinga A, Mitchell RL, Whiting P, Glanville JM: Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst Rev. 2013, 9: MR000022-PubMed Beynon R, Leeflang MM, McDonald S, Eisinga A, Mitchell RL, Whiting P, Glanville JM: Search strategies to identify diagnostic accuracy studies in MEDLINE and EMBASE. Cochrane Database Syst Rev. 2013, 9: MR000022-PubMed
16.
Zurück zum Zitat Bachmann LM, Estermann P, Kronenberg C, Ter Riet G: Identifying diagnostic accuracy studies in EMBASE. J Med Libr Assoc. 2003, 91: 341-346.PubMedPubMedCentral Bachmann LM, Estermann P, Kronenberg C, Ter Riet G: Identifying diagnostic accuracy studies in EMBASE. J Med Libr Assoc. 2003, 91: 341-346.PubMedPubMedCentral
17.
Zurück zum Zitat Ritchie G, Glanville J, Lefebvre C: Do published search filters to identify diagnostic test accuracy studies perform adequately?. Health Info Libr J. 2007, 24: 188-192.CrossRefPubMed Ritchie G, Glanville J, Lefebvre C: Do published search filters to identify diagnostic test accuracy studies perform adequately?. Health Info Libr J. 2007, 24: 188-192.CrossRefPubMed
18.
Zurück zum Zitat Glanville J, Wilson P, Richardson R: Accessing the online evidence: a guide to key sources of research information on clinical and cost effectiveness. Qual Saf Health Care. 2003, 12: 229-231.CrossRefPubMedPubMedCentral Glanville J, Wilson P, Richardson R: Accessing the online evidence: a guide to key sources of research information on clinical and cost effectiveness. Qual Saf Health Care. 2003, 12: 229-231.CrossRefPubMedPubMedCentral
19.
Zurück zum Zitat Glanville J, Kaunelis D, Mensinkai S: How well do search filters perform in identifying economic evaluations in MEDLINE and EMBASE?. Int J Technol Assess Health Care. 2009, 25: 522-529.CrossRefPubMed Glanville J, Kaunelis D, Mensinkai S: How well do search filters perform in identifying economic evaluations in MEDLINE and EMBASE?. Int J Technol Assess Health Care. 2009, 25: 522-529.CrossRefPubMed
20.
Zurück zum Zitat Glanville J, Paisley S: Identifying economic evaluations for health technology assessment. Int J Technol Assess Health Care. 2010, 26: 436-440.CrossRefPubMed Glanville J, Paisley S: Identifying economic evaluations for health technology assessment. Int J Technol Assess Health Care. 2010, 26: 436-440.CrossRefPubMed
21.
Zurück zum Zitat McKinlay RJ, Wilczynski NL, Haynes RB: Optimal search strategies for detecting cost and economic studies in EMBASE. BMC Health Serv Res. 2006, 6: 67-CrossRefPubMedPubMedCentral McKinlay RJ, Wilczynski NL, Haynes RB: Optimal search strategies for detecting cost and economic studies in EMBASE. BMC Health Serv Res. 2006, 6: 67-CrossRefPubMedPubMedCentral
22.
Zurück zum Zitat Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically sound prognostic studies in MEDLINE: an analytic survey. BMC Med. 2004, 2: 23-CrossRefPubMedPubMedCentral Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically sound prognostic studies in MEDLINE: an analytic survey. BMC Med. 2004, 2: 23-CrossRefPubMedPubMedCentral
23.
Zurück zum Zitat Wilczynski NL, Haynes RB: Optimal search strategies for detecting clinically sound prognostic studies in EMBASE: an analytic survey. J Am Med Inform Assoc. 2005, 12: 481-485.CrossRefPubMedPubMedCentral Wilczynski NL, Haynes RB: Optimal search strategies for detecting clinically sound prognostic studies in EMBASE: an analytic survey. J Am Med Inform Assoc. 2005, 12: 481-485.CrossRefPubMedPubMedCentral
24.
Zurück zum Zitat Walker-Dilks C, Wilczynski NL, Haynes RB: Cumulative index to nursing and allied health literature search strategies for identifying methodologically sound causation and prognosis studies. Appl Nurs Res. 2008, 21: 98-103.CrossRefPubMed Walker-Dilks C, Wilczynski NL, Haynes RB: Cumulative index to nursing and allied health literature search strategies for identifying methodologically sound causation and prognosis studies. Appl Nurs Res. 2008, 21: 98-103.CrossRefPubMed
25.
Zurück zum Zitat Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically sound causation studies in MEDLINE. AMIA Annu Symp Proc. 2003, 719-723. Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically sound causation studies in MEDLINE. AMIA Annu Symp Proc. 2003, 719-723.
26.
Zurück zum Zitat Haynes RB, Kastner M, Wilczynski NL: Developing optimal search strategies for detecting clinically sound and relevant causation studies in EMBASE. BMC Med Inform Decis Mak. 2005, 5: 8-CrossRefPubMedPubMedCentral Haynes RB, Kastner M, Wilczynski NL: Developing optimal search strategies for detecting clinically sound and relevant causation studies in EMBASE. BMC Med Inform Decis Mak. 2005, 5: 8-CrossRefPubMedPubMedCentral
27.
Zurück zum Zitat Wieland S, Dickersin K: Selective exposure reporting and Medline indexing limited the search sensitivity for observational studies of the adverse effects of oral contraceptives. J Clin Epidemiol. 2005, 58: 560-567.CrossRefPubMed Wieland S, Dickersin K: Selective exposure reporting and Medline indexing limited the search sensitivity for observational studies of the adverse effects of oral contraceptives. J Clin Epidemiol. 2005, 58: 560-567.CrossRefPubMed
28.
Zurück zum Zitat Fraser C, Murray A, Burr J: Identifying observational studies of surgical interventions in MEDLINE and EMBASE. BMC Med Res Methodol. 2006, 6: 41-CrossRefPubMedPubMedCentral Fraser C, Murray A, Burr J: Identifying observational studies of surgical interventions in MEDLINE and EMBASE. BMC Med Res Methodol. 2006, 6: 41-CrossRefPubMedPubMedCentral
29.
Zurück zum Zitat Grant MJ: How does your searching grow? A survey of search preferences and the use of optimal search strategies in the identification of qualitative research. Health Info Libr J. 2004, 21: 21-32.CrossRefPubMed Grant MJ: How does your searching grow? A survey of search preferences and the use of optimal search strategies in the identification of qualitative research. Health Info Libr J. 2004, 21: 21-32.CrossRefPubMed
30.
Zurück zum Zitat Wong SS, Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE. Stud Health Technol Inform. 2004, 107: 311-316.PubMed Wong SS, Wilczynski NL, Haynes RB: Developing optimal search strategies for detecting clinically relevant qualitative studies in MEDLINE. Stud Health Technol Inform. 2004, 107: 311-316.PubMed
31.
Zurück zum Zitat McKibbon KA, Wilczynski NL, Haynes RB: Developing optimal search strategies for retrieving qualitative studies in PsycINFO. Eval Health Prof. 2006, 29: 440-454.CrossRefPubMed McKibbon KA, Wilczynski NL, Haynes RB: Developing optimal search strategies for retrieving qualitative studies in PsycINFO. Eval Health Prof. 2006, 29: 440-454.CrossRefPubMed
32.
Zurück zum Zitat Walters LA, Wilczynski NL, Haynes RB: Developing optimal search strategies for retrieving clinically relevant qualitative studies in EMBASE. Qual Health Res. 2006, 16: 162-168.CrossRefPubMed Walters LA, Wilczynski NL, Haynes RB: Developing optimal search strategies for retrieving clinically relevant qualitative studies in EMBASE. Qual Health Res. 2006, 16: 162-168.CrossRefPubMed
33.
Zurück zum Zitat Flemming K, Briggs M: Electronic searching to locate qualitative research: evaluation of three strategies. J Adv Nurs. 2007, 57: 95-100.CrossRefPubMed Flemming K, Briggs M: Electronic searching to locate qualitative research: evaluation of three strategies. J Adv Nurs. 2007, 57: 95-100.CrossRefPubMed
34.
Zurück zum Zitat Boynton J, Glanville J, McDaid D, Lefebvre C: Identifying systematic reviews in MEDLINE: developing an objective approach to search strategy design. J Info Sci. 1998, 24: 137-157.CrossRef Boynton J, Glanville J, McDaid D, Lefebvre C: Identifying systematic reviews in MEDLINE: developing an objective approach to search strategy design. J Info Sci. 1998, 24: 137-157.CrossRef
35.
Zurück zum Zitat White V, Glanville J, Lefebvre C, Sheldon T: A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy. J Info Sci. 2001, 27: 357-370.CrossRef White V, Glanville J, Lefebvre C, Sheldon T: A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy. J Info Sci. 2001, 27: 357-370.CrossRef
36.
Zurück zum Zitat Wong SS, Wilczynski NL, Haynes RB: Comparison of top-performing search strategies for detecting clinically sound treatment studies and systematic reviews in MEDLINE and EMBASE. J Med Libr Assoc. 2006, 94: 451-455.PubMedPubMedCentral Wong SS, Wilczynski NL, Haynes RB: Comparison of top-performing search strategies for detecting clinically sound treatment studies and systematic reviews in MEDLINE and EMBASE. J Med Libr Assoc. 2006, 94: 451-455.PubMedPubMedCentral
37.
Zurück zum Zitat Wilczynski NL, Haynes RB: EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. J Clin Epidemiol. 2007, 60: 29-33.CrossRefPubMed Wilczynski NL, Haynes RB: EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. J Clin Epidemiol. 2007, 60: 29-33.CrossRefPubMed
38.
Zurück zum Zitat Glanville JM, Lefebvre C, Miles JN, Camosso-Stefinovic J: How to identify randomized controlled trials in MEDLINE: ten years on. J Med Libr Assoc. 2006, 94: 130-136.PubMedPubMedCentral Glanville JM, Lefebvre C, Miles JN, Camosso-Stefinovic J: How to identify randomized controlled trials in MEDLINE: ten years on. J Med Libr Assoc. 2006, 94: 130-136.PubMedPubMedCentral
39.
Zurück zum Zitat Lefebvre C, Manheimer E, Glanville J: Chapter 6: searching for studies. In Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0. Edited by Higgins JPT, Green S. The Cochrane Collaboration; 2011http://www.handbook.cochrane.org Lefebvre C, Manheimer E, Glanville J: Chapter 6: searching for studies. In Cochrane Handbook for Systematic Reviews of Interventions. Version 5.1.0. Edited by Higgins JPT, Green S. The Cochrane Collaboration; 2011http://​www.​handbook.​cochrane.​org
40.
Zurück zum Zitat Glanville J, Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, Foster L, Fraser C, Fry-Smith A, Golder S, Lefebvre C, Miller C, Paisley S, Payne L, Price A, Welch K: So many filters, so little time: the development of a search filter appraisal checklist. J Med Libr Assoc. 2008, 96: 356-361.CrossRefPubMedPubMedCentral Glanville J, Bayliss S, Booth A, Dundar Y, Fernandes H, Fleeman ND, Foster L, Fraser C, Fry-Smith A, Golder S, Lefebvre C, Miller C, Paisley S, Payne L, Price A, Welch K: So many filters, so little time: the development of a search filter appraisal checklist. J Med Libr Assoc. 2008, 96: 356-361.CrossRefPubMedPubMedCentral
42.
Zurück zum Zitat Sampson M, McGowan J, Tetzlaff J, Cogo E, Moher D: No consensus exists on search reporting methods for systematic reviews. J Clin Epidemiol. 2008, 61: 748-754.CrossRefPubMed Sampson M, McGowan J, Tetzlaff J, Cogo E, Moher D: No consensus exists on search reporting methods for systematic reviews. J Clin Epidemiol. 2008, 61: 748-754.CrossRefPubMed
43.
Zurück zum Zitat Yoshii A, Plaut DA, McGraw KA, Anderson MJ, Wellik KE: Analysis of the reporting of search strategies in Cochrane systematic reviews. J Med Libr Assoc. 2009, 97: 21-29.CrossRefPubMedPubMedCentral Yoshii A, Plaut DA, McGraw KA, Anderson MJ, Wellik KE: Analysis of the reporting of search strategies in Cochrane systematic reviews. J Med Libr Assoc. 2009, 97: 21-29.CrossRefPubMedPubMedCentral
45.
Zurück zum Zitat Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62: 944-952.CrossRefPubMed Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C: An evidence-based practice guideline for the peer review of electronic search strategies. J Clin Epidemiol. 2009, 62: 944-952.CrossRefPubMed
49.
Zurück zum Zitat Hopewell S, McDonald S, Clarke M, Egger M: Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007, 2: MR000010-PubMed Hopewell S, McDonald S, Clarke M, Egger M: Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007, 2: MR000010-PubMed
50.
Zurück zum Zitat Hopewell S, Clarke M, Lefebvre C, Scherer R: Handsearching versus electronic searching to identify reports of randomized trials. Cochrane Database Syst Rev. 2007, 2: MR000001-PubMed Hopewell S, Clarke M, Lefebvre C, Scherer R: Handsearching versus electronic searching to identify reports of randomized trials. Cochrane Database Syst Rev. 2007, 2: MR000001-PubMed
51.
Zurück zum Zitat Hopewell S, Clarke M, Lusher A, Lefebvre C, Westby M: A comparison of handsearching versus MEDLINE searching to identify reports of randomized controlled trials. Stat Med. 2002, 21: 1625-1634.CrossRefPubMed Hopewell S, Clarke M, Lusher A, Lefebvre C, Westby M: A comparison of handsearching versus MEDLINE searching to identify reports of randomized controlled trials. Stat Med. 2002, 21: 1625-1634.CrossRefPubMed
52.
Zurück zum Zitat McDonald S, Lefebvre C, Antes G, Galandi D, Gotzsche P, Hammarquist C, Haugh M, Jensen KL, Kleijnen J, Loep M, Pistotti V, Rüther A: The contribution of handsearching European general health care journals to the Cochrane Controlled Trials Register. Eval Health Prof. 2002, 25: 65-75.CrossRefPubMed McDonald S, Lefebvre C, Antes G, Galandi D, Gotzsche P, Hammarquist C, Haugh M, Jensen KL, Kleijnen J, Loep M, Pistotti V, Rüther A: The contribution of handsearching European general health care journals to the Cochrane Controlled Trials Register. Eval Health Prof. 2002, 25: 65-75.CrossRefPubMed
53.
Zurück zum Zitat Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: MR000005-PubMed Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: MR000005-PubMed
54.
Zurück zum Zitat Horsley T, Dingwall O, Sampson M: Checking reference lists to find additional studies for systematic reviews. Cochrane Database Syst Rev. 2011, 8: MR000026-PubMed Horsley T, Dingwall O, Sampson M: Checking reference lists to find additional studies for systematic reviews. Cochrane Database Syst Rev. 2011, 8: MR000026-PubMed
55.
Zurück zum Zitat Schlosser RW, Wendt O, Bhavnani S, Nail-Chiwetalu B: Use of information-seeking strategies for developing systematic reviews and engaging in evidence-based practice: the application of traditional and comprehensive pearl growing. A review. Int J Lang Commun Disord. 2006, 41: 567-582.CrossRefPubMed Schlosser RW, Wendt O, Bhavnani S, Nail-Chiwetalu B: Use of information-seeking strategies for developing systematic reviews and engaging in evidence-based practice: the application of traditional and comprehensive pearl growing. A review. Int J Lang Commun Disord. 2006, 41: 567-582.CrossRefPubMed
56.
Zurück zum Zitat Ormstad SS, Isojarvi J: Keeping up to date with information retrieval research: summarized research in information retrieval (SuRe info). Journal of EAHIL. 2013, 9: 17-19. Ormstad SS, Isojarvi J: Keeping up to date with information retrieval research: summarized research in information retrieval (SuRe info). Journal of EAHIL. 2013, 9: 17-19.
59.
Zurück zum Zitat DeAngelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB, International Committee of Medical Journal Editors: Clinical trial registration: a statement from the international committee of medical journal editors. JAMA. 2004, 292: 1363-1364.CrossRefPubMed DeAngelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB, International Committee of Medical Journal Editors: Clinical trial registration: a statement from the international committee of medical journal editors. JAMA. 2004, 292: 1363-1364.CrossRefPubMed
63.
Zurück zum Zitat Ghersi D, Pang T: From Mexico to Mali: four years in the history of clinical trial registration. J Evid Based Med. 2009, 2: 1-7.CrossRefPubMed Ghersi D, Pang T: From Mexico to Mali: four years in the history of clinical trial registration. J Evid Based Med. 2009, 2: 1-7.CrossRefPubMed
64.
Zurück zum Zitat Doshi P, Jefferson T, Del Mar C: The imperative to share clinical study reports: recommendations from the Tamiflu experience. PLoS Med. 2012, 9: e1001201-CrossRefPubMedPubMedCentral Doshi P, Jefferson T, Del Mar C: The imperative to share clinical study reports: recommendations from the Tamiflu experience. PLoS Med. 2012, 9: e1001201-CrossRefPubMedPubMedCentral
65.
Zurück zum Zitat Jefferson T, Jones MA, Doshi P, Del Mar CB, Heneghan CJ, Hama R, Thompson MJ: Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2012, 1: CD008965-PubMed Jefferson T, Jones MA, Doshi P, Del Mar CB, Heneghan CJ, Hama R, Thompson MJ: Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2012, 1: CD008965-PubMed
66.
Zurück zum Zitat Doshi P: Transparency interrupted: the curtailment of the European Medicines Agency’s policy on access to documents. JAMA Intern Med. 2013, doi:10.1001/jamainternmed.2013.9989 Doshi P: Transparency interrupted: the curtailment of the European Medicines Agency’s policy on access to documents. JAMA Intern Med. 2013, doi:10.1001/jamainternmed.2013.9989
67.
Zurück zum Zitat Doshi P, Jones M, Jefferson T: Rethinking credible evidence synthesis. BMJ. 2012, 344: d7898-CrossRefPubMed Doshi P, Jones M, Jefferson T: Rethinking credible evidence synthesis. BMJ. 2012, 344: d7898-CrossRefPubMed
68.
Zurück zum Zitat Jefferson T, Doshi P, Thompson M, Heneghan C: Ensuring safe and effective drugs: who can do what it takes?. BMJ. 2011, 342: c7258-CrossRefPubMed Jefferson T, Doshi P, Thompson M, Heneghan C: Ensuring safe and effective drugs: who can do what it takes?. BMJ. 2011, 342: c7258-CrossRefPubMed
69.
Zurück zum Zitat Fitzpatrick RB: Science.gov: gateway to government science information. Med Ref Serv Q. 2010, 29: 58-66.CrossRefPubMed Fitzpatrick RB: Science.gov: gateway to government science information. Med Ref Serv Q. 2010, 29: 58-66.CrossRefPubMed
73.
Zurück zum Zitat Thomas J, McNaught J, Ananiadou S: Applications of text mining within systematic reviews. Res Synth Method. 2011, 2: 1-14. doi: 10.1002/jrsm.1027CrossRef Thomas J, McNaught J, Ananiadou S: Applications of text mining within systematic reviews. Res Synth Method. 2011, 2: 1-14. doi: 10.1002/jrsm.1027CrossRef
74.
Zurück zum Zitat Shemilt I, Simon A, Hollands GJ, Marteau TM, Ogilvie D, O’Mara-Eves A, Kelly MP, Thomas J: Pinpointing needles in giant haystacks: use of text mining to reduce impractical screening workload in extremely large scoping reviews. Res Synth Method. 2013, doi: 10.1002/jrsm.1093 Shemilt I, Simon A, Hollands GJ, Marteau TM, Ogilvie D, O’Mara-Eves A, Kelly MP, Thomas J: Pinpointing needles in giant haystacks: use of text mining to reduce impractical screening workload in extremely large scoping reviews. Res Synth Method. 2013, doi: 10.1002/jrsm.1093
75.
Zurück zum Zitat Spoor P, Airey M, Bennett C, Greensill J, Williams R: Use of the capture-recapture technique to evaluate the completeness of systematic literature searches. BMJ. 1996, 313: 342-343.CrossRefPubMedPubMedCentral Spoor P, Airey M, Bennett C, Greensill J, Williams R: Use of the capture-recapture technique to evaluate the completeness of systematic literature searches. BMJ. 1996, 313: 342-343.CrossRefPubMedPubMedCentral
76.
Zurück zum Zitat Rucker G, Reiser V, Motschall E, Binder H, Meerpohl JJ, Antes G, Schumacher M: Boosting qualifies capture-recapture methods for estimating the comprehensiveness of literature searches for systematic reviews. J Clin Epidemiol. 2011, 64: 1364-1372.CrossRefPubMed Rucker G, Reiser V, Motschall E, Binder H, Meerpohl JJ, Antes G, Schumacher M: Boosting qualifies capture-recapture methods for estimating the comprehensiveness of literature searches for systematic reviews. J Clin Epidemiol. 2011, 64: 1364-1372.CrossRefPubMed
77.
Zurück zum Zitat Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D: An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol. 2006, 6: 33-CrossRefPubMedPubMedCentral Sampson M, Zhang L, Morrison A, Barrowman NJ, Clifford TJ, Platt RW, Klassen TP, Moher D: An alternative to the hand searching gold standard: validating methodological search filters using relative recall. BMC Med Res Methodol. 2006, 6: 33-CrossRefPubMedPubMedCentral
78.
Zurück zum Zitat Kastner M, Straus S, Goldsmith CH: Estimating the horizon of articles to decide when to stop searching in systematic reviews: an example using a systematic review of RCTs evaluating osteoporosis clinical decision support tools. AMIA Annu Symp Proc. 2007, 389-393. Kastner M, Straus S, Goldsmith CH: Estimating the horizon of articles to decide when to stop searching in systematic reviews: an example using a systematic review of RCTs evaluating osteoporosis clinical decision support tools. AMIA Annu Symp Proc. 2007, 389-393.
79.
Zurück zum Zitat Kastner M, Straus SE, McKibbon KA, Goldsmith CH: The capture-mark-recapture technique can be used as a stopping rule when searching in systematic reviews. J Clin Epidemiol. 2009, 62: 149-157.CrossRefPubMed Kastner M, Straus SE, McKibbon KA, Goldsmith CH: The capture-mark-recapture technique can be used as a stopping rule when searching in systematic reviews. J Clin Epidemiol. 2009, 62: 149-157.CrossRefPubMed
80.
Zurück zum Zitat Booth A: How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. Int J Technol Assess Health Care. 2010, 26: 431-435.CrossRefPubMed Booth A: How much searching is enough? Comprehensive versus optimal retrieval for technology assessments. Int J Technol Assess Health Care. 2010, 26: 431-435.CrossRefPubMed
81.
Zurück zum Zitat Sampson M, Shojania KG, McGowan J, Daniel R, Rader T, Iansavichene AE, Ji J, Ansari MT, Moher D: Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol. 2008, 61: 755-762.CrossRefPubMed Sampson M, Shojania KG, McGowan J, Daniel R, Rader T, Iansavichene AE, Ji J, Ansari MT, Moher D: Surveillance search techniques identified the need to update systematic reviews. J Clin Epidemiol. 2008, 61: 755-762.CrossRefPubMed
82.
Zurück zum Zitat Shekelle PG, Newberry SJ, Wu H, Suttorp M, Motala A, Lim YW, Balk EM, Chung M, Yu WW, Lee J, Gaylor JM, Moher D, Ansari MT, Skidmore R, Garritty C: Identifying Signals for Updating Systematic Reviews: A Comparison of Two Methods [internet]. 2011, Rockville, MD: Agency for Healthcare Research and Quality (US),http://www.ncbi.nlm.nih.gov/books/NBK56774/, Shekelle PG, Newberry SJ, Wu H, Suttorp M, Motala A, Lim YW, Balk EM, Chung M, Yu WW, Lee J, Gaylor JM, Moher D, Ansari MT, Skidmore R, Garritty C: Identifying Signals for Updating Systematic Reviews: A Comparison of Two Methods [internet]. 2011, Rockville, MD: Agency for Healthcare Research and Quality (US),http://​www.​ncbi.​nlm.​nih.​gov/​books/​NBK56774/​,
84.
Zurück zum Zitat CRD: Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2009, York: Centre for Reviews and Dissemination, University of York CRD: Systematic Reviews: CRD’s Guidance for Undertaking Reviews in Health Care. 2009, York: Centre for Reviews and Dissemination, University of York
85.
Zurück zum Zitat IOM: Standards for finding and assessing individual studies. Finding What Works in Health Care: Standards for Systematic Reviews, Committee on Standards for Systematic Reviews of Comparative Effectiveness Research. Edited by: Eden J, Levit L, Berg A, Morton S. 2011, Washington, DC: The National Academies Press, 81-154. IOM: Standards for finding and assessing individual studies. Finding What Works in Health Care: Standards for Systematic Reviews, Committee on Standards for Systematic Reviews of Comparative Effectiveness Research. Edited by: Eden J, Levit L, Berg A, Morton S. 2011, Washington, DC: The National Academies Press, 81-154.
86.
Zurück zum Zitat Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM: External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007, 2: e1350-CrossRefPubMedPubMedCentral Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM: External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007, 2: e1350-CrossRefPubMedPubMedCentral
87.
Zurück zum Zitat Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007, 7: 10-CrossRefPubMedPubMedCentral Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007, 7: 10-CrossRefPubMedPubMedCentral
88.
Zurück zum Zitat Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62: e1-e34.CrossRefPubMed Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62: e1-e34.CrossRefPubMed
89.
Zurück zum Zitat Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009, 62: 1006-1012.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009, 62: 1006-1012.CrossRefPubMed
90.
Zurück zum Zitat Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010, 63: e1-e37.CrossRefPubMed Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. 2010, 63: e1-e37.CrossRefPubMed
91.
92.
Zurück zum Zitat Ellis AK: Teaching and Learning Elementary Social Studies. 1970, Boston, MA: Allyn & Bacon Ellis AK: Teaching and Learning Elementary Social Studies. 1970, Boston, MA: Allyn & Bacon
93.
Zurück zum Zitat Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC: The ClinicalTrials.gov results database – update and key issues. N Engl J Med. 2011, 364: 852-860.CrossRefPubMedPubMedCentral Zarin DA, Tse T, Williams RJ, Califf RM, Ide NC: The ClinicalTrials.gov results database – update and key issues. N Engl J Med. 2011, 364: 852-860.CrossRefPubMedPubMedCentral
95.
Zurück zum Zitat Cepeda MS, Lobanov V, Berlin JA: From ClinicalTrials.gov trial registry to an analysis-ready database of clinical trial results. Clin Trials. 2013, 10: 347-348.CrossRefPubMed Cepeda MS, Lobanov V, Berlin JA: From ClinicalTrials.gov trial registry to an analysis-ready database of clinical trial results. Clin Trials. 2013, 10: 347-348.CrossRefPubMed
Metadaten
Titel
Methodological developments in searching for studies for systematic reviews: past, present and future?
verfasst von
Carol Lefebvre
Julie Glanville
L Susan Wieland
Bernadette Coles
Alison L Weightman
Publikationsdatum
01.12.2013
Verlag
BioMed Central
Erschienen in
Systematic Reviews / Ausgabe 1/2013
Elektronische ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-2-78

Weitere Artikel der Ausgabe 1/2013

Systematic Reviews 1/2013 Zur Ausgabe