Figures
Abstract
Background
Many research studies have been published on atopic eczema and these are often summarised in systematic reviews (SRs). Identifying SRs can be time-consuming for health professionals, and researchers. In order to facilitate the identification of important research, we have compiled an on-line resource that includes all relevant eczema reviews published since 2000.
Methods
SRs were searched for in MEDLINE (Ovid), EMBASE (Ovid), PubMed, the Cochrane Database of Systematic Reviews, DARE and NHS Evidence. Selected SRs were assessed against the pre-defined eligibility criteria and relevant articles were grouped by treatment category for the included interventions. All identified systematic reviews are included in the Global Resource of EczemA Trials (GREAT) database (www.greatdatabase.org.uk) and key clinical messages are summarised here.
Results
A total of 128 SRs reviews were identified, including three clinical guidelines. Of these, 46 (36%) were found in the Cochrane Library. No single database contained all of the SRs found. The number of SRs published per year has increased substantially over the last thirteen years, and reviews were published in a variety of clinical journals. Of the 128 SRs, 1 (1%) was on mechanism, 37 (29%) were on epidemiology, 40 (31%) were on eczema prevention, 29 (23%) were on topical treatments, 31 (24%) were on systemic treatments, and 24 (19%) were on other treatments. All SRs included searches of MEDLINE in their search methods. One hundred six SRs (83%) searched more than one electronic database. There were no language restrictions reported in the search methods of 52 of the SRs (41%).
Citation: Futamura M, Thomas KS, Grindlay DJC, Doney EJ, Torley D, Williams HC (2013) Mapping Systematic Reviews on Atopic Eczema—An Essential Resource for Dermatology Professionals and Researchers. PLoS ONE 8(3): e58484. https://doi.org/10.1371/journal.pone.0058484
Editor: Michel Simon, CNRS-University of Toulouse, France
Received: October 1, 2012; Accepted: February 5, 2013; Published: March 11, 2013
Copyright: © 2013 Futamura et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: MF conducted this work as part of a research sabbatical funded by the National Center for Child Health and Development. Some of the searches for systematic reviews included in this study were carried out by DG in his previous role producing Annual Evidence Updates for the National Library for Health and NHS Evidence. The GREAT Database has been developed as part of independent research commissioned by the National Institute for Health Research (NIHR) under its Programme Grants for Applied Research funding scheme (RP-PG-0407-10177). The views expressed in this publication are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health. This work was partially supported by NHS evidence. No other external funding was received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Background
Atopic eczema (AE), also known as atopic dermatitis, is a common disease that attracts considerable research interest [1], [2]. Data from published epidemiological research and clinical trials, including randomized controlled trials (RCTs), are exponentially increasing [3]. RCTs are the recognised gold standard for assessing the effectiveness of interventions [4], and these have recently been collated into an openly accessible on-line database of eczema trials, the Global Resource of EczemA Trials (GREAT) database (www.greatdatabase.org.uk) [5].
However, relying on single RCTs is hazardous [6], and systematic reviews (SRs) that collate information from individual studies to provide a more reliable form of evidence are an essential tool for healthcare practitioners.
The aim of this project was to identify and provide easy access to all atopic eczema systematic reviews in a convenient “one-stop shop” in order to facilitate the practice of evidence-based dermatology amongst healthcare practitioners, guideline writers, information specialists, and researchers. In ensuring the easy identification of all published SRs, we hope to reduce unnecessary duplication of effort, and to assist with the identification of potential areas that require an up-to-date review.
As part of the process to build a SR resource, we have been regularly reviewing all SRs on AE published since 2000 and these have been summarised as Annual Evidence Updates published each year [7]–[11]. A similar resource summarising SRs on acne vulgaris has been produced and maintained since 2007, and is available from the website for the Centre of Evidence Based Dermatology, University of Nottingham (www.nottingham.ac.uk/dermatology). This mapping of SRs has been used to produce clinical evidence updates in acne [12]–[14], and similar updates have been published for psoriasis [15], [16] and skin cancer [17], [18].
This paper provides an opportunity to direct healthcare practitioners and researchers to the relevant SRs on AE for different topic areas, and to highlight some of the key messages to have emerged from the last 13 years of AE research.
Methods
Search Dates
Searches were conducted for studies published from 1st January 2000 to 31st December 2012. The last search was conducted on 16th January 2013 in order to allow for the inclusion of studies published in 2012, although it is possible that some reviews published towards the end of 2012 may have been omitted if they have not been indexed yet.
Sources Searched
The following electronic databases were searched: MEDLINE (Ovid), EMBASE (Ovid), PubMed, Cochrane Database of Systematic Reviews, Database of Abstracts of Reviews of Effects (DARE) and NHS Evidence. Searches were conducted by a trained information specialist or librarian (DJCG or EJD).
Search Terms
The following search terms were used in all the databases: “eczema”, “atopic dermatitis” and “neurodermatitis”. The SIGN (Scottish Intercollegiate Guidelines Network) SR filters were used to identify SRs in MEDLINE and EMBASE (see Appendix S1 & S2 in Appendixes S1). The PubMed Clinical Queries SR filter was used for the PubMed search. There were no language restrictions in our searches.
Identification of SRs
An SR was defined from the Glossary of Terms in the Cochrane Collaboration as “A review of a clearly formulated question that uses systematic and explicit methods to identify, select, and critically appraise relevant research, and to collect and analyse data from the studies that are included in the review. Statistical methods (meta-analysis) may or may not be used to analyse and summarise the results of the included studies” [19].
All citations from the searches were handsearched by a single investigator (MF or DJCG) by reading titles and abstracts to identify SRs, and potential SRs, relevant to AE. The following exclusion criteria were used: 1) not relevant for the clinical topic, 2) non-review article, 3) conference abstract only, or 4) methodology unclear preventing potential replication or validation of results. Reviews that did not name the databases that had been searched or the dates of the search were also excluded. In order to be inclusive, we did not exclude SRs because they had 1) searched a single database, 2) used a single data extractor, 3) applied language restrictions, or 4) were not pre-registered. Clinical guidelines were included if a SR had been carried out and published as part of the production process. The final decision on whether publications were to be included as a SR was made by HCW.
Mapping of Reviews
The identified SRs were sorted into six categories: mechanism, epidemiology, prevention, topical treatments, systemic treatments, and other treatments. Updated reviews were counted as a single SR if they were published in the same journal as the earlier version, and for these the latest publication date was used [20]. In the tables, citations (with links to on-line records) are given by category and topic area, and ordered according to the date of the last search. Where a SR covered more than one topic area, it was listed under all relevant topics. Details of databases used for the SR and any language restrictions applied are also listed. The country of origin for all SRs was defined as the location of the institution for the first author.
Current AE Guidelines
Current guidelines on AE were checked to confirm how many of the identified SRs had been used to inform relevant clinical guidelines. We searched for AE guidelines published since 2007 from the National Guidelines Clearing House website (http://guideline.gov/) in addition to PubMed. We selected guidelines which 1) were written in English or had references mainly written in English, 2) were published in medical journals or on a freely accessible website, and 3) were written on behalf of governmental or national organizations. For each identified guideline, the reference list was scrutinised in order to identify the number of relevant SRs that had been cited.
Value of the SR Mapping
In order to assess the potential value of this mapping of SRs in the dermatology community, we conducted an on-line survey between 19th November and 4th December 2012. This anonymous survey was open for two weeks and was performed on-line. Approach letters were sent to 480 members of the UK Dermatology Clinical Trial Network (UK DCTN) (http://www.ukdctn.org/) and to 140 members of the international Harmonizing Outcome Measures for Eczema (HOME) initiative (http://www.homeforeczema.org/). Participants were asked to comment on the potential uses of the map of SRs and to assess how useful the resource would be in their own work.
Results
Overall Characteristics
Our search identified 128 SRs on AE published between 2000 and 2012 (see Figure 1). None of the databases searched contained all of the 128 included SRs. Forty six (36%) were found in the Cochrane Library, 102 (80%) were found in MEDLINE, 113 (88%) were found in EMBASE, 107 (84%) from PubMed, and 53 (41%) from NHS Evidence.
Three non-English SRs (one German and four Chinese) were included. Three clinical guidelines were included as they fulfilled our inclusion criteria of being guidelines containing their own systematic reviews [21]–[23].
Eighty one SRs were published in the last five years alone – equating to an average of 16 SRs per year. The most common places for SRs to be published were the British Journal of Dermatology (14) and the Cochrane Database of Systematic Reviews (13) (see Figure 2). However, SRs were published in many journals, and the five most commonly used journals accounted for less than 40% of the total number of reviews. Thirty seven (29%) of the SRs originated in the United Kingdom, while 24 (19%) came from the United States, and 15 (12%) were from Germany (see Figure 3).
Topic Areas of Systematic Reviews
The categories covered by the SRs were mechanism (1; 1%), epidemiology (37; 29%), prevention (40; 31%), topical treatments (29; 23%), systemic treatments (31; 24%), and other treatments (24; 19%). Each topic had between 1 and 24 relevant SRs (see Table 1). In recent years, there has been increasing interest in prevention (28% between 2000 and 2007, 33% between 2008 and 2012).
Quality of SRs
The number of databases search in a SR can be one indicator of quality of the review. Most of the included SRs searched more than one database (106 SRs; 83%). The most commonly searched database was MEDLINE (used in all SRs), followed by EMBASE (used in 78 SRs; 61%). No language restrictions were reported in 52 SRs (41%).
A meta-analysis was conducted in 71 of the SRs (56%). Five of the thirteen Cochrane SRs had been updated at least once [24]–[26]. None of the other SRs had been updated.
Summary of Clinical Implications from the Reviews
For the last five years, Annual Evidence Updates have been produced that summarise the recent evidence from published SRs [7]–[11]. The key clinical messages from these updates, and from other SRs published between August 2010 and December 2012 are briefly outlined in Table 2.
SRs in Guidelines
We reviewed 12 guideline references relevant to AE that had been published since 2007 (Table 3) [22], [23], [27]–[37]. The guidelines most likely to cite SRs were the SIGN guideline on the management of AE in primary care (22 SRs) and the NICE guideline for the management of children with AE (14 SRs). However, some guidelines cited very few or no SRs, the reasons for which are unclear.
Usefulness of the Resource
In response to an on-line survey of dermatology health care professionals, 123 participants responded (91 members of the UK DCTN and 32 non-UK DCTN members of the HOME initiative). Overall, 112 (91%) of responders felt that the ability to identify relevant SRs quickly would be useful for their work, and 110 (90%) rated the mapping of SRs as being either ‘very useful’ or ‘somewhat useful’. General comments in response to the survey included: “This would be an invaluable source and a great asset for dermatologists” and “This is also useful for patients who can understand English”.
Availability
Full links and citations to reviews relating to the treatment of eczema are included in the GREAT Database. This freely accessible database includes all RCTs of AE interventions published since 1966, and the SRs published since 2000 that are the topic of this paper. A full list of the SRs can be downloaded as a PDF file (available at http://www.nottingham.ac.uk/dermatology).
Discussion
Main Findings
For this review, we focused on one of the most prevalent and commonly researched skin diseases, and found 128 SRs published in the last thirteen years. The number of SRs published in recent years has increased significantly – more than 70% had been published since 2008. Although our eligibility criteria were broad, many articles were excluded because of unclear methodology, especially those published more than five years ago. To address the sub-optimal reporting of SRs, quality of reporting standards have been developed and published such as QUOROM (QUality Of Reporting Of Meta-analyses) in 1999 [38], and PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses) in 2009 [39]. Adherence to these reporting guidelines may explain the apparent increase in the number of eligible SRs included in this review in recent years.
In common with SRs of other diseases [40], the majority of SRs focused on treatments. However, prevention of AE was an increasingly frequent topic in recent years, possibly reflecting a growing research interest in public health.
SRs on AE were found in many different journals, making it difficult for health care practitioners and researchers to identify them easily. Although the Cochrane Library is a reliable source for identifying high-quality SRs [41], [42], it did not contain all the relevant reviews. Similarly, MEDLINE, the most commonly searched bibliographic database [43], did not contain seven of our included reviews. It was time consuming to identify non-Cochrane SRs in the bibliographic databases, and distinguishing true systematic reviews from other clinical reviews was sometimes difficult. From this we conclude that, as when searching for clinical trials to include in a SR, multiple databases should be used to find all relevant SRs on a given topic.
It would seem that many clinical guidelines are produced without reference to relevant and up-to-date SRs. Although it is not possible to establish why this might be, it is clearly important to promote the availability of this mapping of reviews as a resource for future guideline writers in order to ensure that clinical practice is based on the best available evidence.
Strengths and Limitations
We searched six bibliographic databases. SRs were only included in this review if they fulfilled our eligibility criteria. Whilst we might have missed some SRs with non-English abstracts, we believe this review to be the most comprehensive summary of important SRs on AE in the world [44].
The importance of being able to identify relevant SRs quickly was supported by the dermatology professionals and researchers who responded to our survey, and so this resource will be maintained on an annual basis.
Conclusions
This paper describes a collection of SRs on AE which provide a unique resource that will substantially reduce the amount of time and effort spent in searching for high-quality information by healthcare practitioners, guideline writers, information specialists, and researchers. This paper also summarises the key clinical messages to have emerged from these reviews over the last decade. The resource will be continually updated in the future (available through the Centre of Evidence Based Dermatology’s website and the GREAT Database), ensuring that the information remains up-to-date and relevant to the needs of the clinical community.
Supporting Information
Appendixes S1.
Appendix S1. Search strategies of Ovid MEDLINE. Appendix S2. Search strategies of Ovid Embase.
https://doi.org/10.1371/journal.pone.0058484.s001
(DOCX)
Acknowledgments
We thank Helen Nankervis, who supplied the data for the connection with the GREAT database. We also thank Dr Jonathan Batchelor, Dr Rosalind Simpson and Dr Viktoria Eleftheriadou for their helpful comments in assessing the usability of the review maps.
Author Contributions
Conceived and designed the experiments: KST HCW. Performed the experiments: MF DJCG EJD DT. Analyzed the data: MF DJCG DT. Wrote the paper: MF KST.
References
- 1. Hon KL, Yong V, Leung TF (2012) Research statistics in Atopic Eczema: what disease is this? Ital J Pediatr 38: 26.
- 2. Flohr C (2011) Atopic dermatitis diagnostic criteria and outcome measures for clinical trials: still a mess. J Invest Dermatol 131: 557–559.
- 3. Tsay MY, Yang YH (2005) Bibliometric analysis of the literature of randomized controlled trials. J Med Libr Assoc 93: 450–458.
- 4. Harbour R, Miller J (2001) A new system for grading recommendations in evidence based guidelines. BMJ 323: 334–336.
- 5. Nankervis H, Maplethorpe A, Williams HC (2011) Mapping randomized controlled trials of treatments for eczema–the GREAT database (the Global Resource of EczemA Trials: a collection of key data on randomized controlled trials of treatments for eczema from 2000 to 2010). BMC Dermatol 11: 10.
- 6. Schulz KF, Chalmers I, Hayes RJ, Altman DG (1995) Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273: 408–412.
- 7. Williams HC, Grindlay DJ (2008) What’s new in atopic eczema? An analysis of the clinical significance of systematic reviews on atopic eczema published in 2006 and 2007. Clin Exp Dermatol 33: 685–688.
- 8. Williams HC, Grindlay DJ (2010) What’s new in atopic eczema? An analysis of systematic reviews published in 2007 and 2008. Part 1. Definitions, causes and consequences of eczema. Clin Exp Dermatol 35: 12–15.
- 9. Williams HC, Grindlay DJ (2010) What’s new in atopic eczema? An analysis of systematic reviews published in 2007 and 2008. Part 2. Disease prevention and treatment. Clin Exp Dermatol 35: 223–227.
- 10.
Batchelor JM, Grindlay DJ, Williams HC (2010) What’s new in atopic eczema? An analysis of systematic reviews published in 2008 and 2009. Clin Exp Dermatol 35: 823–827; quiz 827–828.
- 11.
Shams K, Grindlay DJ, Williams HC (2011) What’s new in atopic eczema? An analysis of systematic reviews published in 2009–2010. Clin Exp Dermatol 36: 573–577; quiz 577–578.
- 12. Ingram JR, Grindlay DJ, Williams HC (2010) Management of acne vulgaris: an evidence-based update. Clin Exp Dermatol 35: 351–354.
- 13.
Smith EV, Grindlay DJ, Williams HC (2011) What’s new in acne? An analysis of systematic reviews published in 2009–2010. Clin Exp Dermatol 36: 119–122; quiz 123.
- 14.
Simpson RC, Grindlay DJ, Williams HC (2011) What’s new in acne? An analysis of systematic reviews and clinically significant trials published in 2010–11. Clin Exp Dermatol 36: 840–843; quiz 843–844.
- 15.
Foulkes AC, Grindlay DJ, Griffiths CE, Warren RB (2011) What’s new in psoriasis? An analysis of guidelines and systematic reviews published in 2009–2010. Clin Exp Dermatol 36: 585–589; quiz 588–589.
- 16.
Warren RB, Brown BC, Grindlay DJ, Griffiths CE (2010) What’s new in psoriasis? Analysis of the clinical significance of new guidelines and systematic reviews on psoriasis published in 2008 and 2009. Clin Exp Dermatol 35: 688–691; quiz 692.
- 17. Macbeth AE, Grindlay DJ, Williams HC (2011) What’s new in skin cancer? An analysis of guidelines and systematic reviews published in 2008–2009. Clin Exp Dermatol 36: 453–458.
- 18.
National Institute for Health and Clinical Excellence (2011) Improving outcomes for people with skin tumours including melanoma: Evidence Update October 2011.
- 19.
Higgins JPT, Green S, Cochrane Collaboration. (2008) Cochrane handbook for systematic reviews of interventions. Chichester, England; Hoboken, NJ: Wiley-Blackwell. xxi, 649 pp.
- 20. Moher D, Tsertsvadze A (2006) Systematic reviews: when is an update an update? Lancet 367: 881–883.
- 21. Hanifin JM, Cooper KD, Ho VC, Kang S, Krafchik BR, et al. (2004) Guidelines of care for atopic dermatitis, developed in accordance with the American Academy of Dermatology (AAD)/American Academy of Dermatology Association “Administrative Regulations for Evidence-Based Clinical Practice Guidelines”. J Am Acad Dermatol 50: 391–404.
- 22.
National Institute for Health and Clinical Excellence (2007) Atopic Eczema in Children: Management of atopic eczema in children from birth up to the age of 12 years.
- 23.
Scottish Intercollegiate Guidelines Network (2011) Management of atopic eczema in primary care. Scottish Intercollegiate Guidelines Network.
- 24.
Kramer MS, Kakuma R (2006) Maternal dietary antigen avoidance during pregnancy or lactation, or both, for preventing or treating atopic disease in the child. Cochrane Database Syst Rev: CD000133.
- 25.
Osborn DA, Sinn J (2006) Soy formula for prevention of allergy and food intolerance in infants. Cochrane Database Syst Rev: CD003741.
- 26.
Osborn DA, Sinn J (2006) Formulas containing hydrolysed protein for prevention of allergy and food intolerance in infants. Cochrane Database Syst Rev: CD003664.
- 27. Greer FR, Sicherer SH, Burks AW (2008) Effects of early nutritional interventions on the development of atopic disease in infants and children: the role of maternal dietary restriction, breastfeeding, timing of introduction of complementary foods, and hydrolyzed formulas. Pediatrics 121: 183–191.
- 28. Krakowski AC, Eichenfield LF, Dohil MA (2008) Management of atopic dermatitis in the pediatric population. Pediatrics 122: 812–824.
- 29. Sinclair W, Aboobaker J, Jordaan F, Modi D, Todd G (2008) Management of atopic dermatitis in adolescents and adults in South Africa. S Afr Med J 98: 303–319.
- 30. Werfel T, Erdmann S, Fuchs T, Henzgen M, Kleine-Tebbe J, et al. (2009) Approach to suspected food allergy in atopic dermatitis. Guideline of the Task Force on Food Allergy of the German Society of Allergology and Clinical Immunology (DGAKI) and the Medical Association of German Allergologists (ADA) and the German Society of Pediatric Allergology (GPA). J Dtsch Dermatol Ges 7: 265–271.
- 31. Saeki H, Furue M, Furukawa F, Hide M, Ohtsuki M, et al. (2009) Guidelines for management of atopic dermatitis. J Dermatol 36: 563–577.
- 32. Darsow U, Wollenberg A, Simon D, Taieb A, Werfel T, et al. (2010) ETFAD/EADV eczema task force 2009 position paper on diagnosis and treatment of atopic dermatitis. J Eur Acad Dermatol Venereol 24: 317–328.
- 33. Cox L, Nelson H, Lockey R, Calabria C, Chacko T, et al. (2011) Allergen immunotherapy: a practice parameter third update. J Allergy Clin Immunol 127: S1–55.
- 34. Katayama I, Kohno Y, Akiyama K, Ikezawa Z, Kondo N, et al. (2011) Japanese guideline for atopic dermatitis. Allergol Int 60: 205–220.
- 35. Baron SE, Cohen SN, Archer CB (2012) Guidance on the diagnosis and clinical management of atopic eczema. Clin Exp Dermatol 37 Suppl 17–12.
- 36. Ring J, Alomar A, Bieber T, Deleuran M, Fink-Wagner A, et al. (2012) Guidelines for treatment of atopic eczema (atopic dermatitis) part I. J Eur Acad Dermatol Venereol. 26: 1045–1060.
- 37. Ring J, Alomar A, Bieber T, Deleuran M, Fink-Wagner A, et al. (2012) Guidelines for treatment of atopic eczema (atopic dermatitis) Part II. J Eur Acad Dermatol Venereol 26: 1176–1193.
- 38. Moher D, Cook DJ, Eastwood S, Olkin I, Rennie D, et al. (1999) Improving the quality of reports of meta-analyses of randomised controlled trials: the QUOROM statement. Quality of Reporting of Meta-analyses. Lancet 354: 1896–1900.
- 39. Moher D, Liberati A, Tetzlaff J, Altman DG (2009) Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol 62: 1006–1012.
- 40. Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG (2007) Epidemiology and reporting characteristics of systematic reviews. PLoS Med 4: e78.
- 41. Collier A, Heilig L, Schilling L, Williams H, Dellavalle RP (2006) Cochrane Skin Group systematic reviews are more methodologically rigorous than other systematic reviews in dermatology. Br J Dermatol 155: 1230–1235.
- 42. Olsen O, Middleton P, Ezzo J, Gotzsche PC, Hadhazy V, et al. (2001) Quality of Cochrane reviews: assessment of sample from 1998. BMJ 323: 829–832.
- 43. Chiu YW, Weng YH, Lo HL, Ting HW, Hsu CC, et al. (2009) Physicians’ characteristics in the usage of online database: a representative nationwide survey of regional hospitals in Taiwan. Inform Health Soc Care 34: 127–135.
- 44. Egger M, Zellweger-Zahner T, Schneider M, Junker C, Lengeler C, et al. (1997) Language bias in randomised controlled trials published in English and German. Lancet 350: 326–329.