Introduction
Infectious disease outbreaks pose a serious global health challenge, as illustrated by the worldwide pandemic of COVID-19. In the last decade alone, the World Health Organization (WHO) has declared six Public Health Emergency of International Concern (PHEIC) associated with infectious diseases [
1‐
3]. Low and middle-income countries (LMICs) with weaker health systems are particularly at risk with limited surveillance leading to late detection and response to outbreaks [
4,
5]. During outbreaks, timely collection, management, sharing, analysis and reporting of data are required to ensure that interventions are appropriately targeted and effective in supporting outbreak control.
The use of information and communication technologies (ICT) for health - eHealth, is growing in importance as it facilitates access to and delivery of health services as well as collection, management and analysis of infectious and non-communicable disease data [
6,
7]. Electronic tools and solutions offer many advantages over traditional paper-based data collection, including more rapid data collection and transfer, use of checks/validation to improve data accuracy, and collection of more diverse data types including images, audio and barcodes. They can provide cost savings and are more environmentally friendly [
8‐
11]. However, electronic tools also have limitations in some contexts, for example if there are requirements for stable electricity, internet or phone connectivity.
Electronic tools can also be used during outbreaks to support timely collection and analysis of data. However, in practice, in outbreak response we have observed data are often collected on paper and day-to-day programs for analysis being used, foregoing tools better designed to meet needs. There are a growing number of tools available for use in outbreaks and emergencies [
12,
13]. A recent review identified 58 mobile tools developed for, or used during, the Ebola outbreak in West Africa in 2013–2016 [
12]
. There are however challenges to the use of electronic tools in outbreaks and emergencies. Emergencies require rapid deployment of frontline workers for data collection, and while there are now many electronic tools to support this, various similar tools for data collection may occur during the same outbreak at the same time in a fragmented manner, due to lack of coordination. The number of similar tools combined with the compressed timeframes can lead to little time for deliberation over optimal data collection methods. There are also requirements in these contexts - emergencies and outbreaks in LMICs often occur in settings with the most limited infrastructures and tools in these settings need to be flexible to function in these environments. They also need to be able to be incorporated into existing data or surveillance infrastructures and allow for interoperability and/or data sharing between organisations. Ideally, these electronic tools should be employed both for routine surveillance activities and outbreak response in an integrated, sustainable approach.
Choosing the most appropriate electronic tool for an outbreak response is important, but it is also essential to harmonise data collection and ensure interoperability. Some projects seek to support harmonisation of how we collect data independently of the tool we use, including the Humanitarian Exchange Language (HXL) and the WHO “Outbreak Toolkit” [
14,
15]. Standardising the choice, format and/or naming/tagging of the data variables collected between and within organisations during outbreaks and humanitarian emergencies (such as through standardised case investigation forms, unique agreed reporting categories, standardised data formats and data dictionaries) facilitates more efficient data sharing and timelier data analyses for rapid decision making.
In outbreaks and emergencies, diverse technical characteristics are required for an electronic data system to support the most effective outbreak response. With limited time and resources, it is unsurprising that decision makers may have difficulty identifying the most appropriate tools for their needs. Here we aim to identify and describe characteristics of electronic data collection, management and analysis tools used for infectious disease outbreaks in LMICs, the functionalities most commonly required in outbreaks, in order to facilitate decision making on appropriate tool selection. We also aimed to make this information more easily accessible to relevant stakeholders through the creation of an interactive and dynamic online decision-making tool.
Methods
Search strategy
We followed PRISMA guidelines to conduct the systematic review [
16]. We searched five electronic databases: MEDLINE, EMBASE, Global Health, Web of Science and CINAHL. The search terms included four categories: LMICs, outbreaks or epidemics or early warning alert and response or humanitarian emergencies, data management, collection and analysis and electronic tools. Search terms are listed in additional file
1 for all databases. The search strategies included indexed terms where possible. LMIC filters based on World Bank categorizations were used from Ovid [
17].
Inclusion and exclusion criteria
We included studies if they described electronic data collection, management or analysis tools that were used in low- and middle-income countries either for detection or response to an infectious disease outbreak (animal or human) alone or as part of a humanitarian emergency, or as part of an early warning and alert system. In addition, studies that analysed outbreak data or performed operational disease modelling analyses were included. Studies published from 1st January 2010 to 12th October 2018 in English, French, German, Portuguese or Spanish were included. An update of the original search was conducted which included studies published from October 2018 to May 2020.
We excluded studies that described non-communicable diseases or drug epidemics, clinical trials in outbreaks; seroprevalence studies; qualitative studies, unless directly linked to data tools for collection, management and analysis of outbreak or outbreak-related humanitarian data. Studies that focused on retrospective analysis of infectious disease surveillance data to identify outbreaks as well as articles describing electronic data tools without any operational application to outbreak response were also excluded. Similarly, modelling analyses based on surveillance or simulated data as well as tools for humanitarian response or preparedness without any link to outbreak response were excluded. Hospital information management tools, unless specifically developed for an outbreak, were also excluded. Review articles and studies for which full text articles were not available open access were also excluded.
Identification of potentially eligible studies
We exported identified studies to Endnote (version 8, Clarivate Analytics, Philadelphia, USA) and removed any duplicates. Two authors (PK and JM) independently assessed the relevance of all titles and abstracts based on inclusion and exclusion criteria. In the case of differing views on the inclusion of an article, consensus was reached by discussion between the two researchers. Full-text articles were retrieved for all potentially relevant studies. Two authors (PK and JM) independently assessed the full text articles using the inclusion and exclusion criteria.
We extracted information, using a standardised form, on the electronic tools from the included articles examining cost, license type, compatibility with windows, mac and linux, location of data storage, ability to visualise data, whether data could be collected with a mobile application (also the type of mobile devices that could be used for data collection) or via a web interface, data encryption functionality, collection of GPS data, and ability to collect data offline (see additional file
2 for the definitions used for the data extraction). We supplemented data from the systematic review with additional detail on technical capacities and overall functions either via direct contact with the electronic tool developers and/or reading information provided in their websites.
Stakeholder survey
To identify electronic tools used in recent outbreaks in LMICs, we invited key stakeholders, such as Global Outbreak Alert and Response Network (GOARN) members which includes National Public Health Institutes, Ministries of Health, United Nations Agencies, National and international laboratory teams, non-governmental organisations (e.g. Doctors Without Borders/Médecins Sans Frontières), Training Programs in Epidemiology and Public Health Interventions Network (TEPHINET) and related Field Epidemiology Training Programmes to participate in an online survey (created using Enketo and available in English and French) in May 2019 (see additional file
3 for the data dictionary of the survey). To be eligible to complete the survey, participants needed to have responded to outbreaks in World Health Organisation (WHO) grade two or three priority countries that included Afghanistan, Bangladesh, Cameroon, Central African Republic, Chad, Democratic Republic of Congo, Ethiopia, Iran, Iraq, Mali, Nigeria, Occupied Palestinian Territory, Pakistan, Somalia, South Sudan, Sudan, Syrian Arab Republic, Turkey/North Syria, Ukraine and Yemen. We selected these countries to identify tools that had been used in recent outbreaks during acute or protracted emergencies. We asked participants to identify the electronic data collection, management and analysis tools used during the outbreaks and to specify what they used the tools for. We focused on key pillars of outbreak response and asked participants to specify which electronic tools they used to collect/manage and analyse alert, case investigation, contact tracing, health promotion, case management, infection, prevention and control, laboratory, surveillance, clinical trial and water and sanitation data. We also asked participants their reasons for selecting the specific tool, and for any suggestions on how to improve the tools. In addition, participants were asked to rank and comment on data collection challenges in outbreaks.
Data analysis
Counts and proportions of data obtained either from the systematic review or the stakeholder survey were calculated using R version 3.6.1, R Foundation for Statistical Learning, Vienna, Austria. Text data from the stakeholder survey were analysed by reviewing responses and identifying the most frequently shared views.
Discussion
Capturing accurate, timely data on outbreaks is central to any outbreak response and highlighted further during the COVID-19 pandemic, as it allows timely decision making on response activities, whether localised or worldwide. The COVID-19 pandemic alone has led to the development of a number of new tools for contact tracing and other purposes used across multiple settings, although primarily in high-income countries, but also raised concerns about data protection/security [
97]. We identified a wide range of electronic tools to support data collection, management and analysis in outbreak response. Key requirements for tools selected at present include availability and whether training is needed, as well as cost, and if the software is open source. This may lead to use of tools without the optimal functionalities for outbreak response as most members of an outbreak response team, including non-analytical staff, are familiar with standard software. Specifically designed and integrated tools, can better support outbreak investigation across data collection, management and analysis. With more advanced analytics being incorporated into outbreak response and with data management being an integral part of data analysis, ease of use should not drive choice [
98]. Analytic tools used in an emergency should ideally be part of routinely used surveillance software or at least be compatible with and complement such routine surveillance software. In addition, analytic tools should also reflect the analysis and data management required for outbreak control. Supporting decision makers to consider and match the functionalities of a tool, with their requirements, is a key part of enabling optimal use of tools, as well as overcoming practical constraints through preparedness, to support training and implementation.
We identified electronic tools in the published literature as well as tools organisations recently used in outbreak response in LMICs. However, the diversity of information may be limited by the responses to the survey, which was sent out to GOARN members (200 technical institutes and over 600 partners worldwide), with only 20 organisations (four Ministries of Health from LMICs) completing the survey [
99]. In addition, the majority of respondents were epidemiologists from international organisations including MSF and the WHO and thus the results may not fully reflect the electronic tools being used across different pillars in outbreak response nor those used routinely in LMICs for outbreaks in which international organisations do not get involved. The survey did, however, support identification of tools in the grey literature, which also formed a key part of the findings of a recent review on tools used in the Ebola outbreak [
12]. In addition, the period covered by this study included the first months of the COVID-19 pandemic but we only identified one novel tool developed to support COVID-19 response [
25]. This tool called the Honghu Hybrid System incorporated clinical, laboratory and social media platform data to help COVID-19 surveillance and control. It is likely that the Honghu Hybrid System is one of many such tools that have been developed since the start of the pandemic and a COVID-19 specific review would enable the identification of further such innovations.
Despite these limitations, we identified a wide range of tools, and showed that tools which are open source are important, as well as training to support their use. Outbreak response personnel, especially front-line workers, must be trained in the use of integrated tools that can perform key basic analyses to support rapid decision making. Training on such tools during non-emergency periods is thus vital. Training initiatives such as the DHIS2 academy enable individuals to build capacity in the implementation of DHIS2 at national and higher levels outside periods of outbreaks/emergencies [
100]. Similar training initiatives could be used to strengthen capacity of front-line workers on other outbreak deployment tools and factors such as DHIS2-compatibility, being open source and having large and diverse community user bases could help narrow the scope of tools for such initiatives. Moreover, it would enable the identification of tools more likely to be maintained and developed compared to the use of more niche tools. It was surprising to find a small number of tools created for specific projects such as the AVADAR, mHealthSurvey, OlympTRIP and the Institut Pasteur applications [
57,
59,
85,
101]. Through investment in existing open-source tools, researchers and Ministries of Health could add new functionalities to these tools benefitting larger user communities and limiting the proliferation of electronic tools with similar functionalities. In addition, inclusion of regularly updated training modules (in multiple languages) within the tools themselves could offer opportunities to strengthen capacity of front-line workers during non-emergency periods.
The large number of tools for data collection, management and analysis, with similar functionalities (and limited economic evaluation) makes it difficult for decision makers to select the most appropriate tool for their needs. This range of tools has both advantages and disadvantages, as no one tool may be suitable for all types of outbreaks across multiple different contexts. Therefore, decision makers would benefit from support to match the functionalities of tools with their specific requirements and contexts. To address this point, from this study, we created an online decision-making tool (
https://uk-phrst.tghn.org/tools-platforms/tools/data-tool-finder-app/) based on data collected from this study to support organisations to identify the most appropriate tool(s) for their needs (based on data in additional file
8). The online decision-making tool enables users to select electronic tools based on their requirements, rate tools they have already used and to make suggestions of any extra tools to include in the decision-making tool. This will allow it to both identify better performing tools and to remain up to date with electronic tools being used and developed for outbreak response in LMICs. Users can take into consideration factors such as the cost, the license type, availability of a mobile application, ability to perform data visualisation and location where data are hosted.
The need for better data harmonisation and improved interoperability between tools was another key finding of this study. Improving the interoperability and harmonisation between outbreak data collection tools and broader Health Information Systems facilitating routine surveillance activities (such as DHIS2) is important. Harmonising use of data tools within and between organisations, supporting training and improving interoperability remain key to improving uptake and use of electronic tools in outbreak response in LMICs. Harmonising electronic tool use across regions would allow for the roll out of standardised training to regional and national rapid response teams and thus improve their ability to support each other during outbreaks. The current COVID-19 pandemic illustrates this further and that it is not just in LMICs where harmonisation of tools and training is required but it would be highly beneficial in all countries. All pillars of the COVID-19 response rely on data to inform interventions/actions taken from case management, contact tracing, risk communication to infection prevention and control and a harmonisation of data formats, tools and training would save countries time and financial resources.
Improving the consistency of the choice and format of data collected in emergencies is recognised internationally [
14,
15]. Using the same data templates would greatly facilitate management, analysis and sharing of data and thus more rapid and better-informed decision making. Enabling more rapid sharing of data during a pandemic such as COVID-19 within and between countries would further support more rapid and appropriate decision making. In addition, ensuring that data collectors know why they are collecting the data, how it will be used and have access to the results are all important in maintaining motivation to work in challenging outbreak environments.
In conclusion, a multi-faceted approach that considers both the type and format of data being collected, the use of integrated electronic tools that ideally function both for routine surveillance and outbreak response as well as a focus on training and ongoing capacity strengthening on data collection, management and analyses is needed to address this most urgent challenge.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.