Background
The National Malaria Control Programme (NMCP) guidelines in Burkina Faso recommend that all suspicious malaria cases should be confirmed using either a RDT or light microscopy (if available) [
1,
2]. Microscopy detecting
Plasmodium parasites in Giemsa-stained thick or thin blood slides still remains the gold standard for malaria diagnosis [
3]. The sensitivity and specificity of microscopy is however depending on the quality of the blood films, maintenance of the microscopy and training of the microscopists. Therefore, in many peripheral health settings RDTs have been introduced to fill this gap [
4]. Malaria RDTs are in principle easy to perform in the field outside of a conventional laboratory, do not need much training to be performed, are relative cheap, and give a diagnostic result within 15 min [
5].
The decision of many countries of sub-Saharan Africa (SSA), including Burkina Faso, to select malaria rapid diagnostic test detecting
Plasmodium falciparum-specific histidine-rich protein 2 (
PfHRP2) for diagnosis malaria is based on the high sensitivity and specificity reported by the World Health Organization (WHO) and Foundation for Innovative New Diagnostics (FIND) malaria RDT evaluation programme [
6]. Secondly, HRP2-based RDTs are reported to have a good thermal and humid stability compared to tests targeting
Plasmodium-specific parasite lactate dehydrogenase (pLDH) [
7]. Indeed, exposure of
PfHRP2 RDT to high temperature (up to 45°C) over a prolonged period of up to 24 months did not affect the quality of the test [
6]. However, the influence of a very high temperature (> 45 °C; which is common in several SSA countries) and humidity (> 65%) are not documented. In addition, transport and storage conditions and operator performance have been reported to influence RDT performance [
8‐
11]. Thirdly, the issue of persisting HRP2 antigens after successful treatment has been raised as a major factor contributing to reduce the specificity of
PfHRP2-based RDTs [
12‐
19]. Finally, there is also increasing concern with respect to reported false positive diagnosis by
PfHRP2 RDT in particular in low malaria transmission settings [
20].
These concerns warrant close monitoring of the performance of RDTs under field conditions. The objective of the present study was to assess the performance of the recommended HRP2 RDT by the Burkina Faso NMCP executed at peripheral level compared with the performance of the same brand of RDT in controlled conditions at a central reference laboratory with strict adherence to the manufacturer instructions.
Methods
Study design
The study was conducted between April and October 2016 in the health district of Nanoro, which is located at approximately 100 km from Ouagadougou, the capital city of Burkina Faso. Malaria is endemic with the transmission peak occurring between July and November and
P. falciparum is the predominant malaria parasite [
21]. The study was conducted as part of a large project aiming to assess fever aetiologies in Nanoro [
22]. Briefly, children under 5 years with an axillary temperature ≥ 37.5 °C presenting at one of the participating health facilities were asked to participate. After obtaining the consent from parent or legal guardian, the participant was enrolled in the study. The malaria RDT used to screen febrile children at recruitment in the health facilities during the study period was the HRP2-based RDT specific to
P. falciparum (SD Ag Bioline
Pf: Standard Diagnostics, Hagal-Dong, Korea). Information on lot number and expiration date was not collected. The result of malaria RDT testing in the health facilities was recorded on a case record form.
After inclusion, a blood sample was collected for each child in ethylene diamine tetra acetic acid (EDTA) tube, transported under cold conditions in an ice-box at the laboratory of Clinical Research Unit of Nanoro (CRUN). Expert malaria microscopy was performed by expert laboratory technician from blood collected in EDTA tube before stored at − 20 °C until retesting. The retesting is done at the laboratory of CRUN with experimented technician with a PfHRP2 RDT of the same manufacturer (SD Ag Bioline Pf: Standard Diagnostics, Hagal-Dong, Korea: Lot number: 05EDC002A; Expiration date: 01/03/2019). The RDTs are transported and stored according to the manufacturer’s instructions. Standard Operating Procedures (SOPs) for ordering, transportation, storage and performing malaria RDTs are in place at CRUN. Blood samples are thawed at room temperature before retesting.
Laboratory procedures
For retesting in the CRUN laboratory, the blood sample was thawed at room temperature and the diagnostic test was performed according to the manufacturer’s instructions. One trained technician performed the RDT, but the result was read by two technicians and in case of a discordant opinion a third reader would be consulted. The laboratory technicians who repeated the malaria RDT were blinded from the malaria RDT results obtained at the health facilities and the RDT test results were reported on separate case record forms.
Malaria slide reading was performed by expert microscopists who are participating in an external quality programme and only certified microscopists were allowed to read the slides. The limit of detection (LoD) of this expert microscopy was 10 parasites per µl [
23]. Thin films were fixed with methanol and blood slides were stained with 3% Giemsa solution (pH 7.2) for identification and quantification of asexual
P. falciparum and other
Plasmodium species. Parasites densities were determined by counting the number of asexual parasites per 200 white blood cells, and calculating per μl of blood by assuming the number of white blood cells to be at 8000 per μl. Thick blood smears were considered negative when the examination of 200 fields per thick film did not reveal the presence of any asexual parasites. Each blood slide was read by two independent expert readers, and in case of discordance (positive
vs negative, different in
Plasmodium species, difference in parasite density > Log10 or ratio > 2 in case of parasite density ≤ 400/µl or > 400/µl, respectively), the blood slide was read by a third independent reader. Positive microscopy results were recorded as the geometric means of the two reader’s results or the geometric means of the two geometrically closest reading in case of third reading. These results were expressed as asexual parasites per μl by using the patient’s white blood cell (WBC) count. A selection of slides (5%) was re-read by an independent expert microscopist for quality assurance. All microscopists were blinded from the results obtained with the different malaria RDTs.
Ethical approval
The study was approved by the National Ethical Committee in Health Research, Burkina Faso (Deliberation N°2014-11-130). The study was also approved by the health district authorities and community leaders of different villages before implementation.
Data analysis
Double entered data was done using Excel 2016. The data analysis was done with R software version 3.3.1 (R Foundation for Statistical Computing, Vienna, Austria). For the quantitative data, the descriptions were performed by using mean or median respectively. Proportion was used to describe qualitative data. The evaluation of the performance of the malaria RDT performed by nurses at health centres level was done by comparing the results of
PfHRP2 tests performed in the field by health facilities nurses to those repeated in CRUN laboratory by trained technicians. Proportions were used to present the concordance and discordance between the two tests performed in malaria positive and negative groups. Fisher exact test was used to compare the proportions by estimating the p-value (p ≤ 0.05) as statistically significant. Agreement between each RDT test and microscopy and between the two RDTs tests was determined by calculating Kappa (κ) values with 95% confidence intervals by using GraphPad software (
https://www.graphpad.com/quickcalcs/).
Discussion
Rapid diagnostic tests for malaria are widely implemented by National Malaria Control Programmes in endemic countries, including Burkina Faso, in order to meet the WHO requirement of confirming a malaria infection before starting a treatment [
1,
2]. RDTs are hence increasingly replacing (expert) microscopy in many settings, but there is a concern about the diagnostic accuracy of HRP2-based RDTs. Several studies reported a lower sensitivity of RDTs compared to expert microscopy when the parasitaemia is < 200 parasites/µl [
24]. This situation is exacerbated by the fact that
PfHRP2 polymorphisms are being reported and that certain deletions in this gene may negatively affect RDT performance [
25‐
27]. These
PfHRP2 gene deletions have so far not been found in Burkina Faso, but do occur in neighbouring Mali [
25]. However, a sensitivity issue was not observed in the present study. There was no significant difference in test sensitivity when the RDT was performed by the two different groups of operators (nurses in the rural health facilities compared to trained laboratory technicians). Importantly, the RDT sensitivity and NPV achieved by both groups almost reached the level of expert microscopy. Only few false negative results were reported with the employed RDTs.
In contrast, the specificity (and subsequently the PPV) of the RDT was worrying low (52.8%) when the test was performed by the nurses at the health facilities level. This is also reflected in the observed agreement between the tests. Overall, the agreement between expert microscopy and Lab-HRP2 was good, but moderate between HF-RDT and expert microscopy. This could be explained by the fact that the HF-RDT was more often false positive. In general, the specificity of the HRP2-based RDTs is being questioned particularly under low transmission conditions [
20]. This is supported by one of previous studies conducted in the same study area in which a high prevalence of false positive RDT results was reported during the dry season (April–May; low transmission) [
22]. However, the present study was mainly conducted during the rainy season (June–October; high transmission season) but still the number of false positive tests was almost twofold higher at the participating health facilities compared to the laboratory of CRUN. It is more obvious that the number of false positive cases could thus be higher if the study was conducted mainly during the dry season.
HRP2 persistence after a successful treatment is often used as an explanation for the lower specificity of RDTs that are based on the detection of this specific antigen [
12‐
19]. This can however not explain the difference in the test performance observed between the two different groups of operators (i.e. health facility nurses vs laboratory technicians). Several other factors can influence the RDT performance including incorrect test execution and reading of RDT results by health facility nurses whilst performing the test [
9,
10]. Also operator errors such as incorrect application of the blood sample or running buffer on the test device, substituting test kit buffer solution with other liquids such as normal saline, diluted water, tap water or buffer from different kits/lots/batches or faulty test devices can affect the test performance by health facility nurses [
11]. A very long-reading time could also explain the high positive rate of false positive at health levels. Some non-specific binding or interaction with other immunological or infection factors, such as rheumatoid factors, hepatitis C, schistosomiasis, toxoplasmosis, dengue, leishmaniasis, Chagas’ disease and human African trypanosomiasis can lead to a malaria false positive reaction on a HRP2-based RDT, though considered to be rare [
6,
28‐
36]. It is, therefore, crucial to ensure adequate training of the health workers who perform the RDT and periodically monitor the execution of malaria RDT by the health workers [
37].
According to the WHO testing report and the RDT manufacturer information note, the
P. falciparum specific HRP2-based RDT can stand up to 40 °C for 24 months [
6]. However, in Burkina Faso, the mean maximum temperature can reach 45 °C in the dry season [
38]. The participating health facilities in this study had no air-conditioning system or temperature and humidity monitoring system in their store room. This can severely affect the test performance as previously reported [
8,
39,
40]. Moreover, periodical quality checks of the RDT at the health facilities are not in place. The above-mentioned issues should all be addressed when implementing the malaria
PfHRP2 RDT.
Finally, the blood specimen used to perform the malaria RDTs in the field was a capillary sample and the one used to perform malaria RDTs in the central laboratory was from venous blood. It has been reported that the sensitivity of malaria tests (i.e. microscopy) depend on the site of blood collection, in particular in asymptomatic malaria cases. Capillary blood tends to be more sensitive than venous blood [
41]. However, the clinical symptoms of malaria infection, including fever, occur in synchrony with the rupture of infected erythrocytes and the release of these erythrocytes and malaria debris in circulating blood [
42,
43]. So, it is obvious that symptomatic malaria, which was studied in the present research, will be detectable in capillary blood as well as venous blood.
Authors’ contributions
FK, HS, PM, HT and MBvH conceived and designed the study. FK, MT and MB supervised patient inclusion, signature of informed consent and diagnostic specimen collection by study nurses. KF, MT and MB performed/supervised the laboratory analyses (malaria microscopy and the retest of malaria RDTs). FK analyzed the data under the supervision of a biostatistician. FK and HS drafted the manuscript and all authors commented on draft versions. All authors read and approved the final manuscript.