Skip to main content
Erschienen in: Malaria Journal 1/2016

Open Access 01.12.2016 | Research

The diagnostic accuracy of the hand-held Raman spectrometer for the identification of anti-malarial drugs

verfasst von: Benjamin J. Visser, Sophia G. de Vries, Emmanuel B. Bache, Janneke Meerveld-Gerrits, Daniëlle Kroon, Jimmy Boersma, Selidji T. Agnandji, Michèle van Vugt, Martin P. Grobusch

Erschienen in: Malaria Journal | Ausgabe 1/2016

Abstract

Background

There is a need for accurate and field-applicable instruments for the evaluation of the quality of anti-malarial drugs. The aim of this study was to determine the diagnostic accuracy of the NanoRam®, a handheld Raman spectrometer (RS), to identify anti-malarial drugs.

Methods

In total, 289 anti-malarial drugs collected in a randomized field survey in Gabon were evaluated. The samples were compared with authentic products as supplied by the official manufacturer. To determine the sensitivity and specificity of the handheld NanoRam® spectrometer in the identification of anti-malarial drugs, a two-gate reversed-flow design was applied. The standards for reporting of diagnostic accuracy studies (STARD) were followed. The index test was the handheld RS. The reference test standards were thin layer chromatography and high performance liquid chromatography with ultraviolet photo diode array detection.

Results

The sensitivity [95 % confidence interval (95 % CI)] and specificity of the RS to correctly identify an anti-malarial drug were 100 % (95 % CI 94.9–100 %) and 96 % (95 % CI 92.3–99.0 %), respectively. The RS could not differentiate between different batches of the same product or different manufacturers of the same product. Intra-observer agreement for 289 samples was 100 %. The average time to conduct the RS was 15 s per sample compared to 45 min per sample for TLC.

Conclusion

The handheld RS holds promise as an easy-to-use, quick and field-applicable instrument for the evaluation of quality of anti-malarial drugs, potentially empowering pharmacists, drug inspectors and medical regulatory authorities.
Trial registration NTR4341 (Dutch Trial Registry)
Hinweise

Electronic supplementary material

The online version of this article (doi:10.​1186/​s12936-016-1212-y) contains supplementary material, which is available to authorized users.
Abkürzungen
ACT
artemisinin-based combination therapy
AL
artemether–lumefantrine
AMC
Academic Medical Center
API
active pharmaceutical ingredient
CERMEL
Centre de Recherches Médicales de Lambaréné
GPHF
The Global Pharma Health Fund
HPLC
high-performance liquid chromatography
INN
international non-proprietary name
MEDQUARG
medicine quality assessment reporting guidelines
RS
Raman spectrometer
SP
sulfadoxine–pyrimethamine
TLC
semi-quantitative thin-layer chromatography
USP
US Pharmacopeia
UV
ultraviolet-visible
WHO
World Health Organization

Background

Poor-quality, falsified (counterfeit), substandard and degraded anti-malarial drugs (for definitions see [1]) are important impediments to public health. Studies have highlighted the magnitude of the problem of poor quality anti-malarial drugs [28]. According to the latest World Health Organization’s (WHO) estimates, released in December 2015, there were 214 million cases of malaria in 2015 and 438,000 deaths [9]. Early diagnosis and treatment with appropriate anti-malarial drugs are pivotal [10]. The WHO recommends artemisinin-based combination therapy (ACT) for the treatment of uncomplicated falciparum malaria [1113]. Negative consequences arise from the use of poor-quality anti-malarial drugs. Anti-malarials with low amounts of active pharmaceutical ingredients (APIs) may cause increased morbidity and mortality [14]. An estimated 122,350 [interquartile range (IQR): 91,577–154,736] under-five malaria deaths are associated with the use of poor-quality anti-malarials, representing 3.75 % (IQR: 2.81–4.75 %) of all under-five deaths in a sample of 39 countries [15]. However, these results should be interpreted with caution since there are large gaps in data prevalence of poor-quality anti-malarials [3, 16] and in case fatality rates [15]. As well, inadequately low concentrations of the APIs in poor-quality drugs may result in sub-therapeutic concentrations of the drug in patients, which may engender drug resistance [17]. Furthermore, the use of poor-quality anti-malarial drugs leads to significant socio-economic losses for patients and their kin, health-care systems and pharmaceutical industries producing the genuine product [18]. Societies can lose confidence in a pharmaceutical brand, drugs, pharmacies, and health-care providers [2].
The spread of poor-quality anti-malarial drugs increases the need for rapid detection of such medicines throughout the supply chain. The paucity of quality assurance laboratories in Africa with appropriate analytical capabilities (in terms of personnel and equipment) slows down the fight against poor-quality medicines. Several screening methods have been used, or have been investigated for use in screening drug quality in low-resource settings. The aim of a screening tool in drug quality surveys is to minimize the number of anti-malarial drugs that will undergo reference-standard testing in a (resource-limited) laboratory. Furthermore, the ideal screening tool should be low-cost, easy-to-use (not requiring specialist training), sustainable (especially in humid and hot climates) and easy and affordable to be repaired (locally). Ideally, the integrity of the sample should be sustained. Moreover, the total cost of identifying a conspicuous sample should be economically balanced in relation to the screening survey as a whole. Semi-quantitative thin layer chromatography, which was further developed by the Global Pharma Health Fund (GPHF), “the Minilab®”, has been available since the past couple of years [19, 20]. This technique is applicable in the field and relatively cheap (approx. 4500€ in 2014) but requires training, the use of chemicals, and is labour-intensive [21]. It can be used to identify the API and can therefore be used as a screening tool to detect falsified medicines. It is, however, a semi-quantitative method and results should, therefore, be confirmed using more accurate methods, such as high-performance liquid chromatography (HPLC) [1].
Non-invasive (non-destructive) methods as a screening and identification tool of APIs have recently gained more scientific interest [22, 23]. A recent report evaluated the TruScan® Raman device (using inelastic light scattering) for testing pharmaceutical products in the field to detect falsified and substandard medicines [24]. Six pharmaceutical products were under investigation, including analgesics and antidiarrhoeal medicines. It was shown that it could detect falsified drugs, but was not able to discriminate between good-quality and sub-standard drugs. The possibilities of Raman spectroscopy as a fast and reliable screening method for the detection of falsified artesunate tablets were investigated before, with the Renishaw System-1000® spectrometer (Wotton-under-Edge, UK), connected to a conventional light microscope. The method was able to distinguish between genuine and falsified artesunate and to identify the composition of the falsified tablets [25]. It was demonstrated that the results of the Raman spectroscopy method were in agreement with those of colourimetric tests and of liquid chromatography-mass spectrometry of artesunate. The present study aims to explore the ability of Raman spectroscopy (RS) performed by the NanoRam® handheld device to identify anti-malarial drugs and to differentiate between similar anti-malarial drugs. The diagnostic accuracy (sensitivity and specificity) of RS was determined, compared to thin layer chromatography (TLC).

Methods

Anti-malarial drugs tested

The samples used in this pilot study were collected in a randomized field survey of anti-malarial drugs in Gabonese pharmacies [21], following the medicine quality assessment reporting guidelines (MEDQUARG) [1]. The randomized field survey was registered in advance (Trial registration number: NTR4341 [26]). Also, the costs of the present study are reported [27] (Additional file 1). Scientific clearance for the field survey was obtained from the Scientific Review Committee (SRC) of the Centre de Recherches de Médicales de Lambaréné (CERMEL), Albert Schweitzer Hospital (SRC number: 2013.11). The Ethical Committee of CERMEL decided that ethical approval of the field survey study was not required, as the study is a health care quality assurance study, no humans having been subjected to observation or intervention. The detailed methods were described earlier [21, 26]. In brief, anti-malarial drugs were collected by local fieldworkers from randomly selected pharmacies. In total 432 samples were collected, of which 289 were tested in the present study. Not all samples could be tested with the handheld Raman spectrometer (RS) because no reference standards of all the anti-malarial drugs could be obtained from the producing pharmaceutical companies; or the dosage form was not suitable for the handheld RS (e.g., capsule instead of tablet or liquid form); or no material was left from the collected sample (Fig. 1). The following five anti-malarial drugs were evaluated: artemether–lumefantrine (AL, n = 150), quinine (Q, n = 40), sulfadoxine–pyrimethamine (SP, n = 38), dihydroartemisinin–piperaquine (DHA–PQ, n = 32), and artesunate-SP (AS–SP, n = 31). These anti-malarials were produced by multiple pharmaceutical companies (Table 1). For analytical purposes, paracetamol (also known as acetaminophen) 500 mg [collected in the pharmacy of the Academic Medical Center (AMC)] was included since it is readily available and would be useful for studying the ability of the handheld RS to differentiate between different products.
Table 1
Summary of formulations tested with the brand name, dose, dosage form and manufacturer
Pharmaceutical product
Generic name and dose
Manufacturer or distributor
Arsiquinoforme®
Quinine tablet 250 mg
Sanofi Aventis
Artediam®
Artesunate–amodiaquine tablet 100/300 mg
Adams Pharmaceutical (Anhui) Co., Ltd
Artefan®
Artemether–lumefantrine tablet 20/120 mg
Ajanta Pharma Ltd, India
Artemether–lumefantrine tablet 80/480 mg
Artim®
Artemether–lumefantrine tablet 40/240 mg
Twight Litaka Pharma Limited Ltd, India
Artiz (Forte)®
Artemether–lumefantrine tablet 40/240 mg
Alice Pharma Pvt Ltd, India
Artemether–lumefantrine tablet 20/200 mg
Bimalaril®
Artemether–lumefantrine tablet 80/480 mg
Bengba Pharmaceutical factory, China
Coartem®
Artemether–lumefantrine tablet 20/120 mg
Novartis Pharma, Netherlands
Co-artemax®
Dihydroartemisinin–piperaquine tablet 40/320 mg
GA Pharma, Greece
Cofantrine®
Artemether–lumefantrine tablet 20/120 mg
EGR Pharma, Luxembourg
Artemether–lumefantrine tablet 80/470 mg
Colart®
Artemether–lumefantrine tablet 20/120 mg
Glaxo Smith Kline Group
Combimal®
SP tablet 500/25 mg
Ajanta Pharma Ltd, Mauritius
Darte-Q®
Dihydroartemisinin–piperaquine tablet 40/320 mg
Gosun Pharma Corp, China
Duo-Cotecxin®
Dihydroartemisinin–piperaquine tablet 40/320 mg
Beijing Holley-Cotec Pharmaceutical Ltd, China
Falquin®
Quinine tablet 300 mg
Plethico pharmaceutical Ltd, India
Fansidar®
SP tablet 500/25 mg
F.Hoffmann La Roche Ltd, Switzerland
Lariam®
Mefloquine tablet 250 mg
F.Hoffmann La Roche Ltd, Switzerland
Lufanter®
Artemether–lumefantrine 20/120 mg
Bliss Gvs Pharma Ltd, India
Artemether–lumefantrine tablet 80/480 mg
Lumart®
Artemether–lumefantrine tablet 20/120 mg
Cipla Ltd, India
Artemether–lumefantrine tablet 40/240 mg
Malacur®
Dihydroartemisinin–piperaquine tablet 40/320 mg
Elder pharmaceuticals LTD, India
Maloxine®
SP tablet 500/25 mg
Gracure Pharmaceuticals Ltd, India
Mephaquin®
Mefloquine tablet 250 mg
Mepha Ltd, Switzerland
Paracetamol
Paracetamol tablet 500 mg
Actavis/Allergan, Netherlands
P-Alaxin®
Dihydroartemisinin–piperaquine tablet 40/320 mg
Bliss Gvs Pharma Ltd, India
Quinimax®
Quinine 500 and 125 mg
Sanofi Aventis
R-Lume®
Artemether–lumefantrine tablet 80/480 mg
Impact Healthcare Pvt Ltd, India
Surquina®
Quinine tablet 250 mg
Laboratoire Innotech International, France

Reference test: thin-layer chromatography

Detailed reference test methods have been described before [16]. GPHF Minilab® [20] was used to run semi-quantitative thin-layer chromatography (TLC) and disintegration testing to measure the concentration of APIs. The samples failing the TLC test were analysed by HPLC, for confirmation. The MiniLab® protocols award products a ‘pass’ for TLC if 80 % or more of the labelled active ingredient(s) is present. For fixed-dose combinations (e.g., AL) and SP, ‘pass’ was awarded only if both active ingredients met this standard. TLC is an accepted method to assess the quality of drugs [2830].

Index test

The present study was conducted in June and July 2015 at the AMC, University of Amsterdam, The Netherlands. All the tests were carried out in similar environmental conditions of light (±500 Lux), humidity (70 %) and temperature (±21 °C). The index test was conducted by BJV, the reference test by BJV and JMG (TLC) and H. Kaur, London School of Tropical Medicine and Hygiene, UK (HPLC). Inter-observer agreement was calculated for the TLC test, but not for the HPLC and index test. The researcher conducting the index test was not blinded to the outcome of the reference test. The index test and reference test are seldom perfect; therefore, the test reproducibility was calculated using the kappa, the intra-observer agreement [31]. All the index tests were conducted in duplicate.

Index test: Raman spectrometry-technique

Raman spectrometry (inelastic light scattering or “Raman scattering”) is a light-scattering process in which the sample under examination is irradiated with intense monochromatic light; the light scattered from the specimen is analysed for frequency shifts (Fig. 2) [32]. This technique can be used to observe vibrational, rotational, and other low-frequency modes in a material [33]. Raman spectrometry is particularly sensitive to non-polar bonds (e.g., C–C single or multiple bonds) and less sensitive to polar bonds [22]. In chemistry, it is frequently used to provide a “fingerprint” by which a molecule can be identified [34].

Index test: equipment

The NanoRam® hand-held RS was used in this study (Fig. 3). The device (model: BWS456, Serial Number: SAMLNA, manufactured in March 2014) was rented from B&W Tek, Inc. 19 Shea Way, Newark, Delaware, USA, 19713). The NanoRam® is a hand-held Raman instrument for non-destructive identification and verification of materials such as APIs, excipients, intermediates and finished products (see Additional file 2 for specifications). The use of the device does not require any training, and handling can be managed by untrained non-specialist users. An advantage of this technique is that it can analyse drugs through transparent containers (blisters), maintaining the integrity of the sample. Raman spectroscopy is an approved method by the U.S. and European Pharmacopoeia [35], as well as the Pharmacopoeia of the People’s Republic of China [36].

Index test: factory calibration of the NanoRam®

The device used had been calibrated according to B&W Tek, Inc. calibration procedures to a Raman shift accuracy of ±4 cm−1. Standard calibration procedures included the creation of a calibration set using B&W Tek, INc. SCL series Spectral Calibration Lamps (Mercury and Argon) and Polystyrene Calibration Cap. SCL 100 series Light Sources have a wavelength accuracy of ±0.1 nm. The spectral line data for Mercury (Hg) and Argon (Ar) are referenced in “Wavelength and transition probabilities for atomic ions, part 1—wavelength”, a publication of the National Standards Reference System, National Institute of Standards and Technology, U.S. Department of Commerce [37]. The calibration was conducted on 30-7-2014 and is valid for a year.

Index test: establishment of a spectral reference library

The NanoRam® spectral device includes a library of 110 API’s. However, no spectral references for anti-malarial drugs were provided with the NanoRam. Therefore, the spectra of different anti-malarial drugs which are known to be of good quality and which exhibit the variation (manufacturer, batch, crystal modification, particle size) typical of the anti-malarial to be analysed, were created using the instrument’s built-in method without modification. For each reference spectrum, 20 runs (scans) are necessary. This spectrum or signature is used to compare with spectra of other test samples. In this study, only samples provided by the producing pharmaceutical company were considered as ‘reference samples’. Libraries for different anti-malarial drugs and dosages were created (AL, DHA–PQ, Q, AS–SP, SP; for example libraries see Additional file 3). Match-or-fail comparison decisions were performed by the built-in software. Tablets (remaining inside the transparent blisters) were placed in front of the laser. Raman bands [Wave number (cm−1)] can be assigned to corresponding functional groups. The Raman characteristic frequencies of organic molecules and inorganic compounds have been described elsewhere [3840]. The main outcomes of the test of a sample are a ‘match or fail’ result. This match-or-fail outcome is based on the p value automatically calculated by the handheld RS between the comparator (the reference spectrum) and the spectra of the sample under investigation.

Study design and statistical methods

Where appropriate, the standards for reporting of diagnostic accuracy studies (STARD) were followed [41] (Additional file 4). To determine the sensitivity and specificity of the handheld device in the identification of anti-malarial drugs, a two-gate reversed-flow design was applied [42]. The index test (Raman spectroscopy performed by the NanoRam® handheld spectrometer) and reference standard (thin layer chromatography and high performance liquid chromatography with ultraviolet photo diode array detection) were performed in reverse order. Reversing the order in which the index test and reference standard are conducted will not change the estimates of diagnostic accuracy. This type of design was chosen because of practical reasons since the samples were evaluated in another study already [21], and the RS was not yet available in our laboratory. In the preferable one-gate design, cases and controls are sampled from the same pool (anti-malarial drug collection); this was however not possible due to a lack of ‘cases’ (falsified drugs), thus a two-gate design was necessary (see below). To achieve sufficient power for the diagnostic accuracy calculations, the sample size was calculated as described in the sample size methods by Flahault et al. [43]. When the prevalence of poor quality drugs is less than 50 %, two assumptions ought to be made: the expected specificity (or sensitivity) values of the new diagnostic test, and the minimum acceptable lower confidence limit. For the NanoRam®, two studies showed high sensitivity and specificity, but exact numbers were not reported [24, 25].
Assuming that the specificity will be high, at the minimal acceptable confidence limit of 0.7 (together with the required probability which was set here at 0.95 that this limit is not violated), the minimum number of falsified or poor-quality samples required is 24 [43]. The prevalence of poor-quality drugs in Gabon is 0.5 % [(95 % CI 0.08–1.84 %) [21]. Using the prevalence of 0.5 %, the number of controls would be 199, using the equation Ncontrols = Ncases × [(1 − Prevalance)/Prevalence]. The controls come from the same pool as the cases, thus the definite sample size is 223. Since the reference test was already conducted before the index test, it was known that only two samples were of poor quality [21]. Therefore, 24 − 2 = 22 extra controls were added (“falsified anti-malarial drugs”: in this model paracetamol 500 mg was used). This two-gate model is an accepted design in the early investigation of a new diagnostic test [42], it has, however, been criticized for leading to inflated estimates of accuracy. Paracetamol was used since this product has been sold frequently as being an anti-malarial drug in South East Asia [44] and is readily available.
Data was analysed using SPSS (Version 21.0, IBM, NY, USA). The results of each diagnostic test of every sample were recorded in Excel and SPSS. The diagnostic accuracy was defined by sensitivity and specificity with 95 % confidence intervals (CIs), which were computed as by standard literature [45, 46]. A cross tabulation of the index text results by the results of the reference test was conducted.

Results

In this study, a total of 289 anti-malarial drugs were tested (Fig. 1). The index test was conducted within 8 months after the reference test. All samples were tested while remaining in their transparent blisters, except for DHA–PQ tablets (n = 32, 11 %): the blisters were transparent but the tablets have a thick blue coating resulting in a lack of penetration of the laser. These tablets were broken into half with a pill splitter, and subsequently tested. On average, a reference spectrum of an anti-malarial drug (20 runs) could be created within 3.5 (min–max: 3–6) minutes. The average time to conduct a match/fail analysis for one sample was 15: 10 s of entering data (name and sample number of the drug under investigation) and 5 s for scanning the drug sample and obtaining a match/fail result. In comparison, the semi-quantitative layer chromatography technique used by the GPHF MiniLab® costs on average approximately 45 min processing time per sample.

Precision test of the NanoRam spectrometer

To investigate the capability of the NanoRam spectrometer to produce reproducible results, a match/fail analysis using a reference tablet was compared with the reference spectrum of the same sample. All the precision tests were conducted under the same circumstances and in duplicate. AL, DHA–PQ, Q, SP, AS–SP and paracetamol were utilized in different strengths. Table 2 depicts the results of the precision tests, Figs. 4a–d and 5a, b show examples of the precision test. Important to note is that the results of the match/fail scans are adjusted for the concentration of API in the tablet. For example, a match/fail test of AL 40/240 mg tablet matched the NanoRam’s reference spectrum of AL 20/120 mg tablet. In strict sense, this should be a “fail”. However, the NanoRam spectrometer only measures the concentration of the API in the tablet, and does not take into account tablet size or total weight, which may differ between different strengths of the same drug. In this particular case, the 40/240 mg dosage contained the same concentration of API as the 20/120 mg tablet, but the tablet was twice as big.
Table 2
Precision tests
Sample
Number of reference samples
Number of samples matching signature
Percentage of match (%)
Artemether–lumefantrine 20/120, 40/240, 80/480 mg
72
72
100
Quinine sulphate 300 mg
35
35
100
Dihydroartemisinin–piperaquine 40/320 mg
12
12
100
Artesunate–sulfamethoxypyrazine–pyrimethamine 100/250/12,5 mg
14
14
100
Paracetamol 500 mg
48
48
100

Diagnostic accuracy of the RS

To investigate the sensitivity and specificity of the device, different comparison scenarios to assess the ability of the RS to discriminate between different samples were evaluated. First, the diagnostic accuracy of the RS to correctly identify the API in the anti-malarial drug was determined. The 289 anti-malarial drugs plus additional fakes (22 paracetamol 500 mg tablets) were analysed with the RS. The sensitivity and specificity were 100 % (95 % CI 94.9–100 %) and 96.2 % (95 % CI 92.3–99.0 %) respectively (Table 3). The falsified AL sample was correctly identified as having no API inside the tablets (Fig. 6). The suspected SP sample which failed the TLC test, was demonstrated with HPLC to contain the stated API, but the amount was approximately halve of the dose. The API was not identified by the NanoRam and thus “failed” the test (Fig. 7). However, the device suggested the API SP as closely related to the generated spectrum. 11 samples of SP “failed” the RS test, but passed the reference test. These 11 SP samples failed the RS test again in the subsequent round. The device suggested the API SP as closely related to the generated spectrum. Difficulty in using Raman spectroscopy in identifying SP has been previously reported [47]. A reason for this is the high fluorescence of SP itself. The 22 paracetamol tablets were all correctly identified as being a non-malarial drug.
Table 3
2 × 2 Table Raman spectroscopy vs. thin-layer chromotography
 
Falsified/cases (fail TLC)
Non-falsified/controls (pass TLC)
Total
Fail RS
24 (TP)
11 (FP)
35
Pass RS
0 (FN)
276 (TN)
276
Total
24
287
311
TP true positive, FP false positive, FN false negative, TN true negative, RS Raman spectroscopy, TLC thin-layer chromotography

Comparison of different lots of the same product

AL, Q, SP were used in this test. One batch of AL (Coartem, Novartis, Batch: X1639) was used to generate a Raman reference spectrum. This reference spectrum was compared to samples of the same batch (X1639), and 35 samples of 15 selected other batches of the same manufacturer Novartis. All samples matched to the comparator batch. For SP and Q, no differences between different lots of the same product could be identified.

Comparison of similar products from different manufacturers

The capacity of the RS to discriminate between similar products from different pharmaceutical companies was also investigated (Table 1). The RS could not discriminate between products with the same API from different manufacturers.

Discussion

This study represents the first evaluation of the diagnostic accuracy of the NanoRam® spectrometer to identify and discriminate between anti-malarial drugs. The results suggest that the handheld NanoRam® spectrometer has a high sensitivity and specificity to identify anti-malarial drugs. All falsified anti-malarials were detected by the RS. Some samples (n = 11, only SP) contained the stated API, but still failed the test (“false positives”). The results suggest that the NanoRam® can be used to screen large quantities of anti-malarial drugs in a fast and non-destructive way, but caution is required when screening SP tablets. Minimal training was required and agreement between the tests was 100 %. Reference standards for the NanoRam® are not provided with the device but can be easily created and shared between users around the globe.

Strengths and limitations

The major strength of the present study is the large number of different random collected anti-malarial samples, which enabled us to investigate and create different reference spectra for the anti-malarial drugs. Another strength is that the sample size was sufficient to calculate the diagnostic accuracy. A major limitation of this study is that the reference standard is a semi-quantitative method, and that the sensitivity of the reference method is limited [48]. This means that false negatives might be present. The probability of false positives has been reduced, by analysing the samples failing TLC also with HPLC. It was not possible to analyse all samples with HPLC because the funds for this study were insufficient (HPLC of all samples costs approximately 14,000€). An important next step for further research should be an evaluation of the diagnostic accuracy of the handheld RS compared to the reference standard HPLC. Another limitation of our study is that we had a number of missing reference samples and had to exclude 143 anti-malarial samples. Moreover, the number of ‘true’ falsified anti-malarials was small, and an extra case group (paracetamol tablets) had to be added, which is a source of bias and might have led to an overestimation of the diagnostic accuracy. Another potential source of bias is that the investigator could not be blinded for the results of the reference test; this risk is minimal because the device provides a ‘pass’ or ‘fail’ with a p value, leaving little room for interpretation errors. Lastly, a limitation of this study is that the ability of the handheld RS device to discriminate between different dosage strengths as an indicator of the quality of anti-malarial drugs was not investigated. The number of different samples with different dosages for this analysis was insufficient. The ability to differentiate between dosages is important since products with reduced APIs have been produced.
The handheld RS (NanoRam®) device is commercially available but expensive. However, it could be cost-effective to have a device as a medicine regulatory authorities since it can reduce the number of products that will undergo reference testing in specialized laboratories overseas, which is time-consuming and even more expensive.

Conclusion

The results have demonstrated that Raman spectroscopy performed by the NanoRam® has a high sensitivity and specificity to identify and discriminate between anti-malarial drugs. In future medicine quality surveys, a handheld RS, preferably in combination with reference methods such as HPLC, may become the preferred method to assess the quality of large quantities of anti-malarial drugs throughout the supply chain. Hence, a handheld RS can be a valuable tool in the ultimate goal of malaria elimination.

Authors’ contributions

BJV and MPG conceived the study. BJV and DK collected the samples. BJV and JMG conducted the thin-layer chromatography tests. BJV performed the statistical analysis and wrote the first draft of the manuscript. BJV conducted the analysis with the NanoRam®. SGV, EBB, AST and JB contributed to the manuscript. EBB and AST wrote the French abstract. MPG, AST and MVV supervised the study and contributed to the writing of the final version of the manuscript. All authors have agreed to be fully accountable for all aspects of this work. All authors read and approved the final manuscript.

Acknowledgements

We would like to thank Roseline Koumba and Brigitte Migombe of Centre de Recherches Medicales de Lambaréné (CERMEL) for their supportive field assistance. Dr. H. Kaur for conducting the HPLC tests of one AL-sample and one SP-sample, and the manufacturers of the anti-malarial drugs for providing reference samples.

Competing interests

The authors declare that they have no competing interests.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://​creativecommons.​org/​licenses/​by/​4.​0/​), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://​creativecommons.​org/​publicdomain/​zero/​1.​0/​) applies to the data made available in this article, unless otherwise stated.
Literatur
1.
Zurück zum Zitat Newton PN, Lee SJ, Goodman C, Fernandez FM, Yeung S, Phanouvong S, et al. Guidelines for field surveys of the quality of medicines: a proposal. PLoS Med. 2009;6:e52.CrossRefPubMed Newton PN, Lee SJ, Goodman C, Fernandez FM, Yeung S, Phanouvong S, et al. Guidelines for field surveys of the quality of medicines: a proposal. PLoS Med. 2009;6:e52.CrossRefPubMed
2.
Zurück zum Zitat Chaccour C, Kaur H, Del Pozo JL. Falsified antimalarials: a minireview. Expert Rev Anti Infect Ther. 2015;13:505–9.PubMed Chaccour C, Kaur H, Del Pozo JL. Falsified antimalarials: a minireview. Expert Rev Anti Infect Ther. 2015;13:505–9.PubMed
3.
Zurück zum Zitat Tabernero P, Fernandez FM, Green M, Guerin PJ, Newton PN. Mind the gaps–the epidemiology of poor-quality anti-malarials in the malarious world–analysis of the WorldWide antimalarial resistance network database. Malar J. 2014;13:139.CrossRefPubMedPubMedCentral Tabernero P, Fernandez FM, Green M, Guerin PJ, Newton PN. Mind the gaps–the epidemiology of poor-quality anti-malarials in the malarious world–analysis of the WorldWide antimalarial resistance network database. Malar J. 2014;13:139.CrossRefPubMedPubMedCentral
4.
Zurück zum Zitat Almuzaini T, Choonara I, Sammons H. Substandard and counterfeit medicines: a systematic review of the literature. BMJ Open. 2013;3:e002923.PubMedPubMedCentral Almuzaini T, Choonara I, Sammons H. Substandard and counterfeit medicines: a systematic review of the literature. BMJ Open. 2013;3:e002923.PubMedPubMedCentral
5.
Zurück zum Zitat Nayyar GM, Breman JG, Newton PN, Herrington J. Poor-quality antimalarial drugs in southeast Asia and sub-Saharan Africa. Lancet Infect Dis. 2012;12:488–96.CrossRefPubMed Nayyar GM, Breman JG, Newton PN, Herrington J. Poor-quality antimalarial drugs in southeast Asia and sub-Saharan Africa. Lancet Infect Dis. 2012;12:488–96.CrossRefPubMed
6.
Zurück zum Zitat Newton PN, Amin AA, Bird C, Passmore P, Dukes G, Tomson G, et al. The primacy of public health considerations in defining poor quality medicines. PLoS Med. 2011;8:e1001139.CrossRefPubMedPubMedCentral Newton PN, Amin AA, Bird C, Passmore P, Dukes G, Tomson G, et al. The primacy of public health considerations in defining poor quality medicines. PLoS Med. 2011;8:e1001139.CrossRefPubMedPubMedCentral
7.
Zurück zum Zitat Newton PN, Green MD, Mildenhall DC, Plancon A, Nettey H, Nyadong L, et al. Poor quality vital anti-malarials in Africa—an urgent neglected public health priority. Malar J. 2011;10:352.CrossRefPubMedPubMedCentral Newton PN, Green MD, Mildenhall DC, Plancon A, Nettey H, Nyadong L, et al. Poor quality vital anti-malarials in Africa—an urgent neglected public health priority. Malar J. 2011;10:352.CrossRefPubMedPubMedCentral
8.
Zurück zum Zitat Newton PN, Tabernero P, Dwivedi P, Culzoni MJ, Monge ME, Swamidoss I, et al. Falsified medicines in Africa: all talk, no action. Lancet Glob Health. 2014;2:e509–10.CrossRefPubMed Newton PN, Tabernero P, Dwivedi P, Culzoni MJ, Monge ME, Swamidoss I, et al. Falsified medicines in Africa: all talk, no action. Lancet Glob Health. 2014;2:e509–10.CrossRefPubMed
10.
Zurück zum Zitat van Vugt M, van Beest A, Sicuri E, van Tulder M, Grobusch MP. Malaria treatment and prophylaxis in endemic and nonendemic countries: evidence on strategies and their cost-effectiveness. Future Microbiol. 2011;6:1485–500.CrossRefPubMed van Vugt M, van Beest A, Sicuri E, van Tulder M, Grobusch MP. Malaria treatment and prophylaxis in endemic and nonendemic countries: evidence on strategies and their cost-effectiveness. Future Microbiol. 2011;6:1485–500.CrossRefPubMed
11.
Zurück zum Zitat Visser BJ, van Vugt M, Grobusch MP. Malaria: an update on current chemotherapy. Expert Opin Pharmacother. 2014;15:2219–54.CrossRefPubMed Visser BJ, van Vugt M, Grobusch MP. Malaria: an update on current chemotherapy. Expert Opin Pharmacother. 2014;15:2219–54.CrossRefPubMed
12.
Zurück zum Zitat Visser BJ, Wieten RW, Kroon D, Nagel IM, Belard S, van Vugt M, et al. Efficacy and safety of artemisinin combination therapy (ACT) for non-falciparum malaria: a systematic review. Malar J. 2014;13:463.CrossRefPubMedPubMedCentral Visser BJ, Wieten RW, Kroon D, Nagel IM, Belard S, van Vugt M, et al. Efficacy and safety of artemisinin combination therapy (ACT) for non-falciparum malaria: a systematic review. Malar J. 2014;13:463.CrossRefPubMedPubMedCentral
13.
Zurück zum Zitat Grobusch MP, van Vugt M. Malaria therapy: where do we stand, what next? Future Microbiol. 2010;5:1447–9.CrossRefPubMed Grobusch MP, van Vugt M. Malaria therapy: where do we stand, what next? Future Microbiol. 2010;5:1447–9.CrossRefPubMed
14.
Zurück zum Zitat Kelesidis T, Falagas ME. Substandard/counterfeit antimicrobial drugs. Clin Microbiol Rev. 2015;28:443–64.CrossRefPubMed Kelesidis T, Falagas ME. Substandard/counterfeit antimicrobial drugs. Clin Microbiol Rev. 2015;28:443–64.CrossRefPubMed
15.
Zurück zum Zitat Renschler JP, Walters KM, Newton PN, Laxminarayan R. Estimated under-five deaths associated with poor-quality antimalarials in sub-saharan Africa. Am J Trop Med Hyg. 2015;92:119–26.CrossRefPubMedPubMedCentral Renschler JP, Walters KM, Newton PN, Laxminarayan R. Estimated under-five deaths associated with poor-quality antimalarials in sub-saharan Africa. Am J Trop Med Hyg. 2015;92:119–26.CrossRefPubMedPubMedCentral
17.
Zurück zum Zitat White NJ, Pongtavornpinyo W, Maude RJ, Saralamba S, Aguas R, Stepniewska K, et al. Hyperparasitaemia and low dosing are an important source of anti-malarial drug resistance. Malar J. 2009;8:253.CrossRefPubMedPubMedCentral White NJ, Pongtavornpinyo W, Maude RJ, Saralamba S, Aguas R, Stepniewska K, et al. Hyperparasitaemia and low dosing are an important source of anti-malarial drug resistance. Malar J. 2009;8:253.CrossRefPubMedPubMedCentral
18.
Zurück zum Zitat Karunamoorthi K. The counterfeit anti-malarial is a crime against humanity: a systematic review of the scientific evidence. Malar J. 2014;13:209.CrossRefPubMedPubMedCentral Karunamoorthi K. The counterfeit anti-malarial is a crime against humanity: a systematic review of the scientific evidence. Malar J. 2014;13:209.CrossRefPubMedPubMedCentral
21.
Zurück zum Zitat Visser BJ, Meerveld-Gerrits J, Kroon D, Mougoula J, Vingerling R, Bache E, et al. Assessing the quality of anti-malarial drugs from Gabonese pharmacies using the MiniLab(R): a field study. Malar J. 2015;14:273.CrossRefPubMedPubMedCentral Visser BJ, Meerveld-Gerrits J, Kroon D, Mougoula J, Vingerling R, Bache E, et al. Assessing the quality of anti-malarial drugs from Gabonese pharmacies using the MiniLab(R): a field study. Malar J. 2015;14:273.CrossRefPubMedPubMedCentral
22.
Zurück zum Zitat Degardin K, Roggo Y, Been F, Margot P. Detection and chemical profiling of medicine counterfeits by Raman spectroscopy and chemometrics. Anal Chim Acta. 2011;705:334–41.CrossRefPubMed Degardin K, Roggo Y, Been F, Margot P. Detection and chemical profiling of medicine counterfeits by Raman spectroscopy and chemometrics. Anal Chim Acta. 2011;705:334–41.CrossRefPubMed
23.
Zurück zum Zitat Kiehntopf M, Monch B, Salzer R, Kupfer M, Hartmann M. Quality control of cytotoxic drug preparations by means of Raman spectroscopy. Pharmazie. 2012;67:95–6.PubMed Kiehntopf M, Monch B, Salzer R, Kupfer M, Hartmann M. Quality control of cytotoxic drug preparations by means of Raman spectroscopy. Pharmazie. 2012;67:95–6.PubMed
24.
Zurück zum Zitat Hajjou M, Qin Y, Bradby S, Bempong D, Lukulay P. Assessment of the performance of a handheld Raman device for potential use as a screening tool in evaluating medicines quality. J Pharm Biomed Anal. 2013;74:47–55.CrossRefPubMed Hajjou M, Qin Y, Bradby S, Bempong D, Lukulay P. Assessment of the performance of a handheld Raman device for potential use as a screening tool in evaluating medicines quality. J Pharm Biomed Anal. 2013;74:47–55.CrossRefPubMed
25.
Zurück zum Zitat de Veij M, Vandenabeele P, Hall KA, Fernandez FM, Green MD, White NJ, et al. Fast detection and identification of counterfeit antimalarial tablets by Raman spectroscopy. J Raman Spectrosc. 2007;38:181–7.CrossRef de Veij M, Vandenabeele P, Hall KA, Fernandez FM, Green MD, White NJ, et al. Fast detection and identification of counterfeit antimalarial tablets by Raman spectroscopy. J Raman Spectrosc. 2007;38:181–7.CrossRef
27.
Zurück zum Zitat Visser BJ, Buijink AW, Grobusch MP. Reporting of medical research costs. Improving transparency and reproducibility of medical research. Methods Inf Med. 2014;53:329–31.CrossRefPubMed Visser BJ, Buijink AW, Grobusch MP. Reporting of medical research costs. Improving transparency and reproducibility of medical research. Methods Inf Med. 2014;53:329–31.CrossRefPubMed
28.
Zurück zum Zitat Bate R, Tren R, Mooney L, Hess K, Mitra B, Debroy B, et al. Pilot study of essential drug quality in two major cities in India. PLoS One. 2009;4:e6003.CrossRefPubMedPubMedCentral Bate R, Tren R, Mooney L, Hess K, Mitra B, Debroy B, et al. Pilot study of essential drug quality in two major cities in India. PLoS One. 2009;4:e6003.CrossRefPubMedPubMedCentral
29.
Zurück zum Zitat Ioset JR, Kaur H. Simple field assays to check quality of current artemisinin-based antimalarial combination formulations. PLoS One. 2009;4:e7270.CrossRefPubMedPubMedCentral Ioset JR, Kaur H. Simple field assays to check quality of current artemisinin-based antimalarial combination formulations. PLoS One. 2009;4:e7270.CrossRefPubMedPubMedCentral
30.
Zurück zum Zitat Kaur H, Green MD, Hostetler DM, Fernández FM, Newton PN. Antimalarial drug quality: methods to detect suspect drugs. Therapy. 2010;7:49–57.CrossRef Kaur H, Green MD, Hostetler DM, Fernández FM, Newton PN. Antimalarial drug quality: methods to detect suspect drugs. Therapy. 2010;7:49–57.CrossRef
31.
Zurück zum Zitat Quinn MF. Relation of observer agreement to accuracy according to a two-receiver signal detection model of diagnosis. Med Decis Making. 1989;9:196–206.CrossRefPubMed Quinn MF. Relation of observer agreement to accuracy according to a two-receiver signal detection model of diagnosis. Med Decis Making. 1989;9:196–206.CrossRefPubMed
32.
Zurück zum Zitat Paudel A, Raijada D, Rantanen J. Raman spectroscopy in pharmaceutical product design. Adv Drug Deliv Rev. 2015;89:3–20.CrossRefPubMed Paudel A, Raijada D, Rantanen J. Raman spectroscopy in pharmaceutical product design. Adv Drug Deliv Rev. 2015;89:3–20.CrossRefPubMed
33.
Zurück zum Zitat Blevins RD, Plunkett R. Formulas for natural frequency and mode shape. J Appl Mech. 1980;47:461.CrossRef Blevins RD, Plunkett R. Formulas for natural frequency and mode shape. J Appl Mech. 1980;47:461.CrossRef
34.
Zurück zum Zitat Kim HH. Endoscopic Raman spectroscopy for molecular fingerprinting of gastric cancer: principle to implementation. Biomed Res Int. 2015:670121. Kim HH. Endoscopic Raman spectroscopy for molecular fingerprinting of gastric cancer: principle to implementation. Biomed Res Int. 2015:670121.
36.
Zurück zum Zitat Committee NP. Pharmacopoeia of the People’s Republic of China. Part 2010, 1. p. 392–3. Committee NP. Pharmacopoeia of the People’s Republic of China. Part 2010, 1. p. 392–3.
37.
Zurück zum Zitat Reader J, Corliss CH, Wiese WL, Martin GA. Wavelengths and transition probabilities for atoms and atomic ions: part 1. Wavelengths, part 2. Transition probabilities. NSRDS-NBS. vol 68, 1. 1980. Reader J, Corliss CH, Wiese WL, Martin GA. Wavelengths and transition probabilities for atoms and atomic ions: part 1. Wavelengths, part 2. Transition probabilities. NSRDS-NBS. vol 68, 1. 1980.
38.
Zurück zum Zitat Lin-Vien D, Colthup NB, Fateley WG, Grasselli JG. The handbook of infrared and Raman characteristic frequencies of organic molecules. Elsevier; 1991. Lin-Vien D, Colthup NB, Fateley WG, Grasselli JG. The handbook of infrared and Raman characteristic frequencies of organic molecules. Elsevier; 1991.
39.
Zurück zum Zitat Nyquist RA, Kagel RO. Handbook of infrared and raman spectra of inorganic compounds and organic salts: infrared spectra of inorganic compounds. Academic press; 2012. Nyquist RA, Kagel RO. Handbook of infrared and raman spectra of inorganic compounds and organic salts: infrared spectra of inorganic compounds. Academic press; 2012.
40.
Zurück zum Zitat Nakamoto K. Infrared and Raman spectra of inorganic and coordination compounds. Wiley Online Library; 1986. Nakamoto K. Infrared and Raman spectra of inorganic and coordination compounds. Wiley Online Library; 1986.
41.
Zurück zum Zitat Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem. 2003;49:7–18.CrossRefPubMed Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, et al. The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. Clin Chem. 2003;49:7–18.CrossRefPubMed
42.
Zurück zum Zitat Rutjes AW, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PM. Case-control and two-gate designs in diagnostic accuracy studies. Clin Chem. 2005;51:1335–41.CrossRefPubMed Rutjes AW, Reitsma JB, Vandenbroucke JP, Glas AS, Bossuyt PM. Case-control and two-gate designs in diagnostic accuracy studies. Clin Chem. 2005;51:1335–41.CrossRefPubMed
43.
Zurück zum Zitat Flahault A, Cadilhac M, Thomas G. Sample size calculation should be performed for design accuracy in diagnostic test studies. J Clin Epidemiol. 2005;58:859–62.CrossRefPubMed Flahault A, Cadilhac M, Thomas G. Sample size calculation should be performed for design accuracy in diagnostic test studies. J Clin Epidemiol. 2005;58:859–62.CrossRefPubMed
44.
Zurück zum Zitat Hall KA, Newton PN, Green MD, De Veij M, Vandenabeele P, Pizzanelli D, et al. Characterization of counterfeit artesunate antimalarial tablets from southeast Asia. Am J Trop Med Hyg. 2006;75:804–11.PubMed Hall KA, Newton PN, Green MD, De Veij M, Vandenabeele P, Pizzanelli D, et al. Characterization of counterfeit artesunate antimalarial tablets from southeast Asia. Am J Trop Med Hyg. 2006;75:804–11.PubMed
45.
Zurück zum Zitat Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998;17:857–72.CrossRefPubMed Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Stat Med. 1998;17:857–72.CrossRefPubMed
46.
Zurück zum Zitat Newcombe RG. Improved confidence intervals for the difference between binomial proportions based on paired data. Stat Med. 1998;17:2635–50.CrossRefPubMed Newcombe RG. Improved confidence intervals for the difference between binomial proportions based on paired data. Stat Med. 1998;17:2635–50.CrossRefPubMed
47.
Zurück zum Zitat Bate R, Tren R, Hess K, Mooney L, Porter K. Pilot study comparing technologies to test for substandard drugs in field settings. Afr J Pharm Pharmacol. 2009;3:165–70. Bate R, Tren R, Hess K, Mooney L, Porter K. Pilot study comparing technologies to test for substandard drugs in field settings. Afr J Pharm Pharmacol. 2009;3:165–70.
Metadaten
Titel
The diagnostic accuracy of the hand-held Raman spectrometer for the identification of anti-malarial drugs
verfasst von
Benjamin J. Visser
Sophia G. de Vries
Emmanuel B. Bache
Janneke Meerveld-Gerrits
Daniëlle Kroon
Jimmy Boersma
Selidji T. Agnandji
Michèle van Vugt
Martin P. Grobusch
Publikationsdatum
01.12.2016
Verlag
BioMed Central
Erschienen in
Malaria Journal / Ausgabe 1/2016
Elektronische ISSN: 1475-2875
DOI
https://doi.org/10.1186/s12936-016-1212-y

Weitere Artikel der Ausgabe 1/2016

Malaria Journal 1/2016 Zur Ausgabe

Leitlinien kompakt für die Innere Medizin

Mit medbee Pocketcards sicher entscheiden.

Seit 2022 gehört die medbee GmbH zum Springer Medizin Verlag

Update Innere Medizin

Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.