Lateral flow devices (LFDs) are viral antigen tests for the detection of SARS-CoV-2 that produce a rapid result, are inexpensive and easy to operate. They have been advocated for use by the World Health Organisation to help control outbreaks and break the chain of transmission of COVID-19 infections. There are now several studies assessing their accuracy but as yet no systematic review. Our aims were to assess the sensitivity and specificity of LFDs in a systematic review and summarise the sensitivity and specificity of these tests.
Methods
A targeted search of Pubmed and Medxriv, using PRISMA principles, was conducted identifying clinical studies assessing the sensitivity and specificity of LFDs as their primary outcome compared to reverse transcriptase polymerase chain reaction (RT-PCR) for the detection of SARS-CoV-2. Based on extracted data sensitivity and specificity was calculated for each study. Data was pooled based on manufacturer of LFD and split based on operator (self-swab or by trained professional) and sensitivity and specificity data were calculated.
Results
Twenty-four papers were identified involving over 26,000 test results. Sensitivity from individual studies ranged from 37.7% (95% CI 30.6–45.5) to 99.2% (95% CI 95.5–99.9) and specificity from 92.4% (95% CI 87.5–95.5) to 100.0% (95% CI 99.7–100.0). Operation of the test by a trained professional or by the test subject with self-swabbing produced comparable results.
Conclusions
This systematic review identified that the performance of lateral flow devices is heterogeneous and dependent on the manufacturer. Some perform with high specificity but a great range of sensitivities were shown (38.32–99.19%). Test performance does not appear dependent on the operator. Potentially, LFDs could support the scaling up of mass testing to aid track and trace methodology and break the chain of transmission of COVID-19 with the additional benefit of providing individuals with the results in a much shorter time frame.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Abkürzungen
LFD
Lateral flow device
RT-PCR
Reverse transcriptase polymerase chain reaction
Background
Lateral flow device (LFD) immunoassays are common, inexpensive, readily available testing devices that are used in the detection of a number of different medical conditions [1‐4]. They work by binding of conjugated antibodies to a specific antigen in a sample. This antibody-antigen complex moves via capillary flow to a test area which then identifies a positive test by the presence of a coloured line [2, 3].
There has been an increasing number of papers reporting on the use of LFDs in the detection of the Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), which has caused the Coronavirus disease 2019 (COVID-19) pandemic [5]. Currently, the gold standard for detection of SARS-CoV-2 is reverse transcriptase polymerase chain reaction (RT-PCR) [6, 7]. For both of these tests, nasopharyngeal swabs are used to isolate the antigen. However, RT-PCR requires swabs to be sent off to a laboratory with specialist equipment and analysed by trained laboratory staff. This usually has a turnaround time that is variable but of at least 24 h [1, 7]. Furthermore, many countries possess a limited capacity to perform RT-PCR tests, hindering their ability to engage in mass-testing with RT-PCR alone; as an example, the United Kingdom’s current RT-PCR capacity for the detection of SARS-CoV-2 is approximately 500,000 tests per day [8].
Anzeige
Where there are national or local outbreaks, it is important to be able to expand testing in a short time frame (surge-testing) to enable effective identification of individuals infected with the virus for contact tracing and mass population testing in an endeavour to stop the chain of transmission of the virus [5, 9]. Lateral flow devices (LFDs) offer a potential solution as they can quickly turn around a result in less than 30 min without the need for specialist staff or laboratory capacity [2, 3]. Many countries have pioneered the use of LFDs for surge-testing in the healthcare, community and educational setting [10, 11].
To date, there has yet to be a systematic review to assess the sensitivity and specificity of LFDs in the detection of SARS-CoV-2 without which a thorough evaluation of the efficacy of these tests cannot be undertaken.
The primary objective was to identify the sensitivities and specificities of lateral flow devices in the detection of SARS-CoV-2 compared to reverse transcriptase polymerase chain reaction in patients with symptoms of COVID-19 or those screened as part of mass testing programmes. This study also set out to identify if there were any differences in sensitivity and specificity between different manufacturers of LFDs and between different operators of the LFD test.
Methods
Study design
This was a systematic review of clinical studies in peer reviewed journal articles.
Anzeige
Search strategy
Two independent reviewers conducted an electronic search strategy of two online databases, PubMed and Medxriv, in 1st December 2020 to 15th January 2021. Search terms used included but not exclusively a combination of “COVID-19”, “SARS-CoV-2”, “CORONAVIRUS”, “ANTIGEN DETECTION”, “ANTIGEN TEST”, “LATERAL FLOW”. The two reviewers then reviewed each paper generated from the search and excluded articles based firstly on title then abstract and then reviewing the full text. References of the filtered papers were searched for additional studies. Any disagreements between the reviewers were resolved by consulting a separate adjudicator and a discussion between all three parties.
Eligibility and exclusion criteria
Eligible studies had to meet the following criteria: (1) involved the detection of SARS-CoV-2, (2) the intervention was a LFD detecting the antigen to this virus, (3) the LFD was performed at the point of care on samples taken for this purpose, (4) the control used as the “gold standard” must be RT-PCR, (5) outcomes for the paper must include the sensitivity and specificity of the lateral flow device, (6) population must be adults (≥ 18 years) who displayed symptoms of COVID-19 or swabbed as part of screening or mass testing, (7) the full text must be published in peer reviewed journals or a preprint pending review at the time of the search.
Exclusion criteria included any study that did not meet all the conditions for eligibility and: (1) was detecting anything other than SARS-CoV-2, (2) retrospectively tested samples which had been frozen, (3) tested exclusively healthy volunteers with no indication for swabbing, (4) did not provide appropriate sensitivity and specificity data.
Data extraction
Once all papers from the search had been identified the two independent reviewers reviewed the full text of all identified papers. Descriptive data for each article were identified including author, month and year, location, sample size and manufacturer of LFD used. The reviewers then extracted test result data including the number of participants in which SARS-CoV-2 was detected by RT-PCR and LFD and the number of false positive and negative results detected by LFDs. Sensitivity and specificity data were collected for each study including 95% confidence intervals; in all studies, this was calculated to confirm the sensitivity and specificity data. The data was subsequently split and pooled based on the manufacturer of LFD used which enabled calculation of sensitivity and specificity for each manufacturer of LFD compared to RT-PCR. Studies were split again if the sample was taken by a trained professional or if it was taken by the patient with self-swabbing, regardless of who operated the LFD test. Sensitivity and specificity data were calculated comparing these two groups. Again, any disagreements during data extraction were settled by consulting the third party.
Outcomes
The pre-defined primary outcome was to assess the sensitivity and specificity of LFD tests in the detection of SARS-CoV-2 compared to RT-PCR (“gold standard”) testing in patients with symptoms consistent with COVID-19 or in individuals swabbed as part of mass population testing/contact tracing. The secondary outcome was to calculate the sensitivity and specificity of each LFD test by manufacturer in this same population in comparison to RT-PCR and based upon whether the sample collection was performed by a trained professional or by the patient (“self-swabbing”).
Data analysis
Data analysis was conducted using IBM SPSS Version 27.0.0. For the primary outcome in the majority of studies, no data analysis was required as all results were extracted from articles directly. For the secondary outcome, results of individual manufacturers of LFDs were pooled together and a sensitivity/specificity analysis conducted. A total sensitivity and specificity were reported for each manufacturer with 95% confidence intervals. Data visualisation was performed in R version 4.0.3. Heatmaps and Forest plots were generated using the pheatmap() function of the ‘pheatmap’ (v1.0.12) and forestplot() function of the ‘forestplot’ (v1.10.1) R packages, respectively. Bar plots, horizontal dot plots and pie charts were generated using the geom_bar(), geom_line(), geom_point() and coord_polar() functions of the ‘ggplot2’ (v3.3.2) R package, respectively.
Results
The search strategy yielded 1345 papers and further titles were identified by checking the references of these articles. This was narrowed down to 24 full text articles as demonstrated by the PRISMA flow diagram from in Fig. 1. In total 26,903 tests were included in these 24 articles, which are summarised in Table 1, including sample sizes, population and LFD type used. There was an almost equal gender split and a range of different test centres such as COVID-19 test centres and primary care centres (Fig. 2 and Additional file 1: Appendix 1).
Table 1
Data describing study design, population and setting
The indication for testing for SARS-CoV-2 of the participants [e.g., screening or (a)symptomatic testing, close contacts] are included in Fig. 3, demonstrating that the systemic review contains a diverse population sample that would be representative of those being tested for COVID-19.
×
Anzeige
Manufacturer of lateral flow device
Eight different manufacturers of LFDs were used across 24 studies. Panbio Abbot had the highest number of publications and was used across 12 different studies with a combined total of 13,000 tests. This is demonstrated in Fig. 4 and Additional file 1: Appendix 2.
×
Sensitivity and specificity data
Individual study sensitivity and specificity data is demonstrated by Table 2. This shows a range of sensitivity from 37.7% (95% CI 30.6–45.5) from Blairon et al. [16] (which used the CORIS LFD) to Moeren et al. [29] with a sensitivity of 99.2% (95% CI 95.5–99.9) using the BD Veritor LFD test, as demonstrated by Fig. 5A. For specificity, all studies demonstrated a specificity over 92%. Eleven studies had a specificity of 100%. This is demonstrated in Fig. 5B.
Table 2
Sensitivity and specificity data extracted from each study
*Shows data which had slight variations between our data calculations and the calculations made in the study, possibly due to a different method for calculating 95% confidence intervals.
†Shows data that produced significant differences in between our calculated data and the study’s data or it was not possible to calculate sensitivity and specificity from the data in the study
×
Pooled data based on manufacturer of LFD
After combining studies based on manufacturer of LFD, BD Veritor had the best sensitivity of 99.19% (95% CI 95.54–99.86%), though the sample size was small and it was only tested from a single centre study. The CORIS and BIOSENSOR were the lowest sensitivity LFDs demonstrating sensitivities of less than 45%. Panbio Abbott has been most thoroughly evaluated and noted a sensitivity of 78.41% (95% CI 76.78–79.96%) across over 2500 individual tests. All manufacturers demonstrated a specificity of over 93% and three (BD Veritor, BIOCREDIT, COVID-VIRO) had specificities of 100%. This is shown in Table 3 and Fig. 6.
Table 3
Pooled sensitivity and specificity data based on manufacturer of LFD
Type of LFD test
Sample size
Positive sample size
LFD detected
Negative sample size
Number of negatives detected by LFD
Sensitivity %
Sensitivity 95% CI Low
Sensitivity 95% CI High
Specificity %
Specificity 95% CI Low
Specificity 95% CI High
Panbio Abbott
13,221
2566
2012
10,745
10,703
78.41
76.78%
79.96%
99.61
99.47%
99.71%
Innova
6954
197
155
6757
6735
78.68
72.44%
83.82%
99.67
99.51%
99.78%
STANDARD Q
4402
909
744
3493
3460
81.85
79.21%
84.22%
99.06
98.68%
99.33%
CORIS
1199
167
64
1032
1011
38.32
31.29%
45.88%
97.97
96.91%
98.67%
Bioeasy
856
97
87
759
708
89.69
82.05%
94.30%
93.28
91.27%
94.85%
COVID-VIRO®
572
259
233
313
313
89.96
85.70%
93.06%
100.00
98.79%
100.00%
BD Veritor
352
123
122
334
334
99.19
95.54%
99.86%
100.00
98.86%
100.00%
BIOCREDIT
310
188
81
122
122
43.09
36.21%
50.23%
100.00
96.95%
100.00%
×
Sample collection comparison
Studies were split by sample collector as displayed in Table 1. In fourteen studies the sample was collected by trained professionals; only the Peto et al. [31] study involved samples collected by the patient as part of self-swabbing, though with the test performed by a trained professional. Nine studies did not specify who the operator was. Trained professionals carried out 10,656 tests and 6954 were by self-swabbing as demonstrated in Fig. 7A. Sensitivity for trained professionals was 81.47% (95% CI 79.7–83.1) and for self-swabbing was 78.68% (95% CI 72.4–83.8) (see Fig. 7B, C). Both showed a specificity of over 99% as shown in Fig. 7C [trained professionals = 99.4% (95% CI 99.2–99.5); self-swabbing = 99.7% (95% CI 99.5–99.8)].
×
Anzeige
Discussion
This systematic review has identified, across 24 studies and over 26,000 LFD tests, that a number of individual manufacturers of LFDs recorded a sensitivity of over 78% compared to the gold standard test of RT-PCR, with one individual manufacturer reaching up to 99.19% sensitivity in one single centred trial (BD Veritor). Specificity was more consistent, with over 92% in all individual studies and from the pooled data. The large variation between brands of LFDs could be due to several factors including individual study design, operator competencies but also quality of the LFD itself. This highlights the impressive performance of the Panbio Abbot and Innova brands both with sensitivities of over 78% but with a sample size of 13,221 and 6954 respectively.
This study is the first to summarise the existing body of studies to help create a broader understanding for LFD testing for SARS-CoV-2 and is the first systematic review of its kind. While RT-PCR is and is likely to remain the gold standard of testing, this study highlights the potential utility of rapid antigen testing to support RT-PCR in the scaling up of a country’s testing program to include mass testing, contact tracing programs and potentially surge-testing [9, 36]. Potential use of LFDs might be to provide short term additional capacity, or as an adjunct to PCR testing [1, 7, 8]. The lower sensitivity demonstrated by certain brands of LFDs compared to RT-PCR can be overcome to an extent in high prevalence areas with appropriate frequency of testing. LFDs may come into their own when used in areas with big spikes in cases. We note that there is an increasing body of modelling data highlighting that the best surveillance testing methods are tests that can be scaled up and reported quickly, [36] requirements which LFDs may have suitable characteristics. These models also highlight the need for recurrent testing. This again is a requirement LFDs can fulfil given their minimal expense. High frequency testing in high prevalence areas may negate some concerns around sensitivity [36]. In contrast, low incidence areas would expose the inferior sensitivities demonstrated by LFDs in this study, and RT-PCR would be the most suitable, especially if there is a reduction in demand for mass population and high frequency testing in these areas. This point highlights that whilst LFDs have some benefits, when compared directly to RT-PCR, their performance when detecting SARS-CoV-2 was inferior and as such they should be utilised when RT-PCR is overwhelmed.
Our study design is not without its limitations. There are possible confounding variables including the marked heterogeneity in terms of study designs whereby some targeted asymptomatic or symptomatic groups, and others targeted contacts of symptomatic patients. However, as there was a variety of settings and scenarios to replicate the conditions of real-life testing, this data can still provide valuable insight into the performance of LFDs.
Furthermore, this systematic review takes the assumption that for the diagnosis of COVID-19, RT-PCR testing is the most appropriate measure for comparison. There is a debate whether RT-PCR testing is the most appropriate method in a high-incidence setting [37]. In such a setting RT-PCR might actually report an overall greater number of positive cases than those which should be considered active infections, because of the presence of residual RNA which can be present for several months after an initial infection with SARS-CoV-2 [37‐39]. Other measures of assessing the infectivity of individuals, such as viral culture, might provide better measurements but suffer from other logistical implementation issues.
Anzeige
On a final note, caution should be exerted particularly in view of new emergent strains. The sensitivity of any COVID-19 tests to new strains, not least LFDs must be confirmed. Several such evaluations have been completed by Public Health authorities in the United Kingdom and have given reassurance in this regards [40].
Conclusions
In summary, this systematic review has shown that lateral flow devices can produce varying sensitivity and specificity results compared to the other forms of SARS-CoV-2 diagnostics. We have shown that a number of manufacturers of LFDs can produce high specificity but there is significant heterogeneity in sensitivity (38.32–99.19%), which may suit LFD use to high prevalence areas in an attempt to rapidly increase testing in areas with raised transmission. Our evidence gives support to the practice of self-swabbing for sample collection compared to the test being performed by a trained healthcare professional. LFDs potentially offer a new form of COVID-19 testing that might ease the pressure on the RT-PCR testing program. Enhanced capacity for mass testing, contact tracing and surge-testing, may in turn help stop the chain of transmission of COVID-19.
Acknowledgements
The authors would like to thank the authors of the 24 studies used in this systematic review for their contribution to the collection research in the fight against COVID-19. They would like to thank all the doctors, nurses and other clinical staff working on the frontline of healthcare authorities worldwide and those who have suffered or are suffering from COVID-19.
Declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Ob bei einer Notfalloperation nach Schenkelhalsfraktur eine Hemiarthroplastik oder eine totale Endoprothese (TEP) eingebaut wird, sollte nicht allein vom Alter der Patientinnen und Patienten abhängen. Auch über 90-Jährige können von der TEP profitieren.
Wenn unter einer medikamentösen Hochdrucktherapie der diastolische Blutdruck in den Keller geht, steigt das Risiko für schwere kardiovaskuläre Ereignisse: Darauf deutet eine Sekundäranalyse der SPRINT-Studie hin.
Insektenstiche sind bei Erwachsenen die häufigsten Auslöser einer Anaphylaxie. Einen wirksamen Schutz vor schweren anaphylaktischen Reaktionen bietet die allergenspezifische Immuntherapie. Jedoch kommt sie noch viel zu selten zum Einsatz.
Beginnen ältere Männer im Pflegeheim eine Antihypertensiva-Therapie, dann ist die Frakturrate in den folgenden 30 Tagen mehr als verdoppelt. Besonders häufig stürzen Demenzkranke und Männer, die erstmals Blutdrucksenker nehmen. Dafür spricht eine Analyse unter US-Veteranen.
Update Innere Medizin
Bestellen Sie unseren Fach-Newsletter und bleiben Sie gut informiert.