Background
Hepatitis C virus (HCV) infection remains an important world-wide health concern with 130 – 150 million people infected [
1]. Approximately 75–85% of HCV-infected persons will progress to chronic HCV infection and are at risk for the development cirrhosis, and hepatocellular carcinoma (HCC) [
2]. Most people infected with HCV are asymptomatic but the risk of HCC is substantially higher in HCV infected patients compared to HCV negative subjects [
3]. The CDC estimates that 1 – 5% of those chronically infected with HCV will die from end stage liver disease due to either cirrhosis or hepatocellular carcinoma [
4].
Recently developed direct acting antiviral treatments for HCV can eliminate the virus from almost all patients [
5]. The elimination of HCV is measured by a sustained virological response (SVR). SVR is defined as an undetectable HCV RNA plasma/serum concentration at 12 or 24 weeks after treatment completion using a sensitive HCV RNA quantitation assay with a limit of quantitation of under 25 IU/ml [
6]. The risks of HCC and mortality are reduced in patients achieving SVR compared to the risks in untreated patients [
7].
CDC, AASLD/IDSA and EASL guidelines recommend the use of quantitative HCV RNA testing for pre-treatment and on-treatment patient monitoring and management. Quantitative HCV nucleic acid amplification test (NAAT) results prior to initiating HCV therapy are used to determine the baseline level of viral load, and these results guide decisions for treatment regimens and durations [
6,
8,
9]. For diagnosing HCV infections, CDC and AASLD/IDSA recommend initial testing with an HCV antibody test (anti-HCV test). A positive HCV antibody test result is indicative of an active HCV infection or previous HCV infection. An HCV NAAT is recommended to confirm the presence of an active HCV infection or reinfection, after previous viral clearance, in a patient following a positive HCV antibody test result [
6,
8]. In addition, HCV NAAT testing is also recommended for patients with negative antibody results, if they are immunocompromised or have been exposed to the Hepatitis C virus within last six months. EASL recommends the use of a sensitive molecular test for HCV RNA for the diagnosis of HCV infection [
9].
During HCV therapy, HCV quantitative assays are important tools for determining the effectiveness of HCV treatment. Guidelines from the AASLD and EASL suggest testing HCV RNA not only at baseline, but also periodically during treatment (i.e., 4, 12 weeks) and at completion of treatment (i.e., 8 or 12 weeks) and post-treatment (i.e., 12 or 24 weeks); [
6,
9,
10].
This paper presents the data from studies using the Aptima HCV Quant Dx (Aptima; Hologic, Inc., San Diego, CA, USA) assay. This is a quantitative HCV RNA assay for monitoring and diagnosing of HCV infection on the fully automated Panther system. The Aptima assay uses real-time transcription-mediated amplification (TMA) to amplify the RNA target (5’-UTR) of HCV genotypes 1 to 6 [
11]. The assay uses a negative and two positive controls to validate accuracy of the results. The assay has a dynamic range of 10 to 100,000,000 IU/mL and uses 500uL of serum or plasma in each reaction. Performance characteristics tested include 95% limit of detection (LoD), lower limit of quantitation (LLoQ), equal genotype detection, linearity precision and specificity. The results of clinical specimens tested with the Aptima assay were compared to those results obtained by the Abbott and Roche assays.
Methods
Linearity
The linear range of the Aptima assay was demonstrated by testing panels of HCV armored RNA or clinical specimens diluted in HCV negative human plasma and serum. Panels ranged in concentration from 8.08 log IU/mL to less than 1 log IU/mL. Armored RNA was used to make panels above 6 log IU/mL. A combination of diluted clinical specimens or armored RNA was used to make lower concentrations panels.
Analytical Sensitivity (Limit of Detection, LoD)
The LoD was determined by testing dilutions of the WHO 2nd International Standard for Hepatitis C Virus RNA (NIBSC 96/798, genotype 1) in HCV negative human plasma and serum. A total of 10 panel members (0.25, 0.50, 1, 2, 3, 6, 8, 10, 12 and 20 IU/mL) were tested over 3 days on 3 Panther systems with 3 reagent lots for a total of 108 replicates per panel member (36 replicates per lot). In addition, The LoD across genotypes was determined by testing dilutions of HCV positive clinical specimens for genotypes 1, 2, 3, 4, 5 and 6 in HCV negative human plasma and serum. The HCV concentration for each clinical specimen was determined by testing with an FDA approved commercially available HCV quantitative assay. Each panel was tested on three Panther systems over 3 days with 3 reagent lots. A minimum total of 60 replicates were tested for each panel member (minimum 20 replicates per reagent lot). Probit analysis was performed on the Aptima results using SAS software to calculate the LoD for 95% detection rates.
Analytical Sensitivity (Lower Limit of Quantitation, LLoQ)
The LLoQ was determined by testing dilutions of the WHO 2nd International Standard for Hepatitis C Virus RNA (NIBSC 96/798, genotype 1) in HCV negative human plasma and serum. A minimum of 36 replicates of each dilution were tested over 3 days with three reagent lots on 3 Panther systems for a minimum of 108 replicates per dilution. In addition, the LLoQ across genotypes was determined by testing dilutions of HCV positive clinical specimens for genotypes 1, 2, 3, 4, 5 and 6 in HCV negative human plasma and serum. HCV concentration of the clinical specimens was determined using an FDA approved commercially available comparator assay. A minimum of 36 replicates of each dilution were tested over 3 days with each of three reagent lots on 3 Panther systems for a minimum of 108 replicates per panel member. The LLoQ was calculated using a total allowable error of 1 log.
Analytical specificity
Specificity of the Aptima assay was determined using 100 fresh and 270 frozen HCV negative plasma specimens and 98 fresh and 268 frozen HCV negative serum specimens.
Precision
To assess precision of the Aptima assay, nine positive panel members made by diluting HCV genotype 1a virus and armored RNA into HCV negative plasma were tested in triplicate by one operator using one reagent lot on one Panther systems over 21 test days.
Clinical specimen comparisons
Quantitative results for clinical specimens were obtained by running specimens following the manufacturers’ instructions. Quantitative results were obtained for 1058 frozen clinical specimens with both the Aptima and Abbott assays. These specimens represent all six HCV genotypes and cover the full dynamic range of both assays. A subset of these specimens was also tested with the Roche assay. From this subset, 611 gave quantitative results with both the Abbott and Roche assays and 608 gave quantitative results with both the Aptima and Roche assays. Three of the 611 specimens gave an invalid result with the Aptima assay, could not be retested and were excluded from the analysis. Thus, the total number of specimens used for the Aptima vs Roche comparison was 608 and for the Abbott vs Roche comparison was 611. Comparable clinical performance of quantitative measurements was demonstrated by linear regression analysis and Bland Altman plots. The genotype distribution as reported by the vendor or lab providing the specimens is shown in Table
1. One hundred and one specimens did not have a genotype.
Table 1
HCV Specimen Genotype & Origin
Algeria | 13 | 10 | 2 | | 1 | | | |
Australia | 33 | 1 | 4 | 22 | 1 | | 5 | |
Cambodia | 3 | 3 | | | | | | |
Cameroon | 25 | 8 | 5 | | 12 | | | |
Congo | 2 | | | | 2 | | | |
Egypt | 16 | 2 | | | 13 | | | 1 |
France | 89 | 20 | 23 | 30 | 16 | | | |
French Guiana | 1 | | | 1 | | | | |
French Polynesia | 1 | | | | 1 | | | |
Gabon | 9 | 1 | | | 8 | | | |
Germany | 11 | 6 | 1 | 4 | | | | |
Greece | 406 | 145 | 19 | 179 | 63 | | | |
Guadeloupe | 2 | 1 | | 1 | | | | |
Italy | 85 | 50 | 24 | 3 | 8 | | | |
Ivory Coast | 1 | | | | 1 | | | |
Lebanon | 1 | | | | 1 | | | |
Libya | 1 | 1 | | | | | | |
Luxembourg | 2 | 2 | | | | | | |
Madagascar | 1 | 1 | | | | | | |
Martinique | 1 | | | 1 | | | | |
Mauritius | 1 | 1 | | | | | | |
Morocco | 37 | 14 | 18 | 3 | 2 | | | |
New Caledonia | 1 | 1 | | | | | | |
Reunion Island | 1 | | 1 | | | | | |
Russia | 12 | | 11 | 1 | | | | |
Senegal | 1 | | 1 | | | | | |
Spain | 34 | 20 | 3 | 8 | 3 | | | |
Thailand | 3 | | | | | | 3 | |
Tunisia | 29 | 19 | 2 | 1 | 7 | | | |
Unknown | 28 | | | | | 17 | 11 | |
USA | 178 | 36 | 11 | 16 | 8 | 2 | 5 | 100 |
Vietnam | 30 | 16 | 1 | | | | 13 | |
Total n | 1058 | 358 | 126 | 270 | 147 | 19 | 37 | 101 |
Agreement at low HCV Concentrations
One hundred and seven specimens that gave results at or below 25 IU/mL using the Roche assays were compared. For this analysis, results of “Target Not Detected” for Roche or “Not Detected” for Aptima were interpreted as a negative result. A valid result where HCV was detected or quantified was interpreted as a positive result. Both positive and negative agreement between the Aptima assay and the Roche assay was calculated. Where specimens did not agree and sufficient specimen volume was available, the specimen was tested using the Abbott assay.
The specimens using in the studies were obtained as frozen deidentified remnant samples from the following vendors or labs BioCollection, Miami, Florida, USA;
-
Boca Biolistics, Coconut Creek, Florida, USA;
-
Cerba Specimen Services, Saint-Ouen l’Aumone, France;
-
Discovery Life Sciences, Los Osos, California, USA;
-
Hellenic Scientific Society for the Study of AIDS and Transmitted Diseases, Athens, Greece;
-
ProMedDx, Norton, Massachusetts, USA;
-
SeraCare Milford, Massachusetts, USA;
-
SlieaGen, Austin, Texas, USA;
-
Tissue Solutions Glasgow, Scotland;
-
ViroMed Minnetonka, Minnesota, USA
Statistical methods
The 95% positivity rates were estimated using Probit analysis using the normal model and analysis software from the SAS Institute, Cary, NC, USA.
The method comparison simple linear regression and Bland Altman analysis were performed using Analyse-It Software, Leeds, United Kingdom.
Linearity was measured using the R2 of the Pearson correlation coefficient calculated using Microsoft Excel (WA, USA).
Discussion
As recommended by CDC, AASLD/IDSA and EASL guidelines HCV NAAT can be used to confirm the presence of an active HCV infection or reinfection after previous viral clearance in patients with a positive HCV antibody result [
6,
8,
9]. Also, current testing guidelines recommend viral load testing with a HCV NAAT prior to initiating HCV therapy to determine the baseline viral load level and to monitor patients while on therapy as well as to detect a sustained virologic response. The data presented in this paper supports the use of the Aptima assay for these purposes.
To be effective as a diagnostic and viral load monitoring test a NAAT assay must quantitate HCV results across a wide dynamic range, be sensitive, specific, accurate, precise and quantify all 6 HCV genotypes similarly. Performance across a large dynamic range is important because HCV RNA levels can reach over 10,000,000 IU/mL [
12]. The linearity of the Aptima assay across a wide dynamic range is shown in Figs.
1 and
2. The correlation (R
2) for samples diluted over a 7 log range in HCV concentration was 1.00. The intercepts for the linear plots were between −0.11 and 0.17 log IU/mL indicating little bias and good linearity.
The sensitivity of the Aptima assay in both serum and plasma is shown in Table
3. Probit analysis to determine the LoD (95% positivity) of HCV genotypes 1–6 diluted into either serum or plasma showed an LoD of 5 IU/mL or lower in all genotypes. In addition, the LLoQ determined in serum and plasma for genotypes 1–6 was 10 IU/mL or lower. This level of sensitivity is important because the end point for therapy of HCV is defined as </=25 IU/mL so an assay must be able to accurately quantitate at levels at or below 25 IU/mL [
8]. It is recommended by EASL that for HCV diagnosis, an assay with a lower limit of detection < 15 IU/mL is used [
9]. It has also been suggested that testing HCV levels below 50 IU/mL with highly sensitive assays can detect more positive patients and that these patients are more likely to relapse [
13]. With a sensitivity of 10 IU/mL (LLoQ), the Aptima assay is able to quantify HCV at the levels needed for effective treatment monitoring and diagnostics.
Specificity is also important to avoid false positive results when diagnosing patients with HCV infections. As shown in Table
5 the specificity of the Aptima HCV was 100% for both serum and plasma specimens.
Sensitivity and specificity of the Aptima assay were further tested using 107 specimens that gave an HCV result </=25 IU/mL using the Roche assay. As shown in Table
8, positive and negative agreement between the Aptima and Roche assays was 89%. Four of the six samples negative by Roche and positive by Aptima, were also tested in the Abbott assay. Two of these were detected but not quantified by Abbott and Aptima. This indicates that these two specimens likely contained very low levels of HCV. However, the other two specimens tested by the Abbott assay, gave results well above the limit of quantitation (2.18 and 2.58 log IU/mL). These specimens gave results of 1.97 and 2.64 log IU/mL respectively with the Aptima assay. This confirms these two results as false negative results by the Roche assay supporting the superior sensitivity of the Aptima assay. There were six results where the Roche assay detected HCV but the Aptima did not. All six specimens gave detectable but not quantifiable results using the Roche assay. Of these six specimens, two had sufficient volume to test using the Abbott assay and both gave “not detectable” results. Data from testing specimens with HCV levels at or below 25 IU/mL suggests that the Aptima assay has better sensitivity than the Roche assay and equivalent or better specificity. The performance of the Aptima assay compared to the reported performance of the Roche and Abbott assays is summarized in Table
10. Based on this data, it is expected that the Aptima assay should show better sensitivity and comparable precision when measuring low levels of HCV.
Table 10
Performance Summary of the Aptima, Roche and Abbott Assays
Aptima HCV Quant Dx | plasma 4.3 serum 3.9 | 10 | 10-100,000,000 | 0.14 at 2.06 log IU/mL (115 IU/mL) |
Abbott RealTime | plasma 10.5 serum 7.2 | 12 | 10-100,000,000 | 0.10 at 1.96 log IU/mL (91 IU/mL) |
Roche Ampliprep/ COBAS Taqman HCV test v2.0 | plasma 11 serum 12 | 15 | 10-100,000,000 | </= 0.09 at 2.48 log IU/mL (300 IU/mL) |
Good precision is an important requirement for an assay used to monitor patients during treatment. A single HCV RNA measurement may be used to confirm that SVR has been reached. The data shown in Table
6 shows that the coefficient of variation for the assay is below 13.3% even down to 1.2 log IU/mL (16 IU/mL). This low variation gives a high degree of confidence that a single RNA measurement using the Aptima assay will provide a reliable result for determining SVR.
The method comparison between the Aptima and Abbott assays used 1058 specimens obtained from over 30 different countries and included genotypes 1–6 representing a highly genetically diverse population of HCV. Statistical analysis of this data set demonstrated a slope of 1.06, an intercept of 0.08 and a correlation of 0.97. The slope was statistically significant and was influenced by slightly higher results for the Aptima assay above 5.5 log IU/mL. Although statistically significant, the magnitude of the difference is not clinically significant. The method comparison between the Aptima and Roche assays used 608 specimens. The slope of the Aptima assay compared to the Roche assay was similar to that seen when comparing the Aptima assay with the Abbott assay (1.05 – 1.06). However, the average bias of the Aptima assay by Bland Altman analysis was lower vs the Roche assay (0.11 log IU/mL) compared to the Abbott assay (0.34 log IU/mL). There were 611 specimens that gave quantifiable results with both the Roche and Abbott assays. A method comparison was conducted with these data and gave a slope of 1.00, an intercept of −0.25 log IU/mL and an average bias of −0.27 log IU/mL. All three assays gave similar HCV viral load results indicating that there is no need to re-baseline patients if switching to the Aptima assay from the Roche and Abbott assays.
Acknowledgements
Brandon Henderson from Hologic Inc. helped run the Aptima assay for the precision study.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (
http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (
http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.