Previous Article | Next Article ![]()
Journal of Clinical Microbiology, September 2007, p. 2808-2812, Vol. 45, No. 9
0095-1137/07/$08.00+0 doi:10.1128/JCM.00202-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.

Virus Isolation and Serology Laboratory, SAIC—Frederick, Inc., NCI—Frederick, Frederick, Maryland 21702,1 Laboratory of Immunoregulation, National Institute of Allergy and Infectious Disease, National Institutes of Health, Bethesda, Maryland 208922
Received 16 January 2007/ Returned for modification 19 March 2007/ Accepted 20 June 2007
|
|
|---|
|
|
|---|
Unlike HIV, HCV is a curable infection (16, 19), with cure rates of 98% among HIV-negative patients in the acute stage of infection and 26 to 40% among HIV-positive patients (13) following therapy with the FDA-approved regimen of a combination of peg-interferon and ribaviran (4, 14). Experimental therapies, including viramidine, valopicitabine, and SCH503034, an NS3 protease inhibitor, are currently being tested in phase I/II clinical trials. The ability of clinicians to evaluate the efficacies of anti-HCV drug protocols for their patients is partially dependent on their ability to monitor the HCV load over time (10). Both the absolute viral load and the log decline in the viral load from the baseline were found to be clinically useful for predicting a sustained virological response or the lack of a sustained virological response to treatment (15, 21, 22). Unfortunately, despite the use of universal international standards (IU), the results obtained by different methods may vary (9, 12). It is important to determine how assays are related in the event that a patient is monitored by the use of more than one method. Two currently available methods of HCV load measurement are the Bayer Versant HCV RNA (version 3.0) branched DNA (bDNA) assay and the Abbott analyte-specific reagent (ASR) HCV real-time PCR protocol. In this paper we compare the results obtained by these assays, as well as their time to completion and ease of performance.
|
|
|---|
Sample collection and processing. Whole, EDTA-preserved blood was collected from patients. The plasma was separated within 2 h of collection and was distributed as 1-ml aliquots. The aliquots were placed into a –20°C freezer for pickup, which occurs within 12 h. They are thawed once for the assay and are refrozen at –20°C for repeat assays, if necessary. In our evaluation of the Abbott system, we not only used samples thawed once, held at 4°C, and run within 24 h on both instruments, but we also used samples which were run previously on the Bayer system, before we acquired the Abbott system, and immediately frozen. Our experience with this procedure of rerunning samples has shown excellent RNA recovery. Studies show that plasma samples may be held for up to 7 days at 4°C and 5 years at –20°C and may be frozen-thawed up to three times with no ill effects on RNA recovery (8, 11, 18).
Viral load quantitation. Viral load quantitation was performed by the VERSANT HCV RNA (version 3.0) assay (a bDNA assay) with a Q340 instrument (Bayer Healthcare LLC, Diagnostics Division, Tarrytown, NY), following the manufacturer's instructions, and the Abbott ASR HCV assay on an ABI 7000 real-time PCR instrument by following a protocol developed in-house. Essentially, RNA was extracted from plasma samples by using a QIAamp viral RNA minikit (QIAGEN, Inc., Valencia, CA) with an internal standard provided by Abbott. The extracted RNA was then combined with Abbott oligonucleotides, manganese, and polymerase and placed in the ABI 7000 instrument, where the RNA was converted to cDNA, which was subsequently amplified. Total RNA was quantitated by comparing the values with the values obtained with the internal standard.
The bDNA assay is a signal amplification assay with a linear range from 615 to 7,700,000 IU/ml and a 95% detection rate at 1,000 IU/ml. It requires 50 µl of plasma. The real-time PCR assay is a target amplification assay and has an accepted linear range in our laboratory of 10 to 25,000,000 IU/ml. It requires 250 µl of plasma. The lower limit and linearity of the Abbott assay were assessed by quadruplicate testing of a linearity panel consisting of samples with HCV titers ranging from 0 to 5 x 106 IU/ml (BBI Diagnostics, West Bridgewater, MA). Since no commercially available panel that contained a member with an HCV titer greater than 5 x 106 IU/ml was found, the upper limits, accuracy, and precision of the assay were determined by repeat testing of the samples previously quantified by the Bayer bDNA assay. Eleven samples were tested over three separate runs and in replicates (duplicate or more) within each run to evaluate the intra-assay and the interassay precisions.
Comparative analysis. For results that fell in the overlapping dynamic range of the assays, least-square regression was used to find the relationship between the Bayer and Abbott assay measures. A scatter plot was used to compare all values from the two assays, both those that were detectable and those that were below or above the limit of detection. Multiple outputation was used as a tool to handle multiple observations within a subject (6). We used the methods of Bland and Altman to determine the agreement between the assays (3).
|
|
|---|
![]() View larger version (17K): [in a new window] |
FIG. 1. Scatter plot of the Abbott assay readings versus the Bayer assay readings. Solid dots, samples in which RNA was detectable by both assays; triangles, samples with RNA undetectable by the Bayer assay (HCV was present at levels either below the lower detection limit or above the upper detection limit) but detectable by the Abbott assay. In addition, there were 41 samples with RNA undetectable by both assays (Bayer assay reading, <615 IU/ml; Abbott assay reading, <10 IU/ml). The four dashed lines specify the linear range for the Bayer assay, and the broken line is that of identity.
|
Thus, for the samples for which both tests showed detectable HCV load readings (615 IU/ml to 7,700,000 IU/ml), the linear regression result indicates equivalence between the Abbott and Bayer assay measures. Overall, the percent CVs across the range are higher for the Abbott assay than those claimed by Bayer for the bDNA assay. For samples with viral loads ranging from 5,000,000 to 100,000,000, the Abbott assay average interassay CV was 44% and the intra-assay CV was 20%, whereas Bayer reports (HCV RNA 3.0 bDNA assay package insert) that the average interassay CV is 17% and that the intra-assay CV is 13.9%. For samples with viral loads between 1,000 and 5,000,000 IU/ml, the Abbott assay average interassay CV was 27% and the intra-assay CV was 20%, whereas the reported Bayer assay average interassay CV is 18.3% and the intra-assay CV is 11.7%. For samples with viral loads below 100 IU/ml, the Abbott assay interassay CV was 56% and the intra-assay CV was 51%, whereas the reported Bayer assay average interassay CV is 35.2% and the intra-assay CV is 28.7%.
Multiple outputation can be applied to handle the multiple HCV observations within a subject. That is, for subjects with multiple observations, we randomly picked one observation and then did the linear regression for these resampled data to obtain an estimate of the intercept and the slope. We repeated the procedure of "within-subject resampling" and estimation; the average of the estimated intercepts (or slopes) over the resampled data is the multiple outputation estimate of the intercept (or slope). It yields results similar to those presented from regression of the averages, with an estimate of the intercept of 0.04 and an estimate of the slope of 1.02.
Agreement between measures. A Bland-Altman plot shows the differences between two measures (on the y axis) versus the averages of the two measures (on the x axis), which helps to determine how the measurements from two methods agree with each other.
For the detectable viral load readings (both on a log10 scale), we used linear regression of the differences between the two readings versus the averages of the two readings. The estimated coefficients of this linear regression are all close to 0: the intercept is 0.19 (P value = 0.39) and the slope is –0.05 (P value = 0.19). The two P values, both >0.1, indicate that both the intercept and the slope are not significantly different from 0. Therefore, the Bland-Altman analysis shows that the viral load readings from the Bayer and the Abbott assays are almost the same and that the difference between the two readings is not related to the magnitude of the viral load (Fig. 2). In fact, for 95.3% of the subjects, the differences in the viral load readings from the Abbott and the Bayer assays were within 0.51 log10.
![]() View larger version (12K): [in a new window] |
FIG. 2. Plots of the differences between the viral load readings from the Bayer and Abbott assays versus the averages of the two assays. The line is from linear regression.
|
Time to completion and ease of performance. The Bayer Versant HCV RNA (version 3.0) bDNA assay requires an overnight (15- to 18-h) incubation of sample in the Q340 instrument for the hybridization of RNA with target probes (Table 1). The preparation of samples/reagents, the loading of the plate, and the placement of the plate into the instrument on day 1 are usually accomplished in 1 to 2 h. These steps are simple "recipe" mixing and pipetting procedures requiring moderate technical skill. Completion of the assay on day 2 is generally performed in 4 to 5 h and, again, requires the simple mixture of reagents and multichannel pipetting. The washing and reading of the plate are fully automated. Once the Q340 instrument reads the plate, the Bayer software yields a final, printed report automatically. Thus, the overall time required to obtain a result from the bDNA assay is roughly 20 to 25 h.
|
View this table: [in a new window] |
TABLE 1. Comparison of Abbott and Bayer HCV quantitation assays
|
|
|
|---|
Both the Bayer HCV bDNA assay and the Abbott 7000 ASR assay yield consistent, reproducible results (17). Our comparison of the two systems for monitoring of the viral load revealed that both measures were equivalent when the results fell within detectable limits. The areas in which the two assays differed significantly are limit of detection, ease of performance, and time to completion.
Clinical studies rely on early virologic responses to determine the efficacies of therapeutic strategies consistently. Considering this, the Abbott assay has an advantage over the Bayer assay. Its lower limit of detection allows assessment of the viral load over a wider range of viral loads. For example, HCV was detected by the Abbott assay but not by the Bayer assay in eight samples obtained from six patients. (As mentioned above, all but one of these samples had HCV loads below 180 IU/ml, with a range of 18 to 1,900 IU/ml.) In addition, with the Abbott 7000 instrument and the Abbott ASR HCV genotyping reagents, it is possible to simultaneously determine the genotype while quantitating a sample. This may be a bonus to laboratories with limited space and time.
From an ease-of-performance standpoint, the Bayer assay has the advantage. There are fewer overall steps involved with setting up the assay, thus minimizing the potential for contamination, a problem with all PCR-based assays. In addition, while the assay involves more technical time on the second day, the steps are simple and the instrument provides automatic results, something not available with the Abbott 7000 instrument. In addition, it is possible to simultaneously run HCV and HIV load bDNA assays (5), making the Bayer assay an efficient and time-saving option in a laboratory conducting research on both analytes. Finally, as mentioned above, the Abbott assay shows less precision at the extremes of the viral load range.
In conclusion, although it is preferable to continuously monitor a patient by the same assay throughout a course of treatment, it is possible to compare the results obtained by the Abbott HCV quantitative ASR assay to the results obtained by the Bayer HCV (version 3.0) bDNA assay by using the formula derived from our results: log10 Abbott assay measure = 0.032 + 1.01 log10 Bayer assay measure.
In addition, from a laboratory perspective, the two assays give equivalent results when values fall within the overlapping detectable range, but each has advantages, depending upon the needs of the laboratory. Laboratories requiring a quick turnaround and coverage of a broad viral load range may consider the Abbott assay to be more suited to their needs. Laboratories concerned about simplicity of operation, high volume, and multiple analytes may prefer Bayer's bDNA assay. In either test, one may obtain reliable, reproducible results in a reasonable period of time. On the basis of the results of our testing, we believe that both assays are relatively robust and that our findings may easily be reproduced, provided that technicians are familiar with the molecular techniques involved and provided that they follow the manufacturer's instructions or in-house procedures as written.
The content of this publication does not necessarily reflect the views or policies of the U.S. Department of Health and Human Services, nor does the mention of trade names, commercial products, or organizations imply endorsement by the U.S. Government.
Subsequent to the submission of this paper, Bayer Healthcare LLC, Diagnostics Division, was purchased by Siemens Medical Solutions Diagnostics, Tarrytown, NY.
Published ahead of print on 27 June 2007. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»