Previous Article | Next Article ![]()
Journal of Clinical Microbiology, August 2004, p. 3739-3746, Vol. 42, No. 8
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.8.3739-3746.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
Department of Pathology and Laboratory Medicine, Emory University School of Medicine,1 Emory Medical Laboratories, Emory University Hospital, Atlanta, Georgia2
Received 12 February 2004/ Returned for modification 7 April 2004/ Accepted 7 May 2004
|
|
|---|
6-log10 linear dynamic range and excellent reproducibility, with a mean coefficient of variation of 14%. HCV RNA concentration measured with the ASR agreed within an average of 0.42 log10 (2.6-fold) of the labeled concentration with members of a standard reference panel. HCV genotypes 1 to 4 were amplified with similar efficiencies with the ASR. The ASR and AMPLICOR MONITOR viral load results were significantly correlated (r = 0.8898; P < 0.01), but the agreement was poor (mean difference, 0.45 ± 0.35 log10) for 72 HCV RNA-positive clinical samples. However, 98.9% agreement between the ASR and qualitative AMPLICOR test results was found with 60 positive and 29 negative samples. Limiting-dilution experiments demonstrated that the limits of detection for ASR and AMPLICOR tests were 84 and 26 IU/ml, respectively. The performance characteristics of the TaqMan HCV ASR are appropriate for all clinical applications of HCV RNA testing. |
|
|---|
A variety of tests for detection and quantitation of HCV RNA based on different nucleic acid amplification technologies are commercially available. The qualitative AMPLICOR HCV and quantitative AMPLICOR HCV MONITOR version 2.0 tests (Roche Diagnostics Corporation, Indianapolis, Ind.) are based on conventional reverse transcription-PCR in a heterogeneous format (17). The VERSANT HCV RNA qualitative and VERSANT HCV RNA 3.0 quantitative assays (Bayer Healthcare, Tarrytown, N.Y.) are based on transcription-mediated amplification and branched DNA signal amplification, respectively (10, 15).
These tests also differ in their lower limits of detection and dynamic ranges. The qualitative AMPLICOR and VERSANT tests have lower limits of detection of 50 and 5 IU/ml, respectively. Although the lower limits of detection for the quantitative AMPLICOR and VERSANT tests are both approximately 600 IU/ml, the dynamic ranges differ by approximately 1 log10 and are 3.1 and 4.1 log10, respectively. Because of the differences in sensitivity between the qualitative and quantitative assays, many clinical laboratories use a quantitative test to determine viral load and a sensitive qualitative test for diagnosis and test-of-cure. A single test with sensitivity similar to the qualitative tests that accurately quantitates high viral loads would be beneficial for clinical laboratories.
A number of homogeneous TaqMan reverse transcription-PCR assays for detection and quantitation of HCV RNA have been described (12, 13, 19, 21, 29). These tests are very sensitive, have broad dynamic ranges, and provide precise quantitation of viral load. These tests also generate results more rapidly than the earlier heterogeneous tests and are not prone to amplicon carry-over contamination, since the amplification and detection steps are combined in a single closed tube.
Roche Diagnostics Corp. recently developed a TaqMan HCV analyte-specific reagent (ASR). It was designed for the newly released COBAS TaqMan analyzer, a real-time PCR instrument developed for the clinical laboratory. An ASR may be sold to clinical laboratories regulated under the Clinical Laboratory Improvement Amendments (CLIA) of 1998 as qualified to do high-complexity testing. The laboratory is responsible for verifying and validating the test, and the reports should be appended with a standard disclaimer stating that the test was developed by and its performance characteristics determined by the laboratory and that the test has not been cleared or approved by the U.S. Food and Drug Administration (FDA).
This study is the first to report the dynamic range, sensitivity, reproducibility, accuracy, and genotype bias of the ASR. The performance characteristics of the ASR were also compared with those of the qualitative AMPLICOR and quantitative AMPLICOR MONITOR HCV version 2.0 tests.
|
|
|---|
Sample preparation. The starting sample volume for all of the tests was 200 µl. All samples tested in the AMPLICOR MONITOR HCV test were diluted 1:10 in normal human plasma prior to processing. Samples for the other tests were not diluted. HCV RNA was extracted from samples for the AMPLICOR MONITOR HCV test using the manual method according to the manufacturer's instructions. HCV RNA was extracted from serum samples for the AMPLICOR HCV test using the MagNA Pure LC instrument and the total nucleic acid reagent set (Roche Applied Science, Indianapolis, Ind.) as previously described (7).
The MagNA Pure LC instrument and total nucleic acid reagent set were also used to extract HCV RNA for the ASR. The instrument and reagents were used as recommended by the manufacturer with the following exceptions. The ASR quantitation standard (QS) was added to the lysis buffer to achieve a final concentration of 5 copies/µl (0.125 ml of HCV QS to 10 ml of lysis buffer). The purified RNA was eluted in 65 µl of elution buffer. The nominal concentration of the HCV QS in the eluant was 22 copies/µl, as recommended for the TaqMan HCV ASR by the manufacturer.
HCV RNA tests. The microwell plate AMPLICOR and AMPLICOR MONITOR HCV version 2.0 tests were performed according to the manufacturer's instructions. The ASR consists of an HCV master mix, a QS, and a 50 mM solution of manganese acetate. The master mix contains upstream and downstream primers to the 5' untranslated region of the HCV genome, fluorescently labeled HCV- and QS-specific oligonucleotide probes, Z05 DNA polymerase, deoxynucleotide triphosphates (dATP, dCTP, dGTP, and dUTP), AmpErase uracil-N-glycosylase, potassium acetate, dimethyl sulfoxide, glycerol, and sodium azide in tricine buffer. The HCV QS contains a noninfectious, protein-encapsulated RNA with the HCV primer binding sequences and a unique probe binding region at a concentration of 400 copies/µl, poly(rA) RNA, EDTA, amaranth dye, and ProClin 300 in sodium phosphate buffer. Single lots of master mix and QS were used throughout the study.
The master mix was activated by the addition of 170 µl of 50 mM manganese acetate, and the activated master mix was used within 60 min of preparation. Fifty microliters of processed sample or calibrator was added to 50 µl of activated master mix. The amplification and detection reactions were started within 30 min of the addition of the sample. Thermal cycle parameters were as follows: two precycles of 5 min at 50°C and 30 min at 59°C, two cycles of 15 s at 95°C and 25 s at 58°C, and 60 cycles of 15 s at 91°C and 25 s at 58°C, followed by a postcycle hold at 40°C.
The ASR was run on the COBAS TaqMan 48 analyzer. It is a real-time PCR instrument designed for the clinical laboratory that consists of two independently programmable, 24-sample thermal cyclers, a halogen light source, two 24-channel fluorescence photometers with four different filter combinations, and Amplilink software. It has a run size of 6 to 48 samples.
The ASR was calibrated by using serial 10-fold dilutions of a well-characterized clinical specimen containing HCV genotype 1 that were tested at seven different levels in quadruplicate in a single run. The starting concentration was assigned using the AMPLICOR HCV MONITOR test. The threshold or elbow values (EVs) for both HCV and QS were stored and used by the instrument software to determine the lot-specific calibration coefficients that were used in calculation of the sample HCV RNA concentrations.
HCV genotyping. HCV genotypes were determined using a commercially available reverse hybridization, line probe assay (VERSANT HCV Genotype Assay; Bayer Healthcare) according to the manufacturer's instructions. The amplicon from the 5' untranslated region used in the genotyping assay was generated with the AMPLICOR HCV test.
Data analysis. Descriptive statistics, correlation coefficients, and regression line equations were calculated with the data analysis tool pack of Microsoft Excel 2000 (Microsoft Corp., Redmond, Wash.). Agreement between viral load values was assessed by the method of Bland and Altman (2). The limits of detection were determined using probit analysis (8).
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Reproducibility of EVs for the TaqMan HCV ASR calibratorsa
|
![]() View larger version (13K): [in a new window] |
FIG. 1. Measured versus expected concentrations of serial 10-fold dilutions of a sample with a starting concentration of 7.27 log10 IU/ml. The starting concentration was determined with the AMPLICOR HCV MONITOR test. Each point represents the mean of four replicates tested in a single run. The dashed line represents unity.
|
![]() View larger version (11K): [in a new window] |
FIG. 2. Measured versus expected concentrations of serial dilutions of two high-titer samples. , sample 1; , sample 2. The starting concentrations were determined with the TaqMan HCV ASR (sample 1, 8.43 log10 IU/ml; sample 2, 7.95 log10 IU/ml). Each point represents the average of duplicates tested in a single run. The dashed line represents unity.
|
|
View this table: [in a new window] |
TABLE 2. Reproducibility and accuracy of the TaqMan HCV ASR determined with a standard reference panel of HCV RNA
|
![]() View larger version (11K): [in a new window] |
FIG. 3. Measured versus labeled concentrations for a standard reference panel of HCV RNA tested with the TaqMan HCV ASR. Each point represents the mean of four replicates tested in a single run. The dashed line represents unity.
|
![]() View larger version (12K): [in a new window] |
FIG. 4. Correlation and linear regression analysis of viral load values obtained with the TaqMan HCV ASR and the AMPLICOR HCV MONITOR test. HCV genotypes are indicated as follows: , genotype 1; , genotype 2; , genotype 3; , genotype 4.
|
![]() View larger version (12K): [in a new window] |
FIG. 5. Agreement of viral load values obtained with the TaqMan HCV ASR and the AMPLICOR HCV MONITOR test. Difference log10 IU/ml = ASR value MONITOR value. Average log10/IU/ml = (ASR value + MONITOR value)/2. HCV genotypes are indicated as follows: , genotype 1; , genotype 2; , genotype 3; , genotype 4.
|
We tested the 89 clinical samples in parallel with the qualitative AMPLICOR HCV test and the ASR. The results of the two tests agreed for 98.9% of the samples (Table 3). HCV RNA was detected by both tests in 59 samples and not detected by both tests in 29 samples. HCV RNA was detected only with the AMPLICOR test in one sample. The sensitivity and specificity of the ASR with respect to the AMPLICOR test were 98.3 and 100%, respectively.
|
View this table: [in a new window] |
TABLE 3. Qualitative results obtained with the AMPLICOR HCV test and the TaqMan HCV ASR for 89 clinical samples
|
50 IU/ml by the AMPLICOR test, and proportionally fewer replicates were detected at lower concentrations. Probit analysis indicated that the concentration at which 95% of the replicates should be positive (limit of detection) was 84 IU/ml for the ASR and 26 IU/ml for the AMPLICOR test. |
View this table: [in a new window] |
TABLE 4. Limits of detection for the AMPLICOR HCV test and the TaqMan HCV ASR
|
|
|
|---|
Under the ASR rule manufacturers are not required to seek FDA premarket approval for low-risk ASRs, which include all but blood banking tests, and those used for the diagnosis of potentially deadly infectious diseases (e.g., tuberculosis and AIDS) and genetic disorders. To qualify for the regulatory exemptions, the manufacturer cannot make analytical or clinical performance claims. It also cannot provide clinical laboratories with instructions on how to use the ASR or with appropriate calibrators and controls. In addition, the manufacturer is required to register and list the ASR with the FDA, to meet good manufacturing process standards, to report adverse events, and to restrict the distribution of the ASR to CLIA high-complexity laboratories. The clinical laboratories are required to develop and maintain the analytical performance characteristics of the test in which the ASR is used and to report the test results with a standard disclaimer.
Roche also markets a research-use-only (RUO) version of the TaqMan HCV RNA test. The reagents in an RUO test are calibrated by the manufacturer and come with additional controls and instructions for use. However, clinical laboratories that use the RUO test are still required to determine its local performance characteristics under CLIA 1998. Clinical laboratories may use either the ASR or the RUO kit for all the clinical applications of HCV RNA testing except testing of blood donors.
The TaqMan HCV ASR demonstrated a very broad dynamic range of at least 6 log10 IU/ml. The dynamic range for the ASR may actually be even broader, since with at least one sample we were able to document linearity of the assay up to 270,000,000 IU/ml. Even with the more conservative estimate of 6 log10, the ASR has a much broader dynamic range than either of the other commercially available quantitative HCV assays, the AMPLICOR HCV MONITOR version 2.0 (3.1 log10) and the VERSANT HCV RNA 3.0 (4.1 log10). The dynamic range is comparable to that described for in-laboratory-developed, real-time PCR assays for HCV RNA. We were unable to adequately characterize the performance of the ASR at the upper end of the dynamic range due to the scarcity of clinical samples and reference material with viral loads of in excess of 108 IU/ml. Based on our data, we estimate that the ASR can precisely determine viral loads from 500 to 200,000,000 IU/ml. The broad dynamic range of the ASR makes it well suited for assessing viral loads throughout a course of treatment.
The user defines the calibrators for the ASR. We chose to calibrate it using a clinical sample that was assigned a viral load value with the AMPLICOR HCV MONITOR test. A clinical sample was used rather than standard reference material because of the lack of available high-titer reference material. We used the AMPLICOR HCV MONITOR test to assign the initial concentration because it is commonly used in clinical laboratories and it is calibrated against the World Health Organization HCV international standard. We found that the standard curve was stable when using the same lot of reagents, with an average CV in the EVs of only 1.1% over three runs. A single standard curve can be run once in quadruplicate to generate lot-specific calibration coefficients.
The accuracy of the calibration was checked with a commercially available standard reference panel. The values determined with the ASR were consistently 2.6-fold greater than the labeled concentrations from 100 to 2,000,000 IU/ml. Agreement within threefold is generally considered acceptable when comparing different methods for HCV viral load measurement (28).
The within-run precision of the ASR viral load measurements was assessed with a standard reference panel and serial dilutions of a clinical sample. In each case, the average CV over the dynamic range was approximately 14%. Given this level of variation, a greater-than-twofold (0.3 log10) difference between samples will be statistically significant (P < 0.05) over most of the dynamic range of the assay. At either end of the dynamic range, threefold (0.5 log10) differences will be statistically significant (P < 0.05). The precision of the ASR compares favorably with the precision reported for the AMPLICOR HCV MONITOR version 2.0 test (16) and is similar to that reported for the VERSANT HCV RNA 3.0 assay (1, 30).
We found significant correlation but poor agreement between the results obtained with the ASR and the AMPLICOR MONITOR test for the same clinical samples. The average difference between the results was 0.45 log10, and the difference increased as the viral load increased. This is best explained by differences in the true dynamic ranges of the two tests. Although the upper limit of the linear range claimed by the manufacturer for the AMPLICOR MONITOR test is 850,000 IU/ml, other studies indicate that the test plateaus at concentrations above 500,000 IU/ml (14, 16, 22). Significant variation between values from diluted and undiluted samples was observed in those studies with samples in the range of 500,000 to 850,000 IU/ml. We diluted all samples 1:10 prior to testing with the AMPLICOR MONITOR to permit better quantitation of samples with high viral loads, and we used 8,500,000 IU/ml as the upper limit of the linear range. The sharp increase in the magnitude of the differences between test results with samples with mean viral loads greater than 3,200,000 (6.5 log10) observed here suggests that the dynamic range of the AMPLICOR MONITOR test is more limited than previously reported.
Genotype bias was a significant problem with the first version of the AMPLICOR HCV MONITOR test, due to secondary structures that could form in the target cDNA at the relatively low annealing and extension temperatures used. This was addressed by reformulation of the PCR mixture and modification of the thermal cycle parameters in the version 2.0 test. The version 2.0 test amplifies all HCV genotypes with similar efficiency (6, 16). A prototype of the TaqMan HCV ASR was also shown to amplify RNA transcripts from the different HCV genotypes with comparable efficiencies (13). We demonstrated that the ASR amplification efficiencies were similar for clinical samples with HCV genotypes 1 to 4. Like the AMPLICOR MONITOR version 2.0 and prototype TaqMan tests, the ASR was free of significant genotype bias.
The clinical and analytical sensitivities of the ASR were compared with those for the qualitative AMPLICOR HCV test. We found that the ASR detected all but 1 of the 60 positive clinical samples tested in parallel (sensitivity, 98.3%) and that the limits of detection were similar: 84 IU/ml for the ASR and 26 IU/ml for the AMPLICOR test. Since the same sample volume, nucleic acid extraction protocol, and reaction input volume were used for both tests, the difference in the limits of detection may have resulted from small differences in PCR efficiencies between the tests. The small difference in analytical sensitivity is unlikely to have a major impact on the performance of the ASR when it is used to diagnose active infections, since it is rare for pretreatment viral load values to be less than 100,000 IU/ml.
The analytical sensitivity required to adequately assess end-of-treatment virological responses in HCV infection is not well established. The VERSANT HCV RNA assay, with a 5-IU/ml limit of detection, was able to detect residual serum viral RNA in some patients who had no detectable viral RNA in the AMPLICOR HCV test at the end of treatment with interferon and subsequently experienced a virological relapse (4, 27). However, no difference between the tests was observed with end-of-treatment samples from patients treated with the newer, faster-acting, polyethylene glycol-modified interferon (26). It is unlikely that small differences in analytical sensitivity will be important in the assessment of end-of-treatment virological responses in patients treated with the most effective regimens.
The manual extraction protocol given as an example by the manufacturer in the ASR package insert uses a sample input volume of 500 µl. We used automated processing and a 200-µl input. The larger sample volume could improve the limit of detection by as much as 2.5-fold.
The COBAS TaqMan 48 analyzer is the first real-time PCR instrument designed for the clinical laboratory. The instrument was simple to use and was reliable over the 6-month evaluation period. The software allowed storage of patient demographic and order data, which is helpful for clinical laboratories. However, unlike research instruments, the software did not generate amplification plots or multicomponent views, which can be very helpful in troubleshooting real-time PCR.
In conclusion, the TaqMan HCV ASR and the COBAS TaqMan 48 analyzer are among the first real-time PCR assays and platforms designed specifically for the clinical laboratory. Together they represent a powerful new tool for quantitation of HCV RNA and can provide a single assay platform that has the required combination of analytical sensitivity, dynamic range, and precision for all the current clinical applications of HCV RNA testing.
|
|
|---|
2b plus ribavirin for 48 weeks or for 24 weeks verus interon
2b plus placebo for 48 weeks for treatment of chronic infection with hepatitis C virus. Lancet 352:1426-1432.[CrossRef][Medline]
2a. J. Clin. Microbiol. 39:2850-2855.
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2010 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»