Previous Article | Next Article ![]()
Journal of Clinical Microbiology, February 2005, p. 596-603, Vol. 43, No. 2
0095-1137/05/$08.00+0 doi:10.1128/JCM.43.2.596-603.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
Associated Regional and University Pathologists Institute for Clinical and Experimental Pathology,1 Department of Pathology, University of Utah Medical Center, Salt Lake City, Utah2
Received 29 December 2003/ Returned for modification 22 April 2004/ Accepted 1 October 2004
|
|
|---|
|
|
|---|
The Digene Hybrid Capture 2 (HC2; Digene Corporation, Gaithersburg, Md.) assay in the ultrasensitive format has an improved lower limit of detection (4,700 HBV DNA copies/ml) but requires the use of 1 ml of patient sample and an ultracentrifugation step prior to testing. The analytical measurement range (AMR) of the Ultrasensitive HC2 assay determined by the manufacturer and evaluated elsewhere (40) is 4,700 to 56,000,000 HBV DNA copies/ml (3.7 to 7.8 log HBV DNA copies/ml). According to the manufacturer, the AMR of the standard HC2 assay is 142,000 to 1,700,000,000 HBV DNA copies/ml (5.2 to 10.2 log HBV DNA copies/ml). The COBAS Amplicor HBV Monitor assay (Roche Molecular Diagnostics) offers a better lower limit of quantification (200 HBV DNA copies/ml) than non-PCR-based assays. However, like other endpoint detection assays, this assay has the disadvantage of a narrow AMR: 200 to 200,000 HBV DNA copies/ml (42) (range, 2.3 to 5.3 log HBV DNA copies/ml). We evaluated the COBAS Amplicor HBV Monitor test (Amplicor), compared it to the HBV HC2 assay, and examined the efficacy of diluting samples to expand the dynamic range of the Amplicor assay.
|
|
|---|
Digene Hybrid Capture 2 assay. Samples were assayed using the ultrasensitive protocol according to the manufacturer's instructions. The HBV in a sample volume of 1 ml was concentrated by using ultracentrifugation (33,000 x g for 110 min at 4°C), the supernatant was decanted, and 25 µl of buffer was added to residual supernatant and pellet. Thirty microliters each of concentrated calibrators, controls, and samples were denatured in a 96-well microtiter plate, and the RNA probes were added and incubated. Capture of the RNA-DNA hybrids was performed by transfer of the solution into microtiter plates coated with anti-RNA-DNA hybrid antibody. Following incubation and wash steps, the captured antibody hybrid complexes were reacted with anti-hybrid antibody conjugated to alkaline phosphatase and detected with the chemiluminescent substrate CDP-Star with Emerald II. The plate was read using a DML 2000 luminometer (Digene Corporation), and the results were analyzed by using software supplied by Digene. The AMR for this method is 4,700 to 56,000,000 HBV DNA copies/ml (3.7 to 7.8 log HBV DNA copies/ml). Results were reported as HBV DNA copies/milliliter and picograms of HBV DNA/milliliter.
Qualitative HBV DNA PCR. The qualitative assay consisted of HBV DNA extracted by QIAGEN (Valencia, Calif.) chemistry, amplified using hot-start PCR, and analyzed using agarose gel electrophoresis, ethidium bromide staining, and detection at 302 nm. HBV DNA extraction from clinical serum and plasma samples was achieved by using QIAamp DNA Blood Mini kit protease (QIAGEN Inc.), and buffers (AW1 and AW2) were reconstituted as per the manufacturer's instructions. Twenty-five microliters of QIAGEN protease was added to a labeled 1.5-ml microcentrifuge tube, to which 200 µl of patient sample and 200 µl of buffer AL were added. The mixture was then pulse vortexed and placed in a 60°C dry-heat bath for 15 min and then transferred to a 100°C dry-heat bath for 10 min. Tubes were removed from heat and allowed to cool for 2 min, and 200 µl of 96% ethanol was added to each tube. Samples were vortexed and then transferred to the appropriately labeled QIAamp column, which was then centrifuged at 6,000 x g for 1 min. The used collection tube was discarded, and a new collection tube was placed on the column. Five hundred microliters of buffer AW1 was added to each column, which was then centrifuged at 6,000 x g for 1 min. The used collection tube was discarded, and a new collection tube was placed on the column. Five hundred microliters of buffer AW2 was added to each column, which was then centrifuged at 20,000 x g for 3 min. The used collection tube was discarded, and a new collection tube was placed on the column and centrifuged at 20,000 x g for 1 min. The used collection tube was discarded, and the QIAamp column was placed in a 1.5-ml flip-cap tube, and 100 µl of molecular-grade water was added to each column, allowed to incubate at room temperature for 5 min, and then centrifuged for 1 min at 6,000 x g.
The master mix for each sample contained a total final volume of 50 µl and consisted of a final concentration of the following components per reaction: 1.25 U of AmpliTaq Gold DNA polymerase (PE Applied Biosystems, Foster City, Calif.), 1x GeneAmp 10x PCR Buffer II (PE Applied Biosystems), 3 mM (25 mM MgCl2) solution (PE Applied Biosystems), 200 mM (400 mM dUTP) GeneAmp dNTP Blend (12.5 mM with dUTP; PE Applied Biosystems), 0.5 U of AmpErase UNG (PE Applied Biosystems), 1 mM S96-1 primer (50 µM [5'-GTG GCT CCA GTT CAG GAA CA-3']), and 1 mM S96-3 primer (50 µM [5'-CAT CCA GCG ATA ACC AGG AC-3']), with the remaining master mix volume of 40 µl made up with molecular-grade water. Ten microliters of processed sample was added to this master mix. Samples were amplified using a GeneAmp 9700 (PE Applied Biosystems) under the following conditions: a hold step for 10 min at 50°C, a hold step for 10 min at 95°C, and 45 cycles of 94°C for 30 s, 58°C for 30 s, and 72°C for 30 s.
Postamplification, 6 µl of 10x BlueJuice gel loading buffer (Gibco BRL, Rockville, Md.) was added to each reaction mixture as a loading dye. The samples and controls mixed with loading dye were loaded onto agarose gel (Latitude precast 2% Seakem LE plus agarose-1x Tris-borate-EDTA buffer plus ethidium bromide; Biowhittaker Molecular Applications, Rockland, Maine) including one lane with a BioMarker Low 50- to 1,000-bp ladder (Bioventures Inc., Murfreesboro, Tenn.). Electrophoresis was performed at 80 V for
1 h, and the gel was viewed under UV light at 302 nm, digitally photographed, and labeled. A sample was considered positive for HBV DNA if a 340-bp PCR product was observed. The limit of detection of this assay is
200 HBV DNA copies/ml as determined by replicate testing of serial dilutions of HBV DNA-positive samples previously quantitated by using the HC2 assay, and assay specificity was determined to be 100% (60 out of 60 positive by HC2 assay and 60 out of 60 negative from low-risk donor samples).
Sample selection. EDTA plasma and serum samples submitted to Associated Regional and University Pathologists (ARUP) Laboratories for the determination of HBV DNA levels by HC2 or Amplicor assay were systematically selected for use in this study by identifying samples with results within the range of interest and with ample volume remaining for additional testing. Samples tested with the Amplicor and in-house PCR assays were deidentified prior to testing. Clinical samples tested by HC2 assay with results less than 12,000 HBV DNA copies/ml were retested by HC2 assay. The retesting results were compiled by the testing technologists, removing patient identifiers from the data.
Linearity. Four HBV DNA-positive samples were serially diluted five times in NHS to obtain a range of HBV DNA levels from <100 to 40,000 HBV DNA copies/ml as measured with the HC2 assay. An additional four samples with HBV DNA levels determined by HC2 assay to be >200,000 copies/ml were serially diluted five times in NHS to obtain a range of HBV DNA levels from 20,000 to 500,000 copies/ml. All dilution samples were tested by using both the Amplicor and HC2 assays in triplicate on the same day. Results were reported as log HBV DNA copies per milliliter and observed-versus-expected plots were created. Expected results for each dilution series were back calculated by using the result within the claimed analytical measurement range of the assay with the best precision, and the value chosen was not used in the analysis, thereby yielding four expected values for each dilution series. This method of calculation was used to determine the internal linearity of the assays.
Precision. The triplicate measurements from the dilution series were used to evaluate the within-run precision of the methods. Duplicate values from the comparison study were used to evaluate the between-run precision of the Amplicor assay. Precision was expressed as the percent coefficient of variation (CV) (standard deviation [SD] divided by the mean of the replicates multiplied by 100%). In addition, the average within-run variance (SD2) of replicates in both the Amplicor and HC2 assays was calculated. The average SD was determined by taking the square root of the average within-run variance. Average SDs were compared by using the F test.
Correlation. Fifty-eight clinical samples with HBV DNA levels of 5,000 to 300,000 HBV DNA copies/ml as measured in the HBV HC2 assay were split and tested in duplicate with the Amplicor assay. The aliquots of the duplicate specimens were submitted on separate weeks. Forty-two samples with HC2 HBV DNA levels of >200,000 copies/ml were run undiluted in the Amplicor assay. Previous studies indicated that high-titer HBV DNA-containing samples could be diluted to obtain quantitative results (21, 42) in the Amplicor assay, so samples with undiluted results greater than 200,000 HBV DNA copies/ml were diluted 1:900, 1:27,000, or 1:810,000 as needed to obtain results within the analytical measurement range of the Amplicor assay. Final results with the Amplicor and HC2 assays were compared by using Deming regression analysis. In addition, distribution patterns of HBV DNA copies/milliliter for patient results from 12,400 HC2 and 12,329 Amplicor samples were extracted from a central result database. The number and proportion of samples falling in various ranges for both assays were compared.
Specificity. Three clinical samples with alternating HC2-positive and -negative (discrepant) results on the same specimen and 34 samples reported with <5,000 HBV DNA copies/ml in the HC2 assay were assayed singly in the following assays: COBAS Amplicor HBV Monitor, Digene HBV Hybrid Capture 2, and qualitative HBV PCR assays. In addition, over a 4-month period from October 1999 to February 2000, 149 samples quantitated with between 4,700 and 30,000 HBV DNA copies/ml in the Ultrasensitive HC2 assay were observed. These specimens were retested with the Ultrasensitive HC2 assay when enough sample was available. Paired Student's t test analysis was used to compare the means of the initial results against the means of repeated results.
Data analysis. The results from the Amplicor and HC2 assays in HBV DNA copies/milliliter were converted to log units for linearity, comparison, and limit-of-detection analysis. The observed-versus-expected graph was analyzed by using linear regression, and all other comparisons were evaluated by using Deming regression.
|
|
|---|
![]() View larger version (19K): [in a new window] |
FIG. 1. Within-run precision of COBAS Amplicor HBV Monitor and Ultrasensitive Digene HC2 assays. Eight samples were serially diluted in HBV-seronegative NHS and tested in the Amplicor and HC2 assays in triplicate on the same day. The means and standard deviations of triplicate values (log HBV DNA copies per milliliter) were calculated and plotted (HC2 [ ], n = 24; Amplicor [ ], n = 40).
|
![]() View larger version (14K): [in a new window] |
FIG. 2. Between-run precision of COBAS Amplicor HBV Monitor assay. Fifty-two clinical samples were tested undiluted in duplicate in the Amplicor assay on separate days. The means and standard deviations of log HBV DNA copies/milliliter of the duplicate values were calculated and plotted.
|
![]() View larger version (18K): [in a new window] |
FIG. 3. COBAS Amplicor HBV Monitor assay linearity. Eight samples were serially diluted in HBV-seronegative NHS and tested by the Amplicor assay in triplicate on the same day. The means of triplicate values were calculated and plotted as log HBV DNA copies/milliliter. The equation of the linear regression (solid line) is as follows: Observed = 1.073(Expected) 0.247; R2 = 0.993, n = 32. The dashed line represents identity.
|
Correlation. One hundred clinical samples previously tested by HC2 assay were tested with the Amplicor assay. The Deming regression was as follows: Amplicor = 1.197(HC2) 0.961; standard error of the estimate (SEE) = 0.710, n = 94, R2 = 0.799. A Deming regression analysis comparing Amplicor and HC2 results is presented in Fig. 4. Paired Student's t test analysis indicated that the slope (1.197 log) and intercept (0.961 log) are statistically different from 1.000 (P = 0.001) and 0 (P = 0.004), respectively. Paired Student's t test analysis of the means of the Amplicor and HC2 assays indicates that the means are not equivalent (P = 0.04, n = 94). Note that in addition to the poor correlation noted above, six samples which had >5,000 HBV DNA copies/ml by the HC2 assay were found to have <200 HBV DNA copies/ml by Amplicor assay. These samples were tested by the qualitative PCR method and were found to be negative for HBV DNA.
![]() View larger version (17K): [in a new window] |
FIG. 4. Deming regression comparison of Digene HC2 assay and COBAS Amplicor HBV Monitor assay. One-hundred samples previously tested using the HC2 assay were tested undiluted in the Amplicor assay. Samples with results greater than 200,000 HBV DNA copies/ml were diluted and retested. Deming regression (solid line) was as follows: Amplicor = 1.197(HC2) 0.961; R2 = 0.799, SEE = 0.710, n = 94. The dashed line represents identity.
|
![]() View larger version (17K): [in a new window] |
FIG. 5. Deming regression comparison of samples run undiluted and diluted in the COBAS Amplicor HBV Monitor assay (Amplicor). Forty-one clinical samples tested undiluted and diluted in the Amplicor assay are shown. Deming regression comparing undiluted and diluted samples (solid line) was as follows: Diluted = 1.50 (Undiluted) 2.23; SEE = 0.22, n = 38, R2 = 0.922. The dashed line represents identity.
|
|
View this table: [in a new window] |
TABLE 1. Comparison of results using the Digene HBV Hybrid Capture 2 and COBAS Amplicor HBV Monitor assaysa
|
30,000 HBV DNA copies/ml were selected for repeat testing. These samples were retested by Ultrasensitive HC2 assay when enough sample was available. Twenty-eight (18.8%) of the samples were not able to be retested due to insufficient sample volume. Of the remaining 121 samples, 89 (73.6%) samples showed results within 0.41 log of the initial results, and 32 (26.4%) samples showed results of <4,700 HBV DNA copies/ml. Among the samples in which HBV DNA was not detected upon retesting, the average initial value was 6,831 HBV DNA copies/ml, with a median initial value of 6,250 HBV DNA copies/ml and a standard deviation of 1,779 HBV DNA copies/ml. Of the samples that returned results showing >4,700 HBV DNA copies/ml upon retesting, the average initial value was 9,731 HBV DNA copies/ml, with a median initial value of 8,400 HBV DNA copies/ml and a standard deviation of 4,417 HBV DNA copies/ml. Upon retesting, the average value was 10,261 HBV DNA copies/ml, with a median value of 8,600 HBV DNA copies/ml and a standard deviation of 6,062 HBV DNA copies/ml. Paired Student's t test comparing the initial and repeated HBV DNA results of the samples which were quantitated upon retesting indicated that the results were not statistically different (P = 0.507, n = 89). A breakdown of the initial HBV DNA level and the number and percentage of samples that repeated with or without quantitative HBV DNA results are presented in Table 3. |
View this table: [in a new window] |
TABLE 2. Comparison between HBV Hybrid Capture 2, COBAS Amplicor HBV Monitor, and qualitative PCR assaysa
|
|
View this table: [in a new window] |
TABLE 3. Comparison of results initially >4,700 HBV DNA copies/ml by the Digene Ultrasensitive HBV HC2 assay and retested with the HC2 assaya
|
|
|
|---|
This study documents the performance attributes of the COBAS Amplicor HBV Monitor and the HBV Hybrid Capture 2 tests and examines their performance using shared replicate samples. We find that Deming regression comparing the Amplicor assay to the HC2 assay shows poor agreement between the methods, with the large standard error of the estimate (SEE = 0.710) indicating that a sample tested by both assays can have results that differ by 2 logs 5% of the time. The upper limit of linearity of the Amplicor assay, using undiluted samples, was found to be approximately 200,000 HBV DNA copies/ml, which agrees with the manufacturer's package insert, but this range can be expanded through the use of dilution of high-titer samples. In addition, we find that the Amplicor assay has lower within-run variance than the Ultrasensitive HC2 assay when paired samples detected in both assays are compared. The observed greater variation in HC2 results could be attributable to technical issues such as loss or partial removal of the pellet during decanting or could be due to an inherent increase in variation near the limit of detection of the HC2 assay.
A previous study indicated that the dilution level for a sample tested by the COBAS Amplicor HBV Monitor assay could be determined by the serology profile (46), but this is not a practical solution for all laboratories. It was noted in our study that when the quantitation standard OD is weak but a strong target OD is observed in a reaction in which an undiluted sample is tested by the Amplicor assay, it is likely that the sample is greater than 200,000,000 HBV DNA copies/ml. Using this criterion, it may be possible to reduce the number of dilutions necessary to quantitate samples greater than 200,000,000 HBV DNA copies/ml. By using both protocols for the HC2 assay and diluting high-titer samples for the Amplicor assay, these assays will have similar dynamic ranges, although the Amplicor assay is more sensitive and requires much less sample volume to achieve greater sensitivity.
The most striking differences between the Amplicor and HC2 assays were noted near the limit of detection of the HC2 assay. Of 149 samples that were quantitated as less than 30,000 HBV DNA copies/ml with the Ultrasensitive HBV HC2 assay, a large proportion of them, 28 (18.8%), were not able to be retested due to insufficient sample volume, and 32 (26.5%) of the remaining samples were not quantified upon retesting with the HC2 assay. In addition, six samples selected for correlation studies were found to have HBV DNA levels not detectable by the Amplicor or qualitative PCR assay, suggesting that the HBV DNA results generated using the HC2 assay were false-positive results. A separate evaluation of 37 samples with <4,700 HBV DNA copies/ml by HC2 found 22% (8 of 37) of samples positive by both Amplicor and in-house qualitative PCR, suggesting that the Amplicor assay is more sensitive and specific than the Ultrasensitive HC2 method and that the samples tested positive by Amplicor are likely true results as evidenced by the corroborating qualitative HBV PCR data which target a different HBV gene. Analysis of results near the lower limit of the AMR of the HC2 assay suggests that specificity of results in this area of the AMR of the HC2 assay is suspect and as such warrants the inclusion of a grey zone or an increase in the claimed lower limit of the AMR. In addition, the inability to repeat tests of nearly 20% of samples in these experiments due to insufficient sample volume also highlights the shortcomings of the Ultrasensitive HC2 assay, which requires a 1-ml sample input volume, making the possibility of repeat testing in a grey zone difficult for samples that have limited volume. While the apparent lack of specificity near the limit of detection of the HC2 assay appears to account for the discrepancies noted, there are other potential concerns that are appropriate to contemplate for all quantitative HBV DNA assays. The potential for contamination is always present for assays measuring HBV DNA, especially with nucleic acid amplification technologies in addition to specimen stability concerns, technical error, and general assay specificity. Similar systematic evaluations of other molecularly based HBV DNA assays, including the Amplicor assay, have not been performed, but data from the HC2 assay suggest that such studies would be useful.
All HC2 testing was performed as specified by the package insert instructions, which state that incorrect technique may lead to false-positive results; however, the lack of an internal control in the HC2 assay makes it difficult to determine if the inconsistent results experienced are due to an error of technique or lack of specificity in the Ultrasensitive HC2 assay near the lower limit of detection. These problems are addressed by the Amplicor assay through the enhanced specificity of PCR combined with the addition of an internal control early in the extraction procedure. In addition, the Amplicor assay requires 1/10 of the volume required for the Ultrasensitive HC2 assay, making the option of repeat testing available for almost all samples received for clinical testing.
An important next solution for the measurement of HBV DNA levels in clinical samples may be in the form of real-time PCR assays calibrated to the first HBV DNA World Health Organization international standard 97/746 (11, 49), which could potentially allow for a extended dynamic range in a single, sensitive, standardized PCR test requiring minimal sample input volume. These assays have only recently become available in the form of commercial kits, and evaluations of these kits have not been presented in the literature, but studies of in-house-developed real-time PCR assays suggest linear ranges of 8 logs or greater (2, 15, 30, 44, 45, 55). In addition, 96-well formats, as used in many of the real-time PCR systems, offer potential for increased automation using liquid handling devices for nucleic acid extraction and PCR setup with the additional safeguard against contamination through use of a sealed PCR plate. As clinical trials are completed for new therapies using HBV DNA laboratory tests referenced against international standard material, it is likely that a more clear relationship between HBV DNA levels, disease states, drug efficacy, and clinical outcomes will become apparent.
Special thanks to the Molecular Hepatitis/Retrovirus laboratory at ARUP for performing the testing on the Digene Hybrid Capture 2 assays.
COBAS Amplicor HBV Monitor kits were supplied by Roche Molecular Systems, Pleasanton, Calif. The cost of reagents for the Digene Hybrid Capture 2 testing was paid for by Roche Molecular Systems.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2010 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»