Previous Article | Next Article ![]()
Journal of Clinical Microbiology, February 2004, p. 800-806, Vol. 42, No. 2
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.2.800-806.2004
Copyright © 2004, American Society of Microbiology. All Rights Reserved.
Division of Clinical Microbiology, Mayo Clinic, Rochester, Minnesota,1 Department of Clinical Virology, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands,2 Department of Pathology, Singapore General Hospital, Singapore, Singapore,3 Diagnostic Virology and Reference Laboratory, St. Paul's Hospital, Vancouver, British Columbia, Canada,4 Bayer HealthCare-Diagnostics, Berkeley, California5
Received 31 July 2003/ Returned for modification 12 October 2003/ Accepted 11 November 2003
|
|
|---|
|
|
|---|
The VERSANT HBV 3.0 Assay (referred to herein as VERSANT 3.0) is a third-generation branched-DNA (bDNA) assay for the direct quantification of HBV DNA in human serum and plasma. After HBV genomic DNA is released from the virions, the viral DNA is captured by a set of specific, synthetic oligonucleotide capture probes fixed in a microtiter well. A set of target probes (or label extender probes) then hybridizes to both the captured viral DNA and unique preamplifier probes. The capture probes and the target probes bind to conserved DNA regions throughout the entire HBV genome. The amplifier probes subsequently hybridize to the preamplifier probes, forming a bDNA complex. Multiple copies of an alkaline phosphatase-labeled probe are then hybridized to this immobilized complex. Detection is achieved by incubating the alkaline phosphatase-bound complex with a chemiluminescent substrate. The intensity of light emission is directly related to the amount of HBV DNA present in each sample, and results are recorded as relative light units by the luminometer. A standard curve is defined by light emission from quantitative standards containing known concentrations of recombinant DNA. Concentrations of HBV DNA in specimens are determined from this standard curve. This third-generation sandwich nucleic acid hybridization procedure differs from earlier bDNA assays by using the unique preamplifier probes to increase the number of labeled probes that can bind to the target, thereby augmenting the signal amplification and the assay sensitivity. The label extender probes are designed such that two probes must be bound to adjacent regions of the target for efficient hybridization to the preamplifier molecule to occur. This new bDNA technology has been described extensively in previous peer-reviewed publications (1, 2, 8, 9, 12, 14, 18, 19, 22).
This study describes the findings of a multicenter evaluation of VERSANT 3.0 (Bayer HealthCare LLC, Diagnostics Division, Tarrytown, N.Y.). Analytical performance parameters including specificity, reproducibility, linearity, limits of detection, and quantification were examined and compared to those of three other commercially available assays.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Target concentrations and value assignments of the QC panel
|
All testing sites provided additional HBV DNA-positive samples with previous nucleic acid test results obtained using the Digene Hybrid Capture II HBV DNA Test (Digene), VERSANT HBV DNA 1.0 Assay (bDNA) (VERSANT 1.0), or COBAS AMPLICOR HBV MONITOR Test (COBAS AMPLICOR). These samples were reanalyzed using the VERSANT 3.0 assay, and results were compared to the original results. The institutional review boards of each testing site approved the use of specimens utilized in this study.
VERSANT 3.0. VERSANT 3.0 has a reportable range of results from 2.0 x 103 to 1.0 x 108 HBV DNA copies/ml. The assay uses a small sample volume (50 µl undiluted) and is currently available for research use only. The ease of use and throughput of the VERSANT 3.0 are greatly facilitated by use of a semiautomated instrument (Bayer System 340). This instrument system provides a platform wherein the multiple incubations (hybridizations), washes, final luminescence readout, as well as data reduction are all automated. The instrument can process two 96-microwell plates per run (i.e., 84 results per microwell plate or 168 results per single run).
Analytical performance. The analytical performance characteristics of VERSANT 3.0 were evaluated by each testing site analyzing one full microwell plate of the nine-member QC panel samples (shown in Table 1) on five different days. A full microwell plate run consisted of testing each QC panel member prepared in four to seven replicates as well as 30 seronegative samples. For each run, uniform plate maps were used by all testing sites to ensure that the QC panel members and seronegative samples were placed in different microwell locations for each assay run. Eleven blank wells were left as placeholders on each plate. Therefore, at the completion of five runs, there were 20 to 35 results for each QC panel member and 150 results from the unique seronegative samples from each testing site.
Assessment of specificity, reproducibility, linearity, limit of detection, and sensitivity. Specificity of the VERSANT 3.0 was determined using the results of the seronegative specimens analyzed at each testing site (n = 150 unique samples per site). Specificity was defined as the proportion of seronegative samples yielding negative results according to an assay detection cutoff (DC) of 2,000 HBV DNA copies/ml. The point estimate and the exact 95% lower confidence limits for the overall specificity were calculated.
The nine-member QC panel (Table 1) was used to assess the reproducibility, linearity, and limits of detection for VERSANT 3.0. The QC panel (QC1 to QC9, with titers ranging from 800 to 110,000,000 copies/ml) extended over the reportable range of the assay. The reproducibility variance components were estimated using restricted maximum-likelihood estimation, and the total variance (which accounts for between-run and within-run effects at all testing sites) was estimated as the sum of the individual variance components. The variance components and the total variance were converted into coefficients of variation (CV).
Linearity of quantification by VERSANT 3.0 was evaluated as the log recovery for each QC panel member. The log recovery is defined as the difference between mean quantified log value and the assigned log value for each panel member.
The quantitative range of VERSANT 3.0 was defined by the lowest and highest concentrations of HBV DNA evaluated with acceptable linearity, accuracy, and precision. The analytical sensitivity of VERSANT 3.0 is expressed as the lower limit of detection (LOD). The LOD is defined as the lowest concentration of HBV that yields a quantifiable result in 95% of the time. Therefore, a signal at the LOD can be reliably distinguished from background signal in HBV DNA-negative specimens 95% of the time. To estimate this concentration, an interpolation between the 5th percentiles of the quantitative distribution of two QC panel members whose sensitivity brackets 95% was used. Data from all four testing centers were combined to provide a total volume of data sufficient for statistical estimation of the performance specifications of VERSANT 3.0.
Comparative analysis. Correlation between quantitative HBV concentrations obtained from VERSANT 3.0 and those previously determined by other HBV quantitative assays was assessed. Each testing site provided HBV DNA-positive samples with previous nucleic acid test results (111 to 147 specimens per site stored at -70 to -80°C ranging from less than 3 to 24 months). These samples chosen by each testing site had HBV DNA concentrations that overlapped the dynamic range of VERSANT 3.0 (2.0 x 103 to 1.0 x 108 HBV DNA copies/ml). These serum or plasma samples were reanalyzed using VERSANT 3.0, and the results were compared to the initial results obtained from one of the following assays: standard and ultrasensitive Digene (n = 247; Mayo Clinic and University of British Columbia), VERSANT 1.0 (n = 185; Singapore General Hospital and Academic Medical Center), or COBAS AMPLICOR (n = 79; Academic Medical Center). Comparisons between VERSANT 3.0 and the initial assays were achieved by plotting the paired observed values expressed in log10 units for each sample. Furthermore, consistency of the differences between the log10 quantitative values obtained from VERSANT 3.0 and the other assays was assessed according to the analysis proposed by Bland and Altman (3) (Bland-Altman plot). This analysis consisted of constructing a scatter plot depicting the difference in log10 values for each matched pair of quantitative results versus the average of the log10 quantitative values for each pair. The resulting scatter plot would show two horizontal reference lines at levels equal to the upper and lower limits of the 95% two-sided confidence limits for individual differences, and 95% of the differences are expected to be between these two confidence limits. A horizontal reference line at the average difference would be included. If the relationship between the quantitative values were consistent across the range of concentrations for these matched pairs of results, the scatter plot would exhibit no systematic trends in the distribution of differences as a function of the averages. A regression line fitting the differences versus the averages is added to the scatter plot as well as the regression equation. This analysis would determine if the average log10 difference of results was consistent across concentrations spanning the dynamic range of results in common to the two assays being compared.
|
|
|---|
The five negative samples with detectable HBV DNA had initial titers of 2,167, 2,199, 2,668, 3,121, and 35,900 copies/ml. These five samples were returned to Bayer, and these samples plus the matching stored samples were tested in triplicate. All test results showed HBV DNA titers of <2,000 copies/ml.
Analytical precision (reproducibility). Table 2 contains the data on assay reproducibility including site, between-run, and within-run variance components, as well as the total CV for each QC panel member. Over the dynamic range of VERSANT 3.0 (2 x 103 to 1 x 108 HBV DNA copies/ml), the total CV due to all sources of variation ranged from 10.6 to 26.5% at 2 x 103 HBV DNA copies/ml. For the single QC panel member (QC9, 782 copies/ml) with an HBV DNA concentration of <2,000 copies/ml and outside of the quantitative range of the assay, the overall variation was 32.7%.
|
View this table: [in a new window] |
TABLE 2. Reproducibility of quantitation of the QC panel by VERSANT 3.0
|
![]() View larger version (23K): [in a new window] |
FIG. 1. Observed log10 mean quantitation versus log10 concentration for VERSANT 3.0.
|
|
View this table: [in a new window] |
TABLE 3. Reproducibility and accuracy of VERSANT 3.0
|
95%, was estimated by an interpolation between the 5th percentiles of the quantitative distribution of two panel members whose sensitivity brackets 95%. The two panel members were QC7 (99.2% detected) and QC8 (45.8% detected), and the LOD estimate was 3,321 copies/ml with an approximate 95% upper confidence limit of 4,233 copies/ml. Comparative analysis. Figure 2 shows the three scatter plots of the log10 quantitative values from VERSANT 3.0 versus the log10 quantitative values obtained using each of the comparative assays. For each scatter plot, a linear regression was fitted to the data to determine the slope, and a 45° line through the middle of the data was used to evaluate distribution of the quantitative measures around the line.
![]() View larger version (17K): [in a new window] |
FIG. 2. Correlation of log10 quantitative HBV DNA titers between VERSANT 3.0 and VERSANT 1.0 (A), COBAS AMPLICOR (B), and Digene (C).
|
When VERSANT 3.0 was used to test HBV DNA-positive samples previously analyzed by COBAS AMPLICOR, the scatter plot of the results generated a linear regression slope of 1.138 with a 95% CI of 0.997 to 1.278 (Fig. 2B). The slope was not significantly different from a value of 1, indicating a linear relationship between these two assays with overlap of the dynamic ranges. However, the data points were not closely distributed around the 45° line through the middle of the scatter plot, indicating bias between the two assays.
Comparison of results from clinical samples previously tested by standard and ultrasensitive Digene and reanalyzed by VERSANT 3.0 showed a linear regression slope of 0.999 with a 95% CI of 0.983 to 1.014 (Fig. 2C). This plot indicates a highly linear relationship between the two assays, with the 45° line scatter plot virtually identical to the regression line. Furthermore, the data points were narrowly distributed around the 45° line, suggesting that the quantitative results from the two assays were in very close agreement with very little bias between the two assays.
Consistency of the differences in log10 quantitative values between the assays across their overlapping dynamic ranges is assessed by the Bland-Altman plots shown in Fig. 3. The average log10 difference between the data pairs from the two bDNA assays was -0.029 log10 (Fig. 3A). The 95% CI for the individual log10 differences was -0.431 to 0.374. The regression between the log10 differences and log10 averages had a slope of 0.133 that was significantly different from 0. This analysis indicates that the average difference between the two assays is expected to decrease slightly as the concentration of virus increases. Across the range of available data in this study (5.0 to 8.9 log10 copies/ml), the average log10 difference was predicted to range from 0.11 log10 to -0.17 log10.
![]() View larger version (23K): [in a new window] |
FIG. 3. Differences in log10 quantitative HBV DNA titers between VERSANT 3.0 and VERSANT 1.0 (A), COBAS AMPLICOR (B), and Digene (C) in relation to average log10 quantitation.
|
The average log10 difference between samples quantified by VERSANT 3.0 and Digene across an overlapping dynamic range was 0.103 log10 (Fig. 3C). The 95% CI for the individual log10 differences was -0.212 to 0.417. The regression between the log10 differences and log10 averages had a slope of 0.007 and was not statistically significantly different from 0. These results indicate that the difference between these two assays is consistent across their overlapping dynamic range. This final result differs from the nonlinear trends observed in the comparison of results between VERSANT 3.0 and VERSANT 1.0 or COBAS AMPLICOR.
|
|
|---|
VERSANT 3.0 is a new bDNA assay with improved analytical sensitivity and specificity due to the use of preamplifier probes and label extender probes. The hybridization of capture and label extender probes to multiple conserved regions of the target genome provides efficient detection and quantification of the target with minimal effect from viral genomic diversity. Developmental studies revealed that HBV DNA concentrations were all within 0.5 log10 of expected values throughout a 4-log10 quantitative range for HBV genotypes A to F (unpublished data). With an estimated specificity of 99.2% and a lower 95% confidence limit of 98.3%, VERSANT 3.0 is slightly more specific than the COBAS AMPLICOR assay (97%; 95% CI, 94 to 100%) and has a specificity similar to that of the standard and ultrasensitive Digene (99.2%; 95% CI, 97.7 to100%) (22).
VERSANT 3.0 was found to be linear (slope = 1.01, R2 = 0.999) and precise (total CV
26.5%) within the assay quantitative range of 2 x 103 to 108 copies/ml. Furthermore, the LOD for this assay was determined to be 3.32 x 103 copies/ml, which is significantly improved over those of VERSANT 1.0 (range of 7.0 x 105 to 5.0 x 109 copies/ml) and Digene (standard range of 1.4 x 105 to 1.7 x 109 copies/ml; ultrasensitive range of 4.7 x 103 to 5.6 x 107 copies/ml). Of note is the difference between the LOD value and the lower limit (2 x 103 copies/ml) of the quantitative range of VERSANT 3.0. The former value was the result of combining the findings from 20 assay runs at all four testing sites using only one reagent lot, while the latter is the DC titer determined by many assay runs, different operators, and several lots of reagents during the development of this assay by the manufacturer. Although VERSANT 3.0 does not share the analytical sensitivity previously reported for the COBAS AMPLICOR assay (range of 2.0 x 102 to 2.0 x 105 copies/ml), it has a wider dynamic range that includes the current clinically relevant HBV DNA concentrations (104 to 108 copies/ml) (10, 16). The improved analytical sensitivity combined with the wide dynamic range of VERSANT 3.0 may facilitate the monitoring of HBV DNA levels in infected patients at the time of diagnosis and during treatment (including at levels below the current therapeutic threshold of 104 to 105 copies/ml) (6, 20).
Quantitative HBV DNA values generated from VERSANT 3.0 correlated very well with values previously determined by the standard and ultrasensitive Digene tests over the entire overlapping dynamic ranges of the two assays. The relationship between these two tests was highly linear, and there was little or no bias between the two methods. There was substantial bias between the VERSANT 3.0 and COBAS AMPLICOR assays, as results generated by the former were, on average, twice as high as the values quantified by the PCR assay. Furthermore, the log10 difference between these two assays was not consistent across the dynamic range, as indicated by the upward trend in the log10 difference as the HBV DNA concentration increased. This trend suggests that the average difference between HBV DNA concentrations measured using the two assays would be expected to increase as the quantitative values increase. Since VERSANT 3.0 was demonstrated to be highly linear (Fig. 1), one possible explanation for this upward trend in the relationship between VERSANT 3.0 and COBAS AMPLICOR could be the slight nonlinearity of the PCR assay as HBV DNA values approach the upper limit of its dynamic range.
Finally, the relationship between VERSANT 3.0 and VERSANT 1.0 was slightly nonlinear. However, there was only a small bias between the two assays, as the results generated by VERSANT 3.0 were, on average, 94% of corresponding quantitative values from VERSANT 1.0. The log10 difference between the two assays was not consistent across the dynamic range. The slight downward trend in the log10 difference as HBV DNA values increase could be attributed to the nonlinearity of VERSANT 1.0 as HBV DNA concentrations approach the lower limit of the dynamic range for this assay. Overall, the agreement between VERSANT 3.0 and the comparative HBV DNA quantitative assays was very good, with the greatest differences in quantitative values occurring as HBV DNA levels approached or exceeded the limits of the dynamic ranges for the comparative assays.
With the availability of new therapeutic strategies targeting HBV, the use of HBV DNA quantification by clinical laboratories to monitor and optimize treatment will increase (4, 7, 24). The results from this multicenter evaluation of the Bayer VERSANT 3.0 assay (bDNA) show that this test is highly specific and reproducible, with a wide dynamic range for accurate quantitation of HBV DNA in the serum or plasma of HBV-infected specimens. The extended linearity of this assay will facilitate monitoring of HBV viral loads prior to treatment as well as during therapy, when HBV DNA levels may fall below the therapeutic threshold of 104 to 105 copies/ml (6, 20). These characteristics make the VERSANT 3.0 assay (bDNA) an attractive test method for clinical laboratory applications.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»