Previous Article | Next Article ![]()
Journal of Clinical Microbiology, July 2004, p. 3120-3127, Vol. 42, No. 7
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.7.3120-3127.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
Department of Laboratory Medicine, University of California,1 Clinical Laboratory, San Francisco General Hospital,2 Professional Habitat Design, LLC, San Francisco, California,4 Division of Infectious Diseases, Henry Ford Hospital, Detroit, Michigan3
Received 11 June 2003/ Returned for modification 25 September 2003/ Accepted 24 March 2004
|
|
|---|
|
|
|---|
Bayer's VERSANT bDNA 3.0 assays (Diagnostics Division, Bayer Corp., Tarrytown, N.Y.) are used for the quantification of HIV-1, HCV, and HBV (research use only) nucleic acid, and testing is performed on the System 340 platform (7, 10, 11, 13). The basic principles and procedures for bDNA 3.0 are similar for each virus and include viral lysis, overnight hybridization of viral nucleic acid, and target capture in a 96-well plate, followed by wash steps and the serial addition of probes that allow for signal amplification, detection, and quantification (1, 3, 4, 6, 12, 14). However, differences exist in sample processing, overnight hybridization temperature, and day 2 wash conditions.
Because of the technical differences of each assay, laboratories quantify each virus separately and only when the number of test samples is sufficient to be cost-effective. However, a significant advantage exists if both assays could be run simultaneously on the same System 340 platform. These advantages would include improved workflow, testing schedule flexibility, enhanced operating efficiency for laboratories with smaller sample numbers, improved turnaround time for patient results, and simultaneous testing of samples from coinfected patients.
In the present study the HIV-1 bDNA assay protocol was modified to permit a simultaneous run of both HIV-1 and HCV bDNA on the same System 340 platform. The reaction conditions and procedures for HCV bDNA were not changed. This research protocol evaluation was performed by using a defined HIV-1 sample panel, clinical samples from HIV-1-infected and HIV-1-HCV-coinfected patients, and HIV-1-seronegative samples.
|
|
|---|
Up to 1,000 plasma samples were randomly collected, and a total of 564 clinical plasma samples were selected for the analysis to include those with viral loads relatively well distributed across the dynamic range of the assay from
50 to 500,000 copies of HIV-1 RNA/ml, as well as those below the limit of detection of <50 copies/ml. Samples included <50 copies/ml (n = 199), 50 to 1,000 copies/ml (n = 126), 1,001 to 10,000 copies/ml (n = 93), 10,001 to 100,000 copies/ml (n = 91), or >100,001 copies/ml (n = 55).
HIV-1-HCV-coinfected patient plasma samples. Excess plasma samples were obtained from 63 HIV-1-HCV-coinfected subjects (as confirmed by HIV-1 and HCV antibody tests) from the Division of Infectious Diseases, Henry Ford Hospital, Detroit, Mich. Plasma samples were processed at the Henry Ford Hospital exactly as described for SFGH (above), the plasma was transferred as two 1.1-ml aliquots and stored at 70°C. Both aliquots from all 63 patients were delivered in one batch shipment on dry ice to SFGH and stored at 70°C until testing.
Normal human plasma (HIV-1 and HCV antibody negative). Seronegative HIV-1 and HCV plasma samples (n = 743) were purchased from ProMedDx LCC (Norton, Mass.) and stored at 70°C until testing.
HIV-1 quantitation sample panel. Sample panel members containing normal human plasma spiked with HIV-1 derived from ß-propriolactone-treated cultures were provided by Bayer Diagnostics and included the following: panel 1, 31,705 copies/ml (range, 14,179 to 70,895 copies/ml); panel 2, 3,171 copies/ml (range, 1,418 to 7,091 copies/ml); panel 3, 317 copies/ml (range, 142 to 709 copies/ml); and panel 4, <50 copies/ml (seronegative). Panel members were stored at 70°C until testing.
All HIV-1-seropositive plasma samples were used from the second freeze-thaw cycle (i.e., used on the second thaw). All HIV-1-HCV-seropositive samples, seronegative samples, and panel members were used from the first freeze-thaw cycle (i.e., used on the first thaw).
Committee on Human Research. The present study was performed in accordance with the guidelines of both the University of California at San Francisco (UCSF) and the Henry Ford Hospital Committees on Human Research. In order to preserve patient confidentiality, specimens were unlinked to identifier information including date, patient identifier, patient name, and health center identifier.
Study site. One operator at the UCSF Clinical Microbiology Research Laboratory at San Francisco General Hospital performed the analyses.
HIV-1 and HCV bDNA assays. The bDNA signal amplification is a hybridization-based methodology (4). Samples for HIV-1 testing were collected prior to U.S. Food and Drug Administration approval, when results were reported as <50 copies/ml. Thus, for the present study, the dynamic range of HIV-1 bDNA is 50 to 500,000 copies/ml. The dynamic range for HCV bDNA is 615 to 7,690,000 IU/ml. The HIV-1 and HCV bDNA assays differ significantly during specimen processing and assay setup on day 1 but are similar on day 2 for the amplification and detection stages. Details of both assays are illustrated in Table 1.
|
View this table: [in a new window] |
TABLE 1. Comparison of HIV-1 and HCV bDNA assays
|
Comparative analyses of HIV-1 bDNA assay test methods. A stepwise evaluation of performance characteristics, including quantification, specificity, and reproducibility, was performed by using clinical, panel, and seronegative plasma samples by the reference method HIV-1 bDNA assay compared to modified versions (test methods). These included the following methods.
(i) Reference method. The entire HIV-1 bDNA assay was performed according to the manufacturer's instructions. Lysis working reagent was added to virus pellet, followed by vortexing for 20 s, 2 h of incubation in a 63°C heat block, transfer of viral lysate to a 96-well capture plate, and transfer of the plate to System 340 programmed for the HIV RNA 3.0 setting.
(ii) Test method 1. Sample lysis was done as described for the reference method with the System 340 programmed for HCV RNA 3.0.
(iii) Test method 2. Test method 2 was characterized by omission of the heat block step, and System 340 was programmed for HCV RNA 3.0, virus pellet in the lysis working reagent, vortexing at room temperature for 20 s, and transfer of viral lysate to the 96-well capture plate. Transfer of the plate to System 340 was programmed for the HCV RNA 3.0 setting.
(iv) Vortex substudy. The vortex substudy was identical to test method 2, but evaluations were done at different vortex times (20 s, 1, 2.5, and 5 min) after the addition of lysis working reagent to the virus pellet. The vortex substudy resulted in the subsequent evaluation of a 5-min vortex (test method 3) as indicated for test method 3 below.
(v) Test method 3. Test method 3 was identical to test method 2 but with 5-min (not 20-s) vortexing of the virus pellet-lysis working reagent mix.
Reference method versus test method 1. Matched clinical plasma samples stratified by viral load (HIV-1 bDNA) were evaluated in one run each for both conditions and included 50 to 1,000 copies/ml (n = 32), 1,001 to 10,000 copies/ml (n = 21), 10,001 to 100,000 copies/ml (n = 20), and >100,000 copies/ml (n = 11). Matched seronegative samples (n = 136) were evaluated in two runs for both conditions.
Reference method versus test method 2. Matched clinical plasma samples stratified by viral load (HIV-1 bDNA) were evaluated in five runs each for both conditions and included <50 copies/ml (n = 115), 50 to 1,000 copies/ml (n = 62), 1,001 to 10,000 copies/ml (n = 51), 10,001 to 100,000 copies/ml (n = 50), and >100,000 copies/ml (n = 34). Matched seronegative samples (n = 304) were evaluated in two runs for both conditions.
Vortex substudy: following test method 2 but altering the vortex condition. Duplicate aliquots of each panel member (panels 1, 2, 3, and 4) were vortexed for 20 s, 1, 2.5, and 5 min and evaluated in 10 runs for a total of 20 replicas of each panel member with each vortex condition. Standards and controls were vortexed for 20 s (test method 2). After step 1, both the 20-s and the 5-min vortex conditions were further evaluated. Duplicate aliquots of each panel member (panels 1, 2, 3, and 4) were vortexed for 20 s and 5 min and evaluated in 10 runs for a total of 20 replicas of each panel member with each vortex condition. Two sets of standards and controls, one vortexed for 20 s and the other for 5 min, were included in each run.
Reference method versus test method 3. Matched clinical plasma samples stratified by viral load (HIV-1 bDNA) were evaluated in five runs each for both conditions and included <50 copies/ml (n = 115), 50 to 1,000 copies/ml (n = 62), 1,001 to 10,000 copies/ml (n = 51), 10,001 to 100,000 copies/ml (n = 50), and >100,000 copies/ml (n = 34). Matched seronegative samples (n = 303) were evaluated in two runs for both conditions.
Simultaneous quantification of HIV-1 and HCV from coinfected patient samples on a shared System 340. Aliquots of 63 HIV-1-HCV-coinfected patient samples were quantified simultaneously for HIV-1 and HCV. Samples and assays were processed in one 8-h workday in the following order. One aliquot of 1.1 ml of plasma was thawed in cold water and transferred to wet ice. An aliquot of 1.0 ml from each sample (n = 63), standard (n = 9), and control (n = 3) was centrifuged, and the resulting viral pellet transferred to 70°C; a total of four centrifugations were performed. The HIV-1 virus pellet was subsequently thawed and processed by using method 3. Method 3 was selected prior to the final analysis of all method 2 data for simultaneous testing and used to determine feasibility of application and workflow; for this purpose (feasibility and workflow) both methods are identical. Once the HIV-1 bDNA 96-well capture plate was prepared with sample, it was held at room temperature under cover (to protect it from dust) before transfer to the System 340. The HCV bDNA 96-well capture plate was prepared, according to package insert instructions, with the addition of lysis working reagent, followed by the addition of 50 µl of the remaining thawed clinical samples maintained on wet ice, as well as HCV standards and controls. Both prepared HIV-1 and HCV bDNA 96-well capture plates were loaded in succession onto the System 340 programmed for an HCV v3.0 run (HCV RNA 3.0 setting). Since the universal amplification and detection reagents from the HIV-1 and HCV kits were not of the same lots, each working reagent was prepared and added separately to the respective plate. However, wash buffers A and B from both kits were combined.
Labor (time) and workflow analysis of simultaneous versus independent HIV-1 and HCV bDNA. Calculations were based on one plate assay run of either HIV-1 bDNA or HCV bDNA only or on a simultaneous run of one plate each of HIV-1 bDNA and HCV bDNA on a common System 340. The detailed design for labor (time) calculations was described previously (5).
Statistical methods. Assay performance on positive samples by using the new test methods was evaluated by comparing the mean log10 quantitations between the new and reference methods. The new methods were considered equivalent to the reference method if the 90% confidence interval of the log10 difference was within ±0.16 log10 or if the ratio between two geomeans was between 0.79 and 1.45. A difference of 0.16 log10 would result in a decrease of up to 5% in the percent concordance between two measurements (the percent concordance is defined as the percentage of specimens tested in both the reference and test conditions for which the results are not statistically different). In addition, a Student t test was performed on the mean between the two methods compared. The percent detection of positive samples was compared between the new methods and the reference method with matched sample pairs. Statistical significance was assessed by using McNemar's test (9).
Assay performance on negative samples was assessed by estimating the specificity under the new method. A specificity of >95% was considered acceptable. For the analysis of specificity, approximately 300 seronegative samples (303 for method 2 and 304 for method 3) were tested, which allowed the specificity to be estimated with a 2.5% error and a >90% power to detect a difference in specificity of 5%. For analysis of reproducibility from samples of <50 copies/ml, 115 samples were tested to identify a drop of 7% in the percent detection with 74% power. For quantification across the dynamic range, 84 samples for test method 1 and 197 samples for test methods 2 and 3 results in a 5% probability of concluding the test methods are equivalent to the reference method when they are not and a >95% probability of concluding the test methods are equivalent to the reference method when they are truly equivalent. For the vortex substudy, a sample size of 20 (two replicates per run across ten runs) has a 5% probability of concluding that the test methods are equivalent to the reference method when they are not and a >95% probability of concluding the test methods are equivalent to the reference method when they are truly equivalent.
|
|
|---|
![]() View larger version (13K): [in a new window] |
FIG. 1. Comparative quantification by reference method and test method 1 on 84 matched HIV-1 clinical samples selected from the following viral load strata: 50 to 1,000 copies/ml, n = 32; 1,001 to 10,000 copies/ml, n = 21; 10,001 to 100,000 copies/ml, and n = 20; >100,000 copies/ml, n = 11. Samples were tested in one run by each method.
|
![]() View larger version (17K): [in a new window] |
FIG. 2. Comparative quantification by reference method and test method 2 on 197 matched HIV-1 clinical samples selected from the following viral load strata: 50 to 1,000 copies/ml, n = 62; 1,001 to 10,000 copies/ml, n = 51; 10,001 to 100,000 copies/ml, n = 50; and >100,000 copies/ml, n = 34. Samples were tested among five runs by each method.
|
![]() View larger version (16K): [in a new window] |
FIG. 3. Comparative quantification by reference method and test method 3 on 197 matched HIV-1 clinical samples selected from the following viral load strata: 50 to 1,000 copies/ml, n = 62; 1,001 to 10,000 copies/ml, n = 50; 10,001 to 100,000 copies/ml, n = 50; and >100,000 copies/ml, n = 34. Samples were tested among five runs by each method.
|
HIV-1 viral load reproducibility for clinical plasma samples with <50 copies/ml. (i) Reference method versus test method 2. In tests of 115 seropositive samples with <50 copies/ml, 91.3% (105 of 115) had <50 copies/ml as assessed by the reference method and 93.9% (108 of 115) had <50 copies/ml as assessed by test method 2 (Table 2). The level of nonconcordant results (detectable or not detectable) between the reference method and test method 2 was 8% (9 of 115) and not statistically significant (P = 0.32).
|
View this table: [in a new window] |
TABLE 2. Viral load reproducibility by test methods 2 and 3 on HIV-1-seropositive samples with <50 copies of HIV-1 RNA/ml
|
Both test methods 2 and 3 generated equivalent results and were comparable to the reference method with seropositive samples with <50 copies/ml.
Evaluation of specificity on HIV-1-seronegative samples. (i) Reference method versus test method 2. With a limit of detection of 50 copies/ml, the specificity of 304 matched seronegative samples was 100% (304 of 304) by the reference method compared to 96.4% (293 of 304) by test method 2 (Table 3). Although the difference in specificities for the two methods is statistically significant, it demonstrates an acceptable assay specificity of >95%. The 11 samples that were quantified by test method 2 contained 52, 55, 59, 67, 70, 79, 80, 86, 93, 108, and 131 copies/ml.
|
View this table: [in a new window] |
TABLE 3. Specificity by test methods 2 and 3 on seronegative samples with a cutoff of 50 copies of HIV-1 RNA/ml
|
Both test methods 2 and 3 generated equivalent results that were within the acceptable limit for specificity by the reference method.
Vortex substudy. Increased vortex duration resulted in a corresponding increase in the relative luminescence of the three quantifiable panel members 1, 2, and 3 but a decreasing luminescence relative to seronegative panel member 4. Test method 3 (5-min vortex) generated the greatest separation in relative luminescence between seronegative panel 4 and the low-copy-number panel 3. Further analysis demonstrated that test methods 2 and 3 generated viral load values within the acceptable range for each panel member and, although the percent coefficients of variation were relatively higher by test method 2, the viral load geomeans are considered equivalent, with a confidence interval for the ratio between the geomeans of test method 3 and test method 2 that was within 0.79 and 1 (data not shown).
Since quantification of panel members by test method 3 was similar to that for test method 2, the performance of both methods was compared with clinical samples (see reference method versus test method 2 and reference method versus test method 3, above).
Simultaneous quantification of HIV-1 and HCV from coinfected samples on a common System 340. Prior to quantifying coinfected clinical samples, we evaluated the viral load of HIV-1 and HCV proficiency panel members run simultaneously in separate plates (HIV-1 plate and HCV plate) on the System 340 programmed for HCV RNA 3.0. All viral load values were within the acceptable range for the proficiency panels, as well as for the kit standards and controls (data not shown). Therefore, for proof of principal, we then evaluated plasma viral load from 63 plasma specimens from HIV-1-HCV-coinfected patients. The viral pellet from a 1-ml aliquot was used for the HIV-1 plate, and a 50-µl plasma aliquot was used for the HCV plate. The plates were run simultaneously on the System 340 programmed for HCV RNA 3.0. At day 2, the data management software was first configured to accept and process relative light unit data with the HIV-1 template (HIV RNA 3.0). Once the data were received, the data management software was reset to accept and process the same relative light unit data (sent via the System 340 retrieve function) with the HCV template (HCV RNA 3.0). Table 4 illustrates the quantitative HIV-1 and HCV values from these plasma samples of coinfected patients from a single System 340 run of both HIV-1 and HCV bDNA plates.
|
View this table: [in a new window] |
TABLE 4. Simultaneous quantification of HIV-1 and HCV from matched plasma samples of coinfected patients
|
|
View this table: [in a new window] |
TABLE 5. Analysis of labor time for HIV-1 and HCV bDNA assays
|
|
|
|---|
The cost of running a viral load assay, including kit cost, labor, and supplies, is substantial and can range widely from approximately $44 to $129, without considering profit margins, overhead, and other influencing factors. Reimbursement from local and private health organizations may or may not cover the entire cost of the test. Subsequently, the overall expense (i.e., kit cost, labor, disposable cost, and overhead) of a viral load test, and hence the cost per patient result derived from different platforms, is a major deciding factor in selecting the most cost-effective assay. Options to lower costs include, as an example, improved workflow. Platforms are becoming increasingly more automated; however, platform flexibility, allowing for multiple analyte analysis (multiplex testing), is also an effective means for improving workflow. Typically, multiplex testing is standard for most chemistry platforms; however, nucleic acid-based platforms, particularly for viral quantification, are not currently designed for this purpose (an exception to this is blood bank testing for simultaneous detection of HIV-1, HCV, and HBV). Platform flexibility and hence multiplex testing is readily achievable when reaction conditions for the detection or quantification of different analytes are similar since minimal to no changes are needed in the sequence of events.
The bDNA methodology can be divided into three stages: sample preparation, hybridization (target lysis and/or capture), and detection (signal amplification). Only the hybridization and detection stages utilize the platform, System 340. Although the HIV-1 and HCV samples preparation processes are thoroughly different, both the hybridization and detection stages are essentially identical (Table 1).
In the present study comparable quantification and specificity were accomplished when the reference method was adapted to method 2. Interestingly, although an increased vortex duration of 5 min used for method 3 improved the signal separation between negative and low-positive samples, overall quantification was approximately 0.2 log10 higher than the reference method and thus not acceptable as an alternative methodology. The higher quantification, which can be directly attributed to the extended vortex duration, could be explained in part by the mechanical vortex action rendering the HIV-1 target sites more accessible to hybridization. Degradation of the HIV-1 nucleic acid through mechanical action is probably not an explanation for increased quantification since degraded target generates lower signal (P. Nassos, T. Elbeik, B. Haller, and V. L. Ng, Abstr. 101st Gen. Meet. Am. Soc. Microbiol. 2001, abstr. C-481, 2001).
We observed that the simultaneous run of both an HIV-1 and HCV bDNA assay offers several benefits for the user. Labor utilization is greatly improved since the operator will dedicate two consecutive days on both assays run simultaneously, rather than spending either three or four consecutive days running both assays in succession. Moreover, the ability for the operator to multitask during the day 2 detection step of simultaneous testing is still persevered since the time to prepare double the amount of working reagents is minimally increased (at most by seconds to a few minutes per step). Improved workflow associated with HIV-1 bDNA method 2 can provide advantages in addition to those mentioned above. For example, when the HIV-1 bDNA reference method is used, plasma samples that arrive past mid-day (in a 9-to-5 workday) are generally not included in the day's run as sample processing (1 h of centrifugation) may not be achieved in time for the mid-afternoon 2-h heat block incubation at 63°C. However, use of method 2 allows for inclusion of "late-day" samples (so long as they can be centrifuged for 1 h) as the 2-h heat block 63°C incubation step is omitted.
We show that this analysis offers new options for laboratories that may have various or disproportionate numbers of HIV-1 and HCV clinical samples. For example, high-volume laboratories may benefit from running a full HIV-1 and HCV plate to lower overall costs and improve workflow. Low-volume laboratories may include partial HIV-1 and HCV plates to decrease labor costs that would otherwise be significantly higher if the assays were run separately. Moreover, simultaneous runs of full and partial plates, or various combinations, permit increased patient result turnaround opposed to single partial plate runs that may not be economically viable to support rapid patient result turnaround. Application of simultaneous testing for coinfected patient samples is another clear advantage of this adaptation and includes rapid patient result turnaround, limited sample handling and, possibly, use of one aliquot rather than two separate aliquots of valuable clinical samples. It is up to each individual laboratory to make the determination as to whether these products, HIV-1 and HCV bDNA, are used off label. Nevertheless, HIV-1 and HCV viral load may not always require testing at the same visit; it may be reasonable to monitor HCV viral load less frequently than HIV-1 viral load in some situations.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»