Previous Article | Next Article ![]()
Journal of Clinical Microbiology, February 2005, p. 813-817, Vol. 43, No. 2
0095-1137/05/$08.00+0 doi:10.1128/JCM.43.2.813-817.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
Olga Petrauskene,3
Kevin Kunstman,4
Shawn P. Cunningham,1
Christina Trevino,5
Cheryl Davis,6
John Kennedy,7,
Jeff Fairman,8,
Brian Foley,9 and
JoAnn Kop2,¶
The Johns Hopkins Medical Institutions, Baltimore, Maryland,1 Celera Diagnostics, Alameda,2 Applied Biosystems, Foster City,3 Stanford University, Palo Alto,5 PPGx, La Jolla,6 Clingenix, Sunnyvale, California,8 Northwestern University, Chicago, Illinois,4 Los Alamos National Laboratory, Los Alamos, New Mexico;,7 Pompano Beach, Florida9
Received 17 August 2004/ Returned for modification 23 September 2004/ Accepted 23 October 2004
|
|
|---|
|
|
|---|
The ViroSeq HIV-1 genotyping system (Celera Diagnostics, Alameda, Calif.) is one of two FDA-cleared systems for HIV-1 genotyping. ViroSeq is a fully integrated system that is used to identify drug resistance mutations in HIV-1 protease and the first 335 codons of HIV-1 RT. In this system, HIV-1 RNA is first isolated from 0.5 ml of plasma. This involves high-speed centrifugation followed by lysis of virus particles with a chaotropic agent to release the viral RNA and isopropanol-ethanol precipitation for RNA recovery. The RNA is reverse transcribed with Moloney murine leukemia virus RT, and the resulting DNA is amplified using a single 40-cycle PCR with AmpliTaq Gold DNA polymerase. The PCR includes the uracil N-glycosylase (UNG) contamination control system. PCR products (1.8 kb) are purified with spin columns and analyzed by agarose gel electrophoresis prior to sequencing. Premixed BigDye terminator sequencing reagents (Applied Biosystems) are used to sequence the PCR products in both directions with seven different primers. The ViroSeq software is used to assemble the sequence data into a single contiguous sequence that is used for identification of drug resistance mutations. The system reports the evidence of resistance to FDA-approved drugs based on the detection of antiretroviral drug resistance mutations. Previous studies report a high level of performance of the system for analysis of both subtype B and non-subtype B samples (2, 4, 7).
To date, the ViroSeq HIV-1 genotyping system version 2 has FDA clearance for analysis of subtype B clinical samples with viral loads of 2,000 to 750,000 copies/ml with three different automated sequencers: the ABI PRISM 377 DNA sequencer and the ABI PRISM 3100 and 3700 genetic analyzers (Applied Biosystems). The 377 instrument, which separates sequencing ladders by using polyacrylamide gels, requires manual sample loading and manual lane tracking. In contrast, the 3100 and 3700 instruments separate sequencing ladders by using capillary arrays which are automatically filled with a liquid polymer solution. Both capillary instruments load samples automatically from 96-well plates, and neither requires manual lane tracking. In this study, we determined the sensitivity and specificity of the ViroSeq HIV-1 genotyping system for the detection of HIV-1 drug resistance mutations using the ABI PRISM 3100 genetic analyzer.
|
|
|---|
Recombinant-virus samples. Twelve recombinant-virus stocks were created either by site-directed mutagenesis (9) or by cloning patient samples. The virus stocks were sequenced using the ViroSeq system. Sequencing data for each virus stock was reviewed by three independent experts to determine a consensus sequence. The recombinant-virus panel contained at least one virus stock positive for each of 43 antiretroviral drug resistance mutations (17 protease mutations and 26 RT mutations). Eleven of the recombinant-virus stocks were mixed with an HXB2 recombinant-virus stock to generate recombinant-virus samples that contained 40% mutant virus with a total viral load of approximately 5,000 copies/ml. The 12th recombinant-virus sample, which contained an insertion at RT codon 69 (T69SSS), was not mixed with the HXB2 recombinant-virus stock (100% mutant).
HIV-1 genotyping with the ViroSeq system. To determine the sensitivity and specificity of the ViroSeq System for the detection of HIV-1 drug resistance mutations, plasma and recombinant-virus samples were analyzed using ViroSeq system version 2.0. Samples were analyzed at three laboratories: Johns Hopkins University, Northwestern University, and Celera Diagnostics. Each site had one operator and utilized a single 3100 instrument. All operators were trained in the use of the ViroSeq system and passed proficiency tests prior to the study. The sequencing reactions from each sample were analyzed three times to generate a total of nine sets of data for each sample. Genotyping was performed according to manufacturer's instructions except that sequencing reaction mixtures were resuspended in 30 µl of HiDi formamide rather than 20 µl. The larger resuspension volume permitted analysis of each sequencing reaction on three consecutive days. Sequencing analysis software (version 3.7; Applied Biosystems) was used for base calling. ViroSeq HIV-1 genotyping system software version 2.5 was used to identify drug resistance mutations and to generate drug resistance reports.
Phylogenetic analysis. Sequences obtained in this study (nine sequences per sample) were compared to the original reference sequences for each sample. There was no evidence of sample mix-ups or cross-contamination (data not shown).
Statistical analysis. The sensitivity and specificity of the ViroSeq system (overall and for detection of individual antiretroviral drug resistance mutations) were determined for the clinical plasma samples and recombinant-virus samples. True-positive and true-negative results for clinical plasma samples were determined based on data obtained from the analysis of clones (see below). True-positive and true-negative results for recombinant-virus samples were determined based on consensus sequences obtained for the pure virus stocks.
|
|
|---|
Analysis of a clinical plasma sample panel. To determine the sensitivity and specificity of the ViroSeq system, we first generated a panel of clinical plasma samples containing antiretroviral drug resistance mutations in HIV-1 protease and RT. The viral loads of the samples ranged from 1,800 to 10,500 HIV-1 RNA copies/ml. Prior to analysis with the ViroSeq system, the plasma samples were characterized by cloning and sequencing individual viral variants. This process served to confirm the presence of individual mutations in the samples and to assess the prevalence of each mutation in the viral population. Approximately 40 clones from each sample were sequenced (range, 30 to 50 clones) (Tables 1 and 2). Mutations detected in at least 10 clones were designated true-positive results. This threshold was established to meet a goal, namely, that mutations present in approximately 40% of the viral population would be detected in the ViroSeq system with 95% confidence. Some mutations that were present at lower levels (in one to nine clones per sample) were also detected by the ViroSeq system. Those results were also considered true-positive results, since the cloning analysis documented that the mutations were present in the sample. The ViroSeq software version 2.5 algorithm for the interpretation of HIV-1 genotyping considers 75 mutations (35 in protease and 40 in RT). Forty of those mutations (21 in protease and 19 in RT) were present in 10 or more clones in at least one of the plasma samples. Ten other mutations were present in one to nine clones from at least one sample, and 23 mutations were not represented in the sample set (Tables 1 and 2). The RT mutations G333D and G333E were not analyzed.
|
View this table: [in a new window] |
TABLE 1. Characterization of protease mutations in clinical plasma samplesa
|
|
View this table: [in a new window] |
TABLE 2. Characterization of RT mutations in clinical plasma samplesa
|
10 clones positive for the mutation). With nine runs, there were 45 positive and 135 negative data points available for evaluation.
In this study, the overall sensitivity of the ViroSeq system for mutation detection in the plasma sample panel was 99.65% for 40 of the 75 mutations in the ViroSeq version 2.5 software algorithm. All but one of the 40 mutations represented in the panel (i.e., with
10 clones positive for the mutation in one or more of the samples) was detected in all nine runs (sensitivity, 100%). The one exception was the M41L mutation in RT. This mutation was not detected in sample 12 in two laboratories (missed in four of nine runs). Sample 12 had 11 of 38 clones with the M41L mutation. The same mutation was correctly identified in five other samples (1, 13, 14, 17, and 18) in all nine runs. Therefore, the sensitivity of detection of M41L in the plasma sample panel was 92.6% in this study.
The specificity of the ViroSeq system for mutation detection was calculated for 73 of the 75 mutations that are evaluated in the ViroSeq software version 2.5 algorithm for genotype interpretation. Two mutations in RT (G333D and G333E) were not considered. The overall specificity of the ViroSeq system for the detection of mutations in the plasma sample panel was 99.95% in this study. The specificity of detection for all but one of the mutations was 100%. The exception was the L63P mutation in protease. Two sites identified L63P in sample 6 in all three runs. However, the mutation was not detected among the 36 clones analyzed from that sample. Therefore, the specificity for detection of the L63P mutation was 93.9% in this study.
Analysis of recombinant-virus samples. Twelve recombinant-virus samples were analyzed with the ViroSeq system in triplicate in each of the three laboratories to generate nine sets of genotyping data for each sample. Eleven samples were used to determine the sensitivity and specificity of the ViroSeq system for the detection of mutations in viruses that represented 40% of the viral population (mixtures) at a viral load of 2,000 to 5,000 copies/ml (see Materials and Methods). The twelfth sample was used to determine the sensitivity and specificity of ViroSeq for the detection of an insertion at codon 69 in RT, present at 100% of the viral population (no mixture; see Materials and Methods).
The 12 recombinant-virus samples included 43 antiretroviral drug resistance mutations (17 in protease and 26 in RT). In this study, the overall sensitivity of the ViroSeq system for detection of those 43 mutations in the recombinant-virus samples was 99.7%. Forty-two of 43 mutations were detected with 100% sensitivity. The one exception was the A62V mutation in RT. This mutation was missed in three of the nine runs of sample 3 in a single laboratory. For two other samples (10 and 11), the A62V mutation was detected in all runs. The sensitivity of detection of the A62V mutation as a 40% mixture was 88.9%.
The specificity calculation for the ViroSeq system for mutation detection utilized 73 of the 75 mutations in the ViroSeq software algorithm (same as those considered in the analysis of the clinical plasma samples [see above]). This included 18 protease mutations and 12 RT mutations that were not represented in the recombinant-virus samples. In this study, the overall specificity for the recombinant-virus sample panel was 100%.
|
|
|---|
In this study, the all-base accuracy of the 3100 instrument without manual intervention (editing) was 99.9% with the Applied Biosystems BDTSS. For bases 27 to 576, 424 of the 425 sequences met the Applied Biosystems specification of >98.5% accuracy. This high accuracy of base calling, along with the double coverage of ViroSeq sequences and the ViroSeq software's ability to perform manual edits, resulted in highly accurate sample consensus sequences.
In this study, the overall sensitivity and specificity of ViroSeq for detection of drug resistance mutations were 99.65 and 99.95%, respectively, for clinical samples, and were 99.7 and 100%, respectively, for recombinant samples containing mutations as 40% mixtures with viral loads of approximately 5,000 copies/ml. Similar results were obtained at three independent testing sites. These performance characteristics are equivalent to those obtained previously using the 377 instrument (ViroSeq HIV-1 Genotyping System Operator's Manual, 2003, CDx, part number 4341639). The sensitivity for mutation detection was determined for 73 of the 75 mutations included in the ViroSeq resistance interpretation algorithm. The sensitivity was 100% for all but two of the mutations (M41L and A62V in RT), and the specificity was 100% for all but one mutation (L63P in protease). For these mutations, the triplicate sequences were consistent, suggesting that detection of the mutation was dependent on a presequencing event. Since these samples were low-viral-load samples (2,000 to 10,500 copies/ml), it is possible that (i) cDNA from the RT reaction was biased due to a less-than-40% mixture or (ii) the sequence context of the mutation affected dideoxynucleoside triphosphate incorporation, such that some mutations were not proportional to the population mixture. This study suggests that the following criteria are important for the generation of high-quality HIV-1 genotypes: (i) the RT-PCR yield should be at least 20 ng per 5 µl; (ii) total sequencing base signals should be
400; (iii) peak spacing should be between 11 and 16; and (iv) the ViroSeq positive control (8E5) should show no mixtures.
When genotyping assays are performed, it is important to minimize contamination of reaction mixtures with previously amplified products. Sample cross-contamination is minimized in the ViroSeq system by using a single nonnested PCR for amplification, and by using a dUTP/UNG contamination control system. There was no evidence of sample cross-contamination in this study or in previous reports (2, 4).
This study supports use of the ViroSeq system and ABI PRISM 3100 genetic analyzer for identification of HIV-1 drug resistance mutations. Testing is performed using only 0.5 ml of plasma. Research methods have also been developed to use PCR products generated with ViroSeq for analysis of individual HIV-1 variants and genetic linkage of drug resistance mutations by cloning (5), for analysis of the HIV-1 gag region (6), and for detection of minority HIV-1 variants with drug resistance mutations (8). The system is currently available for diagnostic use in both the United States and Europe. The system is cleared by the FDA for analysis of subtype B HIV-1 only. However, excellent performance of the system has also been documented in research studies for analysis of diverse HIV-1 strains (4). An updated version of the ViroSeq HIV-1 genotyping system (version 2.6) was recently cleared by the FDA. Version 2.6 includes an updated algorithm for interpretation of drug resistance to all currently licensed protease and RT inhibitors. The results described in this report should be relevant to version 2.6 as well as version 2.5, since these versions are identical in all aspects except for the interpretive report.
Present address: Chiron, Emeryville, Calif. ![]()
Present address: Juvaris BioTherapeutics, Inc., Pleasanton, Calif. ![]()
¶ Present address: Arcturus, Mountain View, Calif. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»