Previous Article | Next Article ![]()
Journal of Clinical Microbiology, October 2008, p. 3437-3445, Vol. 46, No. 10
0095-1137/08/$08.00+0 doi:10.1128/JCM.00620-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.
,
Division of Cancer Epidemiology and Genetics, National Cancer Institute, National Institutes of Health, Bethesda, Maryland,1 Proyecto Epidemiológico Guanacaste, Fundación INCIENSA, Costa Rica,2 DDL Diagnostic Laboratory, Voorburg, The Netherlands,3 Departments of Epidemiology and Molecular Microbiology and Immunology, Johns Hopkins University, Baltimore, Maryland,4 Universidad de Costa Rica, Costa Rica5
Received 1 April 2008/ Returned for modification 3 August 2008/ Accepted 15 August 2008
|
|
|---|
|
|
|---|
Critical-to-large-scale evaluation of these and future HPV vaccines is the genotype-specific measurement of HPV infections, particularly HPV16 and HPV18, for defining genotype-specific endpoints of HPV persistence and cervical precancer (cervical intraepithelial neoplasia grade 2 [CIN2] and grade 3 [CIN3]). We have primarily relied on a PCR method based on SPF10-LiPA25 (16, 17) to measure HPV genotypes in a large, community-based phase III clinical trial of approximately 7,500 women aged 18 to 25 and living in Guanacaste, Costa Rica (14, 25). We recently demonstrated that detection of carcinogenic HPV by the SPF10-LiPA25 method was in good concordance with Hybrid Capture 2 (hc2; Qiagen, Gaithersburg, MD) (25), an FDA-approved test for carcinogenic HPV. However, hc2 does not distinguish which specific carcinogenic HPV genotype(s) is present, and therefore, we could not evaluate the performance of the SPF10-LiPA25 system for detection of individual HPV genotypes.
We were therefore interested in further validating the use of SPF10-LiPA25 in our trial by a post hoc comparison to another PCR-based HPV genotyping method, Linear Array (LA; Roche Molecular Systems), which uses PGMY09/11 L1 consensus primers (10). PCR methods using PGMY09/11 primers have been extensively used in epidemiologic studies of HPV (9, 23, 24, 27, 31, 35). This PGMY-based method detects 37 HPV genotypes, including all known carcinogenic HPV genotypes. We have recently completed several validation studies of this PGMY-based method, showing good analytic and clinical performance (3, 4, 11). Our primary objective in this analysis was to compare HPV genotyping results from these two protocols/methods, one based on the PGMY primers and one based on the SPF10 primers, by testing a set of baseline, prerandomization cervical specimens from a stratified random sample of women enrolled in the vaccine trial.
|
|
|---|
This analysis was based on enrollment, prevaccination specimens from women entering the vaccine trial. All study protocols were reviewed and approved by the NCI and a Costa Rican institutional review board. All participants provided written, informed consent.
HPV detection and genotyping. (i) hc2 testing. hc2 is a clinical test that collectively targets 13 carcinogenic HPV genotypes (HPV16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, and -68) without distinguishing the HPV genotype present (26). The hc2 assay was performed according to the manufacturer's instructions with residual PreservCyt (Cytyc, Marlborough, MA) samples after they were used for cytology.
(ii) SPF10-LIPA25 testing. Total DNA was isolated from 200 µl of one of the 500-µl PreservCyt aliquots by using a MagNA Pure LC instrument (Roche Diagnostics, Almere, The Netherlands) and a Total DNA isolation kit (Roche Diagnostics). DNA was eluted in 100 µl of water. Each DNA extraction run contained positive and negative controls to monitor the DNA isolation procedure.
A 10-µl aliquot of extracted DNA was used for each SPF10 PCR (4% of the 500-µl aliquot or 0.1% of the entire specimen). The SPF10 PCR primer set (DDL Diagnostic Laboratory, Voorburg, The Netherlands) was used to amplify a broad spectrum of HPV genotypes as described earlier (16, 17). Briefly, this primer set amplifies a small fragment of 65 bp from the L1 region of HPV. The reverse primers contain a biotin label at the 5' end, enabling the capture of the PCR amplicon onto streptavidin-coated microtiter plate wells. Captured amplicons are denatured by alkaline treatment and then detected by a defined cocktail of digoxigenin-labeled probes targeting a broad spectrum of HPV genotypes. Incubation steps with an anti-digoxigenin alkaline phosphatase conjugate and then an alkaline phosphatase substrate were used for detection. This method, designated the HPV DNA enzyme immunoassay (DEIA), provides an optical density value. If the SPF10-DEIA test yielded a borderline value (75 to 100% of the cutoff value), the SFP10 PCR and DEIA tests were repeated. Each DEIA batch contained separate positive, borderline, and negative controls. The broad-spectrum SFP10 primers can recognize at least 54 HPV genotypes.
The resultant SPF10 amplicons (from SPF10-DEIA-positive samples) were used to identify the HPV genotype by reverse hybridization on a line probe assay (LiPA25, version 1; Labo Bio-medical Products, Rijswijk, The Netherlands), containing probes for 25 different HPV genotypes (HPV6, -11, -16, -18, -31, -33, -34, -35, -39, -40, -42, -43, -44, -45, -51, -52, -53, -54, -56, -58, -59, -66, -68/73, -70, and -74). Each LiPA25 run contained negative and positive controls. Since the interprimer regions of HPV68 and -73 are identical, the LiPA system cannot distinguish between HPV68 and -73; hence, they are assigned as HPV68/73. SPF10-LiPA25 results were available for all samples.
(iii) Genotype-specific HPV testing. Because the vaccine trial uses a bivalent HPV16/18 vaccine, genotype-specific PCR primer sets were also used to optimize the detection of these two HPV genotypes. Specimens that tested positive by SPF10 but did not contain HPV16 or HPV18 according to LiPA25 were selectively amplified for HPV16 (TS16) and HPV18 (TS18) (32). The genotype-specific primers were based on those described by Baay et al. (1); they generate amplicons of 92 and 126 bp for HPV16 and HPV18, respectively. Amplicons from the genotype-specific PCRs were detected by DEIA, similar to the method for SPF10 amplicon detection.
(iv) LA testing. The second 500-µl aliquot of PreservCyt was used for testing by LA, a commercialized, research-use-only, L1 consensus primer-based PCR method that employs a primer set designated PGMY09/11 (10). LA testing was done masked to the all other data. Amplicons were subjected to reverse-line blot hybridization for detection of 37 individual HPV genotypes (HPV6, -11, -16, -18, -26, -31, -33, -35, -39, -40, -42, -45, -51 to -56, -58, -59, -61, -62, -64, -66 to -73, -81 to -84, -82v, and -89) (10, 22).
Because of intellectual property rights, LA does not directly detect HPV52 but combines a set of probes that detects HPV33, -35, -52, and -58 combined (HPVmix). Specimens that test negative for HPV33, -35, and -58 individually but are positive for the HPVmix are considered to be HPV52 positive. The specimens that test positive for HPV33, -35, and/or -58 and the HPVmix have an uncertain HPV52 status, and for this analysis, these specimens were considered to be HPV52 negative. LA was used according to the manufacturer's instructions in the product insert, which involve DNA extraction using a QIAamp MinElute Media kit (Qiagen, Inc., Valencia, CA). The only deviation from the LA product insert protocol was in implementing an automated sample preparation for extraction of up to 96 specimens at a time on the Qiagen MDx platform (using the MinElute Media MDx kit according to the manufacturer's instructions) rather than processing 24 specimens per batch with the manual vacuum method (3, 11). LA testing used 21% of the aliquot or 0.5% of the entire specimen.
It is noteworthy that the primers used for amplification and amplicon detection did not comprise the only differences between the assays. Each assay used different extraction procedures and different amounts of purified DNA in the PCR as well as different primers and procedures for amplicon detection. To reflect that no single step in either assay was comparable to the corresponding step in the other method, we will henceforth refer to MagNa Pure DNA extraction, SPF10 primer PCR amplification, and LiPA25 HPV genotype detection as the SPF10 method and MDx DNA extraction, PGMY09/11 primer PCR amplification, and LA HPV genotype detection as the LA method.
Statistical analysis. The SPF10 method results were available for all 5,871 sexually experienced women enrolled in the CVT group. At the time that aliquots were selected for testing by the LA method, 5,659 (96%) of the specimens had been tested by the SPF10 method and thus defined our analytic sample. A stratified, random sample of 1,508 specimens was selected on the basis of SPF10 method, hc2, and cytology results as shown in Table 1 to oversample for cytological abnormalities and discordant test results (e.g., hc2 positive/SPF10 method negative/indicative of low-grade squamous intraepithelial lesion [LSIL] cytology). We sampled the least from common categories, such as specimens that were hc2 negative/SPF10 method negative/indicative of negative cytology and hc2 positive/SPF10 method positive for carcinogenic HPV/indicative of negative cytology. One batch of 81 aliquots selected for LA method testing was lost due to DNA extraction robot failure, and thus, a total of 1,427 specimens (95% of the selected aliquots and 25% of the analytic sample) had results for both the SPF10 and LA methods for a direct comparison. Unless specified, HPV16 and HPV18 genotype-specific PCR testing results were not used in our comparison of the SPF10 and LA methods.
|
View this table: [in a new window] |
TABLE 1. Sampling schema used to select specimens for testing by the LA method for comparison with the SPF10 methoda
|
For detection of any carcinogenic HPV genotype by either method, paired extrapolated results were stratified on hc2 status (positive versus negative) and on the cytological interpretation (negative versus nonnegative) of the ThinPrep slide at the clinical site. Nonnegative cytology was defined as the presence of atypical squamous cells of undetermined significance (ASC-US) or greater severity (
ASC-US).
We explored the design idiosyncrasies of both methods resulting in equivocal HPV genotyping (e.g., the SPF10-DEIA-positive/LiPA25-negative results, the SPF10 method-positive results for HPV68/73, and the LA method-positive results for HPV52) to better understand the meaning of these results. This was accomplished by comparison of the results from one method to the relevant results of the other.
We categorized our HPV genotyping results in two additional ways. First, the numbers of carcinogenic HPV genotypes detected by each method were categorized (zero, one, two, and three or more) and compared. Second, the results for both methods were compared after the results for each were assigned to an HPV risk group according to the following a priori-established cervical cancer risks: (i) positive result for HPV16; (ii) else positive result for HPV18; (iii) else positive result for any carcinogenic HPV genotype and negative result for HPV16 and HPV18 (carcinogenic HPV, excluding HPV16 and HPV18); (iv) else positive result for any noncarcinogenic HPV genotype and negative result for all carcinogenic genotypes, including any SPF10 method-positive result for which no HPV genotype was detected (SPF10-DEIA positive/LiPA25 negative); and (v) negative PCR. The groups, in descending order of risk, are positive HPV16 result > positive HPV18 result > positive carcinogenic-HPV result (excluding HPV16 and HPV18) > positive noncarcinogenic-HPV result > negative PCR.
The results for both HPV genotyping methods were compared by calculating percent overall agreement, percent agreement on testing positive, and kappa and tested for statistical differences (P < 0.05) using an exact-symmetry or McNemar
2 test. For each analysis, each of the 1,427 results was weighted by the inverse of the probability of sampling each for testing and stratified on hc2 result, cytology, and SPF10 method result (Table 1). The sampling weights were accounted for in the testing and variance estimation with a leave-one-out jackknife variance estimator (18).
|
|
|---|
ASC-US). |
View this table: [in a new window] |
TABLE 2. Comparison of results for detection of carcinogenic HPV genotypes (HPV16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -66, and -68/73) by the SPF10 and LA methods for all womena
|
|
View this table: [in a new window] |
TABLE 3. Comparison of results for detection of individual HPV genotypes by the SPF10 and LA methods
|
Of the additional 27 HPV16-positive specimens detected by the LA method compared to the number detected by the SPF10 method in the crude results for the 1,427 paired tests, 19 (70.3%) were confirmed by HPV16 genotype-specific testing. Of the additional 26 HPV18-positive specimens detected by the LA method compared to the number detected by the SPF10 method, 12 (46.2%) were confirmed by HPV18 genotype-specific testing.
The SPF10 method sometimes gave HPV-positive results by DEIA, but no HPV genotype was identified by LiPA25. As shown in Table 4, among the SPF10-DEIA-positive/LiPA25-negative specimens sampled in this analysis, the LA method primarily tested positive for noncarcinogenic HPV genotypes (61.6%), with another 23.0% testing negative for all genotypes, and 15.4% tested positive for any carcinogenic HPV genotype. SPF10-DEIA-positive/LiPA25-negative specimens were more likely to test negative for carcinogenic HPV by the LA method when hc2 was also negative than when hc2 was positive (8.5% versus 31.3%, respectively; P < 0.001). HPV73 (2.7%), HPV51 (2.4%), HPV52 (1.8%), HPV58 (1.8%), and HPV59 (1.8%) were the most common carcinogenic HPV genotypes, and HPV61 (15.7%), HPV84% (11.8%), and HPV89 (10.6%) were the most common noncarcinogenic HPV genotypes detected by the LA method among SPF10-DEIA-positive/LiPA25-negative specimens (data not shown). We further evaluated a random selection of 81 of the 331 SPF10-DEIA-positive/LiPA25-negative specimens by DNA sequencing the SPF10 amplicons (see the table in the supplemental material). We identified an HPV genotype in 63 of 81 specimens (78%). The most common HPV genotypes detected by sequencing SPF10-positive/LiPA25-negative specimens were HPV30 (n = 15; 19%) (an HPV genotype not detected by the LA method), HPV61 (n = 11; 14%) (9 of 11 were confirmed by the LA method), and HPV67 (n = 8; 10%) (8 of 8 were confirmed by the LA method).
|
View this table: [in a new window] |
TABLE 4. Distribution of HPV cancer risk groups as determined by the LA method among those specimens that tested positive by the SPF10 method but for which no HPV genotype was detected by LiPA25a
|
2 test of expected versus observed results) than that for specimens that tested HPVmix negative (2.4%). As expected, some multiple-genotype infections (
5%) of HPV52 and HPV33, HPV35, and/or HPV58 were misclassified as HPV52 negative by the LA method in our analysis and would have been called indeterminate according to the LA product insert. |
View this table: [in a new window] |
TABLE 5. Examination of the indirect method of detecting HPV52 by the LA methoda
|
ASC-US) (data not shown) (nota bene, because hc2 is designed to detect HPV68 but not HPV73, we did not use it to stratify the paired results). However, among the specimens testing positive for HPV68/73 by the SPF10 method, a greater fraction were positive for HPV73 by the LA method alone than for HPV68 (37.5% versus 32.1%). |
View this table: [in a new window] |
TABLE 6. Comparison between detection of HPV68/73 by the SPF10 method and separate detection of HPV68 and HPV73 by the LA methoda
|
|
View this table: [in a new window] |
TABLE 7. Comparison of numbers of carcinogenic HPV types detected by the SPF10 and LA methodsa
|
|
View this table: [in a new window] |
TABLE 8. Comparison of SPF10 and LA test results, categorized hierarchically according to HPV cancer riska
|
|
|
|---|
We again emphasize that we compared two HPV genotyping methods, not just different primer systems, and these methods differed in the following ways: (i) DNA extraction and purification (MDx for the LA method versus MagnaPure LC for the SPF10 method), (ii) amount of purified DNA amplified (0.5% for the LA method versus 0.1% for the SPF10 method), (iii) PCR primers (PGM09/11 for the LA method versus SPF10 for the SPF10 method), and (iv) method of amplicon detection (LA for the LA method versus LiPA25 for the SPF10 method). In general, we found the performances for both methods very similar for the overall detection of carcinogenic HPV, as has previously been reported for a smaller set of specimens (33). However, for individual HPV genotypes, the LA method detected more HPV16, HPV18, HPV39, HPV58, HPV59, HPV66, and HPV68/73, while the SPF10 method detected more HPV11, HPV31, and HPV52.
We also observed that the LA method was able to detect more multigenotype infections and a greater number of HPV genotypes per multigenotype infection than the SPF10 method. The increased detection of multigenotype infections by the LA method compared to that by the SPF10 method could be the result of false positives or increased analytic sensitivity. However, 340 of the 577 (58.9%) additional HPV genotypes detected by the LA method were judged (by P. E. Gravitt) to have HPV genotype band strengths of 3 or 4 (on a 1-to-4 scale, with 1 being the weakest and 4 being the strongest), suggesting that at least a portion of the additional pick-ups were true positives. At this time, we cannot attribute these differences in detection between HPV genotyping methods to any one procedural step.
We note that one previous study compared these PCR primer systems by using the same input amount of DNA (0.1% of a PreservCyt specimen) from the same extraction and found results more similar (33) than those observed here, providing more evidence of the importance of standardization and optimization of the front ends (e.g., DNA purity and quantity) of these methods for their performance (6). Yet, in this previous report (33), differences were still found even when DNA purity and quantity were controlled for, with LA detecting marginally more HPV16 and HPV59 and detecting marginally less HPV51 than SPF10-LiPA25. Thus, each step in a PCR-based HPV genotyping method (DNA extraction, DNA input, use of primers, and amplicon detection) influences the test results and must be taken into consideration in any evaluation of method performance. We plan to explore the impact of these parameters on the test performance of the two HPV genotyping methods in subsequent discrepancy analyses, which should also address any possible false-positive/negative results obtained by either assay.
We found that the SPF10 method used in this study detected slightly less HPV16 and HPV18 than the LA method, but the difference, albeit statistically significant, was small. Combining HPV16 and HPV18 genotype-specific PCR assays with the SPF10 method, per the testing algorithm for the vaccine trial, improved the ascertainment of these genotypes and achieved results similar to those for the LA method. The HPV genotype-specific testing confirmed that at least half of the additional detection by the LA method represented true positives; the reason(s) for the less-than-100% confirmation by HPV genotype-specific testing are uncertain. Because the intermethod differences are small, it may be adequate to use either HPV genotyping method as a stand-alone measurement to monitor the outcomes within HPV16 and HPV18 vaccine phase 3 clinical trials or phase 4 surveillance trials or for the next generation of HPV vaccine trials that will include a broader array of HPV genotypes.
As previously reported in a comparison of LA to a line blot assay (3), the indirect method for HPV52 ascertainment by LA led to an underestimation of the prevalence of that genotype when samples positive for HPV33, -35, or -58 were presumptively considered HPV52 negative. As shown in the previous study, this indirect method of detection was in fair agreement only with direct detection by the other method, in this case an SPF10-based method. However, the HPV52 status cannot be discerned when women test positive for one or more of these other HPV genotypes included in the pooled probes individually as well as in the mixed probes. For assessing HPV persistence in a clinical setting, it will likely be necessary to consider all women positive for the mixed probe to be HPV52 positive, regardless of the other HPV genotypes detected, to maximize the detection of persistent HPV52 at the cost of falsely categorizing some women as having persistent carcinogenic HPV. An alternative might be to use an independent HPV52-specific PCR method (5, 30) to confirm all mixed-probe-positive results if the method is cost-effective and user-friendly.
Because the median and mean age of the women participating in this HPV vaccine trial was only 21 years, there were few cases of confirmed CIN2 or worse (
CIN2) (CIN2, n = 14; CIN3, n = 26), limiting the analytic power to assess clinical sensitivity. Although precancerous lesions in young women tend to be smaller than those diagnosed in older women (28), 97.5% and 100% of the
CIN2 subjects tested positive for carcinogenic HPV by the SPF10 method and the LA method, respectively, and 100% of the CIN3 subjects tested positive for carcinogenic HPV by both methods.
The optimal clinical application of HPV genotyping in cervical cancer screening and clinical management decisions has yet to be determined. There is evidence that individual detection of HPV16 and HPV18 may be useful for deciding who among carcinogenic-HPV-positive, cytologically negative women might benefit from immediate colposcopy (HPV16 and/or HPV18 positive) versus a 1-year follow-up (HPV16 and HPV18 negative) (15, 36). There is increasing evidence that detection of viral persistence over a year or two could be clinically useful (2, 19) for identifying women at risk for cervical precancer and cancer, but the best format for those tests (e.g., partial versus full HPV genotyping) requires additional evaluations (2).
Our analysis was limited by the complex sampling based on SPF10 method, hc2, and cytology results, which were used to define the subset of specimens for LA testing, weighting in favor of the most informative specimens. As a consequence, we could estimate only by extrapolation the analytic performance of the LA method for the full cohort. Estimates of the SPF10 method results extrapolated from the 1,427 tests within the sampling scheme to the full cohort of 5,659 agreed well with the empirical testing results for the full cohort of 5,659, which suggests that our estimates for the LA method are fairly accurate. Nonetheless, we acknowledge that our methods may have led to small errors in our evaluation of the LA method.
We conclude that both HPV genotyping methods showed excellent agreement for common HPV genotypes detected in baseline cervical specimens collected from women participating in the HPV vaccine trial. Based on these data, we suggest that the use of both methods will provide an accurate estimate for the main outcomes in HPV vaccine trials, and both will be useful in studies of the natural history of HPV. Each test has its strengths and weaknesses, including differences in detection of individual HPV genotypes, and these differences should be considered when choosing a method of HPV genotyping for a specific application.
Vaccines were provided for our trial by GSK Biologicals under a Clinical Trials Agreement with the NCI. GSK also provided support for aspects of the trial associated with the regulatory submission needs of the company. Some of the equipment and supplies used in these studies were provided at a reduced cost by Roche Molecular Systems Inc., Alameda, CA. We thank Meera Sangaramoorthy, Dana Ford, and Kennita Riddick for the Roche LA testing.
Our trial was sponsored by the NCI (N01-CP-11005), with support from the NIH Office for Research on Women's Health. This research was also supported (in part) by the Intramural Research Program of the NIH, National Cancer Institute.
The affiliations of the CVT group are as follows: Proyecto Epidemiológico Guanacaste, Fundación INCIENSA, San Jose, Costa Rica (Mario Alfaro, Manuel Barrantes, M. Concepcion Bratti, Fernando Cárdenas, Bernal Cortés, Albert Espinoza, Yenory Estrada, Paula Gonzalez, Diego Guillén, Rolando Herrero, Silvia E. Jimenez, Jorge Morales, Lidia Ana Morera, Elmer Pérez, Carolina Porras, Ana Cecilia Rodriguez, and Maricela Villegas); University of Costa Rica, San Jose, Costa Rica (Enrique Freer, Jose Bonilla, Sandra Silva, Ivannia Atmella, and Margarita Ramírez); U.S. National Cancer Institute, Bethesda, MD (Nora Macklin, Allan Hildesheim, Douglas R. Lowy, Mark Schiffman, John T. Schiller, Mark Sherman, Diane Solomon, and Sholom Wacholder); SAIC, NCI-Frederick, Frederick, MD (Ligia Pinto and Alfonso Garcia-Pineres), Women & Infants' Hospital, Providence, RI (Claire Eklund and Martha Hutchinson); and DDL Diagnostic Laboratory, Voorburg, The Netherlands (Wim Quint and Leen-Jan van Doorn).
Published ahead of print on 20 August 2008. ![]()
Supplemental material for this article may be found at http://jcm.asm.org/. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»