Previous Article | Next Article ![]()
Journal of Clinical Microbiology, October 2008, p. 3215-3221, Vol. 46, No. 10
0095-1137/08/$08.00+0 doi:10.1128/JCM.00476-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Department of Pathology, VU University Medical Center, Amsterdam, The Netherlands,1 Department of Obstetrics and Gynecology, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands,2 Department of Biostatistics and Epidemiology, VU University Medical Center, Amsterdam, The Netherlands,3 Department of Medical Microbiology, Radboud University Nijmegen Medical Center, Nijmegen, The Netherlands4
Received 11 March 2008/ Accepted 25 July 2008
|
|
|---|
0.006). Our data indicate that GP5+/6+-PCR has a better clinical performance than SPF10 for women who are diagnosed with CIN 3 after prior normal cytology results. The extra positivity scored by SPF10 mainly involved infections characterized by low viral loads that do not result in CIN 3. |
|
|---|
CIN 3) and therefore should be considered as clinically relevant. We previously hypothesized that various hrHPV tests, although similarly efficient in detecting persistent infections, may differ considerably in the extent with which transient, clinically irrelevant hrHPV infections are detected (28).
A clinically valuable hrHPV test should perform in such a way that the number of transient infections detected is as low as possible to ensure an optimal balance between clinical sensitivity and specificity for
CIN 3. This is important to minimize the number of unnecessary follow-up procedures, particularly for women with normal cytology results. Based on data from longitudinal clinical studies involving large cohorts, so far only the GP5+/6+-PCR and the commercially available hrHPV hybrid capture 2 (hc2) assays have been proven to reach such an optimal balance and therefore can be considered clinically validated (2, 5, 7, 9, 16, 17, 21, 24). In a previous two-way comparison study, we showed that these assays, which both detect hrHPV types as a pool, perform equally well for the detection of
CIN 3 in a population-based cervical screening setting (13).
Besides GP5+/6+-PCR and hc2, the consensus HPV SPF10-Line Blot 25 linear probe assay (SPF10-LiPA version 1) PCR assay (15) (referred to herein as SPF10) is a commonly used HPV detection assay, particularly in epidemiological studies and vaccination trials (12). However, this method has not yet been tested in a comparison study in relation to the occurrence or development of
CIN 3.
We here performed a comparison study between GP5+/6+-PCR and SPF10 to detect 14 hrHPV types in samples from women with normal cytology results who had or developed CIN 3 lesions. A subsequent discrepancy analysis included viral load analysis by type-specific real-time PCR.
|
|
|---|
Of the outpatient clinic cohort, 1,566 women had normal cytology results, and sample material and follow-up data were available for 1,020 of these women. Women visited the outpatient clinic for a wide spectrum of gynecological complaints and for their hormonal contraception. One hundred twenty of these women had a colposcopy-directed biopsy; of these women, 42, 30, 28, and 20 were diagnosed with no CIN, with CIN 1, with CIN 2, and with CIN 3, respectively. All 20 women with CIN 3 in this cohort were included as cases as well, and all 72 women with a histologically confirmed absence of CIN 2/3 (42 with no CIN and 30 with CIN 1) were included as controls. The median ages for cases and controls were 32 (range, 22 to 49) and 37 (range, 20 to 53) years, respectively, and median follow-up times were 0.2 (range, 0 to 0.5) and 0.3 (range, 0 to 0.6) years. In the hospital group, ages and follow-up times did not differ significantly between cases and controls (ANOVA; both P values were >0.05). Taking these cohorts together, 45 cases and 271 controls were included in this study. Informed consent was obtained from all participating women, and this study followed the local ethical guidelines of our medical center.
Cytology results and HPV testing. Cervical scrape specimens were taken from the cervix uteri with a cervix brush (Rovers, Oss, The Netherlands). A smear was made on a glass slide for cytomorphological analysis, and the brush with remaining cell material was subsequently placed in a tube containing 5 ml phosphate-buffered saline-0.05% Merthiolate. Upon arrival in the laboratory, the samples were spun down and pellets were resuspended in 1 ml Tris-HCl (pH 8) and stored at –80°C for subsequent HPV analysis. In none of the women were HPV test results used for triage. Cytomorphological classification was performed as described before (33).
The high pure PCR template preparation kit was used for DNA extraction from 100-µl Tris-HCl suspensions of stored samples according to the recommendations of the manufacturer (Roche, Mannheim, Germany), except that samples were eluted with 100 µl of elution buffer. Ultimately, 10 µl of eluate was used for each PCR assay. To assess sample quality, DNA isolates were subjected first to β-globin PCR using the primers PCO3/PCO5 (11). The β-globin PCR assay generates a 209-bp PCR fragment, which exceeds the sizes of the PCR products generated by the SPF10 (about 70 bp) and GP5+/6+-PCR (about 150 bp) assays. Subsequently, only β-globin PCR-positive samples were subjected to comparative HPV PCR analyses.
The GP5+/6+-PCR followed by use of the enzyme immunoassay (EIA) readout system with a probe cocktail of 14 hrHPV types (i.e., HPV16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, -66, and -68) was performed at the Department of Pathology, VU University Medical Center (Amsterdam, The Netherlands) as described before (30). Reverse line blotting was used to genotype hrHPV for all EIA-positive samples (30). HPV testing and genotyping using HPV SPF10 were performed at the Department of Medical Microbiology, Radboud University Nijmegen Medical Center (Nijmegen, The Netherlands) according to a routinely used protocol in which DNA EIA (DEIA) was the first readout system for SPF10 PCR products with a probe cocktail of 14 of the above-mentioned hrHPV types plus 24 low-risk HPV types (i.e., 38 types altogether, including HPV6, -11, -16, -18, -26, -30, -31, -33, -34, -35, -39, -40, -42, -43, -44, -45, -51, -52, -53, -54, -55, -56, -58, -59, -61, -62, -64, -66, -67, -68, -69, -70, -72, -73, -74, -82 [MM4], MM7, and MM8) (15, 32). DEIA-positive samples were subsequently subjected to LiPA typing. Both GP5+/6+-PCR and SPF10 assays target the L1 region in the HPV genome. Testing with both methods was performed in parallel by different technicians who were unaware of each others' test results and were blinded to the case/control status of the samples.
For final analysis, the GP5+/6+-PCR and SPF10 assays were considered hrHPV positive when reverse line blotting and LiPA genotyping, respectively, revealed 1 or more of the 14 abovementioned hrHPV genotypes that can be detected by (D)EIA of both assays. Samples that showed a positive (D)EIA signal but failed to reveal a positive signal in the subsequent typing assays were designated as containing HPV-X, which may indicate (sub)types and/or variants that were not available on the respective typing blots. Genotyping results were considered concordant if there was complete agreement between both assays for 1 or more of the 14 hrHPV types listed above. Results were considered compatible when at least one type was detected with both assays while one or more other types were not detected by either of the assays. Genotyping data were considered discordant when no similarity between genotypes detected by both assays was found.
Viral load analysis. Viral load analysis was performed by type-specific real-time PCR for HPV16, -18, and -52 on the LightCycler instrument essentially as described before (14, 27). Real-time PCR was performed on 5 µl of DNA isolate, representing about 1/200 of the DNA of the total scrape specimen. Primers and probes used for HPV16 and -18 real-time PCR have been described before (14, 27). The oligonucleotide sequences for primers and probes used for HPV52 real-time PCR were as follows: the forward primer was 5'-ATGGACAAGCAGAACAAGCCA-3' (nucleotide [nt] positions 683 to 704); the reverse primer was 5'-CCCTCCCTTTCGCCCTCT-3' (nt positions 884 to 902); the donor probe was 5'-TGCGACGGACCTTCGTACTCTACAGC-3' (nt positions 773 to 799), with the 3' end labeled with fluorescein; and the acceptor probe was 5'-TGCTGTTGGGCACATTACAAGTTGTG-3' (nt positions 803 to 828), with the 5' labeled with LCRed640. Viral loads were expressed as HPV DNA copies per scrape specimen.
Statistical analysis. Positivity rates for the GP5+/6+-PCR and SPF10 assays of cases and controls were calculated, and Mantel-Haenszel common odds ratios (ORs) were computed to study assay positivity in relation to the development of CIN 3. The sensitivities, specificities, and ORs were relative to the procedure. The McNemar test was used for mutual comparison of the positivity rates of the GP5+/6+-PCR and SPF10 assays in the two subgroups, i.e., cases and controls. Both pooled and separate analyses of cases and controls of both cohorts were performed. The level of agreement was determined using kappa statistics. All HPV viral load values were log normalized. One-way ANOVA was used to compare viral loads between the GP5+/6+-PCR-negative/SPF10-positive group and the GP5+/6+-PCR-positive/SPF10-positive group. GP5+/6+-PCR- and/or SPF10-positive samples that were negative in the LightCycler tests, thus containing numbers of HPV copies below the detection level, were set at 10 copies (3, 14), which corresponds to approximately 2,000 copies per scrape specimen. The level of statistical significance was set at 0.05. All analyses were performed using SPSS 11.5 software.
|
|
|---|
β-Globin PCR analysis of extracted DNA revealed positivity for samples of all cases and 264 controls (193 and 71 of screening and hospital populations, respectively), and these were considered valid for further HPV PCR analyses. Both HPV PCR assays were subsequently performed on equal amounts of the same DNA isolates of β-globin PCR-positive samples. After (D)EIA detection using cocktail probes, GP5+/6+-PCR gave positive results for 71 samples (42/45 cases and 29/264 controls) and SPF10 for 171 samples (42/45 cases and 129/264 controls). However, it should be noted that whereas the cocktail probe for GP5+/6+-PCR EIA detects only 14 hrHPV types (i.e., HPV16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, -66, and -68), that of SPF10 detects 24 additional low-risk HPV types as well. Subsequent genotyping by the respective reverse hybridization methods revealed that 2 of the 71 GP5+/6+-PCR EIA-positive samples and 36 of the 171 SPF10 DEIA-positive samples did not show a positive typing result for 1 or more of the 14 hrHPV types. These included 2 cases with positivity by both GP5+/6+-PCR and SPF10 and an additional 34 controls with positivity by SPF10 only. Both of the GP5+/6+-PCR EIA-positive, typing-negative cases could be identified as containing HPV-X, whereas one SPF10 DEIA-positive case contained HPV-X and another HPV6. Of the 34 SPF10 DEIA-positive, typing-negative controls, 24 contained low-risk HPV and 10 HPV-X.
The data obtained after restricting the analysis to the 14 hrHPV types are summarized in Table 1. Overall, the GP5+/6+-PCR assay scored a significantly low number of samples as hrHPV positive (n = 69) compared to the SPF10 assay (n = 135; McNemar; P < 0.001). Restricting the analysis to cases, the hrHPV positivity rates of the GP5+/6+-PCR and SPF10 assays were similarly high, namely, 89% (40/45; 95% confidence interval [95%CI], 80 to 98), and did not significantly differ (McNemar; P = 1.0). Similar results were obtained after analysis of samples from case women from both cohorts separately (Table 1). The assays scored 88% (22/25; 95%CI, 76 to 100) and 90% (18/20; 95%CI, 77 to 100) of samples from case women from the screening and hospital cohorts, respectively, as hrHPV positive.
|
View this table: [in a new window] |
TABLE 1. Test results for 14 hrHPV types by GP5+/6+-PCR and SPF10 assays for samples from women with normal cytology results
|
The strength of the overall agreement in assay positivity was moderate (kappa values of 0.42). When stratification was done according to cases and controls, this strength was poor for controls (kappa value of 0.24) but good for cases (kappa value of 0.78). The significantly high positivity rate for controls assayed by SPF10 compared to that assayed by GP5+/6+-PCR was reflected in the ORs of both assays for CIN 3. The overall ORs (Mantel-Haenszel) were 14 (95%CI, 5 to 38; P < 0.001) for the SPF10 assay and 65 (95%CI, 24178; P < 0.001) for the GP5+/6+-PCR assay. This indicates that women with normal cytology results who tested hrHPV positive by the GP5+/6+-PCR assay were 4.5 times more likely to have or develop CIN 3 lesions than those who were hrHPV positive by the SPF10 assay. The agreement figures and differences in ORs did not differ meaningfully when calculated for the two cohorts separately (data not shown).
Comparison of hrHPV genotypes detected by the GP5+/6+-PCR and SPF10 assays. As specified in Table 2, the samples that were scored as hrHPV positive by the SPF10 assay but negative by the GP5+/6+-PCR assay displayed a broad variety of hrHPV genotypes, although HPV52 infections were relatively frequent. Among 23 control samples that were hrHPV positive by both assays, 17 (74%) showed concordant, 2 (9%) compatible, and 4 (17%) discordant typing results. For case samples, these numbers were 31 (79%), 7 (18%), and 1 (3%), respectively. Thus, one or more of the same hrHPV types were detected by both assays in 83% of the control samples and 97% of the case samples that were positive by both assays. The single discordant case had HPV16 as determined by the GP5+/6+-PCR assay and HPV52 according to the SPF10 assay. Furthermore, one case sample that was hrHPV negative by the SPF10 assay was positive for HPV16 by the GP5+/6+-PCR assay, and one case sample that was negative for hrHPV by the GP5+/6+-PCR assay contained HPV52 according to the SPF10 assay.
|
View this table: [in a new window] |
TABLE 2. HPV genotyping results for 14 hrHPV types of SPF10 versus GP5+/6+-PCR
|
0.006) than those for the GP5+/6+-PCR assay-positive/SPF10 assay-positive group, i.e., 1.1 x 106 (range, 1.6 x 105 to 7.7 x 106), 7.4 x 107 (range, 4.0 x 105 to 8.0 x 107), and 3.7 x 106 (range, 2.4 x 105 to 3.7 x 106), respectively (Fig. 1). Only three samples that were HPV52 positive by the SPF10 assay and GP5+/6+-PCR assay negative had viral load levels that overlapped with those of SPF10 and GP5+/6+-PCR assay double-positive samples for this type. These samples, all from control women, might contain certain HPV52 variants that are less efficiently detected by the GP5+/6+-PCR assay than by the SPF10 assay (8). The viral load of the CIN 3 case missed by the GP5+/6+-PCR assay, which was positive for HPV52 by the SPF10 assay, revealed 1.0 x 104 copies/scrape specimen. After the restriction of calculations to control samples, only for HPV16 were sufficient samples with concordant GP5+/6+-PCR and SPF10 results available. This analysis revealed similar findings. Thus, the exclusion of cases had no influence on the relation between lower viral loads and GP5+/6+-PCR assay-negative but SPF10 assay-positive samples (ANOVA; P < 0.001; data not shown). Altogether, these data indicate that the extra positivity scored by the SPF10 assay in relation to the GP5+/6+-PCR assay mainly involved relatively low viral loads.
![]() View larger version (21K): [in a new window] |
FIG. 1. Box plot of HPV16, -18, and -52 DNA loads in GP5+/6+-PCR assay-negative (GP–)/SPF10 assay-positive (SPF+) (light boxes) and GP5+/6+-PCR assay-positive (GP+)/SPF10 assay-positive (dark boxes) samples. Viral load values are shown on the y axis as HPV copies/scrape specimen and are log transformed. For all three HPV types, the viral loads were significantly higher in the GP5+/6+-PCR assay-positive/SPF10 assay-positive samples than in the GP5+/6+-PCR assay-negative/SPF10 assay-positive samples (ANOVA; P values were <0.001, <0.001, and 0.006 for HPV16, -18, and -52, respectively). The upper and lower boundaries of the boxes represent the 75th and 25th percentiles, respectively. The thick black line represents the median, the whiskers represent the minimum and maximum values, and the asterisks represent outliers.
|
|
|
|---|
CIN 3. This is in line with data from several studies indicating that not hrHPV DNA presence per se but increased viral loads confer an increased risk of
CIN 3 (19, 27, 31, 34). It is noteworthy that differences in the population characteristics could influence the relative performance of each assay. However, in this study similar differences in assay performance were found for control women of both the screening and the gynecological outpatient populations. The fact that among the first group of women the median age was significantly higher for controls (i.e., 41 years) than for cases (i.e., 34 years) is unlikely to have contributed markedly to the observed difference between both assays, since in the hospital population the median ages of cases and controls (32 versus 37 years) did not differ significantly. Our data nevertheless seem to contradict those found in a study reported by Safaeian et al. (25). That study revealed that for women with normal cytology results enrolled for a vaccination trial, there was no difference in hrHPV positivities between the SPF10 and hc2 assays, the latter of which is considered to be compatible with the GP5+/6+-PCR assay (25). A likely explanation for this apparent discrepancy is that Safaeian et al. studied young women under 30 years of age (median age, 21 years; range, 18 to 25 years). It is therefore tempting to speculate that hrHPV positivity in women under 30 years of age with normal cytology results is often accompanied by relatively high viral loads, giving rise to positivity rates that are equal for assays displaying different analytical sensitivities for hrHPV. This is supported by findings of a different comparison study between SPF10 and hc2 on samples from a population of women visiting a colposcopic clinic (22). The latter study mainly included women above 30 years of age and displayed for women with normal cytology results a difference between hrHPV positivity by SPF10 versus that by hc2 that was similar to that seen for SPF10 versus GP5+/6+-PCR assays for control samples from our study.
Taken together, these data indicate that the threshold for the positivity of a given hrHPV test should be at such a level that an optimal balance between clinical sensitivity and specificity for identifying women at risk of having or developing
CIN 3 is reached. This concept finds support by recent recommendations of the American Society for Colposcopy and Cervical Pathology (ASCCP) (29), which indicate that in a cervical screening setting, clinical sensitivities for
CIN 3 of at least 92% ± 3% seem satisfactory only when clinical specificities are above 85% at the same time. Therefore, the GP5+/6+-PCR assay can be advocated above SPF10 for screening purposes involving women over 30 years of age.
Apart from the difference in clinical performances, both tests showed common characteristics, since there was a high concordance in hrHPV genotyping, especially for samples from case women. We found a relatively high number of infections with HPV52 among the women for whom samples were SPF10 positive and GP5+/6+-PCR negative. This cannot be explained solely by a potentially low sensitivity of the GP5+/6+-PCR assay for HPV52 compared to that for HPV16 and HPV18 (23). The minimal HPV52 viral load value determined for SPF10 assay-positive but GP5+/6+-PCR assay-negative samples did not differ markedly from those for HPV16 and -18. In fact, only three discordant HPV52 control samples might have resulted from a lower detectability by the GP5+/6+-PCR assay, possibly because these infections involve HPV52 variants. Thus, the majority of HPV52 infections detected by the SPF10 assay alone are due to lower copy numbers of HPV52, which are apparently relatively common among SPF10-positive women with normal cytology results.
In conclusion, the application of hrHPV detection assays with a too-high analytical sensitivity for hrHPV results in a markedly reduced specificity for CIN 3 without being beneficial for clinical sensitivity. Therefore, hrHPV test requirements, as currently under preparation in The Netherlands, should be incorporated in cervical screening guidelines to prevent overdetection, which would counteract the benefits of implementing hrHPV testing in screening programs.
This work was supported by a research grant from ZON-MW, Zorg Onderzoek Nederland-Medische Wetenschappen (Netherlands Organization for Health Research and Development; grant 2200.0147).
Published ahead of print on 6 August 2008. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»