| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Previous Article | Next Article ![]()
Journal of Clinical Microbiology, February 2007, p. 364-369, Vol. 45, No. 2
0095-1137/07/$08.00+0 doi:10.1128/JCM.00706-06
Copyright © 2007, American Society for Microbiology. All Rights Reserved.
Centro per lo Studio e la Prevenzione Oncologica, Analytical Cytology and BioMolecular Unit, Via Cosimo il Vecchio 2, 50127 Florence, Italy
Received 4 April 2006/ Returned for modification 12 June 2006/ Accepted 9 November 2006
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
The Digene Hybrid Capture 2 assay (HC2) (Digene, Gaithersburg, MD) is commonly used for HPV testing to detect 13 common HR-HPV types (types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, and 68). Recently, the Roche AMPLICOR HPV test (AMP) (Roche Molecular Systems, CA) was made available for the same purpose. AMP detects the same 13 HR-HPV types detected by HC2 and, moreover, uses amplification of the ß-globin gene as an internal measure of sample integrity and adequacy. Since it is a PCR-based method, the assay can be performed on small aliquots of samples in liquid cytology media or on samples obtained from archival paraffin-embedded tissue, and it is extremely sensitive (detects <100 copies of HPV DNA/PCR). In addition, incorporation of AmpErase (uracil-N-glycosylase [UNG]) into the master mix allows selective destruction of carryover products (containing deoxyuridine) from previous amplification reactions. However, evaluation of both analytical and clinical sensitivity is needed to support the use of AMP in clinical practice and cervical cancer screening programs.
In the present study, we assessed the prevalence of HR-HPV in samples from subjects with cytological abnormalities (atypical squamous cells of undetermined significance [ASC-US], atypical glandular cells of undetermined significance [AGC-US], low-grade squamous intraepithelial lesions [LSIL], and high-grade squamous intraepithelial lesions [HSIL]) as well as in samples from women with normal cytology; we also evaluated the analytical agreement between AMP and HC2 in detecting HR-HPV, and for analytical determinations, genotyping was carried out on discordant samples. In addition, the clinical sensitivity and specificity of AMP for histologically confirmed >CIN2+ lesions were compared to those for disease detection with HC2. Finally, we calculated the clinical agreement for detecting underlying high-grade cervical disease for both AMP and HC2.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Of these, 962 samples were collected in Florence, Italy, within a study evaluating new technologies for cervical cancer screening, including HC2 HPV testing (the study was approved by the local ethical committee, implying informed written consent). In order to increase the prevalence of CIN2+ cases in the studied series, 70 samples from subjects with histologically confirmed CIN2+ were also included. These patients were referred to the colposcopy clinic at the Centro per lo Studio e la Prevenzione Oncologica of Florence after detection of abnormal cytology or for follow-up after conservative treatment of CIN (samples were taken at the time of colposcopy for study purposes only, implying written informed consent).
At the time of collection, samples were processed for liquid-based cytology and HC2 testing; samples were then stored at room temperature.
Cytological diagnoses were reported according to the Bethesda System 1991, namely, negative, ASC-US/AGC-US, LSIL, HSIL, invasive squamous cervical carcinoma, and invasive adenocarcinoma. The cytological diagnoses for the 1,032 samples were inadequate specimen (n = 7), negative (n = 744), ASC-US/AGC-US (n = 151), LSIL (n = 56), and HSIL (n = 74).
HPV testing by HC2 was performed after cytology, using 4 ml of PreservCyt medium (Cytyc Corporation, Marlborough, MA) for each sample and a sample conversion kit (Digene, Gaithersburg, MD) according to the manufacturer's instructions. HC2 was performed using only probe set B for HR-HPV types. The recommended positivity threshold of 1 pg/ml was used as a cutoff, and all samples with a relative light units/control (RLU/CO) ratio of
1.00 were considered positive.
Women with ASC-US or SIL and those aged 35 years or more and positive by HC2 with any cytology (including negative) were referred for immediate colposcopy. For HPV-positive women of <35 years of age with negative cytology, colposcopy was performed if HPV positivity persisted after 1 year.
For study purposes, histological diagnosis upon colposcopy-directed punch biopsy or diagnostic loop resection was taken as the gold standard for the presence of CIN2+. In terms of correlation between the two tests, all cases were considered. To avoid bias in the estimation of clinical sensitivity and specificity, only those 270 cases resulting from Pap test-positive specimens were selected.
AMPLICOR HPV test. HR-HPV detection using AMP was performed on stored samples by following the manufacturer's instructions. The positive cutoff point for AMP was an A450 value of 0.2.
AMP results were compared with cytology and histology status and also with HC2 results, stratified by HC2 signal intensity.
Genotyping assays. Samples with discrepant HR-HPV results (either positive by HC2 and negative by AMP or negative by HC2 and positive by AMP) were genotyped for the presence of HPV, using two different PCR-based assays. First, discrepant samples were tested with the Roche Linear Array (LA) test to detect a total of 37 high- and low-risk (LR) types (14, 15). If HR-HPV was not detected using the Roche LA test, then another PCR-based assay was used to detect HR-HPV with E6/E7 primers, as previously described (30).
For the Roche LA test, 50 µl of extracted DNA (the same DNA used for AMP) was added to 50 µl of working master mix, following the manufacturer's instructions. The LA detect 37 HR- and LR-HPV genotypes, namely, types 6, 11, 16, 18, 26, 31, 33, 35, 39, 40, 42, 45, 51 to 56, 58, 59, 61, 62, 64, 66 to 70 (CPT141 and LVX180), 71 (CP8081), 72, 73 (Pap238A and MM9), 81 (CP8304), 82, IS39, 83 (P291 and MM7), 84 (P155 and MM8), and 89 (CP 6108).
HPV types considered high risk for the purpose of this study were types 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 68, 73, and 82 (8, 20). All other types were considered low risk.
The E6/E7 PCR assay is a highly sensitive gold standard method for detecting HR-HPV genotypes and is based on that previously described by Walboomers et al. (30). Samples for this assay were extracted from 2.5 ml of stored PreservCyt solution by using a QIAamp tissue kit (QIAGEN) according to the manufacturer's instructions. The genotypes detected with the E6/E7 primer system are the 13 HR-HPV types detected by HC2 and AMP, as well as types 53 and 66, which have previously been shown to generate positive results with HC2 analysis (21, 29).
Statistical analysis.
To estimate clinical sensitivity and specificity, we defined all histologically confirmed CIN2+ samples as true lesions and all other specimens as truly negative. McNemar's chi-square (
2) test was applied (18). As discussed, the analysis was restricted to Pap test-positive specimens.
The agreement between AMP and HC2 was evaluated by means of the K statistic proposed by Cohen (9). According to the statistical literature, K values of <0.40 usually indicate poor agreement, values from 0.40 to 0.75 indicate fair to good agreement, and values of >0.75 indicate excellent agreement.
| RESULTS |
|---|
|
|
|---|
|
2 for trend, 77.3; P = 106). HPV prevalence by AMP and HC2 compared to that by cytology and histology. Table 2 shows the prevalence of HPV according to cytological diagnosis in 930 samples (6 samples were excluded because of inadequate cytology) and the final outcomes for 416 women who underwent, according to the study protocol, colposcopy and/or biopsy. All 73 HSIL samples were HPV positive with both tests. Of 79 CIN1 histological lesions, 57 were positive by AMP (72.1%) and 62 were positive by HC2 (78.4%). Of 93 CIN2+ lesions, 90 (96.7%) were positive by AMP and 91 (97.8%) were positive by HC2.
|
2(1) = 1.00; P = 0.3173]. Also, the specificity of AMP (101/184 [54.9%]) was not significantly different from the specificity of HC2 (95/184 [51.6%]) [McNemar's
2(1) = 1.80; P = 0.1797]. Table 3 shows that the majority of results that were negative by AMP and positive by HC2 corresponded to both cytology- and histology-negative results (61/80 samples [76.2%]). Abnormal cytology was present in some samples that were negative by AMP and positive by HC2, including 11/80 (13.7%) ASC-US/AGC-US samples and 3/80 (3.7%) LSIL samples. With regard to histology, CIN1 was confirmed in 5/80 samples (6.2%) and CIN3 was confirmed in 1 sample (1.2%). Follow-up data were available for 60/80 cases (75%), and no additional CIN2+ cases were recorded.
|
Results of genotyping analysis of discordant samples. The aim of this study was to assess the agreement of HC2 and AMPLICOR, which are both designed to reveal the same 13 high-risk HPV types. For the discordant samples (either positive by HC2 and negative by AMP or negative by HC2 and positive by AMP), further genotyping was aimed at assessing the presence of high-risk types, that is, determining if AMP results were falsely negative, HC2 results were falsely positive, or vice versa.
Cases with discordant results were investigated by genotyping, using two methods. The LA assay was performed on 78/80 cases that were positive by HC2 and negative by AMP (two samples were excluded because of insufficient DNA). HPV genotypes were identified in 36/78 samples. High-risk target genotypes were identified in seven cases, of which four showed coinfection with LR genotypes. In total, LR genotypes were observed in 25 cases, of which 7 cases showed coinfections with other LR genotypes. A nontarget HR genotype (HPV73) was observed in four cases, all of which showed coinfection with LR genotypes. The 42 samples that tested HPV negative using the LA assay were tested further with E6/E7 primers. Four samples were not analyzed by E6/E7 primers because of insufficient DNA. Twenty-two of these 42 samples were identified as containing HR-HPV target genotypes by the E6/E7 assay, 2 samples were positive for HPV53, 1 was positive for HPV66, and 13 tested negative.
Table 4 summarizes the final results obtained for the 80 cases that were positive by HC2 and negative by AMP and were analyzed with the two genotyping methods, together with cytological findings. Genotypes were identified for 61/74 samples (82.4%). Of these, 25 cases (40.9%) contained a single HR-HPV genotype, 8 (13.1%) contained HR and LR genotypes, and 28 (45.9%) contained single or multiple LR genotypes. Of 12 samples that were positive by HC2 with negative typing, 11 had low (<15) HC2 RLU/CO ratios (data not shown).
|
Table 5 summarizes the final results obtained for 21 cases that were negative by HC2 and positive by AMP and were analyzed with the two genotyping methods, together with cytological findings. For two cases, no sample was available. Genotypes were identified in 15/19 samples (78.9%): 12/15 (80%) contained HR-HPV genotypes and 3/15 (20%) contained only LR-HPV genotypes.
|
| DISCUSSION |
|---|
|
|
|---|
Two recent studies evaluated the analytical performance of the newly introduced AMPLICOR HPV test. Poljak et al. (22) obtained concordant results between HC2 and AMP in 85.9% of tested samples. van Ham et al. (28) compared another commercial PCR-based assay, SPF10-LiPA (Innogenetics, Belgium), with AMP and found absolute agreement (97.5%) between the two tests. However, these studies did not correlate HPV testing results with histological findings, as they used only cytological findings. Recently, Sandri et al. (25) compared the performances of AMP and HC2 for women attending a colposcopy clinic either for follow-up or for clinical purposes, and they found concordant results for 83% of the samples.
The overall agreement in our study is comparable with the values obtained in the above-mentioned studies, and moreover, we observed that agreement between AMP and HC2 varied with the HC2 signal intensity, with the lowest agreement being observed for samples with low HC2 signal intensities.
HPV testing performance should most appropriately be based on its clinical sensitivity and specificity for CIN2+ lesions, particularly if HPV testing is going to be employed in a screening setting, alone or in combination with the Pap test.
Monsonego et al. (19) tested AMP performance for women with abnormal Pap tests or attending a clinic for opportunistic infection screening, and they showed AMP to be highly sensitive (95.2%) in detecting CIN2+ lesions. In this study, however, only women with abnormal Pap tests had colposcopy, whereas the primary screening group was checked on a liquid-based cytology basis.
Our study was aimed at assessing whether HPV testing has a higher accuracy for detecting CIN2+ than that of cytology, and in order to increase its power, it was designed to include a very large number of colposcopy- and histology-confirmed lesions.
The reproducibility of histological diagnosis in reporting cervical intraepithelial neoplasia may be suboptimal (17), particularly as far as CIN1 is concerned (12), but this consideration also applies to the reproducibility of cytological diagnosis. In order to minimize this effect, a subset of histology-confirmed lesions were independently reviewed in a blinded fashion, as already described (24). The two tests performed similarly in the detection of confirmed CIN2+ lesions, and even though HC2 identified one more lesion than AMP, clinical sensitivities were not statistically significantly different between the two tests. At the same time, AMP specificity was higher, but the difference was not statistically significant.
It is worth noting that in the present study, cases were selected partially on the basis of their HC2 test-positive (and cytology-negative) status, a condition that would bias HC2 performance towards higher sensitivity and lower specificity. Nevertheless, when the analysis was repeated on cytology-positive-only cases, results were similar to those observed for the whole series. Moreover, AMP clinical sensitivity might have been underestimated due to the retrospective study design, which excluded from analysis patients whose samples were negative by cytology and HC2, who were not referred for colposcopy but might still harbor a slight proportion of potential AMP test-positive CIN2+ lesions.
Criteria to define the reference standard for the presence of HPV infection may be a problem in our study and other similar studies; when evaluating the analytical sensitivities of the two methods (AMP and HC2), samples with negative or positive results by both methods were assumed to be truly negative or truly positive, whereas discordant samples were tested with two different alternative technologies.
Discordant results between the two tests were found in 10.8% of samples. Genotyping with two different methods to confirm the presence of HR-HPV showed a relatively high frequency (45.9%) of LR-HPV types among samples that were positive by HC2 and negative by AMP, a finding consistent with previous reports of HC2 cross-reactions with LR-HPV types (5, 23); all LR-HPV types observed in the present series had already been described as cross-reactive. A low frequency (15.7%) of LR types was identified among samples that were negative by HC2 and positive by AMP. Poljak et al. (22) genotyped all samples tested with HC2 and AMP, and LR types were found in 4 of 862 samples. Sandri et al. (25) genotyped discordant samples and found LR types in 30% of samples testing negative by HC2 and positive by AMP. The different findings between the study of Poljak et al. (22) and the studies presented here and by Sandri et al. (25) might be ascribed to the typing methods used (LA and Inno-LiPA, respectively), where LA detects 37 genotypes and Inno-LiPA detects 27 types. Our study, like that performed by Sandri et al. (25), is based, however, on a small number of typed samples, and no other reports are available on this issue to our knowledge. Considering the possibility that genotypes other than those included in the panel may cross-react with AMP, larger studies are probably needed to clarify this issue.
It is likely that prophylactic HPV vaccines will be available in the near future, and it has been emphasized that in such a scenario it would be important to distinguish between single HPV types rather than simply detecting the presence of HR-HPV by using pooled probes. In particular, it will be important to detect the presence of the specific type to which the vaccine is aimed and to verify to what extent a vaccination program may alter the type-specific HPV prevalence over time (13).
For such purposes, AMP or HC2, when coupled with genotyping, might give more detailed information on incident HPV infections.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
Published ahead of print on 22 November 2006. ![]()
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. |
|---|---|
| Clin. Vaccine Immunol. | ALL ASM JOURNALS |
|---|