Previous Article | Next Article ![]()
Journal of Clinical Microbiology, January 2002, p. 89-95, Vol. 40, No. 1
0095-1137/02/$04.00+0 DOI: 10.1128/JCM.40.1.89-95.2002
Copyright © 2002, American Society for Microbiology. All Rights Reserved.
Departments of Epidemiology,1 Medicine,2 Durham County Health Department, Durham,3 Wake County Human Services, Raleigh, North Carolina,4 Microbiology & Immunology, University of North Carolina at Chapel Hill, Chapel Hill5
Received 6 August 2001/ Returned for modification 27 September 2001/ Accepted 14 October 2001
|
|
|---|
|
|
|---|
In recent years, urine-based molecular amplification detection assays for the bacterial sexually transmitted pathogens Chlamydia trachomatis and Neisseria gonorrhoeae have proven invaluable for diagnosis in routine patient care and for epidemiological research (1, 19, 24). The increased sensitivity over culture and antigen-based detection methods combined with the use of a noninvasive specimen and simple collection and storage parameters has led to the widespread use of these assays. This has been particularly useful in field research settings where urine is the only biological specimen available and culture conditions cannot be achieved. Accordingly, we sought to develop and validate a PCR-based assay with urine for the detection of T. vaginalis.
Several PCR-based diagnostic assays for trichomoniasis using vaginal specimens (7, 12, 25) and urine (11, 13, 28) from women have recently been described. Lawing et al. found that PCR from vaginal swabs was equivalent to culture (11). In the present report, we evaluated urine-based PCR using previously described primers (9) combined with agarose gel-based and enzyme-linked immunosorbant assay (ELISA) detection methods in a large-scale validation study. Estimates of sensitivity and specificity of the urine-based amplification tests were determined by comparison to a combined reference standard of wet mount and culture-positive vaginal swab specimens.
|
|
|---|
Three thousand nine women agreed to participate in the study. Urine specimens were received for PCR testing from 2,930 women. The final study population comprises 2,147 women for whom the time and temperature limits for urine storage and transportation were maintained, as described below.
The study was approved by the Committee on the Protection of Human Subjects and the Institutional Review Board of the University of North Carolina at Chapel Hill.
Clinical data and specimen collection. A medical history was recorded for all subjects according to the standard of care in the STD clinics. The standardized history form included questions on symptoms, past history of an STD, and sexual risk behaviors. In addition, subjects were asked the timing of the last urinary void prior to their clinic visit and frequency of douching. For this analysis, symptomatic women were defined as those with an abnormal vaginal discharge; subjects without a reported or observed abnormal discharge were considered asymptomatic.
Routine specimens were obtained from subjects during standardized pelvic examinations. Vaginal swabs were collected for wet mount microscopy and T. vaginalis culture; endocervical swabs were obtained for Gram staining, N. gonorrhoeae cultures, and C. trachomatis LCR (Abbott Diagnostics, Abbott Park, Ill.) or EIA (Wampole Laboratories, Cranbury, N.J.). After the physical examination, subjects were asked to provide up to 20 ml of first-void urine in marked, sterile specimen containers. Patients were instructed not to pour excess urine from the container if the 20-ml mark was exceeded. For PCR detection of T. vaginalis, specimen collection, storage, transport, and time limits for processing were based on parameters established for LCR detection of N. gonorrhoeae and C. trachomatis from urine (Abbott Diagnostics). Thus, urine specimens were stored at 4°C and transported on ice within 3 days of collection to the Microbiology Core Laboratory at the University of North Carolina at Chapel Hill.
Wet mount microscopy and T. vaginalis culture. Immediately after collection, vaginal swabs were placed in sterile tubes containing 0.5 ml of normal saline and agitated. One drop of the saline mixture was placed on a glass slide with a coverslip and examined at a magnification of x200. A positive result was defined as the presence of one or more trichomonads with characteristic morphology and motility. The InPouch TV culture system (Biomed, San Jose, Calif.) was immediately inoculated with a second vaginal swab according to the manufacturers instructions. Pouch cultures were examined microscopically on day 2 or 3 and again on day 5 after inoculation. A positive result was defined as the presence of motile trichomonads at any time; a negative result was defined as the absence of motile trichomonads at all readings.
T. vaginalis PCR from urine.
To prevent bias in interpretation, persons performing PCR were unaware of wet mount and culture results until after amplification results were recorded. During development of the urine-based PCR assay for T. vaginalis, several combinations of specimen preparation and amplified product detection methods were tested. Initially, urine was processed using a proteinase K treatment method. One milliliter of first void urine was centrifuged at 15,000 x g for 15 min. The pellet was resuspended in 0.5 ml of phosphate-buffered saline (PBS), centrifuged again and the final pellet was resuspended in 0.05 ml of sterile water. Proteinase K was added to a final concentration of 0.04 mg/ml, the solution was incubated for
1 h at 56°C, and the enzyme was inactivated for 10 min at 95°C. Prepared specimens were frozen at -20°C until PCR was performed, using 0.01 ml as the template. Reaction products from specimens prepared in this way were detected by agarose gel electrophoresis as previously described (8).
We tested a second specimen preparation technique using the Amplicor CT Urine Specimen Prep kit (Roche Diagnostic Systems, Indianapolis, Ind.). One milliliter of first void urine was processed according to the manufacturers instructions and frozen at -20°C until PCR was performed, using 0.05 ml as template. Specimens prepared by this procedure performed as well as or better than those prepared with the proteinase K treatment. Since the completion of this study, Amplicor has modified the CT urine prep buffers and procedures. The currently available kits perform equally well for trichomonas PCR; however, this study was conducted entirely with the earlier version of the product. PCR products from specimens prepared in this way were detected using one of the ELISA methods described below.
Oligonucleotide primers TVK3 and TVK7 (9) were used for all PCRs. These primers specifically amplify a 312-bp sequence from repetitive DNA in the T. vaginalis genome. PCR with TVK3 and TVK7 is negative with human DNA, other organisms found in the human genitourinary tract, and other Trichomonas species (9). Amplification reactions contained 20 pmol of each primer; 0.2 mM (each) dATP, dCTP, dGTP, and dTTP or dUTP; 2.5 U of Taq DNA polymerase (Gibco BRL, Grand Island, N.Y.); and 4 mM MgCl2 in 1x PCR buffer (Gibco BRL) in a final volume of 0.1 ml. AmpErase (uracil N-glycosylase; Applied Biosystems, Foster City, Calif.) was included in PCRs for detection by ELISA, and dUTP was substituted for dTTP in the reaction mixture. PCR consisted of an initial 5-min incubation at 90°C followed by 35 cycles of denaturation at 90°C for 1 min, annealing at 60°C for 30 s, and extension at 72°C for 2 min. Purified T. vaginalis DNA and sterile water were used as positive and negative controls, respectively.
ELISA detection of PCR products.
For the ELISA without label, Immulon 2 HB microtiter plates (Dynex Technologies, Chantilly, Va.) were coated (40 ng/well) with TVK probe (5' TTCATGTCCTCTCCAAGCGTA 3') in 1 M ammonium acetate. Plates were incubated at 37°C for 10 to 20 h, washed five times with phosphate-buffered saline containing 1 mM EDTA, and stored at 4°C in sealed plastic bags containing a dessicant pouch for up to 4 weeks. PCR was performed with 5'-biotinylated TVK3 and TVK7 for use with this ELISA. Amplified products were detected using the Amplicor CT detection kit according to the manufacturers instructions except that TVK probe-coated plates were substituted for the kit plates. In this procedure, a streptavidin-horseradish peroxidase conjugate binds amplified targets captured by the probe, a colorimetric substrate is added, and absorbance is measured at 450 nm. Samples and PCR positive and negative controls were tested in duplicate on each plate. In addition, a biotinylated oligonucleotide corresponding to the reverse complement of the TVK probe (40 ng/well) was used as an ELISA positive control for each plate. Tests were considered valid if the absorbances of ELISA and PCR positive controls were
1.0 and those of PCR negative controls were <0.1. The limit of detection for PCR combined with the unlabeled ELISA was between 1 and 10 organisms per PCR mixture prepared from urine. The average standard error on a typical plate was 14.5% of the mean for duplicate determinations.
We tested a second ELISA method using PCR with TVK3 and digoxigenin (DIG)-labeled TVK7 and biotinylated TVK probe (the TVK probe hybridizes to the amplified DNA strand generated with the TVK7 primer). PCR products were detected using the PCR ELISA DIG detection kit (Roche Diagnostic Systems) according to the manufacturers instructions. In this procedure, microtiter plates are precoated with streptavidin, which binds amplified target-probe complexes via the biotinylated TVK probe. The DIG-labeled target is recognized by an anti-DIG antibody-enzyme conjugate, a colorimetric substrate is added, and absorbance is measured at 405 nm. Samples and PCR positive and negative controls were tested in duplicate along with a DIG-labeled oligonucleotide corresponding to the reverse complement of the TVK probe as an ELISA positive control for each plate. Tests were considered valid if the absorbances of ELISA positive controls were
1.0, those of PCR positive controls were
2.0, and those of PCR negative controls were <0.2. The limits of detection for PCR combined with the DIG ELISA were two organisms per PCR mixture prepared from phosphate-buffered saline suspensions and eight organisms per PCR mixture prepared from urine. The average standard error on a typical plate was 3.0% of the mean for duplicate determinations.
Data analysis. Data were entered into databases created and maintained in Microsoft Excel 2000 and EpiInfo (version 6.04; Centers for Disease Control and Prevention, Atlanta, Ga.). Clinical and laboratory data were double entered by different study personnel. Discrepant records were resolved by review of chart information. Data analysis was performed using SAS version 7 (SAS Institute, Cary, N.C.) and STATA version 6.0 (Stata Corp., College Station, Tex.).
For evaluation of the performance of the PCR assays, the reference standard was based on the combined results of wet mount microscopy and culture from vaginal swabs. Presence of trichomoniasis was defined as the presence of motile trichomonads by either test. Absence of trichomoniasis was defined as the absence of motile trichomonads by both tests. Estimates of the sensitivity and specificity and 95% confidence intervals (CIs) were computed for each PCR assay using standard methods. Nonparametric receiver-operating characteristic (ROC) analysis was performed for the two PCR-ELISAs. Sensitivity and specificity of the PCR were calculated for every possible ELISA absorbance cutoff value. Sensitivity was plotted against 1 - specificity at each value to obtain the ROC curve. The absorbance value corresponding to the upper leftmost point of the ROC curve is the ELISA cutoff point that jointly optimizes sensitivity and specificity.
T. vaginalis culture and wet mount are known to be imperfect tests. In particular, the sensitivity of these tests is recognized to be less than 1. As a result, specificity estimates using wet mount or culture as the reference standard are subject to reference test bias. We assessed the potential impact of this bias by adjusting the estimates of specificity using the formula of Staquet et al. (27). We assumed the sensitivity and specificity of the combined reference standard to be 0.70 and 1.0, respectively. This method also assumes the reference standard tests and PCR are independent. Under the assumption that the specificity of the reference standard is 1.0, the sensitivity estimates for the new tests are unbiased (27).
|
|
|---|
Women presenting to the clinics were most likely to seek medical attention because of symptoms, for STD screening, or because they had partners who had been diagnosed with an STD (Table 1). Twenty-three women (0.8% of the study population) reported a partner who had been diagnosed with T. vaginalis infection. Sixty-five percent of the women in the study were symptomatic.
|
View this table: [in a new window] |
TABLE 1. Demographics of study invitees and clinical characteristics of study participants
|
Five hundred two women had trichomoniasis detected by wet mount microscopy or culture. Sixty-five percent (n = 286) of all trichomoniasis cases were positive by both wet mount microscopy and culture, 62 cases (12.3%) were detected by wet mount microscopy only, and 122 cases (24.3%) were detected by culture only.
Among the 1,194 study subjects diagnosed with an STD, 22% (n = 256) were diagnosed with at least two of gonorrhea, chlamydial infection, trichomoniasis, or bacterial vaginosis. Thirty-nine women (3.3%) were diagnosed with three of the four diseases, and two women (0.2%) were diagnosed with all four.
Performance of PCR for T. vaginalis using different detection methods. The development and refinement of the PCR-based T. vaginalis detection assay included the use of several methods for detecting amplified products. Initially, PCR products were visualized as ethidium bromide-stained bands of approximately 300 bp resolved by agarose gel electrophoresis as previously described by our laboratory and others (8, 11, 28). A total of 1,513 urine specimens were tested using this method, 1,038 from symptomatic women and 475 from asymptomatic women. Using the combined reference standard of a positive wet mount or culture from a vaginal swab, urine-based PCR with gel detection performed with an overall sensitivity of 66.9% and specificity of 98.3% (Table 2).
|
View this table: [in a new window] |
TABLE 2. T. vaginalis urine-based PCR performance with specimens from symptomatic and asymptomatic subjects
|
0.500, yielding a sensitivity of 86.4% and specificity of 86.1% (Table 2).
![]() View larger version (21K): [in a new window] |
FIG. 1. ROC analysis of PCR-ELISAs for detection of T. vaginalis in womens urine. ROC curves were plotted for the unlabeled ELISA, the DIG ELISA, and adjusted sensitivity values for the DIG ELISA.
|
Wet mount microscopy and culture are recognized to have virtually perfect specificity but imperfect sensitivity for detection of T. vaginalis. Thus, the observed specificity of T. vaginalis PCR-ELISA using wet mount or culture as the sole reference standard is likely underestimated. To examine the degree of this underestimation, we calculated an adjusted specificity using the formula of Staquet et al. (27). Assuming that wet mount or culture has a sensitivity of 70% and that the tests are independent, the sensitivity and estimated specificity of T. vaginalis PCR-ELISA were calculated at different absorbance cutoffs. The effect of the specificity adjustment on the ROC curve is shown in Fig. 1. Using an absorbance of 3.0 as the cutoff for the T. vaginalis PCR-ELISA resulted in an overall sensitivity of 90.8% and an adjusted specificity of 93.4% (Table 3). If the sensitivity of the reference standard is actually higher than our assumed value, the specificity of the new test will be slightly lower; if the sensitivity of wet mount or culture is actually lower, the specificity of T. vaginalis PCR-ELISA will be higher.
|
View this table: [in a new window] |
TABLE 3. Urine-based T. vaginalis PCR-ELISA performance with specimens from symptomatic and asymptomatic subjects
|
![]() View larger version (21K): [in a new window] |
FIG. 2. Distribution of DIG ELISA absorbance values for T. vaginalis PCR using womens urine. Histograms show data from women who were positive (upper panel) or negative (lower panel) by the reference standard of wet mount and culture from vaginal swabs.
|
The volume of urine collected and time elapsed since the previous void were predicted to affect the performance of T. vaginalis PCR-ELISA. At higher specimen volumes, the expected concentration of organisms in urine is lower. Likewise, the more recent the previous void, the lower the expected concentration of organisms in the test specimen. Although subjects were instructed to collect only the first 20 ml of first-void urine, many women were unable to comply with these instructions. Specimen volumes ranged from 2 to 100 ml, with a mean volume of 30.8 ml (standard error of the mean, 11.9 ml). The assay was slightly more sensitive with urine specimens with smaller volumes (
20 ml) and when more than 1.5 h had elapsed since the previous void (Table 4).
|
View this table: [in a new window] |
TABLE 4. Effect of specimen collection parameters on T. vaginalis PCR-ELISA performance
|
|
|
|---|
Other studies using PCR for detection of T. vaginalis in womens urine report sensitivities between 64 and 100% and specificities from 97 to 100% (11, 13, 28). While these studies are similar in their use of nucleic acid amplification technology, important differences in urine collection and processing, PCR primers, and detection methods make direct comparisons between assays difficult. In a recent comparative study, the primers used in the current analysis (TVK3 and TVK7) performed better than other previously reported PCR primer pairs for T. vaginalis detection in cervicovaginal swab specimens (T. Crucitti, E. Van Dyck, S. Abdellati, and M. Laga, Abstr. Int. Congr. Sex. Transm. Dis., p. 37, 2001). In the T. vaginalis PCR-ELISA described here, 1 ml of first-void urine was concentrated and processed without DNA extraction or purification, whereas DNA was extracted from the sediment of up to 50 ml of first-void urine before amplification in other studies (11, 13, 28).
As with evaluation of any new diagnostic test based on nucleic acid amplification, the selection of a reference standard was central to the design and outcome of this study. The choice of vaginal wet mount microscopy and culture as the reference standard is patient based, reflecting an acceptable reference standard for trichomoniasis in women. Though T. vaginalis can be detected on the vaginal epithelium and in urine, results from both sites are not always concordant. In general, vaginal specimens are more often positive than urine, whether trichomonads are detected by wet mount and culture or by PCR (11, 18). Consequently, diagnosis from urine assay alone is likely to underestimate the true extent of trichomoniasis in a given population of women. In a pilot study, we compared urine culture to wet mount and culture from vaginal swabs for detection of T. vaginalis in our patient population. Detection from vaginal specimens was more sensitive than that from urine; no additional cases of trichomoniasis were identified in urine cultures beyond those identified in vaginal specimens (data not shown). Thus, we did not compare the PCR assays to culture of urine specimens only. Such a comparison would have overestimated test performance, especially given the predominance of infections detected by vaginal preparations only.
Although there are clearly limitations to urine compared to vaginal specimens for T. vaginalis detection in women, the choice of urine for validation of PCR in this study reflected several considerations for large-scale population-based studies. While self-collected vaginal swabs may have performed better than urine, there are field studies under way and in the planning stages for which even this minimally invasive sampling is difficult. Since urine-based amplification tests for gonorrhea and chlamydia are routinely used, development of a test for trichomoniasis that would not require an additional specimen was desirable. In addition, urine can be obtained from women and men with uniform specimen collection procedures, making urine a valuable, if imperfect, specimen.
Comparative studies such as this one, in which an amplification test with the potential for high sensitivity is judged against a less-sensitive culture method, produce a now-familiar dilemma: how to estimate specificity when it is likely that some positive results classified as false positives are, in fact, true positives. Discrepant analysis, which subjects discordant results to additional testing and reclassification, has been used in many previous evaluations of new amplification tests. However, discrepant analysis does not provide valid estimates of sensitivity or specificity, and its use has been discouraged (5, 1416). As an alternative to discrepant analysis, we algebraically adjusted specificity estimates for T. vaginalis PCR-ELISA (27). Using reasonable assumptions for the performance of wet mount microscopy and culture, this procedure is unlikely to overestimate the specificity of the new test. We did not adjust the sensitivity estimate, because we assumed the specificity of our combined reference standard to be 1.0. However, our sensitivity may be slightly overestimated due to the potential for concordant false negatives for PCR and the reference standard. The estimated sensitivity of the PCR assay is based upon specimens positive by the combined reference standard. One would predict that the sensitivity would be lower among women with trichomoniasis but a negative combined reference test (16). If these results could be incorporated into the sensitivity estimate, the figure would be lowered slightly.
The observed and adjusted specificities of the T. vaginalis PCR-ELISA are lower than expected for an amplification test. This relatively low specificity could potentially result from the reference test bias noted above (possibly with insufficient adjustment algebraically), specimen contamination, or inadequate primer specificity. There are two pieces of evidence suggesting that the observed specificity for the PCR-ELISA is an underestimate due to reference test bias. Careful examination of the ROC curve (Fig. 1 [dig ELISA]) reveals that there is an early deviation of the curve from the vertical axis. The specificity drops off rapidly, even at very high cutoff values. This shape of the ROC curve is consistent with the misclassification of truly positive specimens as false positives. Similarly, the substantial number of subjects with positive PCR assays at high absorbances in women with negative wet mounts and cultures (Fig. 2) suggests that a significant number of women with trichomoniasis, correctly identified by the PCR, are being misclassified because of the low sensitivity of the reference standard. Typically, the probability of a false-positive result is greater near the chosen cutoff, rather than at more extreme values. These observations indicate that the specificity may actually be even higher than the adjusted values.
The relatively uncomplicated urine collection and processing procedures adopted for this study make T. vaginalis PCR-ELISA an attractive assay for the detection of T. vaginalis in certain research settings. However, the very features that make this assay useful from a practical perspective may also explain its relative insensitivity compared to urine-based nucleic acid amplification assays for other STD agents. Unlike the gram-negative bacterial pathogens N. gonorrhoeae and C. trachomatis, the protozoan T. vaginalis lacks a protective outer membrane. Thus, trichomonads are more fragile than most bacteria and may not survive or remain physically intact during urine storage and centrifugation before the target DNA can be concentrated and further processed. The addition of a preservative or protectant to urine immediately after collection may stabilize parasites and further improve the performance of this assay. In a recent report, published after the completion of the present study, Williams et al. used Fuji culture medium in this context with promising results (J. A. Williams, N. J. Smith, and V. Van Der Pol, Abstr. Int. Congr. Sex. Transm. Dis., p. 37, 2001).
PCR inhibitors represent another problem in the development of urine-based T. vaginalis detection assays. In experiments using laboratory-grown trichomonads added to urine from study subjects, approximately 9% of specimens showed evidence of inhibition (data not shown). Inhibition was abolished when smaller template volumes were used for PCR amplification or when preparations were extracted with phenol-chloroform and precipitated with sodium acetate; however, we did not systematically assess inhibitory activity in urines throughout the study. The addition of an internal amplification control and interpretation guidelines for inhibitory specimens should greatly improve the performance of urine-based amplification assays for detection of T. vaginalis.
Despite the high prevalence of T. vaginalis infection worldwide (20, 21, 23) and the association of trichomoniasis with adverse pregnancy outcomes (3, 6, 17) and more recently with increased HIV transmission (2, 10), efforts to improve diagnosis of this STD have not kept pace with diagnostic developments for gonorrhea and chlamydia. Particularly for large-scale, population-based studies conducted without clinic or immediate laboratory access, reliable and sensitive urine-based testing for T. vaginalis is necessary. The current study was specifically designed to fulfill this need. Accordingly, urine specimen collection, storage, and transport conditions implemented in this study were kept simple so that these conditions could be reproduced in field studies. Urine specimen processing was likewise simplified using sample volumes and commercially available kit reagents optimized for batch handling in typical laboratory microcentrifuges. PCR combined with ELISA for detection of T. vaginalis in womens urine performed well compared to wet mount microscopy and culture from vaginal swabs. Further improvements in the assay and validation of the test using specimens from men are currently under way. The T. vaginalis PCR-ELISA should be useful for the detection of this under-studied organism in settings where microscopy and culture are not practical.
. .
We thank Zenaida Klepovic, Karen Lau, Linda Brown, Gail Lieblang, Karen Best, and the clinicians and patients at the county health departments for enrollment and specimen collection. Karen Lau and Lashonda Bryant were instrumental in data entry, and Robert Krysiak, Natasha Harvey, and Jay Gratz provided excellent laboratory assistance. We are grateful to James Williams and Barbara Van Der Pol at Indiana University School of Medicine for providing the TVK probe sequence prior to its publication. We thank David Savitz and Lola Stamm for critically reading the manuscript.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»