Previous Article | Next Article 
Journal of Clinical Microbiology, March 2005, p. 1372-1373, Vol. 43, No. 3
0095-1137/05/$08.00+0 doi:10.1128/JCM.43.3.1372-1373.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
Confirming Positive Results of Nucleic Acid Amplification Tests (NAATs) for Chlamydia trachomatis: All NAATs Are Not Created Equal
J. Schachter,1*
E. W. Hook,2
D. H. Martin,3
D. Willis,4
P. Fine,5
D. Fuller,6
J. Jordan,7
W. M. Janda,8 and
M. Chernesky9
University of California, San Francisco, California,1
University of Alabama, Birmingham, Alabama,2
Louisiana State University Medical Center, New Orleans, Louisiana,3
Florida State Department of Health, Jacksonville, Florida,4
Planned Parenthood Foundation of Houston and Southeast Texas, Houston, Texas,5
Wishard Memorial Hospital, Indianapolis, Indiana,6
Magee-Womens Research Institute, Pittsburgh, Pennsylvania,7
University of Illinois, Chicago, Illinois,8
St. Joseph's Health Care Regional Virology and Chlamydiology Laboratory, Hamilton, Ontario, Canada9
Received 4 August 2004/
Returned for modification 7 October 2004/
Accepted 14 November 2004

ABSTRACT
The Centers for Disease Control and Prevention recommended confirming
positive screening tests for
Chlamydia trachomatis when positive
predictive values are <90%. It is accepted that less sensitive
tests (i.e., culture and immunoassays) should not be used to
confirm the results of more sensitive nucleic acid amplification
tests (NAATs). We show that the same principle applies when
NAATs are used for confirmation.

TEXT
Chlamydia trachomatis is the most common sexually transmitted
bacterial pathogen (
4). It causes adverse reproductive consequences
in women and conjunctivitis and pneumonia in infants exposed
to the organism at birth. Screening women in family planning
or in obstetrics and gynecology clinics and treatment of those
infected with
C. trachomatis prevents pelvic inflammatory disease
and neonatal infections (
7,
8). Because most genital chlamydial
infections are asymptomatic, Centers for Disease Control and
Prevention (CDC) guidelines call for routine screening of sexually
active women between ages 15 and 24.
Nucleic acid amplification tests (NAATs) are the most sensitive tests for the screening and diagnosis of genital chlamydial infections (6). NAATs are more sensitive than previously available diagnostic tests (culture, antigen detection, or nucleic acid hybridization) by at least 20 to 30%. That NAATs can be used with noninvasively collected specimens, such as first-catch urine samples (FCU) from men or women and self- or clinician-collected vaginal swabs, improves our ability to screen for chlamydia.
As more screening for genital infections has been done by using NAATs, concerns have been raised about their specificity, particularly in screening low-prevalence populations. In some studies, positive NAAT results could not be reproduced (1-3, 5, 9). There are obvious concerns about the social ramifications of incorrectly informing individuals that they have a sexually transmitted disease based on false-positive screening test results. These concerns led the CDC to recommend confirmatory testing of positive test results when the positive predictive value is <90% (4). Several strategies for confirmation were suggested. One was to perform a second NAAT, targeting a different nucleic acid sequence, with either the original specimen or a specimen collected in duplicate.
Gen-Probe, Inc., has introduced three assays based on its transcription-mediated amplification technology: the APTIMA CT assay (ACT), which detects C. trachomatis, the APTIMA GC assay (AGC), which detects Neisseria gonorrhoeae, and the APTIMA COMBO 2 assay (AC2), which detects both pathogens. The ACT and AGC oligonucleotide probes target rRNA sequences different from those for the AC2. These tests are thus each well suited for confirming results obtained with the other. During a clinical assessment of the performance of these assays, we had an opportunity to evaluate the confirmation of NAAT-positive results by using other NAATs.
The study population consisted of 1,465 females and 1,322 males who attended sexually transmitted disease, obstetrics and gynecology, teen, or family planning clinics in seven centers in North America. FCU and endocervical swabs (CS) from women and urethral swabs and FCU from males were collected and tested by ACT and AC2. The FCU and a duplicate swab from each subject were also tested with BDProbeTec ET System C. trachomatis assay (BD; Becton Dickinson and Co. Diagnostics, Sparks, Md.). With females, FCU were collected first, and then two randomized CS were collected. In males, two randomized urethral swabs were collected first, followed by the FCU. Thus, three NAATs, each having a different target, were used to test specimens from each subject. For this evaluation, the results from the BD, ACT, and AC2 were each considered as primary screening tests, and positive results for each test were then confirmed by the two other tests. The APTIMA assays do not have a control for inhibitors; the BD test does have such a control. All results presented here were valid (there were no indeterminate results due to inhibition).
Of all of the male and female swab specimens and FCU tested, there were 850 positive results with the AC2, 927 positive results with the ACT, and 720 positive results with the BD. Both the ACT and AC2 confirmed 96.9% of the positive results with the BD. Of the positive results with the AC2, 98.1% were positive with the ACT, but only 82% were positive with the BD. Of the positive results with the ACT, the AC2 confirmed 89.8%, but the BD confirmed only 75.1%. The positive results and confirmatory tests by sex and specimen type are shown in Table 1. There were no major differences in the observed patterns by sex or specimen type.
In the CDC guidelines, it was pointed out that less sensitive
diagnostic tests, such as culture and enzyme immunoassays, should
not be used to confirm positive results of the more sensitive
NAATs for
C. trachomatis. This guideline exists because 30%
or more of specimens positive by NAATs will be negative by culture
or enzyme immunoassay. Our study shows that the same principle
applies when only NAATs are being used. Both APTIMA assays yielded
more total and more confirmed-positive results than the BD assay.
If reporting a positive result is based upon confirmation of
the initial positive result, then using BD to confirm positive
results by ACT or AC2 would result in the incorrect reporting
of approximately 15% of confirmable positive results as negative
(i.e., not confirmed).
In this evaluation, the ACT had the greatest number of positive results (927), and the BD had the least number of positive results (720). While a rule of thumb has been that the less sensitive test is more specific, that was not the case here (assuming that confirmation is a proxy for specificity). Approximately 97% of the 720 positive BD results were confirmed by the more sensitive AC2 and ACT. However, the AC2 had 850 positives, 98% of which were confirmed by ACT. The AC2 confirmed only about 90% of the positive results of the ACT. There are two obvious interpretations for the latter result. It may be that the ACT is less specific and that the AC2 failed to confirm positive results because they were false positives. The alternate explanation is that ACT is actually more sensitive than the other tests and that the inability to confirm its greater number of positive results reflects the lower sensitivity of the confirmatory assays. Further studies are needed to answer this question.
It is clear from our results that some NAATs cannot be used to confirm positive results from other NAATs. Even among NAATs, the assays employed should have equivalent sensitivities. The BD should not be used to confirm the APTIMA assays. If, however, the BD were used for the primary screening, the APTIMA assays could be used for confirmation (96.9% confirmed). Based on our results, we would recommend the AC2 for initial screening and the use of the ACT for confirmation, as 98% of AC2 positive results were confirmed by ACT. This strategy would identify more infected individuals.

ACKNOWLEDGMENTS
The clinical trial was funded by Gen-Probe, Inc.

FOOTNOTES
* Corresponding author. Mailing address: Chlamydia Research Laboratory, Department of Laboratory Medicine, University of California, San Francisco, 1001 Potrero Ave., SFGH 3416, San Francisco, CA 94110. Phone: (415) 824-5115. Fax: (415) 821-8945. E-mail:
jsch{at}itsa.ucsf.edu.


REFERENCES
1 - Castriciano, S., K. Luinstra, D. Jang, J. Patel, J. Mahony, J. Kapala, and M. Chernesky. 2002. Accuracy of results obtained by performing a second ligase chain reaction assay and PCR analysis on urine samples with positive or near-cutoff results in the LCx test for Chlamydia trachomatis. J. Clin. Microbiol. 40:2632-2634.[Abstract/Free Full Text]
2 - Culler, E. E., A. M. Caliendo, and F. S. Nolte. 2003. Reproducibility of positive test results in the BDProbeTec ET system for detection of Chlamydia trachomatis and Neisseria gonorrhoeae. J. Clin. Microbiol. 41:3911-3914.[Abstract/Free Full Text]
3 - Gronowski, A. M., S. Copper, D. Baorto, and P. R. Murray. 2000. Reproducibility problems with the Abbott laboratories LCx assay for Chlamydia trachomatis and Neisseria gonorrhoeae. J. Clin. Microbiol. 38:2416-2418.[Abstract/Free Full Text]
4 - Johnson, R. E., W. J. Newhall, J. R. Papp, J. S. Knapp, C. M. Black, T. L. Gift, R. Steece, L. E. Markowitz, O. J. Devine, C. M. Walsh, S. Wang, D. C. Gunter, K. L. Irwin, S. DeLisle, and S. M. Berman. 2002. Screening tests to detect Chlamydia trachomatis and Neisseria gonorrhoeae infections2002. Morb. Mortal. Wkly. Rep. Recomm. Rep. 51(RR-15):1-38;CE1-CE4.
5 - Peterson, E. M., V. Darrow, J. Blanding, S. Aarnaes, and L. M. de la Maza. 1997. Reproducibility problems with the AMPLICOR PCR Chlamydia trachomatis test. J. Clin. Microbiol. 35:957-995.[Abstract]
6 - Schachter, J. 2001. NAATs to diagnose Chlamydia trachomatis genital infection: a promise still unfulfilled. Expert Rev. Mol. Diagn. 1:137-144.[Medline]
7 - Schachter, J., R. L. Sweet, M. Grossman, D. Landers, M. Robbie, and E. Bishop. 1986. Experience with the routine use of erythromycin for chlamydial infections in pregnancy. N. Engl. J. Med. 314:276-279.[Abstract]
8 - Scholes, D., A. Stergachis, F. E. Heidrich, H. Andrilla, K. K. Holmes, and W. E. Stamm. 1996. Prevention of pelvic inflammatory disease by screening for cervical chlamydial infection. N. Engl. J. Med. 334:1362-1366.[Abstract/Free Full Text]
9 - Verkooyen, R. P., G. T. Noordhoek, P. E. Klapper, J. Reid, J. Schirm, G. M. Cleator, M. Ieven, and G. Hoddevik. 2003. Reliability of nucleic acid amplification methods for detection of Chlamydia trachomatis in urine: results of the first international collaborative quality control study among 96 laboratories. J. Clin. Microbiol. 41:3013-3016.[Abstract/Free Full Text]
Journal of Clinical Microbiology, March 2005, p. 1372-1373, Vol. 43, No. 3
0095-1137/05/$08.00+0 doi:10.1128/JCM.43.3.1372-1373.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
This article has been cited by other articles:
-
Masek, B. J., Arora, N., Quinn, N., Aumakhan, B., Holden, J., Hardick, A., Agreda, P., Barnes, M., Gaydos, C. A.
(2009). Performance of Three Nucleic Acid Amplification Tests for Detection of Chlamydia trachomatis and Neisseria gonorrhoeae by Use of Self-Collected Vaginal Swabs Obtained via an Internet-Based Screening Program. J. Clin. Microbiol.
47: 1663-1667
[Abstract]
[Full Text]
-
Wayal, S, Llewellyn, C, Smith, H, Hankins, M, Phillips, A, Richardson, D, Fisher, M, on behalf of the Home Sampling Kit Project Steerin,
(2009). Self-sampling for oropharyngeal and rectal specimens to screen for sexually transmitted infections: acceptability among men who have sex with men. Sex. Transm. Infect.
85: 60-64
[Abstract]
[Full Text]
-
Moncada, J., Donegan, E., Schachter, J.
(2008). Evaluation of CDC-Recommended Approaches for Confirmatory Testing of Positive Neisseria gonorrhoeae Nucleic Acid Amplification Test Results. J. Clin. Microbiol.
46: 1614-1619
[Abstract]
[Full Text]
-
Chernesky, M., Freund, G. G., Hook, E. III, Leone, P., D'Ascoli, P., Martens, M.
(2007). Detection of Chlamydia trachomatis and Neisseria gonorrhoeae Infections in North American Women by Testing SurePath Liquid-Based Pap Specimens in APTIMA Assays. J. Clin. Microbiol.
45: 2434-2438
[Abstract]
[Full Text]
-
Michel, C.-E. C., Sonnex, C., Carne, C. A., White, J. A., Magbanua, J. P. V., Nadala, E. C. B. Jr., Lee, H. H.
(2007). Chlamydia trachomatis Load at Matched Anatomic Sites: Implications for Screening Strategies. J. Clin. Microbiol.
45: 1395-1402
[Abstract]
[Full Text]
-
Yang, J. L, Schachter, J., Moncada, J., Habte, D., Zerihun, M., House, J. I, Zhou, Z., Hong, K. C, Maxey, K., Gaynor, B. D, Lietman, T. M
(2007). Comparison of an rRNA-based and DNA-based nucleic acid amplification test for the detection of Chlamydia trachomatis in trachoma. Br J Ophthalmol
91: 293-295
[Abstract]
[Full Text]
-
Skidmore, S, Horner, P, Mallinson, H, on behalf of the HPA Chlamydia Diagnosis Forum,
(2006). Testing specimens for Chlamydia trachomatis.. Sex. Transm. Infect.
82: 272-275
[Abstract]
[Full Text]
-
Scragg, S, Bingham, A, Mallinson, H
(2006). Should Chlamydia trachomatis confirmation make you cross? Performance of collection kits tested across three nucleic acid amplification test platforms.. Sex. Transm. Infect.
82: 295-297
[Abstract]
[Full Text]
-
Schachter, J., Chow, J. M., Howard, H., Bolan, G., Moncada, J.
(2006). Detection of Chlamydia trachomatis by Nucleic Acid Amplification Testing: Our Evaluation Suggests that CDC-Recommended Approaches for Confirmatory Testing Are Ill-Advised.. J. Clin. Microbiol.
44: 2512-2517
[Abstract]
[Full Text]
-
Chernesky, M., Castriciano, S., Jang, D., Smieja, M.
(2006). Use of Flocked Swabs and a Universal Transport Medium To Enhance Molecular Detection of Chlamydia trachomatis and Neisseria gonorrhoeae.. J. Clin. Microbiol.
44: 1084-1086
[Abstract]
[Full Text]
-
Chernesky, M., Jang, D., Luinstra, K., Chong, S., Smieja, M., Cai, W., Hayhoe, B., Portillo, E., MacRitchie, C., Main, C., Ewert, R.
(2006). High Analytical Sensitivity and Low Rates of Inhibition May Contribute to Detection of Chlamydia trachomatis in Significantly More Women by the APTIMA Combo 2 Assay. J. Clin. Microbiol.
44: 400-405
[Abstract]
[Full Text]