Previous Article | Next Article 
Journal of Clinical Microbiology, February 1998, p. 375-381, Vol. 36, No. 2
0095-1137/98/$04.00+0
Copyright © 1998, American Society for Microbiology. All rights reserved.
Evaluation of Bias in Diagnostic-Test Sensitivity
and Specificity Estimates Computed by Discrepant Analysis
Timothy A.
Green,1,*
Carolyn M.
Black,1 and
Robert E.
Johnson2
Division of AIDS, STD, and TB Laboratory
Research, National Center for Infectious
Diseases,1 and
Division of Sexually
Transmitted Diseases Prevention, National Center for HIV, STD,
and TB Prevention,2 Centers for Disease
Control and Prevention, Atlanta, Georgia 30333
Received 2 June 1997/Returned for modification 12 August
1997/Accepted 30 October 1997
When a new diagnostic test is potentially more sensitive than the
reference test used to classify persons as infected or uninfected, a
substantial number of specimens from infected persons may be reference-test negative but new-test positive. Discrepant analysis involves the performance of one or more additional tests with these
specimens, reclassification as infected those persons for whom the
new-test-positive results are confirmed, and recalculation of the
estimates of new-test sensitivity and specificity by using the revised
classification. This approach has been criticized because of the bias
introduced by the selective use of confirmation testing. Under
conditions appropriate for evaluating a nucleic acid amplification
(NAA) test for Chlamydia trachomatis infection with cell
culture as the reference test, we compared the bias in estimates based
on the discrepant-analysis classification of persons as infected or
uninfected with that in estimates based on the culture classification.
We concluded that the bias in estimates of NAA-test specificity based
on discrepant analysis is small and generally less than that in
estimates based on culture. However, the accuracy of
discrepant-analysis-based estimates of NAA-test sensitivity depends
critically on whether culture specificity is equal to or is slightly
less than 100%, and it is affected by competing biases that are not
fully taken into account by discrepant analysis.
*
Corresponding author. Mailing address: Centers for
Disease Control and Prevention, 1600 Clifton Road, N.E. (MS-A12),
Atlanta, GA 30333. Phone: (404) 639-4460. Fax: (404) 639-4664. E-mail: tag1{at}cdc.gov.
Journal of Clinical Microbiology, February 1998, p. 375-381, Vol. 36, No. 2
0095-1137/98/$04.00+0
Copyright © 1998, American Society for Microbiology. All rights reserved.
This article has been cited by other articles:
-
Masek, B. J., Arora, N., Quinn, N., Aumakhan, B., Holden, J., Hardick, A., Agreda, P., Barnes, M., Gaydos, C. A.
(2009). Performance of Three Nucleic Acid Amplification Tests for Detection of Chlamydia trachomatis and Neisseria gonorrhoeae by Use of Self-Collected Vaginal Swabs Obtained via an Internet-Based Screening Program. J. Clin. Microbiol.
47: 1663-1667
[Abstract]
[Full Text]
-
Diederen, B. M. W., Kluytmans, J. A. J. W., Vandenbroucke-Grauls, C. M., Peeters, M. F.
(2008). Utility of Real-Time PCR for Diagnosis of Legionnaires' Disease in Routine Clinical Practice. J. Clin. Microbiol.
46: 671-677
[Abstract]
[Full Text]
-
Baughman, A. L., Bisgard, K. M., Cortese, M. M., Thompson, W. W., Sanden, G. N., Strebel, P. M.
(2008). Utility of Composite Reference Standards and Latent Class Analysis in Evaluating the Clinical Accuracy of Diagnostic Tests for Pertussis. CVI
15: 106-114
[Abstract]
[Full Text]
-
Hardick, A., Hardick, J., Wood, B. J., Gaydos, C.
(2006). Comparison between the Gen-Probe Transcription-Mediated Amplification Trichomonas vaginalis Research Assay and Real-Time PCR for Trichomonas vaginalis Detection Using a Roche LightCycler Instrument with Female Self-Obtained Vaginal Swab Samples and Male Urine Samples. J. Clin. Microbiol.
44: 4197-4199
[Abstract]
[Full Text]
-
Hardick, J., Giles, J., Hardick, A., Hsieh, Y.-H., Quinn, T., Gaydos, C.
(2006). Performance of the Gen-Probe Transmission-Mediated Amplification Research Assay Compared to That of a Multitarget Real-Time PCR for Mycoplasma genitalium Detection. J. Clin. Microbiol.
44: 1236-1240
[Abstract]
[Full Text]
-
Whiley, D. M., Tapsall, J. W., Sloots, T. P.
(2006). Nucleic Acid Amplification Testing for Neisseria gonorrhoeae: An Ongoing Challenge. J. Mol. Diagn.
8: 3-15
[Abstract]
[Full Text]
-
Novak, R. T., Glass, M. B., Gee, J. E., Gal, D., Mayo, M. J., Currie, B. J., Wilkins, P. P.
(2006). Development and Evaluation of a Real-Time PCR Assay Targeting the Type III Secretion System of Burkholderia pseudomallei. J. Clin. Microbiol.
44: 85-90
[Abstract]
[Full Text]
-
Cook, R. L., Hutchison, S. L., Ostergaard, L., Braithwaite, R. S., Ness, R. B.
(2005). Systematic Review: Noninvasive Testing for Chlamydia trachomatis and Neisseria gonorrhoeae. ANN INTERN MED
142: 914-925
[Abstract]
[Full Text]
-
Solomon, A. W., Peeling, R. W., Foster, A., Mabey, D. C. W.
(2004). Diagnosis and Assessment of Trachoma. Clin. Microbiol. Rev.
17: 982-1011
[Abstract]
[Full Text]
-
Martin, D. H., Nsuami, M., Schachter, J., Hook, E. W. III, Ferrero, D., Quinn, T. C., Gaydos, C.
(2004). Use of Multiple Nucleic Acid Amplification Tests To Define the Infected-Patient "Gold Standard" in Clinical Trials of New Diagnostic Tests for Chlamydia trachomatis Infections. J. Clin. Microbiol.
42: 4749-4758
[Abstract]
[Full Text]
-
Gaydos, C. A., Theodore, M., Dalesio, N., Wood, B. J., Quinn, T. C.
(2004). Comparison of Three Nucleic Acid Amplification Tests for Detection of Chlamydia trachomatis in Urine Specimens. J. Clin. Microbiol.
42: 3041-3045
[Abstract]
[Full Text]
-
Hardick, J., Yang, S., Lin, S., Duncan, D., Gaydos, C.
(2003). Use of the Roche LightCycler Instrument in a Real-Time PCR for Trichomonas vaginalis in Urine Samples from Females and Males. J. Clin. Microbiol.
41: 5619-5622
[Abstract]
[Full Text]
-
Diemert, D. J., Libman, M. D., Lebel, P.
(2002). Confirmation by 16S rRNA PCR of the COBAS AMPLICOR CT/NG Test for Diagnosis of Neisseria gonorrhoeae Infection in a Low-Prevalence Population. J. Clin. Microbiol.
40: 4056-4059
[Abstract]
[Full Text]
-
Black, C. M., Marrazzo, J., Johnson, R. E., Hook III, E. W., Jones, R. B., Green, T. A., Schachter, J., Stamm, W. E., Bolan, G., St. Louis, M. E., Martin, D. H.
(2002). Head-to-Head Multicenter Comparison of DNA Probe and Nucleic Acid Amplification Tests for Chlamydia trachomatis Infection in Women Performed with an Improved Reference Standard. J. Clin. Microbiol.
40: 3757-3763
[Abstract]
[Full Text]
-
Alary, M., Poulin, C., Bouchard, C., Fortier, M., Murray, G., Gingras, S., Aube, M., Morin, C.
(2001). Evaluation of a Modified Sanitary Napkin as a Sample Self-Collection Device for the Detection of Genital Chlamydial Infection in Women. J. Clin. Microbiol.
39: 2508-2512
[Abstract]
[Full Text]
-
Van Dyck, E., Ieven, M., Pattyn, S., Van Damme, L., Laga, M.
(2001). Detection of Chlamydia trachomatis and Neisseria gonorrhoeae by Enzyme Immunoassay, Culture, and Three Nucleic Acid Amplification Tests. J. Clin. Microbiol.
39: 1751-1756
[Abstract]
[Full Text]
-
Johnson, R. E., Green, T. A., Schachter, J., Jones, R. B., Hook, E. W. III, Black, C. M., Martin, D. H., St. Louis, M. E., Stamm, W. E.
(2000). Evaluation of Nucleic Acid Amplification Tests as Reference Tests for Chlamydia trachomatis Infections in Asymptomatic Men. J. Clin. Microbiol.
38: 4382-4386
[Abstract]
[Full Text]
-
Hadgu, A., McAdam, A. J.
(2000). Discrepant Analysis Is an Inappropriate and Unscientific Method. J. Clin. Microbiol.
38: 4301-4302
[Full Text]
-
McAdam, A. J.
(2000). Discrepant Analysis: How Can We Test a Test?. J. Clin. Microbiol.
38: 2027-2029
[Full Text]
-
Van Der Pol, B., Quinn, T. C., Gaydos, C. A., Crotchfelt, K., Schachter, J., Moncada, J., Jungkind, D., Martin, D. H., Turner, B., Peyton, C., Jones, R. B.
(2000). Multicenter Evaluation of the AMPLICOR and Automated COBAS AMPLICOR CT/NG Tests for Detection of Chlamydia trachomatis. J. Clin. Microbiol.
38: 1105-1112
[Abstract]
[Full Text]
-
Pate, M. S., Dixon, P. B., Hardy, K., Crosby, M., Hook, E. W. III
(1998). Evaluation of the Biostar Chlamydia OIA Assay with Specimens from Women Attending a Sexually Transmitted Disease Clinic. J. Clin. Microbiol.
36: 2183-2186
[Abstract]
[Full Text]