Previous Article | Next Article ![]()
Journal of Clinical Microbiology, November 2002, p. 4138-4142, Vol. 40, No. 11
0095-1137/02/$04.00+0 DOI: 10.1128/JCM.40.11.4138-4142.2002
Copyright © 2002, American Society for Microbiology. All Rights Reserved.
Department of Clinical Microbiology, General Hospital Umberto I-Torrette, Ancona,1 Regional Mycobacteria Reference Centre, San Bortolo Hospital, Vicenza, Italy2
Received 11 February 2002/ Returned for modification 30 June 2002/ Accepted 16 August 2002
|
|
|---|
|
|
|---|
Because of their theoretical ability to detect a single organism, nucleic acid amplification (NAA) methods have the potential to reduce detection and identification time to within hours of sample collection. In order to address these problems and to enhance gradual application of amplification technologies into clinical microbiology laboratories, companies have developed kit-based NAA tests specific for MTB. They include PCR (Cobas Amplicor Mycobacterium tuberculosis System; Roche Diagnostic Systems, Inc., Branchburg, N.J.) and rRNA-based transcription-mediated amplification (Amplified Mycobacterium tuberculosis Direct Test [AMTDII]; Gen-Probe, Inc., San Diego, Calif.), both of which have been approved by the U.S. Food and Drug Administration, ligase chain reaction (LCx Mycobacterium tuberculosis assay; Abbott Diagnostic Division, Abbott Park, Ill.) and, more recently, strand displacement amplification (SDA; BDProbeTec ET Mycobacterium tuberculosis Complex Direct Detection Assay [DTB]; Becton Dickinson Biosciences, Sparks, Md.).
SDA is a novel DNA amplification method in which segments of the insertion sequence IS6110 specific to MTB, together with a sequence of the 16S rRNA gene common to most mycobacterial species, are amplified isothermally (11). DTB is a fully automated walkaway system which couples SDA to a fluorescent-energy transfer (hence the "ET" definition) detection system in a closed, high-throughput assay format. An internal amplification control (IAC), designed to detect the presence of inhibiting substances, is run with each sample.
The purpose of the present study was to carry out a comparative evaluation of the DTB assay and the U.S. Food and Drug Administration-approved AMTDII.
|
|
|---|
Specimen collection and processing. Investigated specimens collected from 402 patients included 211 sputum samples, 14 bronchoalveolar lavage samples (BAL), 106 bronchial washings, 16 gastric aspirates, 46 urine samples, 57 samples from normally sterile body fluid (pleural, pericardial, synovial, and cerebrospinal [CSF] fluids and ascites), and 65 miscellaneous samples such as pus and biopsy specimens.
Respiratory specimens were liquefied and decontaminated by the standard N-acetyl-L-cysteine-sodium hydroxide (NALC-NaOH) method (13). Extrapulmonary specimens such as urine, gastric aspirates (which were neutralized upon receipt with 0.067 M phosphate-buffered saline [pH 6.8; PBS]), and pleural and other similar body fluids (pericardial fluid, synovial fluid, and ascites) were centrifuged at 3,500 x g for 15 min at 4°C. The supernatant was discarded, and the pellet was resuspended in 10 ml of sterile water and decontaminated by NALC-NaOH. Part of the sediment from each specimen was inoculated onto the culture media and used for acid-fast staining, whereas the remaining portion was aliquoted and stored at -80°C until the amplification techniques were performed. CSF specimens were cultured without prior decontamination.
Pretreatment of selected clinical specimens for amplification. (i) Pretreatment of CSF. CSF was treated by NALC-NaOH and centrifuged at 12,000 x g for 10 min. The pellet was resuspended in PBS and frozen in aliquots until the amplification techniques were performed.
(ii) Pretreatment of pleural and other sterile fluids. After decontamination by NALC-NaOH, the sediment was washed twice with sterile distilled water before it was stocked for amplification assays.
Culture. A 0.5-ml portion of the processed sediment was cultivated by radiometric Bactec technique (Becton-Dickinson Diagnostic Instrument Systems) and by Löwenstein-Jensen solid medium. All media were incubated for 6 weeks at 36 ± 1°C. Bactec 12B culture vials were tested for growth twice a week for the first 3 weeks and weekly thereafter. The radiometric growth index was recorded by the Bactec instrument; a radiometric growth index of >50 was considered suspect, and smears were made daily to confirm the presence of AFB.
Löwenstein-Jensen slants were inspected weekly for growth, and acid fastness from suspect colonies was confirmed by the Ziehl-Neelsen staining.
Microscopy. To detect AFB, smears were stained with the auramine-rhodamine fluorescent stain.
Identification of mycobacteria. Isolates were identified by specific DNA probes assays (Accuprobe [Gen-Probe] and INNO LiPA Mycobacteria [Innogenetics, Ghent, Belgium] [15]), by standard biochemical tests, and by high-pressure liquid chromatography (5).
Amplification procedures. Amplification assays were run in three separate areas which had been set up in two different rooms.
Gen-Probe AMTDII. The Gen-Probe AMTDII assay was performed according to the instructions supplied by the manufacturer. Each run included positive and negative amplification controls: the former being prepared from a 10-4 to 10-5 dilution of a 1 McFarland nephelometric standard suspension of M. tuberculosis ATCC 27294, whereas the latter was made from a similarly prepared suspension of M. gordonae ATCC 14470. Although a cutoff value of 30,000 relative light units (RLU) was set by the manufacturer for positive specimens, their mean values are usually greater than 2,000,000 RLU. Therefore, to tentatively detect inhibiting substances, the following categories of samples were retested after 1:5 dilution with PBS: (i) samples whose results fell between 30,000 and 500,000 RLU (within 48 h from the first run) and (ii) discrepant samples showing AMTDII-negative results (retrospectively).
DTB. The test was done according to the instructions supplied by the manufacturer. The procedure, starting from a 500-µl sediment sample portion, consisted of two steps: specimen preparation and combined, fully automated amplification and detection. During preparation, samples were added to sample wash buffer to remove possible inhibitors and then centrifuged and heated at 105°C for 30 min (BDProbetc ET oven). The pellet was then resuspended in sample lysis buffer and sonicated for 45 min at 65°C in a water sonic bath (Branson Ultrasonic Corp., Danbury, Conn.). After the addition of sample neutralization buffer, the samples were ready for assay. For each assay, one positive and one negative control were prepared. Corresponding numbers of priming and amplification microwells were placed into two different plates; the first ones contained amplification primers, fluorescence-labeled detector, and other reagents, whereas the second ones contained two enzymes (DNA polymerase and restriction endonuclease) necessary for SDA. By using a programmable eight-channel pipettor, samples and controls were dispensed into priming microwells that were incubated at room temperature for 20 min and then placed into a 71.5°C heating block. Meanwhile, amplification microwells were placed into a 53.5°C heating block for prewarming. After 10 min, samples from the priming microwells were transferred into the corresponding amplification microwells, which were promptly sealed and immediately placed in the DTB instrument. Once samples were introduced to the instrument, amplification and detection assay was completed within 1 h. An IAC built into the priming microwell and containing a DNA sequence identical to that of the MTB target sequence was run with each amplification reaction and coamplified with the possible DNA target from the clinical specimen. Samples showing an MTB MOTA ("metric other than acceleration" values greater than 3,400 were considered positive for MTB regardless of the IAC values. If the MTB MOTA was less than 3,400 and the corresponding IAC MOTA was greater than 5,000, the specimen was considered negative. Finally, if the MTB MOTA was less than 3,400 and the corresponding IAC MOTA was less than 5,000, the result was regarded as indeterminate and the processed sample was retested within 48 h after 1:5 dilution with PBS. In addition, a procedural control was also run weekly by testing a suspension of a 10-4 to 10-5 dilution of a 1 McFarland nephelometric standard suspension of M. tuberculosis ATCC 27294.
Patients' clinical evaluation. Clinical assessment included the patients' medical history, signs, symptoms, chest X-ray, pathology, and microbiology results, as well as follow-up observations. All of the records were carefully reviewed in order to set up the combination of culture and clinical diagnosis as the "gold standard." Two categories of samples were considered as true positives: (i) samples that were culture positive for MTB and (ii) samples that were culture negative for MTB but either they originated from a patient whose other samples were culture positive or else the patient's clinical history provided enough evidence of TB to initiate antituberculous chemotherapy. After this analysis, amplification results were reclassified as appropriate.
Statistical analysis. Statistical comparisons were calculated by using the chi-square test; P < 0.05 was considered significant. AMTDII-negative specimens which turned out positive when frozen aliquots were tested retrospectively were considered as negatives according to their first assay, whereas DTB specimens showing IAC inhibition and a subsequent positive result upon repeat testing were considered as positives. Moreover, samples which remained inhibited by DTB assay despite dilution were considered uninterpretable and therefore excluded from calculations. Sensitivity, specificity, and likelihood ratios (LRs) were determined accordingly. Calculation of LRs involves answering the following two questions: (i) how likely is it to obtain a given test result among people with the target disorder (positive LR) and (ii) how likely is it to obtain the same test result among people without the target disorder (negative LR). LRs were adopted since they are known to provide the same information as predictive values without being subject to the bias of an uneven disease prevalence, as may occur in the population of a multicenter study (10).
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Respiratory specimens: comparison of AMTDII and DTB amplification assays with smear and culture results and clinical dataa
|
After resolution of discrepant results and assuming the combination of culture and clinical diagnosis as the gold standard, the percent sensitivity, the percent specificity, and the positive and negative LRs (PLR and NLR) for AMTDII were 88%, 99.2%, 110, and 0.11, respectively, whereas the corresponding values for DTB were 94.5%, 99.6%, 235, and 0.05, respectively.
Extrapulmonary specimens. A total of 184 extrapulmonary specimens collected from 149 patients were tested. Altogether, 41 specimens were culture positive for AFB and 30 isolates were found to belong to the MTB, whereas the remaining 11 strains were identified as nontuberculous species. A comparison of amplification results with smears, cultures, and clinical data is summarized in Table 2. A total of 39 specimens were from patients with extrapulmonary TB and 134 were from nontuberculous patients based on the clinical and microbiological findings.
|
View this table: [in a new window] |
TABLE 2. Extrapulmonary specimens: comparison of AMTDII and DTB amplification assays with smear and culture results and clinical dataa
|
After resolution of discrepant results assuming the combination of culture and clinical diagnosis as the gold standard, the sensitivity, the specificity, the PLR, and the NLR for AMTDII were 74.3%, 100%, 740, and 0.26, resepctively, whereas the corresponding values for DTB were 92.3%, 100%, 920, and 0.07, respectively.
When the results of both of the assays were evaluated for each patient (Table 3), a significant difference was found (P = 0.046). AMTDII allowed a correct diagnosis in 72 of 85 TB patients, whereas 80 of 85 were correctly detected by DTB.
|
View this table: [in a new window] |
TABLE 3. Evaluation of both amplification assays according to the number of patients with a conclusive diagnosis of TB (P = 0.046)
|
|
|
|---|
The present study demonstrates that both of the amplification tests considered here can detect MTB in clinical samples within a few hours, fulfilling some if not all of the above reported attributes. Although entirely manual, the AMTDII turnaround time is shorter than that of DTB (2.5 versus 3.5 to 4 h). The first part of the DTB procedure, which is variable in duration according to the number of specimens being prepared for amplification, is more labor-intensive; thereafter, the assay is nearly completely automated. Both kits, containing all of the reagents needed for sample amplification and detection, were easy to perform and appeared to fit well in the work flow of a reference laboratory performing amplifications two or three times a week. From an analytical point of view, differences among cutoff values, positive and negative controls, and samples were broad enough to allow easy discrimination by both assays. In fact, mean AMTDII values for negative and positive respiratory and positive extrapulmonary specimens were 4,316 RLU (range, 2,225 to 18,648), 2,419,922 RLU (range, 50,000 to 3,508,265), and 2,130,579 RLU (range, 30,881 to 3,553,685), whereas the corresponding values for DTB were 122 MTB MOTA (range, 0 to 442), 57,738 MTB MOTA (range, 17,116 to 101,622), and 50,456 MTB MOTA (range, 8,735 to 91,852), respectively.
In comparison with the gold standard, the sensitivity and specificity of AMTDII were 88 and 99.2% for respiratory specimens and 74.3 and 100% for extrapulmonary specimens, respectively. In agreement with our previous findings (14), negative results obtained from smear-positive and smear-negative, MTB-yielding samples were shown to depend almost entirely on the presence of inhibitors of enzymatic amplification. This held true also for four smear- and culture-negative samples collected from patients highly suspect for TB. In addition, nine smear-positive MTB-yielding samples (seven respiratory and two extrapulmonary), whose results fell between 30,000 and 500,000 RLU (mean, 241,280) were retested after dilution, showing a mean of 2,207,443 RLU. These samples were considered as true positives from the outset and therefore were not reported in brackets in Tables 1 and 2. Although specimen inhibition rates for both assays were found to be the same, it is likely that a regular search for inhibitors in all AMTDII tested samples would detect a considerably higher one. It is now well established that the larger the specimen volume (it was increased from 50 to 450 µl in the "enhanced" version of AMTD), the higher the test sensitivity, but this also means more frequent the exposure to inhibiting substances (9). Inhibition was shown to affect the majority of kit-based amplification assays (6, 12). Various attempts have been made to remove inhibitors (3, 4; P. Singer and F. Vlaspolder, Abstr. 20th Annu. Conf. Eur. Soc. Mycobacteriol., p. 76, 1999). Inexpensive methods such as dilution or the addition of bovine albumin have been shown to be partially effective, whereas other methods, although highly effective, are too expensive or do not appear to fit easily in the routine work flow. Moreover, inhibiting substances probably affect amplification techniques unevenly so that different procedures may be required according to the amplification technique adopted in each lab (8). In this context, some authors (14; P. Della Latta and M. Saragias, Abstr. 21st Annu. Cong. Eur. Soc. Mycobacteriol., p. 11, 2000) using AMTDII have suggested reducing the sample volume to 225 µl or performing a preliminary dilution. This approach has allowed them to reduce the inhibition rate especially in respiratory samples.
The sensitivity and specificity of DTB were 94.5 and 99.6% for respiratory specimens and 92.3 and 100% for extrapulmonary specimens, respectively. No significant differences in sensitivity between respiratory and extrapulmonary specimens were observed. Literature data about DTB sensitivity and specificity are in partial agreement with our findings (e.g., 92.4 and 96.4% [85.1 and 94.4% for smear-negative samples] [S. Rusch-Gerdes, Abstr. 100th Gen. Meet. Am. Soc. Microbiol. 2000, abstr. U-68, p. 657, 2000], 93.8 and 99.8% [2], and 80 and 98.9%, respectively [P. Della Latta, M. Saragias, and L. Karapici, Abstr. 22nd Annu. Cong. Eur. Soc. Mycobacteriol., p. 26, 2001]). In the last of these studies, the authors, in a comparative evaluation between AMTDII and DTB on respiratory samples, reported a superior sensitivity with AMTDII despite a 10-fold-higher inhibition rate.
For smear-negative, culture-positive noninhibitory samples (four respiratory samples and one CSF sample), a low number of mycobacteria, unequally distributed in the test suspension or a suboptimal target extraction, are perhaps the most likely explanations for a negative DTB result. The problem of smear-negative pulmonary TB is worth particular attention. In acute-care settings, as many as 8 to 10 patients are suspected to have TB for every one confirmed case (16). Moreover, patients with smear-negative, culture-positive TB have been reported to be responsible for ca. 17% of TB transmission (1). In addition, although many investigators have used NAA to test extrapulmonary specimens with encouraging results (17), the sensitivity of this method is still far from ideal when routinely applied to clinical settings whose proper evaluation may be crucial for a patient's outcome. Of the 10 samples (9 respiratory and 1 extrapulmonary) that were both smear and culture negative and were obtained from patients strongly suspected of having TB, 5 were found to be AMTDII positive and 8 were found to be DTB positive. Finally, we observed an overall inhibition rate of 5.0%, and no significant difference between respiratory (4.2%) and extrapulmonary (6.5%) specimens was found. False-negative inhibitory samples were easily detected and were soon reclassified as true positive or, when repeatedly inhibitory, as noninterpretable. In this context, none of these samples was shown to be positive for MTB by culture or clinical diagnosis. The negative result obtained by DTB assay for one smear-positive, MTB-yielding, noninhibitory sample remains unexplained.
The LRs indicate by how much a diagnostic test result will raise or lower the pretest probability of the target disease. Therefore, LRs of >1 increase this probability: the higher the LR, the greater the increase. Conversely, LRs of <1 decrease the probability of the target disease: the smaller the LR, the greater the decrease in probability and the smaller its final value. In this context, PLRs of both tests seem to generate conclusive changes from pretest to posttest probabilities (LRs of >10 or <0.1). NLRs appear to generate conclusive changes from pretest to posttest probabilities for DTB assay only, whereas with AMTDII only moderate shifts in pre- to posttest probabilities are shown (LRs of 5 to 10 or of 0.1 to 0.2). In other words, positive results obtained by both assays are fully reliable, whereas negative ones are more trustworthy for DTB than for AMTDII.
We can conclude that, although at present amplification assays cannot replace culture techniques, AMTDII and DTB proved to be rapid and specific for the detection of MTB in clinical samples. The protocols were easy to perform and were suitable for a routine microbiology laboratory's work flow. In agreement with our previously reported data, the difference between DTB and AMTDII sensitivities was found to depend mainly on the availability of IAC lacking in the latter assay. Finally, selection of patients on the basis of clinical judgment (7), proper number and quality of specimens, staff training, and quality control procedures, including IAC are currently referred to as the best ways to improve the sensitivity and specificity of commercial NAA tests.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»