Previous Article | Next Article ![]()
Journal of Clinical Microbiology, March 2003, p. 948-953, Vol. 41, No. 3
0095-1137/03/$08.00+0 DOI: 10.1128/JCM.41.3.948-953.2003
Copyright © 2003, American Society for Microbiology. All Rights Reserved.
Johns Hopkins Bloomberg School of Public Health,1 Johns Hopkins Hospital,2 Johns Hopkins University School of Medicine, Baltimore, Maryland3
Received 27 September 2002/ Returned for modification 6 November 2002/ Accepted 15 December 2002
|
|
|---|
|
|
|---|
In recent years, rapid diagnostic tests for TB based on nucleic acid amplification techniques have been developed. Two such tests are currently approved in the United States for the detection of M. tuberculosis complex organisms in smear-positive respiratory specimens: the AMPLICOR Mycobacterium tuberculosis test (Roche Diagnostics, Inc., Indianapolis, Ind.) and the Amplified Mycobacterium Tuberculosis Direct test (MTD) (Gen-Probe, Inc., San Diego, Calif.). The MTD is currently marketed as an "enhanced" version that, unlike the AMPLICOR test, is also approved for use with smear-negative specimens (5). For smear-positive respiratory specimens, the sensitivity of the enhanced MTD has been reported between 91.7% (17) and 100% (2, 6, 11, 20), with specificity between 99.6% (6) and 100% (2, 11, 19). Despite such demonstrated high validity, the routine implementation of nucleic acid amplification tests in clinical settings has been slow, due in large part to concerns of their high cost, previously estimated at $50 to $100 per test in most laboratories (10). To determine whether this cost may be offset by savings in the form of isolation room and medication expense, we conducted a cost-effectiveness analysis of the routine use of MTD during the evaluation of patients suspected of having pulmonary TB at a large urban hospital in the mid-Atlantic United States.
|
|
|---|
MTD diagnostic strategy.
In order to measure the cost-effectiveness of MTD relative to the standard of care (no MTD), it was necessary to outline a diagnostic strategy for the use of MTD. We assumed an MTD strategy in which a single MTD test was run on the first smear-positive respiratory specimen submitted from any patient in whom a diagnosis of mycobacterial disease had not been made in the previous 30 days. Tests would be performed according to the manufacturer's instructions. Positive and negative amplification controls would be run on each day that MTD testing was performed. Results of >30,000 relative light units (RLU) would be considered positive or insufficient for the exclusion of M. tuberculosis, whereas those of
30,000 RLU would be considered negative or sufficient to exclude M. tuberculosis. All MTD-negative specimens would be tested for inhibitors by spiking the sample with an aliquot of M. tuberculosis, either in a separate reaction run simultaneously with the original test (a strategy in which MTD-positive specimens would also be tested for inhibitors) or immediately following the initial MTD result. Samples found to contain MTD-inhibitory substances would be considered to provide insufficient evidence for the exclusion of M. tuberculosis and would not be retested. Repeat runs in our institution were rarely necessary outside the context of training or equipment fault; costs of failed training runs were included in our estimates, but we assumed that additional failures on patient samples would not occur. All MTD results were assumed to be uniformly available 24 h after the initial positive AFB smear result. The results of both MTD and smear were assumed to be available 6 days per week.
Smear-positive patients were assumed to be placed immediately in respiratory isolation and started on presumptive therapy for TB, consisting of isoniazid, rifampin, pyrazinamide, and ethambutol. Respiratory isolation would be continued until the earliest of the following: a negative MTD result, isolation of MOTT from culture, or successful completion of 2 weeks of therapy.
Estimation of analysis variables. The sensitivity and specificity of the MTD test, as well as the likelihood of sample inhibition, were estimated from the literature. For this purpose, we conducted a literature search using Medline to identify studies that reported data sufficient to determine the sensitivity and specificity of the enhanced MTD in smear-positive respiratory specimens. Eight such reports (2, 6, 8, 11, 16, 17, 19, 20) were identified. A total of 852 smear-positive samples were evaluated in these reports, 517 of which were from a single laboratory (6). To determine the validity of the MTD test, we used culture (or culture plus clinical criteria, when reported) as the "gold standard." The likelihood of MTD inhibition was estimated from the subset of reports that provided this information.
The relative prevalence of TB among individuals with smear-positive respiratory specimens, as well as the average length of time between smear and culture result, was ascertained directly using data from our hospital's clinical microbiology laboratory. This facility processed 4,607 specimens for mycobacterial culture in 2001. We evaluated laboratory records of all smear- or culture-positive specimens submitted from patients who provided at least one smear-positive sample to our hospital between the years of 1996 and 2001, inclusive. A total of 82 specimens met these criteria and were used for this analysis. Data abstracted on each specimen included anatomic source, date of submission, date of smear and/or culture positivity, date of M. tuberculosis-specific DNA probe result, date of final identification to species level, and species identity. The presence or absence of comorbid conditions, including human immunodeficiency virus and AIDS, was not ascertained. Identification of cultured mycobacteria to the species level was determined by DNA probe or by other standard methods (15).
Estimation of costs. For purposes of determining the incremental cost of MTD testing, the annual costs associated with the MTD testing program at our hospital's clinical microbiology laboratory, implemented in January 2000, were enumerated and estimated. The cost per smear-positive patient was then obtained by dividing the annual program cost by the number of MTD candidates per year. The MTD detection reagents are sold in kits of 50 tests at an estimated cost of $1,200/kit; these reagents have a maximum shelf life of 6 months, after reconstitution. Analysis of records between January 2000 and December 2001 indicated that three new technicians were trained to use MTD per year, the most recent training sessions requiring 12 MTD tests over 3 days per technician trained. During the 2-year period, 28 additional MTD tests were run on six different days for research or quality control purposes. We assumed that an MTD test series requires 2.5 h of technician time (3 h, minus 30 min deemed to be free during a 60-minute incubation) at the midpoint 2001 wage of $25.47 per h (includes 22% benefit rate) for medical technologists at our hospital. Three-day training sessions for new employees were assumed to involve 3 h for an experienced technician at the wage listed above and 10 hours for a starting technician at a wage (including benefits) of $19.58 per h. The cost of supplies (such as gloves and microcentrifuge tubes) needed in addition to the detection reagents was estimated at $5.85 per daily series of MTD tests. In addition, positive and negative control samples were maintained in the laboratory, at an estimated cost of $13.17 per 6 months. Additional costs for proficiency testing were not included.
The marginal daily cost of respiratory isolation was estimated by consultation with the senior operations engineer at our hospital. The refitting of an existing room to accommodate negative-pressure isolation was assumed to cost $120,000 per room. Such rooms have a minimum operational life expectancy of 20 years; we therefore amortized costs for a 30-year operating life, with an annual discount rate of 5% per year, giving an annuity rate of 15.37%. Estimated annual costs included 26 h per year for pressure testing and 16 h for heating, ventilation, and air conditioning maintenance, at a billed rate of $50/h. Furthermore, each two-room unit was assumed to undergo two annual HEPA filter and prefilter changes, with a cost of $600 per filter for parts and installation. Using these estimates, we calculated the mean daily cost of maintaining an available negative-pressure room and took this figure to equal the incremental cost per day of placing a patient in respiratory isolation. The marginal costs of personal protective equipment (masks) were not included in this analysis. Drug costs were estimated from the average wholesale price list in 2001; listed prices were found to be similar to those charged by a nationwide commercial pharmacy.
Sensitivity analysis. One-way sensitivity analyses were performed on all variables in the decision analysis, with the exception of drug costs. Ranges for different analysis variables were determined from literature reports unless such reports were unavailable or identified reports did not appear to cover the range of reasonable possibilities. If one-way variation of a variable throughout its entire range did not change the estimated MTD cost-effectiveness by more than 10%, the analysis was reported as insensitive to that variable. Three-way sensitivity analysis was carried out on the annual number of specimens processed, the relative prevalence of TB, and the marginal cost of respiratory isolation, as the analysis was found to be particularly sensitive to these variables. Decision tree construction and sensitivity analysis were performed using DATA software (version 4.0; TreeAge Software, Inc., Williamstown, Mass.). All cost estimates from the literature were adjusted to 2001 dollars using the medical-care portion of the Consumer Price Index (U.S. Bureau of Labor Statistics [http://data.bls.gov/cgi-bin/surveymost]).
Ethical review. The institutional review board for our hospital approved this study.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Estimation of MTD validity measuresf
|
|
View this table: [in a new window] |
TABLE 2. Variables used in cost-effectiveness and sensitivity analysesa
|
|
View this table: [in a new window] |
TABLE 3. MTD cost-effectiveness and one-way sensitivity analysis of variables
|
![]() View larger version (33K): [in a new window] |
FIG. 1. MTD cost-effectiveness, by TB prevalence, patient load, and isolation cost. Each isocontour represents the daily marginal cost of respiratory isolation needed to offset the costs of a hypothetical MTD testing program at a laboratory with a given number of patients tested per year (y axis) and relative prevalence of pulmonary TB among patients with AFB smear-positive respiratory specimens (x axis). Areas above a given isocontour represent those situations in which the implementation of MTD is expected to be cost-saving relative to the standard of care. The inset at the upper left details MTD cost-effectiveness in laboratories processing small numbers of smear-positive specimens on an annual basis.
|
|
|
|---|
In the base case analysis presented here, the costs of implementing an MTD program ($494 per early exclusion of TB) were not recoverable in terms of averted isolation and treatment ($201 per presumptive TB patient). However, a number of considerations indicate that this analysis may underestimate the cost-effectiveness of MTD testing in other situations. First of all, the marginal cost of respiratory isolation at our hospital is low, due to our hospital's relatively large number of respiratory isolation rooms. In addition, the mean time of 7 days between positive smear result and definitive identification to species level from culture at our hospital is substantially lower than the turnaround time reported from other institutions (21). Finally, this analysis did not consider factors such as decreased length of hospital stay among patients infected with MOTT able to start appropriate therapy sooner or averted toxicity from drugs used for presumptive treatment of TB in individuals with MOTT infections. Although these outcomes are likely to be rare, they are also associated with great costs to the health care system and may therefore have great impact on the cost-effectiveness of MTD testing programs.
In contrast to the above considerations, other components of our analysis may have led us to overestimate the cost-effectiveness of MTD. The relative prevalence of TB (31.4%) among smear-positive respiratory specimens at our hospital is relatively low. Furthermore, this analysis did not include the costs of purchasing equipment such as a luminometer or sonicator or the costs of shipping samples to a hypothetical reference laboratory. Finally, our estimate of a uniform 24 h between smear and culture results may be low, particularly in laboratories incapable of MTD testing 6 days per week. In settings where MTD testing is performed fewer than 6 days per week the amount of respiratory isolation time, and therefore costs, saved by MTD testing may be lower than those in our analysis.
One key limitation of the present analysis is that we were unable to assess the potential costs and outcomes due to false-negative MTD results. As can be seen in Table 1, previous reports have shown the sensitivity of MTD to be extremely high when applied to smear-positive respiratory specimens. Nevertheless, concern justifiably exists that sensitivity in the clinical setting may be lower than that reported in the literature, and the potential consequences of releasing an individual with smear-positive, active TB onto the general hospital ward are serious.
Observations from our analysis indicate that, in sites where the implementation of MTD is expected to be cost-effective, fears of false-negative MTD results may not be sufficient to outweigh cost-effectiveness concerns. First of all, two of the six reports listed in Table 1 (2, 6) identified a total of nine specimens that were positive by MTD but were, based on clinical criteria, false negative by culture. Were MTD not performed on these individuals in the clinical setting, they may have been released with active TB. Secondly, most reports of false-negative MTD results (as in reference 13, for example) involve specimens with initial results in the range of 30,000 to 500,000 RLU. The manufacturer recommends retesting samples in this equivocal range, but the diagnostic strategy promulgated in this analysisthat of considering all results above 30,000 RLU to be positivenot only minimizes cost due to retesting but also maximizes sensitivity. Thirdly, our analysis indicates that MTD is likely to be cost-effective mainly in those laboratories processing large numbers of specimens. As demonstrated by Chedore and Jamieson (6), whose laboratory performed 517 MTD tests on smear-positive respiratory specimens from 1997 to 1998 without a single false-negative result, such large laboratories are the ideal setting for maximizing sensitivity through standardization of procedures. A similar reference laboratory in Florida (S. Rungruanghiranya, D. F. Romero-Fischmann, M. Narita, E. S. Hollender, D. Nolan, Y. M. Hale, and D. Ashkin, Abstr. 4th World Congress Tuberc., abstr. 139, 2002) found no significant difference between the sensitivity of MTD and that of culture in smear-positive respiratory specimens, although five false-negative MTD results were reported out of 257 smear-positive TB cases tested (98% sensitivity). Finally, if concerns regarding imperfect sensitivity persist, a diagnostic strategy based on the current Centers for Disease Control and Prevention guidelines (5), which require two negative MTD results in order to exclude TB, may be adopted. This strategy involves greater expense but could still be cost-effective, for example, at a reference laboratory (500 samples/year) with a relative TB prevalence of 70% among smear-positive samples and a marginal daily cost of $100 for respiratory isolation.
In addition to its inability to assess the impact of false-negative MTD results, this analysis is further limited by the fact that it is restricted to the inpatient setting. For outpatients, the measures implemented to prevent potential M. tuberculosis transmission are likely to vary from one site to another. Furthermore, outpatients are sometimes required to purchase drugs for presumptive treatment in bulk and may not be able to start therapy immediately after a positive smear result is reported by the laboratory. As a result, the estimates of MTD cost and effectiveness are likely to differ substantially in the outpatient setting from those described here.
Although the analysis presented here demonstrates that routine MTD testing can be cost-effective in certain circumstances for routine testing of smear-positive respiratory samples, the greatest promise of rapid molecular TB diagnostics is for use in TB suspects whose specimens are smear negative (1, 3). With evidence emerging (18) that smear-negative TB patients can be infectious, routine MTD testing could play a vital role in disease-prevention efforts by identifying such individuals days or weeks before culture results become available. Catanzaro and colleagues (3) have presented evidence that MTD testing can be carried out on smear-negative specimens with high positive and negative predictive value, if combined with clinical judgment in identifying those patients at high risk for TB. Nevertheless, cost-effectiveness remains a critical obstacle to the routine use of MTD for smear-negative patients; the need for development and analysis of a cost-effective diagnostic strategy is critical, if nucleic acid amplification tests are to reach their full potential in aiding the diagnosis and improving the clinical outcomes of TB patients.
We thank George Comstock, Michael Sweat, and David Bishai for critical review of the manuscript. We also thank Gregory Bova for assistance in estimating costs associated with respiratory isolation at our hospital and Richard Chaisson for many helpful discussions in the design and analysis of this project.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»