Department of Clinical Microbiology, Päijät-Häme Central Hospital, Lahti, Finland
Received 23 January 2004/ Returned for modification 20 April 2004/ Accepted 3 August 2004
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
However, relatively few methods for direct identification of bacteria from blood culture broth have been described. Standard assays comprising the immunological, tube coagulase, and stable endonuclease methods routinely used for identification of Staphylococcus aureus after subculture have been applied directly to positive blood culture bottles, but variable sensitivities and specificities have been reported (3, 12, 20). The use of PCR for the direct identification of Streptococcus pneumoniae from blood has also been described (7, 17, 22), but overall its use for this purpose has been rather limited owing to the amplification inhibitors present in blood (6). The extreme sensitivity of the method may also be a problem (14). However, rapid identification of S. aureus from blood culture by using the LightCycler system has already been reported (18), and the use of real-time fluorescence PCR for rapid identification of bacteria from blood culture may increase in the future. Fluorescent in situ hybridization (FISH) (8, 15, 16), as well as the hybridization protection assay (2), have also been shown to be quite reasonable methods for direct identification of microorganisms from blood.
Direct identification of the most common gram-positive bacteria in blood cultures by using the commercially available DNA probe kit AccuProbe (Gen-Probe, Inc., San Diego, Calif.), which utilizes hybridization protection assay technology, has already been demonstrated (2; H. Sarkkinen, Abstr. 10th Int. Cong. Infect. Dis., p. 161, 2002). However, the test has been validated by the manufacturer only with the use of fresh growth from solid medium or from broth cultures and not with direct clinical specimens. We report here our 6-year routine clinical laboratory experience with the use of AccuProbe for direct identification of S. aureus, S. pneumoniae, enterococci, and group A and B streptococci from positive blood culture bottles. The aim of the present study was also to define the optimal conditions (cutoff values) of the individual AccuProbe tests for direct identification.
| MATERIALS AND METHODS |
|---|
|
|
|---|
When blood culture bottles were signaled as positive, broth from the positive bottle was Gram stained, and bottles containing gram-positive cocci were screened for S. aureus enterococcal or streptococcal rRNA. Probe selection was guided by the Gram stain pattern: when the stain revealed gram-positive cocci in clusters, the S. aureus probe was selected and, if the gram-positive cocci were clearly in pairs or chains, then Str. pneumoniae, enterococcal, and group A and B streptococcal probes were tested. All five tests were performed when the Gram stain showed gram-positive cocci without a predominance of clusters or chains. Subcultures on both chocolate and fastidious anaerobe agar plates were performed to provide isolates for conventional identification methods and susceptibility testing.
AccuProbe technology (Gen-Probe) utilizes a chemiluminescent acridinium ester labeled DNA probe directed toward the rRNA of the target organisms. The manufacturer's instructions for specimen preparation were modified to use a pellet of bacteria made directly from positive blood culture broth as previously described (2). Briefly, 1.5 ml of broth from the positive blood culture bottle was centrifuged for 6 s in a microcentrifuge at 10,000 x g to sediment the red blood cells. The supernatant was then centrifuged at 10,000 x g for 1 min to concentrate the bacteria. A 1-µl loopful of pelleted bacteria was then tested with the appropriate AccuProbe in accordance with the manufacturer's instructions by using reagents supplied by the manufacturer. The chemiluminescence of the hybridized probe was measured with a Gen-Probe Leader 50i luminometer. A positive result registered in the laboratory records was a luminometer reading above the cutoff value of 50,000 relative light units (RLU). This cutoff value has been determined by the manufacturer on the basis of readings obtained from in-house testing (sample prepared by using a colony from an agar plate).
We reviewed all consecutive signal positive blood cultures in which direct Gram stain had revealed gram-positive cocci from laboratory records. The recorded luminometer readings were tabulated with the culture results and analyzed: the culture result being considered the "gold standard." If both bottles in the same blood culture set were positive, only the first AccuProbe result per set was included in the analysis.
During the period from June 1997 to July 2003, the total number of sets of blood cultures in our hospital was 33,695 (with one aerobic and one anaerobic bottle per set). During the same period there were 2,228 patients whose blood culture was positive. We tested 454 consecutive signal positive bottles (one per patient) directly with the AccuProbe when gram-positive cocci were seen in direct Gram stain. The number of different AccuProbe tests performed was as follows: 732 S. aureus tests (203 were culture positive and 529 were culture negative), 423 S. pneumoniae tests (142 were culture positive and 281 were culture negative), 377 enterococcus tests (55 were culture positive and 322 were culture negative), 372 group A streptococcus tests (18 were culture positive and 354 were culture negative), and 372 group B streptococcus tests (36 were culture positive and 336 were culture negative).
Receiver-operating characteristic (ROC) analysis is a method for assessing the value of a quantitative diagnostic test and deciding where to set the threshold when the test is used. In the present study, ROC analysis (StatsDirect statistical software; StatsDirect, Ltd.) was used to adjust the cutoff values (measured in RLU) for the individual AccuProbe tests.
| RESULTS |
|---|
|
|
|---|
To improve the clinical usability of the S. aureus AccuProbe test, ROC analysis was used to find a cutoff value that would increase the sensitivity of the test without excessively compromising the specificity of the test. When the cutoff value was set to
16,000 RLU, an equal number of false-positive and false-negative cases were found. Setting the cutoff value higher than 16,000 RLU therefore increased the likelihood of a positive test result being a true-positive case. When the cutoff value was elevated to 30,000 RLU (Fig. 1a), 17 more culture-positive cases were detected by the AccuProbe at the expense of six more false-positive results. The median RLU value for these false-positive S. aureus samples was 31,472 RLU (Table 1), i.e., very close to the cutoff value.
|
|
The diagnostic characteristics of all AccuProbe tests with the selected ROC analysis based cutoff values are given in Table 2.
|
| DISCUSSION |
|---|
|
|
|---|
The blood culture procedure in the present study included incubation in a continuous monitoring system, Gram staining, and use of the AccuProbe test when the stain demonstrated gram-positive cocci. According to this procedure, the sensitivity of the S. pneumoniae AccuProbe test for the direct identification was excellent. Pneumococci, however, are known to be subject in liquid cultures to autolysis, which first renders the cells gram negative and later brings about lysis of the culture. Consequently, it is possible that when autolysis has occurred, the Gram stain may not demonstrate gram-positive cocci, which may diminish the sensitivity of the blood culture procedure as a whole. However, we have never found a sample giving a positive signal in a continuous monitoring system that would have resulted in a negative Gram stain and then later positive subcultures on agar plates or positive acridine orange stains.
Defining cutoff levels for diagnostic tests is a difficult task that combines ethical and practical considerations with statistical evidence. The main difficulty is not statistical but rather the need to decide how good the test should be in order for it to be clinically relevant. Therefore, the "best clinical" cutoff value is not necessarily the same as the "best statistical" cutoff value. Considering the potentially life-threatening nature of the sepsis, we were willing to accept a moderate number of false-positive results if the sensitivity of the test could be improved. To study the effects of different cutoff values on the diagnostic performance of the AccuProbe tests, ROC curve analysis was used (1, 23). On the basis of our analysis, the cutoff values for individual AccuProbe tests were adjusted as indicated in Table 2. With these adjustments the performance of the AccuProbe tests, especially that for S. aureus, was significantly improved.
In our hospital, and in Finland generally, the most common blood culture pathogens are Escherichia coli, coagulase-negative staphylococci, S. aureus, S. pneumoniae, and Enterococcus spp. Along with enterococci, S. aureus and coagulase-negative staphylococci are among the causes of blood culture-positive nosocomial infections, the rate of which has increased during the past decade (4, 9). Our ROC analysis-based cutoff value adjustment improved the clinical usability of the S. aureus AccuProbe test, but the test still does not perform as well as the other AccuProbe tests. It may be that the sensitivity of the S. aureus AccuProbe test could be further improved with optimization of sample preparation protocol. A probe capable of identifying E. coli, as well as other gram-negative rods, at the species level would also be highly desirable. The development of such a probe has been hampered by the fact that the target sites are often detected not only in E. coli but also in Shigella spp. and in other enteric bacteria. However, an evaluation of a DNA probe matrix that contains a probe for E. coli has recently been described (11). That particular study examined the use of a Gen-Probe research prototype assay for direct identification of microorganisms from blood. Commercial application of this assay is not yet available.
Overall, as noted in the introduction, relatively few methods for direct identification of bacteria from blood culture broth have been described, and their performance in large-scale routine use has not been reported. Very recently, M. Sogaard et al. (Abstr. 14th Eur. Cong. Clin. Microbiol. Infect. Dis., abstr. O57, 2004) reported the use in a routine setting of a PNA FISH assay, which is now available as a kit. In the future, a study comparing the performances of the AccuProbe and the PNA FISH kit in routine clinical laboratory use would be of great interest.
Munson et al. recently reported that, as far as antimicrobial management is concerned, the most important information provided by the clinical microbiology laboratory is the first telephone call reporting positive blood culture and Gram stain results (13). Their data also demonstrated that release of antimicrobial susceptibility test results had little impact on antimicrobial usage. Since we have optimized the cutoff values for direct identification, on the basis of the high predictive values, we can reliably report these results, i.e., the species of the clinically important gram-positive cocci, at almost the same time (within 1 h) as the Gram stain results. In addition, a statistical antibiotic resistance pattern based on local data can be added to the report for guidance. Such a preliminary resistance pattern is indeed relevant, since the antibiotic resistance of the clinically most important bacteria, such as S. aureus, is still relatively stable in Finland (5, 9). However, the final decision about antimicrobial therapy is always made in conjunction with the use of other laboratory and clinical data.
For a method to be successfully implemented in a routine microbiology laboratory, it should be fast, reliable, cost-effective, and simple to perform. The modified microcentrifuge method takes only
30 min to perform and was easy to adopt in our normal daily routines with only a few positive blood cultures per day. The sample preparation needs no special expertise, and the results are objective since they are measured with a luminometer, which automatically calculates and prints out the test result.
The AccuProbe culture identification test is clearly more expensive than identification by conventional methods. The additional cost per sample consists of reagent costs (ca. 6$ per probe) and labor costs of ca. 30 min per sample (one or more probes). However, considering the clinical significance of blood culture and the timely identification provided by the direct AccuProbe method, the additional cost is justified.
In conclusion, on the basis of the present study we can now offer timely and accurate information to clinicians to assist them in the application of antimicrobial therapy in the early stages of infection.
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. |
|---|---|
| Clin. Vaccine Immunol. | ALL ASM JOURNALS |
|---|