Previous Article | Next Article ![]()
Journal of Clinical Microbiology, June 2008, p. 2028-2037, Vol. 46, No. 6
0095-1137/08/$08.00+0 doi:10.1128/JCM.00818-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Laboratório ALERTA, Universidade Federal de São Paulo, São Paulo, Brazil,1 Laboratório Especial de Microbiologia Clínica, Universidade Federal de São Paulo, São Paulo, Brazil2
Received 17 April 2007/ Returned for modification 22 January 2008/ Accepted 28 February 2008
|
|
|---|
|
|
|---|
Several phenotypic methods based on MBL inhibition by EDTA or thiol-based compounds have been published. Although they are simple to perform and cheaper than genotypic methods, they have shown discordant results depending on the employed methodology, β-lactam substrates, MBL inhibitors (IMBL), and bacterial genus tested (11, 14, 17, 21, 26). In addition, SPM-, GIM-, and SIM-producing pathogens rarely have been evaluated by these studies.
The high diversity and prevalence of MBL-producing P. aeruginosa, Acinetobacter spp., and Enterobacteriaceae isolates have motivated the search for an accurate MBL screening test. The aim of this study was to evaluate the accuracy of the double-disk synergy test (DDST) and the combined disk (CD) assay to screen for MBL-producing isolates among P. aeruginosa, Acinetobacter spp., and selected Enterobacteriaceae isolates that are producers of either IMP, GIM, SIM, SPM, or VIM enzymes.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. MBL-producing isolates and non-MBL-producing isolates used in this study as positive and negative controls, respectively
|
MBL-negative controls. Nineteen non-MBL producers, previously screened for the presence of MBL genes (blaIMP, blaGIM, blaSIM, blaSPM, and blaVIM), were included as negative controls (23). In addition, to exclude the possible presence of other not-yet-described MBL enzymes, the imipenemase activity of cell sonicates from overnight broth cultures were determined by spectrophotometric assays using a BioMate 5 UV-visible spectrophotometer. This experiment was carried out with 150 µM imipenem as the substrate at 299 nm. All selected negative control isolates also showed reduced susceptibility to ceftazidime and/or imipenem and were genetically unrelated by random amplification of polymorphic DNA (data not shown).
IMBL growth inhibition activity. The bacterial growth inhibition initially was evaluated by disk diffusion testing 5 µl of different concentrations of each MBL inhibitor (IMBL) against Pseudomonas aeruginosa ATCC 27853. The IMBLs used were EDTA (Sigma, Steinheim Germany), mercaptopropionic acid (MPA; Sigma); mercaptoacetic acid (MAC; Sigma); mercaptoethanol (MET; Gibco, New York, NY); and phenanthroline (PHEN; Sigma). The tested IMBL concentrations were the following: (i) EDTA, 50, 100, 300, and 500 mM; (ii) MPA, 11.2 (undiluted), 5.6 (1:2), 2.8 (1:4), and 1.4 mM; (iii) MET, 55 (undiluted), 27.5 (1:2), 13.2 (1:4), and 7.0 mM (1:8); (iv) MAC, 14.4 (undiluted), 7.2 (1:2), 3.6 (1:4), 1.2 (1:12); and (v) PHEN, 8, 4, 2, and 1 mM.
Five microliters of the IMBL solution presenting the smallest inhibition zone in the absence of β-lactam agents was selected to perform the DDST. Different amounts of the same solution were employed to perform the CD test, ranging from 2 to 10 µl of each IMBL.
The evaluation of the interference of IMBL itself on the growth of each one of the isolates used in this study also was performed by dropping the same volumes of each IMBL employed for the CD assay on a blank disk. The inhibition zones were measured after overnight incubation at 35°C, and the means of inhibition zones were calculated.
Hydrolysis tests. To assess the β-lactam hydrolysis by each IMBL, the hydrolysis rates of β-lactams were measured with a BioMate 5 UV-visible spectrophotometer. The antimicrobial powder was diluted to obtain 1.8 to 2.0 U of absorbance. Briefly, 100 µl of each selected IMBL solution was added to 900 µl of antimicrobial solution. Experiments were carried out at 299 and 260 nm for imipenem and ceftazidime, respectively.
Phenotypic detection of MBL. (i) DDST. The phenotypic tests were performed by following the CLSI recommendations for the disk diffusion method (9). Briefly, a 0.5 McFarland bacterial suspension was inoculated on a Mueller-Hinton (MH) agar plate (Oxoid, Basingstoke, England). Imipenem and ceftazidime disks were aligned around blank filter disks, which contained 5 µl of the chosen inhibitor solution added directly on the disk and already placed on the MH agar plate. The following distances between the inhibitor and the substrates were tested: 1.0, 1.5, 2.0, 2.5, and 3.0 cm (from center to center). The appearance of either an enhanced or a phantom zone between the antimicrobial agents and the inhibitor disk was considered a positive result and indicative of MBL production. The best substrate, IMBL, and distance between the antimicrobial agent and the IMBL disks to detect MBL producers were selected according to the highest sensitivity (SN) and specificity (SP) results.
(ii) CD assay. For the CD assay, ceftazidime and imipenem disks initially were placed on the inoculated MH plates with a 0.5 McFarland bacterial suspension, and 2, 4, 6, 8, or 10 µl of each inhibitor solution was added directly to the disks (1). The amounts of each IMBL solution added to the disks corresponding to 2-, 4-, 6-, 8-, and 10-µl volumes, respectively, were the following: (i) EDTA, 74, 148, 222, 297, and 370 µg; (ii) MPA, 0.295, 0.592, 0.888, 1.184, and 1.48 µg; (iii) MET, 8.58, 17.16, 25.74, 34.32, and 42.92 µg; (iv) MAC, 0.221, 0.441, 0.662, 0.883, and 1.104 µg; and (v) PHEN, 3.17, 6.34, 9.51, 12.68, and 15.85 µg. After an 18- to 24-h incubation period at 35°C, the increase in the size of the inhibition zone obtained with the CD compared to that of the antimicrobial disk alone was measured. The positive criteria for classifying an isolate as an MBL producer is described below.
Statistical analysis. The inhibition zone (in millimeters) produced by each IMBL alone was measured for each tested concentration, and the differences among means (positive and negative controls) were assessed by the Student's t test.
SN, SP, and positive and negative predictive values (PPV and NPV, respectively) were calculated for the DDST for each β-lactam/IMBL combination for the five distances evaluated: 1.0, 1.5, 2.0, 2.5, and 3.0 cm. PCR results for each MBL were considered the gold standard, and isolates were considered true MBL producers if they were positive for blaIMP, blaGIM, blaSIM, blaSPM, or blaVIM.
SN, SP, PPV, and NPV were calculated with the formulas a/(a + c), d/(b + d), a/(a + b), and d/(c + d), respectively, where a represents the number of isolates correctly identified as MBL producers by the DDST, c is the number of true MBL producers (positive controls) that were incorrectly assigned as non-MBL producers by DDST, d is the number of true isolates that are non-MBL producers (negative controls) that were correctly identified by DDST, and b is the number of isolates that were incorrectly identified as MBL producers.
Results from the CD phenotypic method were characterized by receiver operating characteristic (ROC) curves to choose the best cutoff values for indicating MBL production. For each IMBL, the SN and SP of all five concentrations were calculated successively according to the variation of inhibition zones of MBL-producing and non-MBL-producing isolates. The resulting SN values then were plotted against the corresponding values of 1 – SP, producing an ROC curve. The area under the ROC curve (AUC) and its standard error were calculated, and its statistical significance then was evaluated by the nonparametric method. Differences between variables' AUCs were evaluated through a comparison of the 95% confidence intervals of the corresponding areas.
CD and DDST analyses also were stratified into seven groups according to pathogen species and MBL type produced, as follows: (i) general group, including all isolates tested; (ii) Acinetobacter spp. group; (iii) P. aeruginosa group; (iv) enterobacterial group; (v) IMP-producing isolate group; (vi) VIM-producing isolate group; and (vii) SPM-producing isolate group. For the analysis of the MBL type groups (IMP, VIM, and SPM), all 19 negative controls were included. On the other hand, only negative controls representative of the same genus/species or bacterial family were selected for the pathogen (groups ii to iv) analysis. For example, the analysis of P. aeruginosa included all 28 MBL-producing P. aeruginosa isolates and the 6 non-MBL-producing P. aeruginosa isolates.
The statistical analysis was performed using SPSS 10.0 for Windows and Epi Info (CDC), version 6.04. All reported P values were two sided, and values below 0.05 were considered statistically significant.
|
|
|---|
|
View this table: [in a new window] |
TABLE 2. Inhibition of bacterial growth due to MBL inhibitors
|
Phenotypic MBL detection by DDST. Table 3 shows the results of SN, SP, PPV, and NPV for DDST. According to the statistical analysis, PHEN and MET demonstrated a very poor ability to detect the tested MBL-producing strains, providing SN results for less than 20% of all 46 MBL-producing isolates (data not shown). Surprisingly, four isolates (GIM, IMP-18 [isolate 3489], a VIM-1-producing P. aeruginosa, and an SIM-1-producing Acinetobacter sp.) were categorized as MBL producers by MET, even when the distance between MET and the β-lactam disks was 3.0 cm. Further studies that included an increasing number of SIM- and GIM-producing isolates would be important to confirm the MET capability for MBL phenotypic detection.
|
View this table: [in a new window] |
TABLE 3. MBL detection by DDST: results of SN, SP, PPV, and NPV stratified into seven groups according to pathogen species and MBL type produced
|
![]() View larger version (133K): [in a new window] |
FIG. 1. Phenotypic tests to detect MBL production. (A and B) DDST results using EDTA and MPA as the IMBL for P. aeruginosa and Acinetobacter spp. at a distance of 2.0 cm (center to center) between disks. (A) Imipenem presented the best results for screening for Acinetobacter spp. (B) Ceftazidime increased the test SN for screening for MBL production among P. aeruginosa strains. (C and D) DDST and CD assays performed with a non-MBL-producing K. pneumoniae strain. (C) The DDST yielded an inhibition zone with distortion toward the EDTA disk. (D) The CD assay yielded a negative result.
|
We also selected all IMP-producing Acinetobacter spp. to perform a stratified analysis. Compared to the results for non-MBL-producing Acinetobacter spp., SN and SP results reached 100% using MPA/imipenem at 1.5 and 2.0 cm (data not shown). These results were identical to those for the Acinetobacter sp. group (Table 3).
Phenotypic MBL detection by CD test. All of the CD test results were applied in the construction of ROC curves to establish the best breakpoint (increase in millimeters) for MBL detection. Table 4 shows selected CD results. Since the study's priority was to select a screening test that yielded the lowest number of false-negative results, only SN results greater than 80% were included in Table 4. In analyzing the general group, the CD test resulted in SN values greater than 80% for EDTA/imipenem and EDTA/MPA/ceftazidime. However, SP results varied greatly, from 31.6 to 89.5%.
|
View this table: [in a new window] |
TABLE 4. MBL detection by CD: results of SN, SP, PPV, and NPV stratified into seven groups according to pathogen species and MBL type produced
|
![]() View larger version (15K): [in a new window] |
FIG. 2. ROC curve from different volumes of MPA in combination with imipenem for Acinetobacter spp.
|
![]() View larger version (11K): [in a new window] |
FIG. 3. ROC curve from different volumes of EDTA (A) and MPA (B) in combination with ceftazidime for P. aeruginosa.
|
Among the MBL groups, the combination of ceftazidime associated with EDTA (6 and 8 µl) or MPA (2 to 8 µl) resulted in 100% SN and 100% SP for detecting the SPM-producing isolates (Table 4).
|
|
|---|
Many authors have published distinct phenotypic techniques for screening MBL-producing isolates; however, these studies have important limitations, such as the following: (i) the inclusion of a small number of MBL-producing isolates, sometimes harboring the same type of enzyme (2, 36); (ii) the absence of molecular typing to exclude the influence of a single clone in the interpretation of their results (28); (iii) a lack of tests for evaluating the inhibitory effect of IMBL activity on bacterial growth and β-lactam hydrolysis (2, 11, 26, 34, 37); (iv) no inclusion of SPM- or GIM-producing P. aeruginosa isolates or SIM-producing Acinetobacter spp. isolates (11, 14, 17, 21, 25); (v) a lack of results stratified according to pathogen/species, in which the SN and SP values reflect the overall performance of all isolates (2, 14, 17); and (vi) accurate statistical analysis usually is not carried out to interpret and validate their results (2, 11, 21, 37, 38).
This is the first study to assess the accuracy of phenotypic methods to detect all of the major types of mobile MBLs described (GIM, IMP, SIM, SPM, and VIM) that are produced by diverse bacterial genera with distinct imipenem susceptibility patterns. The inclusion of genetically unrelated strains isolated on three distinct continents suggests that these results would be useful for regions in which such a resistance mechanism is frequent. Depending on the tested concentration, IMBLs may possess their own bactericidal activity, which may result in expanded inhibition zones not associated with true MBL production (8). This finding may lead to the false-positive detection of MBL by both CD assay and DDST, and it has been considered a disadvantage to employ EDTA and MPA as IMBL (16). To exclude the effect of such interference on the phenotypic detection of MBL, we have tested the activity of distinct dilutions of IMBL with respect to the growth of P. aeruginosa ATCC 27853. In addition, the influence of IMBL inhibitory activity on the substrate was taken into consideration in the analysis of SN and SP results for screening MBL-producing isolates. False-negative results might arise from the imipenem hydrolysis caused by thiol derivatives (14). Many studies have performed phenotypic MBL detection using Pseudomonas spp., Acinetobacter spp., and/or enterobacterial isolates, but some of them did not present SP and SN results stratified by pathogen/species, reflecting the global performance of all isolates and not for a specific pathogen (11). Other studies did stratify according to species, but it is not clear if only negative controls from the same pathogen/species were included to calculate SN and SP results (21, 37). This is a very important issue that must be taken into consideration when selecting an MBL phenotypic test, as in this study we have observed different SP and SN values according to the group analyzed. Moreover, a rigorous statistical analysis of our data was performed.
In this study, PHEN and MET showed poor results for detecting MBL producers under the tested conditions. The IMBL derivatives of thiol compounds may possess anionic, cationic, or neutral functional groups at neutral pH. MAC and MPA are classified in the anionic group, while MET belongs to the neutral group. Siemann et al. have shown that the inhibition of MBL activity by the anionic IMBL starts immediately. In contrast, neutral IMBLs have a pronounced lag prior to the start of inhibitory activity; i.e., the best inhibitory results are achieved after preincubating the IMBL with MBL before adding the substrate. In this manner, the weakest activity of MET in this study could be explained by the absence of the preincubation step in the performance of the phenotypic detection (28).
The standardization of a phenotypic method to screen MBL-producing isolates is of crucial importance (10). Most previous studies that evaluated MBL phenotypic detection were performed under distinct experimental conditions, jeopardizing the comparison of their results to those of others (2, 11, 14, 15, 21, 25, 26). The sizes of inhibition zones produced by β-lactam/IMBL combinations may vary according to the way that the IMBL is incorporated into the β-lactam disks (1). Since the selection of an appropriate breakpoint for screening MBL-producing isolates is directly influenced by the size of the inhibition zone, the methodology used for preparing the CDs should always be described in such phenotypic reports. In the current study, we have added the IMBL solutions directly on β-lactam disks already placed on the agar plate (1), while some authors previously prepare and freeze IMBL/β-lactams disks; thus, the results of our CD assay may be comparable to those of other studies that use the same methodology.
In addition, a number of authors also have raised concerns about the influence of the bactericidal effect of IMBL alone, claiming that it could not be distinguished from the antimicrobial effect of β-lactam/IMBL (2, 8, 14, 16). Fortunately, we have addressed this issue, since we have documented that the best SN and SP results for CD assays were achieved by establishing breakpoints that were greater than the mean sizes of the inhibition zones produced by all of the IMBL themselves. When choosing the best MPA volume, we should take into consideration the inhibitory effect of MPA itself on the bacterial growth. According to Table 2, the mean increase in the size of the of the inhibition zone caused by MPA itself (excluding the diameter of the blank disk [6 mm]) varied from 1.3 (2 µl) to 12.4 mm (10 µl). We recommend the addition of 2 µl of MPA to the ceftazidime disk, since this volume produced a significant increase in the size of the inhibition zone (13 mm) while exerting the minimal amount of inhibitory effect of MPA itself during the bacterial growth when testing SPM-producing isolates.
A ROC curve consists of a graph containing the relationship between the SN and SP of a test, which are calculated for all possible cutoff values. Thus, in this case, each curve plots the true-positive rate against the false-positive rate for each volume of the IMBL/β-lactam combinations. Since the ROC graph is a result of SN versus 1 – SP, the most accurate test to discriminate between MBL- and non-MBL-producing isolates would pass through the upper left corner of the graph. On the other hand, the closer the curve comes to the 45-degree diagonal, the less accurate is the test. Additionally, the AUC is a measure of the test's accuracy and is useful for comparing different tests. For example, an area of 1 represents an ideal test (SN and SP of 100%), while an area of 0.5 reflects poor SN and SP results (20). The greatest advantage of using ROC curves in this case was the possibility of visualizing a wide range of breakpoints for each IMBL/β-lactam combination by the CD test. In studies of different IMBL, many authors do not consider testing a wide range of breakpoints. SN and SP results usually are calculated only for a narrow range of breakpoints that are chosen randomly or according to previously published results (38). Moreover, many studies have established the best breakpoints only by observing inhibition zones produced by the IMBL/β-lactam (11, 38). Thus, SN and SP values of all possible and different breakpoints may not be presented and are not known by the readers. In our study, a wide range of results were documented and chosen based on ROC curve results, ranging from 3 (for Enterobacteriaceae/imipenem/EDTA) to 18 mm (for SPM/MPA/ceftazidime). If we had tested only the breakpoint of 7 mm, for example, we would have obtained less accurate results for enterobacterial isolates (SN of 71.4% instead of 100%) and SPM-producing isolates (SP of 31.6% instead of 100%). Since higher SP results can be obtained only by jeopardizing SN values, researchers should always consider their main objective when selecting a screening method to detect MBLs. However, due to the possible clinical implications of false-negative MBL results, microbiology laboratories should always favor the selection of more sensitive methods.
As summarized in Table 5, our results show that the DDST was the most accurate phenotypic test to detect MBL production in P. aeruginosa and Acinetobacter spp. when 1.4 mM MPA was used as the IMBL and was positioned 2 cm from the β-lactam disk. However, the choice of the best substrate depended upon the bacterial species tested: ceftazidime and imipenem for P. aeruginosa and Acinetobacter spp., respectively. By the CD assay, no breakpoint achieved 100% SN and SP for the nonfermenting gram-negative bacilli. In contrast, among the enterobacterial isolates, the CD test showed identical results (100% SN, 100% SP, and an AUC of 1) for different EDTA volumes combined with imipenem. Thus, we suggest that 10 µl of 100 mM EDTA applied to the imipenem disk is a good option to discriminate MBL-producing isolates, since it produced the largest increase in the size of the inhibition zone (5 mm). Due to the paucity of MBL-producing Enterobacteriaceae, only seven positive controls were included, and we believe that further studies that evaluate an increased number of MBL isolates are needed to corroborate our results.
|
View this table: [in a new window] |
TABLE 5. Optimal conditions described in this study to perform phenotypic detection of MBL production among P. aeruginosa, Acinetobacter spp., and Enterobacteriaceae clinical isolates
|
We believe that the interpretation of DDST results is more subjective than those of the CD assay (37), because the DDST depends upon the technician's expertise to discriminate true synergism from the intersection of inhibition zones. However, the CD assay did not show a good performance for screening MBL-producing Acinetobacter spp.
The DDST is simple to perform and can be incorporated into the existing workflow of clinical microbiology laboratories that routinely employ disk diffusion as their preferential antimicrobial susceptibility testing method. An MPA disk could be easily placed at 2 cm from the imipenem or ceftazidime disk during the performance of antimicrobial susceptibility testing after the identification of Acinetobacter spp. and Pseudomonas aeruginosa isolates. In our opinion, the detection of MBL-producing isolates is of crucial importance not only for institutions with a high prevalence of such isolates but also in those in which the phenotype of resistance has never been detected. In a scenario of a high frequency of MBL-producing isolates, the detection of such strains would be important for the adjustment of empirical antimicrobial therapy and, probably, the reduction of mortality rates for patients infected with MBL-producing isolates. The early detection of MBL-producing isolates in institutions in which these strains have never been detected would be important to avoid the intrahospital dissemination of such strains, since most of the MBL-encoding genes reside on class 1 integrons and/or plasmids that usually confer high mobility to these genetic elements. However, clinical microbiology laboratories that usually perform susceptibility testing by using automated systems would have an increase in their work burden if an additional test was implemented for the detection of this phenotype of resistance. In this manner, the screening of MBL-producing isolates should be an individual decision best made by each clinical laboratory in consultation with the infectious disease practitioners and infection control committees.
It is desirable that the selection of the appropriate MBL tests to be performed is based upon studies providing SN and SP results for that specific pathogen. Thus, we suggest that the selection of the best MBL screening method should be based on the isolated species, the local prevalence of MBL producers, and the ability of specialized technicians to correctly interpret MBL inhibition.
The study was financially supported by Fundação de Amparo à Pesquisa do Estado de São Paulo (FAPESP; process number 2006/07197-0). A.C.G. is a researcher of CNPq (Conselho Nacional de Desenvolvimento Científico e Tecnológico; process number 307714/2006-3), Brasília, Brazil.
Published ahead of print on 5 March 2008. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»