Previous Article | Next Article ![]()
Journal of Clinical Microbiology, September 2002, p. 3269-3276, Vol. 40, No. 9
0095-1137/02/$04.00+0 DOI: 10.1128/JCM.40.9.3269-3276.2002
Copyright © 2002, American Society for Microbiology. All Rights Reserved.
Department of Pathology, Case Western Reserve University,1 Department of Epidemiology and Biostatistics, Case Western Reserve University School of Medicine, and Center for Quality Improvement Research, Louis Stokes Cleveland Department of Veterans Affairs Medical Center, Cleveland,5 Laboratory Specialists, Westlake, Ohio,4 Department of Pathology, Hershey Medical Center, Hershey, Pennsylvania,2 GR Micro, London, United Kingdom3
Received 16 October 2001/ Returned for modification 7 December 2001/ Accepted 17 June 2002
|
|
|---|
|
|
|---|
Considerable variation in the resistance rates of various agents against H. influenzae has been reported (8, 9, 12). For example, the resistance rates for amoxicillin-clavulanate varied from 0% in a large international study of 2,718 strains (9) to 4.5% in a U.S. study of 1,539 strains (8). Similarly, the resistance rates for cefuroxime varied from 3.2 to 6.4%. Although these resistance rates are low and differences between studies are not very large, the susceptible breakpoint for these agents (
4 µg/ml) is close to the MICs of these agents at which 90% of the isolates tested are inhibited (MIC90s) (1 to 8 µg/ml), and normal population distributions could account for some MICs being in the resistant range (12).
This study examined the effects of various media on the susceptibility of this species to a wide range of antimicrobial agents, using media that would be acceptable in a large number of countries. The results are compared with those of the reference NCCLS method using Haemophilus test medium (HTM) in frozen microdilution trays (16, 17).
|
|
|---|
Antimicrobial agents. A total of 21 antimicrobial agents were tested, consisting of 9 ß-lactam agents (ampicillin, amoxicillin, amoxicillin-clavulanic acid, ceftriaxone, cefuroxime, cefaclor, cefixime, cefprozil, and cefdinir), 3 macrolide agents (azithromycin, clarithromycin, and erythromycin), 6 fluoroquinolone agents (ciprofloxacin, gemifloxacin, grepafloxacin, levofloxacin, ofloxacin and trovafloxacin), chloramphenicol, doxycycline, and trimethoprim-sulfamethoxazole.
MIC methods. All strains were tested with frozen trays utilizing the NCCLS broth microdilution method (15) with in-house-prepared HTM (frozen MH HTM [see below]) and with dried commercial MIC trays (Trek Diagnostics, Westlake, Ohio) rehydrated with five different media. Three different testing sites participated in the study. Frozen MH HTM was tested at Case Western Reserve University, Cleveland, Ohio, while the dried commercial trays were tested at all three sites. For the dried commercial trays, all of the sites used the same batch of in-house HTM (MH HTM), which was prepared by the investigators at Case Western Reserve University using Mueller-Hinton broth base (Difco), 0.5% yeast extract (Difco), 15 µg of NAD per ml, and 15 µg of hematin (Sigma) per ml. Case Western Reserve University (site 1) and M. S. Hershey Medical Center, Hershey, Pa. (site 2) also tested the strains with Mueller-Hinton broth (Trek Diagnostics) supplemented with 2% lysed horse blood (Cleveland Scientific, Bath, Ohio) and 15 µg of NAD/ml (MH LHB NAD). In addition, site 1 tested the strains with a commercial formulation of HTM broth (PML, Tualatin, Oreg.) (PML HTM). GR Micro, London, United Kingdom (site 3) also used IsoSensitest Broth (Oxoid Ltd., Basingstoke, United Kingdom) supplemented with 2% lysed horse blood (TCS Microbiology, Botolph Claydon, United Kingdom) and 15 µg of NAD (Sigma-Aldrich UK Ltd., Poole, United Kingdom)/ml (IST LHB NAD) and IsoSensitest broth-based HTM (IsoSensitest broth supplemented with 15 µg of NAD per ml, 0.5% yeast extract [Oxoid Ltd.], and 15 µg of hematin [Oxoid Ltd.] per ml) (IST HTM).
Inoculum checks were performed on all strains, and quality control strains (H. influenzae ATCC 49247 and 49766 and Escherichia coli ATCC 35218) were included in each testing run. The results were accepted if inocula were in the range of 3 x 105 to 7 x 105 CFU/ml and the MICs for the quality control strains were within published limits (17).
Data analysis. Geometric mean MICs, MIC50s, MIC90s, and standard deviations for each method, based on the doubling-dilution (i.e., log2) values, were determined for antimicrobial agents with unimodal distributions and on-scale endpoints for >90% of the strains. Ampicillin, amoxicillin, and trimethoprim-sulfamethoxazole means were not calculated because of bimodal distributions. Results for all methods were compared to the results for frozen MH HTM, and doubling-dilution differences were calculated. Susceptibility rates were calculated based on both NCCLS (17) and pharmacokinetic-pharmacodynamic (PK-PD) breakpoints (4, 5, 18, 21). The PK-PD breakpoints were based on standard dosing regimens and criteria appropriate to each agent. For ß-lactams, erythromycin, and clarithromycin, these breakpoints were based on drug concentrations in serum present for 40 to 50% of the dosing interval, while for azithromycin, fluoroquinolones, and doxycycline, they were based on 24-h area under the concentration-time curve/MIC ratios exceeding 25 (5, 18). For trimethoprim-sulfamethoxazole, the NCCLS breakpoint was used, as the PK-PD breakpoint was not available and the NCCLS breakpoint had been validated in bacteriologic outcome otitis media studies (6).
The data were also analyzed statistically using several approaches, with the frozen MH HTM as the reference method where applicable. First, the data were examined with generalized estimating equations (25) (GEE) (SAS, Cary, N.C.), a method of multiple regression analysis of the entire data set, which was used to assess overall differences between test sites and methods. GEE methodology was chosen because it could handle the lack of independence among the observations caused by the same isolates being analyzed multiple times. In effect, each isolate created a family of related observations. Since there will be more variability in MICs across isolates than across methods for a particular isolate, it is important to use analysis methods that recognize the relationship of the observations. The GEE methodology can be used to simultaneously examine the effects of method and sites, obtaining an estimated regression coefficient for each individual effect variable. Since all the effects were categorical variables, each effect would be measured as a difference from a reference method and site.
Second, sequential paired t tests were performed to compare data sets, using the frozen MH HTM as the reference method. This analysis was repeated using the site 1 MH HTM as the standard. Since the MH HTM was prepared at site 1 and distributed to each of the other testing sites, it provided a standard for measuring both methodological and within-site differences. Consequently, paired-t-test analysis was also used to examine within-laboratory differences using each site's MH HTM results as the reference method. To account for potential type 1 error resulting from the multiple t tests employed, a Bonferroni correction was used, requiring a critical P value of <0.0003 for statistical significance.
Third, the data were examined for overall mean population differences using the t distribution, since the test sample population MICs were normally distributed with similar variances. While this method is not appropriate for testing dependent data, it was thought to provide some useful information, since population mean data are used in microbial surveillance studies and repeated testing of the same sample would be expected to regress to the mean. The laboratory methods examined in this study are those that would likely be used in large-scale surveillance. The critical value used for this testing was that corresponding to a P value of <0.0003.
The robustness of some of the statistical differences found was tested by adjusting the data by ±0.25-, 0.5-, 0.75-, and 1-doubling-dilution differences. Since a one-doubling-dilution difference is considered an acceptable level of sample reproducibility in MIC testing, this analysis was performed to determine whether adjusting the data incrementally within the one-dilution range would effect statistical significance (9).
The percentages of MICs within one and two dilutions of the frozen reference values were calculated. The differences between sites and methods were examined by the binomial test for proportions for both one- and two-dilution differences. The differences in agreement with the frozen reference values were examined directly for each site-method combination, as well as for methods within each site, with the site-specific MH HTM difference from frozen reference values used as the baseline for these comparisons.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Geometric mean MICs and standard deviations (doubling dilutions) for each method for agents with unimodal populations and >90% of endpoints on scale
|
|
View this table: [in a new window] |
TABLE 2. GEE results; estimated regression coefficients and statistical values of significance for comparison to standard
|
Less variation in mean MICs was found for all methods for amoxicillin-clavulanic acid (0.7 to 1.2 µg/ml), which was one of the most reproducible agents tested, than for cefprozil (2.7 to 9.5 µg/ml), which was one of the least reproducible agents tested. Less variation in ranges of mean ± 2 standard error values (approximate 95% confidence limits) was also noted for amoxicillin-clavulanic acid (approximately 1.5 doubling dilutions) than for cefprozil (approximately 2.5 doubling dilutions). Figure 1 provides a graphical example of these better and worse degrees of agreement, with confidence intervals included. Despite the differences in ranges of variation, the patterns of variability are strikingly similar. In addition, it is possible to see more clearly the similarities within sites and the differences among them.
![]() View larger version (26K): [in a new window] |
FIG. 1. Geometric mean MICs and upper and lower limits of 95% confidence limits (bars) for amoxicillin-clavulanic acid and cefprozil. Much less variation in mean MICs was found for amoxicillin-clavulanic acid ranges (0.7 to 1.4 µg/ml) for all methods and sites than for cefprozil (2.0 to 9.5 µg/ml). However, similar variations in the ranges of 95% confidence limits were noted for amoxicillin-clavulanate and cefprozil.
|
Overall, the results for different media were comparable within each testing laboratory. The results for site 2 and site 3 were slightly lower overall than those for site 1.
GEE methodology examined the effects of testing sites and methods compared to the baseline of site 1 MH HTM, providing an estimated regression coefficient for each individual effect variable. This coefficient, stated as the number of doubling dilutions from the baseline, describes the degree of shift from the baseline caused by the specified variable. These coefficients and the statistical significances of the differences are summarized in Table 2. Site 2 and PML HTM were both significant contributors to differences seen with cefaclor and cefprozil, with shifts in MICs of greater than one doubling dilution for both drugs. The site 2 coefficient was greater than one dilution lower than the frozen standard for both drugs, while the PML HTM coefficient shifted the MICs greater than one dilution higher than the standard for both drugs. The quinolones (except for gemifloxacin and ciprofloxacin) and macrolides (except for clarithromycin) were also shifted nearly one dilution lower with the MH HTM than with the frozen medium. Statistically significant (P < 0.05) differences of ±0.25 dilutions are indicated in the table.
Table 3 summarizes the paired t test findings from the comparison within sites, using the MH HTM values as a baseline. Within site 1, the PML HTM medium was highly statistically different for azithromycin and also significantly different for cefprozil, chloramphenicol, clarithromycin, erythromycin, and gemifloxacin. The MH LHB medium was highly different for gemifloxacin and grepafloxacin and significantly different for cefaclor, clarithromycin, and trovafloxacin. Within site 2, MH LHB NAD was in good statistical agreement with MH HTM only for levofloxacin. Agreement for ceftriaxone and clarithromycin were borderline not significant, and that for ofloxacin and doxycycline was close to the level of statistical significance with the Bonferroni correction. All other agents were significantly or highly significantly different between the two methods used at site 2. Site 3 IST HTM was highly significantly different from MH HTM for the quinolones, doxycycline, and ciprofloxacin and significantly different for amoxicillin-clavulanic acid. All other agents tested with IST HTM at site 3 were not significantly different from the baseline. The site 3 IST LHB showed significance for only doxycycline, ofloxacin, levofloxacin, and cefdinir compared to MH HTM.
|
View this table: [in a new window] |
TABLE 3. Paired t test P value results within sites, with results of MH HTM for each site as standard
|
|
View this table: [in a new window] |
TABLE 4. Paired t test P value results of MH HTM results between sites
|
|
View this table: [in a new window] |
TABLE 5. Paired t test P value results for LHB-supplemented media
|
The MIC adjustments done on azithromycin, erythromycin, grepafloxacin, levofloxacin, ofloxacin, and trovafloxacin to test for the robustness of the statistical differences required no more than a one-doubling-dilution adjustment to change from a very high degree of statistical significance to none (data not shown). The MIC distributions of these drugs also show a left shift in the normally distributed curve of approximately one doubling dilution.
Table 6 summarizes the percentage of MICs found to be within one and two dilutions of the frozen standard. Many statistically significant differences were found when the site-method combinations were compared to the MH HTM site 1 baseline. When comparisons were made within each laboratory, using the site-specific MH HTM difference from the frozen standard as a baseline, fewer significant differences were seen. At site 1, only 4 of the 19 antimicrobial agents tested with PML HTM brothazithromycin, erythromycin, gemifloxacin, and trovafloxicinwere statistically different from the baseline at one dilution difference of agreement. At agreement to two dilutions difference, only amoxicillin and azithromycin were significantly different from the baseline for PML HTM. At site 2, there were a larger number of drugs that did not agree to within one or two dilutions difference for the two methods tested.
|
View this table: [in a new window] |
TABLE 6. Percentages of MICs within one or two dilutions from reference method based on test site and medium
|
|
|
|---|
|
View this table: [in a new window] |
TABLE 7. MIC50 and MIC90 for each method
|
|
View this table: [in a new window] |
TABLE 8. Ranges and mean percentages of susceptible isolates for all methods based on NCCLS and PK-PD breakpoints
|
A necessary consideration when examining data with a permissible range of reproducibility difference statistically is at what point a conventionally significant result is scientifically meaningful. MIC tests are generally regarded as being in agreement when they are reproducible within one doubling dilution, while for statistical tests, such a difference is generally considered highly significant; there is consequently an inherent tension between what is statistically significant and what is scientifically significant. For the purposes of this study, a shift of 0.25-doubling-dilution difference was regarded as representing a scientifically noteworthy methodological or site bias.
There appears to be a greater degree of difference between testing sites than among methods within one site. Sites 1 and 3, for the most part, had good reproducibility across methods, while site 2 showed more variability. This is especially apparent when looking at the GEE results, where site 2 is more frequently a contributor of significant difference than the other two sites. Site 2 shows a consistent bias in the negative direction, suggesting that the MICs for all drugs tested at that site would be consistently lower than those found at the other sites. Examination of method-specific differences shows only PML HTM to be a significant contributor of difference. In contrast to the site 2 bias, that seen with this medium is in the positive direction. MICs with PML HTM broth would be expected to be higher than those found with the other methods.
Examination of the MICs of many of the antimicrobial agents tested by paired t test remained consistent across both methods and testing sites. The quinolones, while very statistically different in the comparison between MH HTM and the frozen standard, did not differ much in the between-site analysis, the GEE analysis, or when tested as population means. Because these drugs are active at very low concentrations, a difference of one dilution is much less important than for drugs with activity at higher concentrations and therefore closer to or crossing breakpoints.
The data adjustment to test robustness and the resulting loss of statistical significance reinforced the data summarized in Table 6, showing that the groups, while statistically different from each other, largely agree within the acceptable range of differences for antimicrobial MIC testing of 95% within one doubling dilution (25). The results of these tests, as well as the examination of differences in group means, suggest that there is a systematic shift of less than one dilution difference in several of the drugs. While this is within the acceptable range for reproducibility, it could be problematic if the shift occurs at or near a breakpoint.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»