Previous Article | Next Article ![]()
Journal of Clinical Microbiology, May 2003, p. 1951-1956, Vol. 41, No. 5
0095-1137/03/$08.00+0 DOI: 10.1128/JCM.41.5.1951-1956.2003
Copyright © 2003, American Society for Microbiology. All Rights Reserved.
Department of Laboratory Medicine, Lahey Clinic Medical Center, Burlington, Massachusetts 01805
Received 15 November 2002/ Returned for modification 3 January 2003/ Accepted 27 January 2003
|
|
|---|
|
|
|---|
In this era of increasing antimicrobial resistance, a comprehensive comparison of ARIS-Sensititre to other widely accepted systems is apropos. The prospective, controlled study described here compared automated reading of susceptibility plates with ARIS-Sensititre and the WalkAway system-MicroScan plates (WalkAway-MicroScan) and was conducted as part of an in-house validation of the ARIS-Sensititre automated AST system in the clinical microbiology laboratory of a 250-bed, suburban teaching hospital.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Isolates tested
|
|
View this table: [in a new window] |
TABLE 2. Antimicrobials and ranges evaluated
|
ARIS-specific quality control. The reproducibilities of the ARIS interpretations were assessed by performing a second automated reading of 30 plates immediately following the initial reading. The two readings were compared to determine whether the plates were being read consistently. Furthermore, the time that had elapsed between plate loading and reading was measured for 54 plates to assess the reliability of the instrument in reading the plates 18 h after they were loaded.
WalkAway system setup. The Prompt Inoculation System-D was used to prepare inocula from several well-isolated colonies. As instructed by the package insert, three colonies were touched with the Prompt system wand, and the wand was subsequently placed into 30 ml of Prompt system diluent and the contents were mixed. Dried plates (PC10 and NUMIC10 plates for gram-positive and gram-negative organisms, respectively) were dosed with a RENOK handheld inoculator. The plates were read at 18 to 24 h by the WalkAway system linked to a computer with Data Management System software (version 22.28).
ARIS setup. Several isolated colonies were used to prepare a suspension equivalent to a 0.5 McFarland standard by using the Sensititre nephelometer. A disposable 10-µl calibrated loop was used to aseptically transfer the suspension into 10 ml of Sensititre cation-adjusted Mueller-Hinton broth. Custom-formatted Sensititre plates (CMC2BLAF and CMC1ALAF plates for gram-positive and gram-negative organisms, respectively) were inoculated by using the AutoInoculator, an automated robotics-driven dosing platform that delivers 50 µl of broth to each well. The plates were read at 18 to 24 h by ARIS linked to a computer running Sensititre Automated Microbiology System software (version 2.4).
Data analysis. Susceptibility results were analyzed for essential (within ±1 twofold dilution) and categorical (sensitive, intermediate, or resistant) agreement according to NCCLS guidelines. The results obtained with ARIS (the test system) were compared to those obtained with the WalkAway system (the in-house system). Only antimicrobial-organism combinations suggested by NCCLS as appropriate for routine use and reporting were evaluated (11). Essential agreement was defined as an MIC within ±1 twofold dilution with both systems. Categorical errors were classified as one of three types: minor (an intermediate versus a susceptible or resistant result), major (ARIS, resistant result; WalkAway system, susceptible result [falsely resistant]), or very major (ARIS, susceptible result; WalkAway system, resistant result [falsely susceptible]). Minor errors that were within essential agreement (plus or minus one well) were not tallied as errors. Therefore, if an MIC of 8 µg/ml, equaling a sensitive interpretation, was obtained with one system and an MIC of 16 µg/ml, equaling an intermediate interpretation, was obtained with the other system, the results were considered within essential agreement and no error was tallied. This study did not look at discrete (as opposed to off-scale [less than the lowest concentration or more than the highest concentration]) MICs because the MICs for isolates encountered in routine testing at this facility are discrete relatively rarely; however, further investigation of this system with a challenge set of organisms for which MICs are capable of being discrete is warranted.
An independent-samples t test was used to compare MicroScan and Sensititre plate inoculum densities. The mean inoculum density for each system was compared to the NCCLS range by a one-sample t test. All statistical analyses were performed with the standard version of SPSS for Windows (release 9.0.0; SPSS, Inc., Chicago, Ill.).
Discrepant results. Plates yielding major or very major errors were read manually by using the touchSCAN-SR (MicroScan) or the SensiTouch (Sensititre) system to corroborate the instrument readings. If major or very major errors were not resolved, the isolate was retested with both systems. The results were reevaluated, and any major or very major errors that did not resolve were arbitrated by the NCCLS M7-A5 frozen reference microdilution method (TREK Diagnostic Systems). Discrepancy analysis was performed by Lab Services at TREK Diagnostic Systems, and the previous susceptibility testing results were unknown to the individuals performing the testing. Following discrepancy analysis, all results were recalculated for major and very major error rates by using as the denominator the total number of antimicrobial-organism combinations susceptible with the WalkAway system and resistant with the WalkAway system, respectively, while minor error rates used the total number of antimicrobial-organism combinations as the denominator.
|
|
|---|
For 231 gram-negative isolates (3,111 antimicrobial-organism combinations), essential agreement was 95.8% between ARIS and the WalkAway system. Following discrepancy analysis, ARIS yielded the following categorical errors: 41 (1.3%) minor errors, 0 (0%) major errors, and 3 (0.4%) very major errors (Table 3). For 95 gram-positive isolates (758 antimicrobial-organism combinations), essential agreement was 93.5%. Following discrepancy analysis, ARIS yielded the following categorical errors: 7 (0.9%) minor errors, 3 (0.6%) major errors, and 1 (0.4%) very major error (Table 3).
|
View this table: [in a new window] |
TABLE 3. Performance of Sensititre compared to MicroScan after discrepancy analysisa
|
|
View this table: [in a new window] |
TABLE 4. Discrepancy analysis performed for isolates with major and very major errors after retesting with NCCLS M7-A5 standard reference panelsa
|
The acceptable range for the final inoculum density according to NCCLS guidelines outlined for the M7-A5 method (10) is 3 x 105 to 7 x 105 CFU/ml. Final inoculum densities, as calculated from the colony counts for 50 consecutive inocula of E. coli ATCC 25922, showed a mean inoculum density of 4.0 x 105 CFU/ml for the Sensititre system and a mean inoculum density of 3.3 x 106 CFU/ml for the MicroScan Prompt system (Fig. 1). The mean inoculum density for the MicroScan Prompt system was significantly higher (P < 0.0001) than that for the Sensititre system. The MicroScan Prompt system yielded colony counts higher than the NCCLS range for 48 of 50 replicates. While the mean colony count for ARIS was within the NCCLS range, 23 of 50 replicates yielded colony counts outside the NCCLS range (15 below the range and 8 above the range). The MicroScan Prompt system yielded a mean inoculum density significantly higher (P < 0.0001) than the NCCLS range, while the Sensititre system yielded a mean inoculum density that did not vary significantly (P = 0.392) from the NCCLS range.
![]() View larger version (23K): [in a new window] |
FIG. 1. Inoculum densities for Sensititre and MicroScan plates.
|
|
|
|---|
3% (given that
35 antimicrobial-resistant organism combinations were evaluated), and the rate for the combination of minor and major errors must not exceed 7%. ARIS-Sensititre met each criterion. The errors obtained with ARIS and the WalkAway system following discrepancy analysis were generally varied, with no major consistent problems with the antimicrobial-organism combinations tested except in three instances. For ARIS-Sensititre, false resistance to tetracycline involving three Enterococcus spp. represented 6% of susceptible results. The manufacturer has since modified one of the parameters in the algorithm for the reading of tetracycline susceptibility, but this does not affect the algorithms for the reading of susceptibilities to any of the other antimicrobials in the system. The in-house data from the manufacturer (R. Grist, TREK Diagnostic Systems, personal communication) for 105 Enterococcus isolates shows that this change eliminated false resistance errors. Problem antimicrobial-organism combinations for the WalkAway system included cefazolin with both gram-positive and gram-negative isolates and piperacillin with gram-negative isolates. With cefazolin, these were three major errors (one gram-positive isolate and two gram-negative isolates) and one very major error (a gram-positive isolate). Piperacillin yielded four major errors and one very major error with different gram-negative species.
The results of discrepancy testing exclusively favored ARIS 2:1 over the WalkAway system. In these cases, previous major or very major errors with ARIS were either resolved or changed from major to minor errors. These results suggest that the results obtained with Sensititre plates may possibly be more accurate since an increased correlation with the results of the NCCLS reference method occurs. One explanation for the difference in the agreement between the MICs obtained with the two systems and the MIC obtained by the reference method is the different methods of inoculum preparation, since some antimicrobial-organism combinations have been shown to yield false resistance if the final inoculum density is higher than recommended (2). The WalkAway system with MicroScan plates and the Prompt inoculation system yielded a mean inoculum density of 3.3 x 106 CFU/ml. This phenomenon has been described previously (9) with mean Prompt system inoculum densities of >105 CFU/ml and some antimicrobial-organism combinations, resulting in <95% essential agreement with reference MICs. While it has been suggested that inoculum density can vary over 1 log10 range without affecting most MIC results (1), further investigation into this area is warranted, given the consistency of the results in this study.
Automated AST systems vary in their performance parameters and mechanics. Evaluation of a system that has not been described previously allowed a reevaluation of the automated system used in our laboratory, the WalkAway system with MicroScan plates. The attributes of WalkAway-MicroScan include setup with the Prompt inoculation system and the RENOK inoculator, which require minimal technician time and bench space. Combination identification and susceptibility testing plates can limit testing to one plate. The chromogenic substrates and turbidity used for identification and susceptibility testing, respectively, allow the plates to be interpreted manually. The instrument has two options for plate capacity; that is, it can use either 40- or 96-plate units. In addition, the instrument offers Windows-based software that streamlines the use of WalkAway-MicroScan. The deficiencies of WalkAway-MicroScan to be considered include daily monitoring and replenishment of colorimetric substrates for identification plates, and the addition of water is necessary to maintain moisture levels. The Prompt system yields colony counts higher than the range recommended by the NCCLS. The seed trays used with the RENOK inoculator are prone to leakage, and the RENOK inoculator can inoculate only one organism per plate. The MicroScan system does not offer custom-formatted plates, and fewer Food and Drug Administration-approved antimicrobials are available on the plates for patient isolate testing. Compared to ARIS, the WalkAway system generates chemical waste and 62% more biohazardous waste (157 g/test for the WalkAway system versus 97 g/test for ARIS).
The attributes of ARIS-Sensititre include the initial standardization of the inoculation broth, as recommended by the NCCLS, and the use of a closed system for inoculation, which minimizes aerosols and the chance for contamination. ARIS requires only yearly calibration. Sensititre offers the largest selection of Food and Drug Administration-approved antimicrobials for AST plates and custom plates in lot sizes as small as 500, which allow frequent changes and testing of the antimicrobials that actually exist in individual hospital formularies. Deficiencies to consider include the use of the Sensititre inoculator, which is instrument based and which requires more time and bench space than the RENOK inoculator. Identification results cannot be interpreted manually. ARIS is available only with a 64-plate capacity. Windows-based software was still in development at the time of submission of this report and is critical for improved laboratory work flow.
Both ARIS-Sensititre and WalkAway-MicroScan performed adequately in supplying AST results. Subsequent to this comparison, ARIS-Sensititre was placed in the clinical laboratory. The substantial issues involved in making this decision were the fact that ARIS-Sensititre susceptibility results agreed with the results of the reference test more frequently than the results of WalkAway-MicroScan did for those isolates subjected to discrepancy testing, the fact that ARIS-Sensititre is able to alter the antimicrobials on susceptibility plates frequently to match the agents in the hospital formulary, and the fact that ARIS-Sensititre generates fewer chemical and biohazardous wastes. Upgraded software, which is in development, is required for the system to be compatible with high-volume use and work flow in the clinical laboratory. Once the upgraded software is available, ARIS-Sensititre will provide a necessary option for automated AST in the clinical laboratory.
This study was supported in part by TREK Diagnostic Systems and was also funded by the Robert E. Wise, MD, Research and Education Institute, Lahey Clinic.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»