Skip to main page content

• HOME
• Current Issue
• Archive
• Alerts
• About ASM
• Contact us
• Tech Support
• Journals.ASM.org

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Reprints and Permissions Copyright Information Books from ASM Press MicrobeWorld Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Rennie, R. P. Articles by Krilcich, A. Search for Related Content PubMed PubMed Citation Articles by Rennie, R. P. Articles by Krilcich, A.

 Previous Article  |  Next Article 

Journal of Clinical Microbiology, August 2008, p. 2681-2685, Vol. 46, No. 8
0095-1137/08/$08.00+0     doi:10.1128/JCM.00449-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

Multicenter Evaluation of the New Vitek 2 Neisseria-Haemophilus Identification Card

Robert P. Rennie,^1* Cheryl Brosnikoff,¹ Sandy Shokoples,¹ L. Barth Reller,² Stanley Mirrett,² William Janda,³ Kathy Ristow,³ and Ann Krilcich³

Medical Microbiology Laboratory, University of Alberta Hospital, Edmonton, AB, Canada,¹ Clinical Microbiology Laboratory, Duke University Hospital, Durham, North Carolina,² University of Illinois Medical Center, Chicago, Illinois³

Received 6 March 2008/ Returned for modification 16 June 2008/ Accepted 18 June 2008

Top ABSTRACT INTRODUCTION MATERIALS AND METHODS RESULTS DISCUSSION REFERENCES

 
The new Neisseria-Haemophilus identification (NH) card for Vitek 2 was compared with 16S rRNA gene sequencing (16S) as the reference method for accurate identification of Neisseria spp., Haemophilus spp., and other fastidious gram-negative bacteria. Testing was performed on the Vitek 2 XL system with modified software at three clinical trial laboratories. Reproducibility was determined with nine ATCC quality control strains tested 20 times over a minimum of 10 days at all three sites. A challenge set of 30 strains with known identifications and 371 recent fresh and frozen clinical isolates were also tested. Expected positive and negative biochemical reactions were also evaluated for substrate reproducibility. All microorganisms were tested on the NH card, and all clinical and stock isolates were saved for 16S testing. All reproducibility tests yielded expected results within a 95% confidence interval. For challenge microorganisms, there was 98% overall correct identification, including 8% low discrimination, 2% incorrect identification, and 0% unidentified. For clinical strains, there was 96.5% overall correct identification, including 10.2% low discrimination, 2.7% incorrect identification, and 0.8% unidentified. The 2.7% (10/371) of clinical isolates that gave an incorrect identification consisted of 7 isolates correct to genus and 3 strains incorrect to genus. There were an additional 27 strains (primarily Neisseria species) for which the 16S identification result was different from the NH card result. These were all unclaimed species by the system. The new NH card met all performance criteria within a 95% confidence interval compared to identification of clinical isolates by 16S.

Top ABSTRACT INTRODUCTION MATERIALS AND METHODS RESULTS DISCUSSION REFERENCES

 
In the diagnostic clinical microbiology laboratory, rapid and accurate identification of bacterial pathogens is essential for prompt and appropriate management of infected patients. This is important for bacterial pathogens within the genera Haemophilus and Neisseria.

The science has evolved over many years. Classical methods gave way to substrate-based identification of these microorganisms involving overnight and then shorter incubation. More recently molecularly based identification has started to change the landscape (2, 5, 7, 8, 12), but for most laboratories that lack such sophisticated technical capabilities, the ability to use either a manual or automated system that will give a high level of correct identifications is sufficient for most purposes.

For identification of Haemophilus and Neisseria species, a variety of commercial methods have been available on the market for many years. For Neisseria species these have included Neisseria-Kwik, Gonogen, Gonochek II, RIM-N, API QuadFERM-Plus, Minitek, Identicult-Neisseria, and several others (1, 6, 16, 18). All of these are based on colorimetric changes in miniaturized substrates, with either enzymatic or growth end points. The ability to identify and separate Haemophilus species from nonpathogenic Neisseria species, particularly those from the respiratory tract, then led to the addition of Haemophilus identification in these systems. RapID NH, API NH strip, and Haemophilus Identification Test Kit were developed to separate Haemophilus species (3, 7, 9-11, 13-15, 17). These systems all perform with reasonable accuracy in the clinical laboratory. Depending on the method used and on the number and variety of strains tested, correct identifications varied between 73 and 99% for species in either genus.

The aforementioned systems are designed primarily for smaller laboratories. With changes and consolidations of laboratories, the use of automated systems for the identification of clinical isolates has become commonplace, and commercial manufacturers have now attempted to expand the capabilities of their identification systems to optimize identification for better patient care.

bioMérieux, Inc., has developed a new Neisseria-Haemophilus (NH) identification card for the Vitek 2 system. The NH card is based on colorimetric technology utilizing dehydrated media containing chromogenic substrates. The card has a database that includes 27 taxa of gram-negative fastidious bacteria and that maintains the predominance of Haemophilus and Neisseria species but also includes Actinobacillus, Campylobacter, Capnocytophaga, Cardiobacterium, Eikenella, Gardnerella, Kingella, Moraxella, Oligella, and Suttonella species. In a recently published investigation from one laboratory, 91% of strains included in the database were identified correctly without the need for additional tests (17). In the present investigation, the quality, reproducibility, and accuracy of this NH card were assessed in three large tertiary care clinical laboratories. Confirmation of identifications was made by 16S rRNA gene sequencing as a quality assurance step to assess the performance of the NH card.

Top ABSTRACT INTRODUCTION MATERIALS AND METHODS RESULTS DISCUSSION REFERENCES

 
Test methodology. Strains were isolated in pure culture on blood agar, chocolate agar, or other media that supported the growth of the individual strains for testing. For inoculation into the 64-well NH card, an overnight or 48-h culture of the strain was suspended in 0.45% aqueous NaCl to a turbidity equivalent to a 3.0 McFarland standard. The inoculated card was loaded into the Vitek 2 XL automated identification system according to the manufacturer's instructions. The inoculated card was incubated for 6 h, and the substrate reactions were read by one of two optical heads in the Vitek 2 system. A computer-assisted algorithm, based on data collected from known strains of the claimed species, was used to interpret the data for a final identification. Sufficient data have been collected from known strains to estimate the typical reactions of the claimed species to a set of discriminating biochemicals. An identification was obtained by evaluating the reactions in the NH card and comparing those results to expected reactions for the species.

Each clinical isolate at all three study sites was stored as a heavy suspension at 4°C in sterile physiological saline. These strains were then shipped directly to MIDI Labs (Newark, DE) for 16S rRNA gene sequencing.

Quality control and reproducibility testing. Nine microorganisms comprised the quality control and reproducibility set of organisms. The strains tested were Eikenella corrodens ATCC BAA-1152, Campylobacter jejuni subsp. jejuni ATCC BAA-1153, Neisseria lactamica ATCC 23970, Gardnerella vaginalis ATCC BAA-1154, Haemophilus (Actinobacillus) actinomycetemcomitans ATCC BAA-1155, Neisseria gonorrhoeae ATCC 19424, Haemophilus influenzae ATCC 9007, Oligella urethralis ATCC 17960, and Haemophilus aphrophilus ATCC 33389. The set was tested 20 times over a minimum of 10 days at each of the three clinical trial sites. The results were used to evaluate system and substrate reproducibility. One manufacturing lot of NH cards was used for the entire study.

Evaluation of system reproducibility was based on the number of correct identifications. Correct identification was defined as accurate identification of a microorganism by the system as the only choice (with any level of confidence—excellent, very good, good, or acceptable) or as one of the choices within a multichoice (i.e., low-discrimination) result. The expected system reproducibility performance criterion was set at 95% or greater correct identification within a 95% confidence interval.

Evaluation of substrate reproducibility was based on microorganism/biochemical well combinations with a distinct expected reaction of positive or negative. For individual well reactions with distinct positive or negative reactions, the expected substrate reproducibility performance criterion was agreement of at least 95% within a 95% confidence interval.

Challenge testing. Each clinical study site tested a panel of 30 well-characterized isolates once on the NH card. The strains were supplied to each study site by bioMérieux. The isolates were not among those used to create the NH database and were selected to represent the identification claims of the NH product. Definitions for the levels of correct identification were as follows: overall correct identification, the isolate was accurately identified by the system as the only choice (with any level of confidence) or as one of the choices within a low-discrimination result; low discrimination, the identification contained two or three single or multichoice identification results in contrast to the correct identification with a single choice; incorrect identification, a final identification in which the genus or species was incorrect; unidentified microorganisms, a final identification of "unidentified organism", "inconclusive identification," or "nonreactive biopattern."

The minimum performance requirements for the clinical trial were at least 95% overall correct identification, less than 25% low discrimination, less than 2% incorrect identification, and less than 5% unidentified organisms for the NH card within a 95% confidence interval.

Clinical isolates. A total of 371 recently isolated clinical strains, either fresh or recently frozen (within the past 6 months) and previously identified as one of the "claimed" species, were tested at the three clinical trial sites. All isolates were tested once on the NH card and by 16S rRNA gene sequencing utilizing approximately 500 bp. 16S rRNA gene sequencing was considered the reference method. MIDI Labs (Newark, DE) performed the 16S sequencing and utilized the Applied Biosystems MicroSeq microbial analysis software and database to evaluate genetic similarity (19). When a genetic match was not found in the MicroSeq library, MIDI performed a BLAST search of the GenBank public database (4). Sequences from isolates with a genus level 16S sequencing identification from MIDI or GenBank were also compared to the bioMérieux, Inc., proprietary 16S database. For the purposes of this investigation the 16S sequencing results were interpreted in the context of the NH identification database. A 16S sequencing result consisting of a single-choice, species level genetic match to the NH card identification was a complete, correct result. A 16S sequencing result with no genetic difference between multiple species was confirmed through supplemental biochemical testing if one of the species listed matched the NH identification. A 16S sequencing result with a species level identification that was discrepant with the NH identification was evaluated to determine if the microorganism listed was part of the NH claim list. If it was, the discrepant result was confirmed or resolved by retesting the isolate. If it was not listed on the NH claim list, the isolate was excluded from the data set but the results were reviewed to evaluate issues related to all unclaimed species. A 16S sequencing result reported by MIDI Labs as a genus level identification and/or match to a sequence in the GenBank database was sent to the bioMérieux R&D Microbiology group in La Balme, France, for review to determine the relationship of the sequence result to microorganisms in the database. Definitions for the level of correct identification and the performance criteria were the same as those used for the challenge testing.

Excluded/unclaimed genera/species. Strains that were not included as claimed genera or species by NH card identification were recorded but necessarily excluded from the overall data set compilations. The 16S RNA sequence was used to arbitrate the NH card results for these strains. The criterion for an excluded or unclaimed strain was an identification from the NH card that was not in the database and that was supported by 16S RNA sequencing, no identification given by the NH card and a 16S sequence identification that was not one of the claimed species, or no 16S rRNA gene sequencing identification.

Top ABSTRACT INTRODUCTION MATERIALS AND METHODS RESULTS DISCUSSION REFERENCES

 
Quality control and reproducibility testing. The performance requirements for quality control and reproducibility were met, within a 95% confidence interval, both cumulatively and by the individual trial site with two exceptions. C. jejuni subsp. jejuni ATCC BAA-1153 failed at one trial site but passed cumulatively and H. actinomycetemcomitans ATCC BAA-1155 failed at one trial site and cumulatively (Table 1). There were four substrates that had less than 100% accuracy and reproducibility in this set. These were L-glutamine, arginine arylamidase (ArgA), lysine arylamidase (LysA), and alanine-phenylalanine-proline arylamidase, although only H. actinomycetemcomitans failed the overall 95% confidence interval test and has since been removed from the NH quality control specifications. The ArgA and LysA tests for this strain were correct only one-third of the time. The other ATCC strains having distinct predictable reactions tested, as expected, correctly 100% of the time by site and cumulatively across sites.

View this table: [in this window] [in a new window]

TABLE 1. NH card quality control and reproducibility results for all sites combined

Challenge testing. For the 90 cumulative results from all three trial sites, the challenge set was identified correctly 98% of the time and met all performance criteria set by the clinical trial protocol. The results also fell within the established confidence interval. There were three strains (10%) at one trial site and two strains (7%) at the other two sites that gave low-discrimination results, but these results included the correct identification. There was one strain (3%) at two trial sites that was not identified correctly. At one site Actinobacillus ureae was misidentified as H. influenzae; at the other site Moraxella catarrhalis was misidentified as Neisseria elongata.

Clinical isolate testing. The clinical isolates tested comprised all 27 of the taxa contained in the NH identification card database. Compared to 16S rRNA gene sequencing as the reference method, 96.5% (358/371) of the clinical isolates were identified correctly by the NH card and met all performance criteria set by the clinical trial protocol across all three sites (Table 2). The cumulative performance by species for all the clinical isolates tested at all three sites is shown in Table 3. The overall correct-identification performance for the new NH card was 96.5%, with only 10.2% low-discrimination results and 2.7% incorrect results. The results also fell within the established confidence intervals.

View this table: [in this window] [in a new window]

TABLE 2. NH card overall performance summary by site for clinical isolate testing

View this table: [in this window] [in a new window]

TABLE 3. NH card performance summary by species for the clinical isolate test set for all sites combined

In addition to the strains identified in Table 3, a total of 27 isolates in the data set were excluded as unclaimed by the NH card; testing for 25 of these gave an incorrect species result but a correct genus. Of those claimed as Neisseria sicca, 16 were Neisseria flavescens, six were Neisseria macacae/Neisseria mucosa, and two were Neisseria subflava. One isolate with a low-discrimination Campylobacter sp. result (Campylobacter coli/Campylobacter jejuni) was an unclaimed Campylobacter upsaliensis. One strain claimed as H. actinomycetemcomitans was Pasteurella bettyae, and one unidentified strain was an unclaimed Brevundimonas species.

Incorrect and discrepant identifications of claimed species as judged by comparison with 16S rRNA gene sequencing are listed in Table 4. The overall performance was excellent. Clinically only one result might be considered problematic. An isolate identified as Neisseria cinerea with an acceptable Vitek 2 confidence was identified by gene sequencing as C. coli.

View this table: [in this window] [in a new window]

TABLE 4. Incorrect or discrepant identifications of the clinical isolate test set for all sites

Top ABSTRACT INTRODUCTION MATERIALS AND METHODS RESULTS DISCUSSION REFERENCES

 
This study was designed to accurately validate the performance of the latest Vitek 2 NH identification card in high-volume tertiary clinical laboratories that perform routine identification of pathogens on automated platforms. The performance of the NH identification card on Vitek 2 met the validation requirements for the three components tested, as described in the study protocol. For the claimed species, there was a high level of performance. With a 95% confidence interval the Vitek 2 NH card gave correct results over 95% of the time at all three laboratory test sites.

With respect to the Neisseria species, the NH card had greater limitations for nonpathogenic Neisseria species than 16S sequence identification. N. sicca is a claimed species but would often be identified as N. flavescens if the gold standard 16S rRNA gene sequencing identification was used. However, in most cases separation as a nonpathogenic Neisseria species would be sufficient to exclude pathogenic strains. This issue is not unique to any of the automated or conventional systems. At the technologist level, the new NH card would misidentify organisms approximately 3% of the time, and currently about 7% of isolates would be unclaimed in the test system.

The NH card was designed to improve significantly the capabilities of the Vitek 2 system to identify a variety of fastidious clinical microorganisms, but particularly Haemophilus and Neisseria species. Clinical trials such as presented here are important to adequately test such new identification systems. The data support the claims of the manufacturer for this new automated identification card.

All microorganism and biochemical combinations having distinct expected reactions of positive or negative in which quality control was evaluated met the performance criteria when measured cumulatively across sites with the exception of four biochemical reactions for three quality control species. As a result of these trials H. actinomycetemcomitans has been removed from the quality control list, leaving only two discrepancies that passed statistical analysis. For the clinical isolates, only a few isolates of some species were included in the evaluation. Haemophilus haemolyticus may be misidentified as H. influenzae or Haemophilus parainfluenzae, unless hemolysis is observed. Also, all four isolates of Kingella denitrificans were identified with low discrimination, although a correct identification was made. Additional strains of some of these species should be evaluated to confirm the conclusions of this investigation.

Overall, the data for which the card has a claim indicate that the NH card meets all performance criteria at greater than 95% confidence. The results from this clinical trial in three large tertiary clinical laboratories indicate that the Vitek 2 NH card is acceptable for routine use in a clinical microbiology laboratory.

 
We acknowledge the technical expertise of Dolores H. Calley and Hina S. Patel from Duke University Medical Center.

This investigation was supported by a grant-in-aid from bioMérieux, Inc., Durham, NC.

 
* Corresponding author. Mailing address: Medical Microbiology (Dept. of Laboratory Medicine and Pathology), University of Alberta Hospital, WMC 4B1.19 8440-112 Street, Edmonton, AB, Canada T6G 2B7. Phone: (780) 407-7242. Fax: (780) 407-8599. E-mail: robertrennie{at}capitalhealth.ca

Published ahead of print on 25 June 2008.

Top ABSTRACT INTRODUCTION MATERIALS AND METHODS RESULTS DISCUSSION REFERENCES

 

1
1. Alexander, S., and C. Ison. 2005. Evaluation of commercial kits for the identification of Neisseria gonorrhoeae. J. Med. Microbiol. 54:827-831.[Abstract/Free Full Text]
2
2. Balganesh, M., M. K. Lalitha, and R. Nathaniel. 2000. Rapid diagnosis of acute pyogenic meningitis by a combined PCR dot-blot assay. Mol. Cell. Probes 14:61-69.[CrossRef][Medline]
3
3. Barbé, G., M. Babolat, J. M. Boeufgras, D. Monget, and J. Freney. 1994. Evaluation of API NH, a new 2-hour system for identification of Neisseria and Haemophilus species and Moraxella catarrhalis in a routine clinical laboratory. J. Clin. Microbiol. 32:187-189.[Abstract/Free Full Text]
4
4. Benson, D. A., I. Karsch-Mizrachi, D. J. Lipman, J. Ostell, and D. L. Wheeler. 2007. GenBank. Nucleic Acids Res. 35(database issue):D21-D25.[CrossRef]
5
5. Clarke, S. C. 2006. Detection of Neisseria meningitidis, Streptococcus pneumoniae, and Haemophilus influenzae in blood and cerebrospinal fluid using fluorescence-based PCR. Methods Mol. Biol. 345:69-77.[Medline]
6
6. Dillon, J. R., M. Carballo, and M. Pauzé. 1988. Evaluation of eight methods for identification of pathogenic Neisseria species: Neisseria-Kwik, RIM-N, Gonobio-Test, Minitek, Gonochek II, Gonogen, Phadebact Monoclonal GC OMNI Test, and Syva Microtrak test. J. Clin. Microbiol. 26:493-497.[Abstract/Free Full Text]
7
7. Doan, B., S. Asikainen, and H. Jousimies-Somer. 1999. Evaluation of two commercial kits and arbitrarily primed PCR for identification and differentiation of Actinobacillus actinomycetemcomitans, Haemophilus aphrophilus, and Haemophilus paraphrophilus. J. Clin. Microbiol. 37:742-747.[Abstract/Free Full Text]
8
8. Haag, A. M., S. N. Taylor, K. H. Johnston, and R. B. Cole. 1998. Rapid identification and speciation of Haemophilus bacteria by matrix assisted laser desorption/ionization time-of-flight mass spectrometry. J. Mass Spectrom. 33:750-756.[CrossRef][Medline]
9
9. Hughes, B., M. T. Pezzlo, L. M. de la Maza, and E. M. Peterson. 1987. Rapid identification of pathogenic Neisseria species and Branhamella catarrhalis. J. Clin. Microbiol. 25:2223-2224.[Abstract/Free Full Text]
10
10. Janda, W. M., P. J. Malloy, and P. C. Schreckenberger. 1987. Clinical evaluation of the Vitek Neisseria-Haemophilus identification card. J. Clin. Microbiol. 25:37-41.[Abstract/Free Full Text]
11
11. Janda, W. M., J. J. Bradna, and P. Ruther. 1989. Identification of Neisseria spp., Haemophilus spp., and other fastidious gram-negative bacteria with the MicroScan Haemophilus-Neisseria identification panel. J. Clin. Microbiol. 27:869-873.[Abstract/Free Full Text]
12
12. Kolberg, J., E. A. Høiby, and E. Jantzen. 1997. Detection of the phosphorylcholine epitope in streptococci, Haemophilus and pathogenic Neisseria by immunoblotting. Microb. Pathog. 22:321-329.[CrossRef][Medline]
13
13. Munson, E., M. Pfaller, F. Koontz, and G. Doern. 2002. Comparison of porphyrin-based, growth factor-based, and biochemical-based testing methods for identification of Haemophilus influenzae. Eur. J. Clin. Microbiol. Infect. Dis. 21:196-203.[CrossRef][Medline]
14
14. Munson, E. L., and G. V. Doern. 2007. Comparison of three commercial test systems for biotyping Haemophilus influenzae and Haemophilus parainfluenzae. J. Clin. Microbiol. 45:4051-4053.[Abstract/Free Full Text]
15
15. Murphy, P. G., I. Craig, A. C. Lafong, and E. T. M. Smyth. 1990. Evaluation of two rapid methods for identifying and biotyping Haemophilus influenzae. J. Clin. Pathol. 43:581-583.[Abstract/Free Full Text]
16
16. Robinson, M. J., and T. R. Oberhofer. 1983. Identification of pathogenic Neisseria species with the RapID NH system. J. Clin. Microbiol. 17:400-404.[Abstract/Free Full Text]
17
17. Valenza, G., C. Ruoff, U. Vogel, M. Frosch, and M. Abele-Horn. 2007. Microbiological evaluation of the new Vitek 2 Neisseria-Haemophilus identification card. J. Clin. Microbiol. 45:3493-3497.[Abstract/Free Full Text]
18
18. Welch, W. D., and G. Cartwright. 1988. Fluorescent monoclonal antibody compared with carbohydrate utilization for rapid identification of Neisseria gonorrhoeae. J. Clin. Microbiol. 26:293-296.[Abstract/Free Full Text]
19
19. Woo, P. C. Y., K. H. L. Ng, S. K. P. Lau, K.-T. Yip, A. M. Y. Fung, K.-W. Leung, D. M. W. Tam, T.-L. Que, and K.-Y. Yuen. 2003. Usefulness of the MicroSeq 500 16S ribosomal DNA-based bacterial identification system for identification of clinically significant bacterial isolates with ambiguous biochemical profiles. J. Clin. Microbiol. 41:1996-2001.[Abstract/Free Full Text]

---

Journal of Clinical Microbiology, August 2008, p. 2681-2685, Vol. 46, No. 8
0095-1137/08/$08.00+0     doi:10.1128/JCM.00449-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Reprints and Permissions Copyright Information Books from ASM Press MicrobeWorld Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Rennie, R. P. Articles by Krilcich, A. Search for Related Content PubMed PubMed Citation Articles by Rennie, R. P. Articles by Krilcich, A.