Previous Article | Next Article ![]()
Journal of Clinical Microbiology, March 2009, p. 758-764, Vol. 47, No. 3
0095-1137/09/$08.00+0 doi:10.1128/JCM.01714-08
Copyright © 2009, American Society for Microbiology. All Rights Reserved.

The University of Arizona/BIO5 Institute, Tucson, Arizona,1 Wishard Memorial Hospital, Indiana University Indianapolis, Indiana,2 The Ohio State University Medical Center, Columbus, Ohio,3 North Shore-Long Island Jewish Health System Laboratories, Lake Success, New York,4 VA Medical Center, West Los Angeles, California,5 Medical City Dallas Hospital,6 Children's Medical Center and University of Texas Southwestern Medical Center, Dallas, Texas,7 Evanston Northwestern Healthcare, Evanston, Illinois8
Received 4 September 2008/ Returned for modification 24 October 2008/ Accepted 25 December 2008
|
|
|---|
|
|
|---|
MRSA is harbored primarily in human nares, on skin, and on mucosal surfaces of the vagina and rectum. Colonized patients (carriers) have a high likelihood of developing and transmitting infections (10, 21, 25). Therefore, routine infection prevention practices, such as active surveillance programs that screen nares for MRSA, have been recommended and established by many accredited health care facilities in North America and Europe (5, 7, 20, 27, 28, 33). Most active surveillance programs rely on rapid detection methods, such as chromogenic agar (4, 9, 14, 32) or real-time PCR (2, 7, 11, 15, 19, 23, 29), to support their efforts, because delays in the identification of MRSA carriers offer an opportunity for MRSA to be transferred to other patients. Recently published results have shown that such MRSA surveillance programs can be combined with other infection prevention practices to significantly reduce the rates of HAIs caused by MRSA (28, 33), but questions remain about the comparative clinical performance and utility of the MRSA screening methods.
Most traditional MRSA screening methods focus on the phenotypic identification of the mecA gene, the structural gene responsible for methicillin resistance via production of an altered penicillin binding protein, PBP2a, which maintains staphylococcal cell wall integrity because of its low affinity to β-lactam antibiotics. The gene is present within a transposon-encoded genetic region known as the staphylococcal cassette chromosome mec (SCCmec).
The BD GeneOhm (BDGO) MRSA assay, first introduced to clinical laboratories as the IDI-MRSA assay, focuses on the detection of a unique junction fragment created by integration of the mecA-containing transposon into a single unique site (orfX), an open reading frame within the S. aureus genome (18), rather than on the detection of the mecA gene itself. The Xpert MRSA assay is a novel second-generation real-time PCR assay for the detection of the SCCmec-orfX junction (Xpert MRSA assay package insert; Cepheid) and is currently the most rapid of all the commercial methods. It is an easy-to-use test that, by virtue of its moderate-complexity CLIA (Clinical Laboratory Improvement Act) categorization, can be performed on-demand by virtually any laboratory technologist or technician. However, its clinical performance against culture-based methods, and against other FDA-cleared high-complexity molecular diagnostic tests, required assessment.
This study is the first comprehensive multicenter U.S. evaluation of the Xpert MRSA assay. It is the first study to assess assay performance stratified by prevalence and by health care setting. It is the first study to report assay performance by operators with limited molecular training and the first to report performance compared with two gold-standard methods, broth enrichment and another FDA-cleared MRSA PCR. The study closes gaps in the published literature by providing an extensive clinical comparison of commercial methods for MRSA detection for subjects and strains found in the United States.
|
|
|---|
(ii) Specificity.
A total of 95 Staphylococcus strains were tested using the Cepheid Xpert MRSA assay. All strains were tested in triplicate at densities of
1 x 106 CFU per swab. Cultures were obtained from the American Type Culture Collection and the Network on Antimicrobial Resistance in S. aureus. MRSA strains representing the six SCCmec types and subtypes (I, II, III, IV, IVa, and V) were included in testing. A total of 51 strains, representing species phylogenetically related to S. aureus, were tested. Other members of the nasal commensal flora, including 32 strains of methicillin-sensitive, coagulase-negative staphylococci and 12 strains of methicillin-resistant, coagulase-negative staphylococci, were also tested.
(iii) Reproducibility/intersite agreement. Reproducibility (intersite agreement) was assessed using a panel of specimens with varying densities of MRSA and methicillin-sensitive Staphylococcus epidermidis (MSSE). Specimens were tested in triplicate on 10 different days at each of three different sites (4 specimens x 3 times/day x 10 days x 3 sites) by individuals with limited laboratory experience. One lot of the Xpert MRSA kit was used at each of the three testing sites.
Clinical experimental design. The performance characteristics of the Xpert MRSA assay were determined in a multisite prospective study performed at seven health care organizations, with populations comprising patients at tertiary-care, extended-stay, and outpatient facilities. Nares swab specimens were tested by the Xpert MRSA assay, and the results were compared to those of direct culture on CHROMagar MRSA medium (direct CM culture), (Becton Dickinson, Sparks, MD) and a more sensitive reference method, broth-enriched culture followed by culture on CHROMagar MRSA medium (broth-enriched CM culture). In order to avoid the pitfalls of traditional discrepant analysis (17), samples were also tested by a third method, the FDA-cleared BDGO MRSA assay (Becton Dickinson, San Diego, CA).
Human subjects were enrolled in accordance to federal policy governing human subject protection and federal medical privacy standards (8). Nares specimens were collected from geographically distinct areas of the United States, including the East, Northeast, Midwest, Southwest, and West. Subjects included individuals from inpatient tertiary-care hospitals, nursing homes, and transplantation units, including health care staff. Each subject was enrolled in the study only once. Subjects who had received systemic or topical nasal antibiotics 48 h to 1 week prior to study enrollment, those under the age of 2 years, and those who had contraindications to nares swab collection were excluded from the study.
Four nares swabs, consisting of two double swabs (liquid Stuart Copan swabs, part 900-0370; Cepheid), were collected from persons in the populations listed in Table 2. After collection, the two double swabs were rubbed together to ensure the homogeneity of the samples. For one swab pair, one swab was tested by the Xpert MRSA assay within 24 h and the other swab was tested by the BDGO MRSA assay within 24 h. For the second swab pair, one swab was routed to a centralized laboratory for culture testing and the other was retained in case repeat testing was necessary.
|
View this table: [in a new window] |
TABLE 2. Demographic description of Xpert MRSA assay results derived from different study populations
|
Within-cartridge controls included reagents for the simultaneous detection of the target MRSA DNA and a sample-processing control (SPC), which serves both to monitor for appropriate sample processing and PCR conditions and to monitor for the presence of substances that can inhibit PCR. In this design, the SPC does not affect the sensitivity of the target sequence, because the concentration of the internal control is adjusted such that in the presence of inhibitors or MRSA DNA, the SPC will be repressed. A second control mechanism within the cartridge, the probe check control, verified reagent rehydration, PCR tube filling in the cartridge, hydrolysis probe integrity, and dye stability.
Culture methods. Direct cultures were performed on site at each of the seven study sites. In addition, a swab was sent to a centralized laboratory for a reference culture. The central laboratory was blind to the on-site results. Specimen swabs were transported to the centralized laboratory at ambient temperatures and were either tested upon receipt or stored at a refrigerated temperature of 2 to 8°C for as long as 72 h. Swabs were directly streaked on to CHROMagar MRSA medium, and in addition, the swab was then transferred to Trypticase soy broth with 6.5% sodium chloride (Becton Dickinson, Sparks, MD) and incubated for 18 to 24 h at 35 ± 2°C (broth-enriched CM culture). If the direct CM culture was negative at 24 h, the enriched Trypticase soy broth was streaked onto another CM plate and incubated for 24 to 48 h at 35 to 37°C. For all cultures, presumptively positive mauve colonies from either culture method were confirmed to be MRSA when the isolate was tube coagulase positive and exhibited typical staphylococcal Gram stain morphology.
Statistical analysis.
Descriptive statistical performance characteristics were calculated for the Xpert MRSA assay relative to direct-CM and broth-enriched-CM culture results, performed at the central laboratory (reference culture), and relative to the on-site CM culture. The sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated according to standard formulas. A priori power analysis was performed for a power of
90%, and the pooled sample size was calculated for analysis with 95% confidence intervals. The criterion for significance (alpha) was established at 0.05 (two-tailed).
Since the PPV and NPV of each assay will change as the prevalence changes, comparisons of performance data by study site can be misleading if MRSA prevalence is not considered. Therefore, site-specific data for sensitivity and specificity were matched with corresponding prevalence data to create graphical representations of the predictive capacities of all test methods compared to that of the reference culture method.
For Fig. 1 and 2, the following equations and the "smooth-curve" function in Excel 2003 were used to create a "y = –1/x" type curve for each test method:
![]() |
![]() |
![]() View larger version (12K): [in a new window] |
FIG. 1. Graphical representation of changes in the PPV with changes in prevalence. The PPVs for four MRSA detection methods at various prevalences are shown.
|
![]() View larger version (18K): [in a new window] |
FIG. 2. Graphical representation of changes in the NPV with changes in prevalence. The NPVs for four MRSA detection methods at various prevalences are shown.
|
|
|
|---|
For MRSA SCCmec type II cells, the assay sporadically identified samples as positive at bacterial densities as low as 10 CFU/swab, while the LoD results indicate that the Xpert MRSA assay will produce a positive result with 95% confidence for a swab containing 80 CFU. Assay linearity was achieved throughout the range of 68 CFU/swab to 6.8 x 107 CFU/swab (4 replicates for each density), with corresponding CT values from 14.7 to 34.0.
Intersite agreement testing confirmed a high concordance of results across study sites on multiple testing days, as depicted in Table 1. For negative results, agreement between sites ranged from 96.8 to 100%; the only source of discordant results was clerical error. For weakly and moderately positive specimens, total agreement ranged from 97.8 to 100%, with clerical error accounting for discordant results. For strongly positive samples, total agreement was 100% across all sites. The overall total agreement across three sites was 99.2%.
|
View this table: [in a new window] |
TABLE 1. Summary of intersite agreement for the Xpert MRSA assay
|
3 days, 24.2% were outpatients, and 7.9% were staff and other subjects. Estimates of MRSA prevalence, derived from subject sampling at the seven study sites, ranged from 5.2 to 44.4%. The performance characteristics of the Xpert MRSA assay (Table 3) were as follows. Compared to the direct CM culture method, the sensitivity (agreement with positive results), specificity (negative agreement), PPV, and NPV of the Xpert MRSA assay were 94.3%, 93.2%, 73.0%, and 98.8%, respectively. Relative to broth-enriched CM culture, sensitivity was 86.3%, specificity was 94.9%, the PPV was 80.5%, and the NPV was 96.6%. For 5 to 10% of the specimens tested, the Xpert MRSA assay results were positive despite a culture-negative status. Table 3 also compares Xpert MRSA assay results to the results of broth-enriched and direct CM cultures. In comparison to direct CM culture, sensitivity ranged from 81.3 to 100%, specificity from 81.8% to 100%, the PPV from 60 to 100%, and the NPV from 93.8 to 100%. Compared to broth-enriched CM culture, sensitivity ranged from 80 to 100%, specificity from 93.2 to 100%, the PPV from 75 to 100%, and the NPV from 94 to 100%. Three of 1,077 specimens did not give results by the Xpert MRSA assay after two attempts (0.3%); because their inclusion did not statistically alter the final result of the study, only samples for which results were obtained by all methods are used in Table 3.
|
View this table: [in a new window] |
TABLE 3. Performance of the Xpert MRSA assay by site and prevalence compared to the performance of the combined reference culture method and of direct culture
|
|
View this table: [in a new window] |
TABLE 4. Performance of the Xpert MRSA assay, the BDGO MRSA assay, and the direct CM culture method compared to the broth-enriched CM culture reference method
|
|
|
|---|
Several studies have shown that PCR provides a sensitive method for identifying MRSA carrier status (15, 19, 26, 29) and have established PCR as an "improved gold standard" compared to direct routine culture (1). Data from the present study support this concept and demonstrate the performance of a new and totally integrated method for MRSA PCR, the Xpert MRSA assay. Of note, improved gold standard methods often have lower calculated PPVs than direct culture, due to their enhanced ability to identify microbes at low densities and produce PCR-positive but culture-negative results. In contrast, such methods exhibit very high NPVs, a performance characteristic that is suitable for laboratory "screening" methods. Consistent with the expectations of an improved gold standard method, Xpert MRSA assay results were MRSA positive, despite a culture-negative status, for 5 to 10% of specimens tested.
PCR-positive, culture-negative results could be consistent with a number of circumstances. For instance, false-negative culture results could arise due to opsonizing antibody responses to S. aureus, or due to antibiotic use. In addition, poor sampling or handling of the swabs may limit bacterial recovery in culture. Other explanations for "false"-positive results could include the presence of nonviable organisms, since the assay does not confirm the presence of live organisms. In addition, low bacterial densities in the nares can render the culture negative and the PCR positive, or vice versa, because low bacterial densities will cause both methods to produce sporadic positive or negative results under the parameters described by the statistical phenomenon known as the Poisson effect. While data describing the presence of MRSA from other body sites were not available for this study, there is a growing body of evidence to suggest that this condition occurs. For example, a recent study showed that among patients with apparently false positive PCR results in nares swabs, MRSA could be recovered by culture from other sites such as the inguinal region, which is most likely a surrogate for gastrointestinal tract colonization (29). As described by Paule et al., such results are often found in patients who have previously tested positive for MRSA or who harbor this organism at other body sites (26). In this example, the results would be considered positive from an infection control perspective.
Of particular interest, genetic excisions within the SCCmec region of MRSA strains may also yield positive PCR results in the absence of a functional mecA gene; therefore, these "empty cassette variants" (sometimes called MR-MSSA) cause PCR-positive, culture-negative results. These results occur because current commercial PCR assays target genetic regions, upstream of the mecA gene, which can remain even after excision of the mecA gene from within the cassette. A limitation of this study is that there was no assessment of the prevalence of these variants; however, the prevalence of empty cassette variants has been shown to differ by geographical region and currently appears to be more common outside the United States (10, 13, 15). Awareness and periodic monitoring for the presence of these variants is prudent. Monitoring of the mecA gene without targeting the SCCmec region is not recommended, because the mecA gene may be carried in bacterial isolates that are not S. aureus by origin.
The performance of the Xpert MRSA assay supports its utility for U.S. active surveillance programs using nares samples. The analytical sensitivity of the Xpert MRSA assay was slightly higher than that of the BDGO MRSA assay (80 CFU/swab reported here versus 325 CFU/swab, reported in the BDGO MRSA assay package insert). The results are comparable to those obtained in Europe by Rossney et al., 58 CFU/swab (29).
Under the conditions of the multicenter clinical trial, false-negative PCR results were rare (10 of 1,074 versus direct CM culture and 29 of 1,074 versus broth-enriched CM culture). Such discrepancies can occur if the microbe density is below the assay's 95% LoD or if unrecognized genotypic variation occurs. The Xpert MRSA assay achieved an exceptional NPV, 96.6%, across a broad range of MRSA prevalences. Improved NPVs are projected for the Xpert MRSA assay in populations with MRSA prevalences higher than 10%, as depicted in Fig. 2, confirming its utility as a screening method in a variety of U.S. health care settings.
Compared to broth-enriched CM culture, the clinical sensitivity, specificity, PPV, and NPV of the Xpert MRSA assay were 86.3%, 94.9%, 80.5%, and 96.6%, respectively, for nares samples from seven different performance sites with different subject populations ranging in prevalence from 12.9 to 25.5%. The performance of the assay in this study was somewhat lower than that achieved in Ireland by Rossney et al. (29), reported as 95%, 98%, 90%, and 99%, respectively, when amended for patients who were known to be positive for MRSA previously. The differences in performance can be attributed to the prevalence in the Irish population (58/204 patients [28.4%]), which could elevate the PPV, and to the sampling of multiple specimen sources in that study (nares, throat, and groin), which adds to the likelihood of acquiring a positive sample. In addition, the Rossney performance characteristics were adjusted, in their final analysis, to include patients previously known to be MRSA positive, a strategy that added to the overall agreement in their study. One could also speculate that in a tertiary-care population, bacterial colonization densities would be higher and would contribute to improved performance of the PCR assay, in contrast to this study, which included outpatients as well as inpatients; that single-site laboratory performance would be improved over that found in our multicenter performance study, which included performance by staff who were not trained in molecular methods; and that differences in detection could occur to due to the fact that the MRSA strains from the Irish population may differ from the U.S. strains.
The clinical performance of the Xpert MRSA assay was statistically equivalent to those of the BD GeneOhm MRSA assay and direct CHROMAgar MRSA culture compared to the reference method of 6.5% salt broth enrichment followed by CHROMAgar MRSA culture. Despite the fact that the targets of each assay are operationally distinct, the two PCR assays produced similar results, since both assays target SCCmec insertion sequences and regions within the orfX gene.
The Xpert MRSA assay has several operational advantages. With a PCR cycling time of
72 min, this assay offers a significant advantage in speed over culture methods and other PCR assays for the identification of MRSA colonization. Another advantage is the assay's ease of use. Since the Xpert MRSA method can be performed as a moderate-complexity method, a variety of health care staff can participate in testing efforts. The method is amenable to a variety of health care settings, ranging from the clinical laboratory to off-site point-of-care testing. The method is highly reproducible, even when performed by personnel with limited experience, as evidenced by a total intersite agreement of 99.2% and its rating as a "moderate-complexity" assay according to the CLIA categorization. For laboratories which are accredited by the College of American Pathologists, the format of the assay requires the testing of external controls for the verification of new lots and shipments of reagents, while daily/run control requirements are met by the assay's built-in controls, designed to ensure precision and reagent integrity.
Reagent costs are higher for the Xpert MRSA assay than for other rapid methods. However, despite the overall higher reagent cost per test, the Xpert MRSA assay offers clinical utility when rapid results are required for appropriate MRSA isolation and cohorting practices, designed to optimize the use of isolation beds. Costs can be partially offset by personnel options, which are available due to the "moderate-complexity" rating of the assay, eliminating the costs associated with highly trained laboratory staff, who are required for high-complexity assays. The limited hands-on-time for assay setup can also be factored into the cost-benefit equation. Ultimately, when selecting a laboratory screening method, each health care institution will have its own particular resources and speed requirements to consider.
We conclude that the Xpert MRSA assay is a novel, rapid, and accurate method for the determination of MRSA carrier status to support active surveillance programs. The results of this study show that the Xpert MRSA assay is reliable and reproducible for on-demand testing in health care settings where such testing is desirable.
We thank Linda Hilbert and Patricia Richards for their support, proofreading, and editing.
Published ahead of print on 7 January 2009. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»