Previous Article | Next Article ![]()
Journal of Clinical Microbiology, October 2008, p. 3285-3290, Vol. 46, No. 10
0095-1137/08/$08.00+0 doi:10.1128/JCM.02487-07
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

National MRSA Reference Laboratory, St. James's Hospital, James's St., Dublin 8, Ireland,1 Department of Clinical Microbiology, University of Dublin, Trinity College, St. James's Hospital, James's St., Dublin 8, Ireland,2 School of Biological Sciences, Dublin Institute of Technology, Kevin St., Dublin 8, Ireland,3 Department of Microbiology, St. James's Hospital, James's St., Dublin 8, Ireland4
Received 28 December 2007/ Returned for modification 9 April 2008/ Accepted 27 July 2008
|
|
|---|
|
|
|---|
In 2007, a new real-time PCR MRSA assay also targeting DNA sequences in the chromosomal orfX-SCCmec junction became available. This assay is the Xpert MRSA kit (Cepheid, Sunnyvale, CA), and it is used in conjunction with the GeneXpert real-time PCR platform (Cepheid). In the Xpert MRSA assay, DNA from specimens is extracted, amplified, and detected in separate chambers of single-use disposable cartridges which contain freeze-dried beads with all reagents required for the real-time process. Sample preparation time is minimal and the PCR time is 75 min. The assay is validated for use with nasal specimens taken on Copan swabs with Stuart's liquid transport medium from patients at risk for colonization with MRSA and has a quoted limit of detection (LoD) of 80 CFU per swab (Xpert MRSA assay product insert; Cepheid, Sunnyvale, CA).
The present study evaluated the Xpert MRSA assay for use in a clinical laboratory. The following parameters were investigated: (i) LoD, (ii) ability to detect isolates of MRSA in a collection representative of MRSA in Ireland since 1974 and to detect isolates carrying recently described SCCmec elements, and (iii) performance in a clinical trial with swabs from nose, throat, and groin/perineum sites from 204 patients.
|
|
|---|
One Copan swab from each dilution was investigated for the presence of MRSA by use of the Xpert MRSA kit on a GeneXpert DX system, version 1.2 (Cepheid, Sunnyvale, CA), according to the manufacturer's instructions. The second Copan swab was reserved for repeat testing if required.
The corresponding Transwab was cultured onto Columbia agar (LabM Lab1; International Diagnostics Group plc, Bury, United Kingdom) containing 7% (wt/vol) horse blood (BA), onto MRSA-Select chromogenic agar (CA) (Bio-Rad 63747; Bio-Rad Life Science Group, Marnes-La-Coquette, France), and into 4 ml tryptic soy broth (BD 211825; Becton Dickinson) containing 6.5% NaCl (salt TSB). After 18 h of incubation at 35°C, enrichment broths (10-µl volumes) were subcultured onto BA and CA. All isolates from enriched and direct culture were identified as S. aureus and confirmed as MRSA as described previously (16).
To express the LoD value as CFU/swab, the volume adsorbed by either Copan swabs or Transwabs was determined by measuring the difference in weights of bijoux of saline before and after adsorbance for 10 s by each of 10 Copan swabs and 10 Transwabs. The average of the 10 replicate readings was taken as the average volume adsorbed by each swab type.
LoDs were recorded as the lowest concentration to give positive results by the Xpert MRSA kit or by culture. The Xpert MRSA assay defines a specimen as MRSA positive if the MRSA target has a cycle threshold (CT) value within the valid range (
36 cycles). The LoDs for both culture methods were calculated on the basis of growth of >1 colony on a single culture medium or
1 colony on more than one medium and were expressed as averages of the counts obtained with the four isolates.
MRSA isolates and MRSA control strains.
To ensure that the kit could detect MRSA strains prevalent in Ireland, 114 MRSA isolates representative of MRSA recovered in Ireland were investigated (isolate details are shown in Table 1) (18). In addition, seven control MRSA strains representing isolates carrying SCCmec IV subtypes IVa (IV.1.1.1), IVb (IV.2.1.1), IVc (IV.3.1.1), IVd (IV.4.1.1), SCCmec V (V.1.1.1), VT, and VI were tested (2, 4, 13). Isolates were prepared in saline suspensions at concentrations of
102 CFU/ml above the LoD of the kit (determined in the present study) and adsorbed onto Copan swabs and Transwabs. One swab of each pair of Copan swabs was tested with the Xpert MRSA assay, and the Transwab was cultured onto BA and CA. Any isolate that was negative by use of the kit was retested in pure culture and at one 10-fold-higher concentration.
|
View this table: [in a new window] |
TABLE 1. MRSA isolates (n = 114) used to determine whether the Xpert MRSA kit could detect all strains of MRSA prevalent in Ireland
|
Specimens collected with Copan swabs were tested using the Xpert MRSA kit according to the manufacturer's instructions as soon as possible after collection. Specimens were tested in batches of eight by use of two four-module GeneXpert machines. If not tested immediately, specimens were stored at 4°C. Following processing, all specimens were stored at 4°C until all molecular and culture testing was complete. Specimens yielding invalid results were retested using the second Copan swab.
Specimens collected with Transwabs were inoculated onto CA in the diagnostic laboratory and subsequently cultured into salt TSB. After incubation at 35°C for 18 h, 10-µl volumes of salt TSB were subcultured onto BA and CA. Growth was identified as MRSA as described previously, and the presence of mecA was confirmed by a conventional in-house end-point PCR assay (16). All MRSA isolates were stored at –70°C on cryoprotective beads (Protect beads; Technical Service Consultants Limited, Heywood, United Kingdom). Bacterial growth from BA plates from specimens yielding positive Xpert MRSA kit results and negative MRSA culture results were also preserved at –70°C on cryoprotective beads. Discrepancies between culture and kit results were investigated by salt enrichment culture of the second Copan swab (if available).
MRSA isolates recovered from specimens yielding kit-negative results were prepared in suspensions in saline at concentrations of 105 CFU/ml, adsorbed onto Copan swabs, and tested using the Xpert MRSA kit. Bacterial growth from BA plates from specimens which tested Xpert MRSA kit positive but from which MRSA was not recovered in culture was similarly tested to exclude the possibility that such positive results occurred as a result of MSSA or MR-CNS.
Control strains. S. aureus ATCC 25923 and S. aureus ATCC 43300 were used as negative and positive controls, respectively. S. epidermidis ATCC 12228 was also used as a negative control as recommended by the manufacturer. Control isolates were prepared in saline suspensions containing 105 CFU/ml and adsorbed onto Copan swabs prior to testing. For determining LoDs, positive and negative controls were included with each batch of tests. When MRSA strains were tested, a negative control was included each day. During the clinical trial, a positive control was included once a week and after any batch of specimens where all specimens yielded kit-negative results. S. aureus ATCC 25923 and S. aureus ATCC 43300 were also included as negative and positive controls with each batch of CA plates.
Statistics. In the clinical trial, the sensitivities, specificities, and positive and negative predictive values of the Xpert MRSA kit were calculated for all specimen types by comparison with direct culture and by comparison with enrichment culture. Because the Xpert MRSA kit detects DNA which may come from nonviable MRSA, whereas culture detects viable organisms only, Xpert MRSA kit-positive specimens that were culture negative were considered as giving possible true-positive results if the patient had been previously positive for MRSA within the last 2 years or was positive at another site. Sensitivities, specificities, and positive and negative predictive values were also calculated using these amended results for all specimen sites and for each specimen site individually. Further calculations were made when patients were grouped into those who were known to have been previously positive for MRSA and those who were not known to have been previously positive.
|
|
|---|
![]() View larger version (36K): [in a new window] |
FIG. 1. Amplification data obtained with the Xpert MRSA kit for two of the four MRSA isolates used in LoD assays (A and B), two replicates of S. aureus ATCC 25923 (C and D), and two replicates of an MRSA isolate (tested at 106 CFU/ml) recovered from a specimen yielding a kit-negative result (E and F). All isolates demonstrated kit-negative results with appropriate amplification of the internal control. The amplification plots in panels A and B demonstrate an exponential rise in fluorescence emission that is consistent with amplification of the MRSA target, suggesting false-negative kit results. The amplification data shown in panel C are representative of results obtained with most replicates of S. aureus ATCC 25923, but on some occasions this MSSA isolate yielded a plot suggestive of MRSA target amplification (panel D). The data shown in panels E and F were obtained from an MRSA isolate tested at a bacterial concentration of 106 CFU/ml on two separate occasions. While both replicates yielded kit-negative results, one replicate demonstrated evidence of MRSA target amplification (panel F).
|
MRSA isolates and MRSA control strains.
When this study was designed, it was intended that the MRSA isolates and MRSA control strains would be tested in the presence of the mixed cocktail of bacteria to mimic normal flora, but the inconsistent results with the MSSA component of the cocktail suggested that this would be unwise. Isolate suspensions were therefore prepared in a pure culture in saline at a concentration of
104 CFU/ml (i.e.,
102 CFU/ml above the LoD determined in the present study). All MRSA isolates except two yielded positive Xpert MRSA kit results; one negative isolate was positive upon repeat testing, and the second negative isolate was positive when retested at a higher concentration (105 CFU/ml). All seven control MRSA strains yielded positive results.
Clinical trial. Six hundred twelve specimens from 204 patients were investigated. An overview of the numbers of positive specimens obtained with the Xpert MRSA kit, with direct culture, with enrichment culture, and with amended results is shown in Table 2. By use of amended results, Xpert MRSA kit-positive specimens that were culture negative were considered to be true-positive results if the patient had been previously positive for MRSA or was positive at another site. MRSA was detected in 99 specimens (16.2%; 99/612) from 58 patients (28.4%; 58/204) by the Xpert MRSA kit. Direct culture yielded positive results from 59 specimens (9.7%; 59/606) from 37 patients (18.3%; 37/202); direct culture results were unavailable for 6 specimens from 2 patients. Specimens from 89 specimens (14.5%; 89/612) from 45 patients (22.1%; 45/204) were positive by enrichment culture. No specimen was culture positive by direct culture and negative by salt enrichment culture. When amended results were calculated, 95 specimens (15.5%; 95/612) from 47 patients (23.0%; 47/204) were deemed positive. Sixteen specimens from 14 patients yielded invalid Xpert MRSA kit results upon initial testing, but upon repeat testing only four specimen results remained invalid (throat [n = 3]; groin [n = 1]).
|
View this table: [in a new window] |
TABLE 2. Overview of results obtained with the Xpert MRSA kit and culture from 612 specimens
|
Non-MRSA bacterial growths from BA plates from specimens which were kit positive and MRSA culture negative were also tested by the kit, but growths from all of these non-MRSA cultures yielded negative results with the kit.
Statistics. The sensitivity, specificity, and positive and negative predictive values of the Xpert MRSA kit compared with those obtained using direct culture, enrichment culture, and amended results are shown in Table 3. With nasal swabs, when the amended results were considered, the sensitivity of the kit was 95%. In comparison, its sensitivity for specimens from the throat was only 75%. When the Xpert MRSA kit results from specimens from all sites were compared with amended results, the overall sensitivity, specificity, and positive and negative predictive values were 90%, 97%, 86%, and 98%, respectively (Table 3). When this analysis was restricted to specimens from patients who were previously recorded as being MRSA positive, the sensitivity of the kit for nasal specimens was 93%, whereas with specimens from patients with no record of being previously positive (i.e., new MRSA patients), the sensitivity for nasal specimens was 100%.
|
View this table: [in a new window] |
TABLE 3. Sensitivity, specificity, and positive and negative predictive values of the Xpert MRSA kit compared with those from direct and enrichment cultures from nose, throat, and groin/perineum specimens
|
|
|
|---|
While RDTs may play a major role in reducing the prevalence of MRSA, the chosen method must be sensitive and specific and have good positive and negative predictive values. Failure to recognize a particular strain of MRSA can have very serious consequences, as was recently experienced in The Netherlands, where phenotypic tests failed to detect a mecA-positive strain with a low oxacillin MIC in one hospital. Over a 2-year period, this strain spread extensively not only within that hospital but in other hospitals also and it took over a year to control the resulting outbreaks (8).
As more molecular RDTs for MRSA become available, the choice of an appropriate assay becomes more difficult. Evaluating new molecular assays is expensive and time-consuming, and it is hard to exclude confounding variables, even when assays are evaluated at the same time. For example, the present study required duplicate specimens to allow comparison between the Xpert MRSA kit and enrichment culture. Because sampling using the routine Transwab method had to be undertaken prior to sampling with Copan swabs to ensure that the routine diagnostic culture protocol was not compromised by the clinical trial, it is possible that less material was available on the Copan swabs for detection by the Xpert MRSA assay. In contrast, in an earlier study evaluating the IDI-MRSA kit on the SmartCycler platform, swabs were cultured by salt enrichment after they had been used with the kit (16). In that evaluation, however, the LoD of salt enrichment culture (by use of Transwabs) was 240 CFU/ml (55 CFU/swab), whereas the LoD of salt enrichment culture (by use of Transwabs) in the present study was 9 CFU/swab, indicating that the Xpert MRSA kit was subjected to a more rigorous evaluation. A possible explanation for the lower LoD of salt enrichment culture in the present study is that the volume of medium used for salt enrichment was 4 ml, whereas the protocol in the IDI-MRSA kit evaluation used 1-ml volumes and enrichment culture was performed after material on the swab was removed for testing with the IDI-MRSA kit. Interestingly, the inclusion of enrichment culture increased the number of culture-positive specimens by 23% in the earlier study and by 51% (30/59) in the present study (16).
The Xpert MRSA assay demonstrated an average LoD (58 CFU/swab) threefold lower than that for direct culture (171 CFU/swab) but sixfold higher than that for enrichment culture (9 CFU/swab). In comparison, the earlier IDI-MRSA kit evaluation reported an average LoD value of 2,000 CFU/ml (equivalent to 190 CFU/swab), which was similar to the LoD of direct culture but 10-fold higher than the LoD of enrichment culture (16). The LoDs of direct culture with Transwabs were comparable in both studies: 171 CFU/swab in the present study and 800 CFU/ml (182 CFU/swab) in the earlier study (16).
The Xpert MRSA assay detected all MRSA isolates investigated, including control isolates exhibiting SCCmec V, VT, and VI (2, 4, 13). Although not investigated here, both Xpert MRSA assay and IDI-MRSA are reported to lack sensitivity when detecting the pulsed-field gel electrophoresis-nontypeable MRSA strain associated with pigs in The Netherlands (15, 19).
In the clinical trial, the Xpert MRSA assay exhibited sensitivities of 95% and 97% for detecting MRSA from nasal and groin/perineum sites but had difficulty detecting MRSA DNA from throat specimens (sensitivity, 75%). Interestingly although the previous evaluation of the IDI-MRSA kit reported lower sensitivities for nose and groin/perineum specimens (90% and 88%, respectively), specimens from the throat yielded a higher sensitivity (89%) (16).
A major difficulty evaluating molecular assays for the detection of MRSA from clinical specimens is defining true-positive and -negative specimens. In the present study, data were analyzed by direct comparison with culture, but to overcome the problem of considering all kit-positive culture-negative specimens as false-positive kit results, kit performance was analyzed using amended results where kit-positive culture-negative results from patients who were previously positive for MRSA were regarded as true-positive results. By use of these amended results for comparison, the sensitivities and specificities of direct culture, enrichment culture, and the Xpert MRSA assay were 60.6% and 99.6%, 84.2% and 98.3%, 89.5% and 97.3%, respectively. However, this comparison is not completely valid and may overestimate the sensitivity of the assay and underestimate that of culture because culture-negative results from patients who have undergone successful treatment for MRSA should not be considered false-negative culture results.
Despite the encouraging findings of the present study, the overall performance of the Xpert MRSA assay might be improved if result interpretation took account of all available assay data. The manufacturer's interpretation is based on the application of a CT cutoff value of 36 cycles, with specimens being recorded as MRSA positive if the CT is
36 and MRSA negative if the CT is >36, regardless of the presence or absence of evidence of amplification (the former being demonstrated by an amplification curve indicating an exponential rise in fluorescence emission). Data obtained in the present study suggested that this CT cutoff value might have introduced false-negative results both in the LoD investigations and during the clinical trial, where some tests (n = 14) demonstrated clear evidence of MRSA amplification but CT values exceeded 36 cycles (Fig. 1A, B, and F). Conversely, false-positive results may have also occurred (with the MSSA component of the mixed-culture cocktail, e.g.) where CT values of
36 were obtained and reported as positive but amplification curves failed to demonstrate an exponential rise. The inclusion of an equivocal interpretative category for tests where the amplification data of the MRSA target DNA fail to support the CT cutoff result warrants investigation.
Aside from the interpretative difficulties associated with the use of the CT cutoff value, findings from the present study also indicate that false-positive results may have occurred, due perhaps to a lack of specificity of the assay's proprietary target sequence for MRSA at the SCCmec-orfX junction. There are increasing numbers of reports of SCC elements that do not contain mecA, for example, SCCcap1 in MSSA, which integrates into the SCCmec chromosomal attachment site attB at the end of orfX (9, 10, 12). Although the Xpert assay recorded negative results for the MSSA control, S. aureus ATCC 25923, on some occasions the accompanying amplification curves demonstrated evidence of amplification of target DNA (Fig. 1D), suggesting that like the IDI-MRSA assay, the Xpert MRSA kit may have the problem of detecting SCC in MSSA strains such as S. aureus ATCC 25923, which may be why the manufacturer recommends the use of S. epidermidis ATCC 12228 as the negative control (6). This problem requires further investigation.
While the Xpert MRSA assay requires more interpretation than currently suggested by the manufacturer, it was found to perform well with nasal and groin/perineum specimens. It is rapid and easy to use and has the advantage of random access (i.e., an urgent specimen can be accommodated because specimens do not need to be tested in batches). Relative to culture, it is expensive, and results need to be confirmed by culture. A more extensive prospective study is warranted to determine its role in clinical practice in Ireland. A question that such a prospective clinical study might investigate is the duration of kit-positive results from specimens from patients who have been successfully treated for MRSA and whether there is a period during which previously culture-positive patients should not be screened by molecular methods. These data could inform how kit-positive results from patients who are known to have been previously positive for MRSA should be interpreted.
There are no conflicting interests to declare.
Published ahead of print on 6 August 2008. ![]()
|
|
|---|
This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»