Previous Article | Next Article ![]()
Journal of Clinical Microbiology, April 2004, p. 1471-1476, Vol. 42, No. 4
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.4.1471-1476.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
McMaster University,1 Father Sean O'Sullivan Research Centre, St. Joseph's Healthcare, Hamilton, and,2 Sunnybrook and Women's College Health Sciences Centre, University of Toronto and Heathcare Network,3 The Hospital for Sick Children Toronto, Ontario L8N 4A6, Canada4
Received 10 October 2003/ Returned for modification 26 November 2003/ Accepted 14 December 2003
|
|
|---|
|
|
|---|
Despite certain noteworthy characteristics of SARS, namely, the absence of upper respiratory tract symptoms, the presence of dry cough, and minimal auscultatory findings, with consolidation on chest radiographs, the clinical features of SARS do not readily allow a distinction from other common causes of respiratory viral infections. For this reason and because at the onset of the outbreak the etiologic agent of the atypical pneumonia was not known, case definitions were used to identify suspect and probable cases and to assist with infection control practices in managing the epidemic (1, 15). Once the SARS-CoV was sequenced, nucleic acid amplification tests were quickly developed to identify the virus in clinical specimens, and the SARS-CoV was shown to be the etiologic agent of SARS (3). In the absence of commercially available tests, a number of in-house reverse transcription-PCR (RT-PCR) assays targeting several areas of the viral genome have been described (2, 4, 7, 9, 10). Both consensus CoV and SARS-CoV-specific primers were developed to amplify the polymerase gene by using both conventional heat block (CHB) assays and real-time PCR instruments. Despite the lack of data on the performance of these assays, they have been proven useful in identifying cases both in the hospital and at autopsy (6, 12b). In the absence of any published comparative data on sensitivity and specificity, we evaluated the performance of seven different conventional and real-time PCR assays for the detection of SARS-CoV with a range of clinical specimens collected during the Toronto SARS outbreak of 2003 (14).
(The results of this study were presented in part at the 43rd Interscience Conference on Antimicrobial Agents and Chemotherapy in Chicago, Ill., in September 2003.)
|
|
|---|
RNA extraction. RNA was extracted by using the Qiagen RNeasy kit according to the manufacturer's instructions with the following modifications for stool and urine specimens. Approximately one gram of stool was emulsified in 5 ml of diethyl pyrocarbonate-treated water and vortexed for 10 s in a 50-ml conical centrifuge tube. The suspension was allowed to stand for 2 min. A 600-µl aliquot was removed from the top layer of the suspension and put into a 1.5-ml microfuge tube. An equal volume of Qiagen RLT lysis buffer containing ß-mercaptoethanol was added and mixed by repeat pipetting. The suspension (600 µl) was added to a Qiashredder column and centrifuged at 14,000 rpm for 2 min in a microfuge. The column was removed, and 600 µl of 70% ethanol was added to the filtrate. After a mixing step, 600 µl of the mixture was added to an RNeasy column, and extraction was conducted according to the manufacturer's instructions. In the absence of optimized protocols for testing urine samples for SARS-CoV and, since Qiagen extraction kits can only handle 0.5-ml portions of specimen, 5 ml of urine was centrifuged at 3,000 rpm for 10 min (Beckman benchtop centrifuge), and the sediment was resuspended in 600 µl of RLT buffer. RNA was extracted with RNeasy columns. For respiratory specimens (sputum, bronchoalveolar lavage, and pleural fluid), 600 µl of sample was added to 600 µl of RLT buffer, and RNA was extracted by using RNeasy columns. RNA was eluted in 30 µl of elution buffer, and an aliquot (2 to 4 µl) was used for RT.
RT-PCR. Six in-house RT-PCR assays were evaluated for the detection of SARS-CoV RNA. These included three CHB assays (one nested and two non-nested) and three real-time assays targeting three different regions of the genome. The probes and primers for each assay are listed in Table 1, and the conditions of amplification are listed in Table 2. Assay 1 was nested with the RT step combined with the first round of PCR amplification, followed by a second round of PCR amplification. Assay 1 used the BNI outer (BNIoutS2/BNIoutAs, 190-bp product) and inner (BNIinS and BNIAs) primers and amplified a 109-bp fragment downstream of the polB gene. Assay 2 was two-step, non-nested assay with the BNI outer primers (BNIoutS2 and BNIoutAs) and amplified the same 190-bp fragment downstream of the polB gene. Assay 3 was a two-step, non-nested RT-PCR assay with Cor-p-F2 and Cor-p-R1 primers (sequence courtesy of Dean Erdman) and amplified a 368-bp fragment of the polB gene. For assays 1, 2 and 3, RT was performed with Moloney murine leukemia virus enzyme from Invitrogen in a 20-µl reaction volume. Each RT reaction contained 5 µl of sample RNA, 0.1 µg of random hexamers as the primer, 0.625 mM deoxynucleoside triphosphates, 4 µl of first-strand buffer, 10 mM dithiothreitol, 40 U of RNAguard (Amersham, Mississauga, Ontario, Canada), and 200 U of Moloney murine leukemia virus reverse transcriptase. The reaction was incubated at 37°C for 1 h and then heat inactivated at 70°C for 15 min. For PCR, 4 µl of the RT reaction was added to 46 µl of PCR amplification master mix or 16 µl for the LightCycler (LC; Roche Diagnostics) assays. For assay 1, RT-PCR was performed with Superscript II/Platinum Taq (Invitrogen/Life Technologies, Burlington, Ontario, Canada). Assays 2 and 3 were performed with AmpliTaq Gold PCR kits from Applied Biosystems, Inc. (Foster City, Calif.). Amplified product was detected by agarose gel electrophoresis with ethidium bromide staining. All in-house assays were optimized for all assay parameters, including MgCl2 concentration, primer concentration, probe concentration, and annealing and acquisition temperatures (real-time assays).
|
View this table: [in a new window] |
TABLE 1. Oligonucleotide
sequences of primers and probes for SARS RT-PCR assays
|
|
View this table: [in a new window] |
TABLE 2. Description
of SARS PCR assaysa
|
The RealArt HPA CoV RT-PCR assay from Artus (Artus GmbH, Hamburg, Germany) was performed in the LC according to the manufacturer's instructions. This assay is a non-nested, one-step RT-PCR that uses proprietary primers to amplify an 80-bp fragment of the SARS-CoV genome downstream of the polB gene. Amplification was detected with a TaqMan probe, and the signal acquisition was set at 55°C on the LC.
Statistical analysis. Sensitivity was calculated as the percent positive, for each test, of 18 clinical specimens from suspected SARS patients that were determined to be positive in at least two of the seven assays. Specificity was calculated as the percent negative, for each test, of 50 clinical specimens that tested positive in none or one of the seven assays. Note that if we had defined any test positive as a true positive, the specificity of all assays by definition would have been 100%.
To compare the sensitivities and specificities of the seven assays, the Cochrane Q test (which compares three or more tests on the same samples) was used. Pairwise comparisons were then made by using the McNemar test, which compares two tests made on the same samples. To more precisely compare the relative sensitivities of the various assays, probit regression analysis was used to estimate the sample dilution at which each test detected 50% of samples with five replicate aliquots of log10 serial dilutions of SARS-CoV RNA (SPSS 11.5; SPSS, Inc., Chicago, Ill.). A P value of 0.05 (two tailed) was considered statistically significant.
|
|
|---|
The analytical sensitivity of all assays was initially compared by testing serial dilutions of a SARS-CoV RNA extracted from lung tissue and then by testing serial dilutions of SARS-CoV-infected cell lysate. All seven assays had similar analytical sensitivities with detection endpoints within 1 or 2 log10 dilutions of each other between 108 and 106 (Fig. 1), corresponding to a limit of detection of between 1 and 100 copies of viral RNA per PCR. Two assays (assay 6, the nucleocapsid TaqMan assay, and assay 7, the Artus assay) showed a trend toward a higher sensitivity with 107 and 108 endpoint dilutions. When testing was repeated with five replicates at each dilution (data not shown), these two assays were significantly more sensitive than the others; probit regression analysis for the sample dilution corresponded to 50% detection (assay 7 versus assay 2, P < 0.001; assay 7 versus assay 6, P < 0.01; and assay 6 versus assay 2, P < 0.05).
![]() View larger version (61K): [in a new window] |
FIG. 1. Analysis
of amplification products of seven RT-PCR assays for SARS-CoV RNA.
Amplification products of both CHB and real-time PCR assays were
analyzed by agarose gel electrophoresis and ethidium bromide staining.
Outside lanes (M) contain molecular weight markers. The sizes
of the amplification products for the various assays are as follows:
109 bp for assay 1, 190 bp for assays 2 and 4, 368 bp for assay 3, 149
bp for assays 5 and 6, and 80 bp for assay 7. Serial dilutions of
SARS-CoV RNA from 102 to 1012
were run in each gel. For assays 1, 4, and 7, the order of the lanes is
as follows: SARS RNA dilutions of 102 to
1012 are in lanes 1 through 11, swine CoV RNA is in
lane 12, bovine CoV is in lane 13, human respiratory CoV OC43 is in
lane 14, avian CoV (Connecticut strain) in lane 15, avian CoV
(Massachusetts strain) is in lane 16, a SARS-CoV RNA-positive control
is in lane 17, and negative controls are in lanes 18 and 19. For assays
2, 3, 5, and 6, the order of the lanes is as follows: lane 1, no
template control; lanes 2 to 12, SARS RNA dilutions of
102 to 1012; lane 13, swine CoV
RNA; lane 14, bovine CoV; lane 15, human respiratory CoV OC43; lane 16,
avian CoV (Connecticut strain); and lane 17, avian CoV (Massachusetts
strain). The last dilution giving an amplification product was
106 for assays 2, 3, 4, and 5;
107 for assay 6; and 108 for
assays 1 and
7.
|
Testing 68 clinical specimens (17 respiratory specimens, 22 stool samples, and 29 urine samples) showed that 63 specimens had the same results in all seven assays; 46 were negative and 17 were positive, with only 5 discordant specimens. By our criteria that required a positive result in two or more assays, there were a total of 18 positives and 50 negatives. The sensitivities and specificities of the seven assays were similar, with sensitivities ranging from 83.3 to 100% and specificities ranging from 94 to 100% (Table 3). Differences in sensitivities were, however, not significant (assay 2 [18 of 18] versus assay 6 [17 of 18], P = 0.5; assay 2 [18 of 18] versus assay 6 [15 of 18], P = 0.25 [McNemar test]). The specificities of the assays ranged from 94.0 to 100% and were not significantly different (assay 2 [47 of 50] versus assay 1 [50 of 50], P = 0.25; assay 4 [48 of 50] versus assay 1 [50 of 50], P = 0.5 [McNemar test]). None of the assays was both 100% sensitive and specific. The results for the five discordant specimens are shown in Table 4. Two of the five discordant specimens were positive in two tests, and the other three were positive in a single test, suggesting that most of the discordant results were false-positive results.
|
View this table: [in a new window] |
TABLE 3. Sensitivity,
specificity, and predictive values for SARS PCR assaysa
|
|
View this table: [in a new window] |
TABLE 4. RT-PCR
results for five discordant specimensa
|
|
View this table: [in a new window] |
TABLE 5. Relative
costs of various SARS PCR assaysa
|
|
|
|---|
Our evaluation of seven different PCR assays for SARS-CoV revealed that, despite their different formats, the seven different assays performed similarly. The clinical sensitivities ranged from 83.3 to 100%; however, the differences were not significant (P = 0.25 for assay 6, with 15 of 18 isolates versus 18 of 18 isolates [McNemar test], and P = 1.0 for assays 1, 3, 5, and 7, with 17 of 18 versus 18 of 18 isolates). The differences in specificities between the seven assays (94 to 100%) were also not significant (P = 0.25 for the lowest versus the highest). This lack of significant differences in sensitivity with clinical specimens was surprising given the differences in the analytical sensitivities of the assays. Despite the most sensitive assays having analytical sensitivities 16 to 166 times higher than the other assays (dilution for 50% detection by probit analysis), they did not show significant improvements in clinical performance. One reason may be that clinical specimens contain amplification inhibitors that copurify with RNA and adversely affect different assays. Alternatively, the similar sensitivity that we observed for the different assays could have been due to the high viral load of SARS-CoV in the clinical specimens used in our study. One might expect a reduced sensitivity of some of these assays when specimens with lower viral loads are tested. This possibility could be examined in future studies by correlating viral loads with PCR results for various assays. An improved understanding of the natural history of SARS-CoV infection, in particular, of which clinical specimens contain the most virus, will assist clinicians and laboratories in diagnosing SARS cases. Analysis of serially collected specimens from SARS cases in the Toronto outbreak has indicated that stool specimens contain a large amount of virus, are positive early in the course of infection, and may be the preferred specimen for diagnosis (12b). If assay sensitivity becomes a problem, then improvements in RNA extraction and/or recovery, together with testing of replicate aliquots of extracted RNA (12), should increase assay sensitivity. Another explanation could be that there were real differences in the performance of the assays that were not detected here due to the small number of specimens. Our evaluation was limited in size to 68 clinical specimens, and additional evaluations with larger numbers of clinical specimens may be required to determine whether there are significant differences in the performance of various assays for the detection SARS-CoV in clinical specimens.
Our decision to use as a "gold standard" for defining true positives, specimens that were positive in at least two tests, was arbitrary but was guided by the fact that, if we had defined a positive specimen as one that was positive in a single test, then the specificity of all assays would have been 100%, which would have been unrealistic. Assay performances could change if a different reference standard was used. For example, if we had defined a positive as being positive in any single test, then assays 2 and 4 would have been the most sensitive. We felt, however, that being positive in two different assays was a more rigorous way to define true positives and to detect false positives. This was, in fact, borne out by repeat testing of three specimens that were positive initially in assay 2 that repeated as negative (Table 4). Future studies with larger numbers of specimens could examine the role of choosing various reference standards.
A comparison of the cost of performing each assay, including the costs of both reagents and the technologist's time, indicated that the cost of the in-house assays ranged from $5.46 to $9.81 CDN per test, the least expensive being the two-step CHB assays and the most expensive being the two-step LC assay. By comparison, the cost of the commercial assay was $40.37 per test (this might be reduced with contract purchasing). Given that most laboratories faced with a SARS test request would not wait to batch specimens, cost comparisons for a single test per run may also be useful. Additional costs for in-house quality controls that are included in the commercial test would bring the prices closer together. When the cost of RNA extraction was added to each assay the actual costs of testing one specimen ranged from $9.64 to $13.99 for the in-house assays and $44.55 for the commercial assay. For laboratories setting up SARS testing for the first time without pedigreed specimens and controls, the commercial test may offer a quick start-up.
Laboratories setting up SARS-CoV PCR testing can therefore choose between various PCR assay formats and have an assay suited to their specific needs and instrumentation that will provide good sensitivity and specificity. The use of a second confirmatory PCR with a different amplification target will provide laboratories with some assurance that specimens giving positive PCR results are true positives. With this in mind, we developed an LC assay (assay 6) that targets the nucleocapsid gene and uses a TaqMan probe that can be used to confirm positive results obtained with the commercial RealArt HPA assay that targets a region downstream of the polB gene. The performance of the nucleocapsid LC assay has recently been validated in a multicenter evaluation involving nine different laboratories (J. B. Mahony et al., unpublished data). Since, in some SARS patients, seroconversion may take as long as 28 days postinfection (1, 12b), the laboratory diagnosis of SARS will continue to rely heavily on the detection of viral RNA by PCR. Given the unknown specificity of available SARS PCR tests in current use and the obvious consequences of reporting a SARS false-positive result, laboratories would be wise to confirm PCR-positive specimens by using a second assay that targets a different part of the genome.
We thank S. Carman and D. Ojkic (University of Guelph) for porcine, bovine, and avian CoVs; Martin Petric (British Columbia CDC, Vancouver, Canada) for SARS-CoV (Tor2 strain)-infected cell lysate; and Thomas, F. Smith (Mayo Clinic, Rochester, Minn.) for human respiratory CoV (strain OC43) RNA.
This study was funded in part by the Ontario Ministry of Health and Long-Term Care and the Canadian Institute of Health Research.
Contributing
members of the Working Group are listed in
Acknowledgments. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2010 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»