United Kingdom National External Quality Assessment Scheme for Microbiology, Quality Assurance Laboratory, Health Protection Agency Centre for Infections, London, United Kingdom
Received 27 September 2004/ Accepted 17 November 2004
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
The United Kingdom National External Quality Assessment Scheme for Microbiology (UK NEQAS for Microbiology) has specialized in the production and performance analysis of external quality assessment (EQA) panels for a wide range of bacteria, fungi, parasites, and viruses for more than 30 years. An EQA panel for the detection of C. trachomatis by EIA and IF was introduced in 1991, and more-challenging specimens specifically designed to test NAAT methods have been included in the scheme from 2002. In addition to the EIA-IF schemes, a pilot scheme for the molecular detection of C. trachomatis is under development, and panels for testing by NAAT methods only have been distributed recently.
Verkooyen et al. (26) described the results obtained from an international EQA scheme consisting of freeze-dried urine specimens. The authors reported difficulty in the detection of C. trachomatis at lower concentrations and found no difference between the NAAT methods Roche AMPLICOR CT/NG, Roche COBAS AMPLICOR CT/NG, and Abbott LCx. Accurate detection of C. trachomatis was common, ranging from 89 to 100%. A further EQA study of detection of C. trachomatis in urine samples, based in Australia, found varying performance depending on the concentration (0 to 100%) and reported that low-level positives could not be detected consistently by a single test (18). In contrast to the results reported by Verkooyen et al. (26), Land et al. (18) found that at lower concentrations of C. trachomatis, the Roche AMPLICOR CT/NG assay was more sensitive than the Abbott LCx. However, Goessens et al. (14) examined the detection of C. trachomatis in female specimens (urine and swabs) and found no difference among three commercial tests (Abbott LCx, Gen-Probe AMP-CT, and Roche COBAS AMPLICOR CT/NG).
The aim of this retrospective study was to analyze the effective detection of C. trachomatis in simulated endocervical swab specimens by clinical laboratories participating in the EIA and molecular EQA schemes distributed internationally by UK NEQAS for Microbiology between January 2002 and June 2004. Negative specimens and those that were designed to challenge participants by including low levels of elementary bodies (EB) per milliliter were included in the study. Two C. trachomatis strains were included in the study: one L2 laboratory-adapted strain and one primary clinical isolate. Due to the large number of participants in the study, additional data were collected that provided insight into the differential performance of the methodologies in use in clinical laboratories. Therefore, the accurate detection of C. trachomatis by participants, different methods (EIA or NAAT), and commercial assays was compared with the C. trachomatis EQA specimens distributed. A total of eight negative specimens were also distributed, and the number of false positives reported was calculated.
| MATERIALS AND METHODS |
|---|
|
|
|---|
|
Before distribution, the specimens were tested for C. trachomatis by a range of laboratories using BDProbeTecET, Gen-Probe AMP-CT, in-house PCR, and Roche AMPLICOR CT/NG (for all panels) and Dade Behring Microtrak II EIA and Dako IDEIA PCE (for panels 1500 to 1733).
To monitor specimen delivery and the effects of transit on the specimen, five specimen sets from each panel were posted within each consignment to five different sites around the United Kingdom and, upon receipt, were returned by post to UK NEQAS for Microbiology for retesting.
Distribution information. Each proficiency panel consisted of four specimens, a reply form, and an instruction sheet. Participants were provided with instructions to reconstitute freeze-dried specimens in 0.5 ml of molecular-grade RNase-free water immediately prior to analysis, add 0.1 ml of the reconstituted specimen to their transport medium, and extract by the usual laboratory routine. For liquid specimens, participants were instructed to examine 0.1 ml of each specimen for C. trachomatis by their routine method. Participants were requested to test for the presence of C. trachomatis in each specimen and report results within 21 days of posting. Results were received by fax, post, or e-mail or via a World Wide Web online reporting system. Ten panels have been distributed since 2002, and the data presented here include a total of 22 specimens, 14 positive and 8 negative, from these distributions (Table 1). The median concentration of C. trachomatis in each specimen, in EB per milliliter, is shown in Table 2. Specimens were distributed to 91 to 295 participating laboratories (Table 1), predominantly in the United Kingdom, but also in other countries including Austria, Belgium, Denmark, Finland, Greece, Hong Kong, Ireland, Israel, Italy, Kuwait, The Netherlands, Norway, Portugal, Slovenia, Sweden, Switzerland, and Zambia.
|
| RESULTS |
|---|
|
|
|---|
For the L2 strain, the rate of detection of C. trachomatis by participants ranged from 32.3 to 83.6% (Table 1). The rate of C. trachomatis detection by users of molecular methods ranged from 66.4 to 98.6% and was significantly higher than that with EIA methods, which ranged from 2.3 to 69.2% (P = 0.00 by Fisher's exact test [Table 1]).
When all data for the L2 strain were compared, no difference was noted between the Abbott LCx, the BDProbeTecET (risk difference coefficient, 7.93 x 1014; P = 1.0), and the Roche AMPLICOR/COBAS CT/NG method group (risk difference coefficient, 2.89 x 1014; P = 1.0). There was no significant difference between molecular methods at dilutions of 1:200 through 1:2,000. However, detection of C. trachomatis by all methods showed significant differences at dilutions greater than 1:2,000 (risk difference coefficients, 1.81 at 1:2,500 [P = 0.007] and 0.27 at 1:3,000 [P = 0.04]), indicating that all methods are less likely to detect C. trachomatis at lower concentrations of the pathogen. The Abbott LCx accurately detected C. trachomatis in 72.7 to 100% of specimens, the BDProbeTecET method detected it in 31.4 to 100% of specimens, and the Roche AMPLICOR/COBAS CT/NG method group detected it in 84.5 to 100% of specimens. Significant differences were found in the likelihood that each method would report a positive result when risk difference analysis was used to compare the Abbott LCx, the BDProbeTecET method, and the Roche AMPLICOR/COBAS CT/NG method group, with differences calculated at each level of dilution. The BDProbeTecET method was less likely to give a positive result at dilutions of 1:1,200 and higher (risk difference coefficients, 0.69 at 1:1,200 [P = 0.00], 0.14 at 1:1,500 [P = 0.04], 0.2 at 1:2,000 [P = 0.11], 0.17 at 1:2,000 [P = 0.02], 0.26 at 1:2,500 [P = 0.007], and 0.27 at 1:3,000 [P = 0.071]), and the Abbott LCx was less likely to give a positive result at dilutions of 1:2,500 and higher (risk difference coefficients, 0.16 at 1:2,500 [P = 0.02] and 0.2 at 1:3,000 [P = 0.14]).
To enable comparison of results for the L2 strain and strain 6498 (for which no Abbott LCx data were available), further analysis was performed to compare all L2 strain data for the BDProbeTecET and the Roche AMPLICOR/COBAS CT/NG method group. No difference was found when all data were compared (risk difference coefficient, 2.03 x 1014, P = 1.0). Significant differences were found in the likelihood that each method would report a positive result when risk difference analysis was used to compare the BDProbeTecET method and the Roche AMPLICOR/COBAS CT/NG method group, with differences calculated at each level of dilution (Table 2). The BDProbeTecET method was less likely to give a positive result than the Roche AMPLICOR/COBAS CT/NG method group at dilutions of 1:1,200 to 1:3,000 (Table 2) for the L2 strain.
The rate of detection of strain 6498 ranged from 32.7 to 100% for the specimens distributed (Table 1). Only molecular tests were performed on these specimens. No difference was noted between the BDProbeTecET and the Roche AMPLICOR/COBAS CT/NG method group when all data for the specimens containing strain 6498 were compared (risk difference coefficient, 5.02 x 1024, P = 1.0). In addition, comparison of C. trachomatis detection by the two methods between the 1:40 dilution and other dilutions gave a significant difference at the 1:250,000 dilution only (risk difference coefficient at 1:250,000, 0.67; P = 0.00), indicating that both methods are less likely to detect C. trachomatis at lower concentrations of the bacterium. The BDProbeTecET method accurately detected C. trachomatis in 33.3 to 100% of specimens, and the Roche AMPLICOR/COBAS CT/NG method group detected it in 31.7 to 100%. Unlike the findings for the L2 strain, no significant difference was found in the likelihood that each method would report a positive result when risk difference analysis was used to compare the BDProbeTecET method and the Roche AMPLICOR/COBAS CT/NG method group with differences calculated at each level of dilution (Table 2). The two methods were equally likely to give a positive result with strain 6498.
There was no significant difference in the detection of the two different C. trachomatis strains by users of all molecular tests (P = 0.76 by Fisher's exact test; for strain L2, 992 of 1,168 tests [84.9%] were positive [95% confidence interval {95% CI}, 82.8 to 86.9%]; for strain 6498, 396 of 462 tests [85.7%] were positive [95% CI, 82.2 to 88.8%]). Similarly, comparison of the detection of the two C. trachomatis strains by users of the BDProbeTecET method showed no difference (P = 0.18 by Fisher's exact test), and no difference was noted in the detection of the two strains by the Roche AMPLICOR/COBAS CT/NG method group tests (P < 0.42 by Fisher's exact test). However, comparison of BDProbeTecET with the Roche AMPLICOR/COBAS CT/NG method group showed that the latter was more likely to detect C. trachomatis in specimens containing the L2 strain (P < 0.008 by Fisher's exact test), whereas no difference was seen in the detection of strain 6498 (P = 1.0 by Fisher's exact test).
For the eight negative specimens that were distributed, 0.3 to 1.5% of results were positive. A total of 20 positive results and 2,080 negative results were received. The positive results were received from 18 different participants using a range of methods (bioMérieux VIDAS [n = 4], Murex Diagnostics [n = 1], Dako IDIEA [n = 1], Launch Diagnostics Phadebact Chlamydia EIA [n = 3], Unipath Clearview Chlamydia [n = 4], Abbott LCx [n = 1], BDProbeTecET [n = 3], Gen-Probe AMP-CT [n = 1], and Roche AMPLICOR CT/NG [n = 2]). A single participant reported three negative specimens as positive, whereas all other false positives were received from separate participants.
| DISCUSSION |
|---|
|
|
|---|
The ability of laboratories to detect C. trachomatis in the EQA panels included in this study has been variable. In general, those using EIAs were significantly less likely to report detection of C. trachomatis than those using the molecule-based NAAT. With a specimen containing approximately 833 EB/ml, only 2.3% of laboratories using EIAs detected C. trachomatis, in comparison to 66.4% of those using NAAT. These findings are in concordance with those of other studies, and it is now accepted that NAAT are superior to EIA-based tests for detection of C. trachomatis (22, 28). However, in this study only those specimens that were designed to be challenging to participants were included, and at higher concentrations such a difference may not exist. Furthermore, NAAT are not without problems, including the effects of inhibitors in the specimens, contamination, sensitivity, reproducibility, and variation in the efficiency of nucleic acid extraction (4, 6, 7, 10, 11, 15, 16, 19, 23, 24).
At higher concentrations of C. trachomatis, detection by NAAT was excellent, irrespective of the method used or the strain under test. Interestingly, we found that the BDProbeTecET method was less likely to detect C. trachomatis than the Roche AMPLICOR/COBAS CT/NG method group at lower concentrations of the L2 strain only. With the clinical isolate no difference was seen, a finding similar to the results of Chan et al. (8). Further analysis indicated that differences in strain detection did not occur with the BDProbeTecET method or with the Roche AMPLICOR/COBAS CT/NG method group. To date at least 18 serotypes of C. trachomatis have been recognized (12, 21, 27). Serotypes are distinguished by differences in the sequence of the ompA gene, which encodes the major outer membrane protein (MOMP). Although MOMP types differ by geographical region, no differences are seen between the serotypes present in males and females in the same population (21). Specific serotypes are associated with particular infections: types A, B, and Ba are commonly associated with trachoma, types C to K are associated with lower and upper genital tract infections, and the lymphogranuloma venereum serotypes L1, L2, L2a, and L3 are associated with more-severe infections such as proctitis and lymphadenitis (2, 5, 21). Furthermore, a strain has been associated with concurrent infection with Neisseria gonorrhoeae (3). Although the serotype of the clinical isolate used in this study, 6498, is not known, it is possible that differences in performance could be attributed to the differential efficacy of the Roche AMPLICOR/COBAS CT/NG method group with different strain types. However, the product insert for the Roche AMPLICOR/COBAS CT/NG method group states that the lower detection limit is the same for all 12 serotypes tested: 80 inclusion-forming units/ml. It is possible that strain 6498 is also an L2 strain, although this would be unusual for a clinical isolate from the United Kingdom. In the future, it would be interesting to distribute defined serotypes at known concentrations in EQA panels to determine whether differences in detection and/or sensitivity actually occur with different serotypes in clinical laboratories. It is also possible that these results have highlighted the fact that the BDProbeTecET method is less able to detect the L2 strain at lower concentrations, and analysis comparing the Abbott LCx results to those of the BDProbeTecET method and the Roche AMPLICOR/COBAS CT/NG method group showed that the BDProbeTecET method was less likely to detect the L2 strain in the lower-concentration specimens whereas the Roche AMPLICOR/COBAS CT/NG method group was more likely to detect the L2 strain. Unfortunately, due to discontinuation of the manufacture of the Abbott LCx test, comparison with strain 6498 was not possible. Interestingly, McCartney et al. (20) found that the sensitivity and specificity of the BDProbeTecET method were comparable to those of the Abbott LCx in testing of male urine and (female) endocervical samples; however, a lower detection rate was found with the BDProbeTecET method for female urine specimens, which contain lower concentrations of C. trachomatis. Furthermore, the product insert information for the BDProbeTecET method states that detection levels differ depending on the serotype in question, ranging from 5 to 200 EB/reaction, and that 15 EB/reaction is the limit of detection for type LGV2. Differences in the sensitivity of detection may affect epidemiological data, and most importantly, the identification of infected patients may be missed, resulting in inappropriate treatment or no treatment and the development of serious physical sequelae, psychological effects, and further transmission of the pathogen.
The rate of false positives in this study was low (0.3 to 1.5%) and was not associated with any method. False positives were common in a single participating laboratory only, which reported three consecutive negative specimens as positive; all other false positives were reported by separate participants. The results found in this study are similar to those reported by Land et al. (0 to 3% false-positive C. trachomatis results with urine specimens [18]).
A major drawback of this study is the use of simulated specimens in place of real clinical specimens. However, it would be very difficult to obtain the required volume of endocervical swab medium with sufficient uniformity of consistency and of C. trachomatis concentrations. Land et al. (18) reported that clinical urine specimens are problematic when used in EQA due to issues of stability and storage, and Kellogg et al. (17) noted that differences in detection are highly dependent on the quality of endocervical specimens. The benefits of using simulated specimens include the ability to define stability, concentration, and uniformity. The major difference between the two strains used in this study lies in the preparation of specimens with the chemical constituents of the medium used and the physical state of the specimens (liquid or freeze-dried). It is possible that these physical and chemical differences could have affected extraction and amplification efficiency, resulting in the differences in performance with the L2 strain. Strain 6498 was freeze-dried and was made with a liquid matrix different from that for the L2 strain. The process of freeze-drying could have damaged the C. trachomatis cells by disrupting cellular integrity, thereby releasing nucleic acid more readily. Freeze-drying could also have had an effect on the aggregation of the bacterial cells. However, the latter possibility is unlikely, because upon IF analysis, no aggregates were seen in freeze-dried specimens (data not shown). It is possible that the composition of the matrix could affect the detection of C. trachomatis, and specific chemical inhibitors and inhibitors in urine are known (4, 9, 19, 23). However, this study did not include inhibitors or their indicators such as hemoglobin, nitrates, and ß-human chorionic gonadotropin in the specimens, although Earle's balanced salt solution with Bronidox and sucrose were used. Land et al. (18) included some specimens with inhibitors and noted that a significant number of participants reported a positive specimen with inhibitors as negative; these differences were not linked to specific methods.
A variety of sample types are tested for C. trachomatis in clinical laboratories. A recent poll of participants by UK NEQAS showed that 100% routinely test endocervical swabs and urine samples by molecular methods, with endocervical swabs representing the most frequently tested sample type. Of these laboratories, 51% also test other sample types (throat, rectal, and conjunctival swabs) less frequently. Varying the specimen types for EQA to include both endocervical swabs and urine specimens would more accurately reflect procedures in the clinical laboratory.
The current expanded gold standard for C. trachomatis detection includes the confirmation of a positive result with a second, different test (28). In 2002, meta-analysis showed that the majority of laboratories use one test only and do not confirm with a second, distinct test (28). In a recent UK NEQAS for Microbiology scheme (distribution 1734), 78% of participants reported that they routinely confirm positive results for C. trachomatis whereas 7% reported that they do not routinely confirm positives. Of those confirming positive results, only 1% used a different NAAT while 72% confirmed positive results by repeat testing with the same assay. Gaydos et al. (13) expressed concern at the cost of repeat testing. The retention of two separate NAAT platforms may simply be beyond the financial and staff resources of smaller laboratories.
In summary, the performance of participating laboratories in the detection of C. trachomatis in simulated EQA specimens was diverse. The detection of C. trachomatis by participants using NAAT was superior to that by those using EIAs. False positives were rare, and detection was excellent, at higher concentrations of C. trachomatis irrespective of the method used or the strain under test. The Roche AMPLICOR/COBAS CT/NG method group was more likely to detect the L2 strain than the Abbott LCx and BDProbeTecET methods in specimens containing lower concentrations, whereas no difference was noted between the Roche AMPLICOR/COBAS CT/NG method group and the BDProbeTecET method with clinical isolate 6498. The use of simulated specimens enabled powerful use of EQA results by testing differing strains and concentrations, reflecting the concentrations found in varying specimen types. The chemical matrix, physical presentation, and strain used in EQA specimens may affect results and should be considered in the design of EQA specimens. Future EQA studies should include a range of specimen types and a variety of C. trachomatis subtypes so as to more accurately reflect routine procedures in clinical diagnostic laboratories.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. |
|---|---|
| Clin. Vaccine Immunol. | ALL ASM JOURNALS |
|---|