Previous Article | Next Article ![]()
Journal of Clinical Microbiology, June 2005, p. 2764-2770, Vol. 43, No. 6
0095-1137/05/$08.00+0 doi:10.1128/JCM.43.6.2764-2770.2005
Copyright © 2005, American Society for Microbiology. All Rights Reserved.
Cátedra de Inmunología, Facultad de Química, UDELAR, Instituto de Higiene, Montevideo, Uruguay,1 Laboratório de Biologia Molecular de Cestódeos, Centro de Biotecnología, Universidade Federal do Rio Grande do Sul, Rio Grande do Sul, Brazil,2 Departamento de Parasitología, Instituto Nacional de Enfermedades Infecciosas, ANLIS "Dr. Carlos G. Malbrán," Buenos Aires, Argentina,3 Departamento de Microbiología, Universidad Peruana Cayetano Heredia, Instituto de Ciencias Neurológicas, Lima, Peru,4 Laboratorio de Zoonosis, División de Parasitología, Instituto Nacional de Salud, Lima, Peru,5 Unidad de Parasitología, Facultad de Medicina, Universidad de Chile, Santiago de Chile, Chile,6 Department of Internal Medicine (Pulmonary), School of Medicine, University of California, Davis, California7
Received 11 November 2004/ Returned for modification 7 January 2005/ Accepted 10 February 2005
|
|
|---|
|
|
|---|
In the past decade major advances have been produced in the purification, cloning, and characterization of relevant E. granulosus antigens. A wealth of reports on the diagnostic evaluation of immunopurified components from hydatid cyst fluid and protoscoleces, as well as that of numerous recombinant Echinococcus antigens, are available (9, 10, 14, 15, 23). However, the diagnostic performance of these antigens has been assessed in different laboratories, using different serum collections and different techniques, which makes it difficult to draw conclusions. Indeed, in a recent review on this matter (24), it can be observed that the sensitivity and specificity obtained with hydatid cyst fluid (HCF), as reported by different laboratories, range from 31 to 96%, and 41 to 100%, respectively. Though less extreme, a wide variation in these parameters was also found for the diagnostic performance of native antigen B (AgB) and antigen 5. This lack of concordance generates confusion, and has hampered the transition towards a more standardized and consensual immunodiagnosis.
In order to join efforts and contribute to the standardization of hydatid disease immunodiagnosis, we recently established a network of South American laboratories (http://bilbo.edu.uy/
inmuno/serology). In our initial study, which is reported here, we conducted a double-blind, multicenter study, where the same batch of six E. granulosus antigens was analyzed against a common serum collection. Our work produced a reliable comparison of these antigens and showed that, under controlled conditions, it is possible to obtain highly reproducible results in distant laboratories.
|
|
|---|
Antigens. A common panel constituted by the same batch of six E. granulosus antigens was evaluated by all participating laboratories and included bovine HCF (HCF1); native AgB; two recombinant AgB subunits, namely, AgB8/1 (7) and AgB8/2 (6); recombinant cytosolic malate dehydrogenase from E. granulosus (18); and an AgB-derived synthetic peptide (p-176) (10). HCF was obtained by aseptic aspiration from either bovine or ovine fertile cyst (2). Seven HCF preparations were used in this study, HCF1 to HCF4 and HCF5 to HCF7, from bovine and ovine origin, respectively. HCF1 was analyzed in parallel in all participating laboratories. AgB was immunopurified from HCF according to the method described by Gonzalez et al. (8). The recombinant antigens were prepared as glutathione S-transferase (GST) fusion proteins and affinity purified. The fusion protein antigen moieties were recovered by thrombin cleavage as described by Virginio et al. (23). Antigen concentration was determined by the bicinchoninic acid protein assay (Pierce, Rockford, Ill.). p-176 is a 38-mer peptide (DDGLTSTSRSVMKMFGEVKYFFERDPLGQKVVDLLKEL) corresponding to the N-terminal extension of the AgB8/1 subunit. The peptide was synthesized, purified by reverse-phase high-performance liquid chromatography (95%), and analyzed by mass spectrometry at Iris Biotech GmbH.
Enzyme-linked immunosorbent assay (ELISA). Antigen coating solutions were prepared in 0.1 M sodium carbonate/bicarbonate buffer, pH 9.2 (25 µg/ml for HCF or 4 µg/ml for the other antigens). Then microtitration plates (NUNC Maxisorp or Greiner Microlon High Binding) were coated by overnight incubation at 4°C with the appropriate antigen solution (100 µl/well). After the coating solution was discarded, the plates were blocked for 1 h at 37°C with 5% nonfat milk powder in phosphate-buffered saline (PBS) and washed with PBS-0.05% Tween 20 (PBS-T). The serum samples were diluted 1:200 in PBS-T containing 5% nonfat milk powder and tested in triplicate. After 90 min of incubation at 37°C the plates were washed three times with PBS-T. Then 100 µl of peroxidase-conjugated goat anti-human immunoglobulin G (Sigma, St. Louis, Mo.) diluted 1:3,000 was dispensed into each well and incubated 1 h at 37°C. After washing, a substrate solution containing H2O2 and 2,2'-azino-bis 3-ethylbenz-thiazoline-6-sulfonic acid was added in 50 mM citrate buffer, pH 4.0 (100 µl/well), and incubated for 15 min at room temperature with shaking. Optical densities were measured at 405 or 415 nm.
Data analysis. The cutoff value for positive scores was calculated in two ways. In the first case, the cutoff was defined as the mean absorbance value for the 15 healthy donors plus 3 standard deviations. Using this criterion, the hydatid patient sera were classified as true positives (tp) or false negatives (fn), on the basis of their positive or negative scores. Similarly, the rest of the sera were classified as false positive (fp) or true negatives (tn), depending on whether the readings were higher or lower than the cutoff, respectively. The following definitions were used to calculate the corresponding diagnostic parameters: sensitivity (se; %) = tp x 100/(tp + fn); specificity (sp; %) = tn x 100/(tn + fp); diagnostic efficiency (de; %) = (tp + tn) x 100/(tp + fp + tn + fn). Alternatively, the receiver operating characteristic (ROC) analysis (20) was utilized to analyze the data using the SPSS 10.0 software package (SPSS Inc., Chicago, Ill.). ROC curves were generated by plotting sensitivity versus 1 specificity, and the area under the curve was used to carry out a pairwise comparison of the diagnostic performance of the antigens.
|
|
|---|
Determination of the cutoff value. All serum samples were analyzed in triplicate, and low- and medium-titer standards (triplicates) were included in all ELISA plates and used for data normalization. The raw data were submitted to the coordinating laboratory in Montevideo, where serum samples and antigens were decoded and data processed. Figure 1 displays representative results produced in the different centers using HCF1, AgB, and AgB8/1, although with lower readings, similar results were obtained with the other antigens (not shown). For each antigen, the cutoff value, which differentiates positive from negative results, was established by two methods. In the first case, we used the widespread approach of defining the cutoff as the mean value of the normal serum group plus three standard deviations. Alternatively, the cutoff was established by ROC analysis, defined as the absorbance value that gave the highest sum of sensitivity (%) and specificity (%). Figure 2 shows a pair of representative sets of ROC curves obtained in two of the participating laboratories, which are used to estimate the cutoff. In general, ROC analysis provided a better discrimination between true-positive and true-negative sera, particularly in the case of HCF1 and AgB (Table 1). Except when specifically stated, this criterion will be used throughout this study to compare the antigens.
![]() View larger version (30K): [in a new window] |
FIG. 1. Reactivity of the serum collection against HCF1, AgB, and AgB8/1 assessed by ELISA. The sera were grouped as follows: Eg, sera from patients with cystic hydatidosis; Ts, sera from patients with cysticercosis; Em, sera from patients with alveolar hydatidosis; Ns, sera from healthy donors; others, other sera used in this study. The cutoff estimated as the mean value plus three standard deviations and by ROC analysis are shown by dotted and solid lines, respectively. OD, optical density.
|
![]() View larger version (20K): [in a new window] |
FIG. 2. ROC curves representing the plot of sensitivity versus 1-specificity for the six E. granulosus antigens. The curves obtained in the Argentinean and Brazilian laboratories are shown as examples of representative ROC curves. Antigen p-176 is distinctively shown with a dotted line; AgB8/2 and EgMDH are represented with boldface solid lines; and HCF1, AgB, and AgB8/1 with normal solid lines. The diagonal reference line is also shown.
|
|
View this table: [in a new window] |
TABLE 1. Diagnostic performance of the six E. granulosus antigens in ELISAa
|
1.96 is taken as evidence that two antigens are not significantly different. Table 2 summarizes the z values for each pair of antigens analyzed in each of the centers. Pairwise comparison shows that, except for the z value of 2.08 obtained in the Chilean laboratory for HCF1 versus AgB8/1, in all other laboratories, there were not significant differences in the diagnostic precision obtained with HCF1, AgB, or AgB8/1. Less consistent results were obtained with the other antigens, except for the fact that AgB8/2 and EgMDH provided equivalent diagnostic precision. This is exemplified in the representative curves shown in Fig. 2, where it is possible to observe two clusters of ROC curves, one corresponding to HCF1, AgB, and AgB8/1 (upper left region of the graph), and a second cluster constituted by AgB8/2 and EgMDH. The ROC curves for p-176 grouped into the first cluster in the case of the Argentinean laboratory and tended to move towards the second in the case of the Brazilian laboratory, indicating that a still-unknown factor affected the performance of the peptide in these centers. |
View this table: [in a new window] |
TABLE 2. ROC z values corresponding to the intralaboratory pairwise comparison of the antigens
|
|
View this table: [in a new window] |
TABLE 3. ROC z values corresponding to the interlaboratory pairwise comparison of the antigens
|
![]() View larger version (24K): [in a new window] |
FIG. 3. Reactivity of the serum collection against different preparations of HCF assessed by ELISA. The sera were grouped as follows: Eg, sera from patients with cystic hydatidosis; Ts, sera from patients with cysticercosis; Em, sera from patients with alveolar hydatidosis; Ns, sera from healthy donors; others, other sera used in this study. The cutoff estimated by ROC analysis is shown.
|
|
View this table: [in a new window] |
TABLE 4. ROC z values corresponding to the interlaboratory pairwise comparison of different batches of HCF
|
|
|
|---|
As shown in Tables 1 and 2, HCF1, AgB, and AgB8/1 exhibited the highest diagnostic value and behaved as equivalent antigens with no significant differences in their diagnostic performance when the data were analyzed by ROC. Moreover, the individual analysis of our serum collection showed that, using these antigens, there was an almost complete agreement in the intra- and interlaboratory classification of each individual serum as positive or negative, which reinforces the statistical findings. We speculated that based on the complex composition of HCF its de could be affected by a high degree of cross-reactivity; however the use of ROC to set up the cutoff for this antigen seems to solve this problem. Under these conditions HCF emerged as a valuable antigen, and for this reason we specifically addressed the issue of its batch-to-batch reproducibility. Strikingly, as can be seen from Table 4, no significant differences existed among HCF batches, even for those of different host species and geographical origins.
The other antigens in our panel, p-176, Ag8/2, and EgMDH, did not perform as well as would have been expected from the previous literature. We would speculate that these contradictions arise, mainly, because of use of a different serum collection. Regarding that, we still do not know the level of variation in the subunit composition of AgB at different stages of the metacestode development (12), or how the integrity of the cyst will determine the host exposure to EgMDH (a cytosolic component of E. granulosus), which certainly depends on the extent of parasite cell damage. In the case of the peptide, an intriguing fact was its differential behavior in the different centers. Indeed, the estimated mean value of p-176 de showed the largest interlaboratory variation (75.8% ± 6.3%). However, it can be observed that three centers (Argentina, Peru-2, and Uruguay) produced a mean value of 81.4% ± 2.1%, similar to that of HCF, AgB, and AgB8/1, and in agreement with the de previously reported for this antigen (10). On the other hand, the other centers (Brazil, Chile, and Peru-1) attained a markedly lower de value of 70.3% ± 1.2%. Since this is a highly reproducible reagent, it may be worth the additional effort to study the causes that negatively affected its performance in these laboratories.
One of the major challenges of hydatid serology is the definition of suitable tools for large-scale seroepidemiological studies. Due to its rather low prevalence, these studies require simple and inexpensive methods, allowing the parallel analysis of thousands of samples with high sensitivity. For this reason, our study was based in the use of ELISA to measure total immunoglobulin G responses. However, despite the fact that our panel of sera was tested against a selection of widely used and highly promising antigens none of them provided the desired sensitivity, and roughly one-fifth of the hydatid sera gave rise to false-negative results. Our previous experience indicates that when the serum collection is based upon samples that have not been selected on the basis of previous serological information, this is a common scenario and not a particular characteristic of the serum collection used in this study (1, 10). In that regard, we searched for complementarity among the antigens to explore the possibility that the combination of two or more antigens would improve sensitivity. However this was not the case and in general, once the proper cutoff has been established, each individual serum classifies as either positive against all of HCF, AgB, and AgB8/1 or negative against all of them, with no intermediate situations. Although the potential role of novel antigens to improve this situation cannot be ruled out, it seems that for some patients and particular stages of the disease, the limiting factor is the actual existence of a measurable antibody response. Indeed, it is a well-established fact that the major evasion strategy of Echinococcus sp. parasites relies on their capacity to seclude themselves from the host immune response (11).
In conclusion, our collaborative work shows that, under controlled conditions, it is possible to perform serological studies in distant laboratories with comparable results. Through a double-blind objective study, this work demonstrated that HCF, AgB, and AgB8/1 are the most valuable antigens of the panel, with equivalent diagnostic performance. The fact that most of the serum samples that score positive using HCF also score positive using AgB or AgB8/1 offers the opportunity of a second confirmatory test that may improve specificity without significant loss of sensitivity. This provides a tool for the confirmation of the large fraction of weakly positive/negative serum samples that classified as doubtful in the initial screening, because their readings are close to the cutoff value, a common scenario in the serology of hydatid disease. Consequently, on the basis of its availability and little influence of batch-to-batch variations, we thus recommend the use of HCF for initial screening in large seroprevalence studies, utilizing a rather permissive cutoff value (such as the mean value of a group of normal sera plus 2 standard deviations). Further analysis of positive serum samples with AgB and AgB8/1 (using a properly estimate ROC cutoff) would allow the confirmation of true positives and eliminate a large fraction of false-positive sera, thus providing specificity.
We thank Arnaldo Zaha for critical reading of the manuscript and Kimiaki Yamano from the Hokkaido Institute of Public Health for donation of the E. multilocularis sera.
This work was done as part of the PAHO South American Subregional Program for Control and Surveillance of Hydatid Disease and the WHO Informal Working Group on Immunodiagnosis of Human Cystic Echinococcosis.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»