Institute of Medical Microbiology, Clinical Virology, University of Muenster, Muenster,1 Euroimmun GmbH, Gross-Groenau, Germany2
Received 20 February 2001/ Returned for modification 2 August 2001/ Accepted 18 November 2001
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
Roughly two-thirds of HSV-2 infections remain subclinical or completely asymptomatic. Therefore, most infections with HSV-2 remain undiagnosed, and the number of HSV-2 carriers is frequently underestimated. The high proportion of unrecognized carriers facilitates spread of HSV-2, since virus is shed intermittently from anogenital sites of most HSV-2-seropositive individuals. The majority of new infections with HSV-2 is thus believed to result from sexual contacts during periods of asymptomatic viral shedding by source partners (26).
Since virus isolation and PCR yield positive results only during phases of active infection and virus shedding, serological screening is needed for the reliable identification of individuals with a past HSV-2 infection (13). Detection of type-specific antibodies against HSV-2, however, is hampered by the extensive serological cross-reactivity between HSV-1 and HSV-2. At present, commercial immunoassays allowing a reliable detection of HSV-2-specific antibodies are mainly based on glycoprotein G-2 (gG-2) as the diagnostic antigen (2, 16). Glycoproteins G of HSV-1 and HSV-2 are highly divergent (25) and typically elicit no or only limited humoral cross-reactivity (21, 22).
Despite substantial progress in the development of simple, cost-effective commercial assays, such as gG-2-based enzyme-linked immunosorbent assays (ELISAs), however, determination of the individual serostatus may require confirmation of results in a second assay, such as immunoblotting. To address this problem, we first analyzed the diagnostic performance of three commercial type-specific ELISAs and a commercial immunoblot in a high-HSV-2-risk collective. Additionally, a gG-2-independent in-house immunoblot assay was applied. The principle of this test (which has been successfully employed for the identification of cross-reactive antibodies between HSV and varicella-zoster virus [19]) was to perform an immunoblot assay on blot strips carrying HSV-2 full antigen with serum samples that had each been preabsorbed with HSV-1 lysates, HSV-2 lysates, or both or mock absorbed. Changes in the reactivity pattern after preabsorption allowed a differentiation between type-common and HSV-2-specific reactivity of a given serum sample, taking into account the complete pattern of HSV-2-specific humoral immune response directed against epitopes other than gG-2. Based on the results of the commercial seroassays, we then evaluated potential confirmatory strategies.
Our results show that of all confirmatory strategies based exclusively on commercial assays, the sequential use of two screening ELISAs and retesting of sera with equivocal results by immunoblotting was the most cost-effective approach with reasonable sensitivity and specificity. The results obtained with the gG-2-independent assay suggested that the commercial assays may have missed some HSV-2-positive samples and that additional gG-2-independent approaches are needed to maximize the sensitivity of HSV-2-specific seroassays.
| MATERIALS AND METHODS |
|---|
|
|
|---|
Viruses and cells. The HSV strains in this study were the strains used by Euroimmun (Gross-Groenau, Germany) for production of the anti-HSV-1/HSV-2 gG Western blot assay (EuW) and the immunoblot strips employed in the in-house HSV-2-specific immunoblot assay (IhW; see below), i.e., HSV-1 strain F (ATCC 733) and HSV-2 strain G (ATCC 734). Viral stocks were obtained by serial passages at a multiplicity of infection of 0.01 PFU/cell. Low-passage titers were approximately 5 x 105 PFU/ml for HSV-1 F and 5 x 104 PFU/ml for HSV-2 G. For propagation of virus stocks, Vero cells (Vircell, Grenada, Spain) were used for HSV-1 and MRC-5 cells (Vircell) were used for HSV-2. Cells were maintained in 100% humidity, 5% CO2, and Eagle's minimal essential medium supplemented with antibiotics (penicillin, 100 U/ml; streptomycin, 100 µg/ml) and 5% fetal calf serum.
Type-common HSV ELISA. All serum samples were tested for the presence of type-common HSV immunoglobulin G (IgG) and IgM antibodies with the Enzygnost HSV/IgG and IgM ELISA (Dade Behring; BeG and BeM, respectively) according to the manufacturer's instructions.
HSV-2-specific commercial assays. The three HSV-2-specific ELISAs are based on gG-2: the Euroimmun anti-HSV-2 IgG ELISA (Eu2), the Gull Laboratories (Bad Homburg, Germany) HSV-2-specific IgG ELISA (Gu2), and the Radim (Sulzbach, Germany) HSV-2 IgG ELISA (Ra2). EuW consisted of HSV-1-loaded Western blot strips with an additional gG-2 band blotted onto the bottom of the strip. All tests were carried out according to the manufacturers' instructions.
Production of viral antigens and preabsorption of sera. Production of viral antigens for preabsorption of sera was always done with Vero cells. Tissue culture flasks (175 cm2) were infected at a multiplicity of infection of 1 to 5 PFU/cell and incubated at least for 2 days or until 100% cytopathic effect was reached. Subsequently, cells were scraped into the medium and pelleted in conical 50-ml tubes by centrifugation at 2,000 x g and 4°C for 15 min. The supernatant was discarded, and the pellet was stored at -80°C until further use. To obtain cell lysates for preabsorption of sera, pellets were thawed, sonicated at 80 W for 5 min, and resuspended in 880 µl of sample dilution buffer provided with the Euroimmun Western blot kit. Preabsorption was performed by mixing 20 µl of serum with 440 µl of cell lysate and 40 µl of proteinase inhibitor (Complete; Roche, Mannheim, Germany) stock solution prepared according to the instructions of the manufacturer and adjusting to a final volume of 1 ml with sample dilution buffer. For mock absorption, the cell lysate was replaced with the appropriate volume of sample dilution buffer, and for preabsorption with both HSV types, 440 µl of HSV-1 lysate and 440 µl of HSV-2 lysate were used. Preabsorption mixtures were incubated at 4°C for 20 h under vigorous shaking and subsequently cleared by centrifugation at 50,000 x g and 4°C for 30 min. The supernatants were recovered, adjusted to 3 ml with sample dilution buffer to give a final serum dilution of 1:150, and stored at -20°C until further use.
IhW. The immunoblot strips loaded with HSV-2 full antigen were manufactured by Euroimmun and are commercially available from Euroimmun upon request. Four strips per serum were preincubated with 1.5 ml of sample dilution buffer (see above) at room temperature for 15 min. Subsequently, one strip was incubated with 2 ml of mock-preabsorbed serum, a second strip was incubated with 2 ml of the same serum preabsorbed with HSV-1 lysate, a third strip was incubated with 2 ml of the serum preabsorbed with HSV-2 lysate, and a fourth strip was incubated with 2 ml of the same serum preabsorbed with both HSV strains. After overnight incubation at room temperature, strips were washed and further processed as described previously (19). The typical patterns for sera positive for HSV-2 antibodies, HSV-1 antibodies, or both are shown in Fig. 1. The criteria for the interpretation of the IhW are given in Table 1.
|
|
Estimation of cost of confirmatory strategies. The estimation of additional costs raised by the individual confirmatory strategies was done in a relative manner. Based on the official tariffs of the German health insurance (Gebührenordnung für Ärzte), we defined the relative cost of an ELISA as 1 and the cost of a Western blot assay as 3.352. Cost estimations for a hypothetical low-risk collective were done by disregarding borderline results and assuming that the diagnostic performance of confirmatory tests was the same as in the high-risk collective studied here. The costs of a given confirmatory strategy were expressed as (i) the additional costs per sample in relation to the costs of the respective screening assay and (ii) the cost per additionally correctly diagnosed sample in relation to screening only.
| RESULTS |
|---|
|
|
|---|
Specificity of the commercial gG-2-based ELISAs in an HSV-seronegative control group. Fifty-six serum samples from HSV IgG- and IgM-seronegative individuals were assayed (for source and definition of HSV-negative control sera, see Materials and Methods). All samples were HSV-2 negative by Eu2 and EuW. In Gu2, four samples (7.1%) were repeatedly reactive and two samples (3.6%) yielded equivocal results. Thirteen samples (23.2%) were found to be reactive by Ra2, and four (7.1%) gave equivocal results. A single serum sample was positive by Gu2 and Ra2. No serum sample gave equivocal results in both assays.
Detection of HSV-2-specific antibodies in female prostitutes by commercial seroassays. The results obtained with the gG-2-based HSV-2-specific seroassays are summarized in Table 2. In Eu2, 102 serum samples (52.57%) were reactive, 91 (46.91%) were negative, and 1 (0.52%) gave an equivocal result. In Gu2, 89 samples (45.88%) were reactive, 103 (53.09%) showed no reactivity, and 2 (1.03%) gave equivocal results. In Ra2, 57 samples (29.38%) were positive, 130 (67%) were negative, and 7 (3.61%) gave equivocal results.
|
Agreement of commercial gG-2-based seroassays. Compared to the outcome of gG-2-based ELISAs, positive results in immunoblot EuW were obtained for 51 of 52 sera concordantly positive by Eu2, Gu2, and Ra2, in all six sera positive by Eu2 and Gu2 and equivocal by Ra2, in 27 of 30 sera positive by Eu2 and Gu2, in a single serum positive by Eu2 and equivocal by Gu2, and in 5 of 13 sera solely positive by Eu2. All sera concordantly negative by Eu2, Gu2, and Ra2 (n = 84) were also negative by EuW. Only 135 of 194 sera (69.6%) from female prostitutes gave concordant results in all commercial HSV-2-specific assays employed. Ra2 showed the highest rate of discrepant results. When the outcome of Ra2 was disregarded, concordant results were obtained in 173 sera (89.2%), i.e., 84 (48.6%) sera were positive and 89 were negative. Of the remaining 21 sera with discrepant results, 6 were positive by EuW. Four sera were negative by EuW but positive by Eu2 and Gu2, and one of these sera was additionally positive by Ra2.
Overall performance of the commercial assays. When a formal PGS was established as described in Materials and Methods, i.e., a "majority decision" of the four commercial assays, the EuW being decisive in stand-off situations, 91 true-positive and 103 true-negative sera were identified in the prostitute sample collective (n = 194; prevalence, 46.91%). Based on this standard, the sensitivities, specificities, negative predictive values (NPVs), and positive predictive values (PPVs) of the commercial assays were as follows (Table 3): Eu2, 100, 89.22, 89.22, and 100%; Gu2, 94.44, 96.08, 95.51, and 95.15%; Ra2, 61.18, 95.10, 91.23, and 74.62%; and EuW, 98.9, 100, 100, and 99.04%. When a low-risk collective with a hypothetical prevalence of 10% was assumed for the calculation of predictive values, the PPVs and NPVs for the commercial tests were 50.75 and 100% (Eu2), 72.80 and 99.36% (Gu2), 58.10 and 95.66% (Ra2), and 100 and 99.88% (EuW).
|
According to the outcome of IhW, a revised gold standard (RGS) was defined, including the samples additionally positive by the IhW. Based on this RGS, the HSV-2 seroprevalence in female prostitutes was 50% (97 of 194). A reranking of the HSV-2-specific commercial seroassays based on the RGS led to better specificities of ELISAs and revealed a general decrease of sensitivity of all commercial assays (Table 3).
Assessment of confirmatory strategies. By using both gold standards as described above for comparative calculations, the performance of combinations of the commercial HSV-2-specific seroassays Eu2, Gu2, and EuW was investigated. For reasons of cost, we considered only approaches employing an ELISA for screening. The performances of the six confirmatory strategies considered here are summarized in Table 4. Due to its obviously poor diagnostic performance, the Ra2 ELISA was not further considered in this context.
|
A strategy comprising the simultaneous testing of all samples by Eu2 and Gu2 and retesting of all samples with discrepant or equivocal results with EuW can be expected to possess a reasonable sensitivity and specificity in the high-risk collective tested here (strategy 5). This approach entails additional costs of 129.39% per sample. Similar performance, albeit with a significantly lower number of assays and significantly less additional cost (79.02%), can be obtained with a three-step approach: all sera with positive or equivocal results by Eu2 are first retested with Gu2, and sera negative or equivocal by Gu2 are confirmed by EuW (strategy 6).
As a rule of thumb, all confirmatory strategies improved specificity at constant or only slightly reduced sensitivity compared to a single ELISA when the PGS was applied. If the RGS was applied, all confirmatory strategies led to a more pronounced loss of sensitivity and a gain in specificity (strategies 1, 3, 5, and 6) compared to the screening ELISAs. The costs per additional correct diagnosis (Table 4) roughly correlated with the respective additional costs per sample.
| DISCUSSION |
|---|
|
|
|---|
As a basis for calculating the performance parameters for the commercial type-specific assays, we first defined a gold standard based exclusively on the results of the commercial assays (PGS; see above). The 46.91% HSV-2 seroprevalence found with this standard in the sera from prostitutes and the fact that all HSV type-common negative sera were also negative by this standard made it highly plausible. All considerations below refer to this PGS unless stated otherwise.
Of the commercial HSV-2-specific seroassays used in this study, Eu2 had the highest sensitivity (100%) and EuW had the highest specificity (100%).
Gu2 has already been evaluated in a number of previous studies and found to be highly sensitive and specific. Its sensitivity and specificity have been reported to be 98 and 97% (3), 96 and 96.2% (10), and 99.7 and 96.7% (13). In the present study, the diagnostic performance of this assay was found to be slightly lower (94.44% sensitivity and 96.08% specificity); however, this may be due to different patient collectives and different definitions of the gold standard.
In accordance to an earlier report (30), the diagnostic performance of Ra2 was poor. Due to its unacceptably low sensitivity of 61.18%, the use of this assay cannot be recommended, and it was not further considered during evaluation of confirmatory strategies.
The observed differences in the specificity between the commercial type-specific assays may become more accentuated in a low-risk collective. Thus, calculating the predictive values for a hypothetical collective with 10% HSV-2 seroprevalence, as found in German pregnant women (10, 34), suggested a significant drop in the PPVs of the screening ELISAs, whereas the PPV of the EuW remained unchanged (for details see Table 3).
Calculation of the overall agreement of the commercial HSV-2-specific assays demonstrated that only roughly two-thirds of sera gave concordant results in all commercial assays (135 of 194; 69.59%). Thus, in order to finally resolve the individual HSV-2-specific serostatus, we studied the diagnostic benefit of potential confirmatory strategies as has been proposed previously (9), employing the commercial assays evaluated in this study.
With respect to technical and economical expenses, HSV-2-specific ELISAs appear to be the most suitable for screening purposes, particularly when large patient collectives are to be tested. As reported earlier (5), immunoblotting and related techniques offer the highest specificity for the detection of HSV-2-specific antibodies, especially in the presence of high levels of cross-reactive antibodies, and therefore appear to be highly suitable as confirmatory assays. Accordingly, EuW showed the highest specificity (100%) of all commercial HSV-2-specific seroassays.
Due to the low number of equivocal results in the screening ELISAs, solely retesting sera with equivocal results in the screening assay by EuW had little or no effect on overall performance (confirmatory strategies 1 and 3) (Table 4). Confirmation by EuW of all positive and equivocal results obtained in a screening ELISA was found to increase significantly the PPVs and to reduce slightly the sensitivity of HSV-2-specific antibody detection (strategies 2 and 4) (Table 4). The additional costs of the latter two confirmatory strategies are the highest of all options evaluated (177.92% with Eu2 as the screening assay and 157.20% with Gu2 as the screening assay), because of the high number of immunoblots to be performed in the high-prevalence collective. Thus, confirmatory strategies involving a gG-2-based screening assay and a gG-2-based immunoblot will be most applicable in low-risk collectives where the number of additional immunoblots to be performed is low, e.g., 57.71 or 39.66% additional cost for Eu2 or Gu2 used as a screening assay, respectively, in a collective with a hypothetical 10% HSV-2 seroprevalence. The combination of two ELISAs for screening, either by testing all sera in parallel or by retesting all sera with positive or equivocal results in the first assay by a second screening assay and confirmation of discrepant results by a gG-2-based immunoblot, may be particularly suitable for achieving a reasonable sensitivity and specificity in a high-risk collective without the need for retesting a large number of sera by immunoblotting (strategies 5 and 6; additional costs, 129.39 and 79.02%, respectively) (Table 4). Although the latter strategy is associated with the least additional cost in a hypothetical low-prevalence collective (strategy 6; 29.35% additional cost per sample) (Table 4), it exhibits a PPV of 79.23%, which is significantly less than the 100% PPV of strategies 2 and 4. Thus, a slightly more expensive confirmatory approach (e.g., approximately 30% additional cost of strategy 6 versus 42% additional cost of strategy 4) may be justified by a considerable gain in PPV in low-prevalence collectives.
Since actual commercial HSV-2-specific seroassays are based exclusively on gG-2 as the diagnostic antigen, only in-house assays come into consideration for a gG-2-independent confirmation of the type-specific humoral immune response. As a gG-2-independent assay we developed an HSV-2 immunoblot combined with an additional preabsorption protocol for the removal of cross-reactive antibodies and control of the specificity of antibody reaction observed. By design, this assay should allow the detection of HSV-2-specific antibodies directed against viral proteins other than gG-2. Inclusion of the additionally positive samples identified by this assay to revise the PGS appeared to be justified with respect to (i) its good overall accordance with the PGS (150 of 157 sera tested; 95.54%) and (ii) the fact that five of six additionally positive samples were also positive by one or more type-specific commercial assays. The remaining sample positive in IhW but concordantly negative in all commercial assays did not contain HSV IgM antibodies, a marker of primary HSV-2 infection. This case may represent infection with a gG-2-negative HSV-2 strain (23). Only a single sample positive according to the PGS was negative in the IhW. Although this discrepancy could theoretically be due to an immune response to type-common epitopes on gG-2, recent studies strongly suggest that this is most probably only a hypothetical possibility (21, 24, 32), and we therefore considered this result a false-negative IhW result.
Based on the RGS, recalculation of the performances of the type-specific commercial assays and confirmatory strategies (Tables 3 and 4) indicated a slight loss in sensitivity of all commercial assays and confirmatory strategies, with the changes being most pronounced for EuW (98.9 to 92.78%). Correspondingly, all commercial HSV-2-specific ELISAs and all confirmatory strategies exhibited an increase in specificity. The slight specificity gains of the screening ELISAs and the loss of sensitivity of the EuW can be interpreted as a probable lack of sensitivity of the EuW in this context. The occurrence of false-negative results has therefore to be considered if both the screening assay and the confirmatory assay rely on gG-2 as the diagnostic antigen. It might therefore be expected that the use of assays like the IhW for confirmation would improve the sensitivity of confirmatory strategies. It should be noted, however, that half of the additional positive samples (three of six) would have already been missed at the screening stage.
In conclusion, our results show that contemporary gG-2-based commercial assays and confirmatory strategies based on them exhibit favorable diagnostic performances. Further improvements especially with regard to sensitivity seem possible but can probably be achieved only if antigens other than gG-2 are added to these tests.
Recommendations for potential confirmatory strategies may vary significantly with respect to the commercial assays employed and patient collectives analyzed. Therefore, further studies are needed which focus specifically on the evaluation of confirmatory strategies for type-specific HSV serology and their diagnostic benefit in various clinical and epidemiological settings.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. |
|---|---|
| Clin. Vaccine Immunol. | ALL ASM JOURNALS |
|---|