Previous Article | Next Article 
Journal of Clinical Microbiology, July 2007, p. 2309-2311, Vol. 45, No. 7
0095-1137/07/$08.00+0 doi:10.1128/JCM.00144-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.
Performance of the HerpeSelect (Focus) and Kalon Enzyme-Linked Immunosorbent Assays for Detection of Antibodies against Herpes Simplex Virus Type 2 by Use of Monoclonal Antibody-Blocking Enzyme Immunoassay and Clinicovirological Reference Standards in Brazil
Maria Claudia Nascimento,1,2*
Suzete Ferreira,3
Ester Sabino,3
Ingrid Hamilton,4
John Parry,4
Claudio S. Pannuti,2 and
Philippe Mayaud1
Clinical Research Unit, Department of Infectious & Tropical Diseases, London School of Hygiene and Tropical Medicine, Keppel Street, London WC1E 7HT, United Kingdom,1
Laboratório de Virologia do Instituto de Medicina Tropical and Departamento de Moléstias Infecciosas e Parasitárias da Faculdade de Medicina, Universidade de São Paulo, Av. Dr Eneas de Carvalho Aguiar, 470, Sao Paulo, Brazil,2
Fundação Pró-sangue/Hemocentro de São Paulo, Sao Paulo, Brazil,3
Virus Reference Laboratory, Health Protection Agency, Colindale, London NW9 5EQ, United Kingdom4
Received 19 January 2007/
Returned for modification 5 March 2007/
Accepted 5 May 2007

ABSTRACT
A total of 586 serum samples were used to evaluate the performance
of type-specific herpes simplex virus type 2 (HSV-2) commercial
enzyme-linked immunosorbent assays (ELISAs) by using the monoclonal
antibody-blocking enzyme immunoassay (MAb-EIA) and a clinicovirological
panel as reference standards. The Kalon and HerpeSelect ELISAs
had similar sensitivities (93.5% and 93.8% compared with the
results obtained by MAb-EIA, respectively, and 100% for both
ELISAs compared with the results obtained with a clinicovirological
panel). The Kalon ELISA had a higher specificity (96.5% and
96.8% compared with the results obtained by MAb-EIA and with
a clinicovirological panel, respectively) than the HerpeSelect
ELISA (86.9% and 94% compared with the results obtained by MAb-EIA
and with a clinicovirological panel, respectively). A higher
cutoff significantly improved the specificity of the HerpeSelect
ELISA.

TEXT
The public health importance of sexually transmitted herpes
simplex virus (HSV) type 2 (HSV-2) is increasingly recognized.
HSV-2 is the main cause of genital ulcers worldwide (
9), and
its presence might facilitate human immunodeficiency virus (HIV)
transmission (
5). The majority of people infected with HSV-2
are unable to recognize their symptomatic disease, which remains
a threat to the control of HSV-2 transmission (
4). Seroepidemiological
studies have been hampered by the lack of accurate and easy-to-use
tests for the detection of antibodies against HSV-2 in different
populations. Western blotting (WB), a time-consuming and expensive
assay, has long been used as a "gold standard" for the detection
of anti-HSV type-specific antibodies (
2). Another reference
standard is the monoclonal antibody (MAb)-blocking enzyme immunoassay
(MAb-EIA) adapted from the MAb radioimmunoassay produced at
the Health Protection Agency (HPA), London, United Kingdom (
13).
In a comparison with serum samples with WB- and HSV-2 culture-positive
results, the HPA MAb-EIA yielded a sensitivity and a specificity
of 93% each with sera from individuals in England, with similar
performance characteristics achieved with sera from individuals
in Uganda (sensitivity, 93%; specificity, 91%) (
6). More recently,
new HSV type-specific antibody assays directed against glycoprotein
G (gG) have been developed and have become commercially available
(
15). While these tests have been extensively evaluated in industrialized
countries, high rates of false-positive reactions in sera from
individuals in Africa have been reported (
14). The aim of this
study was to evaluate the performances of two commercially available
enzyme-linked immunosorbent assays (ELISAs), namely, the HerpeSelect
ELISA (Focus Technologies, Inc., Cypress, CA [formerly MRL Diagnostics])
and the Kalon HSV-2 gG2 assay (Kalon Biologicals Ltd., Aldershot,
United Kingdom) in comparison with those of MAb-EIA and a clinicovirological
assay, which were used as gold standards.
We used stored serum samples obtained during cross-sectional studies conducted between 1995 and 2003 by the Virology Laboratory of the Instituto de Medicina Tropical of the University of Sao Paulo, Sao Paulo, Brazil (3, 11). Duplicate aliquots were tested blindly by the HerpeSelect and Kalon ELISAs at the laboratory of the blood bank of Sao Paulo State (Fundação Pro-Sangue/Hemocentro) and were tested by the reference serological assay (MAb-EIA) at the Virus Reference Division of HPA in London. The main panel of 586 samples comprised samples from six groups, based on the subjects posterior probabilities of being infected or uninfected with HSV-2: group 1, 30 AIDS patients from Sao Paulo with culture- and PCR-proven HSV-2 perianal ulcers; group 2, 40 AIDS patients from Sao Paulo with no genitoanal ulcers; group 3, 137 patients without evidence of genitoanal ulcers attending a clinic for sexually transmitted infections in Sao Paulo; group 4, 29 HIV-negative men who have sex with men enrolled in a cohort study for HIV prevention in Sao Paulo; group 5, 100 college students participating in a cross-sectional HSV seroepidemiological study in Sao Paulo; and group 6, 250 children (ages, 1 to 2 years) from Sao Paulo recruited for a measles vaccine research program (Table 1). The commercial assays were performed by using the manufacturers instructions. Samples with optical density index values <0.9 were recorded as negative, those with index values >1.1 were recorded as positive, and those with intermediate values were recorded as equivocal. We also evaluated the performance of the HerpeSelect assay using an increased cutoff of 3.5, as suggested previously (1).
View this table:
[in this window]
[in a new window]
|
TABLE 1. Antibodies to HSV-2 detected by MAb-EIA, Kalon ELISA, and HerpeSelect ELISA, by population group, in Brazila
|
The performances of the HerpeSelect ELISA at different cutoffs
and the Kalon ELISA for the detection of HSV-2 antibodies in
the whole panel were determined and compared with the performances
of the serological (MAb-EIA) and clinicovirological reference
standard assays. The latter used group 1 as an "HSV-2-infected"
reference group and group 6 as an "HSV-2-uninfected" reference
group.
The McNemar chi-square test was used to estimate the statistical significance of the differences in sensitivities and specificities of the assays by comparing the number of discordant results between the Kalon and HerpeSelect assays among subjects for whom MAb-EIA results were available. Owing to a smaller sample size, statistical significance tests were not applied to estimate the different performances of these assays in comparison with that of the clinicovirological gold standard assay (groups 1 and 6).
As shown in Table 1, most patients (range, 87% to 100%) with proven HSV-2 infection (group 1) were seropositive by the MAb-EIA, Kalon ELISA, and HerpeSelect ELISA. Groups unlikely to be infected by HSV-2 (i.e., groups 5 and 6) had low seropositivity rates (range, 0.9% to 6.2%), except for those determined by the HerpeSelect ELISA by use of the manufacturer's recommended cutoff of 1.1 (30% and 6% in groups 5 and 6, respectively). Equivocal results were found for 8/585 (1.4%) samples tested by MAb-EIA, and these were excluded from further analyses. No equivocal results were obtained by the Kalon ELISA with the 576 serum samples tested. By using the manufacturer's recommended cutoff (>1.1) and the increased cutoff (>3.5), the HerpeSelect ELISA gave equivocal results for 18/529 (3.4%) and 81/529 (15.3%) of the samples tested, respectively. For analysis of test performance, the samples with equivocal results by the HerpeSelect ELISA were categorized as negative. As shown in Table 2, compared with the MAb-EIA as the reference standard, the sensitivity and the specificity of the Kalon ELISA were 93.5% (95% confidence interval [CI], 88% to 97%) and 96.5% (95% CI, 94% to 98%), respectively, while the sensitivity and the specificity of the HerpeSelect ELISA (cutoff > 1.1) were 93.8% (95% CI: 88% to 97%) and 86.9% (95% CI, 83% to 90%), respectively, a significant difference in specificities (McNemar test, P < 0.0001). Raising the cutoff of the HerpesSelect ELISA to 3.5 increased the specificity (98.5%; 95% CI, 97% to 99%; McNemar test, P < 0.0001) but also significantly decreased the sensitivity (81.4%; 95% CI, 74% to 88%; McNemar test, P = 0.0002 in comparison with the results of the Kalon ELISA). Compared with the results obtained by use of the clinicovirological reference standard, the HerpeSelect ELISA (cutoff > 1.1) and the Kalon ELISA were 100% sensitive (95% CI, 88% to 100%), with specificities of 94% (95% CI, 90% to 97%) and 96.8% (95% CI, 94% to 99%), respectively. The sensitivity of the HerpeSelect ELISA was reduced to 89.7% (95% CI, 73% to 98%) and the specificity was increased to 99.1% (95% CI, 97% to 100%) when the cutoff was increased. The MAb-EIA was the least sensitive (86.7%; 95% CI, 69% to 96%) of all three tests, although it had a specificity comparable to those of the other assays.
View this table:
[in this window]
[in a new window]
|
TABLE 2. Performance of HSV-2 serological assays compared to those of serological (MAb-EIA) and clinicovirological reference standards in Brazila
|
The problem with the specificity of the HerpeSelect ELISA is
well known. Initial studies carried out in the United States
showed that in comparison with the results of WB or a combination
of WB and the clinical diagnosis as the gold standard, the HerpeSelect
ELISA had high sensitivities (88% and 98%, respectively) and
high specificities (93.8% and 96%, respectively) (
8,
10). However,
discrepant results were obtained when samples from sub-Saharan
African were tested (
7,
14). In one study with samples from
four African countries (
7), the sensitivity of the HerpeSelect
ELISA compared to the results of WB was 100%, while the specificities
among samples from HIV-negative individuals were 70% in Uganda,
80% in Kenya, and 100% in Zimbabwe and South Africa. In a large
study that evaluated 13 HSV-2 type-specific commercial assays
with samples from Benin, Cameroon, Kenya, and Zambia (
14), the
performance of the HerpeSelect ELISA varied according to HIV
infection status, with decreased specificity among HIV-positive
samples (71% specificity among HIV-positive samples and 74%
specificity among HIV-negative samples). It has been suggested
that the generally lower specificity of the HerpeSelect assay
with samples from African populations in comparison with that
with samples from the United States could be due to cross-reactivity
with HSV-1, which is more prevalent in African countries (
14).
The reason for the lower specificity of the HerpeSelect assay
for the detection of HSV-2 infection in HIV-seropositive samples
is unknown, but it could be related to the HIV-associated immunoglobulin
G polyclonal immune stimulation that might interact with the
test or to some more complex effect of HIV on the immune responses.
Recognizing these limitations, investigators have recommended
raising the cutoff to 3.5 to increase the specificity of the
assay (
1).
In contrast, with samples from the general populations of Cameroon, Kenya, and Zambia, the sensitivity of the Kalon ELISA ranged from 89% to 92% and its specificity ranged from 95% to 100% compared with the results of the MAb-EIA, with WB used as a test for resolution of discrepant results; its performance results were comparable with HIV-positive and HIV-negative samples (14). Furthermore, in comparison with WB, the Kalon assay had stable performance (sensitivity and specificity, 100%) when it was used to test samples from patients with recurrent HSV culture-positive genital ulcers in the United States, regardless of their HSV-1 seropositive status (10).
In our study, the majority of samples with equivocal results by the HerpeSelect assay belonged to groups at low risk for HSV-2 infection and gave negative results by the MAb-EIA. In a previous study, samples with equivocal results by the HerpeSelect assay were shown to be negative by WB (12). Thus, the categorization of samples with equivocal results as "negative" seems to be the most logical decision. However, it cannot be ruled out that a number of equivocal samples among the student group (group 5) represent genuine positive reactions, perhaps associated with seroconversion, as the HerpeSelect assay has been shown to detect seroconversions earlier than other tests, including WB (10). Our study design did not allow exploration of this hypothesis.
In summary, our study showed that the Kalon assay performed better than the HerpeSelect assay for the detection of HSV-2 antibodies in samples from individuals in Brazil. Raising the cutoff to 3.5, as suggested previously (1), significantly improved the specificity of the HerpeSelect assay, but this was at the expense of sensitivity.

ACKNOWLEDGMENTS
We have no conflict of interest to declare.

FOOTNOTES
* Corresponding author. Present address: IARC/CIRC, 150 Cours Albert Thomas, 69372 Lyon Cedex 08, France. Phone: 33 472738179. Fax: 33 472738345. E-mail:
nascimentoc{at}iarc.fr 
Published ahead of print on 16 May 2007. 

REFERENCES
1 - Ashley-Morrow, R., J. Nollkamper, N. J. Robinson, N. Bishop, and J. Smith. 2004. Performance of focus ELISA tests for herpes simplex virus type 1 (HSV-1) and HSV-2 antibodies among women in ten diverse geographical locations. Clin. Microbiol. Infect. 10:530-536.[CrossRef][Medline]
2 - Ashley-Morrow, R., J. Militoni, F. Lee, A. Nahmias, and L. Corey. 1998. Comparison of Western Blot (Immunoblot) and glycoprotein G-specific immunodot enzyme assay for detecting antibodies to herpes simplex virus types 1 and 2 in human sera. J. Clin. Microbiol. 26:662-667.
3 - Carvalho, M., S. de Carvalho, C. S. Pannuti, L. M. Sumita, and V. A. de Souza. 1998. Prevalence of herpes simplex type 2 antibodies and a clinical history of herpes in three different populations in Campinas City, Brazil. Int. J. Infect. Dis. 3:94-98.[CrossRef][Medline]
4 - Fleming, D. T., G. M. McQuillan, R. E. Johnson, A. J. Nahmias, S. O. Aral, F. K. Lee, and M. E. St Louis. 1997. Herpes simplex virus type 2 in the United States, 1976 to 1994. N. Engl. J. Med. 337:1105-1111.[Abstract/Free Full Text]
5 - Freeman, E. E., H. A. Weiss, J. R. Glynn, P. L. Cross, J. A. Whitworth, and R. J. Hayes. 2006. Herpes simplex virus 2 infection increases HIV acquisition in men and women: systematic review and meta-analysis of longitudinal studies. AIDS 20:73-83.[Medline]
6 - Gopal, R., T. Gibbs, M. J. Slomka, J. Whitworth, L. M. Carpenter, A. Vyse, and D. W. Brown. 2000. A monoclonal blocking EIA for herpes simplex virus type 2 antibody: validation for seroepidemiological studies in Africa. J. Virol. Methods 87:71-80.[CrossRef][Medline]
7 - Hogrefe, W., X. Su, J. Song, R. Ashley-Morrow, and L. Kong. 2002. Detection of herpes simplex virus type 2-specific immunoglobulin G antibodies in African sera by using recombinant gG2, Western blotting, and gG2 inhibition. J. Clin. Microbiol. 40:3635-3640.[Abstract/Free Full Text]
8 - Leach, C. T., R. L. Ashley, J. Baillargeon, and H. B. Jenson. 2002. Performance of two commercial glycoprotein G-based enzyme immunoassays for detecting antibodies to herpes simplex viruses 1 and 2 in children and young adolescents. Clin. Diagn. Lab. Immunol. 9:1124-1125.[CrossRef][Medline]
9 - Mindel, A. 1998. Genital herpeshow much of a public-health problem? Lancet 351:16-18.[CrossRef][Medline]
10 - Morrow, R., D. Friedrich, and E. Krantz. 2003. Performance of the Focus and Kalon enzyme-linked immunosorbent assays for antibodies to herpes simplex virus type 2 glycoprotein g in culture-documented cases of genital herpes. J. Clin. Microbiol. 41:5212-5214.[Abstract/Free Full Text]
11 - Nascimento, M. C., L. M. Sumita, V. A. U. F. Souza, and C. S. Pannuti. 1998. Detection and direct typing of herpes simplex virus in perianal ulcers of patients with AIDS by PCR. J. Clin. Microbiol. 36:848-849.[Abstract/Free Full Text]
12 - Reddy, S. M., P. Balakrishnan, S. Uma, S. P. Thyagarajan, and S. Solomon. 2005. Performance of two commercial enzyme-linked immunosorbent assay kits using recombinant glycoprotein G2 antigen for detection of herpes simplex virus type 2-specific antibodies. Clin. Diagn. Lab. Immunol. 12:359-360.[CrossRef][Medline]
13 - Slomka, M. J., R. Ashley-Morrow, F. M. Cowan, A. Cross, and D. W. G. Brown. 1995. Monoclonal antibody blocking tests for the detection of HSV-1 and HSV-2-specific humoral responses: comparison with Western blot assay. J. Virol. Methods 55:27-35.[CrossRef][Medline]
14 - Van-Dyck, E., A. Buvé, H. A. Weiss, J. R. Glynn, D. W. G. Brown, B. D. Deken, J. Parry, and R. J. Hayes. 2004. Performance of commercially available enzyme immunoassays for detection of antibodies against herpes simplex virus type 2 in African populations. J. Clin. Microbiol. 42:2961-2965.[Abstract/Free Full Text]
15 - Wald, A., and R. Ashley-Morrow. 2002. Serological testing for herpes simplex virus (HSV)-1 and HSV-2 infection. Clin. Infect. Dis. 35:S173-S182.[CrossRef][Medline]
Journal of Clinical Microbiology, July 2007, p. 2309-2311, Vol. 45, No. 7
0095-1137/07/$08.00+0 doi:10.1128/JCM.00144-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.
This article has been cited by other articles:
-
Smith, J S, Bailey, R C, Westreich, D J, Maclean, I, Agot, K, Ndinya-Achola, J O, Hogrefe, W, Morrow, R A, Moses, S
(2009). Herpes simplex virus type 2 antibody detection performance in Kisumu, Kenya, using the Herpeselect ELISA, Kalon ELISA, Western blot and inhibition testing. Sex. Transm. Infect.
85: 92-96
[Abstract]
[Full Text]
-
Martins, T. B., Welch, R. J., Hill, H. R., Litwin, C. M.
(2009). Comparison of a Multiplexed Herpes Simplex Virus Type-Specific Immunoglobulin G Serology Assay to Immunoblot, Western Blot, and Enzyme-Linked Immunosorbent Assays. CVI
16: 55-60
[Abstract]
[Full Text]
-
LeGoff, J., Mayaud, P., Gresenguet, G., Weiss, H. A., Nzambi, K., Frost, E., Pepin, J., Belec, L., and the ANRS 12-12 Study Group,
(2008). Performance of HerpeSelect and Kalon Assays in Detection of Antibodies to Herpes Simplex Virus Type 2. J. Clin. Microbiol.
46: 1914-1918
[Abstract]
[Full Text]