ABSTRACT
We performed a multicenter evaluation of a robust and easily performed dipstick assay for the serodiagnosis of human leptospirosis. The assay is aimed at the detection of Leptospira-specific immunoglobulin M (IgM) antibodies. The study involved 2,665 serum samples collected from 2,057 patients with suspected leptospirosis in 12 countries on five continents with different levels of endemicity and different surveillance systems. The patients were grouped as laboratory-confirmed leptospirosis case patients and noncase patients based on the results of culturing and the microscopic agglutination test. Paired samples from 27.7% of the subjects were tested. Of the 485 case patients, 87.4% had a positive dipstick result for one or more samples. Of the 1,513 noncase patients, only 7.2% had a positive result. Whereas most (88.4%) of the positive samples from the case patients showed moderate to strong (2+ to 4+) staining in the dipstick assay, most (68.1%) of the positive samples from the noncase patients showed weak (1+) staining. The sensitivity of the dipstick assay increased from 60.1% for acute-phase serum samples to 87.4% for convalescent-phase samples. The specificities for these two groups of samples were 94.1 and 92.7%, respectively. The dipstick assay detected a broad variety of serogroups. The results of the dipstick assay were concordant (observed agreement, 93.2%; kappa value, 0.76) with the results of an enzyme-linked immunosorbent assay for the detection of specific IgM antibodies, a test which is often used in the laboratory diagnosis of current or recent leptospirosis. This study demonstrated that this easily performed dipstick assay is a valuable and useful test for the quick screening for leptospirosis; has a wide applicability in different countries with different degrees of endemicity; can be used at all levels of the health care system, including the field; and will be useful for detecting and monitoring outbreaks of leptospirosis.
Leptospirosis is a worldwide zoonosis caused by pathogenic spirochetes of the genusLeptospira (2, 4). Leptospirosis is a fairly common disease in humid and warm climates (1, 3). The disease varies from a mild flu-like form to severe forms, such as Weil’s syndrome, which are characterized by renal failure, liver impairments, and hemorrhages and have a high mortality rate. Due to the complexity of the clinical symptoms and signs, leptospirosis is often misdiagnosed. Thus, laboratory support of the clinical diagnosis is essential (10).
Laboratory confirmation of leptospirosis is obtained when either the pathogen is isolated or a positive serological result is obtained. The microscopic agglutination test (MAT) is considered the reference test for leptospirosis. The result of the MAT is considered consistent with leptospirosis when either a ≥4-fold increase in titer is observed between paired serum samples or a significantly increased titer is observed for a single serum sample (13). Recently, we developed a quick and easily performed dipstick assay, the LEPTO dipstick (5), for the serodiagnosis of leptospirosis. This assay, like the immunoglobulin M (IgM) enzyme-linked immunosorbent assay (ELISA) (11, 12), detectsLeptospira-specific IgM antibodies in human sera and is aimed at the serodiagnosis of current or recent leptospirosis. The test needs no special equipment, and its ingredients are highly stable and do not need refrigeration.
A previous evaluation of the dipstick assay with selected serum samples collected mainly in The Netherlands demonstrated high sensitivity and specificity and showed that the results correlated well with those of the ELISA (5). We argued that the dipstick assay could be a useful diagnostic tool for health facilities with few resources and in countries with different levels of endemicity. The detection of specific IgM antibodies could be useful in particular in countries with a high degree of endemicity to help distinguish between acute or recent leptospirosis and past leptospirosis. The present study was conducted to evaluate the performance of the dipstick assay in different countries, including countries with low and countries with high prevalences of the disease. In this study, the performance of the dipstick assay was evaluated with serum samples from patients with suspected leptospiral infection and grouped as laboratory-confirmed leptospirosis case patients or noncase patients based on the results of culturing and the MAT. The results of the dipstick assay also were compared with those of the IgM ELISA.
MATERIALS AND METHODS
Participating laboratories and study groups.Serum samples collected during a certain period from all patients with a clinical suspicion of leptospirosis at nine laboratories in Barbados, Hawaii, India, New Zealand, the Philippines, Russia, the Seychelles, Surinam, and The Netherlands were included in the study. In Surinam, samples were collected during two different periods (studies I and II). In addition, the dipstick assay was tested with samples collected from patients with fever in rural hospitals in Kenya and Thailand. In Puerto Rico, the dipstick assay was tested with samples collected from patients who had a dengue-like illness, who failed to demonstrate anti-dengue virus IgM antibodies (6, 7), and who were thus considered negative for dengue.
Leptospirosis case definition and composition of study groups.Patients with a clinical suspicion of leptospirosis were grouped as laboratory-confirmed leptospirosis case patients and noncase patients based on the results of laboratory procedures (culturing and MAT) performed and interpreted according to criteria routinely used in each of the laboratories performing the tests (Table1). Paired serum samples were available from 27.7% of the patients, so confirmation of leptospirosis by demonstration of seroconversion or a ≥4-fold rise in the MAT titer was possible for only a portion of the patients. Hence, a single raised MAT titer was accepted as the confirmation of leptospirosis for single serum samples (13). Patients in the study groups from Hawaii and the Seychelles and with MAT titers above the cutoff value but not showing seroconversion or a ≥4-fold rise in titer were considered probable leptospirosis patients. These patients were excluded from the analysis. The numbers of case patients and noncase patients, the number of serum samples for each of these groups, and the percentage of patients with more than one sample are shown in Table2.
Criteria used to define leptospirosis case patients for the different study groups
Composition of study groups and number and percentage of patients with a positive result in the dipstick assay
The MAT was performed at the Royal Tropical Institute, Amsterdam, The Netherlands, for the study groups from The Netherlands, Surinam, Thailand, and Kenya. The MAT was performed in New Caledonia for samples from the Seychelles, in Japan for samples from the Philippines, and in the United States for samples from Puerto Rico and Hawaii (Table 1). For all other study groups, the MAT was performed at the collaborating laboratories contributing the samples. A detailed description of the panels of strains used in the MAT and the experimental procedures used for performing the MAT can be obtained from the authors.
The IgM ELISA was performed for seven of the study groups. The results of the IgM ELISA, although often used in the serodiagnosis of leptospirosis, were not taken into consideration for the definition of leptospirosis case patients, as doing so would cause bias for the presence of specific IgM antibodies.
LEPTO dipstick assay.Participants in the study were provided with sealed vials containing (i) 5 ml of lyophilized detection reagent, (ii) 5 ml of reconstitution fluid, and (iii) 5 ml of dipstick fluid; a tightly closed container containing dipsticks and a desiccant; test tubes; and a test tube rack. Participants were asked to perform the test according to the instructions given in an accompanying protocol (5). Briefly, the dipstick assay is performed by incubation of a wet dipstick in a mixture of 250 μl of reconstituted detection reagent and 5 μl of serum at an ambient temperature for 3 h. At the end of the incubation period, the dipstick is rinsed with tap water and air dried, and the staining intensity of the antigen band is compared with that of a colored reference strip showing bands colored at different (1+ to 4+) intensities. In the evaluation of the dipstick assay, a staining intensity of ≥+1 is considered positive. Dipsticks are coated with a heat-stable antigen prepared from a culture of Leptospira biflexa.
ELISA.An ELISA for the detection ofLeptospira-specific IgM antibodies (IgM ELISA) was performed at the Department for Biomedical Research of the Royal Tropical Institute with the serum samples from The Netherlands, Thailand, Puerto Rico, Hawaii, Surinam (study II), and the Seychelles. The ELISA was performed with antigen prepared from strain Wijnberg as described elsewhere (11, 12). The results of the ELISA were considered positive when a titer of ≥1:40 was obtained. For the Barbados samples, the ELISA was performed with antigen prepared from strain Patoc I as described previously (8).
Statistical evaluation.To calculate the sensitivity and specificity of the dipstick assay, the serum samples from leptospirosis case patients and noncase patients were stratified in stage I and stage II. For patients with paired samples, the samples collected first were considered stage I and the samples collected second were considered stage II. For patients from whom more than two samples were obtained, only the first two samples were considered. Single samples were considered stage I when collected during the first 10 days of the disease and stage II when collected more than 10 days after the onset of the disease, as IgM antibodies usually develop during the first 10 days of the disease (2). Single samples for which the duration of the disease was not reported were excluded from the analysis. Also, samples from patients with reported past leptospirosis were excluded from the analysis.
To compare the performance of the dipstick assay with that of the IgM ELISA, the intermethod agreement between the results of the two tests was determined. Kappa statistics were applied, as they offer a measure of agreement which is not attributable to chance. In general, a kappa value of >0.80 represents almost perfect agreement beyond chance. Values below 0.40 represent slight agreement, and values between 0.40 and 0.80 represent fair to good agreement.
RESULTS
Study population.In 12 countries on five continents, 2,665 serum samples from 2,057 patients with a clinical suspicion of leptospirosis were tested with the dipstick assay. According to the results of the MAT and culturing, 485 patients with 729 samples were considered leptospirosis case patients, 1,513 patients with 1,841 samples were considered noncase patients, and 59 patients with 95 samples were considered patients with probable leptospirosis. Paired samples were tested from 27.7% of the patients, including 217 case patients and 317 noncase patients (Table 2).
Percentage of leptospirosis case patients and noncase patients with a positive dipstick assay result.The mean percentage of case patients with one or more serum samples that showed staining of the antigen band of the dipstick was 87.4%; the percentages ranged from 76.5 to 88.2% for five studies and to over 90% for seven other studies (Table 2). For the studies performed in India, the Seychelles, and Thailand, the percentages of case patients with a positive dipstick result were relatively low, namely, 77.8, 78.7, and 76.5%, respectively. The samples from two of the four case patients in the study group from Thailand with negative results in the dipstick test showed borderline titers in the MAT. These samples also were negative in the IgM ELISA. The samples from 13 of the 17 case patients from the Seychelles with negative dipstick test results showed seroconversion in the MAT to a titer at or just above the cutoff value. The samples from 12 of these 13 case patients also were negative in the IgM ELISA. The agglutinating titers were not specified for the study performed in India. Also, an ELISA was not performed on the samples from India.
Samples from 7.2% (on average) of the noncase patients tested positive in the dipstick assay. The percentage of noncase patients with a positive score in the dipstick assay ranged from 0.6 to 20% for the different study groups (Table 2).
The percentage of probable leptospirosis patients from Hawaii and the Seychelles that tested positive in the dipstick assay did not differ from the percentage of case patients that tested positive.
Staining intensity of the antigen band.Semiquantitation of the dipstick results was used for all study groups, with the exception of some of the samples from Hawaii. The staining intensity of the antigen band on the dipstick was moderate to strong (≥2+) for most (88.4%) of the samples from the case patients with a positive score (Table 3). In contrast to the findings for the other study groups, a large proportion of the sera from the case patients in the Philippines stained weakly (1+) (data not shown).
Staining intensity of positive serum samples and stratification according to the duration of the disease
As expected, a higher percentage of the stage II serum samples from the case patients showed staining, and the staining intensity was, on average, stronger than that of stage I serum samples (Table 3). Analysis of the results for study groups for which the time point of sample collection in relation to the duration of the disease was well documented (Barbados, The Netherlands, the Seychelles, and Hawaii) indicated that the majority of the positive samples showed moderate to strong staining intensity by day 6 or 7 after the onset of the disease (data not shown).
The staining intensity for 68.1% of the samples from the noncase patients with a positive result in the dipstick assay was rated 1+ (Table 3). Staining intensities of ≥2+ for samples from the noncase patients were notably found in the study groups from New Zealand and Surinam (study I).
Sensitivity and specificity of the dipstick assay.The mean sensitivity of the dipstick assay for stage I serum samples was calculated to be 60.1% (standard deviation [SD], 17.0) and ranged from just over 35% for the samples studied in the Seychelles, Thailand, and New Zealand to about 80% for the samples studied in Barbados, India, and Puerto Rico (Table4). The mean sensitivity for stage II samples was 87.4% (SD, 10.9) and ranged from 69.2% for the samples studied in India to over 95% for the samples studied in Barbados, New Zealand, Puerto Rico, Russia, and The Netherlands.
Sensitivity and specificity of the LEPTO dipstick assay in the acute phase of disease for groups of serum samples stratified according to the duration of the disease
The mean specificities of the dipstick assay for stage I and stage II samples were calculated to be 94.1% (SD, 4.4) and 92.7% (SD, 5.8), respectively (Table 4).
The sensitivity and specificity for the study groups for which information on the duration of the disease was lacking are presented in Table 5. The mean sensitivity was 91.6% (SD, 2.5), and the mean specificity was 88.6% (SD, 7.0).
Sensitivity and specificity of the LEPTO dipstick assay in the acute phase of disease for groups of serum samples for which the exact duration of the disease was not reported
Comparison of the dipstick assay and the IgM ELISA.The IgM ELISA was performed for the samples from Barbados, Hawaii, The Netherlands, Puerto Rico, Surinam (study II), the Seychelles, and Thailand. A comparison of the test results of the dipstick assay and the IgM ELISA yielded kappa values (agreement beyond chance) ranging from 0.69 for the group of samples from Puerto Rico to 0.83 for the group of samples from the Seychelles (Table6). The mean observed agreement was 93.2%, and the mean kappa value was 0.76. These results show that the dipstick assay and the IgM ELISA yield concordant results. Discrepant results were obtained mainly for sera either with a borderline titer in the ELISA or showing weak staining in the dipstick assay.
Comparison of the results of the IgM ELISA and the LEPTO dipstick assay
DISCUSSION
The present study was initiated to evaluate the clinical utility of a dipstick assay for the detection of Leptospira-specific IgM antibodies in different areas likely to have different degrees of endemicity and where strains of different serovars cause leptospirosis. The results show that the dipstick assay combines a high specificity with a high sensitivity, in particular for samples collected in the convalescent phase of the disease. The mean sensitivity increased from 60.1% (SD, 17.0) for samples collected early in the acute phase of the disease to 87.4% (SD, 10.9) for samples collected later in the disease. The mean specificities for these two groups of samples were 94.1% (SD, 4.4) and 92.7% (SD, 5.8), respectively. Furthermore, most (88.4%) of the positive samples from the case patients gave a moderate to strong (2+ to 4+) staining intensity, and most (68.1%) of the positive samples from the noncase patients gave a weak (1+) staining intensity only.
We previously evaluated the dipstick assay with selected serum samples from leptospirosis case patients and noncase patients from The Netherlands (5). In that study, a sensitivity of 63.0% for acute-phase serum samples, a sensitivity of 85.7% for convalescent-phase serum samples, and a specificity of 92.7% were calculated. The present multicenter study included samples collected prospectively in The Netherlands and sent to the Royal Tropical Institute in 1996 because of a suspicion of leptospirosis or because leptospirosis was in the differential diagnosis. The results of both studies show good agreement. In the present study, a higher sensitivity (95.2%) was observed for convalescent-phase samples, the sensitivity (60.1%) for acute-phase samples was similar, and the specificity was slightly higher.
The incidence of leptospirosis is relatively low in The Netherlands. In the present study, we demonstrated that the dipstick assay can be applied successfully in different parts of the world, including areas with a high endemicity of leptospirosis. The variation in test performance noted for the different study groups likely is attributable to differences in the interpretation of the results of the reference test (MAT) by the different centers involved in the study. Differences in clinical practices and in the collection of clinical data may have contributed to some variation as well. Differences in methodology presumably had a stronger effect on the results of the dipstick assay than did possible epidemiological differences. Differences in the sensitivity calculated for the dipstick assay for samples collected in the acute phase of the disease most likely were due to differences in the accuracy of the reported duration of the disease at the time of sampling. For instance, the relatively high sensitivity calculated for the acute-phase samples in the study performed in India could have been caused by the fact that the patients in this study group first sought medical attention at a late stage of the disease and underreported the duration of the disease. Also, the high sensitivity calculated for the study groups in the Philippines and Surinam (Table 5) suggested that the samples from these groups were collected at a relatively late stage of the disease. The relatively low sensitivity observed for the convalescent-phase samples from the study groups in Hawaii, India, the Seychelles, and Thailand could have been a result of false-positive results obtained in the reference test. The majority of the case patients with serum samples for which a negative result was observed in the dipstick assay had low or borderline titers in the MAT as well as borderline or negative results in the IgM ELISA. The absence of detectable Leptospira-specific IgM levels in these patients suggests that the final diagnosis of laboratory-confirmed leptospirosis could be disputed for these patients. It is possible that some of these patients had residual antibody levels agglutinating in the MAT from a previous Leptospira infection.
We previously demonstrated that the dipstick assay reacted equally well with sera from patients infected with strains of the serogroups Australis, Autumnalis, Icterohaemorrhagiae, Grippothyphosa, Sejroe, and Pomona (5). In the present study, reactivity with a total of 22 serogroups was demonstrated (data not shown). The lack of reactivity with sera from some case patients was not related to agglutination by strains belonging to a specific serogroup. The results of this multicenter study indicate that the dipstick assay has a broad reactivity and is widely applicable. As the dipstick assay yields results quickly and is simple to perform and the assay components are highly stable and do not need refrigeration, the test in particular may fulfill needs in situations where facilities or resources needed to perform more complicated standard laboratory tests such as the MAT or the ELISA are lacking. The observed high degree of concordance between the results of the dipstick assay and the ELISA (mean observed agreement, 93.2%; kappa value, 0.76) shows that similar results will be obtained when either of the tests is used. The sensitivity of the IgM ELISA is lower than that of the dipstick assay for acute-phase samples but is slightly higher for convalescent-phase samples (5). The specificity of the IgM ELISA is higher (5). Assays aimed at the detection ofLeptospira-specific IgM antibodies have somewhat lower sensitivity and specificity than the MAT. In our study, serum samples from about 10% of the case patients did not react in the dipstick assay, and samples from about 9% of the noncase patients showed weak to moderate staining. Although it is possible that some of the patients were misdiagnosed by the reference test, one should consider the possibility of false-positive and false-negative results when applying the dipstick assay.
When the dipstick assay is used as a screening test, a high negative predictive value is important. The predictive value of a test varies with the prevalence of the disease in the target population. The prevalence of leptospirosis among patients with a clinical suspicion of leptospirosis in the study group tested in The Netherlands was 4.1%. The negative predictive value for this study group was 98.0% (95% confidence interval, 96 to 99). From the results of Table 3 it can be calculated that a mean prevalence of leptospirosis of 29.5% among patients with a clinical suspicion of leptospirosis, the negative predictive value would be 90.8% (95% confidence interval, 89 to 92). The dipstick assay primarily has been developed as a rapid screening assay. It is envisaged that due to a lack of facilities or resources needed to perform more complicated confirmatory tests, the dipstick assay may be used as a diagnostic assay. A high positive predictive value will be important for use of the dipstick assay as a diagnostic test. As the majority of the dipstick assay positive results obtained for the noncase patients showed weak (1+) staining, the positive predictive value was calculated separately for results with a weak staining intensity and for results with a moderate to strong (≥2+) staining intensity. For a test result with a moderate to strong staining intensity, a positive predictive value of 91.2% (95% confidence interval, 75 to 98) was calculated for the study performed in The Netherlands. The positive predictive value at a prevalence of 29.5% would be 93.8% (95% confidence interval, 91 to 96). The positive predictive value for a test result with a weak staining intensity was 47.1%.
The results of the dipstick assay, like the results of the MAT and the ELISA, should be interpreted with respect to clinical findings. The results obtained in this study show that a test result with a moderate to strong staining intensity is highly consistent with leptospirosis. Seroconversion usually takes place 6 to 7 days after the onset of the disease, and a negative result or a result with a weak staining intensity may be obtained when samples are collected early in the disease. The present study shows that a moderate to strong reaction in the dipstick assay is obtained by day 6 or 7 for most case patients (data not shown). Demonstration of seroconversion provides strong evidence of leptospirosis. Therefore, it is advised that the assay be repeated with a sample collected a few days later when a negative result is obtained for a sample collected early in the disease and when the suspicion of leptospirosis remains.
The use of the dipstick assay may well lead to improved diagnosis and treatment of patients with leptospirosis and to better knowledge and understanding of the prevalence and epidemiology of the disease. As the dipstick assay is genus specific, it does not provide information regarding the serovar involved in the infection. Knowledge of the serovar is not essential for treatment, but it might be important for identifying possible sources of infection and for developing control programs. Application of culturing and/or the MAT will be required to obtain this information.
The dipstick assay may be universally applicable as a quick screening test for leptospirosis. During this study, the value of the dipstick test was demonstrated by showing a high proportion of strongly positive serum samples among samples from patients with a clinical suspicion of leptospirosis but for whom the resources to perform a reference test were not locally available. Furthermore, the dipstick assay clearly demonstrated the presence of leptospirosis among patients for whom the disease was not considered, as was the case for the group of dengue-negative patients from Puerto Rico. In the study performed in Kenya, the dipstick assay excluded leptospirosis for patients with pyrexia of unknown origin but proven to suffer from several infectious diseases at a later stage.
ACKNOWLEDGMENTS
We thank P. Perolat, P. Bovet, P. Confait, C. N. Edwards, C. Whittington, S. Branch, G. Watt, S. Sumani, V. Ranga Rao, A. Dekker, M. A. G. van der Hoorn, J. de Meza Brewster, H. van der Kemp, B. J. van den Born, I. Gomez, and V. Vorndam for their valuable contributions. We also thank the staff of the Mumias Medical Hospital, Mumias, Kenya, for their contribution to this work. The secretarial assistance of I. M. Struiksma is greatly appreciated.
FOOTNOTES
- Received 20 January 1999.
- Returned for modification 8 April 1999.
- Accepted 4 June 1999.
- Copyright © 1999 American Society for Microbiology
