Centre for Infectious Diseases and Microbiology Laboratory Services, Institute of Clinical Pathology and Medical Research, Westmead Hospital, Westmead NSW 2145, Australia
Received 18 March 2002/ Returned for modification 23 April 2002/ Accepted 6 August 2002
| ABSTRACT |
|---|
|
|
|---|
| INTRODUCTION |
|---|
|
|
|---|
Microscopy remains the diagnostic technique of choice for malaria. It is relatively inexpensive, sensitive to a threshold of 5 to 50 parasites/µl (depending on technical factors such as the expertise of the microscopist) (17, 33), and able to characterize the infecting species and their relative densities. However, it requires considerable technical expertise for optimal blood film preparation, examination, and interpretation. Immunocapture rapid diagnostic tests (RDTs) based on the detection of malarial antigens have been developed to improve the timeliness, sensitivity, and objectivity of malaria diagnosis, through less reliance on expert microscopy. The ParaSight-F (Becton Dickinson, Franklin Lakes, N.J). and ICT P.f (Amrad-ICT, Sydney, Australia) assays detect the histidine-rich protein 2 (HRP2) antigen of the asexual stages and young gametocytes of P. falciparum and have a detection threshold of around 40 to 60 parasites/µl and an overall sensitivity of 84 to 100% for P. falciparum infections (17, 24, 27, 29, 34). Two other recently developed RDTs can detect P. vivax in addition to P. falciparum. The ICT P.f/P.v assay (Amrad-ICT) detects the same P . falciparum-specific HRP2 antigen as the ICT P.f assay and a panmalarial antigen expressed by P. falciparum, P. vivax, and possibly also P. ovale and P. malariae (D. P. Mason, C. Wongsrichanalai, K. Lin, R. S. Miller, and F. Kawamoto, Letter, J. Clin. Microbiol. 39:2035, 2001). The OptiMal assay (Flow Inc., Portland, Oreg.) detects Plasmodium-specific lactate dehydrogenase (pLDH) antigens that are expressed by both sexual and asexual parasitic stages, one P. falciparum specific and one Plasmodium genus specific (23). From limited evaluations, both assays appear sensitive for the detection of P. falciparum infections but variable for non-falciparum infections (1, 3, 7-9, 12, 18, 21, 24, 27, 29).
These RDTs, however, have a number of important limitations, including suboptimal sensitivity at low parasite densities, an inability to accurately identify parasites to the species level or to quantify infection density, and a higher unit cost relative to microscopy. False-positive results occur with HRP2-based assays because of antigen persistence for up to 28 days despite clearance of asexual-stage parasites with chemotherapy (15), and they occur with both HRP2- and pLDH-based assays in the presence of rheumatoid factor (10; A. Bartoloni, G. Sabatinelli, and M. Benucci, Letter, N. Engl. J. Med. 338:1075, 1998; M. P. Grobusch, U. Alpermann, S. Schwenke, T. Jelinek, and D. C. Warhurst, Letter, Lancet 353:297, 1999). Despite these limitations, RDTs are a potentially useful adjunct to microscopy, particularly where expertise is limited, and have been adopted in laboratories in many countries where infection is not endemic. In Australia, 43% of laboratories participating in the Royal Australasian College of Pathologists quality assurance program for malaria diagnosis routinely use RDTs to supplement microscopy (S. Neville, personal communication). The performance characteristics of such assays, however, have not been extensively established for febrile returned travelers.
The objective of this study was to determine prospectively the performance characteristics of two recently developed RDTs (ICT P.f/P.v and OptiMal) in the diagnosis of malaria in febrile patients presenting in New South Wales, Australia. Reference standards used for comparison were expert microscopy and PCR.
(The work cited in this paper was presented in part at the 2001 Australian Society for Microbiology Annual Scientific Meeting, Perth, Australia, 30 September to 5 October 2001 [abstract PP7.1].)
| MATERIALS AND METHODS |
|---|
|
|
|---|
Study design and specimens. Consecutive specimens submitted to the Parasitology Department from August 2000 to June 2001 were included in the study; these comprised specimens referred directly from medical practitioners and those referred secondarily from other laboratories in New South Wales for confirmation. Inclusion in the study required the availability of thick blood films and the primary whole-blood specimen (collected in EDTA) stored at 2 to 8°C. Microscopy (J.W.), PCR (E.G.P.), and the RDTs (M.A.) were performed in parallel on all specimens by separate experienced operators blinded to the results of the other assays. All identifying details were removed from specimens after allocation of a study number, and the results were correlated after completion of all assays.
Microscopy. Thick and thin films were prepared from primarily referred whole-blood specimens and stained with Field's stain by standard procedures within 1 h of receipt (32). Blood films submitted from other laboratories were examined as submitted (if stained) or were stained with Field's stain. A microscopist with more than 30 years of experience examined each thick film for at least 20 min under a 40x oil immersion lens (total magnification, x500) such that at least 200 to 300 fields were examined. The parasite density was calculated with reference to the white cell count measured from simultaneously drawn blood and was expressed as the number of parasites per microliter (26).
PCR assay. DNA was extracted from 200 µl of whole blood using the QIAamp DNA mini kit (Qiagen, Clifton Hill, Victoria, Australia) as specified by the manufacturer. Extracted DNA was amplified in a seminested multiplex PCR assay using primers targeting the small ribosomal subunit gene, allowing the simultaneous detection and identification to the species level of malaria species as previously described (25). Bands were visualized on a 2% agarose gel after electrophoresis at 200 V for 40 min. Contamination control measures included the use of dedicated equipment in separate laboratory areas for each assay step as well as other standard measures (14). A negative control was included for each specimen, and a positive control (incorporating a mixture of all four malaria species) was included for each assay run.
Rapid diagnostic tests. Each whole-blood specimen was tested immediately on receipt by using the ICT P.f/P.v and OptiMal assays as specified by the manufacturers. The RDTs were stored at 4°C until use. Both assays were considered valid if the control line was visible. For the ICT P.f/P.v assay, a visible HRP2 line was interpreted as indicating infection with P. falciparum and a visible panmalarial antigen line was interpreted as indicating infection with P. vivax. Where both the HRP2 and the panmalarial antigen lines were visible, P. falciparum infection was diagnosed, although this is also consistent with a mixed infection with P. falciparum and another malaria species. For the OptiMal test, where both the P. falciparum-specific and the panmalarial pLDH lines were visible, infection with P. falciparum was diagnosed, although this is also consistent with a mixed infection as above. A visible panmalarial pLDH line was interpreted as infection with P. vivax.
Reference standards. Following validation against microscopy, PCR was used as the reference standard for the diagnosis of all malaria, P. falciparum (all stages) malaria, P. vivax malaria, and non-falciparum malaria. Since PCR cannot differentiate between sexual and asexual P. falciparum parasites, microscopy was used as the reference standard for the diagnosis of asexual-stage P. falciparum infection.
Statistical analysis.
Specimens were classified as true positive, true negative, false positive, or false negative for each test under evaluation compared with the reference standard. Sensitivity, specificity, positive and negative predictive values, and likelihood ratios (LRs) for positive and negative test results were calculated (4). Comparison of independent means was performed using a two-sample t test, and comparison of independent proportions was performed using a
2 test. All significance tests were two tailed. Data were analyzed using EpiInfo version 6 and Minitab for Windows release 12 (Minitab Inc., State College, Pa.).
| RESULTS |
|---|
|
|
|---|
Microscopy was positive for 93 specimens from 88 episodes of malaria in 87 patients (Table 1). Of the infections, 28 were acquired in the Pacific region (mostly Papua New Guinea), 27 were acquired in Africa, 21 were acquired in Southeast Asia (mostly East Timor), 11 were acquired in southern Asia (mostly from the Indian subcontinent), and 1 was acquired in South America.
|
Comparison of PCR with microscopy. Microscopy and PCR were concordant for 155 (98%) of 158 specimens for the detection of malaria parasites (Table 1). The three discrepant specimens were PCR positive for P. falciparum but microscopy negative. Although no parasites were detected after repeated microscopic examination, these specimens probably represented true-positive results by PCR since they were obtained after initiation of treatment for microscopy-confirmed P. falciparum infection. Microscopy and PCR results were concordant for the identification to the species level of malaria parasites in 92 (99%) of 93 specimens in which parasites were detected by both techniques. The single discrepancy was identified as P. ovale by PCR but P. vivax by microscopy; subsequent blinded review of the blood film by microscopy favored a diagnosis of P. ovale.
Comparison of RDTs with PCR and microscopy. The performance of the RDTs compared with the reference standards of PCR and microscopy is presented in Tables 2 and 3. The median duration of whole-blood storage at 2 to 8°C until performance of the RDTs was 2 days (range, 0 to 12 days).
|
|
21 = 8.54, P = 0.003). It was also more sensitive for asexual-stage P. falciparum infections (97 and 84.8%, respectively), but the difference was not statistically significant (
21 = 2.92, P = 0.09). The only false-negative result with the ICT P.f/P.v assay was a specimen with a parasite density of 45/µl (Table 4). False-negative results, however, occurred with the OptiMal assay up to parasite densities of 2,500/µl; below this level, only 62% of infections were detected, and for infections at less than 1,000/µl, only 43% were detected (Table 4). The ICT P.f/P.v and OptiMal assays were positive for all seven and one of seven specimens, respectively, with only sexual stages of P. falciparum or that were PCR positive but microscopy negative.
|
21 = 13.8, P < 0.001), false-negative results still occurred at parasite densities up to 5,300/µl. The ICT P.f/P.v assay failed to detect any of the P. ovale and P. malariae infections, whereas the OptiMal assay detected three of four P. ovale infections but neither of the P. malariae infections. The ICT P.f/P.v assay produced false-positive P. falciparum results in two PCR-negative specimens, whereas the OptiMal assay produced P. falciparum false-positive results in one PCR-negative specimen and two specimens containing only P. vivax parasites. No specimen gave a false-positive result in both assays. Clinical follow-up did not suggest recent or subsequent P. falciparum malaria in patients with false-positive results.
Based on recorded intervals between specimen collection and testing, there was no evidence that false-negative or false-positive results were related to a delay in performing RDTs.
| DISCUSSION |
|---|
|
|
|---|
The ICT P.f/P.v assay was highly sensitive (97%) for the diagnosis of clinically significant P. falciparum infections (i.e., those with asexual-stage parasites), consistent with previously published evaluations of the assay in its current and previous formats (17, 24, 27, 29). It demonstrated a low detection threshold, although only two specimens with parasite densities of <100/µl were assessed. However, the assay performed particularly poorly in diagnosing P. vivax malaria (sensitivity, 44%), with false-negative results encountered for infections with densities up to 10,000 parasites/µl. These results are considerably inferior to those in other reports from countries with endemic infection (27, 29), possibly reflecting the lower parasite densities encountered in infected nonimmune patients.
On the other hand, the OptiMal assay demonstrated only moderate sensitivity for both P. falciparum and non-falciparum malaria, generally consistent with previous reports (7, 8, 12, 18, 21). False-negative results occurred with P. falciparum malaria at densities up to 2,500 parasites/µl and with P. vivax malaria at densities up to 5,300/µl.
The specificities of both assays were generally high, despite the occurrence of occasional false-positive P. falciparum detections. In addition, the specificity of the ICT P.f/P.v assay for asexual-stage P. falciparum infections suffered from the detection of all seven clinically insignificant infections (i.e., those that contained only sexual-stage P. falciparum parasites or that were PCR positive and microscopy negative).
LRs can be used to quantitate the impact of either a positive or a negative test result on the pretest disease probability; from knowledge of the LR and an estimate of the pretest probability, the posttest probability can be derived directly or with a nomogram (11). Thus, LRs are of greater practical value for clinicians as performance parameters of diagnostic tests than are sensitivity, specificity, and predictive values. In general, large and generally conclusive changes in disease probability are produced by tests with LRs greater than 10 or less than 0.1 (11). From this study, both assays have LRs for a positive test result greater than 10 for all malarial diagnoses (Table 3); a positive test result thus makes the likelihood of malaria very high across a wide range of pretest probabilities. In contrast, with one exception, the LRs for a negative test result with both assays are greater than 0.2; a negative test result therefore does not substantially alter the pretest disease probability. However, with an LR of 0.03, a negative ICT P.f/P.v assay result would virtually exclude the diagnosis of asexual-stage P. falciparum malaria. This study used expert microscopy and PCR as reference standards. The concordance of these standards was high; the only discrepancies involved three post-treatment specimens in which P. falciparum was detected by PCR but not by microscopy and one misidentification of P. ovale as P. vivax by microscopy. Although PCR is an impractical primary diagnostic technique because of the turnaround time, expense, and technical expertise required, its accuracy makes it an important reference standard for evaluating new diagnostic assays.
RDTs have the potential to improve the accuracy and timeliness of malaria diagnosis, particularly for laboratories in countries without endemic infection, where expertise with microscopy may be limited. Consequently, such assays are becoming increasingly utilized in such settings. Given that malaria in nonimmune returned travelers is generally associated with low-level parasitemias of between 50 and 5,000/µl (17), the relatively poor performance characteristics of RDTs at these densities demands caution regarding their use in nonimmune infected persons. The incremental utility of RDTs over nonreference microscopy in countries without endemic infection has also not been evaluated; such an evidence-based approach is required before their application can be widely recommended. On the basis of the published evaluations of these assays, the most rational potential application of RDTs in countries without endemic infection would be where expert microscopy is unavailable for the detection or exclusion of P. falciparum parasites in suspicious negative blood films or in the presence of a non-falciparum species. However, the latter situation is uncommon in Australia, since mixed infections with P. falciparum constituted only 21 (1.4%) of 1,473 malaria notifications in Australia during 1992 to 1993 (2). Therefore, we think that the results of this study emphasize that microscopy should remain the diagnostic technique of choice for malaria diagnosis in nonimmune patients and that they also emphasize the importance of close links with a reference microscopy service where expertise is limited such as in countries where infection is not endemic. The accuracy and utility of RDTs require further investigation before their widespread adoption in such settings can be recommended.
| ACKNOWLEDGMENTS |
|---|
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Antimicrob. Agents Chemother. | Clin. Microbiol. Rev. |
|---|---|
| Clin. Vaccine Immunol. | ALL ASM JOURNALS |
|---|