Previous Article | Next Article ![]()
Journal of Clinical Microbiology, June 2004, p. 2733-2741, Vol. 42, No. 6
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.6.2733-2741.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
3)-ß-D-Glucan Test in Weekly Screening for Invasive Aspergillosis in Patients with Hematological Disorders
Department of Hematology and Oncology,1 Department of Cell Therapy and Transplantation Medicine,2 Department of Regeneration Medicine for Hematopoiesis, Graduate School of Medicine, University of Tokyo, Tokyo 113-8655, Japan3
Received 30 October 2003/ Returned for modification 11 December 2003/ Accepted 18 February 2004
|
|
|---|
3)-ß-D-glucan (BDG), and Aspergillus DNA, have been developed. In this study, we prospectively evaluated the diagnostic potential of three noninvasive tests for IA that were used in a weekly screening strategy: the double-sandwich enzyme-linked immunosorbent assay (ELISA) for galactomannan (Platelia Aspergillus), a real-time PCR assay for Aspergillus DNA (GeniQ-Asper), and an assay for BDG (ß-glucan Wako). We analyzed 149 consecutive treatment episodes in 96 patients with hematological disorders who were at high risk for IA and diagnosed 9 proven IA cases, 2 probable IA cases, and 13 possible invasive fugal infections. In a receiver-operating characteristic (ROC) analysis, the area under the ROC curve was greatest for ELISA, using two consecutive positive results (0.97; P = 0.036 for ELISA versus PCR, P = 0.055 for ELISA versus BDG). Based on the ROC curve, the cutoff for the ELISA could be reduced to an optical density index (O.D.I.) of 0.6. With the use of this cutoff for ELISA and cutoffs for PCR and BDG that give a comparable level of specificity, the sensitivity/specificity/positive predictive value/negative predictive value of the ELISA and the PCR and BDG tests were 1.00/0.93/0.55/1.00, 0.55/0.93/0.40/0.96, and 0.55/0.93/0.40/0.96, respectively. In conclusion, among these weekly screening tests for IA, the double-sandwich ELISA test was the most sensitive at predicting the diagnosis of IA in high-risk patients with hematological disorders, using a reduced cutoff of 0.6 O.D.I. |
|
|---|
To overcome this problem and to improve the treatment outcome, advances have been made over the past decade in the fields of both diagnostics and therapeutics, including improvements in diagnostic imaging (7, 8, 18) and histopathology (1), and the development of broad-spectrum antifungal agents with low toxicities (4, 24, 29, 33). In the field of diagnostics, much attention has recently been given to the development of several types of noninvasive laboratory tests for IA. These tests are designed to sensitively detect circulating Aspergillus components and include a double-sandwich enzyme-linked immunosorbent assay (ELISA) for galactomannan (GM) antigen (Platellia Aspergillus) (30), tests for (1
3)-ß-D-glucan (BDG) (ß-glucan Wako or FungiTec G test) (23, 25), and a number of PCR-based assay systems for Aspergillus DNA (5, 6, 12, 34).
The ELISA for GM uses a rat monoclonal antibody directed against the 1
5-ß-galactofuranoside side chains of the GM molecule as both the capture and detection antibodies for ELISA and can detect as little as 1.0 ng of circulating GM per ml (30). The excellent sensitivity and specificity of this assay have been repeatedly demonstrated and validated in tests of patients with hematological disorders (22, 27, 32). BDG is a ubiquitous component of diverse fungal species and a possible target for the diagnostic detection of IA. Two assay systems are currently available for the sensitive detection of circulating BDG, and both are based on the Limulus reaction, in which a trace amount of BDG can trigger a horseshoe crab coagulation cascade through factor G (23, 25). The BDG test is a useful method for screening for invasive fungal infection (IFI) and is widely used in Japan. The other test that has long been under intensive investigation for the sensitive detection of IA is PCR amplification of Aspergillus DNA, mainly of the 18S ribosomal gene (5, 6, 12, 34). Moreover, recently introduced real-time PCR designs have made it possible to quantitatively evaluate a fungal load with high sensitivity (9, 17, 21).
With regard to an antifungal strategy, it would be interesting to determine which of these tests is the best for diagnosing IA in patients with hematological disorders. Although high sensitivity and specificity are reported for PCR-based assays, the question whether PCR-based assays are superior to GM ELISA is still controversial (3, 5, 19, 34). Previously, we developed a sensitive real-time PCR system for detecting Aspergillus 18S ribosomal DNA, with which as few as 40 copies of aspergillus DNA per ml of plasma could be stably detected. We reported that the sensitivity of our real-time PCR for IA in 33 IA patients was higher than those of the double-sandwich ELISA for GM and the BDG test, with only a slightly lower specificity than that of GM ELISA (17). However, this previous study may have been biased by its partially retrospective design, limited sampling points in each case or infectious episode, and use of an inappropriately high cutoff value for ELISA. In the present purely prospective analysis, we consecutively enrolled 96 patients with hematological disorders who were at high risk for IA, monitored the levels of Aspergillus DNA, GM, and BDG in plasma, as well as the development of IA, at weekly intervals, and evaluated their diagnostic potentials by using receiver-operating characteristic (ROC) analyses.
|
|
|---|
The level of Aspergillus DNA in plasma was measured using real-time PCR, as described previously (17). The ELISA for GM (Platelia Aspergillus; Sanofi Diagnostics Pasteur, Marnes-La-Cosuette, France) and the ß-glucan Wako test (Wako Pure Chemical Industries, Ltd., Tokyo, Japan) were performed as specified by the manufacturers. Each sample was tested twice for GM and BDG, and the average of the two measurements was taken.
Antifungal prophylaxis consisted of daily administration of 200 mg of fluconazole or itraconazole capsules with or without 15 mg of aerosolized amphotericin B or 10 mg of intravenous amphotericin B for patients with a suspected history of IA. Neutropenic fever was treated with broad-spectrum antibiotics in accordance with the published guidelines (16). Blood samples were used for bacterial, mycobacterial, and fungal cultures prior to the initiation of antibiotics. When IFI was suspected, treatment with 1 mg intravenous amphotericin B per kg was initiated. During the febrile period, patients were intensively surveyed for possible sites of infection and causative microorganisms. Diagnostic procedures included routine cultures of urine and stools, repeated cultures of blood and sputum, weekly chest X rays, high-resolution computed tomography (CT) scan of the chest, and, when possible, bronchoscopic examinations and open biopsies.
Case definitions. For each treatment episode, a diagnosis was made following the published case definition criteria for invasive fungal infections from the European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperative Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group (EORTC-IFICG and NIAID-MSG) (2), with the necessary modification that the plasma GM level was not included in the microbiological criteria.
Statistical analysis. As described by Maertens et al. (22), we made a set of different estimates (A/B, C, and D) for the sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of each test, where different definitions of disease status for an episode were used to calculate these statistical indexes, since there is an intrinsic uncertainty regarding the true disease status of IA so that the calculation of these values could be significantly affected by the definition of the disease status. Estimate A/B defines "proven IA" and "probable IA" as truly positive and only "no IA" as truly negative, whereas estimates C and D incorporate "possible IFI" into the truly positive and truly negative groups, respectively. In all of the estimates, "no-IA" episodes were considered truly negative. Since our objective was to validate and compare the potentials of different diagnostic tests in a setting where these tests are performed weekly to monitor the development of IA, the positivity or negativity of a test was defined for each episode, where an episode was considered positive if at least one sample (method I), or any two consecutive samples (method II) became positive. There is also a practical reason for this approach. The onset and resolution of an IA episode are not always clear and, indeed, are rather poorly defined in many cases. Even in proven cases, there might be several febrile episodes and the onset might be insidious. In this setting, the sample-based calculation of sensitivity and specificity might be severely biased. In addition, we determined a proper cutoff value for each test through a ROC analysis, in which sensitivity and specificity were calculated as a function of the cutoff value, (1 specificity) was plotted against the sensitivity, and the areas under the ROC curves (AUCs) were calculated. The significance of the difference in the AUCs of any two diagnostic measures was statistically tested as described above, and P values were calculated by the paired method under the null hypothesis that the two ROC curves represent random samples from similar underlying data for sensitivities and specificities (13). Therefore, the P values can be used only to compare two ROC curves at a time. The calculated P values reflect the one-tailed significance of difference between two ROC curves.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Patient characteristics
|
|
View this table: [in a new window] |
TABLE 2. Diagnosis of IA and its documentation
|
ROC analysis. Figure 1 shows ROC curves for each test, using different definitions of the disease status. First, we examined the behaviors of the ROC curves for different diagnostic tests by using an "ideal" estimate (estimate A/B), in which episodes were expected to be most accurately defined. ELISA has a larger AUC in both method I (ELISA, 0.93; PCR, 0.81; BDG, 0.85) and method II (ELISA, 0.97; PCR, 0.76; BDG, 0.79). To increase the sensitivity for GM, we could more easily decrease its cutoff value with a small decrease in specificity. In contrast, a higher sensitivity could be obtained for the PCR and BDG tests by decreasing their cutoff values, but this would be at a significant cost in terms of specificity. When we shifted the diagnostic algorithm from method I (one positive sample) to method II (two consecutive positive samples), the AUC for the GM test was further increased while those for the PCR and BDG tests decreased, indicating that the GM test has higher reproducibility than the other two tests. The comparison of ROC curves of ELISA (method II), PCR (method I), and BDG (method I) is presented in Fig. 1D. When estimate C was applied for ROC analyses, these characteristics of the ROC curve for GM were partially obscured. In estimate C, a large decrease in sensitivity shifted the ROC curve downward and caused a significant reduction in AUC for the ELISA and BDG test, as expected. On the other hand, the ROC curve for the PCR test did not significantly change, since an expected decrease in sensitivity due to false-positive episodes in the possible IFI group is thought to be counterbalanced by a gain due to false-positive PCR results in these episodes. The ROC curves for the GM test in estimates A/B, C, and D, which is not presented but is similar to that for A/B, represent extreme cases, and the unknown "real" ROC curve might be mapped between these extremes.
![]() View larger version (44K): [in a new window] |
FIG. 1. (A to C) ROC curves of the GM (A), PCR (B), and BDG (C) tests for screening for IA. Both methods I and II were used. The ROC curves obtained by estimate A/B are shown in red, and those obtained by estimate C are shown in blue. The ROC curves obtained by method II are indicated by solid lines, and those obtained by method I are indicated by dotted lines. (D) Combination of ROC curves of the GM test (method II) and those of the PCR and BDG tests (method I).
|
|
View this table: [in a new window] |
TABLE 3. Statistics for some selected thresholds
|
![]() View larger version (24K): [in a new window] |
FIG. 2. Number of days from when GM assays become positive to the onset of treatment, using a threshold of 0.6 O.D.I. by method II (solid arrowheads) or 1.0 O.D.I. by method II (open arrowheads), or positive findings on CT. Open triangles indicate the date of positive culture, and solid triangles indicate when the histopathological diagnosis was made (Px, biopsy; Ax, autopsy). The values in parentheses indicate the number of days after the onset of treatment. For example, for episode 11, CT showed specific findings 50 days after the onset of treatment and the GM assay become positive 2 days before treatment. Episode numbers correspond to those in Table 2. Episodes whose GM assays did not reach the threshold are not shown. For episodes 2 and 9, a CT scan was not performed, and for episodes 7, 8, 10, 17, 19, 21, and 22, the CT findings were nonspecific and could not be used for decision-making. Each treatment was started at the discretion of the physician, taking into account various prices of clinical information, including CT findings and the results of GM assays. For Episode 8, IA was not suspected and no antifungal agent was administered. Therefore, the date of death was used instead of the date of treatment onset.
|
![]() View larger version (24K): [in a new window] |
FIG. 3. Number of days before death that each test gave positive results. Solid triangles indicate the date when GM became positive, using a threshold of 0.6 O.D.I. by method II; open triangles indicate the date when PCR exceeded a cutoff value of 40 copies/ml; and shaded triangles indicate the date when the BDG test exceeded a cutoff value of 11 ng/ml, by method I. In episode 2, PCR never exceeded the cutoff value. Episode numbers correspond to those in Table 2.
|
|
|
|---|
We previously reported that this real-time PCR for Aspergillus DNA was highly sensitive in vitro and with clinical samples (17): it could stably detect as few as 40 copies/ml in vitro and showed a higher sensitivity (79%) than those of the GM (58%) and BDG (67%) tests. In the present prospective analysis with consecutive patients, however, these results were not reproduced. This may be partly explained by the fact that our previous study included many retrospective samples. Furthermore, we intentionally selected IA patients and used a higher cutoff value for the GM test. Although several authors have also reported excellent sensitivity in PCR assays for IA (5, 6, 14, 34), we cannot directly compare those results with ours since there were differences in the target genes, methods of DNA extraction, starting materials, and designs of the PCR amplifications. Some form of standardization is required to make an international comparison possible. We used our real-time PCR system (GeniQ-Asper) (17) because it is most widely used in Japan. Several authors, including Loeffler et al. and Costa et al., also published excellent real-time PCR detection systems for Aspergillus DNA (9, 21, 26, 28), and their systems might produce superior results in the diagnosis of IA, which should be addressed in future studies.
As a diagnostic test, PCR requires more time and more complicated processing and thus costs more than the BDG and GM tests. It costs six times (15,700 yen/test) as much as the BDG and GM assays (2,700 yen/test) in Japan. A specialized laboratory as well as an expensive assay system and reagents are also required. These problems should be addressed before PCR is widely accepted as a standard screening test for IA, although it still seems to have value in making a diagnosis when a variety of clinical samples are used (20, 26, 28, 31).
The BDG test has also been widely used in Japan as a noninvasive diagnostic test for IFI. While it covers wide ranges of fungal species and may be potentially more useful as a screening test for IFI, it can cause frequent nonspecific reactions to various medical materials. Three kinds of assay systems for BDG have been developed in Japan: a chromogenic assay (FungiTec G test), ß-glucan test Maruha) and a kinetic assay (ß-glucan test Wako), but there is still some debate regarding their diagnostic potential. According to a sample-based analysis by Yoshida et al. (35), the chromogenic assay seems to be more sensitive (87.9 and 72.7%, respectively) than the kinetic assay but much less specific (43.3 and 75.2%, respectively) when the cutoff values recommended by the manufacturers are used. In the present study, where we used a kinetic assay, we could not obtain sufficient sensitivity even with the cutoff being maximally reduced. Furthermore, even if positive results were obtained, the positive results with the BDG test tended to occur later in the clinical course. The present result (55% sensitivity and 98% specificity) is consistent with our previous results (67% sensitivity and 84% specificity) using the chromogenic assay and also with other reports. This seems to be an inherent limitation of BDG assays for the diagnosis of IA, although they show a very high sensitivity and specificity for candidiasis (25).
The diagnostic potential of double-sandwich ELISA for GM has been repeatedly validated in recent large-scale studies (15, 22). However, a direct comparison of the results of different studies, including ours, is not always easy and in fact can be quite difficult or impractical. Many factors can influence the apparent sensitivity and specificity and of course the PPV and NPV. Therefore, the important point is the way in which these results should be interpreted, and this depends on the objective and design of each study. From this perspective, our results are comparable to those of Maertens et al. (22) but in contrast to those of Herbrecht et al. (15). The latter addressed principally the diagnostic potential of the GM test in the presence of an unknown neutropenic fever or some respiratory signs and symptoms in cancer patients. On the other hand, in our study as well as in that of Maertens et al., the principal concern was the potential of the test in serial screenings with multiple measurements throughout the entire period of hematology care. For example, the mean numbers of measurements per episode in our study and that of Maertens et al. (8.3 and 11.2 per episode, respectively, with GM measured weekly) are significantly different from that in the study of Herbrecht et al. (5.5 per episode, with GM measured daily or weekly), consistent with the study designs. The difference becomes more prominent for proven IA episodes (17.3 and 19 versus 6.8). The differences in the mean number and timing of measurements clearly affect the apparent sensitivity and specificity of the studies. Hence, the apparent statistical values obtained by Herbrecht et al. are expected to be lower than ours and those of Maertens et al., but they should provide a better approximation of the corresponding sample-based statistics, even though the patient population was more heterogeneous.
According to the ROC analysis of double-sandwich ELISA, the conventionally used cutoff seems to be too high: our recommendation is 0.6 O.D.I., and two consecutive positive results should be taken into consideration. With these new criteria, the GM test showed an excellent chronological profile. It gave the first positive diagnostic result in 9 of 14 GM-positive IA episodes and in 5 of 9 IA or possible IFI episodes where both CT and GM were positive. It preceded the initiation of empiric or definitive antifungal therapy in seven episodes. Using the novel criteria, positivity was ascertained a median of 10 days before conventional positivity was noted, and in six cases the GM test gave positive results only with the novel criteria. These chronological advantages were not observed with a threshold of 1.0 O.D.I. by method II: for episodes 5, 7, 8, and 10, the GM assay did not become positive; for episode 4, the GM assay exceeded the criteria 38 days after the onset of treatment; for episode 12, the GM assay gave positive results 16 days before the onset of treatment. According to the high PPV with the novel cutoff criteria (0.55 for proven or probable IA and 0.48 for proven, probable, or possible IFI) and the early timing of its positivity, we could have initiated antifungal therapy in a preemptive manner for episodes 4, 5, 7, 8, 10, 11, and 12.
Our result does not justify a discontinuation or moratorium of empiric antifungal treatment based only on a single negative result in the face of an impending threat of IA. It should be stressed that the extremely high NPVs provided here are episode-based calculations. Sample-based NPVs should be much lower, especially when patients are at high risk. We could not exclude a possibility of other IFI. Similarly, PPV does not always represent the probability of currently having IA but, rather, predicts the probability that the subject has or will have IA. In addition, while there was a sufficient number of no-IA episodes in this study to permit reliable estimations of specificity and NPV, there is much uncertainty regarding the estimations of the absolute values of sensitivity and PPV because of the small number of IA patients.
|
|
|---|
3)-beta-D-glucan measurement by the kinetic turbidimetric Limulus test,for the clinical diagnosis of mycotic infections. Eur. J. Clin. Chem. Clin. Biochem. 35:553-560.[Medline]
3)-beta-D-glucan measurement in diagnosis of invasive deep mycosis and fungal febrile episodes. Lancet 345:17-20.[CrossRef][Medline]
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»