Previous Article | Next Article ![]()
Journal of Clinical Microbiology, January 2004, p. 21-29, Vol. 42, No. 1
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.1.21-29.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
Abbott Diagnostika GmbH & Co. KG, Wiesbaden, Germany,1 Abbott Laboratories, Abbott Park, Illinois2
Received 11 April 2003/ Returned for modification 5 August 2003/ Accepted 17 September 2003
|
|
|---|
9.3% for each precision panel specimen or assay control and
5.3% for the negative assay control. |
|
|---|
Antigen (p24) testing in a combined (fourth-generation) format has been estimated to reduce the seroconversion window by a few days to as much as
2 weeks in comparison with third-generation single-format antibody detection assays (5, 12, 18, 25, 27, 28, 30-32). Despite enhanced seroconversion sensitivity, fourth-generation assays will be most valuable only if the specificity and sensitivity of individual antibody and antigen detection formats are not compromised when they are combined into a single immunoassay. Sensitive combination assays will need to detect antigen at levels equivalent to those of single-format antigen assays in order to be recommended as replacements for current antigen tests (5, 6, 15, 18, 32). This prerequisite, however, presents a considerable technical challenge not met by all combination assays (5, 6, 12, 15, 28). In addition, not all combined formats have achieved the low (nonconfirmed) repeat-reactive rates expected of blood donor screening and diagnostic assays that result in high specificities such as those typically displayed by third-generation single-format antibody assays (5, 12, 17, 23, 25, 32). In this report we describe a multicenter evaluation of a fourth-generation, fully automated HIV combination assay (AxSYM HIV Ag/Ab Combo MEIA [AxSYM Combo]; Abbott Laboratories, Abbott Park, Ill.), and we demonstrate an antigen assay sensitivity approaching that of single-format antigen tests, achievement of a specificity equivalent to that of a third-generation single-format antibody assay, and a high degree of total precision.
|
|
|---|
In the second step, antibody (anti-tmp) and/or antigen (p24 core antigen) sandwiches are formed by automated addition of biotinylated probes (biotinylated recombinant tmp, biotinylated peptides derived from the immunodominant regions of tmp, and biotinylated monoclonal [anti-p24] antibodies) to microparticle-bound immune complexes. Biotinylated probes are presented in a buffered diluent (probe diluent) formulated to enhance immune binding and to limit nonspecific interactions between probes and solid-phase components. After an incubation period, AxSYM washes the matrix and removes unbound materials.
In the third step, biotinylated probes bound to the solid phase via sandwich formation are reacted with an anti-biotin rabbit antibody complexed with alkaline phosphatase (conjugate) presented in a diluent formulated to enhance the formation of biotin-anti-biotin immune complexes and to limit nonspecific binding of the conjugate. After an incubation period, unbound, excess conjugate is washed away. AxSYM detects the formation of antibody (anti-tmp) and antigen (p24 core protein) immune complexes by automated addition of 4-methylumbelliferyl phosphate, which is a fluorescent substrate for alkaline phosphatase. As 4-methylumbelliferyl phosphate is converted to methylumbelliferone by alkaline phosphatase, AxSYM detects and quantifies the fluorescent signal. The signal is proportional to the amount of antibody (anti-tmp) or antigen (p24 core protein) contained in the original plasma or serum sample. Additional, detailed technical information is contained in the AxSYM Combo LN2G83 package insert.
The AxSYM Combo assay cutoff value (the rate units of the index calibrator plus 27.5 rate units) was determined from previous studies and was maintained throughout this study. AxSYM stores the mean rate of three index calibrator replicates, calculates the cutoff by adding 27.5 rate units, and delivers specimen results as a ratio of the specimen signal (in rate units) to the cutoff value (S/CO). S/CO ratios of
1 were reactive and indicated the presence of anti-HIV immunoglobulin and/or p24 antigen (markers); ratios equal to or greater than 0.90 and less than 1.0 were in the gray zone; and ratios of <0.90 were negative or nonreactive for the marker(s). AxSYM Combo reagent and control kits were made and supplied by Abbott GmbH & Co. KG, Wiesbaden, Germany.
AxSYM gO. AxSYM HIV [1/2] gO MEIA (AxSYM gO; Abbott Laboratories) is a three-step antibody detection assay similar to the AxSYM Combo employing the same antibody detection reagents and components. Additional, detailed technical information can be found in the AxSYM gO package insert. AxSYM gO reagent and control kits were made and supplied by Abbott GmbH & Co. KG.
Confirmatory (supplemental) assays. New LAV Blot I and New LAV Blot II were from Bio-Rad, Hercules, Calif. HIV Antigen MAB (p24 antigen test) and HIV Antigen Confirmatory were from Murex Biotech Ltd., Dartford, United Kingdom. Amplicor HIV-1 Monitor was from Roche Diagnostics GmbH, Mannheim, Germany. Commercial assays were performed according to their respective package inserts. Confirmatory testing was conducted at Abbott GmbH & Co. KG and at BioScientia, Ingelheim, Germany.
Specimens. Human specimens used in this study were collected according to each country's relevant guidelines and each vendor's relevant institutional policies. In addition to specificity testing against specimens from random blood donors and hospital patients, AxSYM Combo was evaluated against a panel of plasma specimens (n = 319) from non-HIV-infected patients with a variety of diseases, disorders, infectious agents, or conditions which might cause inaccurate test results. These included specimens from (i) individuals with previous or current infection with hepatitis B virus (HBsAg positive) (n = 15), cytomegalovirus (n = 15), Epstein-Barr virus (n = 10), herpes simplex virus (n = 15), or hepatitis A virus (n = 15) (all from Pyramid Profile Diagnostics, Sherman Oaks, Calif.), hepatitis C virus (n = 10), human T-cell leukemia virus type I (n = 10), or human T-cell leukemia virus type II (n = 10) (all from Impath BioClinical Partners, Franklin, Mass.), or rubella virus (n = 15) (Pyramid Profile Diagnostics); (ii) individuals with previous or current infection with Candida albicans (n = 10), Toxoplasma gondii (toxoplasmosis) (n = 15), Treponema pallidum (syphilis) (n = 15), or E. coli (blood and/or urine culture positive) (n = 9) (supplied by Pyramid Profile Diagnostics [T. pallidum and T. gondii], ProMedDx [E. coli], and BioScientia [C. albicans]); (iii) individuals with rheumatoid factor (n = 12) (Uniklinikum Aachen, Aachen, Germany, and Pyramid Profile Diagnostics), anti-nuclear antibodies (n = 14) (Pyramid Profile Diagnostics), elevated levels of IgG (n = 10) or IgM (n = 10) (Millennium Biotech, Fort Lauderdale, Fla.), multiple myeloma (n = 9) or monoclonal gammopathy (n = 10) (BioClinical Partners), or HAMA (human anti-mouse antibody) (n = 10) (Scantibodies); (iv) pregnant females in the 1st (n = 26), 2nd (n = 17), or 3rd (n = 17) trimester, or multiparous females (n = 10) (supplied by BioClinical Partners [pregnant and multiparous females] and Millenium Biotech [pregnant females only]); and (v) flu vaccinees (n = 10) (supplied by Uniklinikum Aachen).
Sensitivity was determined by using the following categories of specimens: (i) 453 specimens from HIV-1-infected individuals staged to according to the Centers for Disease Control and Prevention (CDC) classifications (143 at stage A, 131 at stage B, and 179 at stage C); (ii) 55 specimens from individuals infected with known HIV-1 group M subtypes (11 with subtype A, 3 with subtype B, 1 with subtype B/D, 7 with subtype C, 5 with subtype D, 6 with CRF01_A/E, 16 with subtype F, 5 with subtype G, and 1 with subtype J) (supplied by Boston Biomedica Inc., West Bridgewater, Mass., and Abbott Laboratories); (iii) 107 specimens from nonstaged individuals infected with unknown subtypes of HIV-1; (iv) 19 specimens from individuals infected with HIV-1 group O (supplied by Loeffler Institute of Greifswald, Greifswald, Germany, Boston Biomedica Inc., and Abbott Laboratories), 9 of which were tested at a 1:100 dilution in normal human plasma to conserve the specimens, while all others were tested undiluted; (v) 108 specimens from individuals infected with HIV-2 living in regions of HIV-2 endemicity (supplied by Boston Biomedica Inc., Abbott Laboratories, and DiaServe Laboratories GmbH, Hamburg, Germany); (vi) 50 specimens from individuals infected with HIV-1 containing p24 antigen, half of which also contained detectable antibody against HIV-1 (supplied by Impath-BioClinical Partners, Pyramid Profile Diagnostics, Inc., and Boston Biomedica Inc.); (vii) 179 specimens from individuals with elevated risks of HIV infection, including 40 from homosexual males and 40 from individuals with a sexually transmitted disease (supplied by Millenium Biotech, Inc.), 40 specimens from intravenous drug abusers (supplied by Pyramid Profile Diagnostics Inc.), and 19 specimens from individuals with hemophilia, 10 from dialysis patients, and 30 from multiply transfused individuals (supplied by Impath-BioClinical Partners); (viii) HIV-1 seroconversion panels (designated by catalog no.) 6240, 6243, 6244, 6247, 6248, 9012, 9013, 9015, and 9028 (supplied by Impath-BioClinical Partners), PRB923, PRB924, PRB926, PRB931, PRB938, PRB940, PRB941, and PRB945 (supplied by Boston Biomedica Inc.), RP029 (supplied by Pyramid Profile Diagnostics Inc.), and SV-0400, SV-0401, SV-0403, and SV-0406 (supplied by Nabi, Boca Raton, Fla.). In addition, (ix) quantitative antigen sensitivity was estimated from linear regression analysis of panel members 2025 to 2029 from the p24 quantitative standard panel VIH SFTS96', supplied by the French Society of Blood Transfusion.
Precision. The assay precision was evaluated at each testing center by using controls consisting of a negative index calibrator, negative control, positive control 1 (human anti-HIV-1 plasma), positive control 2 (human anti-HIV-2 plasma), viral lysate positive control (gradient enriched, lysed HIV-1 in Tris buffer), and a proficiency panel consisting of two human anti-HIV-1 plasma specimens, two human anti-HIV-2 plasma specimens, one specimen containing a mouse monoclonal antibody (anti-HIV-1 group O tmp) in negative human plasma, and one specimen containing p24 purified from HIV-1 in negative human plasma (delivered frozen). The controls and panel samples were evaluated at 10 independent sites on 10 instruments, with the exception of the HIV-1 p24 proficiency panel member tested at 8 sites on 8 instruments. Nine sites tested two different lots of controls, and one site tested three different lots of controls. All samples were tested in triplicate over three runs. At one site, the controls and panel samples were tested on one reagent kit (clinical) lot; at eight sites, they were tested on each of two reagent kit (clinical) lots; and at one site, they were tested across four different reagent kit (clinical) lots. The within-run and between-run standard deviations (SD) and coefficients of variation (CV) were analyzed by variance component analysis using a mixed analysis of variance model (20).
Specificity and sensitivity.
Specificity was determined with samples from random blood donor populations (7,900 specimens collected from seven blood screening centers and comprising 6,352 serum samples [distributed over five testing sites] and 1,548 plasma samples [distributed over two testing sites]) and diagnostic populations (1,938 specimens collected from patients in six hospitals, with testing distributed over five sites). Specificity was defined as the percentage of HIV marker-negative specimens correctly identified as nonreactive in populations at low risk of HIV infection and was calculated as [TN/(TN + FP)] x 100, where TN (true negatives) is the number of HIV RNA- and HIV marker-negative specimens correctly identified by the AxSYM Combo as nonreactive (negative), FP (false positives) is the number of HIV RNA- and HIV marker-negative specimens incorrectly identified as repeat reactive (positive) by the AxSYM Combo, and TN + FP is the sum of all specimens in the study population (10). Specimens that were initially reactive (S/CO,
1.0) or initially gray zone reactive (0.9
S/CO < 1.0) in AxSYM Combo and/or AxSYM gO were retested in duplicate in both assays, and those that were repeatedly reactive and/or repeatedly gray zone reactive were analyzed by supplemental tests including the Amplicor HIV-1 Monitor (ultrasensitive HIV RNA procedure), New LAV Blot I and New LAV Blot II (interpreted for the presence of antibodies against HIV according to German standard DIN 58969-41 [July 1994]), and/or HIV Antigen MAB and HIV Antigen Confirmatory (to detect HIV p24 antigen). Repeat-reactive specimens that contained detectable HIV RNA, HIV antigen, or anti-HIV immunoglobulin were confirmed as positive and omitted from the specificity calculation.
Sensitivity was defined as the percentage of HIV marker-positive specimens correctly identified as repeat reactive in pedigreed specimens containing detectable anti-HIV immunoglobulin, HIV p24 antigen, or HIV RNA and was calculated as [TP/(TP + FN)] x 100, where TP (true positives) is the number of repeat-reactive specimens containing HIV markers or HIV RNA, FN (false negatives) is the number of specimens containing at least one HIV marker incorrectly identified as nonreactive (negative), and TP + FN is the sum of all the specimens in the sensitivity study (10).
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. AxSYM Combo precision
|
|
View this table: [in a new window] |
TABLE 2. AxSYM Combo specificity
|
During testing of the AxSYM Combo against a panel of 319 specimens (from non-HIV-infected individuals) containing potential interfering substances, only 5 samples were identified as repeat reactive (data not shown). These specimens belonged to individuals with E. coli infection (n = 2) (S/CO, 2.8 and 4.4), rheumatoid factor (n = 1) (S/CO, 1.7), or monoclonal gammopathy (n = 2) (S/CO, 17.8 and 2.1).
Panels of pedigreed HIV-1 and HIV-2 specimens were evaluated in order to determine the qualitative sensitivity of the AxSYM Combo compared to the AxSYM gO (Table 3). The AxSYM Combo readily detected all specimens containing anti-HIV immunoglobulin (S/CO, 6.42 to 72.11) from patients in CDC stages A, B, and C (Fig. 1A through C, respectively). These data demonstrated that the AxSYM Combo had ample sensitivity to detect HIV-1 infections (anti-HIV-1 immunoglobulin), although the means of S/CO ratios for the specimens from staged patients were slightly greater for the AxSYM gO. Additionally, specimens containing anti-HIV-1 immunoglobulin against specific group M subtypes (Fig. 2A) were slightly more reactive by the AxSYM Combo than by the AxSYM gO. Further comparisons of S/CO ratios demonstrated that specimens from individuals infected with HIV-1 group O (Fig. 2B) or HIV-2 (Fig. 2C) were more reactive by the AxSYM Combo than by the AxSYM gO. Of 25 specimens (Table 3) containing at least 25 pg of HIV antigen/ml but no antibody, all were detected at S/CO ratios ranging from 1.15 to 71.37; the remaining 25 specimens containing antigen and antibody also were reactive.
|
View this table: [in a new window] |
TABLE 3. AxSYM Combo sensitivity
|
![]() View larger version (26K): [in a new window] |
FIG. 1. Evaluation of the qualitative antibody sensitivity of the AxSYM Combo compared to that of the AxSYM gO by using pedigreed specimens from HIV patients at different CDC stages.
|
![]() View larger version (22K): [in a new window] |
FIG. 2. Evaluation of the qualitative antibody sensitivity of the AxSYM Combo compared to that of the AxSYM gO by using pedigreed specimens from individuals infected with HIV-1 group M (A), HIV-1 group O (B), or HIV-2 (C).
|
|
View this table: [in a new window] |
TABLE 4. Concordance between the AxSYM Combo and the AxSYM gO in a high-risk population
|
|
View this table: [in a new window] |
TABLE 5. AxSYM Combo seroconversion sensitivity
|
|
View this table: [in a new window] |
TABLE 6. AxSYM Combo performance on selected seroconversion panels
|
|
View this table: [in a new window] |
TABLE 7. AxSYM Combo p24 antigen analytical sensitivitya
|
|
|
|---|
The quantitative antigen sensitivity of the combined immunoassay was estimated at 17.5 pg of p24/ml of plasma, a value closely approaching that of single-format antigen detection assays evaluated in a study by Laperche et al. (15). In contrast to the antigen sensitivity of the AxSYM Combo, the authors (15) noted that other combined-format assays were manyfold less sensitive (65 to 250 pg/ml) than the single-antigen detection formats (8 to 15.7 pg/ml). Of course, comparisons of quantitative sensitivity are primarily dependent on the quantitative standard, and for that reason we selected the "Ag VIH SFTS96'" panel (French Society of Blood Transfusion) for our studies. The antigen sensitivity of commercial combination assays often is lower than standards set by current single-format antigen assays (8, 15, 18, 21). Delforge et al. (8) noted significant differences in the reactivities of commercially available combination assays against a patient specimen apparently containing a high level of p24 antigen (1,600 pg/ml), resulting in one selected combination assay producing a false-negative result. Further, the study (8) noted that one combination assay may be even less sensitive than third-generation single-format antibody detection assays. Additionally, Mukadi et al. (21) noted that a third-generation single-format antibody detection assay (AxSYM gO) was more sensitive than an unrelated commercial combination assay. These observations emphasize the sensitivity issues that may arise when individual antigen and antibody formats are combined into a single format (28). Although antigen sensitivity is of particular value because it is the key driver of seroconversion sensitivity (5, 6, 8, 12, 15, 18, 25, 27, 28, 30-32), antibody sensitivity must be maintained in order to detect specimens that may contain barely detectable levels of antibody or very low levels of both antibody and antigen. Sensitivity is the most important performance characteristic of an HIV screening or diagnostic assay, and it should not be compromised for any reason.
The reduction in the seroconversion window achieved with the AxSYM Combo was consistent with sensitive (17.5 pg/ml) antigen detection. Close inspection of the commercial seroconversion panels (and their associated vendor data) selected for this study revealed that in 17 of 22 (77%) seroconversion panels, the combined immunoassay was reactive against the earliest positive bleed detected by a single-format antigen (or antibody) assay, and the mean time delay between a sensitive antibody assay (the AxSYM gO) and the AxSYM Combo was 6.15 days. The data clearly demonstrate that the combined format detects specimens from HIV-antigenemic seronegative individuals and therefore reduces the risk of transfusion-transmitted HIV infection due to seronegative donations during the window period. The mean time delay (6.15 days) is in agreement with the findings of several other reports examining HIV combination assays (5, 12, 15, 18, 25, 27, 28, 30-32). However, estimations of mean time delay are dependent on the seroconversion panels selected, particularly the time intervals between collection of specimens, and the comparative tests employed. Ly et al. (16, 18) and others (6, 15, 30-32) have attempted to provide a frame of reference across multiple seroconversion panels and multiple HIV combination assays, including the AxSYM Combo. Comparisons between combination assays are most meaningful when identical seroconversion panels are evaluated across assays run concurrently.
It is noteworthy that Ly et al. (16) reported the AxSYM Combo to be sensitive for (p24) antigen from multiple HIV-1 group M subtypes. Remarkably, the AxSYM Combo displayed little or no difference in antigen sensitivity across group M and group O isolates. In contrast, one selected commercial HIV combination assay was specifically insensitive to antigen from an HIV-1 subtype C isolate, and a second combination assay was generally less sensitive than the AxSYM Combo against antigens from group M subtype isolates and was specifically insensitive to antigen from a group O isolate (16). Future improvements to estimations of antigen sensitivity across subtypes and groups of HIV-1 should include quantitative standards for each (p24) antigen.
Antibody sensitivity in the combined format was equivalent to or better than that of a related, sensitive, third-generation single-format antibody assay, the AxSYM gO. Significantly, the reactivities of specimens containing immunoglobulin elicited against HIV-1 group O and HIV-2 were greater in the AxSYM Combo than in the AxSYM gO, representing an improvement of antibody sensitivity in the combined format over that in the third-generation single-format antibody assay. The combined immunoassay readily detected all specimens from individuals infected with known or unknown HIV-1 group M subtypes and from patients in CDC stages A, B, and C. Reactivities for all samples were in excess of an S/CO ratio of 10.0, with the single exception of one strongly reactive specimen with an S/CO ratio of 6.42. These data are consistent with the observations of Ly et al. (16) indicating that the antibody sensitivity of the AxSYM Combo is equal to or greater than the antibody sensitivity of multiple other commercial HIV combination assays, particularly for specimens from individuals infected with HIV-2 or HIV-1 group O. The antibody sensitivity of the AxSYM Combo is consistent with the goal of maintaining sensitivity as the single most important performance characteristic of an HIV screening or diagnostic assay.
The specificities of the combined format for blood donor (99.87%) and diagnostic (99.90%) populations were nearly equivalent and met or exceeded the specificity characteristics usually associated with third-generation single-format antibody assays. In diagnostic populations, the AxSYM Combo outperformed the AxSYM gO, and the specificity of the combined format (99.90%) fell into the high end of the 95% confidence interval (99.55 to 99.97%) bracketing the specificity of the single-format antibody assay. In blood donors, the specificity of the AxSYM Combo was statistically equivalent to that of the AxSYM gO and fell into a narrow 95% confidence interval (99.83 to 99.97%) bracketing the specificity of the AxSYM gO. Only an additional 5 repeat-reactive specimens would be identified among 10,000 donor specimens when the combined format rather than the single-antibody format was used. The AxSYM Combo is an appropriate screening method for low-incidence populations (blood donors) because of the low rate of potential deferrals (the percentage of repeat false-reactive results was 0.13% among blood donors), and it is an appropriate diagnostic assay for higher-risk populations because of the low rate of false-reactive results (0.10% in a diagnostic population) coupled with excellent sensitivity and a high positive predictive value (10). In contrast, Ly et al. (17) observed 99.51% specificity (29,657 specimens) for a commercial diagnostic combination assay in a survey performed with consecutive and unselected French samples in public and private laboratories. Numerous other reports indicate that the specificities of HIV combination assays appear to vary significantly (5, 12, 17, 23, 25, 28, 31, 32). HIV combination immunoassays may suffer from a lack of specificity because each of the two individual formats (antigen detection or antibody detection) may elicit different negative population profiles (means and SD), may require different cutoff values for optimal sensitivity and specificity, and must necessarily utilize more reagents (e.g., antigens and monoclonal antibodies) in the combined format, providing additive contributions to nonspecific binding (12, 33; unpublished data). These factors must be reconciled in the combined format in order to achieve a specificity equivalent to or better than that of third-generation single-format antibody assays.
The AxSYM Combo is a highly sensitive, specific, and reproducible fourth-generation test that provides a clear sensitivity advantage over third-generation single-format antibody assays. Technical factors that may cause combination assays to be less sensitive or less specific than single-format assays have been overcome, resulting in an assay with a specificity suitable for screening (99.87%) or diagnostic (99.90%) purposes, an antigen sensitivity approaching that of single-format antigen tests, and an antibody sensitivity equivalent to that of a related third-generation HIV antibody assay. The AxSYM Combo received the EC Design Examination Certificate on 22 March 2002.
na Levi
nik-Stezinar, Blood Transfusion Center of Slovenia, Ljubljana, Slovenia; Rüttger Averdunk, Auguste Viktoria Krankenhaus, Berlin, Germany; Michael Elgas, Medizinisches-Diagnostisches Institut, Städtisches Klinikum Karlsruhe GmbH, Karlsruhe, Germany; Sveinn Gudmundsson, Blood Bank of the National University Hospital, Reykjavik, Iceland; Sheila Cameron, Gartnavel General Hospital, Glasgow, Scotland; Gulja Willnauer, Institut für Klinische Immunologie & Transfusionsmedizin, Universitätsklinikum Leipzig AöR, Leipzig, Germany; Giovanni Landucci, Lucca Ospedale Civile, Lucca, Italy; Michaela Macri, Azienda Ospedalira "A. Cardarelli," Naples, Italy; and Michèle Maniez- Montreuil, EFS Nord de France, Lille, France. We thank L. Gurtler (Friedrich Loeffler Institute for Medical Microbiology, Griefswald, Germany), L. Kaptue (Département d'Hématologie, Université de Yaoundé, Yaoundé, Cameroon), and L. Zekeng (Laboratoire de Santé Hygiène Mobile, Yaoundé, Cameroon) for kindly providing us with specimens.
Participants of the AxSYM Clinical Study Group are listed in Acknowledgments. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»