Previous Article | Next Article ![]()
Journal of Clinical Microbiology, June 2004, p. 2623-2628, Vol. 42, No. 6
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.6.2623-2628.2004
HIV Immunology and Diagnostics Branch, Division of AIDS, STD and TB Laboratory Research, National Center for HIV, STD, and TB Prevention, Centers for Disease Control and Prevention, Atlanta, Georgia 30333
Received 14 November 2003/ Accepted 21 February 2004
|
|
|---|
1.5 demonstrated a high degree of correlation (R2 = 0.92); 566 (92%) of 615 of specimens tested in the two modes retained the same classification (recent or long-term infection). The values for those specimens with changed classifications (n = 49) were close to the cutoff (OD-n = 1.0), as expected. The twofold difference in the HIV IgG contents between the controls and the calibrator reagents was exploited to monitor individual plate runs by using a control plot, which was incorporated into the spreadsheet for data entry and run monitoring. This information provides baseline data for the successful transfer of BED-CEIA to other laboratories and the use of BED-CEIA for the detection of recent HIV seroconversion and the calculation of incidence estimates worldwide. |
|
|---|
The development and application of a less sensitive (LS) 3A11 assay provided a first practical approach and permitted detection of recent HIV-1 infection to estimate incidence (2). This assay was based on the increasing HIV antibody titers following seroconversion and distinguished recent from long-term infections on the basis of the antibody levels measured at a 1/20,000 dilution in conjunction with a predefined cutoff (determined with a calibrator specimen). This simple algorithm involving sensitive or LS assays provided a tool that could be used to test a single specimen to detect recent HIV seroconversion. However, the three-step, labor-intensive process of diluting the specimen 1/20,000, the need for dedicated equipment, the subtype-dependent assay performance (7), and the lack of availability of the assay resulted in the evaluation of other approaches, including a less sensitive modification of a 96-well HIV-1 enzyme immunoassay (EIA; Vironostika HIV-1 EIA; Organon Teknika Corp., Durham, N.C.). Although the LS Vironostika EIA works reasonably well with samples from HIV-1 subtype B-infected individuals (3), it does not address the issues related to 1/20,000 dilution and subtype-dependent performance (15). None of the commercial assays are likely to have similar performances with different subtypes because they use an antigen(s) derived from a single subtype.
We evaluated a number of alternative approaches for distinguishing recent from long-term infections (9) and have recently developed a new assay, an immunoglobulin G (IgG)-capture BED-EIA (BED-CEIA), that captures and detects an increasing proportion of HIV IgG in the serum (8). The BED-CEIA was designed by using a branched gp41 peptide (BED) with sequences derived from multiple subtypes to achieve similar performances with the different subtypes. An exhaustive evaluation of more than 600 longitudinal specimens from 139 incident infections allowed us to define a threshold cutoff that detects recent infection in which seroconversion occurred within the previous 160 days. This assay was developed in-house and is not yet commercially available. However, there is considerable interest in the use and application of this assay in various settings.
To enable training and to permit the transfer of the methodology to other laboratories, over the past year we have further refined the protocol and have included additional control reagents to monitor the performance of the assay. We describe here the performance characteristics of the BED-CEIA by assessment of the interrun, intrarun, batch, and operator variabilities and other parameters. These data will assist in the use and interpretation of the results of the assay and should provide a basis for the implementation of BED-CEIA in other laboratories.
|
|
|---|
![]() View larger version (21K): [in a new window] |
FIG. 1. Schematic showing the various steps of BED-CEIA. Among the antibodies captured, HIV IgG is shown by solid lines, while non-HIV IgG is shown by broken lines. TMB, tetramethylbenzidine; Strep, streptavidin.
|
1.5 were retested in triplicate to confirm their status (confirmatory mode) by using the median values for the triplicate values to calculate OD-n during the confirmatory mode. During the retesting, if the OD-n was >1.0, the seroconversion was assumed to have occurred more than 160 days before serum collection. Individuals with specimens with OD-n values
1.0 were considered to be recently infected, with seroconversion occurring within the last 160 days (8).
![]() View larger version (27K): [in a new window] |
FIG. 2. Algorithm for testing cross-sectional specimens to detect recent HIV-1 infection for incidence estimate purposes. See Materials and Methods for a description of OD-n.
|
500 sealed vials of each type of lyophilized specimen that had been stored frozen). The contents of the vials were reconstituted to the original volume by adding 200 µl of deionized water. The vials were vortexed and warmed to 37°C to solubilize the contents. High-positive control (HPC), CAL, and low-positive control (LPC) specimens were prepared by using 1/10, 1/20, and 1/40 dilutions of the HIV-1-positive specimen in HIV seronegative plasma, respectively. The relative proportions of HIV IgG in the HPC, CAL, and LPC specimens were 1x, 0.5x, and 0.25x (where the multiplication factor is related to the actual proportion of HIV IgG), respectively, because of the twofold dilution differences among these controls. The negative control (NC) was the HIV-seronegative plasma used to prepare the other controls. Serum specimens. During this study, about 3,000 blinded HIV-positive serum specimens from various cross-sectional populations were tested by the BED-CEIA. The specimens were from the United States, Thailand, Cote d'Ivoire, and Uganda and also included commercial sera (Boston Biomedica Inc., Boston, Mass.), which were used for the training. No specimen-specific data are presented here. Data for assessment of the reproducibility and performance characteristics of the BED-CEIA are presented here.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Mean OD-n, standard deviation, CV, and 99% confidence intervals for controls and CAL specimensa
|
![]() View larger version (20K): [in a new window] |
FIG. 3. Control plots showing the best-fit lines for 24 plates (A) and mean control plot for 144 plates with 99% limits (B). The x axis represents the relative levels of HIV IgG in controls and CAL. R2 values are shown for the best-fit lines for a mean of 24 plates (A) or a mean of 144 plates (B).
|
![]() View larger version (27K): [in a new window] |
FIG. 4. Interoperator reproducibility of BED-CEIA runs. Six operators tested a total of 504 specimens during their training periods, and raw OD (left) or OD-n (right) values were compared with the values generated by an experienced operator (operator 1) at the Centers for Disease Control and Prevention.
|
1.5 and therefore were further tested in triplicate for confirmation of the results. The level of concordance between the initial test results and the confirmatory test results was excellent (R2 = 0.92; Fig. 5), with 566 (92%) of 615 specimens retaining the same classification (recent or long-term seroconversion). To put it another way, 385 (12.8%) of 3,000 specimens were classified as being from individuals with recent seroconversion (OD-n,
1.0) on the basis of initial testing alone and 388 (12.9%) specimens were classified as being from individuals with recent seroconversion after the confirmatory testing, indicating a high degree of reproducibility. The classification changed for only 49 (8%) specimens upon confirmatory testing, and the values for all specimens were close to the cutoff, with mean values for the initial tests and the confirmatory tests of 1.007 ± 0.28 and 1.004 ± 0.27, respectively. As expected, the values for about equal number of specimens moved from below 1.0 to above 1.0 (n = 23), and vice versa (n = 26).
![]() View larger version (36K): [in a new window] |
FIG. 5. Concordance between the results of initial and confirmatory tests for 625 specimens (R2 = 0.92). The solid line represents the best-fit line, while the broken line represents 100% concordance (R2 = 1.0).
|
![]() View larger version (31K): [in a new window] |
FIG. 6. Mean interrun CVs between initial and confirmatory tests and mean intrarun CVs for specimens tested in triplicate at various ranges of OD values.
|
|
|
|---|
Development of the BED-CEIA to detect recent HIV infection by indirectly measuring the increasing proportion of HIV IgG following seroconversion addresses many of these issues (8). With data collected over 18 months, we demonstrate here that BED-CEIA is a very stable assay with minimal variation and outstanding interrun, intrarun, and interoperator CVs (Table 1; Fig. 4 to 6). Not only does the assay format permit the use of a 1/100 dilution of serum, but also more than twofold differences in dilutions are well tolerated, as long as the proportions of HIV IgG and non-HIV IgG do not change (data not shown). A multisubtype antigen (branched gp41 peptide; BED) was used in the assay to permit the equivalent detection of increasing antibody levels in individuals infected with each of the different subtypes. Our recent work with individuals infected with divergent HIV-1 subtypes (subtypes A through E) suggests that the assay performs similarly for individuals infected with different subtypes (unpublished data). It has recently been reported that both the LS 3A11 EIA (7) and the LS Vironostika EIA (15) have subtype-dependent performances; hence, their usefulness in countries where the different subtypes are present remains questionable. We have developed a CAL and other appropriate control reagents (HPC, LPC, and NC) that were run in triplicate on every plate. The ODs for the HPC and LPC reagents were designed to bracket the OD for the CAL, which is used to calibrate the assay and define the threshold cutoff value. These reagents are also used to validate the runs, to calculate the interrun CVs and 99% confidence limits, and to define the criteria for the acceptance or rejection of runs. Only 1 of 144 plates run over the 18 months of the study was rejected (the ODs were beyond the 99% limits). In addition, we have developed a spreadsheet that incorporates a control plot for quality assurance and analysis of the raw data (Fig. 7). This spreadsheet allows instant validation of the results for each plate and a systematic approach to data management. We recommend use of the control and CAL OD-n values derived from the last 20 plates instead of the values derived from the first 20 plates to establish the mean and the 99% confidence limits. This process accounts for lot-to-lot changes in one or more reagents or controls. Any major changes in raw OD values for the controls should be carefully examined to assess the performance of the assay.
![]() View larger version (65K): [in a new window] |
FIG. 7. Representation of a spreadsheet designed for data processing and quality assurance. Raw OD values are transferred electronically, and the best-fit plot indicating the acceptance or rejection of the data for the plate is generated.
|
It is noteworthy that the commercial assays being used or considered for use for detection of recent infection are designed as qualitative assays. Therefore, the kit reagents are prepared for a qualitative answer (yes or no) and have a wider range of values for acceptability. This can result in increased variability when such assays are modified (as in the LS EIAs) to gain a quantitative answer. The BED-CEIA, in contrast, is designed to be a quantitative EIA and therefore should be more reproducible. Since most cross-sectional specimen sets include specimens from individuals exhibiting antibodies at various levels, the precision of the methodology becomes more important. In addition, our procedure for normalizing the OD value by a simple ratio (specimen OD/CAL OD) resulted in better reproducibility. Subtraction of the OD value for the NC from the OD values for the specimen and CAL (as is done by the LS EIA protocol) resulted in more variability (data not shown).
Although the BED-CEIA has outstanding performance characteristics, it is still an in-house assay with limited availability. Some of the crucial reagents (e.g., the BED-biotin peptide and the CAL and control reagents) are available only from our laboratory; however, we plan to develop an assay kit for wider availability. This will allow us to conduct studies of the stabilities of the reagents in a kit format. We anticipate that the actual variability of the test among laboratories will be higher than that shown here as more laboratories begin to perform the assay. However, these data provide guidance for monitoring the performance of the test to minimize assay variations. Personnel from several laboratories have successfully been trained over the last year, and our data indicate that the reproducibility during the training was excellent (Fig. 4). Subsequently, the assay has successfully been transferred to six laboratories. This description of the performance characteristics of BED-CEIA should further help with training and the transfer of this technology to other laboratories and expansion of the use of this approach for the detection of recent HIV seroconversion.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»