Previous Article | Next Article ![]()
Journal of Clinical Microbiology, February 2004, p. 610-617, Vol. 42, No. 2
0095-1137/04/$08.00+0 DOI: 10.1128/JCM.42.2.610-617.2004
Copyright © 2004, American Society for Microbiology. All Rights Reserved.
Department of Pathology, Clinical Microbiology Division, University of Texas Medical Branch, Galveston, Texas 77555
Received 18 July 2003/ Returned for modification 31 August 2003/ Accepted 4 November 2003
|
|
|---|
|
|
|---|
The HCV genome consists of seven functional regions: the core, the envelope, including the E1 and E2 regions, and the nonstructural region, including NS2, NS3, NS4, and NS5 (31). The first commercially available HCV test was an enzyme-linked immunosorbent assay, which was introduced in 1989. This assay incorporated recombinant C100-3 antigen derived from the nonstructural region of the virus. The second-generation assay, introduced in 1991, incorporated recombinant antigens from nonstructural regions (NS3 and NS4) of the putative HCV genome (3, 38, 45). These antigens are shown to be detectable in the late phase of acute infection and become undetectable a few months to a few years after recovery in subjects not progressing to chronicity. The first- and the second-generation anti-HCV enzyme immunoassays, thus, had important limitations, notably, a high rate of false-positive and -negative results (7, 18). To increase both sensitivity and specificity, a greater number of HCV-encoded antigens are now included in the third-generation enzyme immunoassay (EIA), allowing an increase in the specificity (8, 19). The addition of core and NS5 region-encoded antigens on the solid phase of serological assays also resulted in earlier detection of anti-HCV during acute infection, a marked increase in the sensitivity, and a dramatic reduction in the incidence of posttransfusion hepatitis in blood banks (25). Detection of antibodies to the NS5 region-encoded antigens in the immunoassay, together with a different format and antigen concentration on the solid phase contributes to increased sensitivity of the screening test (25). A strip immunoassay developed by the Chiron Corporation (Emeryville, Calif.) is being used to help differentiate true-positive from false-positive EIA results. The Food and Drug Administration approved the second-generation recombinant immunoblot assay (RIBA) in 1993 followed by approval of the third-generation RIBA in 1999. The strip immunoassays include the EIA antigens and human superoxide dismutase (hSOD). The RIBA is considered positive if there are reactions with at least two antigens with intensities greater than or equal to that for the weak immunoglobulin G (IgG) control and no reactivity with hSOD. Indeterminate RIBA are those in which there are reactions with only one antigen or with the hSOD plus one or more HCV antigens. Replacement of the C100 and C22 recombinant proteins with synthetic peptides in the version 3.0 RIBA has significantly reduced the number of indeterminate RIBA results (16, 36, 40, 41).
Although diagnostic tests that employ EIA and RIBA are used for serological screening and confirmation, respectively, nucleic acid testing and HCV antigen detection methods are required to demonstrate active infection (11, 17). As HCV antigen tests are still under development, qualitative nucleic acid testing is currently the method of choice to confirm active infection (11, 17, 42). In addition, the measurement of HCV RNA levels in plasma by a branched DNA assay has become an important tool for monitoring individuals during antiviral therapy (9).
Viral hepatitis due to HBV is a major public health problem, with an estimated 300 million persistent carriers of HBV worldwide (54, 55). HBV infection produces an array of unique antigens and antibody responses that follow distinct serological patterns (55, 56). The envelope protein of HBV, HBsAg, is one of the first serum markers to appear during the course of HBV infection and can be detected 2 to 8 weeks before biochemical evidence of liver dysfunction and the onset of jaundice. HBsAg is a glycosylated lipoprotein that is usually shed in large amounts in the serum of infected individuals. HBsAg is cleared within a few months in self-limited illness. If HBsAg persists for more than 6 months, spontaneous clearance is unlikely and the infected individual is considered a chronic HBV carrier (56). The determinant of HBsAg is the major neutralizing epitope. Serological detection of HBsAg involves the use of either monoclonal or polyclonal anti-HBs bound to a solid-phase or second labeled anti-HBs to detect the captured antigen. Despite the high performance of third-generation enzyme-linked immunosorbent assay in the detection of HBsAg, a high incidence of false-negative results has been reported (22-24, 43).
Antibodies to HBsAg indicate recovery from infection and serve as an indicator of protection from infection (53). Individuals who have resolved their HBV infection usually demonstrate both anti-HBsAg and antibody to HBcAg (anti-HBc) in their serum. Anti-HBsAg testing is useful for identifying HBV-susceptible individuals in pre- and postvaccination screening programs, where absence of these antibodies is indicative of susceptibility to HBV infection (26, 28, 53). This could be an indication for vaccination against HBV. Serological immunoassays for qualitative determination of antibodies to HBsAg in serum involves the reaction of anti-HBsAg in the sample with HBsAg coated onto the wells.
While the diagnosis of HBV infection is based on serologic detection of the HBsAg and anti-HBsAg antibodies as described above, HBV replication status in these patients is usually monitored through assessment of HBV DNA levels. Monitoring of serum HBV DNA levels is a consistent method for the assessment of potency of antiviral therapy (1, 37).
The aim of this study was to assess the performance of a new, fully automated rapid immunodiagnostic chemiluminescence system (Ortho/ECi) for qualitative detection of HBsAg, antibodies to HBsAg, and antibodies to HCV in terms of specificity, sensitivity, and suitability for use in the diagnosis of viral hepatitis compared to commercially available and commonly used screening Abbott EIA, version 2.0. Supplemental assays based on either neutralization or RIBA that possess high specificity were applied to resolve discrepant results between the two immunoassays.
|
|
|---|
Ortho/ECi anti-HCV assay.
The Ortho/ECi anti-HCV assay is a two-step sandwich chemiluminescence assay for the qualitative detection of human antibodies in serum or plasma to various proteins of HCV, with a total incubation time of 45 min. Recombinant antigens from the HCV core, NS3, NS4, and NS5 regions of the HCV genome are immobilized on the solid phase (coated wells). After incubation of controls and specimens and subsequent washing, horseradish peroxidase (HRP)-labeled mouse anti-human IgG conjugate is added. Unbound materials are removed by washing, and a reagent containing luminogenic substrates and an electron transfer agent are added to the wells. The HRP in the bound conjugates catalyzes the oxidation of the luminol derivative, producing light. The electron transfer agent increases the level and duration of the light produced. The light signals are read by the Ortho/ECi system. Results are calculated as a normalized signal relative to the cutoff value (signal/cutoff [S/C] ratio). During the calibration process, a lot-specific parameter, encoded on the lot calibration card, is used to determine a valid stored cutoff value for the Ortho/ECi system. Therefore, the results are calculated by dividing the signal for test sample by the cutoff value. Patient samples with single S/C ratio of
1.00 are considered to test positive. If the S/C ratio is <0.90, the sample is considered negative. Samples with an S/C ratio of
0.90 and <1.00 were retested in duplicate based on the manufacturer's recommendation. The Ortho/ECi system uses a small sample volume (20 µl) for each determination compared to 100 µl of sample used for the anti-HCV Abbott EIA. Discrepant results between Ortho/ECi and Abbott EIA were resolved by Chiron HCV strip RIBA, version 3.0.
Ortho/ECi HBsAg.
Detection of HBsAg by Ortho/ECi involves the simultaneous reaction of HBsAg in the sample with mouse monoclonal anti-HBs antibodies coated onto the wells and an HRP-labeled mouse monoclonal anti-HBs antibody in the conjugate. The total incubation time is 29 min. Results are calculated similar to that described above. Samples with an S/C ratio of
5.00 are considered positive. If the S/C ratio is <0.90, the sample is considered negative. Samples with an S/C ratio between
0.90 and <5.00 are retested in duplicate. The Ortho/ECi HBsAg assay uses 80 µl of sample for each determination compared to 200 µl of sample used for the Abbott EIA for HBsAg. Indeterminate or discrepant results were resolved by the Ortho HBsAg confirmatory kit. As part of the evaluation process, the performance of the Vitros HBsAg confirmatory neutralization kit was also evaluated and the results were compared with those obtained by the same test performed by another laboratory. The test utilizes the principal of specific antibody neutralization to confirm the presence of HBsAg. The sample is tested twice: one aliquot is incubated with a neutralizing reagent containing high-titer human anti-HBs (the confirmatory antibody), and the second aliquot is incubated with a nonneutralizing control reagent (the sample diluent). The confirmatory antibody binds to HBsAg in the sample, inhibiting its reaction in the Vitros HBsAg assay. This leads to a reduced S/C ratio compared to that for the nonneutralized control samples.
Ortho/ECi anti-HBsAg antibody assay.
Detection of anti-HBsAg antibodies by Ortho/ECi involves the simultaneous reaction of antibodies in serum with purified native HBsAg coated onto the wells and an HRP-labeled mouse monoclonal anti-HBs antibody in the conjugate. The results are calculated in a way similar to that for the anti-HCV assay. The incubation time is 45 min. Samples with an S/C ratio of
1.20 are considered positive. This cutoff value was found to be consistent with a level of anti-HBs antibodies of
10 mIU/ml determined by quantitative anti-HBsAg assay. The accepted criterion for immunity to HBV is
10 mIU of anti-HBs/ml, with milli-international units defined by the World Health Organization reference preparation (14).
If the S/C ratio is <0.50, the sample is considered negative. Samples with an S/C ratio of
0.50 and <1.20 are reported as indeterminate and retested in duplicate. The Ortho/ECi anti-HBsAg assay uses 80 µl of sample for each determination compared to 200 µl of sample used for Abbott EIA anti-HBsAg. Indeterminate or discrepant results were resolved by quantitative anti-HBs assay to determine the immunological status of the patient. Additionally, further chart reviews, described below, were undertaken to determine the clinical and immunological status of the individual as well as the presence or absence of risk factors and/or interfering substances.
Design of evaluation and procedures. Intra-assay precision was determined as follows: negative and positive controls of the test kit as well as known positive or negative patient samples were measured repeatedly within one run.
Evaluation of laboratory performance. Six different sample panels were selected: sera negative (n = 318) or positive (n = 177) for anti-HCV prescreened with Abbott EIA, version 2.0; sera negative (n = 214) or positive (n = 239) for anti-HBsAg prescreened with Abbott EIA, version 2.0; and sera negative (n = 312) or positive (n = 158) for HBsAg prescreened with Abbott EIA. Serum specimens were stored both refrigerated and frozen prior to testing. Some of the serum samples were preselected on the basis of serological profile as determined by Abbott EIA, version 2.0. These samples were frozen and tested subsequently with the Ortho/ECi assay. Other samples were refrigerated and tested simultaneously within 72 h of specimen collection with Ortho/ECi and Abbott EIA.
Comparative and supplemental assays. The Ortho/ECi chemiluminescence assay (Ortho Clinical Diagnostic) was compared to the Abbott EIA, version 2.0 (Abbott Laboratories). The Ortho/ECi test results obtained in each assay format were independently evaluated against the Abbott EIA. Confirmatory tests for each assay and marker were performed on all specimens, with discrepant results between Ortho/ECi and Abbott EIA to determine false-positive and -negative test results. For example, a third-generation RIBA (Chiron) was performed on discrepant anti-HCV samples according to the manufacture's instructions. Discrepant HBsAg samples were additionally tested with the Ortho/ECi HBsAg confirmatory kit. Discrepant anti-HBsAg samples were further evaluated by Abbott EIA AUSAB anti-HBsAg quantitation panel according to the manufacturer's instructions. Discrepant samples with indeterminate results by confirmatory and supplemental tests were further evaluated by chart review.
Chart review and clinical evaluation. Patient samples used in this study were sent to our laboratory under suspicion for HCV or HBV infection due to either elevated liver enzyme values (alanine aminotransferase, >45 U/liter), clinical signs of hepatitis (jaundice and upper abdominal pain), or risk factors for parenterally transmitted diseases, such as chronic hemodialysis, blood transfusion, or intravenous drug use. Samples that were tested by Ortho/ECi, Abbott EIA, and a supplemental assay and had indeterminate results were investigated further through chart review. This chart review involved examination of clinical signs of hepatitis described above, elevated liver enzymes, and the presence or absence of past and present clinical and other laboratory evidence of infection with hepatitis A virus, HBV, and HCV. For example, we looked for the presence of anti-hepatitis A virus IgM antibodies, anti-HBcAg IgM, and IgG. In addition, these samples were investigated for the presence of clinical conditions and substances that could interfere with the performance and specificity of Ortho or Abbott assays, such as acute and chronic viral and bacterial infections, autoimmune diseases, dialysis, pregnancy, and rheumatoid factor.
Evaluation of results. Evaluation of sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of the Ortho/ECi assay and Abbott EIA were based on agreement between Ortho/ECi and Abbott EIA as well as confirmation of discrepant results by supplemental tests or clinical chart review, when indicated. A sample was considered a true positive for anti-HCV, HBsAg, or anti-HBsAg if it was reactive on both Ortho and Abbott assays or if it was only reactive on one assay but confirmed as a true positive by a supplemental assay. Serum samples with insufficient volume due to the consumption of a large volume during the comparative analysis and repeating tests were further investigated based on clinical data and chart review described above. Conversely, a test result was interpreted as a true negative if it was negative by the Ortho/ECi assay and the Abbott EIA or if it was only negative on one assay but confirmed as a true negative by supplemental tests or chart review and other serological markers.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Intra-assay precision of testing with 10 replicates of controls and positive and negative human sera
|
|
View this table: [in a new window] |
TABLE 2. Results of clinical evaluation of Ortho/ECi on a panel of predefined anti-HCV, HBsAg, and anti-HBsAg positive and negative sera, comparing performance to Abbott EIA
|
|
View this table: [in a new window] |
TABLE 3. Results of confirmatory anti-HCV RIBA on discrepant sera
|
|
View this table: [in a new window] |
TABLE 4. Results of screening and confirmatory anti-HCV tests on sera with discrepant results between Ortho/ECi and Abbott EIAa
|
|
View this table: [in a new window] |
TABLE 5. Results of clinical evaluation of diagnostic Ortho/ECi assay and Abbott EIA following resolution of discrepant samplesa
|
|
View this table: [in a new window] |
TABLE 6. Sensitivities, specificities, and predictive values of Ortho and Abbott assays on samples confirmed positive or negative by confirmatory tests or chart review
|
|
View this table: [in a new window] |
TABLE 7. Results of medical chart review and confirmatory HBsAg assays on initially discordant Ortho and Abbott HBsAg samples (n = 10)
|
|
View this table: [in a new window] |
TABLE 8. Results of medical chart review and quantitative anti-HBsAg supplemental assays on initially discordant Ortho and Abbott anti-HBsAg samples (n = 31)
|
|
View this table: [in a new window] |
TABLE 9. Potentially cross-reactive or interfering subgroups on the performance of Ortho/ECi anti-HBsAg assays
|
The Ortho assays are very easy to perform, have random access, require a small sample volume (Table 10), and are fully automated compared to the partially automated Abbott EIA. The time to results and hands-on time per sample were measured once in each individual assay setup (Table 10). Both are substantially better for Ortho/ECi analysis, even when a large number of specimens is tested. Consequently, labor costs are lower for the Ortho/ECi assay. In addition, the availability of random access and the short assay time of the Ortho/ECi tests allow the repetition of positive samples and performance of supplemental tests, if needed, in the same day. The general cost of disposables is also lower for the Ortho/ECi assay. Comparing list prices for both assays, the reagent cost of the Abbott EIA is significantly lower than that of the Ortho/ECi assay, although the manufacturers' volume discounts certainly influence final pricing.
|
View this table: [in a new window] |
TABLE 10. Detailed analysis of hands-on and hands-off time for anti-HCV, HBsAg, and anti-HBsAg diagnosis by the Abbott EIA, version 2.0, and the Ortho/ECi assaya
|
|
|
|---|
The overall concordances of the Ortho/ECi assay with Abbott EIA for detection of anti-HCV antibodies, HBsAg, and anti-HBs antibodies were 98, 98, and 94%, respectively.
The Ortho/ECi test gives a number of positive results with negative or indeterminate confirmatory Chiron strip RIBA HCV, version 3.0, and Abbott EIA, respectively. The inability of RIBA to resolve the discrepancy in one-third of discrepant HCV samples greatly limits its usefulness for confirmation of EIA results, which is consistent with previous reports (46). Confirmation by RIBA has not been very useful for resolving weakly positive samples, and a molecular HCV RNA detection is then recommended (45, 46).
In our laboratory, we perform approximately 85,000 anti-HCV tests per year. Of all anti-HCV reactive samples, approximately 10 to 15% are weakly positive (S/C ratio of <8, as determined by Ortho/ECi anti-HCV test, or <3.8, as determined by Abbott EIA), and the other 85 to 90% are strongly positive, with an S/C ratio of
8, as determined by Ortho/ECi, or
3.8, as determined by Abbott EIA (6). Possible explanations for low positive anti-HCV results include false-positive serological tests, early testing during acute infection (i.e., before complete seroconversion), decreased immune responses due to immunosuppression, and waning antibody due to resolved infection (44, 47, 48, 49). Under these conditions, nucleic acid testing can determine if HCV RNA is present in these samples. Similarly, in patients with strongly positive anti-HCV serology, nucleic acid testing is required to confirm active HCV infection (50). Confirmation of active infection is essential when assessing individuals who undergo treatment (30, 42). Therefore, if the nucleic acid testing result is negative for persons with a positive screening test result, the HCV antibody or infection status cannot be determined. Among persons with these results, additional testing with RIBA is necessary to verify the anti-HCV result and determine the need for counseling and medical evaluation (6). If the anti-HCV screening test results are judged falsely positive (i.e., RIBA negative), no further evaluation of the person is needed, whereas if the anti-HCV screening test results are verified as positive by RIBA, the person should undergo medical evaluation, including serial determinations of HCV RNA and serum transaminase activity (6).
Nevertheless, certain situations exist in which the HCV RNA result can be negative for persons with active HCV infection. For example, HCV RNA is not detectable in certain persons during the acute phase of hepatitis C infection (9). In addition, intermittent positive HCV RNA has been detected among individuals with chronic HCV infection (9). Therefore, in the absence of additional clinical information, the significance of a single negative HCV RNA result is unknown, and the need for further medical evaluation is determined by verifying anti-HCV status.
A negative HCV RNA result also can indicate resolved infection (44, 47). To determine if HCV infection has resolved, a negative HCV RNA result should be demonstrated on multiple occasions. In addition, several studies on hepatitis C patients treated with interferon showed that HCV RNA can be undetectable even if the virus is still present, as demonstrated by the recurrence of HCV RNA after the end of the therapeutic course. For these reasons, HCV RNA is able to confirm whether an infection is established but its undetectability cannot preclude the true presence of anti-HCV (25, 31, 32, 57).
For samples with indeterminate anti-HCV RIBA results in this study, nucleic acid testing was not performed due to insufficient specimen volume. Since the true status of these specimens could not be determined, they (n = 3) were excluded from our analysis of specificity. The results of the present study, including a group of individuals with high anti-HCV prevalence and another group with low anti-HCV prevalence (pregnant women and outpatient clinic patients), show that the Ortho/ECi assay combines high sensitivity and specificity. On the population tested, the Ortho/ECi system showed a higher sensitivity (100%) than the Abbott EIA (98.9%). However, the specificity of the Ortho/ECi anti-HCV assay was lower than that of the Abbott EIA (98.1 versus 100%).
With regard to detection of HBsAg, the results of the present study show that the Ortho/ECi assay has 100% specificity and 97.4% sensitivity for detection of HBsAg, which is higher than that of Abbott EIA HBsAg assay (99.7% specificity and 96.8% sensitivity). Nevertheless, both assays have a high rate of false-negative HBsAg results (2.6% for Ortho/ECi and 3.2% for Abbott EIA). There are three possible explanations for the high false-negative results. First, in low-level chronic HBV carriers, the HBsAg level may be below the detection limit. Antibodies against HBcAg (anti-HBc) could be the only serological marker of infection in the low-level chronic carriers (25, 27). Second, very low levels of HBsAg can be observed in fulminant hepatitis and in neonatal infections (29). Third, virus variants can yield sequences that are not recognized by the antibodies employed in the assay. In different locations, vaccine escape mutants are emerging under the selective pressure of active immunization (13, 24, 28). Vaccine escape mutants within the determinant of the S gene are not recognized as effectively by conventional diagnostic tests as the wild-type determinant (12, 52). Similarly, mutation in the a determinant may also affect the performance of the HBsAg immunoassay (51).
Samples that had discordant results upon repetition were resolved by confirmatory HBsAg neutralization assay. For those samples that were not resolved by confirmatory assay due to insufficient sample volume to perform the test, it is important to consider additional HBV markers. HBsAg in combination with anti-HBc determination shows a very high PPV and NPV of 100%. However, during acute hepatitis B, anti-HBc may not be detected in the first days to weeks in up to 8% of the cases (33). Alternatively, isolated HBsAg positive results could be encountered due to absence of anti-HBc antibody response as a consequence of immunodeficiency or an immunocompromised patient (34).
With regard to detection of anti-HBsAg antibodies, a higher percentage of false-positive results (4.7%) was obtained with the Ortho/ECi anti-HBsAg test compared to 3.3% false positives with the Abbott EIA. One possible reason for false-positive anti-HBsAg results could be due to presence of potentially cross-reactive substance in the patient samples, as indicated in Table 10. The majority of discrepant results that accounted for high false-positive results in our data were indeterminate by the Ortho/ECi test (Table 8). The higher frequency of indeterminate results by the Ortho/ECi assay than by the Abbott EIA could be due to the fact that the S/C ratio of positive Ortho test was established at a relatively high cutoff that corresponds to immunity to HBV infection (>10 mIU/ml). According to the manufacturer's instructions, the Abbott EIA reports the specimen to be anti-HBsAg positive if only two of three replicates are positive, whereas the Ortho/ECi assay considers the specimen to be positive only if all three replicates are
1.20 (i.e., reactive). Therefore, indeterminate results will be reported if only one of three replicates is between 0.50 (i.e., nonreactive) and 1.20 (reactive). Nevertheless, the infectivity of these individuals is usually confirmed by detection of HBV DNA by hybridization (21) or PCR (1, 21). However, due to insufficient samples in our study, we could not further test these samples.
In addition to precision and reliability, technical complexity and result turnaround time have important bearings on the usefulness of an assay in the clinical management of patients. In this regard, the Ortho/ECi analyzer, which permits a high-speed throughput, random access, primary tube sampling, and full automation, offers the great advantage of being technically simpler and faster in yielding results than the Abbott EIA, particularly for high-volume laboratories.
In conclusion, Ortho/ECi (chemiluminescence) assays for serological diagnosis of HCV and HBV infection demonstrated excellent concordance with Abbott EIA and other markers of liver disease. Our findings demonstrate that the Ortho anti-HCV and HBsAg assays show a better sensitivity than the corresponding Abbott EIA (100 versus 98.9% for the anti-HCV assay, respectively, and 97.4 versus 96.8% for the HBsAg assay, respectively). The increased sensitivity of the anti-HCV assay performed in conjunction with the molecular detection of HCV RNA may be increasingly important in HCV diagnostic testing as screening and new therapeutic strategies evolve. In contrast, the anti-HCV Abbott EIA show a better specificity than the Ortho/ECi assay (100 versus 98.1%, respectively). Therefore, confirmation of positive HCV ECi results, particularly those of weakly reactive samples with low S/C ratios, by supplemental tests is recommended. Finally, because larger numbers of samples can be processed in a shorter time than for the Abbott EIA, the Ortho/ECi assay may be the assay of choice in a laboratory which requires short turnaround times. In addition, the Ortho/ECi assays are an excellent choice for laboratories with large numbers of qualitative HCV and HBV immunodiagnostic tests.
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»