Previous Article | Next Article ![]()
Journal of Clinical Microbiology, June 2008, p. 1955-1960, Vol. 46, No. 6
0095-1137/08/$08.00+0 doi:10.1128/JCM.00231-08
Copyright © 2008, American Society for Microbiology. All Rights Reserved.

National Serology Reference Laboratory, Australia, St. Vincent's Institute, 4th Floor, Healy Building, 41 Victoria Parade, Fitzroy, Victoria 3065,1 Department of Serology, Symbion Health, Dorevitch Pathology, 18 Banksia Street, Heidelberg, Victoria 3084,2 Centre for Infectious Diseases and Microbiology Laboratory Services, Institute of Clinical Pathology and Medical Research, Westmead Hospital, Westmead, New South Wales 2145,3 Microbiology Department, Southern Health, 246 Clayton Road, Clayton, Victoria 3168,4 Department of Microbiology and Immunology, University of Melbourne, Parkville, Victoria 3052, Australia5
Received 4 February 2008/ Returned for modification 9 April 2008/ Accepted 14 April 2008
|
|
|---|
|
|
|---|
Since the 1980s, rubella virus IgG assays have been calibrated against the same World Health Organization (WHO) international standard rubella virus serum (second standard preparation) and test results have been reported in international units per milliliter (IU/ml). The introduction of quantitative measurement of rubella virus IgG had the potential to increase standardization and facilitate the comparison between the results of different tests.
In 1992, we published a multicenter evaluation comparing commercial immunoassays used to measure rubella virus IgG antibodies (9). The conclusion was that, although there was a moderate degree of correlation, reporting anti-rubella virus IgG levels in IU/ml had insufficient practical use. At that time, we concluded that the results of rubella virus antibody testing be confined to a statement concerning immunity rather than a numerical value. More than 15 years later, the assays compared in the 1992 study are no longer in common usage in Australia and have generally been replaced with random-access analyzers that perform a range of immunoassays of multiple disciplines. A comparison of six random-access and two microtiter plate (MTP) immunoassays that report anti-rubella virus IgG levels in IU/ml was undertaken to review analytical performance and determine whether the standardization of reporting in the newer assays had improved. While the standardization of reporting for rubella virus IgG levels is greater with the introduction of automated immunoassays, further improvement is needed.
|
|
|---|
Serum or plasma samples used in the study were collected and stored at –20°C. Samples were thawed and aliquoted into single-use vials that were refrozen and stored at –20°C until they were used. Before testing, thawed aliquots were held at 4°C for up to 3 weeks or until use and then were discarded. No sample underwent more than three freeze-thaw cycles.
Tests. All samples were tested by the HAI assay and eight commercially available immunoassays. Selected samples were tested further using an in-house Western blot assay.
(i) HAI assay. All samples were tested in an HAI assay (1, 13, 29). Briefly, samples were treated with kaolin to remove nonspecific agglutinins. A twofold serial dilution of each sample was made in phosphate-buffered saline buffer. Fresh pigeon red blood cells coated with rubella virus antigen obtained from Dade Behring (Marburg, Germany) were used as the indicator. The results were expressed as the reciprocal of the titer. Each sample was tested in duplicate, and the results were read by two independent readers. If a reading that exceeded a difference of 1 doubling dilution between duplicate tests or between readers was obtained, the sample was retested.
(ii) Immunoassays. Six of the assays were automated immunoassays using random-access instruments that could perform a range of infectious disease and biochemical assays, and two were 96-well MTP immunoassays. All tests were performed as instructed by the manufacturer. The manufacturer's cutoff was applied to determine reactivity of the sample. All assays reported the test results in IU/ml.
The random-access immunoassays were Access Rubella IgG (Beckman Coulter, CA), AxSYM Rubella IgG (Abbott Diagnostics, IL), Advia Centaur Rubella G (Bayer HealthCare, NY), Immulite 2000 Rubella Quantitative IgG (Diagnostic Products Corporation, CA), Liaison Rubella IgG (DiaSorin, Saluggia, Italy), and Vidas Rub IgG II (bioMérieux, Marcy l'Etoile, France).
Access Rubella IgG (Beckman Coulter, CA) (Access) had rubella virus membrane antigen bound to paramagnetic particles. Anti-rubella virus IgG bound to the particles was detected using alkaline phosphatase-conjugated monoclonal antibody and a chemiluminescent substrate (Lumi-Phos). The light produced was proportional to the amount of bound patient anti-rubella virus IgG, and the results were calibrated against a multipoint calibration curve standardized against the WHO second international standard preparation for anti-rubella virus serum.
AxSYM Rubella IgG (Abbott Diagnostics, IL) (AxSYM) (8, 21) used a microparticle solid phase coated with rubella virus antigen. Anti-human rubella virus IgG bound to the solid phase was detected with an anti-human IgG conjugated to alkaline phosphatase and a 4-methylumbelliferyl phosphate substrate.
Advia Centaur Rubella G (Bayer HealthCare, NY) (Centaur) (6, 7, 17) employed a sandwich immunoassay using direct chemiluminometric technology. An anti-human IgG monoclonal antibody was coupled to paramagnetic particles acting as the solid phase. Rubella virus was labeled with acridinium ester. The test sample was simultaneously incubated with the solid phase and labeled rubella virus, and the resulting antibody-antigen complex was detected through the addition of acid and base reagents.
Immulite 2000 Rubella Quantitative IgG (Diagnostic Products Corporation, CA) (Immulite) (8, 20, 30) used beads coated with inactivated rubella virus as the solid phase and alkaline phosphatase conjugated to monoclonal murine anti-human IgG as the conjugate. Chemiluminescent substrate was used to detect the antibody-antigen reaction.
Liaison Rubella IgG (DiaSorin Saluggia, Italy) (Liaison) (21) had rubella virus antigen coated onto magnetic particles as the solid phase. The secondary antibody was a mouse monoclonal antibody linked to an isoluminol derivative. To detect bound anti-rubella virus IgG, a starter reagent was added and a flash chemiluminescence reaction was induced. The resulting light signal was measured using a photomultiplier and converted to relative light units that were proportional to the amount of anti-rubella virus IgG present in the sample.
Vidas Rub IgG II (bioMérieux, Marcy l'Etoile, France) (Vidas) (21, 30) combined a two-step sandwich immunoassay method using a fluorescence detection system. The solid-phase receptacle acted as both the solid phase and pipetting device. The conjugate was an alkaline phosphatase-labeled monoclonal anti-human IgG (mouse), and the substrate was 4-methylumbelliferyl phosphate.
The two MTP immunoassays used 96-well plates coated with rubella virus antigen and a series of standards to calibrate the assay. They were ETI-RUBEK-G Plus (DiaSorin, Saluggia, Italy) and Enzygnost Anti-Rubella-Virus/IgG (Dade Behring, Marburg, Germany).
ETI-RUBEK-G Plus (DiaSorin, Saluggia, Italy) (DiaSorin) (9) was a MTP immunoassay using rubella virus coated to the MTP wells. Anti-rubella virus antibodies in the sample were bound to the rubella virus and were detected using a protein A conjugated to horseradish peroxidase tracer and a tetramethylbenzidine-hydrogen peroxide substrate, giving a color change that was proportional to the amount of anti-human IgG bound to the solid phase.
Enzygnost Anti-Rubella-Virus/IgG (Dade Behring, Marburg, Germany) (Enzygnost) was a MTP immunoassay consisting of duplicate test wells, one coated with rubella virus and the other control well coated with noninfected cell culture. The secondary antibody was a rabbit antibody conjugated with peroxidase. The antibody-antigen reaction was detected using a tetramethylbenzidine-hydrogen peroxide substrate. The optical density of the control well antigen was subtracted from that of the antigen-coated well for each sample to reduce the effect of nonspecific reactivity.
Western blot assay. Samples that were negative by the HAI assay but had an equivocal or positive test result in one or more immunoassays were tested by Western blotting if sufficient sample remained. Western blots were performed by running rubella virus lysate on a nonreducing 10% sodium dodecyl sulfate-polyacrylamide gel, transferring the proteins to nitrocellulose, and probing for antibody in plasma samples that were diluted 1 in 100 in buffer (16, 31, 32).
Analysis. (i) Sensitivity and specificity. The results of the HAI assay were used to assign a negative or positive status to the samples. An HAI titer of less than 8 was considered negative for anti-rubella virus immunoglobulin. A titer of 8 or more was considered positive (15). The analytical sensitivity and specificity of each immunoassay were estimated by comparing the immunoassay qualitative results with the sample's assigned positive or negative status. The sensitivity and specificity of the immunoassays were calculated twice, first interpreting equivocal results as negative and then as positive. The Western blot result did not change the status of any samples and did not affect the estimations of sensitivity or specificity.
(ii) Statistical analyses. The results expressed as IU/ml were used in statistical analyses. Where an assay produced a result expressed as greater than the highest limit of the assay, the result was assigned a value of the limit level plus one. For example, if the assay's highest reportable result was 300 IU/ml, results greater than 300 IU/ml were assigned a value of 301 IU/ml prior to statistical analyses. The exception was results from Centaur, because the highest reportable result changed from 500 IU/ml to 175 IU/ml midway through the evaluation. All results greater than 175 IU/ml were converted to 176 IU/ml for statistical analysis for this assay.
For all immunoassays, the mean values of the results expressed in IU/ml were compared by analysis of variance, and Tamhane's T2 post hoc test using SPSS (SPSS Inc., Chicago, IL) version 15.0. A P value of <0.05 was considered statistically significant. Positive and negative delta values were estimated for each immunoassay (5). The delta value is the distance the mean of the positive and negative populations of a data set is removed from the cutoff and is measured in standard deviations. To calculate the delta value, a cutoff of 10 IU/ml was used for each assay, with all results greater than or equal to 10 IU/ml being analyzed as positive. Results less than 10 IU/ml were analyzed as negative.
|
|
|---|
|
View this table: [in a new window] |
TABLE 1. Sensitivity and specificity of eight immunoassays testing 48 negative and 273 positive samples for anti-rubella virus IgGa
|
|
View this table: [in a new window] |
TABLE 2. Qualitative and quantitative anti-rubella virus IgG test results and corresponding Western blot test results of 20 samplesa
|
|
View this table: [in a new window] |
TABLE 3. Results of 18 HAI positive samples that tested negative or equivocal in one or more of eight rubella IgG immunoassays
|
![]() View larger version (13K): [in a new window] |
FIG. 1. Mean and 95% confidence intervals of results reported for 321 samples tested with eight immunoassays for anti-rubella virus IgG tests giving results in international units per milliliter.
|
|
View this table: [in a new window] |
TABLE 4. Tamhane's post hoc analysis of the means of anti-rubella virus IgG resultsa
|
|
View this table: [in a new window] |
TABLE 5. Estimated delta values of 48 negative samples and 273 positive samples tested for the quantification of anti-rubella virus IgG in eight immunoassays
|
|
|
|---|
The status of all samples was assigned by HAI testing. Although HAI testing is often considered to be the reference method for rubella virus antibody detection, it must be noted that, unlike rubella virus IgG-specific immunoassays, HAI testing detects both IgG and IgM (13, 15). There were 28 samples from individuals known to have acute rubella infection included in the study, and all these samples were reactive by both the HAI test and immunoassays. Therefore, any discrepancy between the HAI test and immunoassays was not due to the detection of rubella virus IgM.
When a cutoff of 10 IU/ml was used, all assays included in the study had comparable sensitivity and specificity, with overlapping 95% confidence intervals. All assays reported some false-negative and false-positive test results. It is more acceptable to report a false-negative anti-rubella virus IgG test result than a false-positive result. Clinically, a false-negative result may give rise to unnecessary vaccination or, at worst, anxiety for a pregnant woman who has had contact with rubella. A false-positive result may lead to a susceptible person not being vaccinated and result in an infection if she is subsequently exposed to the virus. If a woman is in the first trimester of pregnancy, a congenitally acquired rubella infection may ensue.
When the equivocal test results were considered reactive, all assays had a sensitivity of 98.9% or greater, offering confidence in their ability to detect the presence of anti-rubella virus IgG. A relatively small percentage of false-negative results would be reported using any of the assays evaluated. However, the specificity of the assays would result in a higher percentage of false-positive results, with up to 22% false-positive results with AxSYM. The AxSYM specificity reported by Diepersloot et al. was 81.5% (8). In Australia, many laboratories use the manufacturer's cutoff to determine nonimmune status but apply a "gray zone" to express doubt over the levels of immunity conferred by low levels of reactivity. The "gray zone" used differs widely between laboratories.
Of the 48 samples with an HAI result of <8, four samples were subsequently found to be Western blot positive. Two samples had insufficient volume for Western blotting but were reactive in at least six of the eight immunoassays. It has been noted previously that using methods other than HAI testing, immune individuals with specific but low levels of rubella virus antibodies have been identified (12, 15, 18, 27, 28). Of the remaining 42 samples, Access, Centaur, Liaison, and Vidas reported no false-positive results; Enzygnost had one equivocal result (6 IU/ml). Immulite gave one positive test result (10.8 IU/ml) and three equivocal test results for the 42 samples. The application of a "gray zone" to these assays may not be necessary. AxSYM gave four positive and three equivocal results, the highest results being 28 IU/ml. This confirms previous findings which indicated about 1% of AxSYM positive results could not be confirmed (19). A "gray zone" of 30 IU/ml and a comment indicating doubt in immune status with results between 10 and 30 IU/ml may be considered for this assay. DiaSorin gave three positive test results (20.8, 47.9, and 108.7 IU/ml) and two equivocal test results. The spread of results overlapped considerably with the results reported for positive samples. An application of a "gray zone" to this assay would be impractical.
Statistical comparisons of the results reported by all eight immunoassays suggested that several assays gave comparable results. Results from the automated immunoassays Access, AxSYM, Centaur, and Immulite assays compared well, as did the Immulite, Liaison, and Vidas assays. Results from the MTP immunoassay DiaSorin (and, to a lesser extent Enzygost) did not compare well with any other assay. These results indicate that standardization of some anti-rubella virus IgG assays that report in IU/ml has occurred, but greater standardization throughout all immunoassays is required.
Positive and negative delta values were calculated for all immunoassays. The delta value describes the distance the mean of the positive and negative populations of a data set is removed from the cutoff and is measured in standard deviations. Therefore, an assay with a positive delta value of 4.0 has a mean of the results of positive samples 4 standard deviations from the cutoff. All immunoassays had a delta value of less than 2, implying poor separation of the negative and positive population, potentially leading to the false-negative and false-positive test results. Assays undergo variation from test event to test event, arising from changes of reagent batches, variation in the volume of reagents pipetted, temperature, length of incubation, and other process changes. A low delta value indicates an increased possibility of these variations in the test system affecting the sensitivity or specificity of the assay.
Immunoassays used for the quantification of rubella virus IgG are standardized to the WHO international standard rubella virus serum (second standard preparation) and report results in IU/ml. A report expressed in IU/ml implies traceability from one assay to another, much in the manner of many biochemistry assays. This and previous investigations indicate that the assumption of transferability of IU/ml is incorrect. Therefore, greater standardization of assays reporting rubella virus IgG in IU/ml is required.
Carlie Di Camilo and Sau-Wan Chan provided technical assistance.
Published ahead of print on 23 April 2008. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»