Previous Article | Next Article ![]()
Journal of Clinical Microbiology, April 2007, p. 1244-1249, Vol. 45, No. 4
0095-1137/07/$08.00+0 doi:10.1128/JCM.01540-06
Copyright © 2007, American Society for Microbiology. All Rights Reserved.

Department of Molecular Medicine and Hematology, University of the Witwatersrand and the National Health Laboratory Service, Johannesburg, South Africa
Received 25 July 2006/ Returned for modification 26 September 2006/ Accepted 19 January 2007
|
|
|---|
|
|
|---|
To address the NucliSENS miniMAG ease-of-use issues, bioMérieux recently introduced the NucliSENS easyMAG platform for nucleic acid isolation. This instrument has exactly the same extraction chemistry but automates the labor-intensive NucliSENS miniMAG washing steps, thereby significantly reducing hands-on time. The NucliSENS easyMAG-NucliSENS EasyQ HIV-1 bioMérieux combination v1.1 (Biomerieux, Boxtel, The Netherlands) was compared to the Roche combination COBAS AmpliPrep-COBAS AMPLICOR HIV-1 Monitor (Roche Diagnostics, Branchburg, NJ) and described in this study. Throughput capacities, ease-of-use, reliability, and robustness of both systems in a clinical laboratory setting were also evaluated.
|
|
|---|
Instrumentation and analysis. The NucliSENS easyMAG and the NucliSENS EasyQ analyzer were installed in a separate dedicated laboratory for the duration of the study. The AmpliPrep and AMPLICOR Roche analyzers already installed and maintained in the main PCR accredited laboratory were used for the comparative analysis. All assays were conducted according to the manufacturer's instructions and good laboratory practice standards.
For the Roche assay, the input volume was 0.35 ml. Results below the detection limit of the standard Roche assay were not evaluated further using the ultrasensitive version of the kit. Plasma for the NucliSENS assay was transferred to lysis buffer according to the manufacturer's protocol. Extractions for the NucliSENS assay were performed using a 1-ml input volume with an internal calibrator added to each sample prior to extraction. Purified HIV-1 RNA and internal calibrator RNA were coamplified, and amplicon formation was measured in real time on the EasyQ analyzer. In cases where undetectable levels of viral load were obtained in both assays, they were considered concordant. For the NucliSENS assay, the only deviations to the manufacturer's instructions were the addition of negative and positive control samples to the run, which at the time, were not routinely supplied by the manufacturer.
Control samples. High-positive controls (control 1, 25,000 IU/ml), low-positive controls (control 2, 2,500 IU/ml), and negative controls (control 3) were obtained from the VQC Laboratories (Acrometrix, Alkmaar, The Netherlands) and used as reference material in each run. The number of controls per easyMAG run was 8 (control 1, n = 2; control 2, n = 2; control 3, n = 4). Similar runs were prepared with high- and low-positive controls and negative controls at identical positions for the Roche platform.
Linearity with specimens known to contain HIV-1 RNA.
Dilution series of known HIV-1-positive samples were prepared by diluting the samples in steps of
0.5 logs in HIV-negative pooled plasma. Each dilution was tested in quadruplicate. The quantitative log result was plotted against the dilution factor, and reproducibility was measured by the percent coefficient of variation (%CV) at each dilution range. The R2 value was also reported for the linear regression equation of the relationship between quantitative viral result and dilution factor. Linearity studies were only performed using the NucliSENS easyMAG and NucliSENS EasyQ HIV-1 combination.
Statistical models applied. A detailed statistical analysis included the following: (i) correlation studies (Pearson and Spearman correlation coefficients), (ii) the Bland-Altman (1) difference plot for bias and agreement, including limits of agreement and confidence intervals, and (iii) the percent similarity model (4) for measuring agreement, including accuracy (percent similarity mean) and precision (percent similarity standard deviation [SD]) and overall agreement (percent similarity CV). The Bland-Altman model measures the difference between two methods (a b). This model is represented by scatter plots of the difference between the methods on the vertical axis and the absolute value of the reference on the horizontal axis. The average absolute value is not used, as this evaluation is to determine whether the new method can replace the existing method and reported patient results are given as absolutes not averages between two methods. The percent similarity model applies the formula (a + b)/2/a x 100, where a is the reference method and b is the new method. The percent similarity values between data pairs are then represented in a histogram format overlaid with a normal curve. The peak distance (mean percent similarity) from 100% shows the accuracy between the two methods, and the spread (SD) of the curve shows the precision between two methods. The overall agreement between the two methods is then represented by a single unit, the percent similarity CV (SD/mean) which summarizes both accuracy and precision into one unit. A low percent similarity CV shows good agreement between methods. All statistical analysis was performed on log-transformed data, after converting AMPLICOR results in RNA copies/ml into IU/ml as described by Stevens et al. in 2005 (copies/ml x 0.51 = IU/ml) (5). For purposes of the statistical analyses, the COBAS AmpliPrep-AMPLICOR assay was considered the reference method against which the easyMAG-NucliSENS EasyQ HIV-1 v1.1 combination was evaluated.
|
|
|---|
Thus, statistical analyses were performed on the results of the 265 samples for which both a valid NucliSENS EasyQ HIV-1 and AMPLICOR result were available.
Results of QC controls. The quality control (QC) samples were used to calculate the intervariability of each assay as well as the background error. Table 1 outlines the control results from both assays. The CVs for both assays increased at the lower control (2) range and overall showed slightly more variability in Roche AMPLICOR, with lower average values than in the EasyQ HIV-1 assay. Four of 50 control (2) samples were not detected in the Amplicor standard assay (8%).
|
View this table: [in a new window] |
TABLE 1. Results of control samples incorporated in easyMAG-NucliSENS EasyQ HIV-1 combination (EasyQ) and in AmpliPrep-AMPLICOR (Roche) runs
|
![]() View larger version (15K): [in a new window] |
FIG. 1. A scatter plot of the Roche AMPLICOR and EasyQ results reported in log IU/ml, showing the range in reported results and limits to each assay. The horizontal axis shows log IU/ml, and the vertical axis shows sample numbers in order of preparation for the total number of samples analyzed (n = 256).
|
The statistical analysis is performed on both the total group (n = 265) and the trimmed group (n = 108). The summary statistics for the total and trimmed group are shown in Table 2. Therefore, part of the analysis was performed on three data sets: (i) total data set including those below the detection limit (designated LDL by the analyzer) and overrange results (n = 265), (ii) trimmed group, LDL results and overrange results are excluded (n = 108), and (iii) trimmed group, of which the one outlier was excluded (n = 107).
|
View this table: [in a new window] |
TABLE 2. Data summary for the total sample group (n = 265) and the trimmed group (n = 108)
|
|
View this table: [in a new window] |
TABLE 3. Pearson and Spearman correlation coefficients
|
![]() View larger version (26K): [in a new window] |
FIG. 2. Percent similarity histograms and Bland-Altman difference scatter plots for the total group (n = 256, left) and the trimmed group (n = 108, right). The histograms plot the frequency of the percent similarity values between the AMPLICOR and EasyQ results and show the number of similar results in each percent similarity interval. The normal curves are included, which visually show the accuracy between the methods (closeness of the peak to the 100% similarity line) and the precision (spread around the mean). The 100% similarity and 50 and 100% reference lines are also included. The summary statistics for these models are presented in Table 4.
|
|
View this table: [in a new window] |
TABLE 4. Summary statistics of the observed differences in quantitation results (log Roche AMPLICOR [IU] log EasyQ) for the three data subsets
|
Linearity with specimens known to contain HIV-1 RNA. The linearity in quantitation using the EasyQ HIV-1 assay was analyzed by testing a dilution series of two high-positive samples derived from two HIV-1-infected individuals. Dilution series of samples were prepared by diluting the samples with steps of 0.5 logs. A good linearity was observed for both samples at an R2 of >0.96, with the greatest variability in the low range ± log 2.0 (CV = 6.7%.) and high ranges log 5.0 (CV = 9.2%). Figure 3 represents the linear regression for one sample including the %CV over the range in dilution.
![]() View larger version (15K): [in a new window] |
FIG. 3. Linear regression of one of the samples prepared in quadruplicate dilutions over log ranges to show linearity of the easyMAG EasyQ method. The horizontal axis shows the dilution number, and the vertical axis shows log intervals (IU/ml). The equation of the line is presented as well as the R2, which shows that 96.7% of the data are represented by this equation. The %CV values for the quadruplicate results at each dilution are also given and show that the greatest variability occurs in the high and low ranges.
|
|
|
|---|
In this study a significant correlation existed between the log values of the easyMAG-EasyQ HIV-1 and COBAS AmpliPrep-AMPLICOR methods. This showed a linear relationship between the AMPLICOR and EasyQ HIV-1 methods in spite of removing the influencing values from the total group: Spearman, r = 0.93 for the total group (n = 265); Spearman, r = 0.73 for the trimmed group (n = 108), and Spearman, r = 0.75 for the trimmed group without outlier (n = 107). The high similarity in quantitation between the assays suggests that switching from one assay to the other can be done without new baseline testing. This was confirmed by the additional analysis using methods of agreement, the percent similarity model and Bland-Altman analysis: (i) percent similarity model which revealed a mean observed similarity of 96% and a mean percent difference (MPD) (±SD) of 3.8 ± 5.0%, with overall good agreement (low CV) with the AMPLICOR assay (% similarity CV = 5.2%); (ii) for Bland-Altman, the limits of agreement (1.31, 0.55) and the mean difference (0.38) are within the boundaries of clinically acceptable differences between reportable results of the assays.
The easyMAG-EasyQ HIV-1 system has a higher sensitivity and broader dynamic range than the COBAS AmpliPrep-AMPLICOR system when the standard Roche assay is used alone, with 25 to 3,000,000 IU/ml versus 400 to 750,000 copies/ml, respectively. This system thus obviates the need for processing with a second assay, the Roche Ultrasensitive assay. In the future, this two-test strategy can be replaced by the Roche AmpliPrep-Roche Taqman combination, which has a linear range of 40 to 10E6 RNA copies/ml and is currently under evaluation in this laboratory.
Fifty percent of the samples tested in this study had values below the LDL of the AMPLICOR assay (400 copies/ml), which shows the impact of ARV therapy on the patients being referred to the laboratory but influences the statistical analysis. Forty percent of the samples tested in the study had negative results in the EasyQ HIV-1 assay (LDL, 25 IU/ml). All 24 samples (9.1%) with a UDL result in the AMPLICOR assay could be quantified by EasyQ HIV-1 assay; in these cases, a high viral load result was always obtained with EasyQ HIV-1. In spite of sensitivity controls in each AMPLICOR run, 8% of the low-positive QC control samples containing 2,500 IU/ml were not detected by the AmpliPrep-AMPLICOR system, while the same control sample was detected with 100% sensitivity (n = 50) by the easyMAG-EasyQ HIV-1 combination. No explanation was found for the AMPLICOR reduced sensitivity on this control material. Both control 1 and 2, however, yielded, on average, lower values with the AMPLICOR assay than the EasyQ. This was similarly noted in the Bland-Altman scatter plots with the clinical samples in Fig. 2 where the EasyQ assay yields higher values than the AMPLICOR in the lower quantitative results. This may relate to differences between the two systems' nucleic amplification and detection technologies.
The throughput of samples was greatly improved using the easyMAG-EasyQ HIV-1 system. One hundred forty-four samples could easily be processed within 6 h using one easyMAG and one EasyQ instrument. Using one AmpliPrep and three COBAS AMPLICOR instruments, processing of the same number of samples takes 24 h. Concerns that require ongoing evaluation include the frequent occurrence of gelation of the samples during transport in the lysis buffer provided by biomérieux, leading to the higher number of invalid samples flagged by the EasyQ analyzer. The potential for contamination has been dramatically reduced with the automated extraction system, but as with any real-time analyzer, significant caution needs to be used to prevent contamination at the back end amplification step. It is for this reason that additional negative controls have been included in the system based on the South African laboratory experience.
The assay thus presents a very real option for HIV-1 viral load monitoring in high-volume environments due to its robust nature and the ability to produce rapid, reproducible results.
Published ahead of print on 31 January 2007. ![]()
|
|
|---|
This article has been cited by other articles:
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»