Previous Article | Next Article ![]()
Journal of Clinical Microbiology, September 2007, p. 3101-3104, Vol. 45, No. 9
0095-1137/07/$08.00+0 doi:10.1128/JCM.00656-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.

Division of Clinical Microbiology,1 Section of Biostatistics, Mayo Clinic, Rochester, Minnesota2
Received 23 March 2007/ Returned for modification 10 June 2007/ Accepted 5 July 2007
|
|
|---|
|
|
|---|
Use of CAP/CA eliminates the need for the 1-h ultracentrifugation step currently required when performing MCA with the ultrasensitive assay format and increases the upper quantification limit of the assay from 7.5 x 105 copies/ml to 1.0 x 106 copies/ml with the standard format (9, 10). CAP/CA also has the potential to improve laboratory workflow as well as reduce the hands-on time requirements and run-to-run variability associated with manual sample processing methods (1, 2, 5, 11). Previous studies evaluating the performance of CAP/CA and MCA have demonstrated good overall agreement of test results between the two assays performed with the ultrasensitive format, albeit with slightly lower HIV-1 RNA titers obtained by CAP/CA (1, 2). The current study compares workflow, assay performance characteristics, and direct costs associated with CAP/CA and MCA (standard and ultrasensitive formats) to determine the overall impact of increased use of automation on the clinical laboratory.
CAP/CA and MCA testing was performed with both the standard and the ultrasensitive assay formats and with batch sizes of 12 and 24 samples, following the manufacturer's instructions for use. Hands-on, hands-off, and total time requirements were estimated for each assay, format, and batch size, based on the average times obtained from a minimum of six runs for each combination. These data were used along with several assumptions to construct assay timelines allowing the direct comparison of assay run and specimen throughput under optimal conditions at 8-, 16-, and 24-h durations. The assumptions used in these comparisons were as follows: use of one complete CAP/CA system (a single CAP linked to a maximum of three CA instruments) for all CAP/CA testing, a maximum of three CA instruments dedicated to the performance of MCA testing, unlimited specimen availability, and the continuous effort of multiple laboratory technologists equivalent to one full-time employee per 8-h work shift to perform each assay.
Assay control and clinical specimen data obtained from six runs of 12 samples each (i.e., 6 A-rings) and six runs of 24 samples each (i.e., 12 A-rings) were combined for each assay (CAP/CA and MCA) and format (standard and ultrasensitive) to determine the overall assay control failure rate and invalid specimen result rate for each of the four assay/format combinations. All individual A-rings processed for this portion of the evaluation contained nine specimens and three assay controls. These clinical specimens, which were also used to compare the correlation between CAP/CA and original MCA results, included 162 specimens with titers ranging from <400 copies/ml to >750,000 copies/ml and 162 specimens with titers ranging from <50 copies/ml to >100,000 copies/ml as determined by MCA using the standard and ultrasensitive formats, respectively.
Cost estimates were determined on a per-specimen basis for each assay, format, and batch size, using the manufacturer's current list prices for reagent kits and consumables, while excluding labor costs. Cost comparisons were based on batch sizes of 12 (9 specimens and three assay controls) and 24 (21 specimens and three assay controls) according to the manufacturer's instructions for use of these assays.
In contrast to what was found for MCA, there was no difference between the CAP/CA standard and ultrasensitive assay formats in terms of hands-on or total time requirements (Fig. 1). CAP/CA yielded reductions in hands-on time requirements ranging from 32% (standard format with a batch size of 24) to 40% (ultrasensitive format with a batch size of 12) compared to MCA. In addition to reductions in labor, CAP/CA yielded a consolidation of hands-on time by eliminating multiple periods of nonproductive hands-off time (e.g., periods of
15 min each) associated with MCA with either assay format. Importantly, this feature resulted in larger blocks of hands-off time that allowed laboratory technologists to prepare additional assay runs or to perform other tasks within the laboratory. Our findings on the consolidation of hands-on time are consistent with those previously reported by Berger et al. (1) using CAP/CA with the ultrasensitive format.
![]() View larger version (24K): [in a new window] |
FIG. 1. Hands-on and hands-off time requirements and workflow for CAP/CA and MCA with standard (S) and ultrasensitive (U) assay formats and batch sizes of 12 and 24. For a batch size of 12, CAP sample processing required 90 min for the initial assay run (as shown) and 30 min for each of the next two consecutive runs before defaulting back to 90 min for the fourth run due to delays in amplification/detection. For a batch size of 24, CAP sample processing required 120 min for the initial assay run (as shown) and 70 min for each of the next two consecutive runs.
|
Projected run and specimen throughput were comparable for CAP/CA and MCA using the standard format with batch sizes of either 12 or 24 samples at 8-, 16-, and 24-h durations (Table 1). However, compared to that for MCA with the ultrasensitive format and batch sizes of 12 and 24 samples, the projected 16-h specimen throughputs for CAP/CA (ultrasensitive format) increased by 29% and 25%, respectively, while the 24-h specimen throughputs increased by 17% and 13%, respectively.
|
View this table: [in a new window] |
TABLE 1. Projected run and specimen throughput values for CAP/CA and MCA
|
|
View this table: [in a new window] |
TABLE 2. Assay control and invalid specimen result rates for CAP/CA and MCA
|
Statistical analyses of the log10-transformed, valid clinical specimen results (within the quantifiable range of both CAP/CA and MCA) were performed using SAS version 9.0 (SAS Institute, Cary, NC). Deming regression analyses demonstrated the same good correlation (r = 0.95) and linear association (r2 = 0.90) for CAP/CA and MCA results using both standard (90 specimens) and ultrasensitive (74 specimens) formats, with linear equations of y = 1.06x – 0.02 and y = 1.02x + 0.10, respectively. Intraclass correlation coefficients of 0.96 and 0.97 were obtained for CAP/CA and MCA with the standard and ultrasensitive formats, respectively. Bland-Altman plotting further indicated that the mean differences between CAP/CA and MCA for the standard (0.21 log10 copies/ml) and ultrasensitive (0.14 log10 copies/ml) formats were independent of HIV-1 RNA titer (data not shown).
Despite the increased use of automation associated with CAP/CA, the direct costs per specimen, excluding labor, increased by <10% with CAP/CA compared to those for MCA, regardless of the batch size or assay format used. The total reagent and consumable cost estimates ranged from $127 (batch size of 24) to $148 (batch size of 12) for MCA and from $139 (batch size of 24) to $163 (batch size of 12) for CAP/CA using the standard assay format. The cost estimates for MCA using the ultrasensitive format were only slightly higher, ranging from $128 (batch size of 24) to $149 (batch size of 12), while the costs for CAP/CA remained unchanged.
In summary, CAP/CA performed as reliably as MCA with similar assay performance characteristics in this limited evaluation, while reducing hands-on time and consolidating labor through the automation of all major steps involved in the quantification of HIV-1 RNA by RT-PCR. The increased costs associated with CAP/CA may also be offset by reductions in labor-related costs. While assay run and specimen throughput were modestly increased with CAP/CA, workflow was interrupted by CA and CAP processing delays after just three consecutive assay runs, thereby limiting the throughput potential of the CAP/CA platform. In addition, transfer of working master mix and sample extract to individual reaction tubes (i.e., A-rings) must still be performed manually with CAP/CA. It should also be emphasized that CAP/CA remains an endpoint PCR-based assay with a limited dynamic range requiring both standard and ultrasensitive formats to accurately quantify HIV-1 RNA over the range of levels found in clinical specimens. Despite these shortcomings, CAP/CA is a reliable, cost-effective alternative to MCA for those clinical laboratories seeking a labor-saving, quantitative HIV-1 RNA assay capable of modest increases in specimen throughput.
This work was supported in part by a grant from Roche Molecular Systems, Inc.
Published ahead of print on 18 July 2007. ![]()
|
|
|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Copyright © 2009 by the American Society for Microbiology. For an alternate route to Journals.ASM.org, visit: http://intl-journals.asm.org | More Info»