Skip to main page content

• HOME
• Current Issue
• Archive
• Alerts
• About ASM
• Contact us
• Tech Support
• Journals.ASM.org

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Reprints and Permissions Copyright Information Books from ASM Press MicrobeWorld Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Nowicki, M. J. Search for Related Content PubMed PubMed Citation Articles by Nowicki, M. J.

 Previous Article  |  Next Article 

Journal of Clinical Microbiology, October 2001, p. 3760-3763, Vol. 39, No. 10
0095-1137/01/$04.00+0   DOI: 10.1128/JCM.39.10.3760-3763.2001
Copyright © 2001, American Society for Microbiology. All rights reserved.

Longitudinal Variability of Human Immunodeficiency Virus Type 1 RNA Viral Load Measurements by Nucleic Acid Sequence-Based Amplification and NucliSens Assays in a Large Multicenter Study

Marek J. Nowicki,^1,* Lorie Benning,² James W. Bremer,³ William A. Meyer III,⁴ Carl Hanson,⁵ Donald Brambilla,⁶ Sylvia Silver,⁷ Andrea Kovacs,¹ and the Women's Interagency HIV-1 Study Collaborative Study Group

University of Southern California, Los Angeles,¹ and California State Department of Health, Berkeley,⁵ California; Johns Hopkins School of Public Health Department of Epidemiology,² and Quest Diagnostics Incorporated,⁴ Baltimore, Maryland; Rush Medical College, Chicago, Illinois³; New England Research Institutes, Watertown, Massachusetts⁶ and Office of HIV-1 Activities, The George Washington University Medical Center, Washington, D.C.⁷

Received 2 March 2001/Returned for modification 15 May 2001/Accepted 10 July 2001

	ABSTRACT

Top Abstract Text References

Human immunodeficiency virus type 1 (HIV-1) RNA measurements were evaluated within an externally controlled multilaboratory program. Three external standards (1.5 × 10³ to 1.5 × 10⁶ copies/ml) were included in 814 assay runs by four laboratories. Results indicate that HIV-1 RNA levels can be measured with a precision equal to that of the pre-highly active antiretroviral therapy era (standard deviations, ±0.16 to 0.25 log₁₀ units).

	TEXT

Top Abstract Text References

The Women's Interagency HIV-1 Study (WIHS), a prospective multicenter study established in August 1993 to carry out comprehensive investigations of the impact of human immunodeficiency virus (HIV) infection on women, utilizes nucleic acid sequence-based amplification technology (NASBA) and NucliSens assays (Organon Teknika Corporation [OTC], Durham, N.C.) to quantify HIV type 1 (HIV-1) RNA (1). Decreasing viral loads resulting from the introduction of highly active antiretroviral therapy (HAART) have necessitated the use of more sensitive HIV-1 RNA assays (17; NucliSens: Synergy of Strengths, OTC pamphlet, OTC, 1997; Amplicor HIV-1 Monitor Assay, Roche pamphlet, Roche Diagnostic Corporation, Durham, N.C., 1999).

Conflicting estimates of the contribution of biological and assay variability to the total variance of consecutive HIV-1 RNA measurements have been reported (2, 9, 11). Findings indicate that approximately two-thirds of total variance is due to biological fluctuation and that one third is due to assay variance (2, 5). The increasing number of multilaboratory-based studies has made differences between laboratories another important issue. A study by Skidmore et al. found high interlaboratory variability, indicating a need for an external quality assurance-quality control system for HIV-1 RNA measurements (15).

The WIHS HIV-1 RNA viral load data are unique because of the long observation period and the homogeneity of material used for the external standards. This report clarifies the key issues of laboratory differences and systematic fluctuations over time that affect the nonbiological variability component of HIV-1 RNA viral load measurements.

In the WIHS, four laboratories (all certified by the Virology Quality Assurance Laboratory [VQA], Rush Presbyterian/St. Luke's Medical Center, Chicago, Ill.) performed HIV-1 RNA testing using three versions of OTC assays and a common set of HIV-1 RNA external standards. The standard consisted of HIV-1-negative plasma spiked with HIV-1 virus (4, 5). NASBA assays (0.1-ml input [NASBA_{0.1 ml}]; lower detection limit [LDL], >4,000 copies/ml) were run with sets of 1.5 × 10⁶, 1.5 × 10⁵, and 1.5 × 10⁴ (~10^6.18, 10^5.18, and 10^4.18, respectively) HIV-1 RNA copies/ml. The corresponding values for standards for both versions of NucliSens (0.2-ml input; LDL, >400 copies/ml; and 1.0-ml input; LDL, >80 copies/ml) were 1 log unit lower. The manufacturer retrained laboratory technicians prior to the distribution of NucliSens with reformulated enzymes (October 1998).

We used the mean square error from a one-way analysis of variance to obtain estimates for the intra-assay variance of the log₁₀ unit of the absolute copy number for each external standard. We used Bartlett's test to compare variances between labs (14). To evaluate systematic fluctuations over time, we fit smooth curves to scatter plots of all log-transformed results for each external standard using the S-plus lowess function (6, 16). P values indicate the statistical significance of the observed nonlinear trends.

Assay format and input volume. Table 1 shows overall means and standard deviations (SD) of the log-transformed results of the external standards for each assay-input volume combination. Observed variability was lowest for NucliSens_{1.0 ml} and was similar for NASBA_{0.1 ml}.

View this table: [in this window] [in a new window]   TABLE 1.   HIV-1 RNA results from each VQA control-OTC assay combination

In a retrospective analysis of assay run acceptability, we defined run rejection criteria as (i) two results exceeding the target value by more than 2 SD, (ii) one result exceeding the target value by more than 3 SD, or (iii) an R square of <0.95 (8). Overall rejection rates were 6% for NASBA_{0.1 ml}, 3% for NucliSens_{0.2 ml}, and <1% for NucliSens_{1.0 ml} (data not shown).

Fluctuations in HIV concentrations greater than 0.5 log₁₀ unit have been described as clinically relevant (7, 10, 12, 13). The NASBA_{0.1 ml} result was more than ± 0.5 log unit from the target of 10^4.18 copies/ml for 23 of 474 runs (5%) compared to 0 of 178 runs for NucliSens_{0.2 ml} and 0 of 162 runs for NucliSens_{1.0 ml} (P < 0.0001). NucliSens_{0.2 ml} missed the target of 10^3.18 copies/ml 26 times (15%) compared to 0 times for NucliSens_{1.0 ml} (P < 0.0001).

Laboratory differences. There were statistically significant differences in levels of variance between labs for the lowest-range standard of all three assay-input volume combinations and for the highest-range standard for NucliSens_{1.0 ml} (data not shown).

Variability over time. Table 2 summarizes SD for 6-month time intervals corresponding to WIHS visit windows for each assay-input volume combination and VQA external standard. Within each combination and for all standards, the SD was stable and there were no statistically significant trends except with the lowest-range control value for NucliSens_{0.2 ml}.

View this table: [in this window] [in a new window]   TABLE 2.   Longitudinal trends in SD of log10 HIV-1 RNA results from each VQA control-OTC assay combinationa

For NASBA_{0.1 ml} (April 1996 to October 1998), the observed nonlinear trends were statistically significant for all standards (lowest range, P = 0.003 [Fig. 1A]; middle range, P < 0.0001 [Fig. 1B]; highest range, P < 0.0001 [Fig. 1C]). NucliSens_{0.2 ml} (October 1997 to January 1999) demonstrated a marginally significant trend in the highest-range standard (Fig. 1F; P = 0.03). NucliSens_{1.0 ml} (February 1999 to January 2000) demonstrated significant trends in the middle and high-range standards (Fig. 1H, P = 0.003, and I, P = 0.001, respectively).

View larger version (42K): [in this window] [in a new window]   FIG. 1.   Scatter plots with nonlinear smooth curves of all log-transformed results over the observation period of each assay for each of the three VQA controls (solid line). Each dot represents the result from one run. Nominal target values (dashed lines) and values 2 SD above and below the nominal value (dotted lines) give context to the measurement fluctuations over time. Nonlinear P values indicate the strength (fit) of the association between time and the control result. (C) 1.5 × 106 copies/ml; (B, F, and I) 1.5 × 105 copies/ml; (A, E, and H) 1.5 × 104 copies/ml; (D and G) 1.5 × 103 copies/ml.

While we observed no gain in precision in the transition from NASBA_{0.1 ml} to Nuclisens_{0.2 ml}, there was a gain in precision and reproducibility for all standards in the transition from Nuclisens_{0.2 ml} to Nuclisens_{1.0 ml}. This was most likely the cumulative result of kit reformulation and increased input volume (M. Cronin, OTC, personal communication, 2000; Introducing a New Family of Assays Based on NASBA, OTC pamphlet, 1997; NucliSens: Synergy of Strengths, OTC pamphlet, 1997).

Theoretically, the observed systematic decrease in results over the 2.5-year observation period for NASBA_{0.1 ml} may be an indication of the deterioration of the virus in the viral stock used for VQA standards over time. However, an internal VQA study to address this possibility found no indication of deterioration of the virus in quality assurance panels (3). The observed increase in the level of HIV-1 RNA over the 1-year observation period for NucliSens_{1.0 ml} also argues against deterioration of the virus in the viral stock. All statistically significant longitudinal trends were well within 2 SD, indicating no biologically relevant bias. We conclude that it is not necessary to make an intra-assay adjustment for time.

We have described the performance over a period spanning the introduction of HAART of three versions of OTC assays within an externally controlled multilaboratory program. NASBA technology is invariant to specimen type, an advantage that makes this assay valuable to clinicians and researchers testing nonplasma body fluids for HIV-1 RNA. Our data demonstrate that the precision of the OTC assays is comparable to that of other assays not invariant to specimen type. We also demonstrated that patient viral load levels in the HAART era can be measured with the same precision as or with better precision than in the pre-HAART era, despite an average HIV-1 RNA decrease of 2 log₁₀ units. We have shown that HIV-1 RNA measurements across multiple WIHS sites over a period of 4 years were comparable despite the introduction of HAART, different versions of the assay, and differences between labs.

	ACKNOWLEDGMENTS

Data in this manuscript were collected by the WIHS Collaborative Study Group, which is made up of the following consortia or centers (principal investigators): New York City/Bronx, N.Y., Consortium (Kathryn Anastos); Brooklyn, N.Y. (Howard Minkoff); Washington, D.C., Metropolitan Consortium (Mary Young); The Connie Wofsy Study Consortium of Northern California (Ruth Greenblatt, Herminia Palacio); Los Angeles County/Southern California Consortium (Alexandra Levine); Chicago Consortium (Mardge Cohen); and the Data Coordinating Center (Alvaro Muñoz, Stephen J. Gange).

The WIHS is funded by the National Institute of Allergy and Infectious Diseases, with supplemental funding from the National Cancer Institute, the National Institute of Child Health and Human Development, the National Institute on Drug Abuse, the National Institute of Dental and Craniofacial Research, the Agency for Health Care Policy and Research, and the Centers for Disease Control and Prevention (grants U01-AI-35004, U01-AI-31834, U01-AI-34994, AI-34989, U01-HD-32632 [NICHD], U01-AI-34993, and U01-AI-42590). The VQA program is funded by the Division of AIDS, National Institute of Allergy and Infectious Diseases, National Institutes of Health, contract NO1-A1-85354.

	FOOTNOTES

^* Corresponding author. Mailing address: University of Southern California, Pediatrics, 1801 E. Marengo St., Room 2G11, Los Angeles, CA 90033. Phone: (323) 226-4161. Fax: (323) 226-3831. E-mail: marek{at}usc.edu.

	REFERENCES

Top Abstract Text References

1.	Barkan, S. E., S. L. Melnick, S. Preston-Martin, K. Weber, L. A. Kalish, P. Miotti, M. Young, R. Greenblatt, H. Sacks, and J. Feldman. 1998. The Women's Interagency HIV Study WIHS Collaborative Study Group. Epidemiology 9:117-125[CrossRef][Medline].
2.	Bartlett, J. A., R. DeMasi, D. Dawson, and A. Hill. 1998. Variability in repeated consecutive measurements of plasma human immunodeficiency virus RNA in persons receiving stable nucleoside reverse transcriptase inhibitor therapy or no treatment. J. Infect. Dis. 178:1803-1805[CrossRef][Medline].
3.	Brambilla, D. 2000. 180-Day stability of stored RNA proficiency panels. VQA Program's Report Quarterly. Virology Quality Assurance Laboratory, Rush Presbyterian/St. Luke's Medical Center, Chicago, Ill.
4.	Brambilla, D., S. Leung, J. Lew, J. Todd, S. Herman, M. Cronin, D. E. Shapiro, J. Bremer, C. Hanson, G. V. Hillyer, G. D. McSherry, R. S. Sperling, R. W. Coombs, and P. S. Reichelderfer. 1998. Absolute copy number and relative change in determinations of human immunodeficiency virus type 1 RNA in plasma: effect of an external standard on kit comparisons. J. Clin. Microbiol. 36:311-314[Abstract/Free Full Text].
5.	Brambilla, D., P. S. Reichelderfer, J. W. Bremer, D. E. Shapiro, R. C. Hershow, D. A. Katzenstein, S. M. Hammer, B. Jackson, A. C. Collier, R. S. Sperling, M. G. Fowler, and R. W. Coombs. 1999. The contribution of assay variation and biological variation to the total variability of plasma HIV-1 RNA measurements. The Women Infant Transmission Study Clinics. Virology Quality Assurance Program. AIDS 13:2269-2279[CrossRef][Medline].
6.	Chambers, J. M., and T. J. Hastie (ed.). 1992. Statistical models in S. Chapman and Hall, New York, N.Y.
7.	Clerici, M., A. Sarin, R. L. Coffman, T. A. Wynn, S. P. Blatt, C. W. Hendrix, S. F. Wolf, G. M. Shearer, and P. A. Henkart. 1994. Type 1/type 2 cytokine modulation of T-cell programed cell death as a model for human immunodeficiency virus pathogenesis. Immunology 91:11811-11815.
8.	Constantine, N. T., and J. D. W. Callahan. 1992. Quality control and quality assurance, p. 121-167. In Retroviral testing. Essentials for quality control and laboratory diagnosis. CRC Press, Inc., Boca Raton, Fla.
9.	Deeks, S. G., R. L. Coleman, R. White, C. Pachl, M. Schambelan, D. N. Chernoff, and M. B. Feinberg. 1997. Variance of plasma human immunodeficiency virus type 1 RNA levels measured by branched DNA within and between days. J. Infect. Dis. 176:514-517[Medline].
10.	Gerondelis, P., R. H. Archer, C. Palaniappan, R. C. Reichman, P. J. Fay, R. A. Bambara, and L. M. Demeter. 1999. The P236L delavirdine-resistant human immunodeficiency virus type 1 mutant is replication defective and demonstrates alterations in both RNA 5'-end- and DNA 3'-end-directed RNase H activities. J. Virol. 73:5803-5813[Abstract/Free Full Text].
11.	Lin, H. J., L. Pedneault, and F. B. Hollinger. 1998. Intra-assay performance characteristics of five assays for quantification of human immunodeficiency virus type 1 RNA in plasma. J. Clin. Microbiol. 36:835-839[Abstract/Free Full Text].
12.	Mellors, J. W., A. Munoz, J. V. Giorgi, J. B. Margolick, C. J. Tassoni, P. Gupta, L. A. Kingsley, J. A. Todd, A. J. Saah, R. Detels, J. P. Phair, and C. R. J. Rinaldo. 1997. Plasma viral load and CD4+ lymphocytes as prognostic markers of HIV-1 infection. Ann. Intern. Med. 126:946-954[Abstract/Free Full Text].
13.	Mellors, J. W., C. R. J. Rinaldo, P. Gupta, R. M. White, J. A. Todd, and L. A. Kingsley. 1996. Prognosis in HIV-1 infection predicted by the quantity of virus in plasma. Science 272:1167-1170[Abstract]. (Erratum, 275:14, 1997.)
14.	Pollard, J. H. 1977. A handbook of numerical and statistical techniques, p. 195-196. Cambridge University Press, New York, N.Y.
15.	Skidmore, S. J., M. Zuckerman, and J. V. Parry. 2000. Accuracy of plasma HIV RNA quantification: a multicentre study of variability. J. Med. Virol. 61:417-422[CrossRef][Medline].
16.	Venables, W. N., and B. D. Ripley. 1997. Modern regression, p. 323-331. In Modern applied statistics with S-Plus. Springer, New York, N.Y.
17.	Witt, D. J., M. Kemper, A. Stead, C. C. Ginocchio, and A. M. Caliendo. 2000. Relationship of incremental specimen volumes and enhanced detection of human immunodeficiency virus type 1 RNA with nucleic acid amplification technology. J. Clin. Microbiol. 38:85-89[Abstract/Free Full Text].
18.	Roche Molecular Diagnostics. Amplicore HIV-1 Monitor Assay. 2-1999. Roche Diagnostic Corporation. Ref Type: Pamphlet

---

Journal of Clinical Microbiology, October 2001, p. 3760-3763, Vol. 39, No. 10
0095-1137/01/$04.00+0   DOI: 10.1128/JCM.39.10.3760-3763.2001
Copyright © 2001, American Society for Microbiology. All rights reserved.

This article has been cited by other articles:

• Li, X., Chu, H., Gallant, J. E, Hoover, D. R, Mack, W. J, Chmiel, J. S, Munoz, A. (2006). Bimodal virological response to antiretroviral therapy for HIV infection: an application using a mixture model with left censoring.. J. Epidemiol. Community Health 60: 811-818 [Abstract] [Full Text]  
• Strickler, H. D., Burk, R. D., Fazzari, M., Anastos, K., Minkoff, H., Massad, L. S., Hall, C., Bacon, M., Levine, A. M., Watts, D. H., Silverberg, M. J., Xue, X., Schlecht, N. F., Melnick, S., Palefsky, J. M. (2005). Natural History and Possible Reactivation of Human Papillomavirus in Human Immunodeficiency Virus-Positive Women. JNCI J Natl Cancer Inst 97: 577-586 [Abstract] [Full Text]  
• Raggi, C. C., Pinzani, P., Paradiso, A., Pazzagli, M., Orlando, C. (2003). External Quality Assurance Program for PCR Amplification of Genomic DNA: An Italian Experience. Clin. Chem. 49: 782-791 [Abstract] [Full Text]  

This Article Abstract Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Reprints and Permissions Copyright Information Books from ASM Press MicrobeWorld Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Nowicki, M. J. Search for Related Content PubMed PubMed Citation Articles by Nowicki, M. J.