Skip to main content
  • ASM
    • Antimicrobial Agents and Chemotherapy
    • Applied and Environmental Microbiology
    • Clinical Microbiology Reviews
    • Clinical and Vaccine Immunology
    • EcoSal Plus
    • Eukaryotic Cell
    • Infection and Immunity
    • Journal of Bacteriology
    • Journal of Clinical Microbiology
    • Journal of Microbiology & Biology Education
    • Journal of Virology
    • mBio
    • Microbiology and Molecular Biology Reviews
    • Microbiology Resource Announcements
    • Microbiology Spectrum
    • Molecular and Cellular Biology
    • mSphere
    • mSystems
  • Log in
  • My alerts
  • My Cart

Main menu

  • Home
  • Articles
    • Current Issue
    • Accepted Manuscripts
    • COVID-19 Special Collection
    • Archive
    • Minireviews
  • For Authors
    • Submit a Manuscript
    • Scope
    • Editorial Policy
    • Submission, Review, & Publication Processes
    • Organization and Format
    • Errata, Author Corrections, Retractions
    • Illustrations and Tables
    • Nomenclature
    • Abbreviations and Conventions
    • Publication Fees
    • Ethics Resources and Policies
  • About the Journal
    • About JCM
    • Editor in Chief
    • Editorial Board
    • For Reviewers
    • For the Media
    • For Librarians
    • For Advertisers
    • Alerts
    • RSS
    • FAQ
  • Subscribe
    • Members
    • Institutions
  • ASM
    • Antimicrobial Agents and Chemotherapy
    • Applied and Environmental Microbiology
    • Clinical Microbiology Reviews
    • Clinical and Vaccine Immunology
    • EcoSal Plus
    • Eukaryotic Cell
    • Infection and Immunity
    • Journal of Bacteriology
    • Journal of Clinical Microbiology
    • Journal of Microbiology & Biology Education
    • Journal of Virology
    • mBio
    • Microbiology and Molecular Biology Reviews
    • Microbiology Resource Announcements
    • Microbiology Spectrum
    • Molecular and Cellular Biology
    • mSphere
    • mSystems

User menu

  • Log in
  • My alerts
  • My Cart

Search

  • Advanced search
Journal of Clinical Microbiology
publisher-logosite-logo

Advanced Search

  • Home
  • Articles
    • Current Issue
    • Accepted Manuscripts
    • COVID-19 Special Collection
    • Archive
    • Minireviews
  • For Authors
    • Submit a Manuscript
    • Scope
    • Editorial Policy
    • Submission, Review, & Publication Processes
    • Organization and Format
    • Errata, Author Corrections, Retractions
    • Illustrations and Tables
    • Nomenclature
    • Abbreviations and Conventions
    • Publication Fees
    • Ethics Resources and Policies
  • About the Journal
    • About JCM
    • Editor in Chief
    • Editorial Board
    • For Reviewers
    • For the Media
    • For Librarians
    • For Advertisers
    • Alerts
    • RSS
    • FAQ
  • Subscribe
    • Members
    • Institutions
Virology

Longitudinal Variability of Human Immunodeficiency Virus Type 1 RNA Viral Load Measurements by Nucleic Acid Sequence-Based Amplification and NucliSens Assays in a Large Multicenter Study

Marek J. Nowicki, Lorie Benning, James W. Bremer, William A. Meyer III, Carl Hanson, Donald Brambilla, Sylvia Silver, Andrea Kovacs, the Women's Interagency HIV-1 Study Collaborative Study Group
Marek J. Nowicki
University of Southern California, Los Angeles, and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Lorie Benning
Johns Hopkins School of Public Health Department of Epidemiology, and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
James W. Bremer
Rush Medical College, Chicago, Illinois; New England
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
William A. Meyer III
Quest Diagnostics Incorporated, Baltimore, Maryland;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Carl Hanson
California State Department of Health, Berkeley, California;
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Donald Brambilla
Research Institutes, Watertown, Massachusetts and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Sylvia Silver
Office of HIV-1 Activities, The George Washington University Medical Center, Washington, D.C.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andrea Kovacs
University of Southern California, Los Angeles, and
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
DOI: 10.1128/JCM.39.10.3760-3763.2001
  • Article
  • Figures & Data
  • Info & Metrics
  • PDF
Loading

ABSTRACT

Human immunodeficiency virus type 1 (HIV-1) RNA measurements were evaluated within an externally controlled multilaboratory program. Three external standards (1.5 × 103 to 1.5 × 106 copies/ml) were included in 814 assay runs by four laboratories. Results indicate that HIV-1 RNA levels can be measured with a precision equal to that of the pre-highly active antiretroviral therapy era (standard deviations, ±0.16 to 0.25 log10 units).

The Women's Interagency HIV-1 Study (WIHS), a prospective multicenter study established in August 1993 to carry out comprehensive investigations of the impact of human immunodeficiency virus (HIV) infection on women, utilizes nucleic acid sequence-based amplification technology (NASBA) and NucliSens assays (Organon Teknika Corporation [OTC], Durham, N.C.) to quantify HIV type 1 (HIV-1) RNA (1). Decreasing viral loads resulting from the introduction of highly active antiretroviral therapy (HAART) have necessitated the use of more sensitive HIV-1 RNA assays (17; NucliSens: Synergy of Strengths, OTC pamphlet, OTC, 1997; Amplicor HIV-1 Monitor Assay, Roche pamphlet, Roche Diagnostic Corporation, Durham, N.C., 1999).

Conflicting estimates of the contribution of biological and assay variability to the total variance of consecutive HIV-1 RNA measurements have been reported (2, 9, 11). Findings indicate that approximately two-thirds of total variance is due to biological fluctuation and that one third is due to assay variance (2, 5). The increasing number of multilaboratory-based studies has made differences between laboratories another important issue. A study by Skidmore et al. found high interlaboratory variability, indicating a need for an external quality assurance-quality control system for HIV-1 RNA measurements (15).

The WIHS HIV-1 RNA viral load data are unique because of the long observation period and the homogeneity of material used for the external standards. This report clarifies the key issues of laboratory differences and systematic fluctuations over time that affect the nonbiological variability component of HIV-1 RNA viral load measurements.

In the WIHS, four laboratories (all certified by the Virology Quality Assurance Laboratory [VQA], Rush Presbyterian/St. Luke's Medical Center, Chicago, Ill.) performed HIV-1 RNA testing using three versions of OTC assays and a common set of HIV-1 RNA external standards. The standard consisted of HIV-1-negative plasma spiked with HIV-1 virus (4, 5). NASBA assays (0.1-ml input [NASBA0.1 ml]; lower detection limit [LDL], >4,000 copies/ml) were run with sets of 1.5 × 106, 1.5 × 105, and 1.5 × 104(∼106.18, 105.18, and 104.18, respectively) HIV-1 RNA copies/ml. The corresponding values for standards for both versions of NucliSens (0.2-ml input; LDL, >400 copies/ml; and 1.0-ml input; LDL, >80 copies/ml) were 1 log unit lower. The manufacturer retrained laboratory technicians prior to the distribution of NucliSens with reformulated enzymes (October 1998).

We used the mean square error from a one-way analysis of variance to obtain estimates for the intra-assay variance of the log10unit of the absolute copy number for each external standard. We used Bartlett's test to compare variances between labs (14). To evaluate systematic fluctuations over time, we fit smooth curves to scatter plots of all log-transformed results for each external standard using the S-plus lowess function (6, 16). Pvalues indicate the statistical significance of the observed nonlinear trends.

Assay format and input volume.Table1 shows overall means and standard deviations (SD) of the log-transformed results of the external standards for each assay-input volume combination. Observed variability was lowest for NucliSens1.0 ml and was similar for NASBA0.1 ml.

View this table:
  • View inline
  • View popup
Table 1.

HIV-1 RNA results from each VQA control-OTC assay combination

In a retrospective analysis of assay run acceptability, we defined run rejection criteria as (i) two results exceeding the target value by more than 2 SD, (ii) one result exceeding the target value by more than 3 SD, or (iii) an R square of <0.95 (8). Overall rejection rates were 6% for NASBA0.1 ml, 3% for NucliSens0.2 ml, and <1% for NucliSens1.0 ml(data not shown).

Fluctuations in HIV concentrations greater than 0.5 log10unit have been described as clinically relevant (7, 10, 12, 13). The NASBA0.1 ml result was more than ± 0.5 log unit from the target of 104.18 copies/ml for 23 of 474 runs (5%) compared to 0 of 178 runs for NucliSens0.2 ml and 0 of 162 runs for NucliSens1.0 ml(P < 0.0001) . NucliSens0.2 ml missed the target of 103.18 copies/ml 26 times (15%) compared to 0 times for NucliSens1.0 ml (P < 0.0001) .

Laboratory differences.There were statistically significant differences in levels of variance between labs for the lowest-range standard of all three assay-input volume combinations and for the highest-range standard for NucliSens1.0 ml (data not shown).

Variability over time.Table 2summarizes SD for 6-month time intervals corresponding to WIHS visit windows for each assay-input volume combination and VQA external standard. Within each combination and for all standards, the SD was stable and there were no statistically significant trends except with the lowest-range control value for NucliSens0.2 ml.

View this table:
  • View inline
  • View popup
Table 2.

Longitudinal trends in SD of log10 HIV-1 RNA results from each VQA control-OTC assay combinationa

For NASBA0.1 ml (April 1996 to October 1998), the observed nonlinear trends were statistically significant for all standards (lowest range, P = 0.003 [Fig.1A]; middle range, P < 0.0001 [Fig. 1B]; highest range, P < 0.0001 [Fig. 1C]). NucliSens0.2 ml (October 1997 to January 1999) demonstrated a marginally significant trend in the highest-range standard (Fig. 1F; P = 0.03 ). NucliSens1.0 ml (February 1999 to January 2000) demonstrated significant trends in the middle and high-range standards (Fig. 1H, P = 0.003 , and I, P = 0.001 , respectively).

Fig. 1.
  • Open in new tab
  • Download powerpoint
Fig. 1.

Scatter plots with nonlinear smooth curves of all log-transformed results over the observation period of each assay for each of the three VQA controls (solid line). Each dot represents the result from one run. Nominal target values (dashed lines) and values 2 SD above and below the nominal value (dotted lines) give context to the measurement fluctuations over time. NonlinearP values indicate the strength (fit) of the association between time and the control result. (C) 1.5 × 106copies/ml; (B, F, and I) 1.5 × 105 copies/ml; (A, E, and H) 1.5 × 104 copies/ml; (D and G) 1.5 × 103 copies/ml.

While we observed no gain in precision in the transition from NASBA0.1 ml to Nuclisens0.2 ml, there was a gain in precision and reproducibility for all standards in the transition from Nuclisens0.2 ml to Nuclisens1.0 ml. This was most likely the cumulative result of kit reformulation and increased input volume (M. Cronin, OTC, personal communication, 2000; Introducing a New Family of Assays Based on NASBA, OTC pamphlet, 1997; NucliSens: Synergy of Strengths, OTC pamphlet, 1997).

Theoretically, the observed systematic decrease in results over the 2.5-year observation period for NASBA0.1 ml may be an indication of the deterioration of the virus in the viral stock used for VQA standards over time. However, an internal VQA study to address this possibility found no indication of deterioration of the virus in quality assurance panels (3). The observed increase in the level of HIV-1 RNA over the 1-year observation period for NucliSens1.0 ml also argues against deterioration of the virus in the viral stock. All statistically significant longitudinal trends were well within 2 SD, indicating no biologically relevant bias. We conclude that it is not necessary to make an intra-assay adjustment for time.

We have described the performance over a period spanning the introduction of HAART of three versions of OTC assays within an externally controlled multilaboratory program. NASBA technology is invariant to specimen type, an advantage that makes this assay valuable to clinicians and researchers testing nonplasma body fluids for HIV-1 RNA. Our data demonstrate that the precision of the OTC assays is comparable to that of other assays not invariant to specimen type. We also demonstrated that patient viral load levels in the HAART era can be measured with the same precision as or with better precision than in the pre-HAART era, despite an average HIV-1 RNA decrease of 2 log10 units. We have shown that HIV-1 RNA measurements across multiple WIHS sites over a period of 4 years were comparable despite the introduction of HAART, different versions of the assay, and differences between labs.

ACKNOWLEDGMENTS

Data in this manuscript were collected by the WIHS Collaborative Study Group, which is made up of the following consortia or centers (principal investigators): New York City/Bronx, N.Y., Consortium (Kathryn Anastos); Brooklyn, N.Y. (Howard Minkoff); Washington, D.C., Metropolitan Consortium (Mary Young); The Connie Wofsy Study Consortium of Northern California (Ruth Greenblatt, Herminia Palacio); Los Angeles County/Southern California Consortium (Alexandra Levine); Chicago Consortium (Mardge Cohen); and the Data Coordinating Center (Alvaro Muñoz, Stephen J. Gange).

The WIHS is funded by the National Institute of Allergy and Infectious Diseases, with supplemental funding from the National Cancer Institute, the National Institute of Child Health and Human Development, the National Institute on Drug Abuse, the National Institute of Dental and Craniofacial Research, the Agency for Health Care Policy and Research, and the Centers for Disease Control and Prevention (grants U01-AI-35004, U01-AI-31834, U01-AI-34994, AI-34989, U01-HD-32632 [NICHD], U01-AI-34993, and U01-AI-42590). The VQA program is funded by the Division of AIDS, National Institute of Allergy and Infectious Diseases, National Institutes of Health, contract NO1-A1-85354.

FOOTNOTES

    • Received 2 March 2001.
    • Returned for modification 15 May 2001.
    • Accepted 10 July 2001.
  • Copyright © 2001 American Society for Microbiology

REFERENCES

  1. 1.↵
    1. Barkan S. E.,
    2. Melnick S. L.,
    3. Preston-Martin S.,
    4. Weber K.,
    5. Kalish L. A.,
    6. Miotti P.,
    7. Young M.,
    8. Greenblatt R.,
    9. Sacks H.,
    10. Feldman J.
    The Women's Interagency HIV Study WIHS Collaborative Study Group.Epidemiology91998117125
    OpenUrlCrossRefPubMedWeb of Science
  2. 2.↵
    1. Bartlett J. A.,
    2. DeMasi R.,
    3. Dawson D.,
    4. Hill A.
    Variability in repeated consecutive measurements of plasma human immunodeficiency virus RNA in persons receiving stable nucleoside reverse transcriptase inhibitor therapy or no treatment.J. Infect. Dis.178199818031805
    OpenUrlCrossRefPubMed
  3. 3.↵
    1. Brambilla D.
    180-Day stability of stored RNA proficiency panels. VQA Program's Report Quarterly. 2000 Virology Quality Assurance Laboratory, Rush Presbyterian/St. Luke's Medical Center Chicago, Ill
  4. 4.↵
    1. Brambilla D.,
    2. Leung S.,
    3. Lew J.,
    4. Todd J.,
    5. Herman S.,
    6. Cronin M.,
    7. Shapiro D. E.,
    8. Bremer J.,
    9. Hanson C.,
    10. Hillyer G. V.,
    11. McSherry G. D.,
    12. Sperling R. S.,
    13. Coombs R. W.,
    14. Reichelderfer P. S.
    Absolute copy number and relative change in determinations of human immunodeficiency virus type 1 RNA in plasma: effect of an external standard on kit comparisons.J. Clin. Microbiol.361998311314
    OpenUrlAbstract/FREE Full Text
  5. 5.↵
    1. Brambilla D.,
    2. Reichelderfer P. S.,
    3. Bremer J. W.,
    4. Shapiro D. E.,
    5. Hershow R. C.,
    6. Katzenstein D. A.,
    7. Hammer S. M.,
    8. Jackson B.,
    9. Collier A. C.,
    10. Sperling R. S.,
    11. Fowler M. G.,
    12. Coombs R. W.
    The contribution of assay variation and biological variation to the total variability of plasma HIV-1 RNA measurements. The Women Infant Transmission Study Clinics. Virology Quality Assurance Program.AIDS13199922692279
    OpenUrlCrossRefPubMedWeb of Science
  6. 6.↵
    1. Chambers J. M.,
    2. Hastie T. J.
    Statistical models in S. 1992 Chapman and Hall New York, N.Y
  7. 7.↵
    1. Clerici M.,
    2. Sarin A.,
    3. Coffman R. L.,
    4. Wynn T. A.,
    5. Blatt S. P.,
    6. Hendrix C. W.,
    7. Wolf S. F.,
    8. Shearer G. M.,
    9. Henkart P. A.
    Type 1/type 2 cytokine modulation of T-cell programed cell death as a model for human immunodeficiency virus pathogenesis.Immunology9119941181111815
    OpenUrl
  8. 8.↵
    1. Constantine N. T.,
    2. Callahan J. D. W.
    Quality control and quality assurance Retroviral testing. Essentials for quality control and laboratory diagnosis. 1992 121 167 CRC Press, Inc. Boca Raton, Fla
  9. 9.↵
    1. Deeks S. G.,
    2. Coleman R. L.,
    3. White R.,
    4. Pachl C.,
    5. Schambelan M.,
    6. Chernoff D. N.,
    7. Feinberg M. B.
    Variance of plasma human immunodeficiency virus type 1 RNA levels measured by branched DNA within and between days.J. Infect. Dis.1761997514517
    OpenUrlCrossRefPubMedWeb of Science
  10. 10.↵
    1. Gerondelis P.,
    2. Archer R. H.,
    3. Palaniappan C.,
    4. Reichman R. C.,
    5. Fay P. J.,
    6. Bambara R. A.,
    7. Demeter L. M.
    The P236L delavirdine-resistant human immunodeficiency virus type 1 mutant is replication defective and demonstrates alterations in both RNA 5′-end- and DNA 3′-end-directed RNase H activities.J. Virol.73199958035813
    OpenUrlAbstract/FREE Full Text
  11. 11.↵
    1. Lin H. J.,
    2. Pedneault L.,
    3. Hollinger F. B.
    Intra-assay performance characteristics of five assays for quantification of human immunodeficiency virus type 1 RNA in plasma.J. Clin. Microbiol.361998835839
    OpenUrlAbstract/FREE Full Text
  12. 12.↵
    1. Mellors J. W.,
    2. Munoz A.,
    3. Giorgi J. V.,
    4. Margolick J. B.,
    5. Tassoni C. J.,
    6. Gupta P.,
    7. Kingsley L. A.,
    8. Todd J. A.,
    9. Saah A. J.,
    10. Detels R.,
    11. Phair J. P.,
    12. Rinaldo C. R. J.
    Plasma viral load and CD4+ lymphocytes as prognostic markers of HIV-1 infection.Ann. Intern. Med.1261997946954
    OpenUrlCrossRefPubMedWeb of Science
  13. 13.↵
    1. Mellors J. W.,
    2. Rinaldo C. R. J.,
    3. Gupta P.,
    4. White R. M.,
    5. Todd J. A.,
    6. Kingsley L. A.
    Prognosis in HIV-1 infection predicted by the quantity of virus in plasma.Science272199611671170 (Erratum, 275:14, 1997.)
    OpenUrlAbstract
  14. 14.↵
    1. Pollard J. H.
    A handbook of numerical and statistical techniques 1977 195 196 Cambridge University Press New York, N.Y
  15. 15.↵
    1. Skidmore S. J.,
    2. Zuckerman M.,
    3. Parry J. V.
    Accuracy of plasma HIV RNA quantification: a multicentre study of variability.J. Med. Virol.612000417422
    OpenUrlCrossRefPubMedWeb of Science
  16. 16.↵
    1. Venables W. N.,
    2. Ripley B. D.
    Modern regression Modern applied statistics with S-Plus. 1997 323 331 Springer New York, N.Y
  17. 17.
    1. Witt D. J.,
    2. Kemper M.,
    3. Stead A.,
    4. Ginocchio C. C.,
    5. Caliendo A. M.
    Relationship of incremental specimen volumes and enhanced detection of human immunodeficiency virus type 1 RNA with nucleic acid amplification technology.J. Clin. Microbiol.3820008589
    OpenUrlAbstract/FREE Full Text
  18. 18.
    Roche Molecular Diagnostics. Amplicore HIV-1 Monitor Assay. 2-1999. Roche Diagnostic Corporation. Ref Type: Pamphlet
View Abstract
PreviousNext
Back to top
Download PDF
Citation Tools
Longitudinal Variability of Human Immunodeficiency Virus Type 1 RNA Viral Load Measurements by Nucleic Acid Sequence-Based Amplification and NucliSens Assays in a Large Multicenter Study
Marek J. Nowicki, Lorie Benning, James W. Bremer, William A. Meyer III, Carl Hanson, Donald Brambilla, Sylvia Silver, Andrea Kovacs, the Women's Interagency HIV-1 Study Collaborative Study Group
Journal of Clinical Microbiology Oct 2001, 39 (10) 3760-3763; DOI: 10.1128/JCM.39.10.3760-3763.2001

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Print

Alerts
Sign In to Email Alerts with your Email Address
Email

Thank you for sharing this Journal of Clinical Microbiology article.

NOTE: We request your email address only to inform the recipient that it was you who recommended this article, and that it is not junk mail. We do not retain these email addresses.

Enter multiple addresses on separate lines or separate them with commas.
Longitudinal Variability of Human Immunodeficiency Virus Type 1 RNA Viral Load Measurements by Nucleic Acid Sequence-Based Amplification and NucliSens Assays in a Large Multicenter Study
(Your Name) has forwarded a page to you from Journal of Clinical Microbiology
(Your Name) thought you would be interested in this article in Journal of Clinical Microbiology.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Longitudinal Variability of Human Immunodeficiency Virus Type 1 RNA Viral Load Measurements by Nucleic Acid Sequence-Based Amplification and NucliSens Assays in a Large Multicenter Study
Marek J. Nowicki, Lorie Benning, James W. Bremer, William A. Meyer III, Carl Hanson, Donald Brambilla, Sylvia Silver, Andrea Kovacs, the Women's Interagency HIV-1 Study Collaborative Study Group
Journal of Clinical Microbiology Oct 2001, 39 (10) 3760-3763; DOI: 10.1128/JCM.39.10.3760-3763.2001
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Top
  • Article
    • ABSTRACT
    • ACKNOWLEDGMENTS
    • FOOTNOTES
    • REFERENCES
  • Figures & Data
  • Info & Metrics
  • PDF

KEYWORDS

HIV Infections
HIV-1
Nucleic Acid Amplification Techniques
RNA, Viral
Self-Sustained Sequence Replication

Related Articles

Cited By...

About

  • About JCM
  • Editor in Chief
  • Board of Editors
  • Editor Conflicts of Interest
  • For Reviewers
  • For the Media
  • For Librarians
  • For Advertisers
  • Alerts
  • RSS
  • FAQ
  • Permissions
  • Journal Announcements

Authors

  • ASM Author Center
  • Submit a Manuscript
  • Article Types
  • Resources for Clinical Microbiologists
  • Ethics
  • Contact Us

Follow #JClinMicro

@ASMicrobiology

       

ASM Journals

ASM journals are the most prominent publications in the field, delivering up-to-date and authoritative coverage of both basic and clinical microbiology.

About ASM | Contact Us | Press Room

 

ASM is a member of

Scientific Society Publisher Alliance

 

American Society for Microbiology
1752 N St. NW
Washington, DC 20036
Phone: (202) 737-3600

 

Copyright © 2021 American Society for Microbiology | Privacy Policy | Website feedback

Print ISSN: 0095-1137; Online ISSN: 1098-660X