Previous Article | Next Article 
Journal of Clinical Microbiology, November 2007, p. 3788-3790, Vol. 45, No. 11
0095-1137/07/$08.00+0 doi:10.1128/JCM.00825-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.
Multicenter Trials Need To Use the Same Assay for Hepatitis C Virus Viral Load Determination
Syria Laperche,1
Françoise Bouchardeau,1
Vincent Thibault,2
Bruno Pozzetto,3
Sophie Vallet,4
Arielle R. Rosenberg,5
Anne-Marie Roque-Afonso,6
Michèle Gassin,7
Françoise Stoll-Keller,8
Pascale Trimoulet,9
Elyanne Gault,10
Bruno Chanzy,11
Bernard Mercier,12
Michel Branger,13
Jean-Michel Pawlotsky,14
Cécile Henquell,15
Françoise Lunel,16
Catherine Gaudy-Graffin,17
Sophie Alain,18
Marie-Laure Chaix,19
Gilles Duverlie,20
Jacques Izopet,21 and
Jean-Jacques Lefrère22,23*
Centre National de Référence pour les hépatites B et C en transfusion, Département des Agents Transmissibles par le Sang, Institut National de la Transfusion Sanguine, Paris,1
Laboratoire de Virologie, Centre Hospitalo-Universitaire Pitié-Salpêtrière, Paris,2
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire, Saint-Etienne,3
Laboratoire de Microbiologie, Centre Hospitalo-Universitaire, Brest,4
Université René Descartes, Faculté de Médecine, and AP-HP, Groupe Hospitalier Cochin, Paris,5
Laboratoire de Virologie, Centre Hospitalier Paul Brousse, Villejuif,6
Institut de Biologie, Hôtel Dieu, Nantes,7
Laboratoire de Virologie, Centre Hospitalier, Strasbourg,8
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Bordeaux,9
Laboratoire de Virologie-Bactériologie associé au CNR des hépatites B et C, Centre Hospitalo-Universitaire Avicenne, Bobigny,10
Laboratoire de Virologie, Centre Hospitalier, Annecy,11
Laboratoire de Virologie, Etablissement Français du Sang Bretagne, Brest,12
Laboratoire de Virologie, Centre Hospitalo-Universitaire Bichat, Paris,13
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire Henri-Mondor, Créteil,14
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Clermont-Ferrand,15
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire, Angers,16
Université François Rabelais, Inserm ERI19, Centre Hospitalier Universitaire, Tours,17
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire, Limoges,18
Laboratoire de Virologie, Centre Hospitalo-Universitaire Necker, Paris,19
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Amiens,20
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Toulouse,21
Laboratoire d'Hématologie, Centre Hospitalo-Universitaire, Amiens,22
Département des Agents Transmissibles par le Sang, Institut National de la Transfusion Sanguine, Paris, France,23
Received 18 April 2007/
Returned for modification 17 June 2007/
Accepted 15 September 2007

ABSTRACT
This study, involving 20 laboratories and using currently available
assays for hepatitis C virus RNA quantification, demonstrated
that differences in viral load values are due not to interlaboratory
variations but rather to the nature of the assay itself. This
underlines the importance of using the same assay in multicenter
studies or when monitoring antiviral therapy.

TEXT
In a previous multicenter study designed to assess the expertise
of laboratories involved in large-scale therapeutic trials for
providing reliable data on hepatitis C virus (HCV) viral loads
(VLs) (
11), we found a wide heterogeneity of results depending
both on the laboratories and on the HCV RNA quantification assays.
Since that study, new assays based on real-time (RT) PCR have
been developed. These assays are very useful tools for antiviral
therapeutic monitoring, because they offer several advantages,
including lower limits of detection and larger dynamic ranges
of quantification (
1-
3,
8). Moreover, the availability of automatic
platforms makes them attractive for the monitoring of HCV infection,
and hence an increasing number of laboratories have decided
to introduce these assays for routine use. Thus, a variety of
HCV RNA quantification assays are now in use in laboratories
that may be involved in large-scale trials. This prompted us
to conduct a multicenter study in order to evaluate the expertise
of such laboratories for determining HCV VL in this new context.
The panel included 15 samples: 13 samples collected from HCV-infected blood donors (one was represented in duplicate, genotype 2k) and one negative sample. The characteristics of this panel are described in Table 1. For each positive sample, HCV genotype was determined with a method based on the analysis of the NS5b region sequence (9).
The 20 participating laboratories provided a total of 21 results:
9 with bDNA Versant HCV 3.0 (Bayer Healthcare, Eragny, France),
6 with HCV Monitor 2.0 (Roche Diagnostics, Meylan, France),
4 with Cobas Ampliprep/Cobas TaqMan 48 HCV (Roche Diagnostics),
and 2 with Abbott RealTime HCV PCR (Abbott Diagnostics, Rungis,
France). The two latter assays are based on RT PCR. Table
1 shows the mean VLs obtained with each assay and the related
coefficients of variation (CV). No false-positive result was
observed for the HCV RNA-negative sample. Although not designed
to evaluate specificity, this study confirms that unlike first-generation
assays (
4), standardized commercial assays, including those
based on RNA extraction platforms, guarantee an optimal specificity
score.
In contrast to the observation recently made by our working group on hepatitis B virus DNA quantification assays (10), we observed no significant intra-assay differences. Indeed, all HCV RNA quantification assays showed a high reproducibility rate, as evidenced by the low variations observed, irrespective of the VL level and the genotype. As shown in Table 1, the interlaboratory CV ranged from 0.8 to 6.2% (mean, 2.6%) for Bayer bDNA assay, from 0.8 to 10.9% (mean, 3.52%) for the Roche Monitor assay, from 0.5 to 5.3% (mean, 2.25%) for the Cobas TaqMan 48, and from 0.1 to 15.2% (mean, 5.12%) for the Abbott RealTime HCV PCR. The relatively high CV for results from laboratories using the latter assay may suggest interlaboratory variability. As the calculation relied on only two independent values, more extensive studies are needed to assess more accurately the performance of this new method of HCV RNA quantification.
The low interlaboratory CV rate observed for each assay contrasts with the interassay CV, which reached values above 10% (Table 1) for two samples (sample 4, genotype 1b, and sample 12, genotype 4d). Interestingly, as shown in Fig. 1 and in Table 1, the difference between the highest and the lowest VLs for each sample ranged from 0.33 (genotype 4a sample) to 1.95 log10 (genotype 1a). For 12 of the 14 samples, the lowest value was given by the bDNA assay, which was performed by four laboratories, eliminating the hypothesis that differences in laboratory procedure were responsible. Moreover, as depicted in Table 1, the bDNA assay provided significantly lower VLs than Monitor (13 samples) and Cobas TaqMan (11 samples) assays. The two remaining samples were underestimated by Cobas TaqMan 48 (one genotype 4a sample) and Abbott RealTime (one genotype 4d sample). This supports the concern of previous studies about the ability of the new RT PCR assays to correctly quantify samples of genotype 4 (2, 12). However, more studies of genotype 4 are required before a conclusion on the ability of the new RT PCR assays to correctly quantify such samples can be reached. The highest values were obtained in eight cases with the Monitor assay and in six cases with the Cobas TaqMan HCV 48.
Many recent comparative studies of commercially available HCV
RNA quantification assays have shown contradictory results,
in particular concerning the ability of assays to accurately
quantify certain HCV genotypes. A significant underestimation
of genotypes 2, 3, 4, and 5 was observed with the Cobas TaqMan
48 when the High Pure system was used for RNA extraction (
5,
12). The same RT PCR method used in conjunction with the Cobas
Ampliprep sample preparation device was described as having
an efficiency equal to that of the Abbott RealTime HCV mostly
for genotype 1 samples (
7), while it was reported to underestimate
genotype 4 VL (
2,
12). In another study (
8), the Cobas TaqMan
provided a poor correlation with Amplicor Roche and Bayer bDNA
assays, leading to a 1.5-log
10 IU/ml difference in the quantification
of the same sample in 5% of the cases. However, this study was
based on the use of an extraction device different from those
recommended by the manufacturer of this assay. Conflicting results
have also been published concerning the performance of the Bayer
bDNA assay: some studies have shown a good sensitivity irrespective
of genotype (
5,
6,
8), while another study demonstrated a constantly
lower quantification of genotypes 1 to 3 (
12). In comparison
with the majority of previous studies, a major asset of our
study is the involvement of several laboratories using the same
assay; thus, the impact of potential interlaboratory variations
on the comparison of the assays was minimized. In this way,
we observed a global underestimation of HCV VL with the bDNA
assay, since this method gave a mean VL lower than the total
mean for all the samples, with a statistically significant difference
for six of them (Table
1).
As a whole, these results demonstrate that any laboratory with good expertise in HCV RNA quantification techniques is able to provide reliable VLs when using a given assay. Therefore, the centralization of samples in one single laboratory is not necessary when a multicenter study is carried out. However, the interassay differences, in particular in the extreme VLs, lead us to recommend that the same assay be used in multicenter clinical trials or when the response to therapy in a single patient is being monitored.

ACKNOWLEDGMENTS
This work was supported by a grant from the Agence Nationale
de Recherches sur le SIDA et les Virus des Hépatites
(ANRS).
We thank Véronique Descamps, Christine Portal, Annie Razer, and Patricia Zawadzki for their technical assistance and Christopher Payan for his helpful advice in the reading of the manuscript.

FOOTNOTES
* Corresponding author. Mailing address: Institut National de la Transfusion Sanguine, 6 rue Alexandre-Cabanel, 75015 Paris, France. Phone: 44 49 30 51. Fax: 44 49 30 59. E-mail:
jeanjacqueslefrere{at}wanadoo.fr 
Published ahead of print on 3 October 2007. 

REFERENCES
1 - Barbeau, J. M., J. Goforth, A. M. Caliendo, and F. S. Nolte. 2004. Performance characteristics of a quantitative TaqMan hepatitis C virus RNA analyte-specific reagent. J. Clin. Microbiol. 42:3739-3746.[Abstract/Free Full Text]
2 - Caliendo, A. M., A. Valsamakis, Y. Zhou, B. Yen-Lieberman, J. Andersen, S. Young, A. Ferreira-Gonzalez, G. J. Tsongalis, R. Pyles, J. W. Bremer, and N. S. Lurain. 2006. Multilaboratory comparison of hepatitis C virus viral load assays. J. Clin. Microbiol. 44:1726-1732.[Abstract/Free Full Text]
3 - Forman, M. S., and A. Valsamakis. 2004. Verification of an assay for quantification of hepatitis C virus RNA by use of an analyte-specific reagent and two different extraction methods. J. Clin. Microbiol. 42:3581-3588.[Abstract/Free Full Text]
4 - French Study Group for the Standardization of Hepatitis C Virus PCR. 1994. Improvement of hepatitis C virus RNA polymerase chain reaction through a multicentre quality control study. J. Virol. Methods 49:79-88.[CrossRef][Medline]
5 - Gelderblom, H. C., S. Menting, and M. G. Beld. 2006. Clinical performance of the new rRoche COBAS TaqMan HCV test and High Pure system for extraction, detection and quantitation of HCV RNA in plasma and serum. Antivir. Ther. 11:95-103.[Medline]
6 - Giraldi, C., A. Noto, R. Tenuta, F. Greco, D. Perugini, M. Spadafora, A. M. Bianco, O. Savino, and A. Natale. 2006. A comparative evaluation between real time Roche COBas TAQMAN 48 HCV and bDNA Bayer Versant HCV 3.0. New Microbiol. 29:243-250.[Medline]
7 - Halfon, P., M. Bourliere, G. Penaranda, H. Khiri, and D. Ouzan. 2006. Real-time PCR assays for hepatitis C virus (HCV) RNA quantitation are adequate for clinical management of patients with chronic HCV infection. J. Clin. Microbiol. 44:2507-2511.[Abstract/Free Full Text]
8 - Konnick, E. Q., S. M. Williams, E. R. Ashwood, and D. R. Hillyard. 2005. Evaluation of the COBAS hepatitis C virus (HCV) TaqMan analyte-specific reagent assay and comparison to the COBAS Amplicor HCV Monitor V2.0 and Versant HCV bDNA 3.0 assays. J. Clin. Microbiol. 43:2133-2140.[Abstract/Free Full Text]
9 - Laperche, S., K. Saune, P. Deny, G. Duverlie, S. Alain, M. L. Chaix, C. Gaudy, F. Lunel, J. M. Pawlotsky, C. Payan, B. Pozzetto, C. Tamalet, V. Thibault, S. Vallet, F. Bouchardeau, J. Izopet, and J. J. Lefrere. 2006. Unique NS5b hepatitis C virus gene sequence consensus database is essential for standardization of genotype determinations in multicenter epidemiological studies. J. Clin. Microbiol. 44:614-616.[Abstract/Free Full Text]
10 - Laperche, S., V. Thibault, F. Bouchardeau, S. Alain, S. Castelain, M. Gassin, M. Gueudin, P. Halfon, S. Larrat, F. Lunel, M. Martinot-Peignoux, B. Mercier, J. M. Pawlotsky, B. Pozzetto, A. M. Roque-Afonso, F. Roudot-Thoraval, K. Saune, and J. J. Lefrere. 2006. Expertise of laboratories in viral load quantification, genotyping, and precore mutant determination for hepatitis B virus in a multicenter study. J. Clin. Microbiol. 44:3600-3607.[Abstract/Free Full Text]
11 - Lefrère, J. J., F. Roudot-Thoraval, F. Lunel, S. Alain, M. L. Chaix, E. Dussaix, M. Gassin, J. Izopet, J. M. Pawlotsky, C. Payan, F. Stoll-Keller, V. Thibault, M. A. Trabaud, D. Bettinger, M. Bogard, M. Branger, C. Buffet-Janvresse, A. Charrois, C. Defer, C. Laffont, J. Lerable, T. Levayer, M. Martinot-Peignoux, B. Mercier, and A. R. Rosenberg. 2004. Expertise of French laboratories in detection, genotyping, and quantification of hepatitis C virus RNA in serum. J. Clin. Microbiol. 42:2027-2030.[Abstract/Free Full Text]
12 - Sarrazin, C., B. C. Gartner, D. Sizmann, R. Babiel, U. Mihm, W. P. Hofmann, M. von Wagner, and S. Zeuzem. 2006. Comparison of conventional PCR with real-time PCR and branched DNA-based assays for hepatitis C virus RNA quantification and clinical significance for genotypes 1 to 5. J. Clin. Microbiol. 44:729-737.[Abstract/Free Full Text]
Journal of Clinical Microbiology, November 2007, p. 3788-3790, Vol. 45, No. 11
0095-1137/07/$08.00+0 doi:10.1128/JCM.00825-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.