Previous Article | Next Article 
Journal of Clinical Microbiology, November 2007, p. 3788-3790, Vol. 45, No. 11
0095-1137/07/$08.00+0 doi:10.1128/JCM.00825-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.
Multicenter Trials Need To Use the Same Assay for Hepatitis C Virus Viral Load Determination
Syria Laperche,1
Françoise Bouchardeau,1
Vincent Thibault,2
Bruno Pozzetto,3
Sophie Vallet,4
Arielle R. Rosenberg,5
Anne-Marie Roque-Afonso,6
Michèle Gassin,7
Françoise Stoll-Keller,8
Pascale Trimoulet,9
Elyanne Gault,10
Bruno Chanzy,11
Bernard Mercier,12
Michel Branger,13
Jean-Michel Pawlotsky,14
Cécile Henquell,15
Françoise Lunel,16
Catherine Gaudy-Graffin,17
Sophie Alain,18
Marie-Laure Chaix,19
Gilles Duverlie,20
Jacques Izopet,21 and
Jean-Jacques Lefrère22,23*
Centre National de Référence pour les hépatites B et C en transfusion, Département des Agents Transmissibles par le Sang, Institut National de la Transfusion Sanguine, Paris,1
Laboratoire de Virologie, Centre Hospitalo-Universitaire Pitié-Salpêtrière, Paris,2
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire, Saint-Etienne,3
Laboratoire de Microbiologie, Centre Hospitalo-Universitaire, Brest,4
Université René Descartes, Faculté de Médecine, and AP-HP, Groupe Hospitalier Cochin, Paris,5
Laboratoire de Virologie, Centre Hospitalier Paul Brousse, Villejuif,6
Institut de Biologie, Hôtel Dieu, Nantes,7
Laboratoire de Virologie, Centre Hospitalier, Strasbourg,8
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Bordeaux,9
Laboratoire de Virologie-Bactériologie associé au CNR des hépatites B et C, Centre Hospitalo-Universitaire Avicenne, Bobigny,10
Laboratoire de Virologie, Centre Hospitalier, Annecy,11
Laboratoire de Virologie, Etablissement Français du Sang Bretagne, Brest,12
Laboratoire de Virologie, Centre Hospitalo-Universitaire Bichat, Paris,13
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire Henri-Mondor, Créteil,14
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Clermont-Ferrand,15
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire, Angers,16
Université François Rabelais, Inserm ERI19, Centre Hospitalier Universitaire, Tours,17
Laboratoire de Virologie-Bactériologie, Centre Hospitalo-Universitaire, Limoges,18
Laboratoire de Virologie, Centre Hospitalo-Universitaire Necker, Paris,19
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Amiens,20
Laboratoire de Virologie, Centre Hospitalo-Universitaire, Toulouse,21
Laboratoire d'Hématologie, Centre Hospitalo-Universitaire, Amiens,22
Département des Agents Transmissibles par le Sang, Institut National de la Transfusion Sanguine, Paris, France,23
Received 18 April 2007/
Returned for modification 17 June 2007/
Accepted 15 September 2007
 |
ABSTRACT
|
|---|
This study, involving 20 laboratories and using currently available assays for hepatitis C virus RNA quantification, demonstrated that differences in viral load values are due not to interlaboratory variations but rather to the nature of the assay itself. This underlines the importance of using the same assay in multicenter studies or when monitoring antiviral therapy.
 |
TEXT
|
|---|
In a previous multicenter study designed to assess the expertise of laboratories involved in large-scale therapeutic trials for providing reliable data on hepatitis C virus (HCV) viral loads (VLs) (11), we found a wide heterogeneity of results depending both on the laboratories and on the HCV RNA quantification assays. Since that study, new assays based on real-time (RT) PCR have been developed. These assays are very useful tools for antiviral therapeutic monitoring, because they offer several advantages, including lower limits of detection and larger dynamic ranges of quantification (1-3, 8). Moreover, the availability of automatic platforms makes them attractive for the monitoring of HCV infection, and hence an increasing number of laboratories have decided to introduce these assays for routine use. Thus, a variety of HCV RNA quantification assays are now in use in laboratories that may be involved in large-scale trials. This prompted us to conduct a multicenter study in order to evaluate the expertise of such laboratories for determining HCV VL in this new context.
The panel included 15 samples: 13 samples collected from HCV-infected blood donors (one was represented in duplicate, genotype 2k) and one negative sample. The characteristics of this panel are described in Table 1. For each positive sample, HCV genotype was determined with a method based on the analysis of the NS5b region sequence (9).
The 20 participating laboratories provided a total of 21 results: 9 with bDNA Versant HCV 3.0 (Bayer Healthcare, Eragny, France), 6 with HCV Monitor 2.0 (Roche Diagnostics, Meylan, France), 4 with Cobas Ampliprep/Cobas TaqMan 48 HCV (Roche Diagnostics), and 2 with Abbott RealTime HCV PCR (Abbott Diagnostics, Rungis, France). The two latter assays are based on RT PCR. Table 1 shows the mean VLs obtained with each assay and the related coefficients of variation (CV). No false-positive result was observed for the HCV RNA-negative sample. Although not designed to evaluate specificity, this study confirms that unlike first-generation assays (4), standardized commercial assays, including those based on RNA extraction platforms, guarantee an optimal specificity score.
In contrast to the observation recently made by our working group on hepatitis B virus DNA quantification assays (10), we observed no significant intra-assay differences. Indeed, all HCV RNA quantification assays showed a high reproducibility rate, as evidenced by the low variations observed, irrespective of the VL level and the genotype. As shown in Table 1, the interlaboratory CV ranged from 0.8 to 6.2% (mean, 2.6%) for Bayer bDNA assay, from 0.8 to 10.9% (mean, 3.52%) for the Roche Monitor assay, from 0.5 to 5.3% (mean, 2.25%) for the Cobas TaqMan 48, and from 0.1 to 15.2% (mean, 5.12%) for the Abbott RealTime HCV PCR. The relatively high CV for results from laboratories using the latter assay may suggest interlaboratory variability. As the calculation relied on only two independent values, more extensive studies are needed to assess more accurately the performance of this new method of HCV RNA quantification.
The low interlaboratory CV rate observed for each assay contrasts with the interassay CV, which reached values above 10% (Table 1) for two samples (sample 4, genotype 1b, and sample 12, genotype 4d). Interestingly, as shown in Fig. 1 and in Table 1, the difference between the highest and the lowest VLs for each sample ranged from 0.33 (genotype 4a sample) to 1.95 log10 (genotype 1a). For 12 of the 14 samples, the lowest value was given by the bDNA assay, which was performed by four laboratories, eliminating the hypothesis that differences in laboratory procedure were responsible. Moreover, as depicted in Table 1, the bDNA assay provided significantly lower VLs than Monitor (13 samples) and Cobas TaqMan (11 samples) assays. The two remaining samples were underestimated by Cobas TaqMan 48 (one genotype 4a sample) and Abbott RealTime (one genotype 4d sample). This supports the concern of previous studies about the ability of the new RT PCR assays to correctly quantify samples of genotype 4 (2, 12). However, more studies of genotype 4 are required before a conclusion on the ability of the new RT PCR assays to correctly quantify such samples can be reached. The highest values were obtained in eight cases with the Monitor assay and in six cases with the Cobas TaqMan HCV 48.

View larger version (10K):
[in this window]
[in a new window]
|
FIG. 1. Plot of the mean VLs for each assay. For each sample, means of the VLs (as log10 IU/ml) obtained by all laboratories using the same assay are shown. The upper and lower black squares indicate the extreme individual values, the box shows the 25th and 75th percentiles, and the line within the box indicates the median value. x axis, genotype; y axis, VL.
|
|
Many recent comparative studies of commercially available HCV RNA quantification assays have shown contradictory results, in particular concerning the ability of assays to accurately quantify certain HCV genotypes. A significant underestimation of genotypes 2, 3, 4, and 5 was observed with the Cobas TaqMan 48 when the High Pure system was used for RNA extraction (5, 12). The same RT PCR method used in conjunction with the Cobas Ampliprep sample preparation device was described as having an efficiency equal to that of the Abbott RealTime HCV mostly for genotype 1 samples (7), while it was reported to underestimate genotype 4 VL (2, 12). In another study (8), the Cobas TaqMan provided a poor correlation with Amplicor Roche and Bayer bDNA assays, leading to a 1.5-log10 IU/ml difference in the quantification of the same sample in 5% of the cases. However, this study was based on the use of an extraction device different from those recommended by the manufacturer of this assay. Conflicting results have also been published concerning the performance of the Bayer bDNA assay: some studies have shown a good sensitivity irrespective of genotype (5, 6, 8), while another study demonstrated a constantly lower quantification of genotypes 1 to 3 (12). In comparison with the majority of previous studies, a major asset of our study is the involvement of several laboratories using the same assay; thus, the impact of potential interlaboratory variations on the comparison of the assays was minimized. In this way, we observed a global underestimation of HCV VL with the bDNA assay, since this method gave a mean VL lower than the total mean for all the samples, with a statistically significant difference for six of them (Table 1).
As a whole, these results demonstrate that any laboratory with good expertise in HCV RNA quantification techniques is able to provide reliable VLs when using a given assay. Therefore, the centralization of samples in one single laboratory is not necessary when a multicenter study is carried out. However, the interassay differences, in particular in the extreme VLs, lead us to recommend that the same assay be used in multicenter clinical trials or when the response to therapy in a single patient is being monitored.
 |
ACKNOWLEDGMENTS
|
|---|
This work was supported by a grant from the Agence Nationale de Recherches sur le SIDA et les Virus des Hépatites (ANRS).
We thank Véronique Descamps, Christine Portal, Annie Razer, and Patricia Zawadzki for their technical assistance and Christopher Payan for his helpful advice in the reading of the manuscript.
 |
FOOTNOTES
|
|---|
* Corresponding author. Mailing address: Institut National de la Transfusion Sanguine, 6 rue Alexandre-Cabanel, 75015 Paris, France. Phone: 44 49 30 51. Fax: 44 49 30 59. E-mail: jeanjacqueslefrere{at}wanadoo.fr 
Published ahead of print on 3 October 2007. 
 |
REFERENCES
|
|---|
- Barbeau, J. M., J. Goforth, A. M. Caliendo, and F. S. Nolte. 2004. Performance characteristics of a quantitative TaqMan hepatitis C virus RNA analyte-specific reagent. J. Clin. Microbiol. 42:3739-3746.[Abstract/Free Full Text]
- Caliendo, A. M., A. Valsamakis, Y. Zhou, B. Yen-Lieberman, J. Andersen, S. Young, A. Ferreira-Gonzalez, G. J. Tsongalis, R. Pyles, J. W. Bremer, and N. S. Lurain. 2006. Multilaboratory comparison of hepatitis C virus viral load assays. J. Clin. Microbiol. 44:1726-1732.[Abstract/Free Full Text]
- Forman, M. S., and A. Valsamakis. 2004. Verification of an assay for quantification of hepatitis C virus RNA by use of an analyte-specific reagent and two different extraction methods. J. Clin. Microbiol. 42:3581-3588.[Abstract/Free Full Text]
- French Study Group for the Standardization of Hepatitis C Virus PCR. 1994. Improvement of hepatitis C virus RNA polymerase chain reaction through a multicentre quality control study. J. Virol. Methods 49:79-88.[CrossRef][Medline]
- Gelderblom, H. C., S. Menting, and M. G. Beld. 2006. Clinical performance of the new rRoche COBAS TaqMan HCV test and High Pure system for extraction, detection and quantitation of HCV RNA in plasma and serum. Antivir. Ther. 11:95-103.[Medline]
- Giraldi, C., A. Noto, R. Tenuta, F. Greco, D. Perugini, M. Spadafora, A. M. Bianco, O. Savino, and A. Natale. 2006. A comparative evaluation between real time Roche COBas TAQMAN 48 HCV and bDNA Bayer Versant HCV 3.0. New Microbiol. 29:243-250.[Medline]
- Halfon, P., M. Bourliere, G. Penaranda, H. Khiri, and D. Ouzan. 2006. Real-time PCR assays for hepatitis C virus (HCV) RNA quantitation are adequate for clinical management of patients with chronic HCV infection. J. Clin. Microbiol. 44:2507-2511.[Abstract/Free Full Text]
- Konnick, E. Q., S. M. Williams, E. R. Ashwood, and D. R. Hillyard. 2005. Evaluation of the COBAS hepatitis C virus (HCV) TaqMan analyte-specific reagent assay and comparison to the COBAS Amplicor HCV Monitor V2.0 and Versant HCV bDNA 3.0 assays. J. Clin. Microbiol. 43:2133-2140.[Abstract/Free Full Text]
- Laperche, S., K. Saune, P. Deny, G. Duverlie, S. Alain, M. L. Chaix, C. Gaudy, F. Lunel, J. M. Pawlotsky, C. Payan, B. Pozzetto, C. Tamalet, V. Thibault, S. Vallet, F. Bouchardeau, J. Izopet, and J. J. Lefrere. 2006. Unique NS5b hepatitis C virus gene sequence consensus database is essential for standardization of genotype determinations in multicenter epidemiological studies. J. Clin. Microbiol. 44:614-616.[Abstract/Free Full Text]
- Laperche, S., V. Thibault, F. Bouchardeau, S. Alain, S. Castelain, M. Gassin, M. Gueudin, P. Halfon, S. Larrat, F. Lunel, M. Martinot-Peignoux, B. Mercier, J. M. Pawlotsky, B. Pozzetto, A. M. Roque-Afonso, F. Roudot-Thoraval, K. Saune, and J. J. Lefrere. 2006. Expertise of laboratories in viral load quantification, genotyping, and precore mutant determination for hepatitis B virus in a multicenter study. J. Clin. Microbiol. 44:3600-3607.[Abstract/Free Full Text]
- Lefrère, J. J., F. Roudot-Thoraval, F. Lunel, S. Alain, M. L. Chaix, E. Dussaix, M. Gassin, J. Izopet, J. M. Pawlotsky, C. Payan, F. Stoll-Keller, V. Thibault, M. A. Trabaud, D. Bettinger, M. Bogard, M. Branger, C. Buffet-Janvresse, A. Charrois, C. Defer, C. Laffont, J. Lerable, T. Levayer, M. Martinot-Peignoux, B. Mercier, and A. R. Rosenberg. 2004. Expertise of French laboratories in detection, genotyping, and quantification of hepatitis C virus RNA in serum. J. Clin. Microbiol. 42:2027-2030.[Abstract/Free Full Text]
- Sarrazin, C., B. C. Gartner, D. Sizmann, R. Babiel, U. Mihm, W. P. Hofmann, M. von Wagner, and S. Zeuzem. 2006. Comparison of conventional PCR with real-time PCR and branched DNA-based assays for hepatitis C virus RNA quantification and clinical significance for genotypes 1 to 5. J. Clin. Microbiol. 44:729-737.[Abstract/Free Full Text]
Journal of Clinical Microbiology, November 2007, p. 3788-3790, Vol. 45, No. 11
0095-1137/07/$08.00+0 doi:10.1128/JCM.00825-07
Copyright © 2007, American Society for Microbiology. All Rights Reserved.