ABSTRACT
Hepatitis B virus (HBV) infection is a leading cause of death in sub-Saharan Africa (SSA). Point-of-care tests for hepatitis B surface antigen (HBsAg) could be an ideal tool for a large-scale HBV screening/treatment program in SSA. Using data from the PROLIFICA (Prevention of Liver Fibrosis and Cancer in Africa) program, we conducted a cross-sectional study to assess the diagnostic accuracy of three point-of-care tests (Determine, Vikia, and Espline) for the detection of HBsAg in the field or a laboratory setting in the Gambia. In the field, we used finger-prick whole blood for the Determine and Vikia tests and dried blood spots for the reference standard test (AxSYM HBsAg enzyme-linked immunosorbent assay [ELISA]). In the laboratory we used serum for the Determine, Espline, and reference test (Architect chemiluminescent microparticle immunoassay). Of 773 participants recruited at the community and 227 known chronic HBV carriers (1,000 subjects in total), 293 were positive for HBsAg. The sensitivity and specificity of the Determine test were 88.5% and 100% in the field and 95.3% and 93.3% in the laboratory setting, respectively. The sensitivity and specificity were 90.0% and 99.8% for the Vikia test (in the field) and 93.9% and 94.7% for the Espline test (in the laboratory). There was no evidence that one kit was better than another. Most of the patients with false-negative results (18/19) were classified as inactive chronic carriers. In summary, the three point-of-care tests had acceptable ranges of diagnostic accuracy. These tests may represent accurate, rapid, and inexpensive alternatives to serology testing for the screening of HBV infection at field level in SSA.
INTRODUCTION
Sub-Saharan Africa (SSA) is an area of high endemicity for hepatitis B virus (HBV) infection, particularly in West Africa, where the prevalence of hepatitis B surface antigen (HBsAg) may exceed 8% (1). HBV is the main cause of hepatocellular carcinoma (HCC), one of the most frequent cancers in SSA and the leading cause of cancer deaths in West African males (2, 3). Despite a highly effective vaccine, people who had established chronic HBV infection before the immunization program are left with a high risk of developing HCC (4). Therefore, immunization alone is not sufficient to control HBV infection (5). To reduce the burden of HBV-related liver diseases and HCC in SSA, identifying infected subjects is essential (5). Yet screening for HBV infection and access to care and treatment are sorely lacking in SSA, where the vast majority of infected individuals are unaware of their serological status.
HBsAg is a key marker for the diagnosis of HBV infection. An enzyme-linked immunosorbent assay (ELISA) is the gold standard to detect HBsAg but requires a high-quality laboratory, expensive equipment, cold storage, well-trained technicians, and a sustained supply of electricity (6). In contrast, point-of-care (POC) tests are easier to use and inexpensive compared with ELISA. In addition, some POC tests accommodate not only serum or plasma but also whole blood collected by finger stick, which can avoid a phlebotomy. Recently, two systematic reviews of POC tests for HBsAg detection confirmed their excellent diagnostic accuracy (6, 7). Taken together, HBsAg POC tests seem suitable for community-based and large-scale screening. However, most of the studies which validated their performance were done at the facility level and among specific populations, i.e., blood donors (8–10), hospital patients (11–13), or HIV-infected people (14–18). Although one study in France investigated the accuracy of HBsAg POC tests in the general population, the tests were performed in health centers using whole blood collected by venipuncture (19).
The ongoing PROLIFICA (Prevention of Liver Fibrosis and Cancer in Africa [www.prolifica.eu and https://clinicaltrials.gov/ct2/show/record/NCT02129829; accessed 10 January 2015]) program aims to demonstrate that HBsAg screening at the community level and provision of antiviral treatment decrease the incidence of HCC in West Africa. Within this project, the diagnostic accuracy of three POC tests (Determine, Vikia, and Espline) was estimated, both in the field (using whole blood through finger prick) and laboratory (using serum), and the characteristics of individuals with false-negative results were identified.
MATERIALS AND METHODS
Study participants.We collected the data from three studies within the PROLIFICA program in the Gambia. These studies were approved by the Gambia Government/Medical Research Council (MRC) Joint Ethics Committee (L2013.14) and were conducted in agreement with the principles of the Declaration of Helsinki.
Study 1.From January to December 2012, the PROLIFICA program screened for HBsAg 3,068 adults living in 27 randomly selected local communities using the Determine POC test (Alere, USA). After a community sensitization meeting, a screening site was set up at the center of each community; this could be at a school, mosque, or bantaba (local community gathering space in the open air). Following written consent, Determine was performed using whole blood from finger prick at the screening site. Dried blood spots (DBS) were also collected from all the study participants. The result of the POC test was available within 15 min, and posttest counseling was provided on site. Of the 3,068 DBS collected at the community screening, 10% were randomly selected to be tested with the AxSYM HBsAg ELISA (Abbott, USA) as a reference standard for HBsAg detection and included in the current validation study. The selection was made irrespective of the result of the Determine test. All participants positive by the Determine test and people with false-negative results (nonreactive Determine test but positive ELISA) were invited for a standardized liver assessment at the liver clinic at the MRC. This included physical examination, abdominal ultrasound, transient elastography (FibroScan; Echosens, France), measurement liver function (Vitros 350 Analyzer; Ortho, USA), hepatitis B e antigen (HBeAg) ELISA (ETI-EBK Plus; DiaSorin, Italy), anti-hepatitis C virus (HCV) (AxSYM, anti-HCV; Abbott, USA) and anti-hepatitis D virus (HDV) (ETI-AB-Deltak-2; DiaSorin, Italy) assays, anti-HIV enzyme immunoassay (EIA) (Genscreen Ultra; Bio-Rad, USA), and quantification of HBV DNA and HBsAg using serum.
Study 2.Between August and November 2013, 489 adults living in six randomly selected communities (different from those of study 1) in the Gambia were screened in the field for HBsAg using two POC tests at the same time: Determine and Vikia (bioMérieux, France). DBS were also collected during the screening, and all the DBS were tested by AxSYM HBsAg ELISA. All participants positive for at least one of HBsAg tests (Determine, Vikia, or AxSYM HBsAg ELISA) were invited for liver assessment as described above.
Study 3.Following historical community sero-surveys for HBV infection conducted in rural villages (different from those in studies 1 and 2) in the Gambia in the 1980s (20, 21), there was a cohort of 405 chronic HBV carriers who had been regularly followed for HBV serology. Between May 2012 and April 2014, 301 known chronic HBV carriers agreed to take part in the liver assessment of the PROLIFICA program. After the venipuncture at the liver clinic, serum samples were quantified for HBsAg using a chemiluminescent microparticle immunoassay (CMIA) (Architect; Abbott, USA). The first 227 consecutive serum samples from the same visit were also tested by POC tests in the laboratory, either with Determine or Espline (Fujirebio, Japan), and were included in this validation study.
Rapid POC tests.The Determine, Vikia, and Espline POC tests were evaluated for their diagnostic accuracy to detect HBsAg using finger-stick whole-blood samples (Determine in studies 1 and 2 and Vikia in study 2) or serum (Determine and Espline in study 3). When a test was invalid, it was repeated until a valid result was obtained. The frequency of the invalid result was recorded in study 2.
Fieldworkers had 2 days of training for the use and storage of POC tests according to the manufacturers' instructions. In study 2, results of the POC tests were read and recorded independently by one laboratory staff member and one fieldworker; only results on which the two readers agreed were included. In contrast, the results were read by one fieldworker in study 1 and by one laboratory technician in study 3.
DBS.Five drops of finger-stick whole blood were absorbed onto a filter paper (Whatman 903) which was dried for 2 h in the field and then overnight at room temperature at the MRC laboratory and eventually stored in plastic bags with desiccant at room temperature. A 6-mm disc was punched from the dried blood spots (DBS), and elutes were obtained according to the manufacturer's instructions and stored at −20°C.
Reference standard tests for HBsAg detection.For study 1 and 2, the AxSYM HBsAg ELISA was performed as a reference standard on whole-blood samples eluted from DBS. Positive results were confirmed by neutralization assay as per the manufacturer's instructions. For study 3, sera were quantified for HBsAg using Architect HBsAg CMIAs. All the samples with ≥0.05 IU/ml were classified as positive for HBsAg, according to the manufacturer's protocol. Laboratory technicians were blinded to the results of the POC tests.
HBsAg quantification.HBsAg quantification was performed using a CMIA (Architect, Abbott, USA). A 1:500 dilution of samples was performed when the initial value exceeded 250 IU/ml. All samples were run in duplicate.
HBV DNA quantification.HBV DNA was extracted from serum with a Qiagen kit (Qiagen, Hilden, Germany), and a quantitative in-house PCR assay was run using an ABI 5700 sequence detection system. Quality control was ensured by a French laboratory (INSERM, Lyon, France).
Transient elastography.Liver stiffness measurement (LSM) was performed using FibroScan according to previously described technical and examination procedures (22) under fasting conditions (23). For assessing the severity of the liver fibrosis, we used previously published cutoffs (24).
Statistical analysis.Results of POC tests were compared to the result of ELISAs (studies 1 and 2) or CMIAs (study 3). Sensitivity, specificity, positive and negative predictive values, and positive and negative likelihood ratios were estimated. The areas under the receiver operating characteristic curves (AUROC) were obtained and compared between POC tests using a test of equality of AUROC. Interrater reliability was determined using the kappa statistic in study 2. Clinical and virological characteristics of study participants with false-negative results (i.e., with at least one negative POC but a positive result with the reference standard) were compared with those of participants with true-positive results (i.e., positive results from both POC and the reference standard). Age, quantified HBsAg levels, HBV DNA levels, alanine aminotransferase (ALT) levels, and LSM results are presented as medians (range), and comparison was made using a Wilcoxon rank sum est. The proportion of males and participants with positive HBeAg was compared between true positives and false negatives using Fisher's exact test. For these comparisons, participants in studies 1 and 2 were combined. All the analyses were performed using STATA, version 11.0 (Stata Corporation, College Station, TX). This study was reported in accordance with the standards for reporting of diagnostic accuracy (STARD) checklists (25).
RESULTS
Study participants.A total of 1,000 participants from the three studies were included in the analysis (296 participants in study 1, 477 in study 2, and 227 in study 3). In study 1, a total of 3,068 people were screened using Determine, and from these 10% of participants (307) were randomly selected. Eleven DBS were lost, and thus 296 DBS were tested by HBsAg ELISA and included in the analysis. The median age of the subjects was 40 years (range, 30 to 105 years), and 113 subjects (38.2%) were male. In study 2, both the Determine and Vikia tests were performed in 489 people. As 12 DBS were lost, 477 DBS were tested by HBsAg ELISA; the median age of the subjects was 43 years (range, 30 to 103 years), and 176 subjects (36.9%) were male. In study 3, both POC tests (either Determine, Espline, or both) and HBsAg serology were performed in 227 subjects. Their median age was 37 years (range, 14 to 79), and 97 (42.7%) were male.
Invalid POC results (study 2).Successful results were obtained for 100% (477/477) and 99.8% (476/477) on the first attempt with the Determine and Vikia tests, respectively. One participant with an invalid Vikia test had negative result on a subsequent prick. Both the Determine test and HBsAg ELISA for this participant were negative.
Interrater reliability (study 2).Interrater agreement (κ value) was 1.00 for the Determine test and 0.99 for Vikia. There was one disagreement about the reading of a Vikia result, and this participant was finally tested negative by ELISA. This discordant result was excluded from the subsequent analysis.
Diagnostic accuracy.Diagnostic accuracy of each POC test is presented in Table 1 (for field setting, studies 1 and 2) and Table 2 (for laboratory setting, study 3). The AUROC did not vary significantly by POC: the values in the field were 0.942 (95% confidence interval [CI], 0.911 to 0.973) and 0.949 (95% CI, 0.910 to 0.987) for Determine and Vikia, respectively; in the laboratory setting, the values were 0.943 (95% CI, 0.894 to 0.992) and 0.943 (95% CI, 0.903 to 0.984) for Determine and Espline, respectively. In studies 1 and 2, the lowest serum HBsAg levels quantified by Architect that showed reactivity in the Determine and Vikia tests were 26.5 IU/ml (Table 3), while in study 3 the lowest levels that showed reactivity in the Determine and Espline tests were 2.8 IU/ml (Table 4).
Diagnostic accuracy of Determine and Vikia tests in field settings (studies 1 and 2)
Diagnostic accuracy of Determine and Espline tests in laboratory settings (study 3)
Characteristics of HBsAg-positive participants according to the results of Determine and Vikia tests in studies 1 and 2a
Characteristics of HBsAg-positive participants according to the results of Determine and Espline in study 3a
Characteristics of participants with false-negative results.Of 1,000 participants examined for the POC validation, 293 were found to carry HBsAg using the reference standard tests, and there were 23 (2.3%) participants with false-negative results: five by the Determine test in study 1, one by Determine and six by both the Determine and Vikia tests in study 2, and one by Determine, four by Espline, and six by both the Determine and Espline tests in study 3 (Tables 3 and 4). Of 23 participants with false-negative results, four in studies 1 and 2 declined to have a liver assessment at the MRC clinic, leaving 8 and 11 subjects for the subsequent analysis for factors associated with false negativity in the field (studies 1 and 2) and laboratory (study 3) settings, respectively.
In the field studies, subjects with false negatives were more likely to be female (P = 0.05), with lower HBsAg levels (P = 0.0002) and lower ALT levels (P = 0.01) than subjects with true-positive results (Table 4). In the laboratory study, subjects with false negatives were older (P = 0.04) and had lower HBsAg (P < 0.0001) and ALT levels (P = 0.01) than true-positive participants (Table 4). None of subjects with false negatives were positive for HBeAg or had an ALT over the normal range (>40 IU/ml), and only one had a high viral load (>2,000 IU/ml), implying that the vast majority (94.7%, 18/19) of subjects with false-negative results were inactive carriers (26). However, POC tests missed four participants with an elevated LSM over 7.2 kPa. Three of these subjects were even in a precirrhotic range (subjects EG0203, EG0444, and EG0783). There was no HIV, HCV, or HDV coinfection in HBsAg-positive participants in studies 1 and 2 while three HBsAg-positive patients in study 3 were also positive for HIV (two with HIV-1 and one with HIV-2). They were all treatment naive and were reactive for the Determine and Espline tests. Their viral loads ranged from <50 to 18,000 IU/ml, and HBsAg levels ranged from 7 to 2,334 IU/ml.
DISCUSSION
Numerous HBsAg POC tests using immunochromatographic assays have been commercialized worldwide. However, the majority of these tests were evaluated under laboratory conditions using serum or plasma. Only a few studies assessed the performance of these tests using whole blood from venipuncture (9, 12, 16, 17, 19); none of them used capillary blood from finger prick in the field.
We studied the diagnostic accuracy of POC tests in both community (using whole blood from finger prick) and laboratory (using serum) settings. Our study found the following: (i) an acceptable range of diagnostic accuracy of the three tests in both the field and laboratory settings; (ii) a minimum clinical impact of the low sensitivity of these tests as false negatives were inactive carriers; (iii) excellent interrater reliability; and (iv) infrequent invalid results.
These tests are widely used and have been assessed in various studies (Table 5). In 2012, a meta-analysis reported high performance of the Determine test, with a pooled sensitivity at 98.2% (95% credible interval [CrI], 94.7 to 99.9%) and a specificity at 99.9% (95% CrI, 99.3 to 100%) (6). However, other studies cast doubt on the Determine test's high sensitivity (13, 15, 16). Sensitivity was generally acceptable, ranging from 93.6 to 100% (except in one study [10]), in HIV-negative individuals (Table 5). However, in HIV-infected individuals results were conflicting; unsatisfactory sensitivity (55.9 to 75.0%) was observed in Malawi, Ghana, and South Africa while in Tanzania and United Kingdom sensitivity was 96.0 to 100% (14, 17). Lamivudine- or tenofovir-based antiretroviral therapy may reduce HBsAg levels in coinfected people and may explain the heterogeneous sensitivity among HIV-infected individuals (17). However, a recent study assessing another HBsAg POC test in HIV-infected people in Guinea-Bissau failed to find an association between a history of lamivudine therapy and false negativity (18). In our study, most of participants were not HIV infected and none of them received HBV antiviral therapy. The sensitivities of the Determine test (88.5% [95% CI, 80.7 to 93.9%] in the field and 95.3% [95% CI, 90.5 to 98.1%] in the laboratory) were within the range reported in HIV-uninfected individuals.
Studies assessing the accuracy of the Determine, Vikia, and Espline HBsAg tests
To date, the Vikia test has been validated in parallel with Determine in two studies. Both studies found similar sensitivities in Vikia and Determine: 70.7% and 69.3% in Ghana and 96.5% and 93.6% in France, respectively (15, 19). Similarly, we did not find a significant difference in sensitivities between the Vikia and Determine tests in study 2 (90.0% and 88.3%, respectively). One discordant result (Vikia-positive and Determine-negative result) was observed in an HBsAg-positive participant with a very low serum HBsAg level at 14.6 IU/ml (subject EG0865).
Previously, only one study has assessed the diagnostic accuracy of the Espline test and reported sensitivity of 94.7% and specificity of 100% (11), values which were similar to our findings.
It has been reported that false-negative results of HBsAg POC tests are associated with a low HBsAg concentration, HBsAg mutants, low viral load, and certain viral genotypes (10, 15, 19, 27). Although the number of subjects with false-negative results in our study was small, subjects with false negatives tend to have inactive disease and lower HBsAg levels than subjects with true-positive results, suggesting a low clinical impact of the low sensitivity of these tests. However, of 23 subjects with false-negative results, 4 (17%) were found to have elevated LSM values by transient elastography, implying that a POC test is not a perfect tool to rule out HBV-infected individuals who require antiviral therapy due to advanced liver fibrosis in SSA.
Our study has several limitations. First, we could not obtain HBV genetic information on the HBVs in order to relate a specific mutation or viral genotype to false-negative results.
Second, we used DBS as a medium for the reference standard instead of serum or plasma. The diagnostic accuracy of HBsAg detection (ELISA) using DBS compared to the accuracy with serum or plasma has been assessed in the past and found to be very good, with sensitivity and specificity at 96 to 100% and at 97 to 100%, respectively (28–30).
Currently, WHO is calling for urgent action to reduce the burden of viral hepatitis and is designing HBV guidelines for screening and treatment in low- and middle-income countries (31). This study provides important evidence to support the feasibility of a large-scale community screening program for HBV in SSA by showing acceptable diagnostic accuracy of inexpensive (<$2) HBsAg rapid POC tests using finger prick in a real community environment.
ACKNOWLEDGMENTS
We thank the Medical Research Council Laboratories in the Gambia, the local Ministry of Health and Social Welfare for supporting the project, all the study participants, and the PROLIFICA team, in particular, Ignatius Baldeh, Famara Bojang, Amie Ceesay, Mavis Foster-Nyarko, Debbo Jallow, Abdoulie Jatta, Adam Jeng, Sheriff Kolley, Yamundow Jallow Samba, Alagie Sanneh, Demba Sonko, Penda Suso, and Saydiba Tamba. We also thank Debbie Garside, the project manager of the PROLIFICA project.
This study is part of the PROLIFICA program funded by the European commission (EC FP7, P34114).
We have no conflict of interest related to this study.
FOOTNOTES
- Received 20 October 2014.
- Returned for modification 28 November 2014.
- Accepted 20 January 2015.
- Accepted manuscript posted online 28 January 2015.
- Copyright © 2015, American Society for Microbiology. All Rights Reserved.