Highlights
- •This external validation study included 2963 individuals with HIV/HBV coinfection from 4 European cohorts.
- •Within a median of 9.6 years, 68 patients developed hepatocellular carcinoma (incidence rate 2.58/1000 person-years).
- •Among individuals with HIV/HBV coinfection, PAGE-B (based on age, sex and platelets) showed good model discrimination.
- •A PAGE-B score <10 had a negative predictive value of 99.4% for developing hepatocellular carcinoma within 5 years.
Abstract
Background & Aims
Methods
Results
Conclusions
IMPACT AND IMPLICATIONS
Graphical abstract

Keywords
Potential conflicts of interest
Funding
Authors’ contribution
Data availability statement
Introduction
European AIDS Clinical Society (EACS). Guidelines for the management of people living with HIV 2021. https://www.eacsociety.org/media/final2021eacsguidelinesv11.0_oct2021.pdf (accessed February 25, 2022).
Patients and methods
Study setting and participants
- Scherrer A.U.
- Traytel A.
- Braun D.L.
- Calmy A.
- Battegay M.
- Cavassini M.
- et al.
- Boender T.S.
- Smit C.
- van Sighem A.
- Bezemer D.
- Ester C.J.
- Zaheri S.
- et al.
- Collin A.
- Le Marec F.
- Vandenhende M.-A.
- Lazaro E.
- Duffau P.
- Cazanave C.
- et al.
Outcomes and definitions
Statistical Analyses
Rubin DB. Multiple Imputation for Nonresponse in Surveys. Wiley; 1987. https://doi.org/10.1002/9780470316696.
R Core Team. R: A Language and Environment for Statistical Computing 2022. https://www.R-project.org/(accessed April 4, 2022).
Sensitivity Analyses
Results
Study population
Characteristic | Overall (n = 2963) | Aquitaine (n = 337) | ATHENA (n = 1319) | EuroSIDA (n = 800) | SHCS (n = 507) |
---|---|---|---|---|---|
Male sex | 2477 (84%) | 277 (82%) | 1147 (87%) | 662 (83%) | 391 (77%) |
Age in years (IQR) | 41 (35 to 47) | 42 (37 to 48) | 41 (35 to 48) | 41 (36 to 47) | 40 (35 to 46) |
Caucasian | 2023 (68%) | 289 (86%) | 774 (59%) | 641 (80%) | 319 (63%) |
(Missing) | 69 (2.3%) | 3 (0.9%) | 8 (0.6%) | 58 (7.2%) | 0 (0%) |
Region of Origin | |||||
European or USA | 2023 (68%) | 289 (86%) | 774 (59%) | 641 (80%) | 319 (63%) |
African | 525 (18%) | 41 (12%) | 293 (22%) | 56 (7.0%) | 135 (27%) |
Latin American | 162 (5.5%) | 1 (0.3%) | 148 (11%) | 0 (0%) | 13 (2.6%) |
Asian | 155 (5.2%) | 3 (0.9%) | 96 (7.3%) | 18 (2.2%) | 38 (7.5%) |
Other | 29 (1.0%) | 0 (0%) | 0 (0%) | 27 (3.4%) | 2 (0.4%) |
Unknown | 69 (2.3%) | 3 (0.9%) | 8 (0.6%) | 58 (7.2%) | 0 (0%) |
Transmission Group | |||||
MSM | 1536 (52%) | 159 (49%) | 820 (67%) | 330 (41%) | 227 (47%) |
PWID | 412 (14%) | 62 (19%) | 41 (3.3%) | 234 (29%) | 75 (15%) |
Heterosexual | 783 (26%) | 98 (30%) | 350 (29%) | 156 (20%) | 179 (37%) |
Other | 50 (1.7%) | 8 (2.4%) | 16 (1.3%) | 19 (2.4%) | 7 (1.4%) |
(Missing) | 182 (6.1%) | 10 (3.0%) | 92 (7.0%) | 61 (7.6%) | 19 (3.7%) |
HIV Viral Load | |||||
≥ 200 cp/mL | 1596 (54%) | 146 (43%) | 780 (59%) | 382 (48%) | 288 (57%) |
50 – 199 cp/mL | 190 (6.5%) | 21 (6.2%) | 88 (6.7%) | 57 (7.1%) | 24 (4.7%) |
Below 50 cp/mL | 1018 (34%) | 112 (33%) | 419 (32%) | 298 (37%) | 189 (37%) |
(Missing) | 159 (5.4%) | 58 (17%) | 32 (2.4%) | 63 (7.9%) | 6 (1.2%) |
BMI in kg/m2 | 22.8 (20.8 to 25.1) | 22.3 (20.4 to 24.6) | 22.9 (20.9 to 25.0) | 22.7 (20.8 to 25.1) | 23.0 (20.8 to 25.8) |
(Missing) | 639 (22%) | 92 (27%) | 185 (14%) | 317 (40%) | 45 (8.9%) |
CD4 cell count, cells/μL (IQR) | 323 (182 to 510) | 376 (196 to 584) | 310 (170 to 490) | 346 (210 to 531) | 314 (198 to 472) |
(Missing) | 181 (6.1%) | 60 (18%) | 32 (2.4%) | 83 (10%) | 6 (1.2%) |
Diabetes | 183 (6.2%) | 38 (11%) | 82 (6.2%) | 39 (4.9%) | 24 (4.7%) |
Liver cirrhosis | 314 (11%) | 27 (9.9%) | 129 (15%) | 94 (12%) | 64 (16%) |
ALT at baseline in IU/L (IQR) | 41 (25 to 79) | 38 (24 to 70) | 47 (26 to 134) | 39 (25 to 69) | 39 (25 to 65) |
(Missing) | 731 (25%) | 60 (18%) | 444 (34%) | 191 (24%) | 36 (7.1%) |
Platelets in G/L (IQR) | 190 (141 to 236) | 194 (144 to 235) | 188 (133 to 235) | 192 (152 to 233) | 190 (148 to 239) |
(Missing) | 1063 (36%) | 76 (23%) | 560 (42%) | 406 (51%) | 21 (4.1%) |
Platelet count category | |||||
≥ 200 G/L | 859 (25%) | 121 (36%) | 347 (26%) | 175 (22%) | 216 (43%) |
100-199 G/L | 828 (28%) | 102 (30%) | 325 (25%) | 179 (22%) | 222 (46%) |
<100 G/L | 213 (7.2%) | 38 (11%) | 87 (6.6%) | 40 (5%) | 48 (9.5%) |
(Missing) | 1063 (36%) | 76 (23%) | 560 (42%) | 406 (51%) | 21 (4.1%) |
HDV coinfection | 147 (5%) | 15 (17%) | 13 (9.4%) | 69 (8.6%) | 50 (11%) |
(Missing) | 1941 (66%) | 250 (74%) | 1180 (89%) | 451 (56%) | 60 (12%) |
HCV coinfection | 274 (9.2%) | 22 (6.5%) | 51 (3.9%) | 157 (20%) | 44 (8.7%) |
HBeAg-positivity | 799 (27%) | 106 (50%) | 515 (45%) | 26 (3.2%) | 152 (55%) |
(Missing) | 1277 (43%) | 124 (37%) | 167 (13%) | 756 (94%) | 230 (45%) |
XTC use before TFV | 1629 (55%) | 211 (63%) | 584 (44%) | 550 (69%) | 284 (56%) |
Prior XTC in years (IQR) | 3.7 (0.0 to 8.2) | 3.8 (0.0 to 7.2) | 0.0 (0.0 to 6.0) | 5.2 (0.0 to 8.1) | 9.9 (5.2 to 15.1) |
Follow-up on TFV in years (IQR) | 9.6 (4.9 to 13.3) | 10.8 (5.6 to 15.0) | 9.7 (5.3 to 13.1) | 8.4 (3.8 to 12.3) | 10.3 (5.2 to 14.3) |
Occurrence of HCC
PAGE-B model validation


PAGE-B Category | Years | N at risk | Cumulative N (Cumulative Incidence) of HCCs | Cumulative Incidence of Original Publication | |||
---|---|---|---|---|---|---|---|
Complete case | Imputation | Complete case | Imputation | Derivation | Validation | ||
Score <10 | 1 | 480 | 734 | 1 (0.2%) | 1 (0.1%) | 0% | 0% |
2 | 449 | 694 | 1 (0.2%) | 1 (0.1%) | 0% | 0% | |
3 | 412 | 651 | 1 (0.2%) | 1 (0.1%) | 0% | 0% | |
5 | 357 | 573 | 2 (0.5%) | 2 (0.3%) | 0% | 0% | |
10 | 216 | 358 | 2 (0.5%) | 2 (0.3%) | n.r. | n.r. | |
15 | 79 | 131 | 4 (2.5%) | 4 (1.5%) | n.r. | n.r. | |
Score 10-17 | 1 | 1001 | 1625 | 1 (0.1%) | 1 (0.1%) | 0% | 0% |
2 | 937 | 1534 | 3 (0.3% | 8 (0.5%) | 1% | 1% | |
3 | 877 | 1442 | 5 (0.5%) | 10 (0.6%) | 1% | 1% | |
5 | 794 | 1319 | 8 (0.9%) | 14 (0.9%) | 3% | 4% | |
10 | 490 | 863 | 13 (1.6%) | 21 (1.5%) | n.r. | n.r. | |
15 | 147 | 279 | 15 (2.2%) | 26 (2.3%) | n.r. | n.r. | |
Score ≥18 | 1 | 268 | 426 | 5 (1.8%) | 6 (1.4%) | 3% | 3% |
2 | 247 | 396 | 8 (2.9%) | 9 (2.1%) | 6% | 5% | |
3 | 217 | 356 | 12 (4.6%) | 15 (3.7%) | 9% | 8% | |
5 | 185 | 311 | 14 (5.6%) | 20 (5.2%) | 17% | 16% | |
10 | 92 | 175 | 22 (11.2%) | 32 (10.1%) | n.r. | n.r. | |
15 | 28 | 52 | 24 (14.4%) | 38 (16.0%) | n.r. | n.r. |
Sensitivity analyses
Screening cut-off

Discussion
European AIDS Clinical Society (EACS). Guidelines for the management of people living with HIV 2021. https://www.eacsociety.org/media/final2021eacsguidelinesv11.0_oct2021.pdf (accessed February 25, 2022).
European AIDS Clinical Society (EACS). Guidelines for the management of people living with HIV 2021. https://www.eacsociety.org/media/final2021eacsguidelinesv11.0_oct2021.pdf (accessed February 25, 2022).
Acknowledgments
Appendix A. Supplementary data
References
- The contributions of hepatitis B virus and hepatitis C virus infections to cirrhosis and primary liver cancer worldwide.J Hepatol. 2006; 45: 529-538https://doi.org/10.1016/j.jhep.2006.05.013
- Surveillance for Hepatocellular Carcinoma: Current Best Practice and Future Direction.Gastroenterology. 2019; 157: 54-64https://doi.org/10.1053/j.gastro.2019.02.049
- Compliance With Hepatocellular Carcinoma Surveillance Guidelines Associated With Increased Lead-Time Adjusted Survival of Patients With Compensated Viral Cirrhosis: A Multi-Center Cohort Study.Gastroenterology. 2018; 155 (e10): 431-442https://doi.org/10.1053/j.gastro.2018.04.027
- Low compliance with hepatocellular carcinoma screening guidelines in hepatitis B/C virus co-infected HIV patients with cirrhosis.J Viral Hepat. 2019; 26: 1224-1228https://doi.org/10.1111/jvh.13146
- Surveillance for hepatocellular carcinoma in people of African ancestry with HIV and Hepatitis B.Int J STD AIDS. 2022; 33: 202-204https://doi.org/10.1177/09564624211042828
- Incidence of hepatocellular carcinoma in HIV/HBV-coinfected patients on tenofovir therapy: Relevance for screening strategies.J Hepatol. 2019; 71: 274-280https://doi.org/10.1016/j.jhep.2019.03.032
- PAGE-B predicts the risk of developing hepatocellular carcinoma in Caucasians with chronic hepatitis B on 5-year antiviral therapy.J Hepatol. 2016; 64: 800-806https://doi.org/10.1016/j.jhep.2015.11.035
- Clinical Practice Guidelines on the management of hepatitis B virus infection.J Hepatol. 2017; 67: 370-398https://doi.org/10.1016/j.jhep.2017.03.021
European AIDS Clinical Society (EACS). Guidelines for the management of people living with HIV 2021. https://www.eacsociety.org/media/final2021eacsguidelinesv11.0_oct2021.pdf (accessed February 25, 2022).
- Cohort Profile Update: The Swiss HIV Cohort Study (SHCS).Int J Epidemiol. 2022; 51 (33–34j)https://doi.org/10.1093/ije/dyab141
- AIDS Therapy Evaluation in the Netherlands (ATHENA) national observational HIV cohort: cohort profile.BMJ Open. 2018; 8e022516https://doi.org/10.1136/bmjopen-2018-022516
- Incidence and Risk Factors for Severe Bacterial Infections in People Living with HIV. ANRS CO3 Aquitaine Cohort, 2000-2012.PLoS One. 2016; 11e0152970https://doi.org/10.1371/journal.pone.0152970
- The EuroSIDA study: 25 years of scientific achievements.HIV Med. 2020; 21: 71-83https://doi.org/10.1111/hiv.12810
- Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement.Ann Intern Med. 2015; 162: 55-63https://doi.org/10.7326/M14-0697
- External validation of a Cox prognostic model: principles and methods.BMC Med Res Methodol. 2013; 13: 33https://doi.org/10.1186/1471-2288-13-33
- AASLD guidelines for the treatment of hepatocellular carcinoma.Hepatology. 2018; 67: 358-380https://doi.org/10.1002/hep.29086
- Estimating and comparing time-dependent areas under receiver operating characteristic curves for censored event times with competing risks.Stat Med. 2013; 32: 5381-5397https://doi.org/10.1002/sim.5958
- mice: Multivariate Imputation by Chained Equations in R.J Stat Softw. 2011; 45: 1-67https://doi.org/10.18637/jss.v045.i03
Rubin DB. Multiple Imputation for Nonresponse in Surveys. Wiley; 1987. https://doi.org/10.1002/9780470316696.
- Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines.BMC Med Res Methodol. 2009; 9: 57https://doi.org/10.1186/1471-2288-9-57
R Core Team. R: A Language and Environment for Statistical Computing 2022. https://www.R-project.org/(accessed April 4, 2022).
- Welcome to the tidyverse.J Open Source Softw. 2019; 4: 1686https://doi.org/10.21105/joss.01686
- Hepatocellular Carcinoma Occurs at an Earlier Age in Africans, Particularly in Association With Chronic Hepatitis B.Am J Gastroenterol. 2015; 110: 1629-1631https://doi.org/10.1038/ajg.2015.289
- EASL Clinical Practice Guidelines: Management of hepatocellular carcinoma.J Hepatol. 2018; 69: 182-236https://doi.org/10.1016/j.jhep.2018.03.019
- Prediction of long-term clinical outcome in a diverse chronic hepatitis B population: Role of the PAGE-B score.J Viral Hepat. 2017; 24: 1023-1031https://doi.org/10.1111/jvh.12727
- Validation of PAGE-B model in Asian chronic hepatitis B patients receiving entecavir or tenofovir.Liver Int. 2017; 37: 1788-1795https://doi.org/10.1111/liv.13450
- Reassessing the accuracy of PAGE-B-related scores to predict hepatocellular carcinoma development in patients with chronic hepatitis B.J Hepatol. 2020; 72: 847-854https://doi.org/10.1016/j.jhep.2019.12.005
- Risk of HCC With Hepatitis B Viremia Among HIV/HBV-Coinfected Persons in North America.Hepatology. 2021; 74: 1190-1202https://doi.org/10.1002/hep.31839
- Impact of country of birth on age at the time of diagnosis of hepatocellular carcinoma in the United States.Cancer. 2017; 123: 81-89https://doi.org/10.1002/cncr.30246
- Characteristics, management, and outcomes of patients with hepatocellular carcinoma in Africa: a multicountry observational study from the Africa Liver Cancer Consortium.Lancet Gastroenterol Hepatol. 2017; 2: 103-111https://doi.org/10.1016/S2468-1253(16)30161-3
- Sample size considerations for the external validation of a multivariable prognostic model: a resampling study.Stat Med. 2016; 35: 214-226https://doi.org/10.1002/sim.6787
- Hepatitis delta-associated mortality in HIV/HBV-coinfected patients.J Hepatol. 2017; 66: 297-303https://doi.org/10.1016/j.jhep.2016.10.007
Article info
Publication history
Publication stage
In Press Journal Pre-ProofIdentification
Copyright
User license
Creative Commons Attribution (CC BY 4.0) |
Permitted
- Read, print & download
- Redistribute or republish the final article
- Text & data mine
- Translate the article
- Reuse portions or extracts from the article in other works
- Sell or re-use for commercial purposes
Elsevier's open access license policy