Noninvasive Models to Predict Liver Fibrosis in Patients with Chronic Hepatitis B: A Study from Turkey

authors:

avatar Pinar Korkmaz 1 , * , avatar Nese Demirturk 2 , avatar Ayse Batırel 3 , avatar Ahmet Cem Yardimci 4 , avatar Unal Cagir 5 , avatar Salih Atakan Nemli 6 , avatar Fatime Korkmaz 7 , avatar Fusun Zeynep Akcam 8 , avatar Huseyin Sener Barut 9 , avatar Burcu Bayrak 10 , avatar Faruk Karakecili 11 , avatar Huseyin Tarakci 12 , avatar Zerrin Yulugkural 13 , avatar Esma Yuksel 14 , avatar Nazlım Aktug Demir 15 , avatar Onur Ural 15 , avatar Sua Sumer 15 , avatar Rezan Harman 16 , avatar Ayten Kadanali 17 , avatar Sinan Ozturk 17 , avatar Sila Cetin Akhan 18 , avatar Necla Eren Tulek 19 , avatar Derya Keten 20 , avatar Alper Sener 21 , avatar Bilgehan Aygen 22 , avatar Aysel Kocagul Celikbas 23 , avatar Fatma Yilmaz Karadag 24 , avatar Gule Aydin 25 , avatar Eyup Arslan 26 , avatar Cahide Sacligil 27 , avatar Gulfem Akengin Ocal 27 , avatar Alpaslan Tanoglu 28 , avatar Asim Ulcay 29 , avatar Ergenekon Karagoz 29 , avatar Nese Saltoglu 30 , avatar Fatma Sırmatel 31 , avatar Hayrettin Akdeniz 31 , avatar Aynur Aynıoglu 32 , avatar Selcan Arslan Ozel 33 , avatar Selmin Dirgen Caylak 34 , avatar Ilhami Celik 35 , avatar Yesim Alpay 36 , avatar Zehra Bestepe Dursun 35 , avatar Muhammed Bekcibasi 37 , avatar Gunay Tuncer Ertem 19 , avatar Arzu Tigli 38 , avatar Elif Sargin Altunok 39 , avatar Kemal Avsar 38 , avatar Kaya Suer 40 , avatar Murat Sayan 41

Dumlupinar University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Kutahya, Turkey
Afyon Kocatepe University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Afyon, Turkey
Kartal Dr. Lutfi Kırdar Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey
Sanliurfa Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Sanlıurfa, Turkey
Nevsehir State Hospital, Department of Infectious Diseases and Clinical Microbiology, Nevsehir, Turkey
Izmir Katip Celebi University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Izmir, Turkey
Konya Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Konya, Turkey
Suleyman Demirel University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Isparta, Turkey
Gaziosmanpasa University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Tokat, Turkey
Istanbul Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey
Erzincan University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Erzincan, Turkey
Izmir Metropolitan Municipality Esrefpasa State Hospital, Department of Infectious Diseases and Clinical Microbiology, Izmir, Turkey
Trakya University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Edirne, Turkey
Karsikaya State Hospital, Department of Infectious Diseases and Clinical Microbiology, Izmir, Turkey
Selcuk University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Konya, Turkey
Private Sanko Hospital, Department of Infectious Diseases and Clinical Microbiology, Gaziantep, Turkey
Health Sciences University Umraniye Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey
Kocaeli University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology
Ankara Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Ankara, Turkey
Kahramanmaras Necip Fazıl City Hospital, Department of Infectious Diseases and Clinical Microbiology
Canakkale Onsekiz Mart University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Canakkale, Turkey
Erciyes University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Kayseri, Turkey
Ankara NumuneTraining and Research Hospital, Department of Infectious Diseases and Clinical Microbiology,Ankara, Turkey
Istanbul Medeniyet University Goztepe Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey
Afyon State Hospital, Department of Infectious Diseases and Clinical Microbiology, Afyon, Turkey
Diyarbakir Selahaddin Eyyubi State Hospital, Department of Infectious Diseases and Clinical Microbiology, Diyarbakır, Turkey
Kartal Yavuz Selim State Hospital, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey
Istanbul Sultan Abdulhamid HanTraining Hospital, Department of Gastroenterology, Istanbul, Turkey
Istanbul Sultan Abdulhamid Han Training Hospital, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey
Cerrahpasa University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Istanbul, Turkey.
Abant Izzet Baysal University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Bolu, Turkey
Zonguldak Ataturk State Hospital, Department of Infectious Diseases and Clinical Microbiology, Zonguldak, Turkey
Derince Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Kocaeli, Turkey
Mugla Sıtkı Koçman University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Mugla, Turkey
Kayseri Training and Research Hospital, Department of Infectious Diseases and Clinical Microbiology, Kayseri, Turkey
Balikesir University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Balikesir, Turkey
Bismil StateHospital, Department of Infectious Diseases and Clinical Microbiology, Diyarbakır, Turkey
Isparta State Hospital, Department of Infectious Diseases and Clinical Microbiology, Isparta, Turkey
Bitlis State Hospital, Department of Infectious Diseases and Clinical Microbiology, Bitlis, Turkey
Yakın Dogu University Faculty of Medicine, Department of Infectious Diseases and Clinical Microbiology, Nicosia, TRNC
Kocaeli University Faculty of Medicine, Department of Microbiology, Kocaeli, Turkey, Near East University, Research Center of Experimental Health Sciences, Nicosia, Northern Cyprus

how to cite: Korkmaz P, Demirturk N, Batırel A, Cem Yardimci A, Cagir U, et al. Noninvasive Models to Predict Liver Fibrosis in Patients with Chronic Hepatitis B: A Study from Turkey. Hepat Mon. 2017;17(12):e60266. https://doi.org/10.5812/hepatmon.60266.

Abstract

Background:

Many noninvasive methods, including aspartate amino transaminase (AST)/alanine amino transaminase (ALT) ratio (AAR), AST-to-platelet ratio index (APRI), Bonacini cirrhosis discriminant score (CDS), fibrosis-4 (FIB4) index, and age-platelet index (API), have been described to determine the stage of hepatic fibrosis. However, these methods are developed for patients with chronic hepatitis C (CHC) and produce conflicting results in the prediction of liver fibrosis in patients with chronic hepatitis B (CHB).

Objectives:

The aim of this study was to evaluate the relationship between 7 noninvasive models, including AAR, APRI, CDS, API, FIB-4, neutrophil-to-lymphocyte ratio (NLR), and red cell distribution width (RDW)-to-platelet ratio (RPR) in patients with CHB.

Methods:

The study population included all patients with CHB, undergoing liver biopsy to determine HBsAg and HBV DNA positivity in more than 6 months.

Results:

A total of 2520 treatment-naive CHB patients from 40 different centers were included in the study. In total, 62.6% of the patients were male, and the mean age was 40.60 ± 12.34 years (minimum, 18 years; maximum, 77 years). The Ishak fibrosis score was ≥ 3 in 29.8% of the patients, indicating significant fibrosis. The mean API, APRI, CDS, NLR, FIB4, and RPR scores in the noninvasive models were significantly different between the groups with significant and low fibrosis (P < 0.05). All the noninvasive models (API, APRI, AAR, CDS, NLR, RPR, and FIB4) were found to be significant in the discrimination of cirrhosis (P < 0.05). In the multiple logistic regression analysis, CDS, albumin, alkaline phosphatase (ALP), total bilirubin, neutrophil count, NLR, mean platelet volume (MPV), and FIB4 were independent indices for cirrhosis.

Conclusions:

In the present study, the role of noninvasive tests in the prediction of liver fibrosis stage and cirrhosis was evaluated in a large cohort of CHB patients. Overall, noninvasive models are gradually becoming more promising. Accordingly, the need for liver biopsy can be reduced with a combination of noninvasive methods in the future.

1. Background

Approximately one-third of the world's population is infected with hepatitis B virus (HBV), and 350 - 400 million people are chronic hepatitis B surface antigen (HBsAg) carriers. The disease has a broad clinical spectrum, ranging from inactive carriers to cirrhosis and hepatocellular carcinoma (HCC). The major aim of treatment is to prevent disease progression to advanced stages, such as cirrhosis and HCC.

Diagnosis of hepatic fibrosis is important in the selection of treatment (1). Liver biopsy is the gold standard for the evaluation of hepatic fibrosis stage (2). Although percutaneous liver biopsy is generally considered a safe procedure, it is costly and may increase the risk of complications (3). Biopsy can only represent 1:50.000 of the liver, and its accuracy may be influenced by the techniques and methodological interventions. For instance, fibrosis stage cannot be classified in 20% of the patients (4, 5).

Low compliance of patients due to the invasive nature of biopsy, contraindication of liver biopsy in hemostasis disorders, and limited use of liver biopsy during follow-up are the limitations of the procedure (3, 6, 7). The other limitations include the need for static information about the time of liver biopsy for fibrosis, variability of histological findings from the right and left hepatic lobes (considering the biopsy performance), frequent fragmentation of biopsy specimens during biopsy of cirrhotic patients, and finally a fibrosis level lower than expected (8-10).

Many noninvasive methods, including aspartate amino transaminase (AST)/alanine amino transaminase (ALT) ratio (AAR), AST-to-platelet ratio index (APRI), Bonacini cirrhosis discriminant score (CDS), fibrosis-4 (FIB4) index, and age-platelet index (API), have been described to evaluate the degree of hepatic fibrosis (11-15). However, these methods are developed for patients with chronic hepatitis C (CHC) and produce conflicting results in the prediction of liver fibrosis in patients with chronic hepatitis B (CHB) (16). CHC and CHB are different in terms of virological characteristics, histological changes in the liver, and triggering mechanisms for fibrosis (17). Therefore, it is necessary to evaluate the use of these parameters in patients with CHB.

2. Objectives

The aim of this study was to evaluate the relationship between 7 noninvasive models, including AAR, APRI, CDS, API, FIB-4, neutrophil-to-lymphocyte ratio (NLR), and red cell distribution width (RDW)-to-platelet ratio (RPR) in patients with CHB.

3. Methods

3.1. Study Population

The present research was designed as a retrospective multicenter study, performed at infectious diseases and clinical microbiology and gastroenterology clinics. All patients with CHB undergoing liver biopsy for HBsAg and HBV DNA analysis in more than 6 months, between January 2011 and December 2015, were included in the study. On the other hand, the exclusion criteria were as follows: 1) regular use of alcohol (> 20 g in a week); 2) use of antiinflammatory drugs; 3) decompensated liver disease, renal failure, diabetes mellitus, chronic inflammatory diseases (eg, ulcerative colitis, Crohn’s disease, and rheumatoid arthritis), coinfection (eg, HIV, HCV, and HDV), and HCC; 4) other malignancies metabolic and autoimmune liver diseases; and 5) history of liver surgery or transplantation. The medical records of patients undergoing liver biopsy for CHB were evaluated retrospectively. The study was approved by Dumlupinar University clinical research ethics committee.

3.2. Laboratory Assessment

The patients' leukocyte count, neutrophil count, lymphocyte, platelet count, hemoglobin, RDW, mean corpuscular volume (MCV), and mean platelet volume (MPV) were recorded, based on the complete blood cell count before biopsy. AST, ALT, albumin, total bilirubin, gamma-glutamyl transferase (GGT), and alkaline phosphatase (ALP) were recorded among biochemical parameters, and the international normalized ratio (INR) was reported among coagulation parameters. HBsAg, anti-HB antibody, HBeAg, anti-HBe antibody, HBV DNA, delta-antigen, anti-delta, anti-HIV, and anti-HCV antibodies were also evaluated in viral serological tests.

3.3. Histological Assessment

Liver biopsy specimens of the patients were assessed by pathologists in the follow-up location. Liver biopsy specimens, which were assessed according to the histological activity index (HAI) and Ishak fibrosis index, were included in the study (7). The specimens with fibrosis scores of 0 - 2 were classified as low fibrosis, scores ≥ 3 were classified as significant fibrosis, and scores of 5 - 6 were defined as cirrhosis. Noninvasive models were compared between patients with low and significant fibrosis, as well as cirrhotic and noncirrhotic patients.

3.4. Noninvasive Models

Among the noninvasive models, AAR, API, CDS, FIB4, and APRI were measured for each patient, using different formulas: AAR (De Ritis ratio): AST/ALT; API: age + platelet count (age: < 30 years, 0; 30 - 39 years, 1; 40 - 49 years, 2; 50 - 59 years, 3; 60 - 69 years, 4; ≥ 70 years, 5); platelet count × 109/L (≥ 225, 0; 200 - 224, 1; 175- 199, 2; 150 - 174, 3; 125 - 149, 4; < 125, 5); CDS: platelet count + ALT/AST ratio + INR (platelet count × 109/L > 340, 0; 280 - 339, 1; 220 - 279, 2; 160 - 219, 3; 100 - 159, 4; 40 - 99, 5; < 40, 6) (ALT/AST ratio > 1.7, 0; 1.2 - 1.7, 1; 0.6 - 1.19, 2; < 0.6, 3) (INR < 1.1, 0; 1.1 - 1.4, 1; > 1.4, 2); APRI: ([AST/ULN]/platelet count [× 109/L]) × 100; and FIB4: [age × AST (U/L)]/platelet count (109/L) × ALT (U/L)1/2] (11-15). Moreover, NLR was calculated by dividing the neutrophil count to lymphocyte count in the complete blood cell count, and RPR was calculated by dividing RDW to platelet count (17, 18).

3.5. Statistical Analysis

The number cruncher statistical system (NCSS 2007; Kaysville, Utah, USA) was used for the statistical analysis. For the comparison of descriptive results, mean, standard deviation, median, frequency, ratio, minimum, and maximum values were calculated. In addition, regarding quantitative data, student t test was used for intergroup comparisons of parameters with normal distribution, while Mann-Whitney U test was applied for the intergroup comparisons of parameters without a normal distribution. Diagnosis screening, including sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and receiver operating curve (ROC) analyses, were used to determine the cut-off values for the parameters. Multivariate logistic regression analysis was used to determine the risk factors for fibrosis and cirrhosis. The significance level was set at P < 0.05.

4. Results

A total of 2520 treatment-naive CHB patients from 40 different centers were included in the study. Overall, 62.6% of the patients were male, and the mean age was 40.60 ± 12.34 years (minimum, 18 years; maximum, 77 years). The Ishak fibrosis score was ≥ 3 in 29.8% of the patients, indicating significant fibrosis (Table 1). According to the comparisons, while no significant difference was found regarding hemoglobin, lymphocyte, RDW, leukocyte, or MPV (P > 0.05), a significant difference was found in the platelet count, albumin, neutrophil count, AST, ALT, INR, GGT, ALP, total bilirubin, and MCV between the groups with low and significant fibrosis (P < 0.05). The prevalence of significant fibrosis was significantly higher in male patients and those with advanced age (P < 0.05).

Table 1.

The Demographic Characteristics of the Patients

Min-Max (Median)
Age18 - 77 (40)
Female942 (27.4)
Male1578 (62.6)
Total bilirubin, mg/dL0.1 - 3.5 (0.7)
AST, U/L5 - 599 (35)
ALT, U/L6 - 1053 (52)
Albumin, g/dL2-5.6 (4.3)
GGT, U/L1 - 670 (26)
ALP, U/L10 - 511 (78)
Neutrophil, 103/µL0.8 - 11.6 (3.7)
Lymphocyte, 103/µL0.2 - 7 (2.1)
Hb, g/dL7.5 - 18.8 (14.6)
RDW6.3 - 47.7 (13.5)
MCV35.8 - 120.7 (87.8)
MPV5.5 - 22.8 (9.2)
Platelet count, 109/L56 - 640 (215)
INR0.4 - 3.1 (1)
HBeAg negative1966 (78)
HBeAg positive554 (22)
HBV DNA × 104, IU/mL0.2 - 627924 (24.9)
HAI0 - 18 (6)
F0345 (13.7)
F1612 (24.3)
F2810 (32.1)
F3452 (17.9)
F4187 (7.4)
F596 (3,8)
F618 (0.7)

While albumin level, platelet count, and neutrophil count were significantly lower in the group with significant fibrosis, age, AST, ALT, INR, GGT, ALP, total bilirubin, and MCV were significantly lower in the group with significant fibrosis. API, AST, ALT, INR, albumin, GGT, ALP, and MCV were independent variables for the diagnosis of significant fibrosis in the multiple logistic regression analysis. Two most important independent variables associated with significant fibrosis were INR (odds ratio, 5.234; 95% CI, 2.73 - 10.04) and API (odds ratio, 1.668; 95% CI, 1.28 - 2.16). However, no significant difference was found regarding the mean AAR between the groups (P = 0.524; Table 2). Among the noninvasive models, the mean API, APRI, CDS, NLR, FIB4, and RPR were significantly different between the groups with significant and low fibrosis. The ROC curves of these models are presented in Figure 1.

Table 2.

Group Comparisons and Logistic Regression Analysis of Patients with CHB According to Fibrosisa

Group ComparisonsLogistic Regression Analysis
Low Fibrosis (n, 1767)Significant Fibrosis (n, 753)P ValueUnivariate OR (95% CI)Multivariate OR (95% CI)
Age39.29 ± 11.9243.67 ± 12.760.001b1.029 (1.022 - 1.037)
Gender (male)1072 (60.7)506 (67.2)0.002b1,328 (1.100 - 1.589)
Platelet count228.03 ± 62.76206.98 ± 68.460.001b0.995 (0.993 - 0.996)
AST31 (23 -48)48 (31 - 89)0.001b1.011 (1.009 - 1.013)1.005 (1.001 - 1.010)
ALT45.5 (24 -80)67 (40 - 128)0.001b1.004 (1.003 - 1.005)0.998 (0.995 - 1.000)
INR1 (1 - 1.1)1.1 (1 - 1.2)0.001b13.825 (8.068 - 23.691)5.234 (2.729 - 10.040)
Albumin4.29 ± 0.434.16 ± 0.470.001b0.534 (0.439 - 0.649)0.719 (0.557 - 0.927)
GGT24 (16 - 36)33 (21 - 54)0.001b1.013 (1.009 - 1.016)1.003 (1.001 - 1.006)
ALP75 (60 - 91)85 (67 - 109)0.001b1.009 (1.007 - 1.012)1.006 (1.003 - 1.009)
Total bilirubin0.6 (0.4 - 0.9)0.7 (0.5 - 1)0.001b1.782 (1.446 - 2.197)
HBeAg positive375 (21.2)181 (24.1)0.1121.178 (0.962 - 1.443)
HBV DNA ×10410.2 (1.1 - 344.3)174.4 (8.3 - 1685)0.001b1.000 (1.000 - 1.000)
Hb14.42 ± 1.7214.41 ± 1.660.8550.995 (0.947 - 1.047)
Leukocyte6.8 (5.6 - 8)6.6 (5.5 - 7.8)0.0510.964 (0.919 - 1.010)
Neutrophil3.8 (3 - 4.8)3.5 (2.8 - 4.5)0.001b0.892 (0.837 - 0.950)
Lymphocyte2.1 (1.7 - 2.6)2.1 (1.7 - 2.6)0.4520.957 (0.845 - 1.085)
RDW13.4 (12.8 - 14.4)13.7 (12.8 - 14.7)0.0610.989 (0.955 - 1.025)
MPV9.31 ± 1.749.42 ± 1.830.1641.035 (0.986 - 1.085)
MCV87.3 (84.1 - 90.4)88.8 (85.3 - 91.9)0.001b1.051 (1.035 - 1.067)1.017 (1.00 - 1.036)
API2 (1 - 4)3 (2 - 5)0.001b1.272 (1.220 - 1.327)1.668 (1.286 - 2.164)
APRI0.4 (0.2 - 0.6)0.6 (0.4 - 1.1)0.001b2.403 (2.063 - 2.799)
NLR1.8 (1.4 - 2.3)1.7 (1.3 - 2.3)0.021c0.914 (0.834 - 1.002)
RPR0.06 (0.05 - 0.07)0.07 (0.06 - 0.09)0.001b2,452 (1.985 - 3.027)
FIB40.8 (0.6 - 1.2)1.3 (0.8 - 2.1)0.001b2.040 (1.827 - 2.276)
CDS4.85 ± 1.425.41 ± 1.460.001b1.319 (1.240 - 1.404)
AAR0.7 (0.6 - 1)0.7 (0.6 - 0.9)0.5241.050 (0.857 - 1.287)
The ROC of Noninvasive Models (API, CDS, APRI, NLR, FIB4, and RPR) in CHB Patients
The ROC of Noninvasive Models (API, CDS, APRI, NLR, FIB4, and RPR) in CHB Patients

The area under ROC (AUROC) for the noninvasive models of API, APRI, CDS, NLR, FIB4, and RPR were 0.629, 0.688, 0.609, 0.470, 0.681, and 0.596, respectively among CHB patients. The cut-off point for NLR in discrimination of low and significant fibrosis was ≤ 1.63. Moreover, the cut-off points for API, CDS, APRI, FIB4, and RPR, according to the fibrosis scores, were > 3, 5, 0.54, 1.19, and 0.07, respectively. The optimal cut-off point, sensitivity, specificity, PPV, and NPV of 6 noninvasive models, significant in the discrimination of low and significant fibrosis (API, APRI, CDS, NLR, FIB4, and RPR), are presented in Table 3.

Table 3.

The Sensitivity, Specificity, Predictive Values, and AUROC of Noninvasive Models (API, CDS, APRI, NLR, FIB4, and RPR) for the Prediction of Significant Fibrosis

Diagnostic TestROC CurveP Value
Cut-OffSensitivitySpecificityPPVNPVAreaSE95% CI
API > 348.8770.6841.4976.470.6290.0130.604 - 0.6530.001a
CDS> 548.4767.8039.0475.570.6090.0130.584 - 0.6330.001a
APRI> 0.5456.5771.4145.7179.450.6880.0120.667 - 0.7130.001a
NLR≤ 1.6346.7559.7233.0572.500.4700.0130.445 - 0.4960.022b
FIB4> 1.1955.2574.4647.9379.640.6810.0120.658 - 0.7060.001a
RPR> 0.0740.3375.4740.7875.130.5960.0130.571 - 0.6220.001a

The comparison of groups with and without cirrhosis indicated that hemoglobin, leukocyte, and lymphocyte levels were not significantly different between the groups (P > 0.05). However, there was a significant difference regarding the platelet count, albumin level, neutrophil count, AST, ALT, INR, GGT, ALP, total bilirubin, HAI, MCV, and RDW between the groups (P < 0.05). All the noninvasive models (API, APRI, AAR, CDS, NLR, RPR, and FIB4) were significant in the discrimination of cirrhosis (P < 0.05). The ROC curves of noninvasive models for the prediction of cirrhosis are shown in Figure 2. The prevalence of cirrhosis was significantly higher in male patients and those with advanced age (P < 0.05; Table 4).

The ROC of Noninvasive Models (API, AAR, CDS, APRI, NLR, FIB4, and RPR) in Cirrhotic Patients
The ROC of Noninvasive Models (API, AAR, CDS, APRI, NLR, FIB4, and RPR) in Cirrhotic Patients
Table 4.

Group Comparisons and Logistic Regression Analysis of Patients with CHB for the Prediction of Cirrhosisa

Group ComparisonsLogistic Regression Analysis
Noncirrhotic (n, 2406)Cirrhotic (n, 114)P ValueUnivariate OR (95% CI)Multivariate OR (95% CI)
Age40.20 ± 12.1648.96 ± 13.170.001b1.057 (1.041 - 1.074)
Gender (male)1496 (62.2)82 (71.9)0.035c1.559 (1.027 - 2.365)
Platelet count223.95 ± 64.37175.25 ± 65.910.001b0.985 (0.981 - 0.989)
AST34 (24 - 57)59.5 (37 - 101)0.001b1.007 (1.004 - 1.009)
ALT51 (27 - 93)68 (41.8 - 133)0.001b1.002 (1.001 - 1.004)
INR1 (1 - 1.1)1.1 (1 - 1.2)0.001b2.020 (1.094 - 3.731)
Albumin4.26 ± 0.433.92 ± 0.530.001b0.248 (0.173 - 0.354)0.411 (0.243 - 0.693)
GGT25 (17 - 41)41 (26 - 70)0.001b1.006 (1.003 - 1.009)
ALP77.5 (62 - 95)84 (67 - 115.5)0.007b1.008 (1.004 - 1.011)1.005 (1.000 - 1.010)
Total bilirubin0.6 (0.5 - 0.9)0.9 (0.7 - 1.2)0.001b3.019 (2.156 - 4.227)1.612 (0.934 - 2.782)
HBeAg positive525 (21.8)31 (27.2)0.1761.339 (0.876 - 2.045)
HBV DNA × 10421.2 (1.6 - 558.6)221.7 (20 - 2492.5)0.001b1.000 (1.000 - 1.000)
Hb14.42 ± 1.7014.30 ± 1.820.4410.958 (0.859 - 1.068)
Leukocyte6.7 (5.6 - 8)6.6 (5.5 - 7.6)0.3470.946 (0.851 - 1.052)
Neutrophil3.7 (2.9 - 4.7)3.4 (2.7 - 4.5)0.029c0.879 (0.761 - 1.016)1.252 (1.051 - 1.491)
Lymphocyte2.1 (1.7 - 2.6)2.1 (1.7 - 2.7)0.5641.101 (0.843 - 1.438)
RDW13.5 (12.8-14.5)13.9 (13.1 - 14.9)0.009b1.027 (0.966 - 1.091)
MCV87.7 (84.3 - 90.9)89 (85.8 - 92.4)0.007b1.039 (1.006 - 1.074)
MPV9.32 ± 1.769.77 ± 1.890.009b1.129 (1.031 - 1.238)1.220 (1.055 - 1.412)
FIB40.9 (0.6 - 1.4)1.9 (1.3 - 3.1)0.001b1.713 (1.538 - 1.908)2.349 (1.314 - 4.199)
API3 (1 - 4)5 (3 - 7)0.001b1.579 (1.452 - 1.718)
APRI0.4 (0.3 - 0.7)0.9 (0.5 - 1.6)0.001b1.692 (1.467 - 1.952)
AAR0.7 (0.6 - 1)0.8 (0.6 - 1)0.020c1.475 (1.085 - 2.005)
CDS4.97 ± 1.455.86 ± 1.390.001b1.564 (1.361 - 1.797)1.259(1.056 - 1.501)
NLR1.8 (1.4 - 2.3)1.6 (1.3 - 2.2)0.046c0.895 (0.719 - 1.116)2.018 (1.162 - 3.503)
RPR0.06 (0.05 - 0.08)0.08 (0.07 - 0.11)0.001b5,031 (3.420 - 7.400)

While albumin, platelet count, and neutrophil count were found to be lower in the cirrhotic group, compared to the noncirrhotic group, age, AST, ALT, INR, GGT, ALP, total bilirubin, and MCV were significantly higher in the cirrhotic group (P ≤ 0.05). In the multiple logistic regression analysis, CDS, albumin, ALP, total bilirubin, neutrophil count, NLR, MPV, and FIB4 were independent risk factors for cirrhosis. The most important independent factor for cirrhosis was FIB4 (odds ratio, 2.349; 95% CI, 1.31 - 4.199), followed by NLR (odds ratio, 2.108; 95% CI, 1.162 - 3.503; Table 4). The cut-off points for CDS, API, AAR, APRI, FIB4, and RPR in cirrhotic patients were 5, 4, 0.86, 0.4, 1.17, and > 0.08, respectively. Moreover, the cut-off point for NLR in cirrhotic patients was ≤ 1.62. The optimum cut-off point, sensitivity, specificity, PPV, and NPV of 7 noninvasive models (API, APRI, CDS, NLR, FIB4, and RPR) in the prediction of cirrhosis are shown in Table 5.

Table 5.

The Sensitivity, Specificity, PPV, NPV, and AUROC of Noninvasive Models (API, AAR, CDS, APRI, NLR, FIB4, and RPR) for the Prediction of Cirrhosis

Diagnostic TestROC CurveP Value
Cut-OffSensitivitySpecificityPPVNPVAreaSE95% CI
API > 459.6580.6112.7197.690.7750.0220.758 - 0.7910.001a
AAR> 0.8644.7467.126.0596.250.5640.0270.545 - 0.5840.017b
CDS> 564.0464.227.8197.420.6790.0250.661 - 0.6980.001a
APRI> 0.487.7249.567.6098.840.7520.0220.735 - 0.7690.001a
NLR≤ 1.6254.3959.075.9296.470.5550.0280.536 - 0.5750.047b
FIB4> 1.1781.5867.3710.5898.720.8040.0210.788 - 0.8190.001a
RPR> 0.0850.0083.4212.5397.230.7280.0250.710 - 0.7450.001a

5. Discussion

Based on the findings, 6 out of 7 noninvasive models could successfully identify fibrosis in CHB patients without biopsy. The APRI model, which was first investigated by Wai et al. in the staging of fibrosis among CHB patients, showed the most accurate diagnostic value and most powerful predictive value for fibrosis among the models in this study (19). The AUROC of APRI in the prediction of significant fibrosis was 0.688; this finding seems to be consistent with the data reported in the literature (20-24). The NPV of APRI in the prediction of fibrosis and cirrhosis was > 90% in a study by Guzelbulut et al. and 92% in a study by Celikbilek et al. (20, 22). In the present study, the NPVs of APRI for fibrosis and cirrhosis were 79.45% and 98.84%, respectively. These findings show that APRI is an important indicator, which can exclude fibrosis and cirrhosis and can be used accordingly in CHB patients.

The cut-off AUROC of FIB4, which is another index used to evaluate liver fibrosis, was 1.19; the sensitivity and specificity of FIB4 for significant fibrosis were 55.25% and 74.46%, respectively. This cut-off value seems to be consistent with the values reported in the literature (21, 23). In a meta-analysis by Xiao et al. the sensitivity and specificity of FIB4 in the prediction of cirrhosis were 87.4% and 64.7%, respectively (25). In the present study, the sensitivity and specificity of FIB4 in the prediction of cirrhosis were 81.5% and 67.3%, respectively, based on the AUROC. These findings are consistent with the results obtained by Xiao and colleagues. Moreover, in the present study, the NPVs of FIB4 to exclude significant fibrosis and cirrhosis were 79.64% and 98.7%, respectively. Consequently, FIB4 seems to be an important noninvasive assessment tool, which can be used to exclude significant fibrosis, especially cirrhosis.

Lymphocytes play a regulatory role in immune responses and have been shown to influence liver fibrosis in CHB patients (22). NLR is an inexpensive noninvasive model, showing the host's immune responses. Simply, it can be calculated via complete blood cell count parameters. NLR was found to be useful in the evaluation of HCC prognosis and discrimination of nonalcoholic steatohepatitis and significant fibrosis (26, 27). In various studies, NLR has been shown to efficiently identify the stage of liver fibrosis among CHB patients and can be used to demonstrate liver fibrosis (18, 28). On the contrary, some studies have indicated no relationship between NLR and cirrhosis and liver fibrosis (22). In the present study, NLR could be used in the discrimination of both significant fibrosis and cirrhosis. Analysis of the relationships, especially between NLR and cirrhosis, was performed using multiple regression analysis, and NLR was determined to be an independent factor for cirrhosis. NLR also showed the greatest value effect, following FIB4 among multiple factors for cirrhosis. However, the efficiency of NLR in the identification of liver fibrosis should be supported in future studies.

RDW is an indicator of variability in erythrocyte volume in circulation. In addition, it is used for the differential diagnosis of anemia (16). The increase in RDW has been shown to be proportional to the severity of liver damage. Thrombocytopenia is one of the well-known markers of severe liver injury. RPR is the ratio of RDW to platelet count and can be calculated according to the complete blood cell count parameters, such as NLR. In the literature, some studies have used RPR in staging of liver fibrosis (16, 29, 30). Chen et al. reported RPR as a cost-effective and easily measurable method and found it to be superior to AAR, FIB4, and APRI in the prediction of cirrhosis (16). In the present study, AUROC of RPR for significant fibrosis and cirrhosis was 0.596 and 0.728, respectively. According to the present findings, RPR was a more valuable parameter in the diagnosis of significant fibrosis in comparison with cirrhosis among CHB patients.

CDS is another model in which liver fibrosis is evaluated noninvasively. For the first time, in a study by Bonacini et al. a positive correlation was found between fibrosis score and CDS in CHC patients. In their study, the cut-off value, sensitivity, and specificity of CDS for advanced fibrosis or cirrhosis were > 8, 46%, and 98%, respectively (11). Overall, the number of studies indicating a relationship between CDS and fibrosis staging is limited in CHB patients. While CDS was insufficient in the diagnosis of liver fibrosis in some studies, it could be used to diagnose fibrosis in several other studies (21, 24, 30). In the present study, the cut-off value and NPV of CDS for low and significant fibrosis in cirrhotic and noncirrhotic patients were > 5, 75.57%, and 97.42%, respectively.

According to the present results, CDS is efficient in the discrimination of low fibrosis, significant fibrosis, and cirrhosis. However, since a higher NPV was obtained in the discrimination of cirrhosis, it is more successful in the evaluation of cirrhosis. Since no previous studies in the literature have evaluated the use of CDS in the discrimination of cirrhosis among CHB patients, the present findings can shed light on future studies.

For the first time, Poynard et al. evaluated API as a model for fibrosis in CHC patients (12). This model has been shown to be a good predictive index for liver fibrosis stage in many studies (24, 30). In the present study, AUROC for API was 0.629, which is consistent with the literature. On the contrary, Erdogan et al. reported that API is ineffective in the discrimination of significant fibrosis (21). Moreover, in an extensive meta-analysis, API was a successful noninvasive model for cirrhosis and NPV was 99.1% (25). Moreover, in the present study, the NPV of API was 97.69% for cirrhosis and API was an effective model.

In addition, AAR is a common index for identifying the underlying liver disease. AAR is generally > 2 in alcoholic liver disease and < 1 in chronic hepatitis and chronic cholestatic syndrome (24). In the present study, AAR was ineffective in differentiation of low fibrosis from significant fibrosis. There are studies supporting our results in the literature (21, 24, 31). In some studies, AAR is a parameter, used to identify cirrhosis rather than fibrosis (23). Similarly, we showed that AAR is an index for cirrhosis (Table 4).

INR is the most important indirect and noninvasive index for the prediction of hepatic cirrhosis. ALT, AST, and platelet count are correlated with liver cell death. In liver damage, an increase in PT/INR ratio and a decrease in albumin level have been observed (31). In a study on the role of laboratory tests in the identification of fibrosis in CHB patients, platelet count, AST, ALT, GGT, ALP, total bilirubin, albumin, and INR were compared between patients with liver fibrosis stages 0 - 1 and 2 - 4; these parameters were found to be significantly different between the groups with respect to fibrosis stage (32). In another study, age, INR, AST, and GGT were associated with liver fibrosis stage (21). In addition, in our study, the association between fibrosis and parameters such as age, albumin level, platelet count, HBV DNA, neutrophil count, AST, ALT, INR, GGT, ALP, total bilirubin, and MCV was investigated. AST, ALT, INR, albumin, GGT, ALP, and MCV were independent predictors of fibrosis in the regression analysis.

In patients with significant liver fibrosis, platelet count decreases due to reduced thrombopoietin production and increased platelet destruction (14). In this regard, conflicting results have been obtained in studies investigating the association between platelet count and fibrosis (2, 8, 14, 15, 21, 22). In addition, in our study, while platelet count was negatively correlated with fibrosis stage in the univariate analysis, it was not an independent parameter in the regression analysis. Similarly, the association between platelet count and cirrhosis was investigated. The platelet count was valuable in identifying cirrhosis in the univariate analysis, whereas it was not significant in the regression analysis. Based on the analyses, further clinical studies are required to clarify the efficiency of platelet count in the identification of fibrosis or cirrhosis alone.

The present study included the largest cohort of patients and investigated all noninvasive models in order to examine liver fibrosis stage and cirrhosis in the literature. The most important limitation of this study is the retrospective design; therefore, assessment by different pathologists was required for fibrosis staging. On the other hand, use of a similar method by all pathologists and high-quality standards of Ishak system are the strengths of this study, despite its retrospective design. Additionally, inclusion of patients from different centers is important in representing the general population. Sharing data of one center in relevant studies is reported as limitation of the study and it is stated that data obtained should also be validated by multicenter studies (19, 31). The present study is also important in substantiating this validation.

In conclusion, in the present study, the role of noninvasive tests in the prediction of liver fibrosis stage and cirrhosis was evaluated in a large cohort of CHB patients. Six out of seven noninvasive models for fibrosis stage were efficient in the prediction of significant liver fibrosis. AAR was an insufficient model in staging fibrosis. All 7 noninvasive models were found to be predictive of cirrhosis. FIB4 and APRI were the noninvasive models with the highest diagnostic accuracies for fibrosis stage, while FIB4 and API were the noninvasive models with the highest diagnostic accuracy for cirrhosis. Liver biopsy is currently the gold standard for staging hepatic fibrosis; nevertheless, its status can change in the future. Noninvasive models are gradually becoming more promising, and the need for liver biopsy can be reduced with combinations of noninvasive methods in the future.

Acknowledgements

References

  • 1.

    European Association For The Study Of The L. EASL clinical practice guidelines: Management of chronic hepatitis B virus infection. J Hepatol. 2012;57(1):167-85. [PubMed ID: 22436845]. https://doi.org/10.1016/j.jhep.2012.02.010.

  • 2.

    Zeng MD, Lu LG, Mao YM, Qiu DK, Li JQ, Wan MB, et al. Prediction of significant fibrosis in HBeAg-positive patients with chronic hepatitis B by a noninvasive model. Hepatology. 2005;42(6):1437-45. [PubMed ID: 16317674]. https://doi.org/10.1002/hep.20960.

  • 3.

    Cadranel JF, Rufat P, Degos F. Practices of liver biopsy in France: results of a prospective nationwide survey. For the Group of Epidemiology of the French Association for the Study of the Liver (AFEF). Hepatology. 2000;32(3):477-81. [PubMed ID: 10960438]. https://doi.org/10.1053/jhep.2000.16602.

  • 4.

    Siddique I, El-Naga HA, Madda JP, Memon A, Hasan F. Sampling variability on percutaneous liver biopsy in patients with chronic hepatitis C virus infection. Scand J Gastroenterol. 2003;38(4):427-32. [PubMed ID: 12739716].

  • 5.

    Regev A, Berho M, Jeffers LJ, Milikowski C, Molina EG, Pyrsopoulos NT, et al. Sampling error and intraobserver variation in liver biopsy in patients with chronic HCV infection. Am J Gastroenterol. 2002;97(10):2614-8. [PubMed ID: 12385448]. https://doi.org/10.1111/j.1572-0241.2002.06038.x.

  • 6.

    Standish RA, Cholongitas E, Dhillon A, Burroughs AK, Dhillon AP. An appraisal of the histopathological assessment of liver fibrosis. Gut. 2006;55(4):569-78. [PubMed ID: 16531536]. https://doi.org/10.1136/gut.2005.084475.

  • 7.

    Ishak K, Baptista A, Bianchi L, Callea F, De Groote J, Gudat F, et al. Histological grading and staging of chronic hepatitis. J Hepatol. 1995;22(6):696-9. [PubMed ID: 7560864].

  • 8.

    Lok AS, Ghany MG, Goodman ZD, Wright EC, Everson GT, Sterling RK, et al. Predicting cirrhosis in patients with hepatitis C based on standard laboratory tests: results of the HALT-C cohort. Hepatology. 2005;42(2):282-92. [PubMed ID: 15986415]. https://doi.org/10.1002/hep.20772.

  • 9.

    Pinzani M, Rombouts K, Colagrande S. Fibrosis in chronic liver diseases: diagnosis and management. J Hepatol. 2005;42 Suppl(1):S22-36. [PubMed ID: 15777570]. https://doi.org/10.1016/j.jhep.2004.12.008.

  • 10.

    Hsieh YY, Tung SY, Lee K, Wu CS, Wei KL, Shen CH, et al. Routine blood tests to predict liver fibrosis in chronic hepatitis C. World J Gastroenterol. 2012;18(8):746-53. [PubMed ID: 22371634]. https://doi.org/10.3748/wjg.v18.i8.746.

  • 11.

    Bonacini M, Hadi G, Govindarajan S, Lindsay KL. Utility of a discriminant score for diagnosing advanced fibrosis or cirrhosis in patients with chronic hepatitis C virus infection. Am J Gastroenterol. 1997;92(8):1302-4. [PubMed ID: 9260794].

  • 12.

    Poynard T, Bedossa P. Age and platelet count: a simple index for predicting the presence of histological lesions in patients with antibodies to hepatitis C virus. METAVIR and CLINIVIR Cooperative Study Groups. J Viral Hepat. 1997;4(3):199-208. [PubMed ID: 9181529].

  • 13.

    Giannini E, Botta F, Fasoli A, Ceppa P, Risso D, Lantieri PB, et al. Progressive liver functional impairment is associated with an increase in AST/ALT ratio. Dig Dis Sci. 1999;44(6):1249-53. [PubMed ID: 10389705].

  • 14.

    Wai CT, Greenson JK, Fontana RJ, Kalbfleisch JD, Marrero JA, Conjeevaram HS, et al. A simple noninvasive index can predict both significant fibrosis and cirrhosis in patients with chronic hepatitis C. Hepatology. 2003;38(2):518-26. [PubMed ID: 12883497]. https://doi.org/10.1053/jhep.2003.50346.

  • 15.

    Sterling RK, Lissen E, Clumeck N, Sola R, Correa MC, Montaner J, et al. Development of a simple noninvasive index to predict significant fibrosis in patients with HIV/HCV coinfection. Hepatology. 2006;43(6):1317-25. [PubMed ID: 16729309]. https://doi.org/10.1002/hep.21178.

  • 16.

    Chen B, Ye B, Zhang J, Ying L, Chen Y. RDW to platelet ratio: a novel noninvasive index for predicting hepatic fibrosis and cirrhosis in chronic hepatitis B. PLoS One. 2013;8(7). e68780. [PubMed ID: 23874760]. https://doi.org/10.1371/journal.pone.0068780.

  • 17.

    Lee IC, Chan CC, Huang YH, Huo TI, Chu CJ, Lai CR, et al. Comparative analysis of noninvasive models to predict early liver fibrosis in hepatitis B e Antigen-negative Chronic Hepatitis B. J Clin Gastroenterol. 2011;45(3):278-85. [PubMed ID: 20505530]. https://doi.org/10.1097/MCG.0b013e3181dd5357.

  • 18.

    Kekilli M, Tanoglu A, Sakin YS, Kurt M, Ocal S, Bagci S. Is the neutrophil to lymphocyte ratio associated with liver fibrosis in patients with chronic hepatitis B? World J Gastroenterol. 2015;21(18):5575-81. [PubMed ID: 25987782]. https://doi.org/10.3748/wjg.v21.i18.5575.

  • 19.

    Wai CT, Cheng CL, Wee A, Dan YY, Chan E, Chua W, et al. Non-invasive models for predicting histology in patients with chronic hepatitis B. Liver Int. 2006;26(6):666-72. [PubMed ID: 16842322]. https://doi.org/10.1111/j.1478-3231.2006.01287.x.

  • 20.

    Guzelbulut F, Sezikli M, Akkan-Cetinkaya Z, Yasar B, Ozkara S, Kurdas-Ovunc AO. AST-platelet ratio index in the prediction of significant fibrosis and cirrhosis in patients with chronic hepatitis B. Turk J Gastroenterol. 2012;23(4):353-8. [PubMed ID: 22965506].

  • 21.

    Erdogan S, Dogan HO, Sezer S, Uysal S, Ozhamam E, Kayacetin S, et al. The diagnostic value of non-invasive tests for the evaluation of liver fibrosis in chronic hepatitis B patients. Scand J Clin Lab Invest. 2013;73(4):300-8. [PubMed ID: 23514016]. https://doi.org/10.3109/00365513.2013.773592.

  • 22.

    Celikbilek M, Dogan S, Gursoy S, Zararsiz G, Yurci A, Ozbakir O, et al. Noninvasive assessment of liver damage in chronic hepatitis B. World J Hepatol. 2013;5(8):439-45. [PubMed ID: 24023983]. https://doi.org/10.4254/wjh.v5.i8.439.

  • 23.

    Teshale E, Lu M, Rupp LB, Holmberg SD, Moorman AC, Spradling P, et al. APRI and FIB-4 are good predictors of the stage of liver fibrosis in chronic hepatitis B: the Chronic Hepatitis Cohort Study (CHeCS). J Viral Hepat. 2014;21(12):917-20. [PubMed ID: 25131445]. https://doi.org/10.1111/jvh.12279.

  • 24.

    Eminler AT, Ayyildiz T, Irak K, Kiyici M, Gurel S, Dolar E, et al. AST/ALT ratio is not useful in predicting the degree of fibrosis in chronic viral hepatitis patients. Eur J Gastroenterol Hepatol. 2015;27(12):1361-6. [PubMed ID: 26352130]. https://doi.org/10.1097/MEG.0000000000000468.

  • 25.

    Xiao G, Yang J, Yan L. Comparison of diagnostic accuracy of aspartate aminotransferase to platelet ratio index and fibrosis-4 index for detecting liver fibrosis in adult patients with chronic hepatitis B virus infection: a systemic review and meta-analysis. Hepatology. 2015;61(1):292-302. [PubMed ID: 25132233]. https://doi.org/10.1002/hep.27382.

  • 26.

    Halazun KJ, Hardy MA, Rana AA, Woodland D, Luyten EJ, Mahadev S, et al. Negative impact of neutrophil-lymphocyte ratio on outcome after liver transplantation for hepatocellular carcinoma. Ann Surg. 2009;250(1):141-51. [PubMed ID: 19561458]. https://doi.org/10.1097/SLA.0b013e3181a77e59.

  • 27.

    Alkhouri N, Morris-Stiff G, Campbell C, Lopez R, Tamimi TA, Yerian L, et al. Neutrophil to lymphocyte ratio: a new marker for predicting steatohepatitis and fibrosis in patients with nonalcoholic fatty liver disease. Liver Int. 2012;32(2):297-302. [PubMed ID: 22097893]. https://doi.org/10.1111/j.1478-3231.2011.02639.x.

  • 28.

    Yesil A, Cosgun S, Erdem E, Kochan K, Gunduz F, Gonen C. The relationship between fibrosis level and blood neutrophil to lymphocyte ratio in chronic HBV patients. Age. 2013;38(13):37-14.

  • 29.

    Lou Y, Wang M, Mao W. Clinical usefulness of measuring red blood cell distribution width in patients with hepatitis B. PLoS One. 2012;7(5). e37644. [PubMed ID: 22649548]. https://doi.org/10.1371/journal.pone.0037644.

  • 30.

    Taefi A, Huang CC, Kolli K, Ebrahimi S, Patel M. Red cell distribution width to platelet ratio, a useful indicator of liver fibrosis in chronic hepatitis patients. Hepatol Int. 2015;9(3):454-60. [PubMed ID: 26088296]. https://doi.org/10.1007/s12072-015-9638-9.

  • 31.

    Ma J, Jiang Y, Gong G. Evaluation of seven noninvasive models in staging liver fibrosis in patients with chronic hepatitis B virus infection. Eur J Gastroenterol Hepatol. 2013;25(4):428-34. [PubMed ID: 23358121]. https://doi.org/10.1097/MEG.0b013e32835cb5dd.

  • 32.

    Zeng X, Xu C, He D, Li M, Zhang H, Wu Q, et al. Performance of several simple, noninvasive models for assessing significant liver fibrosis in patients with chronic hepatitis B. Croat Med J. 2015;56(3):272-9. [PubMed ID: 26088852].