Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Liver Stiffness Value-Based Risk Estimation of Late Recurrence after Curative Resection of Hepatocellular Carcinoma: Development and Validation of a Predictive Model

  • Kyu Sik Jung ,

    Contributed equally to this work with: Kyu Sik Jung, Ji Hong Kim

    Affiliation Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea

  • Ji Hong Kim ,

    Contributed equally to this work with: Kyu Sik Jung, Ji Hong Kim

    Affiliation Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea

  • Seung Up Kim ,

    ksukorea@yuhs.ac

    Affiliations Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea, Institute of Gastroenterology, Yonsei University College of Medicine, Seoul, Korea, Liver Cancer Special Clinic, Yonsei University College of Medicine, Seoul, Korea, Liver Cirrhosis Clinical Research Center, Seoul, Korea

  • Kijun Song,

    Affiliation Department of Biostatistics, Yonsei University College of Medicine, Seoul, Korea

  • Beom Kyung Kim,

    Affiliations Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea, Institute of Gastroenterology, Yonsei University College of Medicine, Seoul, Korea, Liver Cancer Special Clinic, Yonsei University College of Medicine, Seoul, Korea, Liver Cirrhosis Clinical Research Center, Seoul, Korea

  • Jun Yong Park,

    Affiliations Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea, Institute of Gastroenterology, Yonsei University College of Medicine, Seoul, Korea, Liver Cancer Special Clinic, Yonsei University College of Medicine, Seoul, Korea, Liver Cirrhosis Clinical Research Center, Seoul, Korea

  • Do Young Kim,

    Affiliations Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea, Institute of Gastroenterology, Yonsei University College of Medicine, Seoul, Korea, Liver Cancer Special Clinic, Yonsei University College of Medicine, Seoul, Korea, Liver Cirrhosis Clinical Research Center, Seoul, Korea

  • Sang Hoon Ahn,

    Affiliations Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea, Institute of Gastroenterology, Yonsei University College of Medicine, Seoul, Korea, Liver Cancer Special Clinic, Yonsei University College of Medicine, Seoul, Korea, Liver Cirrhosis Clinical Research Center, Seoul, Korea

  • Do Chang Moon,

    Affiliation Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea

  • In Ji Song,

    Affiliation Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea

  • Gi Hong Choi,

    Affiliation Department of Surgery, Yonsei University College of Medicine, Seoul, Korea

  • Young Nyun Park,

    Affiliation Department of Pathology, Yonsei University College of Medicine, Seoul, Korea

  • Kwang-Hyub Han

    Affiliations Department of Internal Medicine, Yonsei University College of Medicine, Seoul, Korea, Institute of Gastroenterology, Yonsei University College of Medicine, Seoul, Korea, Liver Cancer Special Clinic, Yonsei University College of Medicine, Seoul, Korea, Liver Cirrhosis Clinical Research Center, Seoul, Korea

Abstract

Background

Preoperative liver stiffness (LS) measurement using transient elastography (TE) is useful for predicting late recurrence after curative resection of hepatocellular carcinoma (HCC). We developed and validated a novel LS value-based predictive model for late recurrence of HCC.

Methods

Patients who were due to undergo curative resection of HCC between August 2006 and January 2010 were prospectively enrolled and TE was performed prior to operations by study protocol. The predictive model of late recurrence was constructed based on a multiple logistic regression model. Discrimination and calibration were used to validate the model.

Results

Among a total of 139 patients who were finally analyzed, late recurrence occurred in 44 patients, with a median follow-up of 24.5 months (range, 12.4–68.1). We developed a predictive model for late recurrence of HCC using LS value, activity grade II-III, presence of multiple tumors, and indocyanine green retention rate at 15 min (ICG R15), which showed fairly good discrimination capability with an area under the receiver operating characteristic curve (AUROC) of 0.724 (95% confidence intervals [CIs], 0.632–0.816). In the validation, using a bootstrap method to assess discrimination, the AUROC remained largely unchanged between iterations, with an average AUROC of 0.722 (95% CIs, 0.718–0.724). When we plotted a calibration chart for predicted and observed risk of late recurrence, the predicted risk of late recurrence correlated well with observed risk, with a correlation coefficient of 0.873 (P<0.001).

Conclusion

A simple LS value-based predictive model could estimate the risk of late recurrence in patients who underwent curative resection of HCC.

Introduction

Hepatic resection is the treatment of choice for hepatocellular carcinoma (HCC) in non-cirrhotic patients and remains the mainstay of treatment in cirrhotic patient with well-preserved liver function.[1] Although adequate patient selection, optimized surgical technique and postoperative management increased treatment efficacy, recurrence remains the main cause of a unsatisfactory long-term prognosis rate after resection of HCC.[2] Thus, identifying risk factors for recurrence after curative resection is important when selecting optimal candidates for resection and predicting a postoperative prognosis.

As recent study revealed that the prognosis and underlying mechanism are different for early and late recurrence, independent risk factors for each type of recurrence have been investigated respectively.[2][5] Among these, advanced liver fibrosis or cirrhosis is a known risk factor for late recurrence, as it contributes to multicentric recurrence at the remnant liver.[2], [3], [6] Furthermore, advanced liver fibrosis or cirrhosis is closely correlated with the development of postoperative mortality or complications, such as liver failure, worsening encephalopathy, or ascites.[7][9] Thus, a preoperative assessment of liver fibrosis severity is essential for prediction of postoperative outcomes.

Recently, liver stiffness (LS) measurement using transient elastography (TE, FibroScan) has been used to assess the degree of liver fibrosis noninvasively with high reproducibility and reliability.[10], [11] After much research into the role of LS value in predicting future development of clinical endpoints such as hepatic decompensation or HCC[12][14], several studies revealed that preoperative LS value could be used in the preoperative setting to predict postoperative outcomes such as hepatic insufficiency or operative blood loss.[7], [15] Furthermore, a recent study demonstrated that preoperative LS value was significantly correlated with intrahepatic recurrence after curative resection of HCC, particularly with late recurrence, suggesting that LS value could be used to stratify the risk of recurrence in patients with a remnant fibrotic liver.[16]

Thus, this prospective study was designed to investigate the correlation of LS value with the risk of late recurrence of HCC, and if such a correlation was identified, to construct and validate a LS value-based predictive model for late recurrence in patients who underwent curative resection of HCC.

Materials and Methods

Predictive model derivation

Between August 2006 and January 2010, patients with HCC, who were due to undergo curative resection of HCC at Severance Hospital, Yonsei University College of Medicine, Seoul, Korea, were prospectively enrolled in this study. Inclusion criteria were as follows; (1) age >20 years, (2) volunteered to participate in the study, (3) no previous diagnosis or treatment for HCC. TE was performed after enrollment to obtain preoperative LS value within 1 month prior to the operation by study protocol.

The database of our cohort included information on patient demographics, preoperative laboratory results, preoperative LS values, and pathological results of extracted liver and HCC specimens. The study protocol was consistent with the ethical guidelines of the 1975 Declaration of Helsinki. Written informed consent was obtained from each participant. This study was approved by the Ethics Committee/Independent Institutional Review Board of Severance Hospital, Yonsei University College of Medicine, Seoul, Korea.

Diagnosis of HCC

The preoperative diagnosis of HCC was made based on dynamic imaging studies, biopsy, and alpha-fetoprotein (AFP) serology according to the AASLD guideline.[17] Before surgery, the size, number, and location of HCC, and the presence of extrahepatic metastatic lesions were confirmed by imaging studies including computed tomography (CT), magnetic resonance imaging (MRI), positron emission tomography, and angiography.

Preoperative LS measurement

The principles of LS measurement have been described previously.[10] Briefly, TE generates an elastic wave using a vibrator ultrasound transducer applied to the intercostal spaces at the level of the right lobe of the liver and measures the propagation velocity of the shear wave, which is directly related to LS. LS values were obtained according to the instructions provided by the manufacturer. Immediately after ultrasonographic evaluation of the right hepatic lobe to avoid interference by HCC, LS measurement was performed on the right lobe of the liver through the intercostal spaces on patients lying in the dorsal decubitus position with the right arm in maximal abduction. A single experienced technician (more than 10,000 examinations), who was blind to the patients' clinical data, performed TE. The results were expressed as kilopascals (kPa).

Before surgery, TE was performed once at a single visit and LS values were measured more than 10 times during a single performance of TE. The interquartile range (IQR) was defined as an index of intrinsic variability of LS values corresponding to the interval of LS value containing 50% of the valid measurements between the 25th and 75th percentiles. The median value of successful measurements was selected as representative of the LS values in a given patient. Only LS values with at least 10 validated measurements, an IQR to median value ratio (IQR/M) of <0.3, and a success rate of at least 60% were considered reliable. LS value that did not satisfy these conditions was considered unreliable and excluded from further analysis.

Surgery and follow-up

The time of surgery was determined after diagnostic work up of HCC considering the status of the patient and the operation schedule. All resections were performed by three experienced surgeons (GH Choi, KS Kim, and JS Choi). The type and extent of resection were determined according to tumor size, location, and liver reserve function estimated by the Child-Pugh score and indocyanine green retention rate at 15 min (ICG R15).[18] Intraoperative ultrasonography was performed routinely to determine tumor location and extent and to exclude the presence of additional lesions in the residual liver. Curative resection was defined as a negative histopathological surgical margin and the absence of residual tumor, as demonstrated by abdominal CT scans 1 month after hepatectomy.

Patients were followed up 1 month after surgery and every 3 months thereafter with tumor markers (AFP and des-gamma carboxy prothrombin) and imaging studies including abdominal CT or MRI. Recurrence was diagnosed based on the combined findings of these clinical examinations, and sub-classified as early (<1 year) and late (≥1 year) recurrence [3], [19].

Histological evaluation of extracted liver specimens

A histological evaluation of the extracted liver specimens was performed by one experienced hepatopathologist (YN Park) who was blind to the patients' clinical information. Gross tumor classification, tumor size and number, tumor capsule formation and invasion, macroscopic or microscopic vascular invasion, satellite nodule, and the Edmondson-Steiner grade were determined.[20], [21] All HCCs were histologically confirmed in 139 patients and tumor stage was determined using the tumor, node, metastasis (TNM) staging system of the American Joint Commission on Cancer (7th edition).[22] _ENREF_20_ENREF_20Liver fibrosis and necroinflammatory activity were evaluated semi-quantitatively in non-cancerous tissues according to the Metavir system.[23] Fibrosis was staged on a 0–4 scale: F0, no fibrosis; F1, portal fibrosis without septa; F2, portal fibrosis and a few septa; F3, numerous septa without cirrhosis and F4, cirrhosis. Histological activity grade (degree of necroinflammatory activity in the lobules and periportal area) was scored as follows: A0, no activity; A1, mild activity; A2, moderate activity and A3, severe activity. Activity grade was defined as lobule or periportal activity (whichever was higher) [23].

Statistical analyses

Data are expressed as means ± standard deviation (SD), medians (range), or n (%), as appropriate. Comparisons between patients with late recurrence and those without were performed using Student's t-test or the Mann-Whitney test for continuous variables and the chi-square or Fisher's exact tests for categorical variables. In a univariate analysis, patient demographics including background liver etiology, preoperative laboratory results including ICG R15, preoperative LS values, surgical factors (types and extent of resections, resection margin, intraoperative blood loss, and perioperative transfusion) and pathological results of the extracted liver (fibrosis and necroinflammatory activity) and HCC (gross tumor classification, tumor size and number, tumor capsule formation and invasion, macroscopic or microscopic vascular invasion, satellite nodule, and the Edmondson-Steiner grade) were evaluated in terms of their relationship with late recurrence. Based on variables with clinical relevance and a univariate statistical significance, multivariate predictive model was constructed using a logistic regression model. The output of the model was expressed as regression coefficients, odd ratios (ORs), and 95% confidence intervals (CIs), which were used to predict late recurrence of HCC.

The model was validated by discrimination and calibration. Discrimination was assessed with the receiver operating characteristic curve, area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity. We calculated the predicted risk of late recurrence based on our predictive model and then estimated the observed risk of late recurrence to assess calibration. Observed risk estimates were plotted against the predicted risk in the group to create a calibration chart. All statistical analyses were conducted using the SAS software, ver. 9.2 (SAS Institute, Cary, NC, USA).

Results

Baseline characteristics

A total of 164 patients with HCC who underwent curative resection of HCC were enrolled. Five patients were excluded due to LS measurement failure (no valid shot) or an unreliable LS value. Thereafter, since the purpose of our study was to investigate the risk factor and construct a model to predict late recurrence of HCC, two patients with perioperative mortality (death within 1 month of the operation) and 18 with early recurrence (<1 year) were also excluded from the analysis (Fig. 1). Finally, the study cohort consisted of 139 patients, who were used to develop the predictive model for late recurrence after curative resection. With exception of 16 patients who died during study period due to recurrence, the patients were followed-up until October 2012, and the median follow-up period was 42.9 months (range, 20.4–72.7 months).

thumbnail
Figure 1. Flow chart of patient selection.

A total of 164 patients with HCC undergoing curative resection were recruited. Five patients were excluded due to LS measurement failure or an unreliable LS measurement. Of the 159 patients with a reliable LS value, 20 were excluded due to postoperative death within 1 month, or early recurrence within 1 year. Thus, a total of 139 patients were selected for statistical analysis. HCC, hepatocellular carcinoma; LS, liver stiffness measurement.

https://doi.org/10.1371/journal.pone.0099167.g001

The baseline characteristics of the study population are summarized in Table 1. Median age (119 males and 20 females) was 59 years. The most common etiology of underlying liver disease was chronic hepatitis B (n = 113, 81.3%). Liver cirrhosis was histologically confirmed in 56 (40.3%) patients. Median tumor size was 3.0 cm, and most tumors (n = 118, 84.9%) were single. According to the TNM staging system, 84 (60.5%) patients were classified as stage I, 7 (5.0%) stage II, and 48 (34.5%) stage IIIA.

Late recurrence was observed in 44 (31.7%) patients at a median of 24.5 months (range, 12.4–68.1 months). Intrahepatic recurrence was identified in all patients with late recurrence. Among these patients, simultaneous extrahepatic metastasis with intrahepatic recurrence were identified in seven patients at the time of recurrence (lung, n = 4; bone, n = 3).

LS values and the performance to predict liver fibrosis

LS value using TE was obtained for all patients within 1 month before surgery (median 5 days; range 1–30 days). The median LS value was 10.5 kPa (range, 4.0–45.0 kPa). LS values according to fibrosis stage were 5.1 kPa for F0-1 (range, 4.1–5.5 kPa), 8.5 kPa for F2 (range, 4.0–35.3 kPa), 9.2 kPa for F3 (range, 4.1–38.0 kPa), and 13.4 kPa for F4 (range, 5.8–45.0 kPa) (Fig. 2). The median LS value increased significantly with fibrosis stage (all P<0.05). The AUROCs of LS values to predict ≥F2, ≥F3, and F4 were 0.951 (95% CI, 0.913–0.988), 0.796 (95% CI, 0.702–0.889), and 0.837 (95% CI, 0.755–0.919), respectively.

thumbnail
Figure 2. Distribution of LS values according to fibrosis stage.

The median LS value increased significantly with fibrosis stage (P<0.001). LS, liver stiffness.

https://doi.org/10.1371/journal.pone.0099167.g002

Multivariate logistic regression model

The influence of each variable was tested in a univariate analysis (Table S1). In our cohort, ICG R15, the presence of multiple tumors, activity grade II-III, and LS value were significantly related with late recurrence in the univariate analysis (all P<0.05), whereas other variables were not statistically significant. A multivariate analysis was performed using the variables that exhibited statistical significance in the univariate analysis. Table 2 shows the β-regression coefficient estimates in the multivariate logistic regression model. In the multivariate analysis, activity grade II-III, and LS value were identified as independent predictors of late recurrence (all P<0.05), whereas ICG R-15 and the presence of multiple tumors did not achieve statistical significance (P>0.05).

thumbnail
Table 2. Multivariate analysis to identify independent predictors ofHCC occurrence.

https://doi.org/10.1371/journal.pone.0099167.t002

Development of a predictive model of late HCC recurrence

In addition to the two independent variables (activity grade II-III, and LS value), ICG R-15 and the presence of multiple tumors were also incorporated as constituent variables to develop a predictive model for late HCC recurrence, which is a known significant risk factor for late recurrence.[24], [25] This predictive model showed a fairly good discrimination capability, with an AUROC of 0.724 (95% CIs, 0.632–0.816).Where A = LS value (kPa); B = activity grade II-III (0: no, 1: yes); C = multiple tumors (0: no, 1: yes); D = ICGR15 (%)

Discrimination and calibration

We used a bootstrap method to assess discrimination, in which 1,000 random samples were drawn with replacement from the original dataset, and AUROCs were recalculated in each sample. The AUROCs remained largely unchanged between iterations, with an average AUROC of 0.722 (95% CIs, 0.718–0.724). We plotted a calibration chart that compared the predicted and observed risks of late HCC recurrence (Fig. 3). The predicted risk of late recurrence calibrated well with the observed risk, with a correlation coefficient of 0.873(P<0.001).

thumbnail
Figure 3. Calibration chart for predicted versus observed risk of late recurrence after curative resection of HCC.

The predicted risk of recurrence calibrated well with the observed risk, with a correlation coefficient of 0.873 (P<0.001).HCC, hepatocellular carcinoma.

https://doi.org/10.1371/journal.pone.0099167.g003

Discussion

Although the risk factors for postoperative recurrence have been investigated extensively, few mathematical models are available to predict recurrence after resection of HCC. [26][29] As none of the previous models included the effect of fibrosis in the formula, this is the first study to validate a specified prediction model for late recurrence of HCC based on LS value, which accurately reflects the burden of liver fibrosis. Finally, this study demonstrated that LS value-based predictive model could estimate the risk of late recurrence in patients who have undergone curative resection of HCC with considerable accuracy.

Compared to other risk factors, for a long time, the impact of liver fibrosis on recurrence has generally been underestimated. In previous studies, the influence of liver fibrosis was attenuated by other risk factors such as pathological factors, because recurrence was not classified into early and late one.[2], [28], [30] However, when types of recurrence were considered in the analysis, advanced liver fibrosis was selected as one of the independent risk factors for late recurrence.[3], [16], [24], [31] Additionally, as advances in surgical technique and proper patient selection have reduced early recurrence, which has a poorer prognosis than late recurrence, the effect of underlying fibrosis on long-term prognosis has gained greater importance. Despite its clinical importance, in most cases, it is difficult to assess histological staging of liver fibrosis prior to surgical resection. This suggests the need for a preoperative and non-invasive method of estimating liver fibrosis for selecting optimal candidates for resection or making individualized treatment and follow-up plans.

Recently, it has been proposed that preoperative LS value assessed using TE is significantly associated with recurrence, suggesting that clinicians can estimate fibrosis status noninvasively and accurately before surgery.[16] Consistently, preoperative LS value was selected as independent risk factor for late recurrence in this study, whereas histological fibrosis stage was not significant even in a univariate analysis.[16] These results might suggest that risk stratification using preoperative LS value could add more prognostic information for patients undergoing resection regardless of the histological findings, as LS might enable more precise quantification of liver fibrosis, expressed as continuous values, than simple stepwise histological grading. These findings also support a theoretical concept that the main mechanism of late recurrence is de novo development of HCC from a remnant fibrotic liver, rather than from dissemination of primary tumor cells [2].

Because the mechanism of late recurrence could not be explained solely by liver fibrosis, we developed a prediction model that included other important clinical factors and that could be validated internally. At first, as necroinflammatory activity was significantly associated with late recurrence in the multivariate analysis, consistent with previous studies, it was included in our predicting model.[24], [32], [33] Because liver fibrosis and necroinflammation are associated with a risk of carcinogenesis, it may enhance the performance to assess the risk of HCC development by incorporating simultaneously LS value and necroinflammatory activity into our prediction model.[4], [17] _ENREF_17Nevertheless, there can be a concern regarding potential overestimation of the influence of necroinflammation on LS values, which affected the overall performance of our prediction model.[34], [35] However, because we did not detect a correlation between LS and necroinflammatory activity in our patient cohort in a univariate analysis (P>0.05 by Spearman's correlation analysis), it was possible to use these two variables which reflect the degree of fibrosis and activity for our prediction model.

In addition, ICG R15, which had significant correlation with late recurrence in a univariate analysis, was included in our prediction model. Indeed, ICG R15 was significantly correlated with late recurrence in previous studies.[4], [24] _ENREF_24Although ICG R15 has been used to estimate remnant liver function after hepatectomy[18], the value of ICG R15 for predicting late recurrence was attenuated in our cohort. However, because ICG R15 could reflect the degree of functional liver status by estimating hepatic metabolic capacity whereas LS values could reflect the degree of physical status of liver fibrosis, we incorporated ICG R15 in our prediction model based on the hypothesis that the combination of these two parameters would strengthen the accuracy of our prediction model. Lastly, the presence of multiple tumors was included in our prediction models. Previous studies have demonstrated that the presence of multiple tumors was significantly related to late recurrence, suggesting that tumor multiplicity reflects increased carcinogenicity of the background liver.[2], [4] In this study, the presence of multiple tumors, which was confirmed histologically, was successfully diagnosed by radiological methods in all patients prior to resection. This result suggests that an advanced imaging modality can detect multiple tumors sensitively, thus the presence of multiple tumors, which was assessed by preoperative imaging, could be incorporated in the model.

Our new prediction model consisted of four variables: LS value, activity grade, presence of multiple tumors, and ICG R15, but other risk factors such as vascular invasion, tumor differentiation, and preoperative AFP level were not included in our model. Although these factors were identified as significant risk factors of recurrence in previous studies[36], [37], they did not achieve significance, even in the univariate analysis in this study. Additionally, because these factors did not enhance accuracy of our model, they were excluded from our final prediction model.

Although our study proposed a LS values-based HCC prediction model after curative resection, several issues remain unresolved in our study. First, this prediction model was developed using a relatively small sized cohort with various liver disease etiologies and validated internally and its accuracy seemed modest (AUROC = 0.724). Although, the etiology of liver disease was not significantly related to late recurrence in this study, consistently with the results of previous studies (P>0.05), further research with a larger and more homogenous study population should be followed by external validation.[2] Second, cross-sectional methods of identifying the risk factors for late recurrence in a cohort with variable follow-up time and exclusion of patients with early recurrence might lead to a selection bias. However, because the aim of our study was to develop a model to predict the risk of late recurrence itself, not the increasing risk of late recurrence over time, we used logistic regression instead of longitudinal statistical methods. Additionally, a short follow-up time less than 3 years was identified in 10 patients who died after recurrence and the remaining patients (n = 129) were followed up more than 3 years, suggesting that the current cross-sectional approach might be adequate for our cohort to compensate for the wide range of follow-up durations. Similar to our work, previous studies used cross-sectional methods to identify the risk factors for the late recurrence after resection of HCC.[3], [38] However, additional studies of a prediction model based on a survival analysis, such as Cox-regression or standardization of follow-up time, are required in the future. Third, as histological necroinflammatory activity grade was included, our model cannot be used prior to resection. Consequently, it does not seem feasible to use this model for stratification of an appropriate treatment modality such as liver transplantation, instead of surgical resection, especially for patients at high risk of recurrence after resection. Thus, it will be important to determine whether other noninvasive surrogate markers of the degree of necroinflammatory activity grade may be used as a preoperative risk calculator. Serum aminotransferase or apolipoprotein A1 are possible candidates as they revealed a significant correlation with necroinflammatory activity in a previous study.[39] Lastly, this model did not include gene expression profiles of surrounding non-cancerous liver tissue, which has been emphasized in recent studies as a significant risk factor for late recurrence after curative resection for HCC.[40], [41] However, from a different point of view, our results might suggest the importance of the characteristics of the remnant liver, such as LS values, ICG R15, and necroinflammation in predicting late recurrence in patients who have undergone curative resection of HCC.

In conclusion, this study constructed and validated a novel LS value-based model for predicting late HCC recurrence. This model, which involved tumor and non-tumor characteristics, demonstrated acceptable accuracy in patients who underwent curative resection of HCC. However, further studies with a larger sample size are warranted for external validation of our prediction model.

Supporting Information

Table S1.

Comparison between patients with and without late recurrence.

https://doi.org/10.1371/journal.pone.0099167.s001

(DOCX)

Acknowledgments

The authors are grateful to Dong-Su Jang, (Medical Illustrator, Medical Research Support Section, Yonsei University College of Medicine, Seoul, Korea) for his help with the figures.

Author Contributions

Conceived and designed the experiments: SUK KJS. Analyzed the data: SUK KJS KSJ. Contributed reagents/materials/analysis tools: JHK BKK JYP DYK SHA GHC YNP KHH IJS DCM. Wrote the paper: KSJ JHK SUK.

References

  1. 1. Llovet JM, Schwartz M, Mazzaferro V (2005) Resection and liver transplantation for hepatocellular carcinoma. Semin Liver Dis. 25: 181–200.
  2. 2. Tung-Ping Poon R, Fan ST, Wong J (2000) Risk factors, prevention, and management of postoperative recurrence after resection of hepatocellular carcinoma. Ann Surg 232: 10–24.
  3. 3. Poon RT, Fan ST, Ng IO, Lo CM, Liu CL, et al. (2000) Different risk factors and prognosis for early and late intrahepatic recurrence after resection of hepatocellular carcinoma. Cancer. 89: 500–507.
  4. 4. Imamura H, Matsuyama Y, Tanaka E, Ohkubo T, Hasegawa K, et al. (2003) Risk factors contributing to early and late phase intrahepatic recurrence of hepatocellular carcinoma after hepatectomy. J Hepatol. 38: 200–207.
  5. 5. Qu LS, Jin F, Huang XW, Shen XZ (2010) High hepatitis B viral load predicts recurrence of small hepatocellular carcinoma after curative resection. J Gastrointest Surg. 14: : 1111–1120. Epub 2010 Apr 1127.
  6. 6. Sasaki Y, Imaoka S, Masutani S, Ohashi I, Ishikawa O, et al. (1992) Influence of coexisting cirrhosis on long-term prognosis after surgery in patients with hepatocellular carcinoma. Surgery 112: 515–521.
  7. 7. Kim SU, Ahn SH, Park JY, Kim do Y, Chon CY, et al. (2008) Prediction of postoperative hepatic insufficiency by liver stiffness measurement (FibroScan((R))) before curative resection of hepatocellular carcinoma: a pilot study. Hepatol Int. 2: 471–477. Epub 2008 Sep 2009.
  8. 8. van den Broek MA, Olde Damink SW, Dejong CH, Lang H, Malago M, et al. (2008) Liver failure after partial hepatic resection: definition, pathophysiology, risk factors and treatment. Liver Int. 28: 767–780.
  9. 9. Friedman LS (2010) Surgery in the patient with liver disease. Trans Am Clin Climatol Assoc. 121: 192–204 discussion 205.
  10. 10. Sandrin L, Fourquet B, Hasquenoph JM, Yon S, Fournier C, et al. (2003) Transient elastography: a new noninvasive method for assessment of hepatic fibrosis. Ultrasound Med Biol. 29: 1705–1713.
  11. 11. Jung KS, Kim SU (2012) Clinical applications of transient elastography. Clin Mol Hepatol. 18: 163–173
  12. 12. Jung KS, Kim SU, Ahn SH, Park YN, Kim do Y, et al. (2011) Risk assessment of hepatitis B virus-related hepatocellular carcinoma development using liver stiffness measurement (FibroScan). Hepatology. 53: 885–894
  13. 13. Chon YE, Jung ES, Park JY, Kim do Y, Ahn SH, et al. (2012) The accuracy of noninvasive methods in predicting the development of hepatocellular carcinoma and hepatic decompensation in patients with chronic hepatitis B. J Clin Gastroenterol. 46: 518–525
  14. 14. Kim SU, Lee JH, Kim do Y, Ahn SH, Jung KS, et al. (2012) Prediction of liver-related events using fibroscan in chronic hepatitis B patients showing advanced liver fibrosis. PLoS One. 7: e36676
  15. 15. Wong JS, Wong GL, Chan AW, Wong VW, Cheung YS, et al. (2013) Liver stiffness measurement by transient elastography as a predictor on posthepatectomy outcomes. Ann Surg. 257: 922–928
  16. 16. Jung KS, Kim SU, Choi GH, Park JY, Park YN, et al. (2012) Prediction of recurrence after curative resection of hepatocellular carcinoma using liver stiffness measurement (FibroScan(R)). Ann Surg Oncol. 19: 4278–4286
  17. 17. Bruix J, Sherman M (2011) Management of hepatocellular carcinoma: an update. Hepatology. 53: 1020–1022
  18. 18. Makuuchi M, Sano K (2004) The surgical approach to HCC: our progress and results in Japan. Liver Transpl. 10: S46–52.
  19. 19. Shimada M, Takenaka K, Gion T, Fujiwara Y, Kajiyama K, et al. (1996) Prognosis of recurrent hepatocellular carcinoma: a 10-year surgical experience in Japan. Gastroenterology. 111: 720–726.
  20. 20. Edmondson HA, Steiner PE (1954) Primary carcinoma of the liver: a study of 100 cases among 48,900 necropsies. Cancer 7: 462–503.
  21. 21. Kanai T, Hirohashi S, Upton MP, Noguchi M, Kishi K, et al. (1987) Pathology of small hepatocellular carcinoma. A proposal for a new gross classification. Cancer 60: 810–819.
  22. 22. Edge S, Byrd DR, Compton CC, Fritz AG, Greene FL, et al. (2010) AJCC cancer staging handbook. New York: Springer-Verlag. 237–245 p.
  23. 23. Bedossa P, Poynard T (1996) An algorithm for the grading of activity in chronic hepatitis C. The METAVIR Cooperative Study Group. Hepatology. 24: 289–293.
  24. 24. Wu JC, Huang YH, Chau GY, Su CW, Lai CR, et al. (2009) Risk factors for early and late recurrence in hepatitis B-related hepatocellular carcinoma. J Hepatol. 51: 890–897
  25. 25. Mazzaferro V, Romito R, Schiavo M, Mariani L, Camerini T, et al. (2006) Prevention of hepatocellular carcinoma recurrence with alpha-interferon after liver resection in HCV cirrhosis. Hepatology. 44: 1543–1554.
  26. 26. Huang X, Wei W, Ya N, Zeng J, Zeng Y, et al. (2013) A mathematical model to predict short-term recurrence and metastasis of primary hepatocellular carcinoma larger than 10 cm in diameter. Hepatogastroenterology. 60: 225–230
  27. 27. Zhao WH, Ma ZM, Zhou XR, Feng YZ, Fang BS (2002) Prediction of recurrence and prognosis in patients with hepatocellular carcinoma after resection by use of CLIP score. World J Gastroenterol. 8: 237–242.
  28. 28. Okada S, Shimada K, Yamamoto J, Takayama T, Kosuge T, et al. (1994) Predictive factors for postoperative recurrence of hepatocellular carcinoma. Gastroenterology. 106: 1618–1624.
  29. 29. Woo HG, Park ES, Cheon JH, Kim JH, Lee JS, et al. (2008) Gene expression-based recurrence prediction of hepatitis B virus-related human hepatocellular carcinoma. Clin Cancer Res. 14: 2056–2064
  30. 30. Ng IO, Lai EC, Fan ST, Ng MM, So MK (1995) Prognostic significance of pathologic features of hepatocellular carcinoma. A multivariate analysis of 278 patients. Cancer. 76: 2443–2448.
  31. 31. Ko S, Kanehiro H, Hisanaga M, Nagao M, Ikeda N, et al. (2002) Liver fibrosis increases the risk of intrahepatic recurrence after hepatectomy for hepatocellular carcinoma. Br J Surg. 89: 57–62.
  32. 32. Hanazaki K, Matsushita A, Nakagawa K, Misawa R, Amano J (2005) Risk factors of intrahepatic recurrence after curative resection of hepatocellular carcinoma. Hepatogastroenterology. 52: 580–586.
  33. 33. Ko S, Nakajima Y, Kanehiro H, Hisanaga M, Aomatsu Y, et al. (1996) Significant influence of accompanying chronic hepatitis status on recurrence of hepatocellular carcinoma after hepatectomy. Result of multivariate analysis. Ann Surg. 224: 591–595.
  34. 34. Oliveri F, Coco B, Ciccorossi P, Colombatto P, Romagnoli V, et al. (2008) Liver stiffness in the hepatitis B virus carrier: a non-invasive marker of liver disease influenced by the pattern of transaminases. World J Gastroenterol. 14: 6154–6162.
  35. 35. Kim SU, Kim JK, Park YN, Han KH (2012) Discordance between liver biopsy and Fibroscan(R) in assessing liver fibrosis in chronic hepatitis b: risk factors and influence of necroinflammation. PLoS One. 7: e32233
  36. 36. Yamamoto J, Kosuge T, Takayama T, Shimada K, Yamasaki S, et al. (1996) Recurrence of hepatocellular carcinoma after surgery. Br J Surg. 83: 1219–1222.
  37. 37. Li T, Qin LX, Gong X, Zhou J, Sun HC, et al. (2013) Hepatitis B virus surface antigen-negative and hepatitis C virus antibody-negative hepatocellular carcinoma: clinical characteristics, outcome, and risk factors for early and late intrahepatic recurrence after resection. Cancer. 119: 126–135
  38. 38. Portolani N, Coniglio A, Ghidoni S, Giovanelli M, Benetti A, et al. (2006) Early and late recurrence after liver resection for hepatocellular carcinoma: prognostic and therapeutic implications. Ann Surg 243: 229–235.
  39. 39. Cheong JY, Kim DJ, Hwang SG, Yang JM, Kim YB, et al. (2011) Serum markers for necroinflammatory activity in patients with chronic viral hepatitis and normal or mildly elevated aminotransferase levels. Liver Int. 31: 1352–1358
  40. 40. Sato F, Hatano E, Kitamura K, Myomoto A, Fujiwara T, et al. (2011) MicroRNA profile predicts recurrence after resection in patients with hepatocellular carcinoma within the Milan Criteria. PLoS One. 6: e16435
  41. 41. Hoshida Y, Villanueva A, Kobayashi M, Peix J, Chiang DY, et al. (2008) Gene expression in fixed tissues and outcome in hepatocellular carcinoma. N Engl J Med. 359: 1995–2004