Figures
Abstract
Background
The enhanced liver fibrosis test (ELF) has been shown to accurately predict significant liver fibrosis in several liver diseases.
Aims
To perform a meta-analysis to assess the performance of the ELF test for the assessment of liver fibrosis.
Study
Electronic and manual searches were performed to identify studies of the ELF test. After methodological quality assessment and data extraction, pooled estimates of the sensitivity, specificity, area under the receiver operating characteristic curve (AUROC), positive likelihood ratio (PLR), negative likelihood ratio (NLR), diagnostic odds ratio (DOR) and summary receiver operating characteristics (sROC) were assessed systematically. The extent of heterogeneity and reasons for it were assessed.
Results
Nine studies were identified for analysis. The pooled sensitivity, specificity, positive LR, negative LR, and DOR values of ELF test, for assessment of significant liver fibrosis, were 83% (95% CI = 0.80–0.86), 73% (95% CI = 0.69–0.77), 4.00 (95% CI = 2.50–6.39), 0.24 (95% CI = 0.17–0.34), and 16.10 (95% CI = 8.27–31.34), respectively; and, for evaluation of severe liver fibrosis, were 78% (95% CI = 0.74–0.81), 76% (95% CI = 0.73–0.78), 4.39 (95% CI = 2.76–6.97), 0.27 (95% CI = 0.16–0.46), and 16.01 (95% CI: 7.15–35.82), respectively; and, for estimation of cirrhosis, were 80% (95% CI = 0.75–0.85), 71% (95% CI = 0.68–0.74), 3.13 (95% CI = 2.01–4.87), 0.29 (95% CI = 0.19–0.44), and 14.09 (95% CI: 5.43–36.59), respectively.
Citation: Xie Q, Zhou X, Huang P, Wei J, Wang W, Zheng S (2014) The Performance of Enhanced Liver Fibrosis (ELF) Test for the Staging of Liver Fibrosis: A Meta-Analysis. PLoS ONE 9(4): e92772. https://doi.org/10.1371/journal.pone.0092772
Editor: James Fung, The University of Hong Kong, Hong Kong
Received: October 11, 2013; Accepted: February 26, 2014; Published: April 15, 2014
Copyright: © 2014 Xie et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by grants from the National Natural Science Foundation of China (No. 81172315/H1617) and the research Special Fund For public welfare industry of health and the translational research of early diagnosis and comprehensive treatment in pancreatic cancer (201202007). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Liver fibrosis is a consequence of various chronic liver diseases, often caused by viruses, alcohol, and fat deposition, and can result in liver cirrhosis. Cirrhosis is the main cause of morbidity and mortality in chronic liver disease, but is often asymptomatic until the synthetic and filtering functions of the liver are finally compromised or portal hypertension develops. In addition, for chronic viral hepatitis, the degree of liver fibrosis is an important parameter for decisions on antiviral therapy [1], so the early detection of fibrosis progression and the development of cirrhosis are important in the management of patients with chronic liver disease.
Presently, a liver biopsy remains the reference standard for evaluating liver fibrosis. However, it is limited by sampling error and the risk of complications [2], [3]. Intra- and interobserver variability may lead to misinterpretation of the fibrosis stage [4]–[7]. One reason for the difficulty in correctly assessing the fibrosis stages may be simply that a biopsy specimen represents only 1/50,000th of the total liver mass [2]. Even with adequate biopsy samples (≥15 mm in length with five or more portal tracts), cirrhosis can be understaged in 10–30% of cases [8]. Moreover, it is usually difficult to undertake biopsies on a repeated basis, because of their invasive nature and complications, such as pain and bleeding.
Thus, much attention has been focused on the development of non-invasive methods, including radiological and biochemical tests, to detect liver fibrosis. Transient elastography for assessing liver stiffness has become available for the evaluation of liver fibrosis as a rapid, non-invasive method. However, this technique is cost-intensive and its availability is largely limited to specialist liver centres. Moreover, liver stiffness measurements can be difficult or impossible in obese patients, in those with narrow intercostal space, and in patients with ascites [9], and a failure rate up to 18.9% has been reported [10].
Alternative method assessing the degree of liver fibrosis focused on serum biomarkers. The combined use of three serum biomarkers of hyaluronic acid (HA) [11], which is a component of the extracellular matrix (ECM) and is primarily cleared from the bloodstream by the hepatic sinusoids, tissue inhibitors of metalloproteinases (TIMP-1) [12]–[16] inhibiting the activities of matrix metalloproteinases (MMPs) and amino-terminal propeptide of procollagen type III (PIIINP) [17]–[20] reflecting collagen synthesis at the site of disease has recently been proposed for the detection of fibrosis. In clinical practice, serum samples were analysed for levels of HA, TIMP-1 and PIIINP. Results were entered into the established algorithm and expressed as discriminant scores. This simplified version of panel was called enhanced liver fibrosis (ELF) score. In other word, a higher concentration of individual biomarkers leads to a higher ELF score and indicates a greater likelihood of more severe fibrosis. The ELF test has several strengths such as better automaticity, high reproducibility, less invasiveness and proven considerable diagnostic performance in the assessment of the degree of liver fibrosis [21]–[23]. The ELF test has received the Conformité Européénne mark in May 2007 [24].
The aim of this study was to perform a meta-analysis to evaluate the diagnostic accuracy of ELF, with histopathology as a reference standard.
Methods
Search Strategy
A computerised search was performed in PubMed/Medline, EMBASE, the Cochrane Library, and Google Scholar to identify relevant articles published from 2003 to 2013. The literature search was performed with the following terms: cirrhosis, liver fibrosis, and enhanced liver fibrosis test or ELF test. The research was limited to articles concerning humans with an abstract in English. The complete search yielded 260 articles from databases.
Study Selection and Quality Assessment
Two reviewers (W-L.W. and Q-S.X.) read the titles and abstracts of original articles that addressed the diagnostic accuracy of ELF for staging liver fibrosis in humans to select potentially relevant articles. All of the selected articles were collected and reviewed independently by the same reviewers to determine their eligibility for detailed analysis. The inclusion criteria were as follows: patients with suspected cirrhosis, ELF scores as the index test, defined optimal cut-off values or a threshold of ELF, histopathology as the reference test, and raw data (i.e., true-positive (TP), false-positive (FP), true-negative (TN), and false-negative (FN) results could be found or calculated). Exclusion criteria were duplicate publication (based on the same primary study) and sample size of less than 20. Disagreements between the two reviewers regarding study inclusion were resolved by consensus after a face-to-face discussion. Investigators in the primary research were approached for additional information as necessary.
The methodological quality of each study was assessed using a checklist based on the Quality Assessment for Studies of Diagnostic Accuracy (QUADAS) tool [25], which enables reviewers to evaluate the quality of studies, especially investigations of diagnostic accuracy [26], [27].
Data Extraction
Data were extracted from primary studies by the two reviewers (W-L.W. and Q-S.X.) independently. In cases of discrepancies between the first two reviewers, a senior surgeon (S-S.Z.), with more than 20 years of experience in hepatic disease, was consulted and a consensus was reached. We defined significant fibrosis as a fibrosis stage ≥2 for studies using grading systems with five stages (F0–F4; i.e., the METAVIR, Brunt, Batts-Ludwig systems) or as a fibrosis stage ≥3 for studies using the Ishak scoring system (S0–S6). For grading systems using five stages or the Ishak scoring system, severe fibrosis was defined as a fibrosis stage ≥3 or ≥4, and cirrhosis was defined as a fibrosis stage = 4 or ≥5, respectively [28]. We extracted available data on TPs, FNs, FPs, and TNs for staging liver fibrosis to construct a 2×2 contingency table.
Data Synthesis and Statistical Analysis
From the extracted data, arranged in 2×2 contingency tables, we computed sensitivity, specificity, and diagnostic odds ratios (DORS) to estimate the diagnostic performance of each test modality to assess each stage of liver fibrosis. All statistics are reported as point values with 95% confidence intervals (CIs). Sensitivity was defined by the TP rate and was calculated as TP/(TP+FN). Specificity was defined by the TN rate and was calculated as TN/(FP+TN). The DOR is a single overall indicator of diagnostic performance and is the ratio of the odds of positivity in disease subjects relative to the odds of positivity in non-diseased subjects [29]. The DOR was calculated as (TP×TN)/(FP×FN).
The performance was summarised using a bivariate binomial model [30]. This model assumed a binomial distribution for the number of patients with TP and TN results and allowed the inclusion of covariates and random effects. The inherent association between sensitivity and specificity was modelled in a bivariate normal distribution by assuming random effects [31].
The heterogeneity of all diagnostic test parameters was evaluated initially with a graphic examination of forest plots for each parameter. A statistical assessment was then made of the inconsistency index (I2). The I2 statistic is defined as the percentage of variability due to heterogeneity beyond that from chance; values greater than 50% represent the possibility of substantial heterogeneity. The pooled summary statistics for the sensitivities, specificities, likelihood ratios, and diagnostic odds ratios of the individual studies are reported.
Summary receiver operating characteristic (SROC) curves were also constructed to express the test parameter results as the diagnostic odds ratios. These curves were also used to assess the presence of a diagnostic threshold (cut-off) bias as a cause of between-study heterogeneity. Analyses were performed using the Meta-Disc 1.4 statistical software (Unit of the Clinical Biostatistics team of the Ramón y Cajal Hospital in Madrid, Spain).
Results
Study Characteristics
Figure 1 depicts the flow of our search results. In total, 261 studies were identified using electronic searches. Without duplicates, 117 abstracts were assessed. Of them, 19 seemed relevant and the full studies were assessed. Ultimately, nine investigations were identified for inclusion in this study [32]–[40]. Quality assessment scores for the diagnostic studies were above 10 of the 14 QUADAS items describing methodological quality.
The nine studies evaluated involved 1826 patients from Asian and European medical centres. In four trials, the disease spectrum was restricted to chronic viral hepatitis, in one trial to non-alcoholic fatty liver disease (NAFLD), and in four trials, there was no restriction (Table 1).
Five studies reported quality criteria for liver biopsy specimens [32], [34], [36]–[38], and three investigations reported a minimum length of 15 mm [33], [35], [39]. The Ishak histological scoring system was used in three studies [35], [38], [39], the National Institute of Diabetes and Digestive and Kidney Diseases system was used in one study [33], the modified Brunt system was used in one study [32], the Batts-Ludwig system was used in one study [37], and the METAVIR system was used in four studies [34]–[36], [40] (Table 2). Moreover, there are four studies [34], [37], [38], [40] comparing the performance of ELF test with transient elastograhpy (TE) for staging liver fibrosis (Table 3).
The demographic and clinical features of the patients in the studies analysed are listed in Table 1. The median sample size of the studies assessing the presence of significant liver fibrosis was 141 (range, 74–512) [32]–[34], [36], [37], [39], the median sample size of the studies assessing the presence of severe liver fibrosis was 181 (range, 74–512) [32]–[37], [40], and the median sample size of the studies assessing the presence of cirrhosis was 102 (range, 74–512) [34], [36]–[39], [40].
In the studies analysed, the median proportion of individuals with cirrhosis was 14.9% (range, 10–36.7%). The diagnostic cut-off values ranged from 8.5 to 10.18 for significant liver fibrosis [32]–[34], [36], [37], [39], from 9.33 to 10.51 for severe liver fibrosis [32]–[37], [40], and from 9.35 to 11.3 [32], [34]–[37], [40] for cirrhosis.
Diagnostic Threshold Bias and Meta-Regression Assessment
To assess the diagnostic threshold (cut-off) bias as a cause of heterogeneity in test performance, we prepared an ROC plot of the sensitivity versus 1-the specificity. Among the six primary studies providing data for the detection of significant liver fibrosis, the diagnostic threshold (cut-off) yielded an area under receiver operating characteristic (AUROC) of 0.8813, among another seven primary studies providing data for the assessment of severe liver fibrosis, the diagnostic threshold (cut-off) yielded an AUROC of 0.8696, among another six primary studies providing data for the prediction of cirrhosis, the diagnostic threshold (cut-off) yielded an AUROC of 0.8770, and they all revealed evidence supporting the diagnostic threshold (cut-off) bias as a major cause of heterogeneity(Fig. 2).
Summary Estimates of Primary Studies
For the assessment of significant liver fibrosis, the sensitivity values of ELF ranged from 70% to 94%, and the pooled sensitivity value was 83% (95% CI = 0.8–0.86, P = 0.0249, I2 = 61.1%). The specificity values ranged from 62% to 93%, and the pooled specificity value was 73% (95% CI = 0.69–0.77, P<0.0001, I2 = 88.8%). The pooled positive likelihood ratio was 4.00 (95% CI = 2.03–6.39, P<0.0001, I2 = 83.7), and the pooled negative likelihood ratio was 0.24 (95% CI = 0.17–0.34, P = 0.0215, I2 = 62.2%) (Fig. 3) The summary diagnostic odds ratio was 16.10 (95% CI = 8.27–31.34, P = 0.0064, I2 = 69.1%) (Fig. 4).
For the prediction of severe liver fibrosis, the sensitivity values of ELF test ranged from 62% to 100%, and the pooled sensitivity value was 78% (95% CI = 0.74–0.81, P<0.0001, I2 = 85.2%). The specificity values ranged from 66% to 98%, and the pooled specificity value was 76% (95% CI = 0.73–0.78, P<0.0001, I2 = 93.8%). The pooled positive likelihood ratio was 4.39 (95% CI = 2.76–6.97, P<0.0001, I2 = 88.0%), and the pooled negative likelihood ratio was 0.27 (95% CI = 0.16–0.46, P<0.0001, I2 = 85.2%) (Fig. 5) The summary diagnostic odds ratio was 16.01 (95% CI = 7.15–35.82, P<0.0001, I2 = 82.4%) (Fig. 6).
For the evaluation of cirrhosis, the sensitivity values of ELF test ranged from 70% to 100%, and the pooled sensitivity value was 80% (95% CI = 0.75–0.85, P = 0.0987, I2 = 46.1%). The specificity values ranged from 47% to 95%, and the pooled specificity value was 71% (95% CI: 0.68–0.74, P<0.0001, I2 = 99.3%). The pooled positive likelihood ratio was 3.13 (95% CI = 2.01–4.87, P<0.0001, I2 = 91.4%), and the pooled negative likelihood ratio was 0.29 (95% CI = 0.19–0.44, P = 0.0646, I2 = 51.9%) (Fig. 7) The summary diagnostic odds ratio was 14.09 (95% CI = 5.43–36.59, P = 0.0002, I2 = 79.3%) (Fig. 8).
Two [34], [38] of the 4 studies [34], [37], [38], [40] comparing the performance of ELF test with TE for assessment of cirrhosis reported that ELF test has a higher sensitivity, while the all 3 studies [34], [37], [38], [40] uncovered TE has a preferable performance of specificity. More specifically, compared to ELF test that revealed a pooled sensitivity of 78% (95% CI = 0.70–0.85, P = 0.0401, I2 = 63.9%), a specificity of 64% (95% CI = 0.59–0.69, P<0.0001, I2 = 92.5%) and an AUROC of 0.7947, the transient elastography showed a higher pooled sensitivity 82% (95% CI = 0.75–0.88, P = 0.4820, I2 = 0.0%), a higher pooled specificity 89% (95% CI = 0.86–0.92, P<0.0001, I2 = 90.5%) and a higher AUROC (0.8812) for detection of cirrhosis(Fig. 9, Fig. 10, Fig. 11).
Discussion
Information on the presence and degree of liver fibrosis is pivotal for making therapeutic decisions and predicting disease outcomes [41]. For example, the ultimate goal of treatment at the stage of significant liver fibrosis is to prevent the potential pathogenesis of liver disease [41], [42]. In contrast, given that the severe liver fibrosis or cirrhosis may have a risk of progression to hypertension and HCC, discrimination of severe liver fibrosis and cirrhosis is important [42]. The increasing awareness of the limitations of liver biopsies [43], [44] has stimulated the development and refinement of non-invasive techniques for the assessment of liver fibrosis. Theoretically, non-invasive techniques for the assessment of liver fibrosis should possess the advantages of liver specificity, easy execution, and high diagnostic performance, in terms of sensitivity, specificity, DOR, PLR, NLR, and AUROC. The most studied non-invasive detection method for liver fibrosis is transient elastography, but it has shown less accuracy in discriminating lower fibrosis stages [45], [46] and restricted by narrow intercostal space and ascites.
Studies have confirmed that the ELF test can accurately determine the degree of liver fibrosis [32], [47]–[49] and revealed a lower significance for discrimination of low and moderate fibrosis stages and a broad overlapping range for those stages [38]. In the three subgroups of this meta-analysis, the pooled sensitivity, pooled specificity, and summary DOR of the ELF test were greater than 80%, 74%, and 17, respectively. That indicates that at least 74% of patients could reasonably avoid a liver biopsy. With summary AUROCs of 0.8813, 0.8696, and 0.8770 for significant and severe liver fibrosis and cirrhosis, respectively, the results of this meta-analysis demonstrate that ELF has good diagnostic performance for assessing liver fibrosis.
A diagnostic tool is deemed perfect if the AUROC is 100%, excellent if the AUROC is greater than 90%, and good if the AUROC is greater than 80% [50]. According to these results, coupled with its reproducibility, the ELF test can be used in clinical practice as a good tool for the staging of cirrhosis. The fine performance of the ELF test may result from the fact that serum markers reflect fibrosis in the whole liver rather than 1/50,000th of the organ, as does a biopsy sample, or, alternatively, that the ELF test evaluates the impact of liver fibrosis on liver function as well as the architectural damage associated with histological fibrosis and cirrhosis.
It is worth noting that the ELF test showed a high correlation with aminotransferase levels and revealed a significantly high correlation with inflammation [38]. One study [47] found that the ELF test, reflecting on-going pathophysiological processes and functions that a biopsy cannot capture, had prognostic value. The ELF test, an index of HA, PIIINP, and TIMP-1, exhibited prognostic ability even in the early stages of the disease process (AUROC = 0.737–0.863 at all times points) [48], because, probably, the above indices are expressed during the early stages of collagen deposition in the liver. In further analysis of ELF test performance in predicting all-cause mortality, it was found that the AUROC of the ELF test at 6 years was significantly greater than that of a biopsy [47].
In future, the ELF test may be used to evaluate the impact of treatment directed at the underlying causes, such as viral hepatitis, and in the development of new treatments, such as anti-fibrotic drugs.
Indeed, there was significant heterogeneity in this meta-analysis, which may be due to the following reasons. First, differences in study methodologies are well-recognised causes of heterogeneity in meta-analyses of diagnostic tests. Second, subtle variations in the algorithm of the ELF score and liver biopsy may also contribute to between-study variation. Third, the use of different histological scoring systems may result in discrepancies in the findings of the studies. The studies included in this meta-analysis used five histological scoring systems. Although the histological staging system is complex, it is relevant for the assessment, follow-up, and definition of the rate of fibrosis progression, and is also categorical in nature. The current reliance on histological staging using categorical scores for liver biopsy samples is recognised as suboptimal for assessing efficacy, and this may be a source of heterogeneity [51]. Fourth, the size of liver biopsy tissue cores may impact the accuracy of liver fibrosis staging. Criteria for liver biopsy specimens (≥20 mm in length and/or 11 portal tracts) have been described previously [8]. However, in practice, it is difficult for biopsy samples to achieve these criteria. In this meta-analysis, the mean length of specimens ranged from 18.9 to 25.1 mm, so no study reported liver biopsy samples meeting the criteria, and only two studies [32], [36] described liver biopsy specimens with 11 complete portal tracts. Thus, the observed heterogeneity may be secondary to intrinsic errors in liver biopsy measurements, which limit the diagnostic accuracy of non-invasive evaluations [52], [53]. Fifth, a diagnostic threshold (or cut-off value) bias was identified as an important cause of heterogeneity in the pooled results for the three patient groups. In this meta-analysis, there was no consistent cut-off value, which would also generate heterogeneity. Finally, publication bias may also have resulted in heterogeneity in this meta-analysis because we excluded some studies having no full text and published in languages other than English.
In summary, the ELF test showed good performance and considerable diagnostic value for the prediction of histological fibrosis stage and can be deemed a ‘good’ diagnostic tool in clinical practice for the staging of cirrhosis.
Acknowledgments
This manuscript has been edited and proofread by Textcheck and the certificate can beacquired from the following link. http://www.textcheck.com/login.
Author Contributions
Conceived and designed the experiments: SZ WW QX. Performed the experiments: QX XZ PH. Analyzed the data: QX JW. Wrote the paper: SZ WW QX.
References
- 1. National Institutes of Health Consensus Development Conference (2002) National Institutes of Health Consensus Development Conference Statement: Management of hepatitis C: 2002; June 10–12, 2002; Hepatology. 36: S3–20.
- 2. Bravo AA, Sheth SG, Chopra S (2001) Liver biopsy. N Engl J Med 344: 495–500.
- 3. Castera L, Negre I, Samii K, Buffet C (1999) Pain experienced during percutaneous liver biopsy. Hepatology 30: 1529–1530.
- 4. Bedossa P, Dargere D, Paradis V (2003) Sampling variability of liver fibrosis in chronic hepatitis C. Hepatology. 38: 1449–1457.
- 5. Rousselet MC, Michalak S, Dupre F, Croue A, Bedossa P, et al. (2005) Sources of variability in histological scoring of chronic viral hepatitis. Hepatology 41: 257–264.
- 6. Afdhal NH (2003) Diagnosing fibrosis in hepatitis C: is the pendulum swinging from biopsy to blood tests? Hepatology 37: 972–974.
- 7. Regev A, Berho M, Jeffers LJ, Milikowski C, Molina EG, et al. (2002) Sampling error and intraobserver variation in liver biopsy in patients with chronic HCV infection. Am J Gastroenterol 97: 2614–2618.
- 8. Afdhal NH, Nunes D (2004) Evaluation of liver fibrosis: a concise review. Am J Gastroenterol 99: 1160–1174.
- 9. Sandrin L, Fourquet B, Hasquenoph JM, Yon S, Fournier C, et al. (2003) Transient elastography: a new noninvasive method for assessment of hepatic fibrosis. Ultrasound Med Biol 29: 1705–1713.
- 10. Castera L, Foucher J, Bernard PH, Carvalho F, Allaix D, et al. (2010) Pitfalls of liver stiffness measurement: a 5-year prospective study of 13,369 examinations. Hepatology 51: 828–835.
- 11. Eriksson S, Fraser JR, Laurent TC, Pertoft H, Smedsrod B (1983) Endothelial cells are a site of uptake and degradation of hyaluronic acid in the liver. Exp Cell Res 144: 223–228.
- 12. Gomez DE, Alonso DF, Yoshiji H, Thorgeirsson UP (1997) Tissue inhibitors of metalloproteinases: structure, regulation and biological functions. Eur J Cell Biol 74: 111–122.
- 13. Arthur MJ, Mann DA, Iredale JP (1998) Tissue inhibitors of metalloproteinases, hepatic stellate cells and liver fibrosis. J Gastroenterol Hepatol 13 Suppl: S33–38.
- 14. Prakobwong S, Pinlaor S, Yongvanit P, Sithithaworn P, Pairojkul C, et al. (2009) Time profiles of the expression of metalloproteinases, tissue inhibitors of metalloproteases, cytokines and collagens in hamsters infected with Opisthorchis viverrini with special reference to peribiliary fibrosis and liver injury. Int J Parasitol 39: 825–835.
- 15. Kossakowska AE, Edwards DR, Lee SS, Urbanski LS, Stabbler AL, et al. (1998) Altered balance between matrix metalloproteinases and their inhibitors in experimental biliary fibrosis. Am J Pathol 153: 1895–1902.
- 16. Herbst H, Wege T, Milani S, Pellegrini G, Orzechowski HD, et al. (1997) Tissue inhibitor of metalloproteinase-1 and -2 RNA expression in rat and human liver fibrosis. Am J Pathol 150: 1647–1659.
- 17. Kivirikko KI, Myllyla R (1985) Post-translational processing of procollagens. Ann N Y Acad Sci 460: 187–201.
- 18. Horslev-Petersen K (1990) Circulating extracellular matrix components as markers for connective tissue response to inflammation. A clinical and experimental study with special emphasis on serum aminoterminal type III procollagen peptide in rheumatic diseases. Dan Med Bull 37: 308–329.
- 19. Entzian P, Huckstadt A, Kreipe H, Barth J (1990) Determination of serum concentrations of type III procollagen peptide in mechanically ventilated patients. Pronounced augmented concentrations in the adult respiratory distress syndrome. Am Rev Respir Dis 142: 1079–1082.
- 20. Waydhas C, Nast-Kolb D, Trupka A, Lenk S, Duswald KH, et al. (1993) Increased serum concentrations of procollagen type III peptide in severely injured patients: an indicator of fibrosing activity? Crit Care Med 21: 240–247.
- 21. Zarski JP, Sturm N, Guechot J, Zafrani ES, Vaubourdolle M, et al. (2013) Contribution of the ELFG test in algorithms of non-invasive markers towards the diagnosis of significant fibrosis in chronic hepatitis C. PLoS One. 8: e59088.
- 22. Yoo EJ, Kim BK, Kim SU, Park JY, Kim do Y, et al. (2013) Normal enhanced liver fibrosis (ELF) values in apparently healthy subjects undergoing a health check-up and in living liver donors in South Korea. Liver Int 33: 706–713.
- 23. Janciauskiene S, Wallmark A, Piitulainen E, Kohnlein T, Welted T, et al. (2011) Performance of enhanced liver fibrosis plasma markers in asymptomatic individuals with ZZ alpha1-antitrypsin deficiency. Eur J Gastroenterol Hepatol 23: 716–720.
- 24.
National Institute for Health Research National Horizon Scanning Centre (2008) Enhanced Liver Fibrosis Test (ELF) for evaluating liver fibrosis. Birmingham: National Horizon Scanning Centre 2008.
- 25. Whiting P, Rotes AW, Reitman JB, Bossuet PM, Keenen J (2003) The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol 3: 25.
- 26. Hollingworth W, Medina LS, Lenkinski RE, Shibata DK, Bernal B, et al. (2006) Interrater reliability in assessing quality of diagnostic accuracy studies using the QUADAS tool. A preliminary assessment. Acad Radiol 13: 803–810.
- 27. Whiting P, Harbord R, de Salis I, Egger M, Sterne J (2008) Evidence-based diagnosis. J Health Serv Res Policy 13 Suppl 357–63.
- 28. Ishak K, Baptista A, Bianchi L, Callea F, De Groote J, et al. (1995) Histological grading and staging of chronic hepatitis. J Hepatol 22: 696–699.
- 29. Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuet PM (2003) The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol 56: 1129–1135.
- 30. Reitman JB, Glas AS, Rotes AW, Scholten RJ, Bossuet PM, et al. (2005) Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. J Clin Epidemiol 58: 982–990.
- 31.
Chu H, Cole SR (2006) Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. J Clin Epidemiol 59: 1331–1332; author reply 1332–1333.
- 32. Nobili V, Parkes J, Bottazzo G, Marcellini M, Cross R, et al. (2009) Performance of ELF serum markers in predicting fibrosis stage in pediatric non-alcoholic fatty liver disease. Gastroenterology 136: 160–167.
- 33. Guha IN, Parkes J, Roderick P, Chattopadhyay D, Cross R, et al. (2008) Noninvasive markers of fibrosis in nonalcoholic fatty liver disease: Validating the European Liver Fibrosis Panel and exploring simple markers. Hepatology 47: 455–460.
- 34. Friedrich-Rust M, Rosenberg W, Parkes J, Herrmann E, Zeuzem S, et al. (2010) Comparison of ELF, FibroTest and FibroScan for the non-invasive assessment of liver fibrosis. BMC Gastroenterol 10: 103.
- 35. Parkes J, Guha IN, Roderick P, Harris S, Cross R, et al. (2011) Enhanced Liver Fibrosis (ELF) test accurately identifies liver fibrosis in patients with chronic hepatitis C. J Viral Hepat. 18: 23–31.
- 36. Guechot J, Trocme C, Renversez JC, Sturm N, Zarski JP (2012) Independent validation of the Enhanced Liver Fibrosis (ELF) score in the ANRS HC EP 23 Fibrostar cohort of patients with chronic hepatitis C. Clin Chem Lab Med. 50: 693–699.
- 37. Kim BK, Kim HS, Park JY, Kim do Y, Ahn SH, et al. (2012) Prospective validation of ELF test in comparison with Fibroscan and FibroTest to predict liver fibrosis in Asian subjects with chronic hepatitis B. PLoS One. 7: e41964.
- 38. Wahl K, Rosenberg W, Vaske B, Manns MP, Schulze-Osthoff K, et al. (2012) Biopsy-controlled liver fibrosis staging using the enhanced liver fibrosis (ELF) score compared to transient elastography. PLoS One 7: e51906.
- 39. Lichtinghagen R, Pietsch D, Bantel H, Manns MP, Brand K, et al. (2013) The Enhanced Liver Fibrosis (ELF) score: Normal values, influence factors and proposed cut-off values. J Hepatol 59: 236–242.
- 40. Wong GL, Chan HL, Choi PC, Chan AW, Yu Z, et al. (2014) Non-invasive algorithm of enhanced liver fibrosis and liver stiffness measurement with transient elastography for advanced liver fibrosis in chronic hepatitis B. Aliment Pharmacol Ther. 39: 197–208.
- 41. Ghany MG, Strader DB, Thomas DL, Seeff LB (2009) Diagnosis, management, and treatment of hepatitis C: an update. Hepatology 49: 1335–1374.
- 42. Friedrich-Rust M, Ong MF, Martens S, Sarrazin C, Bojunga J, et al. (2008) Performance of transient elastography for the staging of liver fibrosis: a meta-analysis. Gastroenterology 134: 960–974.
- 43. Berenguer M (2009) Non-invasive biomarkers of liver fibrosis in liver transplant patients with hepatitis C: can we avoid liver biopsies? Dig Liver Dis 41: 226–228.
- 44. Kamphues C, Lotz K, Rocken C, Berg T, Eurich D, et al. (2010) Chances and limitations of non-invasive tests in the assessment of liver fibrosis in liver transplant patients. Clin Transplant 24: 652–659.
- 45. Foucher J, Chanteloup E, Vergniol J, Castera L, Le Bail B, et al. (2006) Diagnosis of cirrhosis by transient elastography (FibroScan): a prospective study. Gut 55: 403–408.
- 46. The French METAVIR Cooperative Study Group (1994) Intraobserver and interobserver variations in liver biopsy interpretation in patients with chronic hepatitis C. Hepatology. 20: 15–20.
- 47. Parkes J, Roderick P, Harris S, Day C, Mutimer D, et al. (2010) Enhanced liver fibrosis test can predict clinical outcomes in patients with chronic liver disease. Gut 59: 1245–1251.
- 48. Mayo MJ, Parkes J, Adams-Huet B, Combes B, Mills AS, et al. (2008) Prediction of clinical outcomes in primary biliary cirrhosis by serum enhanced liver fibrosis assay. Hepatology 48: 1549–1557.
- 49. Trepo E, Potthoff A, Pradat P, Bakshi R, Young B, et al. (2011) Role of a cirrhosis risk score for the early prediction of fibrosis progression in hepatitis C patients with minimal liver disease. J Hepatol 55: 38–44.
- 50. Swets JA (1988) Measuring the accuracy of diagnostic systems. Science 240: 1285–1293.
- 51. Guha IN, Myers RP, Patel K, Talwalkar JA (2011) Biomarkers of liver fibrosis: what lies beneath the receiver operating characteristic curve? Hepatology 54: 1454–1462.
- 52. Mehta SH, Lau B, Afdhal NH, Thomas DL (2009) Exceeding the limits of liver histology markers. J Hepatol 50: 36–41.
- 53. Cholongitas E, Quaglia A, Samonakis D, Senzolo M, Triantos C, et al. (2006) Transjugular liver biopsy: how good is it for accurate histological interpretation? Gut 55: 1789–1794.