- About this Journal ·
- Abstracting and Indexing ·
- Aims and Scope ·
- Annual Issues ·
- Article Processing Charges ·
- Articles in Press ·
- Author Guidelines ·
- Bibliographic Information ·
- Citations to this Journal ·
- Contact Information ·
- Editorial Board ·
- Editorial Workflow ·
- Free eTOC Alerts ·
- Publication Ethics ·
- Reviewers Acknowledgment ·
- Submit a Manuscript ·
- Subscription Information ·
- Table of Contents
Journal of Biomedicine and Biotechnology
Volume 2011 (2011), Article ID 875309, 8 pages
Sparse Logistic Regression for Diagnosis of Liver Fibrosis in Rat by Using SCAD-Penalized Likelihood
1Department of Mathematics, Southeast University, Nanjing 210096, China
2Department of Mathematics, China Pharmaceutical University, Nanjing 210009, China
3State Key Laboratory of Natural Medicines, China Pharmaceutical University, Nanjing 210009, China
Received 28 November 2010; Revised 3 February 2011; Accepted 24 March 2011
Academic Editor: Sanford I. Bernstein
Copyright © 2011 Fang-Rong Yan et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
The objective of the present study is to find out the quantitative relationship between progression of liver fibrosis and the levels of certain serum markers using mathematic model. We provide the sparse logistic regression by using smoothly clipped absolute deviation (SCAD) penalized function to diagnose the liver fibrosis in rats. Not only does it give a sparse solution with high accuracy, it also provides the users with the precise probabilities of classification with the class information. In the simulative case and the experiment case, the proposed method is comparable to the stepwise linear discriminant analysis (SLDA) and the sparse logistic regression with least absolute shrinkage and selection operator (LASSO) penalty, by using receiver operating characteristic (ROC) with bayesian bootstrap estimating area under the curve (AUC) diagnostic sensitivity for selected variable. Results show that the new approach provides a good correlation between the serum marker levels and the liver fibrosis induced by thioacetamide (TAA) in rats. Meanwhile, this approach might also be used in predicting the development of liver cirrhosis.
Chronic hepatitis, characterized by hepatic fibrosis, is recognized as a health problem with a worldwide prevalence, and it may gradually progress toward cirrhosis and hepatocellular carcinoma which may induce death. Successful and early treatment of chronic hepatitis can prevent development of cirrhosis and hepatocellular carcinoma. There are two major symptoms of chronic hepatitis: necroinflammatory activity and fibrosis. Liver fibrosis is the best sign for predicting the development of liver cirrhosis . Since there is no correlation between aminotransferase activities and fibrosis, aminotransferase activities cannot be used for the diagnosis of fibrosis. Considering that liver fibrosis is reversible in the early stage, accurate and early diagnosis of liver fibrosis is required for better prognosis of chronic hepatitis.
Liver biopsy has to date been the gold standard for the grading of hepatic inflammation and the staging of hepatic fibrosis and has been used as the reference standard method in evaluations of plasma markers of liver diseases . However, it is an expensive, invasive procedure with a considerable risk of complications (particularly bleeding) and a small chance (<1 : 1000) of death . And liver biopsy sample is only 1 : 50000th of the mass of the liver and therefore causing the risk of false negative. Even with sample of adequate sized biopsies, cirrhosis may still be missed in 15–30% of liver biopsies . Due to the limitations of biopsy including the small but significant mortality rates, sampling error, inter- and intraobserver variation in pathology reporting, and provision of a static picture of liver architecture in a dynamic disease process, it is still necessary to look for alternative approaches. Moreover, to evaluate drug efficacy, it is essential to establish appropriate animal models of liver fibrosis. Since establishing an animal model is time-consuming, usually lasting 8 to 12 weeks, histopathologic examination may lead to the consumption of animals, and the testing small proportion cannot reflect the condition of whole population. All these would increase the cost and decrease the efficiency and reliability of the research. In order to build appropriate animal models for liver fibrosis, also it is necessary to develop a reliable and accurate method to diagnose liver fibrosis quickly.
The search of a noninvasive method to assess liver fibrosis has encouraged the development of various approaches. Transient elastography for the noninvasive measurement of liver stiffness was developed [5–7]. Currently, it is notable that monitoring serum markers of liver fibrosis could offer an attractive alternative to liver biopsy, as it allows dynamic calibration of fibrosis efficaciously. Liver fibrosis is characterized by an overall increase of the extracellular matrix, mainly produced by hepatic stellate cells (HSCs) [8, 9], which undergo a phenotypic switch induced within the inflammation process by numerous cells and cytokines. A number of potential serum markers of fibrosis and cirrhosis have been used in the diagnosis of a variety of chronic liver diseases.
Therefore, monitoring a variety of plasma markers, especially collagen-related biomarkers such as aminoterminal peptide of procollagen III (PIIINP), is a novel approach for liver fibrosis diagnosis. In general, there are many plasma markers identified but some of them still have not been determined yet. So constructing a sparse classification for the progression of liver fibrosis based on detected plasma markers has attracted much attention. A novel method is linear discriminant analysis with stepwise variable selection. Guyon et al.  proposed a recursive feature elimination technique with support vector machine to analyze gene expression data. Rocke and Nguyen  raised dimension reduction of microarray-based classification. Li et al.  introduced two bayesian approaches with technique of automatic relevance determination for the same problem. Debashis and Arul  suggested that linear discriminant function by optimal scoring with LASSO was an alternative approach. Sparse Fisher's linear discriminant analysis, suggested by Qiao et al. , was also an excellent method.
The aim of this study, therefore, is to develop classification rules based on the consideration of measures of diagnostic accuracy. In particular, we are interested in finding liver fibrosis that can discriminate between two populations. Our solution was to combine the problems of variable selection and classification. We suggested an approach for classification using the smoothly clipped absolute deviation penalty (SCAD)  approach with logistic regression . We compared it with the stepwise linear discriminant analysis (SLDA) and sparse logistic regression (SLR) with least absolute shrinkage and selection operator (LASSO-)penalized function [17, 18]. At last, we analyzed the sensitivity of these methods using the receiver operating characteristic (ROC). Considering the small sample size, we fit the ROC curve and compute the area under the curve (AUC) using Bayesian bootstrap [19, 20].
2. Materials and Method
Twenty-eight Sprague-Dawley (SD) rats were provided from SLAC Laboratory Animal Co.ltd (Shanghai, China, SCXK: 2007-0005). The rats were maintained under specific-pathogen-free conditions, with a constant temperature ranging between 25 and 27°C, and a constant humidity ranging between 45 and 50% at animal laboratory of China Pharmaceutical University. Animal care was in accordance with the guidelines of the animal laboratory of China Pharmaceutical University.
2.2. Induction Of Liver Fibrosis
The modeling method is in accord with Imanishi et al.  and Kuriyama et al. . The rats were randomly divided into 4 subgroups: (I) model group (8 weeks, ), (II) model group (12 weeks, ), (III) normal control group (8 weeks, ), and (IV) normal control group (12 weeks, ). All rats were observed at 8th week and 12th week after TAA treatment. Rats in the model subgroup were injected intraperitoneally (i.p) with TAA 3 consecutive days per week and lasted for 8 weeks at a dose of 6% TAA 200 mg/kg as an initial dose. The doses after the first time were modified according to weekly weight and AST changes in response to TAA during the induction. Rats in normal control groups were treated with saline. After the final administration in the 8th and 12th weeks, blood samples were collected and serum was separated by centrifugation at 4°C and kept at −20°C for further analysis. Then all rats were sacrificed under anesthesia. The livers were washed with cold saline, and a part of the right hepatic lobular was removed and stored in liquid nitrogen for content detection of hydroxyproline. The remaining part of the right hepatic lobular was made into slices for pathological diagnosis. Several serum markers and liver function indices studied in clinical research were measured at the 8th and 12th weeks, respectively. There are many serum markers reported as the liver function indices. After consideration, we ultimately chose hyaluronan (HA), serum laminin (LN), collagen Type I (Col I), IV collagen (IVC), procollagen III (PC-III), aspartate aminotransferase (AST), albumin (Alb), hydroxyproline (Hyp), total protein (TP), and total bilirubin (T.Bil) [7, 23] in this study. The liver tissue slices were observed and diagnosed by HE, Masson-trichrome staining, and transmission electron microscope. Then the relationship between the serum index and the occurrence of liver fibrosis was analyzed by statistics model.
2.3. Statistics Model and Solution
2.3.1. Statistics Model.
Let be input-output pairs of a given data set, where in is variable levels of plasma markers and in is the type of liver fibrosis occurs or not identified in liver biopsy. Here, is the number of liver biopsy and is the number of plasma markers. For binary logistic regression, we can write it as where . Then, the log-likelihood function of this binary logistic regression is Further, the SCAD-penalized maximum likelihood function is where for some and .
In general, may be different coefficients. Here, we make . In other words, the same penalty function is applied to each component of . Generally, can be selected by GCV. Another alternative penalized function is the least absolute shrinkage and selection operator . They suggested the penalized function could be selected with . The algorithm can be carried with least angle regression . Making , the penalized maximum likelihood with LASSO is Once the regression coefficient is estimated, the classifier is constructed as follows. Let be the cost of classifying an observation to the class when the true class is . Then, a new tissue sample with plasma markers is classified into class , where becomes In practice, are equal which is most frequent. So minimum is equal to .
In this study, we principally discuss the SCAD penalized. It can be locally approximated by a quadratic function as follows: In other words, Then, the penalized log-likelihood can be locally approximated by where We then estimate as follows: where
, , , and is an index matrix. Given the good initial value , the penalized maximum likelihood can be as efficient as the fully iterative procedure.
2.3.3. Simulation Studies
In this subsection, we numerically compare the proposed approach of variable selection and classification methods with SLDA and LASSO methods.
We simulate 1000 datasets when = 20, 40, 60, 100 respectively, from the model , where and . The previous six components of come from a standard normal distribution. The correlation between and is with . The last two components of are independently and identically distributed as a Bernoulli distribution with probability of success 0.5. All covariates are standardized. This model was used in Tibshirani et al. . The classification standard is based on the probability .
Define The true classification ratio is computed via 1000 Monte Carlo simulations. The summary of simulation results is depicted in Table 1.
Table 1 shows that the true classification ratio associates with the sample size . With the increase of the sample size , the true classification ratio tends to one. Another important key point: three methods are all working well for large sample size .
3.1. Histopathology of Liver Fibrosis
Typical liver fibrosis was induced after 8 weeks of TAA treatment, with the hepatofibrosis pathological characteristics of fibroblast extending around from central venous or portal area, forming the obvious fiber separator without the formation of false lobules. From the light microscope, it could be seen that pathological slice of normal animals had clear lobule, there was no edema or denatured fat in liver cells, and Sinus hepaticus had no expansion and congestion (Figures 1(a) and 1(d)). The pathological slice of model animals had obvious fibroplasias extending from the central venous or portal area to surrounding area, which formed the clear fibrous septa. The liver cells had mild steatosis with lipid droplet and vacuoles accompanied by mild bile duct hyperplasia (Figures 1(b), 1(c), 1(e), and 1(f)).
3.2. Serum Markers Analysis
According to Table 3, there was a major difference between the normal group and control group in several serum markers and liver function indices such as HA,LN, IVC, and I Collogen. During the 1st–4th weeks, AST activity reached the peak and there is no significant difference () in the 5th to 8th weeks (Table 2). In Figure 2, it is shown that after peak value AST activity gradually decreased and returned to normal during the 12th week. As a matter of fact the level of AST in human goes up obviously during acute hepatitis, and it correlate with the severity of the disease. Then the activity of AST decreases during the course of liver fibrosis . AST activity of control group was significantly higher than the normal group and decreased slightly in the 12th week without TAA for four weeks which agrees with the literature . At last typical liver fibrosis was induced after 8 weeks of TAA.
We applied the proposed sparse logistic regression with SCAD, LASSO, and SLDA to the classification of liver fibrosis. The dataset consisted of 26 observations. The binary response variable is 1 for those rats who have liver fibrosis and 0 otherwise. All the twelve covariates are considered. All covariates’ meanings were listed in Table 4.
Carrying out the procedure, including the SLDA, SLR-SCAD, SLR-LASSO, then the outcome about the selected variable and the classification true rates were obtained, respectively, according to Tables 5 and 6.
3.4. Test Significance
The receiver operating characteristic (ROC) curve is an excellent method to test the significance of selected variables. The ROC curve is a plot of the true positive fraction (TPF) as a function the false positive fraction (FPF), or sensitivity versus one minus specificity, and is obtained by varying the threshold criterion distinguishing between a positive and negative diagnosis. For example, the diagnostic variables are for the population without liver fibrosis and are for those with liver fibrosis, where and are the distribution functions. Some features such as the invariance property and interpretation of the area under the curve (AUC) as make the ROC analysis extremely popular in diagnostics research. Generally, the selected variables are sensitive for the classification if the . However, estimation of AUC for the ROC curve is very difficult, especially for the small sample size. Here, we use the Bayesian bootstrap (BB) estimation of AUC, proposed by Kuriyama et al. , to test the variables in SLDA, LASSO, and SCAD. The AUC calculation results are shown in Table 7, displaying the sensitivity for classification variable . Figure 3 described these covariates’ ROC curves.
The ROC of , , and are more than 0.7, and they represent the hydroxyproline, LN, and hyaluronan, respectively.
As shown in Table 7 and Figure 3, we come to a conclusion that some covariates may be very important for diagnosis of the occurrence of liver fibrosis, such as hydroxyproline, LN, hyaluronan, as the AUCs for these covariates are more than 0.7.
Fortunately, these covariates are all selected by the three statistical models. Though SLR-SCAD chose only two covariates, it gets higher diagnostic accuracy, equaling to SLDA, better than SLR-LASSO, as shown in Tables 5 and 6. It elucidates that by using SLR-SCAD we could obtain high diagnostic accuracy with fewer serum indices so as to save the experiment cost. Meanwhile, the SLDA and SLAR-LASSO also display well. But their high diagnosis accuracy needs more variables to be selected.
4. Discussion and Conclusion
It has been thought that the research on liver fibrosis is entering a new era of the whole wound and heal reaction . The ideal animal model, which is a reliable and reproducible on hepatic fibrosis, should have the basic pathological characteristics with the same phase change on pathology as human liver fibrosis. However, there are some defects on detection methods in the process of establishing animal model. Considering the limitation of traditional test method in modeling, we propose an alternative approach to construct the quantification between fibrotic condition and serum indices. Since accurate diagnosis of liver fibrosis remains a difficult and crucial problem in both the animal models and patients, an ongoing challenge is to identify new prognostic markers that are directly related to liver fibrosis and that can more accurately predict the likelihood of gaining liver fibrosis. Here we introduce a new approach to the jointing problems of simultaneous classification and variable selection utilizing the sparse logistics regression with SCAD-penalized function. The proposed method is applied in our study to analysis the data of plasma makers for diagnosis of the liver fibrosis in rat model and to determine the occurrence of cirrhosis.
In this study, the pathological section results were used to determine whether the reliable animal model with liver fibrosis induced by the dose individualization of TAA was established successfully. Despite, there is, difference between liver biopsy of human in clinic and pathological section of dead animal, they are both expensive, invasive and have a chance of death, especially the inevitable death of animals. It is because that the pathological slice from the whole rat’s liver could supply the highest accuracy that the results can be as the standard to verify the outcome of statistical model. There is no doubt that sacrificing animal life attributes to significant mortality rates and disobeys the morality and ethics. Our proposed method by using serum indices may indeed greatly decrease the consumption of a lot of animals when used in hepatic drug screening.
Monitoring a variety of plasma markers, especially the levels of collagen-related markers, is becoming a novel approach of liver fibrosis diagnosis with simple procedure and high sensitivity and accuracy. According to Table 1, the novel SLR-SCAD method performs as well as other well-known methods such as SLDA and SLR-LASSO in statistical classification and variable selection. They all perform well for the fixed sample size. The SLR-SCAD achieved higher classification ratio by the two selected variables, hydroxyproline and LN, which are reasonable by the verification of ROC curve. The two variables also have significant sense in clinic. If SLDA and SLR-LASSO want to obtain higher classification, they need to test more serum indices. In addition, it is mentioned that the SLDA method has its own drawback especially when the variables have collinearity [26, 29]. Compared with the SLDA and SLR-LASSO methods, SLR-SCAD is quite befitting for penalized regressions.
It will be a very useful approach to determine the occurrence of liver fibrosis in animals based on statistic models with fairly high diagnosis accuracy and without loss of animals. The occurrence of liver fibrosis can be effectively estimated in rats by using our proposed SLR-SCAD method with the right serum indices. In summary, we propose a new method by combining the analysis of serum index of fibrosis and statistic model which represent a reliable diagnostic and prognostic approach of liver disease. It could be beneficial to extend this study to other fields where classification and many variables exist.
The authors gratefully acknowledge the Editor, Associate Editor, and referees for their valuable comments and suggestions that substantially improved the paper. The project is supported by NSFC 11001052.
- C. Timothy, A. Charalambos, and H. Phillip, “Non-invasive markers for the prediction of fibrosis in chronic hepatitis C infection,” Hepatology Research, vol. 38, no. 8, pp. 762–769, 2008.
- R. A. Standish, E. Cholongitas, A. Dhillon, A. K. Burroughs, and A. P. Dhillon, “An appraisal of the histopathological assessment of liver fibrosis,” Gut, vol. 55, no. 4, pp. 569–578, 2006.
- J. L. Dienstag, “The role of liver biopsy in chronic hepatitis C,” Hepatology, vol. 36, no. 5, pp. S152–S160, 2002.
- A. Regev, M. Berho, L. J. Jeffers et al., “Sampling error and intraobserver variation in liver biopsy in patients with chronic HCV infection,” American Journal of Gastroenterology, vol. 97, no. 10, pp. 2614–2618, 2002.
- Y. Kentaro, K. Naoto, and H. Senju, “Transient elastography: applications and limitations,” Hepatology Research, vol. 38, no. 11, pp. 1063–1068, 2008.
- S. C. Gordon, I. Jacobson, C. Hézode et al., “Evaluation of a panel of non-invasive serum markers to differentiate mild from moderate-to-advanced liver fibrosis in chronic hepatitis C patients,” Journal of Hepatology, vol. 41, no. 6, pp. 935–942, 2004.
- E. Giannini and R. Testa, “Noninvasive diagnosis of fibrosis: the truth is rarely pure and never simple,” Hepatology, vol. 38, no. 5, pp. 1312–1313, 2003.
- S. Naveau, B. Raynard, V. Ratziu et al., “Biomarkers for the prediction of liver fibrosis in patients with chronic alcoholic liver disease,” Clinical Gastroenterology and Hepatology, vol. 3, no. 2, pp. 167–174, 2005.
- E. Rossi, L. Adams, A. Prins et al., “Validation of the FibroTest biochemical markers score in assessing liver fibrosis in hepatitis C patients,” Clinical Chemistry, vol. 49, no. 3, pp. 450–454, 2003.
- I. Guyon, J. Weston, S. Barnhill, and V. Vapnik, “Gene selection for cancer classification using support vector machines,” Machine Learning, vol. 46, no. 1–3, pp. 389–422, 2002.
- D. M. Rocke and D. V. Nguyen, “On partial least squares dimension reduction for microarray-based classification: a simulation study,” Computational Statistics and Data Analysis, vol. 46, no. 3, pp. 407–425, 2004.
- Y. Li, C. Campbell, and M. Tipping, “Bayesian automatic relevance determination algorithms for classifying gene expression data,” Bioinformatics, vol. 18, no. 10, pp. 1332–1339, 2002.
- G. Debashis and M. C. Arul, “Classification and selection of biomarkers in genomic data using LASSO,” Journal of Biomedicine and Biotechnology, vol. 2005, no. 2, pp. 147–154, 2005.
- Z. Qiao, L. Zhou, and J. Z. Huang, “Sparse linear discriminant analysis with applications to high dimensional low sample size data,” IAENG International Journal of Applied Mathematics, vol. 39, no. 1, pp. 1–13, 2009.
- J. Fan and R. Li, “Variable selection via nonconcave penalized likelihood and its oracle properties,” Journal of the American Statistical Association, vol. 96, no. 456, pp. 1348–1360, 2001.
- Y. Kim, S. Kwon, and S. Heun Song, “Multiclass sparse logistic regression for classification of multiple cancer types using gene expression data,” Computational Statistics and Data Analysis, vol. 51, no. 3, pp. 1643–1655, 2006.
- R. J. Tibshirani, “Regression coefficient and autoregressive order shrinkage and selection via the LASSO,” Journal of the Royal Statistical Society B, vol. 58, no. 1, pp. 267–288, 1996.
- R. Tibshirani, “The LASSO method for variable selection in the cox model,” Statistics in Medicine, vol. 16, no. 4, pp. 385–395, 1997.
- D. B. Rubin, “The bayesian bootstrap,” The Annals of Statistic, vol. 9, no. 1, pp. 130–134, 1981.
- J. Gu, S. Ghosal, and A. Roy, “Bayesian bootstrap estimation of ROC curve,” Statistics in Medicine, vol. 27, no. 26, pp. 5407–5420, 2008.
- Y. Imanishi, N. Maeda, K. Otogawa et al., “Herb medicine Inchin-ko-to (TJ-135) regulates PDGF-BB-dependent signaling pathways of hepatic stellate cells in primary culture and attenuates development of liver fibrosis induced by thioacetamide administration in rats,” Journal of Hepatology, vol. 41, no. 2, pp. 242–250, 2004.
- S. Kuriyama, M. Yamazaki, A. Mitoro et al., “Hepatocellular carcinoma in an orthotopic mouse model metastasizes intrahepatically in cirrhotic but not in normal liver,” International Journal of Cancer, vol. 80, no. 3, pp. 471–476, 1999.
- P. Bedossa, D. Dargère, and V. Paradis, “Sampling variability of liver fibrosis in chronic hepatitis C,” Hepatology, vol. 38, no. 6, pp. 1449–1457, 2003.
- J. Fan and H. Peng, “Nonconcave penalized likelihood with a diverging number of parameters,” Annals of Statistics, vol. 32, no. 3, pp. 928–961, 2003.
- B. Efron, T. Hastie, I. Johnstone et al., “Least angle regression,” Annals of Statistics, vol. 32, no. 2, pp. 407–499, 2004.
- P. L. Flom and D. L. Cassell, “Stopping stepwise: why stepwise and similar selection methods are bad, and what use,” in Proceedings of the 20th Conference for the NorthEast SAS® Users Group (NESUG '07), 2007.
- F. H. Anderson, L. Zeng, N. R. Rock, and E. M. Yoshida, “An assessment of the clinical utility of serum ALT and AST in chronic hepatitis C,” Hepatology Research, vol. 18, no. 1, pp. 63–71, 2000.
- S. L. Friedman, D. C. Rockey, and D. M. Bissell, “Hepatic fibrosis 2006: report of the third AASLD single topic conference,” Hepatology, vol. 45, no. 1, pp. 242–249, 2007.
- F. E. Harrell, Regression Modeling Strategies: With Applications to Linear Mode to Logistic Regression, and Survival Analysis, Springe, New York, NY, USA, 2001.