Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2013 (2013), Article ID 379690, 13 pages
http://dx.doi.org/10.1155/2013/379690
Research Article

Weight-Selected Attribute Bagging for Credit Scoring

Beijing Laboratory of Intelligent Information Technology, School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China

Received 21 March 2013; Accepted 29 April 2013

Academic Editor: Yudong Zhang

Copyright © 2013 Jianwu Li et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. H. L. Chen, B. Yang, G. Wang et al., “A novel bankruptcy prediction model based on an adaptive fuzzy k-nearest neighbor method,” Knowledge-Based Systems, vol. 24, no. 8, pp. 1348–1359, 2011. View at Publisher · View at Google Scholar · View at Scopus
  2. B. Yang, L. X. Li, Q. Xie, and J. Xu, “Development of a KBS for managing bank loan risk,” Knowledge-Based Systems, vol. 14, no. 5-6, pp. 299–302, 2001. View at Publisher · View at Google Scholar · View at Scopus
  3. L. C. Thomas, D. B. Edelman, and J. N. Crook, Credit Scoring and Its Applications, SIAM Monographs on Mathematical Modeling and Computation, SIAM, Philadelphia, Pa, USA, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  4. J. N. Crook, D. B. Edelman, and L. C. Thomas, “Recent developments in consumer credit risk assessment,” European Journal of Operational Research, vol. 183, no. 3, pp. 1447–1465, 2007. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  5. J. H. Myers and E. W. Forgy, “The development of numerical credit evaluation systems,” Journal of the American Statistical Association, vol. 58, no. 303, pp. 799–806, 1963. View at Google Scholar
  6. J. C. Wiginton, “A note on the comparison of logit and discriminant models of consumer credit behavior,” Journal of Financial Quantitative Analysis, vol. 15, no. 3, pp. 757–770, 1980. View at Google Scholar
  7. P. Makowski, “Credit scoring branches out,” Credit World, vol. 74, no. 2, pp. 30–37, 1985. View at Google Scholar
  8. X. Y. Zhou, D. F. Zhang, and Y. Jiang, “A new credit scoring method based on rough sets and decision tree,” in Advances in Knowledge Discovery and Data Mining, vol. 5012 of Lecture Notes in Computer Science, pp. 1081–1089, Springer, New York, NY, USA, 2008. View at Publisher · View at Google Scholar · View at Scopus
  9. W. E. Henley and D. J. Hand, “Construction of a k-nearest-neighbor credit-scoring system,” IMA Journal of Management Mathematics, vol. 8, no. 4, pp. 305–321, 1997. View at Google Scholar
  10. H. L. Jensen, “Using neural networks for credit scoring,” Managerial Finance, vol. 18, no. 6, pp. 15–26, 1992. View at Google Scholar
  11. D. West, “Neural network credit scoring models,” Computers and Operations Research, vol. 27, no. 11-12, pp. 1131–1152, 2000. View at Publisher · View at Google Scholar · View at Scopus
  12. V. S. Desai, D. G. Conway, J. N. Crook, and G. A. J. R. Overstreet, “Credit-scoring models in the credit-union environment using neural networks and genetic algorithms,” IMA Journal of Management Mathematics, vol. 8, no. 4, pp. 323–346, 1997. View at Google Scholar
  13. M. B. Yobas, J. N. Crook, and P. Ross, “Credit scoring using neural and evolutionary techniques,” IMA Journal of Mathematics Applied in Business and Industry, vol. 11, no. 2, pp. 111–125, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  14. D. F. Zhang, H. Y. Huang, Q. S. Chen, and Y. Jiang, “A comparison study of credit scoring models,” in Proceedings of the 3rd International Conference on Natural Computation (ICNC '07), vol. 1, pp. 15–18, Haikou, China, August 2007. View at Publisher · View at Google Scholar · View at Scopus
  15. H. A. Abdou, “Genetic programming for credit scoring: the case of Egyptian public sector banks,” Expert Systems with Applications, vol. 36, no. 9, pp. 11402–11417, 2009. View at Publisher · View at Google Scholar · View at Scopus
  16. J. J. Huang, G. H. Tzeng, and C. S. Ong, “Two-stage genetic programming (2SGP) for the credit scoring model,” Applied Mathematics and Computation, vol. 174, no. 2, pp. 1039–1053, 2006. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  17. K. Leung, F. Cheong, and C. Cheong, “Consumer credit scoring using an artificial immune system algorithm,” in Proceedings of the IEEE Congress on Evolutionary Computation (CEC '07), pp. 3377–3384, Singapore, September 2007. View at Publisher · View at Google Scholar · View at Scopus
  18. K. K. Lai, L. Yu, L. G. Zhou, and S. Y. Wang, “Credit risk evaluation with least square support vector machine,” in Rough Sets and Knowledge Technology, vol. 4062 of Lecture Notes in Computer Science, pp. 490–495, Springer, New York, NY, USA, 2006. View at Google Scholar · View at Scopus
  19. K. B. Schebesch and R. Sleeking, “Support vector machines for classifying and describing credit applicants: detecting typical and critical regions,” Journal of the Operational Research Society, vol. 56, no. 9, pp. 1082–1088, 2005. View at Publisher · View at Google Scholar · View at Scopus
  20. D. Zhang, X. Y. Zhou, S. C. H. Leung, and J. Zheng, “Vertical bagging decision trees model for credit scoring,” Expert Systems with Applications, vol. 37, no. 12, pp. 7838–7843, 2010. View at Publisher · View at Google Scholar · View at Scopus
  21. S. L. Lin, “A new two-stage hybrid approach of credit risk in banking industry,” Expert Systems with Applications, vol. 36, no. 4, pp. 8333–8341, 2009. View at Publisher · View at Google Scholar · View at Scopus
  22. N. C. Hsieh, “Hybrid mining approach in the design of credit scoring models,” Expert Systems with Applications, vol. 28, no. 4, pp. 655–665, 2005. View at Publisher · View at Google Scholar · View at Scopus
  23. D. Zhang, M. Hifi, Q. Chen, and W. Ye, “A hybrid credit scoring model based on genetic programming and support vector machines,” in Proceedings of the 4th International Conference on Natural Computation (ICNC '08), vol. 7, pp. 8–12, Jinan, China, October 2008. View at Publisher · View at Google Scholar · View at Scopus
  24. L. Zhou, K. K. Lai, and L. Yu, “Least squares support vector machines ensemble models for credit scoring,” Expert Systems with Applications, vol. 37, no. 1, pp. 127–133, 2010. View at Publisher · View at Google Scholar · View at Scopus
  25. T. G. Dietterich, “Machine-learning research: four current directions,” AI Magazine, vol. 18, no. 4, pp. 97–136, 1997. View at Google Scholar · View at Scopus
  26. R. O. Duda, P. H. Hart, and D. G. Stork, Pattern Classification, Wiley-Interscience, New York, NY, USA, 2000.
  27. L. Breiman, “Bagging predictors,” Machine Learning, vol. 24, no. 2, pp. 123–140, 1996. View at Google Scholar · View at Scopus
  28. L. Breiman, “Bias, variance, and arcing classifiers,” Tech. Rep. 460, University of California, Department of Statistics, Berkeley, Calif, USA, 1996. View at Google Scholar
  29. Y. Freund and R. Schapire, “Experiments with a new boosting algorithm,” in Proceedings of the 13th International Conference on Machine Learning, pp. 148–156, Bari, Italy, 1996.
  30. R. Bryll, R. Gutierrez-Osuna, and F. Quek, “Attribute bagging: improving accuracy of classifier ensembles by using random feature subsets,” Pattern Recognition, vol. 36, no. 6, pp. 1291–1302, 2003. View at Publisher · View at Google Scholar · View at Scopus
  31. K. Tumer and N. C. Oza, “Decimated input ensembles for improved generalization,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '99), pp. 3069–3074, Washington, DC, USA, July 1999. View at Scopus
  32. K. Tumer and J. Ghosh, “Classifier combining: analytical results and implications, Working notes from the workshop ‘integrating multiple learned models’,” in Proceedings of the 13th National Conference on Artificial Intelligence, Portland, Ore, USA, August 19961996.
  33. D. Opitz, “Feature selection for ensembles,” in Proceedings of the 16th AAAI National Conference on Artificial Intelligence, pp. 379–384, Orlando, Fla, USA, 1999.
  34. D. Opitz and R. Maclin, “Popular ensemble methods: an empirical study,” Journal of Artificial Intelligence Research, vol. 11, pp. 169–198, 1999. View at Google Scholar · View at Scopus
  35. L. Nanni and A. Lumini, “An experimental comparison of ensemble of classifiers for bankruptcy prediction and credit scoring,” Expert Systems with Applications, vol. 36, no. 2, pp. 3028–3033, 2009. View at Publisher · View at Google Scholar · View at Scopus
  36. G. Wang, J. Ma, L. Huang, and K. Xu, “Two credit scoring models based on dual strategy ensemble trees,” Knowledge-Based Systems, vol. 26, pp. 61–68, 2012. View at Publisher · View at Google Scholar
  37. P. Ravisankar and V. Ravi, “Financial distress prediction in banks using group method of data handling neural network, counter propagation neural network and fuzzy ARTMAP,” Knowledge-Based Systems, vol. 23, no. 8, pp. 823–831, 2010. View at Publisher · View at Google Scholar · View at Scopus
  38. C. F. Tsai, “Feature selection in bankruptcy prediction,” Knowledge-Based Systems, vol. 22, no. 2, pp. 120–127, 2009. View at Publisher · View at Google Scholar · View at Scopus
  39. A. Asuncion and D. J. Newman, UCI Machine Learning Repository, School of Information and Computer Science, University of California, Irvine, Calif, USA, 2007, http://www.ics.uci.edu/~mlearn/MLRepository.html.
  40. Y. Freund and R. E. Schapire, “A decision-theoretic generalization of on-line learning and an application to boosting,” Journal of Computer and System Sciences, vol. 55, no. 1, pp. 119–139, 1997. View at Google Scholar · View at Scopus
  41. C. Guerra-Salcedo and D. Whitley, “Genetic approach to feature selection for ensemble creation,” in Proceedings of the Genetic and Evolutionary Computation Conference (GECCO '99), pp. 236–243, Morgan Kaufmann, 1999.
  42. V. Vapnik, The Nature of Statistical Learning Theory, Springer, Berlin, Germany, 1995.
  43. B. Janez, G. Marko, M. Natasa, and M. Dunja, “Feature selection using linear support vector machines,” Tech. Rep. MSR-TR-2002-63, Microsoft Research Microsoft Corporation, 2002. View at Google Scholar
  44. R. P. W. Duin, P. Juszczak, P. Paclik et al., PRTools4. 1, A Matlab Toolbox for Pattern Recognition, 2007, http://www.prtools.org/.
  45. Y. Zhang and L. Wu, “Stock market prediction of S&P 500 via combination of improved BCO approach and BP neural network,” Expert Systems with Applications, vol. 36, no. 5, pp. 8849–8854, 2009. View at Publisher · View at Google Scholar · View at Scopus
  46. Y. Zhang, Z. Dong, L. Wu, and S. Wang, “A hybrid method for MRI brain image classification,” Expert Systems with Applications, vol. 38, no. 8, pp. 10049–10053, 2011. View at Publisher · View at Google Scholar · View at Scopus