Table of Contents
Advances in Artificial Neural Systems
Volume 2016 (2016), Article ID 2303181, 11 pages
http://dx.doi.org/10.1155/2016/2303181
Research Article

A State-Based Sensitivity Analysis for Distinguishing the Global Importance of Predictor Variables in Artificial Neural Networks

1Management Department, College of Business, Frostburg State University, Frostburg, MD 21532, USA
2Palm Island Enviro-Informatics LLC, Sarasota, FL 34232, USA
3Department of Industrial and Systems Engineering, Russ College of Engineering and Technology, Ohio University, Athens, OH 45701, USA
4Management Information Systems Department, College of Business, Ohio University, Athens, OH 45701, USA

Received 11 April 2016; Accepted 29 June 2016

Academic Editor: Ozgur Kisi

Copyright © 2016 Ehsan Ardjmand et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. L. N. de Castro, “Fundamentals of natural computing: an overview,” Physics of Life Reviews, vol. 4, no. 1, pp. 1–36, 2007. View at Publisher · View at Google Scholar · View at Scopus
  2. K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, no. 5, pp. 359–366, 1989. View at Publisher · View at Google Scholar · View at Scopus
  3. S. J. Kemp, P. Zaradic, and F. Hansen, “An approach for determining relative input parameter importance and significance in artificial neural networks,” Ecological Modelling, vol. 204, no. 3-4, pp. 326–334, 2007. View at Publisher · View at Google Scholar · View at Scopus
  4. E. Borgonovo, W. Castaings, and S. Tarantola, “Model emulation and moment-independent sensitivity analysis: an application to environmental modelling,” Environmental Modelling & Software, vol. 34, pp. 105–115, 2012. View at Publisher · View at Google Scholar · View at Scopus
  5. G. Weckman, D. Millie, C. Ganduri et al., “Knowledge extraction from the neural ‘black box’ in ecological monitoring,” Journal of Industrial and Systems Engineering, vol. 3, no. 1, pp. 38–55, 2009. View at Google Scholar
  6. D. F. Millie, G. R. Weckman, W. A. Young, J. E. Ivey, H. J. Carrick, and G. L. Fahnenstiel, “Modeling microalgal abundance with artificial neural networks: demonstration of a heuristic ‘Grey-Box’ to deconvolve and quantify environmental influences,” Environmental Modelling and Software, vol. 38, pp. 27–39, 2012. View at Publisher · View at Google Scholar · View at Scopus
  7. M. Gevrey, I. Dimopoulos, and S. Lek, “Review and comparison of methods to study the contribution of variables in artificial neural network models,” Ecological Modelling, vol. 160, no. 3, pp. 249–264, 2003. View at Publisher · View at Google Scholar · View at Scopus
  8. J. D. Olden, M. K. Joy, and R. G. Death, “An accurate comparison of methods for quantifying variable importance in artificial neural networks using simulated data,” Ecological Modelling, vol. 178, no. 3-4, pp. 389–397, 2004. View at Publisher · View at Google Scholar · View at Scopus
  9. O. Pastor-Bárcenas, E. Soria-Olivas, J. D. Martín-Guerrero, G. Camps-Valls, J. L. Carrasco-Rodríguez, and S. Del Valle-Tascón, “Unbiased sensitivity analysis and pruning techniques in neural networks for surface ozone modelling,” Ecological Modelling, vol. 182, no. 2, pp. 149–158, 2005. View at Publisher · View at Google Scholar · View at Scopus
  10. W.-S. Lee, Y.-S. Kwon, Y.-S. Park, T.-S. Chon, and J.-C. Yoo, “Evaluation of environmental factors to predict breeding success of Black-tailed Gulls,” Ecological Informatics, vol. 1, no. 3, pp. 331–339, 2006. View at Publisher · View at Google Scholar · View at Scopus
  11. A. M. Mouton, A. P. Dedecker, S. Lek, and P. L. M. Goethals, “Selecting variables for habitat suitability of Asellus (Crustacea, Isopoda) by applying input variable contribution methods to artificial neural network models,” Environmental Modeling and Assessment, vol. 15, no. 1, pp. 65–79, 2010. View at Publisher · View at Google Scholar · View at Scopus
  12. J. Cariboni, D. Gatelli, R. Liska, and A. Saltelli, “The role of sensitivity analysis in ecological modelling,” Ecological Modelling, vol. 203, no. 1-2, pp. 167–182, 2007. View at Publisher · View at Google Scholar · View at Scopus
  13. A. Saltelli, S. Tarantola, and F. Campolongo, “Sensitivity analysis as an ingredient of modeling,” Statistical Science, vol. 15, no. 4, pp. 377–395, 2000. View at Publisher · View at Google Scholar · View at MathSciNet
  14. A. Saltelli, S. Tarantola, F. Campolongo, and M. Ratto, Sensitivity Analysis in Practice, John Wiley & Sons, Sussex, UK, 2004. View at MathSciNet
  15. A. Saltelli, M. Ratto, T. Andres et al., Global Sensitivity Analysis: The Primer, John Wiley & Sons, Chichester, UK, 2008.
  16. D. F. Millie, G. R. Weckman, W. A. Young et al., “Coastal ‘big data’ and nature-inspired computation: prediction potentials, uncertainties, and knowledge derivation of neural networks for an algal metric,” Estuarine, Coastal and Shelf Science, vol. 125, pp. 57–67, 2013. View at Publisher · View at Google Scholar · View at Scopus
  17. D. F. Millie, G. R. Weckman, G. L. Fahnenstiel et al., “Using artificial intelligence for cyanoHAB niche modeling: discovery and visualization of Microcystis–environmental associations within western Lake Erie,” Canadian Journal of Fisheries & Aquatic Sciences, vol. 71, no. 11, pp. 1642–1654, 2014. View at Publisher · View at Google Scholar · View at Scopus
  18. S. Lek, A. Belaud, P. Baran, I. Dimopoulos, and M. Delacoste, “Role of some environmental variables in trout abundance models using neural networks,” Aquatic Living Resources, vol. 9, no. 1, pp. 23–29, 1996. View at Publisher · View at Google Scholar · View at Scopus
  19. D. Yeung, I. Cloete, D. Shi, and W. Ng, Sensitivity Analysis for Neural Networks, Neural Computing Series, Springer, Berlin, Germany, 2010.
  20. A. P. Engelbrecht, I. Cloete, and J. M. Zurada, “Determining the significance of input parameters using sensitivity analysis,” in From Natural to Artificial Neural Computation, J. Mira and F. Sandoval, Eds., vol. 930 of Lecture Notes in Computer Science, pp. 382–388, 1995. View at Publisher · View at Google Scholar
  21. M. Wang, J. Wright, R. Buswell, and A. Brownlee, “A comparison of approaches to stepwise regression for global sensitivity analysis used with evolutionary optimization,” in Proceedings of the 13th Conference of International Building Performance Simulation Association (BS '13), pp. 2551–2558, Chambéry, France, 2013.
  22. S. Wagner, “Global sensitivity analysis of predictor models in software engineering,” in Proceedings of the IEEE International Workshop on Predictor Models in Software Engineering, PROMISE'07: ICSE Workshops 2007, Minneapolis, Minn, USA, May 2007. View at Publisher · View at Google Scholar
  23. R. Muñoz-Carpena, Z. Zajac, and Y.-M. Kuo, “Global sensitivity and uncertainty analyses of the water quality model VFSMOD-W,” Transactions of the ASABE, vol. 50, no. 5, pp. 1719–1732, 2007. View at Publisher · View at Google Scholar · View at Scopus
  24. E. Kent, S. Neumann, U. Kummer, and P. Mendes, “What can we learn from global sensitivity analysis of biochemical systems?” PLoS ONE, vol. 8, no. 11, Article ID e79244, 2013. View at Publisher · View at Google Scholar · View at Scopus
  25. R. Confalonieri, G. Bellocchi, S. Bregaglio, M. Donatelli, and M. Acutis, “Comparison of sensitivity analysis techniques: a case study with the rice model WARM,” Ecological Modelling, vol. 221, no. 16, pp. 1897–1906, 2010. View at Publisher · View at Google Scholar · View at Scopus
  26. J. Yang, “Convergence and uncertainty analyses in Monte-Carlo based sensitivity analysis,” Environmental Modelling and Software, vol. 26, no. 4, pp. 444–457, 2011. View at Publisher · View at Google Scholar · View at Scopus
  27. A. Saltelli, F. Campolongo, and J. Cariboni, “Screening important inputs in models with strong interaction properties,” Reliability Engineering and System Safety, vol. 94, no. 7, pp. 1149–1155, 2009. View at Publisher · View at Google Scholar · View at Scopus
  28. B. Iooss and P. Lemaître, “A review on global sensitivity analysis methods,” in Uncertainty Management in Simulation-Optimization of Complex Systems, G. Dellino and C. Meloni, Eds., vol. 59, pp. 101–122, Springer, New York, NY, USA, 2015. View at Google Scholar
  29. J. S. Coggan, T. M. Bartol, E. Esquenazi et al., “Evidence for ectopic neurotransmission at a neuronal synapse,” Science, vol. 309, no. 5733, pp. 446–451, 2005. View at Publisher · View at Google Scholar · View at Scopus
  30. I. Sobol, “Sensitivity analysis for non-linear mathematical models,” Mathematical Modeling & Computational Experiment, vol. 1, pp. 407–414, 1993. View at Google Scholar
  31. U. Reuter and M. Liebscher, Global Sensitivity Analysis in View of Nonlinear Structural Behaviour, LS- DYNA Anwenderforum, Bamberg, Germany, 2008.
  32. C.-S. Zhan, X.-M. Song, J. Xia, and C. Tong, “An efficient integrated approach for global sensitivity analysis of hydrological model parameters,” Environmental Modelling and Software, vol. 41, pp. 39–52, 2013. View at Publisher · View at Google Scholar · View at Scopus
  33. R. I. Cukier, H. B. Levine, and K. E. Shuler, “Nonlinear sensitivity analysis of multiparameter model systems,” Journal of Computational Physics, vol. 26, no. 1, pp. 1–42, 1978. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet · View at Scopus
  34. S. L. Özesmi and U. Özesmi, “An artificial neural network approach to spatial habitat modelling with interspecific interaction,” Ecological Modelling, vol. 116, no. 1, pp. 15–31, 1999. View at Publisher · View at Google Scholar · View at Scopus
  35. J. D. Olden, “An artificial neural network approach for studying phytoplankton succession,” Hydrobiologia, vol. 436, pp. 131–143, 2000. View at Publisher · View at Google Scholar · View at Scopus
  36. D. F. Millie, G. R. Weckman, R. J. Pigg et al., “Modeling phytoplankton abundance in Saginaw Bay, Lake Huron: using artificial neural networks to discern functional influence of environmental variables and relevance to a great lakes observing system,” Journal of Phycology, vol. 42, no. 2, pp. 336–349, 2006. View at Publisher · View at Google Scholar · View at Scopus
  37. D. F. Millie, G. R. Weckman, H. W. Paerl et al., “Neural net modeling of estuarine indicators: hindcasting phytoplankton biomass and net ecosystem production in the Neuse (North Carolina) and Trout (Florida) Rivers, USA,” Ecological Indicators, vol. 6, no. 3, pp. 589–608, 2006. View at Publisher · View at Google Scholar · View at Scopus
  38. J. D. Olden and D. A. Jackson, “Illuminating the ‘black box’: a randomization approach for understanding variable contributions in artificial neural networks,” Ecological Modelling, vol. 154, no. 1-2, pp. 135–150, 2002. View at Publisher · View at Google Scholar · View at Scopus
  39. C. Karul, S. Soyupak, A. F. Çilesiz, N. Akbay, and E. Germen, “Case studies on the use of neural networks in eutrophication modeling,” Ecological Modelling, vol. 134, no. 2-3, pp. 145–152, 2000. View at Publisher · View at Google Scholar · View at Scopus
  40. H. Gurbuz, E. Kivrak, S. Soyupak, and S. V. Yerli, “Predicting dominant phytoplankton quantities in a reservoir by using neural networks,” Hydrobiologia, vol. 504, pp. 133–141, 2003. View at Publisher · View at Google Scholar · View at Scopus
  41. J. C. Gower, “A general coefficient of similarity and some of its properties,” Biometrics, vol. 27, no. 4, pp. 857–872, 1971. View at Publisher · View at Google Scholar
  42. E. Smith, “Uncertainty analysis,” in Encyclopedia of Environmetrics, A. H. El-Shaarawi and W. W. Piegorsch, Eds., pp. 2283–2297, John Wiley & Sons, Chichester, UK, 2002. View at Google Scholar
  43. A. Saltelli, M. Ratto, S. Tarantola, and F. Campolongo, “Sensitivity analysis practices: strategies for model-based inference,” Reliability Engineering and System Safety, vol. 91, no. 10-11, pp. 1109–1125, 2006. View at Publisher · View at Google Scholar · View at Scopus
  44. S. Holtzman, Intelligent Decision Systems, Addison-Wesley, Reading, Mass, USA, 1989.
  45. M. Gevrey, I. Dimopoulos, and S. Lek, “Two-way interaction of input variables in the sensitivity analysis of neural network models,” Ecological Modelling, vol. 195, no. 1-2, pp. 43–50, 2006. View at Publisher · View at Google Scholar · View at Scopus
  46. I. Dimopoulos, J. Chronopoulos, A. Chronopoulou-Sereli, and S. Lek, “Neural network models to study relationships between lead concentration in grasses and permanent urban descriptors in Athens city (Greece),” Ecological Modelling, vol. 120, no. 2-3, pp. 157–165, 1999. View at Publisher · View at Google Scholar · View at Scopus
  47. Y.-S. Park, J. Rabinovich, and S. Lek, “Sensitivity analysis and stability patterns of two-species pest models using artificial neural networks,” Ecological Modelling, vol. 204, no. 3-4, pp. 427–438, 2007. View at Publisher · View at Google Scholar · View at Scopus
  48. C. Vasilakos, K. Kalabokidis, J. Hatzopoulos, and I. Matsinos, “Identifying wildland fire ignition factors through sensitivity analysis of a neural network,” Natural Hazards, vol. 50, no. 1, pp. 125–143, 2009. View at Publisher · View at Google Scholar · View at Scopus
  49. K.-S. Jeong, D.-K. Kim, and G.-J. Joo, “River phytoplankton prediction model by Artificial Neural Network: model performance and selection of input variables to predict time-series phytoplankton proliferations in a regulated river system,” Ecological Informatics, vol. 1, no. 3, pp. 235–245, 2006. View at Publisher · View at Google Scholar · View at Scopus
  50. S. Lek and J. F. Guégan, “Artificial neural networks as a tool in ecological modelling, an introduction,” Ecological Modelling, vol. 120, no. 2-3, pp. 65–73, 1999. View at Publisher · View at Google Scholar · View at Scopus