Table of Contents
ISRN Applied Mathematics
Volume 2011, Article ID 145801, 12 pages
http://dx.doi.org/10.5402/2011/145801
Research Article

Lyapunov Stability Analysis of Gradient Descent-Learning Algorithm in Network Training

Mechanical Agriculture Department, Tarbiat Modares University, Tehran, P.O. Box 14115-336, Iran

Received 17 March 2011; Accepted 13 May 2011

Academic Editors: J.-J. Ruckmann and L. Simoni

Copyright © 2011 Ahmad Banakar. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. K. S. Narendra and K. Parthasarathy, “Identification and control of dynamical systems using neural networks,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 4–27, 1990. View at Publisher · View at Google Scholar · View at PubMed
  2. S. Z. Qin, H. T. Su, and T. J. McAvoy, “Comparison of four neural net learning methods for dynamic system identification,” IEEE Transactions on Neural Networks, vol. 3, no. 1, pp. 122–130, 1992. View at Publisher · View at Google Scholar · View at PubMed
  3. T. Yabuta and T. Yamada, “Learning control using neural networks,” in Proceedings of the IEEE International Conference on Robotics and Automation, (ICRA '91), pp. 740–745, Sacramento, Calif, USA, April 1991.
  4. P. Frasconi, M. Gori, and G. Soda, “Local feedback multilayered networks,” Neural Computation, vol. 7, no. 1, pp. 120–130, 1992. View at Google Scholar
  5. J. C. Patra, R. N. Pal, B. N. Chatterji, and G. Panda, “Identification of nonlinear dynamic systems using functional link artificial neural networks,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 29, no. 2, pp. 254–262, 1999. View at Publisher · View at Google Scholar · View at PubMed
  6. Q. Zhang and A. Benveniste, “Wavelet networks,” IEEE Transactions on Neural Networks, vol. 3, no. 6, pp. 889–898, 1992. View at Publisher · View at Google Scholar · View at PubMed
  7. J. Zhang, G. G. Walter, Y. Miao, and W. Lee, “Wavelet neural networks for function learning,” IEEE Transactions on Signal Processing, vol. 43, no. 6, pp. 1485–1497, 1995. View at Publisher · View at Google Scholar
  8. T. I. Boubez and R. L. Peskin, “Wavelet neural networks and receptive field partitioning,” in Proceedings of the IEEE International Conference on Neural Networks, pp. 1544–1549, San Francisco, Calif, USA, March 1993.
  9. A. Banakar and M. F. Azeem, “Artificial wavelet neural network and its application in neuro-fuzzy models,” Applied Soft Computing, vol. 8, no. 4, pp. 1463–1485, 2008. View at Publisher · View at Google Scholar
  10. Q. Zhang, “Using wavelet network in nonparametric estimation,” IEEE Transactions on Neural Networks, vol. 8, no. 2, pp. 227–236, 1997. View at Publisher · View at Google Scholar · View at PubMed
  11. A. Benveniste, B. Juditsky, B. Delyon, Q. Zhang, and P. Y. Glorennec, “Wavelets in identification,” in Proceedings of the 10th IFAC Symposium on System Identification, (SYSID '94), Copenhagen, Denmark, July 1994. View at Publisher · View at Google Scholar · View at PubMed
  12. X. D. Li, J. K. L. Ho, and T. W. S. Chow, “Approximation of dynamical time-variant systems by continuous-time recurrent neural networks,” IEEE Transactions on Circuits and Systems, vol. 52, no. 10, pp. 656–660, 2005. View at Google Scholar
  13. B. Srinivasan, U. R. Prasad, and N. J. Rao, “Back propagation through adjoints for the identification of nonlinear dynamic systems using recurrent neural models,” IEEE Transactions on Neural Networks, vol. 5, no. 2, pp. 213–228, 1994. View at Publisher · View at Google Scholar · View at PubMed
  14. P. Frasconi and M. Gori, “Computational capabilities of local-feedback recurrent networks acting as finite-state machines,” IEEE Transactions on Neural Networks, vol. 7, no. 6, pp. 1520–1525, 1996. View at Google Scholar
  15. R. A. Jacobs, M. I. Jordan, S. J. Nowlan, and G. E. Hinton, “Adaptive mixtures of local experts,” Neural Computation, vol. 3, pp. 79–87, 1991. View at Publisher · View at Google Scholar
  16. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing I, D. E. Rumelhart and J. L. McClelland, Eds., pp. 675–695, MIT Press, Cambridge, UK, 1986. View at Google Scholar
  17. P. Werbos, “Generalization of backpropagation with application to a recurrent gas Markov model,” Neural Networks, vol. 1, pp. 339–356, 1988. View at Google Scholar
  18. R. J. Williams and D. Zipser, “A learning algorithm for continually running fully recurrent networks,” Neural Networks, vol. 1, pp. 270–280, 1989. View at Google Scholar
  19. R. J. Williams and D. Zipser, “Mechanical system modeling using recurrent neural networks via quasi-Newton learning methods,” Applied Mathematical Modeling, vol. 19, no. 7, pp. 421–428, 1995. View at Publisher · View at Google Scholar
  20. C.-F. Juang, “A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms,” IEEE Transactions on Fuzzy Systems, vol. 10, no. 2, pp. 155–170, 2002. View at Publisher · View at Google Scholar
  21. C.-H. Lee and C.-C. Teng, “Identification and control of dynamic systems using recurrent fuzzy neural networks,” IEEE Transactions on Fuzzy Systems, vol. 8, no. 4, pp. 349–366, 2000. View at Publisher · View at Google Scholar
  22. P. A. Mastorocostas and J. B. Theocharis, “A recurrent fuzzy-neural model for dynamic system identification,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 32, no. 2, pp. 176–190, 2002. View at Publisher · View at Google Scholar · View at PubMed
  23. S. J. Yoo, Y. H. Choi, and J. B. Park, “Generalized predictive control based on self-recurrent wavelet neural network for stable path tracking of mobile robots: adaptive learning rates approach,” IEEE Transactions on Circuits and Systems, vol. 53, no. 6, pp. 1381–1394, 2006. View at Publisher · View at Google Scholar · View at MathSciNet
  24. T. G. Barbounis, J. B. Theocharis, M. C. Alexiadis, and P. S. Dokopoulos, “Long-term wind speed and power forecasting using local recurrent neural network models,” IEEE Transactions on Energy Conversion, vol. 21, no. 1, pp. 273–284, 2006. View at Publisher · View at Google Scholar
  25. T. Takagi and M. Sugeno, “Fuzzy identification of systems and its applications to modeling and control,” IEEE Transactions on Systems, Man and Cybernetics, vol. 15, no. 1, pp. 116–132, 1985. View at Google Scholar · View at Zentralblatt MATH
  26. J. S. R. Jang, “ANFIS: adaptive-network-based fuzzy inference system,” IEEE Transactions on Systems, Man and Cybernetics, vol. 23, no. 3, pp. 665–685, 1993. View at Publisher · View at Google Scholar