Table of Contents
ISRN Applied Mathematics
Volume 2012 (2012), Article ID 324194, 34 pages
http://dx.doi.org/10.5402/2012/324194
Review Article

Using Radial Basis Function Networks for Function Approximation and Classification

1Enjoyor Laboratories, Enjoyor Inc., Hangzhou 310030, China
2Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, Canada H3G 1M8

Received 16 November 2011; Accepted 5 December 2011

Academic Editors: E. Gallopoulos, E. Kita, and M. Sun

Copyright © 2012 Yue Wu et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart and J. L. McClelland, Eds., vol. 1, pp. 318–362, MIT Press, Cambridge, Mass, USA, 1986. View at Google Scholar
  2. K.-L. Du and M. N. S. Swamy, Neural Networks in a Softcomputing Framework, Springer, London, UK, 2006.
  3. D. S. Broomhead and D. Lowe, “Multivariable functional interpolation and adaptive networks,” Complex Systems, vol. 2, no. 3, pp. 321–355, 1988. View at Google Scholar · View at Zentralblatt MATH
  4. M. J. D. Powell, “Radial basis functions for multivariable interpolation: a review,” in Algorithms for Approximation, J. C. Mason and M. G. Cox, Eds., vol. 10 of Institute of Mathematics & Its Applications Conference Series, pp. 143–167, Oxford University Press, Oxford, UK, 1987. View at Google Scholar · View at Zentralblatt MATH
  5. M. Klaseen and Y. H. Pao, “The functional link net in structural pattern recognition,” in Proceedings of the IEEE Region Conference on Computer and Communication Systems (IEEE TENCON '90), vol. 2, pp. 567–571, Hong Kong, September 1990. View at Scopus
  6. T. Poggio and F. Girosi, “Networks for approximation and learning,” Proceedings of the IEEE, vol. 78, no. 9, pp. 1481–1497, 1990. View at Publisher · View at Google Scholar · View at Scopus
  7. F. Girosi and T. Poggio, “Networks and the best approximation property,” Biological Cybernetics, vol. 63, no. 3, pp. 169–176, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  8. J. S. Albus, “A new approach to manipulator control: cerebellar model articulation control (CMAC),” Journal of Dynamic Systems, Measurement and Control, vol. 97, no. 3, pp. 220–227, 1975. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  9. W. T. Miller, F. H. Glanz, and L. G. Kraft, “CMAC: an associative neural network alternative to backpropagation,” Proceedings of the IEEE, vol. 78, no. 10, pp. 1561–1567, 1990. View at Publisher · View at Google Scholar · View at Scopus
  10. N. E. Cotter and T. J. Guillerm, “The CMAC and a theorem of Kolmogorov,” Neural Networks, vol. 5, no. 2, pp. 221–228, 1992. View at Publisher · View at Google Scholar · View at Scopus
  11. M. Brown, C. J. Harris, and P. C. Parks, “The interpolation capabilities of the binary CMAC,” Neural Networks, vol. 6, no. 3, pp. 429–440, 1993. View at Publisher · View at Google Scholar · View at Scopus
  12. J. Park and I. W. Sanberg, “Universal approximation using radial-basis-function networks,” Neural Computation, vol. 2, pp. 246–257, 1991. View at Google Scholar
  13. Y. Liao, S. C. Fang, and H. L. W. Nuttle, “Relaxed conditions for radial-basis function networks to be universal approximators,” Neural Networks, vol. 16, no. 7, pp. 1019–1028, 2003. View at Publisher · View at Google Scholar · View at Scopus
  14. C. A. Micchelli, “Interpolation of scattered data: distance matrices and conditionally positive definite functions,” Constructive Approximation, vol. 2, no. 1, pp. 11–22, 1986. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  15. N. B. Karayiannis, “Reformulated radial basis neural networks trained by gradient descent,” IEEE Transactions on Neural Networks, vol. 10, no. 3, pp. 657–671, 1999. View at Publisher · View at Google Scholar · View at Scopus
  16. S. Chen, S. A. Billings, C. F. N. Cowan, and P. M. Grant, “Practical identification of NARMAX models using radial basis functions,” International Journal of Control, vol. 52, no. 6, pp. 1327–1350, 1990. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  17. G. B. Huang, L. Chen, and C. K. Siew, “Universal approximation using incremental constructive feedforward networks with random hidden nodes,” IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 879–892, 2006. View at Publisher · View at Google Scholar · View at Scopus
  18. K. L. Du, K. K. M. Cheng, and M. N. S. Swamy, “A fast neural beamformer for antenna arrays,” in Proceedings of the International Conference on Communications (ICC '02), vol. 1, pp. 139–144, New York, NY, USA, May 2002. View at Scopus
  19. A. R. Webb, “Functional approximation by feed-forward networks: a least-squares approach to generalization,” IEEE Transactions on Neural Networks, vol. 5, no. 3, pp. 363–371, 1994. View at Publisher · View at Google Scholar · View at Scopus
  20. D. Lowe, “On the use of nonlocal and non positive definite basis functions in radial basis function networks,” in Proceedings of the 4th International Conference on Artificial Neural Networks, pp. 206–211, Cambridge, UK, 1995.
  21. J. Meinguet, “Multivariate interpolation at arbitrary points made simple,” Journal of Applied Mathematics and Physics, vol. 30, no. 2, pp. 292–304, 1979. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  22. I. Rojas, H. Pomares, J. L. Bernier et al., “Time series analysis using normalized PG-RBF network with regression weights,” Neurocomputing, vol. 42, pp. 267–285, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  23. C. C. Lee, P. C. Chung, J. R. Tsai, and C. I. Chang, “Robust radial basis function neural networks,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 29, no. 6, pp. 674–685, 1999. View at Google Scholar · View at Scopus
  24. S. J. Lee and C. L. Hou, “An ART-based construction of RBF networks,” IEEE Transactions on Neural Networks, vol. 13, no. 6, pp. 1308–1321, 2002. View at Publisher · View at Google Scholar · View at Scopus
  25. R. J. Schilling, J. J. Carroll, and A. F. Al-Ajlouni, “Approximation of nonlinear systems with radial basis function neural networks,” IEEE Transactions on Neural Networks, vol. 12, no. 1, pp. 1–15, 2001. View at Publisher · View at Google Scholar · View at Scopus
  26. P. Singla, K. Subbarao, and J. L. Junkins, “Direction-dependent learning approach for radial basis function networks,” IEEE Transactions on Neural Networks, vol. 18, no. 1, pp. 203–222, 2007. View at Publisher · View at Google Scholar · View at Scopus
  27. P. A. Devijver and J. Kittler, Pattern Recognition: A Statistical Approach, Prentice-Hall International, Englewood Cliffs, NJ, USA, 1982.
  28. S. Haykin, Neural Networks: A Comprehensive Foundation, Prentice Hall, Upper Saddle River, NJ, USA, 2nd edition, 1999.
  29. A. V. D. Sanchez, “Second derivative dependent placement of RBF centers,” Neurocomputing, vol. 7, no. 3, pp. 311–317, 1995. View at Publisher · View at Google Scholar · View at Scopus
  30. J. Moody and C. J. Darken, “Fast learning in networks of locally-tuned processing units,” Neural Computation, vol. 1, no. 2, pp. 281–294, 1989. View at Publisher · View at Google Scholar
  31. C. L. Chen, W. C. Chen, and F. Y. Chang, “Hybrid learning algorithm for Gaussian potential function networks,” IEE Proceedings D, vol. 140, no. 6, pp. 442–448, 1993. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  32. T. Kohonen, Self-Organization and Associative Memory, vol. 8 of Springer Series in Information Sciences, Springer, Berlin, Germany, 3rd edition, 1989.
  33. K. L. Du, “Clustering: a neural network approach,” Neural Networks, vol. 23, no. 1, pp. 89–107, 2010. View at Publisher · View at Google Scholar · View at Scopus
  34. G. H. Golub and C. F. van Loan, Matrix Computation, John Hopkins University Press, Baltimore, Md, USA, 2nd edition, 1989.
  35. Y. Abe and Y. Iiguni, “Fast computation of RBF coefficients for regularly sampled inputs,” Electronics Letters, vol. 39, no. 6, pp. 543–544, 2003. View at Publisher · View at Google Scholar · View at Scopus
  36. K. J. Astrom and B. Wittenmark, Adaptive Control, Addison-Wesley, Reading, Mass, USA, 1995.
  37. W. Kaminski and P. Strumillo, “Kernel orthonormalization in radial basis function neural networks,” IEEE Transactions on Neural Networks, vol. 8, no. 5, pp. 1177–1183, 1997. View at Publisher · View at Google Scholar · View at Scopus
  38. S. Chen, C. F. N. Cowan, and P. M. Grant, “Orthogonal least squares learning algorithm for radial basis function networks,” IEEE Transactions on Neural Networks, vol. 2, no. 2, pp. 302–309, 1991. View at Publisher · View at Google Scholar · View at Scopus
  39. S. Chen, P. M. Grant, and C. F. N. Cowan, “Orthogonal least-squares algorithm for training multioutput radial basis function networks,” IEE Proceedings, Part F, vol. 139, no. 6, pp. 378–384, 1992. View at Publisher · View at Google Scholar · View at Scopus
  40. S. Chen and J. Wigger, “Fast orthogonal least squares algorithm for efficient subset model selection,” IEEE Transactions on Signal Processing, vol. 43, no. 7, pp. 1713–1715, 1995. View at Publisher · View at Google Scholar · View at Scopus
  41. X. Hong and S. A. Billings, “Givens rotation based fast backward elimination algorithm for RBF neural network pruning,” IEE Proceedings: Control Theory and Applications, vol. 144, no. 5, pp. 381–384, 1997. View at Google Scholar
  42. H. Akaike, “A new look at the statistical model identification,” Institute of Electrical and Electronics Engineers, vol. 19, pp. 716–723, 1974. View at Google Scholar · View at Zentralblatt MATH
  43. M. J. L. Orr, “Regularization in the selection of radial basis function centers,” Neural Computation, vol. 7, no. 3, pp. 606–623, 1995. View at Publisher · View at Google Scholar
  44. S. Chen, E. S. Chng, and K. Alkadhimi, “Regularized orthogonal least squares algorithm for constructing radial basis function networks,” International Journal of Control, vol. 64, no. 5, pp. 829–837, 1996. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  45. S. Chen, X. Hong, C. J. Harris, and P. M. Sharkey, “Sparse modelling using orthogonal forward regression with press statistic and regularization,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 34, no. 2, pp. 898–911, 2004. View at Publisher · View at Google Scholar · View at Scopus
  46. K. Z. Mao, “RBF neural network center selection based on Fisher ratio class separability measure,” IEEE Transactions on Neural Networks, vol. 13, no. 5, pp. 1211–1217, 2002. View at Publisher · View at Google Scholar · View at Scopus
  47. J. E. Bobrow and W. Murray, “An algorithm for RLS identification of parameters that vary quickly with time,” Institute of Electrical and Electronics Engineers, vol. 38, no. 2, pp. 351–354, 1993. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  48. D. L. Yu, J. B. Gomm, and D. Williams, “A recursive orthogonal least squares algorithm for training RBF networks,” Neural Processing Letters, vol. 5, no. 3, pp. 167–176, 1997. View at Publisher · View at Google Scholar · View at Scopus
  49. J. B. Gomm and D. L. Yu, “Selecting radial basis function network centers with recursive orthogonal least squares training,” IEEE Transactions on Neural Networks, vol. 11, no. 2, pp. 306–314, 2000. View at Publisher · View at Google Scholar · View at Scopus
  50. H. Akaike, “Fitting autoregressive models for prediction,” Annals of the Institute of Statistical Mathematics, vol. 21, pp. 243–247, 1969. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  51. D. Wettschereck and T. Dietterich, “Improving the performance of radial basis function networks by learning center locations,” in Advances in Neural Information Processing Systems, J. E. Moody, S. J. Hanson, and R. P. Lippmann, Eds., vol. 4, pp. 1133–1140, Morgan Kauffmann, San Mateo, Calif, USA, 1992. View at Google Scholar
  52. D. Gorinevsky, “An approach to parametric nonlinear least square optimization and application to task-level learning control,” Institute of Electrical and Electronics Engineers, vol. 42, no. 7, pp. 912–927, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  53. S. McLoone, M. D. Brown, G. Irwin, and G. Lightbody, “A hybrid linear/nonlinear training algorithm for feedforward neural networks,” IEEE Transactions on Neural Networks, vol. 9, no. 4, pp. 669–684, 1998. View at Publisher · View at Google Scholar · View at Scopus
  54. H. Peng, T. Ozaki, V. Haggan-Ozaki, and Y. Toyoda, “A parameter optimization method for radial basis function type models,” IEEE Transactions on Neural Networks, vol. 14, no. 2, pp. 432–438, 2003. View at Publisher · View at Google Scholar · View at Scopus
  55. D. Simon, “Training radial basis neural networks with the extended Kalman filter,” Neurocomputing, vol. 48, pp. 455–475, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  56. I. B. Ciocoiu, “RBF networks training using a dual extended Kalman filter,” Neurocomputing, vol. 48, pp. 609–622, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  57. M.-T. Vakil-Baghmisheh and N. Pavešić, “Training RBF networks with selective backpropagation,” Neurocomputing, vol. 62, no. 1–4, pp. 39–64, 2004. View at Publisher · View at Google Scholar
  58. M. T. Vakil-Baghmisheh and N. Pavešić, “A fast simplified fuzzy ARTMAP network,” Neural Processing Letters, vol. 17, no. 3, pp. 273–316, 2003. View at Publisher · View at Google Scholar · View at Scopus
  59. N. B. Karayiannis and Y. Xiong, “Training reformulated radial basis function neural networks capable of identifying uncertainty in data classification,” IEEE Transactions on Neural Networks, vol. 17, no. 5, pp. 1222–1233, 2006. View at Publisher · View at Google Scholar · View at Scopus
  60. A. Roy, S. Govil, and R. Miranda, “An algorithm to generate radial basis function (RBF)-like nets for classification problems,” Neural Networks, vol. 8, no. 2, pp. 179–201, 1995. View at Publisher · View at Google Scholar · View at Scopus
  61. M. Heiss and S. Kampl, “Multiplication-free radial basis function network,” IEEE Transactions on Neural Networks, vol. 7, no. 6, pp. 1461–1464, 1996. View at Publisher · View at Google Scholar · View at Scopus
  62. A. P. Dempster, N. M. Laird, and D. B. Rubin, “Maximum likelihood from incomplete data via the EM algorithm,” Journal of the Royal Statistical Society. Series B. Methodological, vol. 39, no. 1, pp. 1–38, 1977. View at Google Scholar · View at Zentralblatt MATH
  63. M. Lázaro, I. Santamaría, and C. Pantaleón, “A new EM-based training algorithm for RBF networks,” Neural Networks, vol. 16, no. 1, pp. 69–77, 2003. View at Publisher · View at Google Scholar
  64. R. Langari, L. Wang, and J. Yen, “Radial basis function networks, regression weights, and the expectation—maximization algorithm,” IEEE Transactions on Systems, Man, and Cybernetics Part A, vol. 27, no. 5, pp. 613–623, 1997. View at Publisher · View at Google Scholar · View at Scopus
  65. A. Ukrainec and S. Haykin, “A mutual information-based learning strategy and its application to radar,” in Fuzzy Logic and Neural Network Handbook, C. H. Chen, Ed., pp. 12.3–12.26, McGraw-Hill, New York, NY, USA, 1996. View at Google Scholar
  66. M. E. Tipping and D. Lowe, “Shadow targets: a novel algorithm for topographic projections by radial basis functions,” Neurocomputing, vol. 19, no. 1–3, pp. 211–222, 1998. View at Publisher · View at Google Scholar · View at Scopus
  67. P. András, “Orthogonal RBF neural network approximation,” Neural Processing Letters, vol. 9, no. 2, pp. 141–151, 1999. View at Publisher · View at Google Scholar · View at Scopus
  68. D. F. Specht, “Probabilistic neural networks,” Neural Networks, vol. 3, no. 1, pp. 109–118, 1990. View at Publisher · View at Google Scholar · View at Scopus
  69. M. K. Titsias and A. C. Likas, “Shared kernel models for class conditional density estimation,” IEEE Transactions on Neural Networks, vol. 12, no. 5, pp. 987–997, 2001. View at Publisher · View at Google Scholar · View at Scopus
  70. C. Constantinopoulos and A. Likas, “An incremental training method for the probabilistic RBF network,” IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 966–974, 2006. View at Publisher · View at Google Scholar · View at Scopus
  71. G. B. Huang, Q. Y. Zhu, and C. K. Siew, “Extreme learning machine: theory and applications,” Neurocomputing, vol. 70, no. 1–3, pp. 489–501, 2006. View at Publisher · View at Google Scholar · View at Scopus
  72. G. B. Huang, Q. Y. Zhu, K. Z. Mao, C. K. Siew, P. Saratchandran, and N. Sundararajan, “Can threshold networks be trained directly?” IEEE Transactions on Circuits and Systems II, vol. 53, no. 3, pp. 187–191, 2006. View at Publisher · View at Google Scholar · View at Scopus
  73. N. Y. Liang, G. B. Huang, P. Saratchandran, and N. Sundararajan, “A fast and accurate online sequential learning algorithm for feedforward networks,” IEEE Transactions on Neural Networks, vol. 17, no. 6, pp. 1411–1423, 2006. View at Publisher · View at Google Scholar · View at Scopus
  74. X. X. Wang, S. Chen, and D. J. Brown, “An approach for constructing parsimonious generalized Gaussian kernel regression models,” Neurocomputing, vol. 62, no. 1–4, pp. 441–457, 2004. View at Publisher · View at Google Scholar · View at Scopus
  75. S. E. Fahlman and C. Lebiere, “The cascade-correlation learning architecture,” in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed., vol. 2, pp. 524–532, Morgan Kauffmann, San Mateo, Calif, USA, 1990. View at Google Scholar
  76. M. Lehtokangas, J. Saarinen, and K. Kaski, “A ccelerating training of radial basis function networks with Cascade-Correlation algorithm,” Neurocomputing, vol. 9, no. 2, pp. 207–213, 1995. View at Publisher · View at Google Scholar · View at Scopus
  77. D. Shi, J. Gao, D. S. Yeung, and F. Chen, “Radial basis function network pruning by sensitivity analysis,” in Proceedings of the 17th Conference of the Canadian Society for Computational Studies of Intelligence, Advances in Artificial Intelligence, A. Y. Tawfik and S. D. Goodwin, Eds., vol. 3060 of Lecture Notes in Artificial Intelligence, pp. 380–390, Springer, Ontario, Canada, May 2004.
  78. T. Y. Kwok and D. Y. Yeung, “Constructive algorithms for structure learning in feedforward neural networks for regression problems,” IEEE Transactions on Neural Networks, vol. 8, no. 3, pp. 630–645, 1997. View at Publisher · View at Google Scholar · View at Scopus
  79. N. B. Karayiannis and G. W. Mi, “Growing radial basis neural networks: merging supervised and unsupervised learning with network growth techniques,” IEEE Transactions on Neural Networks, vol. 8, no. 6, pp. 1492–1506, 1997. View at Publisher · View at Google Scholar · View at Scopus
  80. A. Esposito, M. Marinaro, D. Oricchio, and S. Scarpetta, “Approximation of continuous and discontinuous mappings by a growing neural RBF-based algorithm,” Neural Networks, vol. 13, no. 6, pp. 651–665, 2000. View at Publisher · View at Google Scholar · View at Scopus
  81. N. A. Borghese and S. Ferrari, “Hierarchical RBF networks and local parameters estimate,” Neurocomputing, vol. 19, no. 1–3, pp. 259–283, 1998. View at Publisher · View at Google Scholar · View at Scopus
  82. S. Ferrari, M. Maggioni, and N. A. Borghese, “Multiscale approximation with hierarchical radial basis functions networks,” IEEE Transactions on Neural Networks, vol. 15, no. 1, pp. 178–188, 2004. View at Publisher · View at Google Scholar · View at Scopus
  83. M .R. Berthold and J. Diamond, “Boosting the performance of RBF networks with dynamic decay adjustment,” in Advances In Neural Information Processing Systems, G. Tesauro, D. S. Touretzky, and T. Leen, Eds., vol. 7, pp. 521–528, MIT Press, New York, NY, USA, 1995. View at Google Scholar
  84. D. L. Reilly, L. N. Cooper, and C. Elbaum, “A neural model for category learning,” Biological Cybernetics, vol. 45, no. 1, pp. 35–41, 1982. View at Publisher · View at Google Scholar · View at Scopus
  85. B. Fritzke, “Supervised learning with growing cell structures,” in Advances in Neural Information Processing Systems, J. D. Cowan, G. Tesauro, and J. Alspector, Eds., vol. 6, pp. 255–262, Morgan Kauffmann, San Mateo, Calif, USA, 1994. View at Google Scholar
  86. B. Fritzke, “Fast learning with incremental RBF networks,” Neural Processing Letters, vol. 1, no. 1, pp. 2–5, 1994. View at Publisher · View at Google Scholar · View at Scopus
  87. Q. Zhu, Y. Cai, and L. Liu, “A global learning algorithm for a RBF network,” Neural Networks, vol. 12, no. 3, pp. 527–540, 1999. View at Publisher · View at Google Scholar · View at Scopus
  88. J. Platt, “A resource allocating network for function interpolation,” Neural Computation, vol. 3, no. 2, pp. 213–225, 1991. View at Publisher · View at Google Scholar
  89. B. Widrow and M. E. Hoff, “Adaptive switching circuits,” in IRE Eastern Electronic Show & Convention (WESCON1960), Convention Record, vol. 4, pp. 96–104, 1960.
  90. M. Wallace, N. Tsapatsoulis, and S. Kollias, “Intelligent initialization of resource allocating RBF networks,” Neural Networks, vol. 18, no. 2, pp. 117–122, 2005. View at Publisher · View at Google Scholar · View at Scopus
  91. V. Kadirkamanathan and M. Niranjan, “A function estimation approach to sequential learning with neural network,” Neural Computation, vol. 5, no. 6, pp. 954–975, 1993. View at Publisher · View at Google Scholar
  92. V. Kadirkamanathan, “A statistical inference based growth criterion for the RBF network,” in Proceedings of the IEEE Workshop Neural Networks for Signal Processing, pp. 12–21, Ermioni, Greece, 1994.
  93. L. Yingwei, N. Sundararajan, and P. Saratchandran, “A sequential learning scheme for function approximation using minimal radial basis function neural networks,” Neural Computation, vol. 9, no. 2, pp. 461–478, 1997. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  94. L. Yingwei, N. Sundararajan, and P. Saratchandran, “Performance evaluation of a sequential minimal Radial Basis Function (RBF) neural network learning algorithm,” IEEE Transactions on Neural Networks, vol. 9, no. 2, pp. 308–318, 1998. View at Publisher · View at Google Scholar · View at Scopus
  95. R. Rosipal, M. Koska, and I. Farkaš, “Prediction of chaotic time-series with a resource-allocating RBF network,” Neural Processing Letters, vol. 7, no. 3, pp. 185–197, 1998. View at Publisher · View at Google Scholar · View at Scopus
  96. M. Salmerón, J. Ortega, C. G. Puntonet, and A. Prieto, “Improved RAN sequential prediction using orthogonal techniques,” Neurocomputing, vol. 41, pp. 153–172, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  97. B. Todorović and M. Stanković, “Sequential growing and pruning of radial basis function network,” in Proceedings of the International Joint Conference on Neural Networks (IJCNN '01), vol. 3, pp. 1954–1959, Washington, DC, USA, 2001.
  98. G. B. Huang, P. Saratchandran, and N. Sundararajan, “An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks,” IEEE Transactions on Systems, Man, and Cybernetics, Part B, vol. 34, no. 6, pp. 2284–2292, 2004. View at Publisher · View at Google Scholar · View at Scopus
  99. G. B. Huang, P. Saratchandran, and N. Sundararajan, “A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation,” IEEE Transactions on Neural Networks, vol. 16, no. 1, pp. 57–67, 2005. View at Publisher · View at Google Scholar · View at Scopus
  100. M. Riedmiller and H. Braun, “Direct adaptive method for faster backpropagation learning: the RPROP algorithm,” in Proceedings of the IEEE International Conference on Neural Networks, pp. 586–591, San Francisco, Calif, USA, April 1993. View at Publisher · View at Google Scholar · View at Scopus
  101. B. Hassibi, D. G. Stork, and G. J. Wolff, “Optimal brain surgeon and general network pruning,” in Proceedings of the IEEE International Conference on Neural Networks, pp. 293–299, San Francisco, Calif, USA, April 1993. View at Scopus
  102. Y. Le Cun, J. S. Denker, and S. A. Solla, “Optimal brain damage,” in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed., vol. 2, pp. 598–605, Morgan Kauffmann, San Mateo, Calif, USA, 1990. View at Google Scholar
  103. N. Jankowski and V. Kadirkamanathan, “Statistical control of growing and pruning in RBF-like neural networks,” in Proceedings of the 3rd Conference Neural Networks and Their Applications, pp. 663–670, Kule, Poland, 1997.
  104. A. Alexandridis, H. Sarimveis, and G. Bafas, “A new algorithm for online structure and parameter adaptation of RBF networks,” Neural Networks, vol. 16, no. 7, pp. 1003–1017, 2003. View at Publisher · View at Google Scholar · View at Scopus
  105. J. Paetz, “Reducing the number of neurons in radial basis function networks with dynamic decay adjustment,” Neurocomputing, vol. 62, no. 1–4, pp. 79–91, 2004. View at Publisher · View at Google Scholar · View at Scopus
  106. A. L. Oliveira, B. J. Melo, and S. R. Meira, “Improving constructive training of RBF networks through selective pruning and model selection,” Neurocomputing, vol. 64, no. 1–4, pp. 537–541, 2005. View at Publisher · View at Google Scholar · View at Scopus
  107. E. Ricci and R. Perfetti, “Improved pruning strategy for radial basis function networks with dynamic decay adjustment,” Neurocomputing, vol. 69, no. 13–15, pp. 1728–1732, 2006. View at Publisher · View at Google Scholar · View at Scopus
  108. S. Mc Loone and G. Irwin, “Improving neural network training solutions using regularisation,” Neurocomputing, vol. 37, pp. 71–90, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  109. C. S. Leung and J. P. F. Sum, “A fault-tolerant regularizer for RBF networks,” IEEE Transactions on Neural Networks, vol. 19, no. 3, pp. 493–507, 2008. View at Publisher · View at Google Scholar · View at Scopus
  110. J. P. F. Sum, C. S. Leung, and K. I. J. Ho, “On objective function, regularizer, and prediction error of a learning algorithm for dealing with multiplicative weight noise,” IEEE Transactions on Neural Networks, vol. 20, no. 1, pp. 124–138, 2009. View at Publisher · View at Google Scholar · View at Scopus
  111. A. Leonardis and H. Bischof, “An efficient MDL-based construction of RBF networks,” Neural Networks, vol. 11, no. 5, pp. 963–973, 1998. View at Publisher · View at Google Scholar · View at Scopus
  112. J. Rissanen, “Modeling by shortest data description,” Automatica, vol. 14, no. 5, pp. 465–471, 1978. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  113. M. T. Musavi, W. Ahmed, K. H. Chan, K. B. Faris, and D. M. Hummels, “On the training of radial basis function classifiers,” Neural Networks, vol. 5, no. 4, pp. 595–603, 1992. View at Publisher · View at Google Scholar · View at Scopus
  114. A. Ghodsi and D. Schuurmans, “Automatic basis selection techniques for RBF networks,” Neural Networks, vol. 16, no. 5-6, pp. 809–816, 2003. View at Publisher · View at Google Scholar · View at Scopus
  115. G. Schwarz, “Estimating the dimension of a model,” The Annals of Statistics, vol. 6, no. 2, pp. 461–464, 1978. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  116. P. Niyogi and F. Girosi, “Generalization bounds for function approximation from scattered noisy data,” Advances in Computational Mathematics, vol. 10, no. 1, pp. 51–80, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  117. P. Niyogi and F. Girosi, “On the relationship between generalization error, hypothesis complexity, and sample complexity for radial basis functions,” Neural Computation, vol. 8, no. 4, pp. 819–842, 1996. View at Publisher · View at Google Scholar · View at Scopus
  118. A. R. Barron, “Universal approximation bounds for superpositions of a sigmoidal function,” Institute of Electrical and Electronics Engineers, vol. 39, no. 3, pp. 930–945, 1993. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  119. A. Krzyzak and T. Linder, “Radial basis function networks and complexity regularization in function learning,” IEEE Transactions on Neural Networks, vol. 9, no. 2, pp. 247–256, 1998. View at Publisher · View at Google Scholar · View at Scopus
  120. Y. Li and J. M. Deng, “WAV—a weight adaptation algorithm for normalized radial basis function networks,” in Proceedings of the IEEE International Conference on Electronics, Circuits, and Systems, vol. 2, pp. 117–120, Lisbon, Portugal, 1998.
  121. J. S. R. Jang and C. T. Sun, “Functional equivalence between radial basis function networks and fuzzy inference systems,” IEEE Transactions on Neural Networks, vol. 4, no. 1, pp. 156–159, 1993. View at Publisher · View at Google Scholar · View at Scopus
  122. G. Bugmann, “Normalized Gaussian radial basis function networks,” Neurocomputing, vol. 20, no. 1–3, pp. 97–110, 1998. View at Publisher · View at Google Scholar · View at Scopus
  123. S. J. Nowlan, “Maximum likelihood competitive learning,” in Advances in Neural Information Processing Systems, D. S. Touretzky, Ed., vol. 2, pp. 574–582, Morgan Kauffmann, Boston, Mass, USA, 1990. View at Google Scholar
  124. M. Benaim, “On functional approximation with Normalized Gaussian units,” Neural Computation, vol. 6, no. 2, pp. 319–333, 1994. View at Publisher · View at Google Scholar
  125. J. S. R. Jang, “ANFIS: adaptive-network-based fuzzy inference system,” IEEE Transactions on Systems, Man and Cybernetics, vol. 23, no. 3, pp. 665–685, 1993. View at Publisher · View at Google Scholar · View at Scopus
  126. F. Yang and M. Paindavoine, “Implementation of an RBF neural network on embedded systems: real-time face tracking and identity verification,” IEEE Transactions on Neural Networks, vol. 14, no. 5, pp. 1162–1175, 2003. View at Publisher · View at Google Scholar · View at Scopus
  127. G. Loreto and R. Garrido, “Stable neurovisual servoing for robot manipulators,” IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 953–965, 2006. View at Publisher · View at Google Scholar · View at Scopus
  128. S. Chen, A. Wolfgang, C. J. Harris, and L. Hanzo, “Symmetric RBF classifier for nonlinear detection in multiple-antenna-aided systems,” IEEE Transactions on Neural Networks, vol. 19, no. 5, pp. 737–745, 2008. View at Publisher · View at Google Scholar · View at Scopus
  129. D. Jianping, N. Sundararajan, and P. Saratchandran, “Communication channel equalization using complex-valued minimal radial basis function neural networks,” IEEE Transactions on Neural Networks, vol. 13, no. 3, pp. 687–697, 2002. View at Publisher · View at Google Scholar · View at Scopus
  130. S. Chen, S. McLaughlin, and B. Mulgrew, “Complex-valued radial basic function network, Part I: network architecture and learning algorithms,” Signal Processing, vol. 35, no. 1, pp. 19–31, 1994. View at Publisher · View at Google Scholar · View at Scopus
  131. C. S. Leung, T. T. Wong, P. M. Lam, and K. H. Choy, “An RBF-based compression method for image-based relighting,” IEEE Transactions on Image Processing, vol. 15, no. 4, pp. 1031–1041, 2006. View at Publisher · View at Google Scholar · View at Scopus
  132. S. Y. Cho and T. W. S. Chow, “Neural computation approach for developing a 3-D shape reconstruction model,” IEEE Transactions on Neural Networks, vol. 12, no. 5, pp. 1204–1214, 2001. View at Publisher · View at Google Scholar · View at Scopus
  133. Y. T. Tsai and Z. C. Shih, “All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation,” ACM Transactions on Graphics, vol. 25, no. 3, pp. 967–976, 2006. View at Google Scholar
  134. I. E. Lagaris, A. C. Likas, and D. G. Papageorgiou, “Neural-network methods for boundary value problems with irregular boundaries,” IEEE Transactions on Neural Networks, vol. 11, no. 5, pp. 1041–1049, 2000. View at Publisher · View at Google Scholar · View at Scopus
  135. R. L. Jenison and K. Fissell, “A spherical basis function neural network for modeling auditory space,” Neural Computation, vol. 8, no. 1, pp. 115–128, 1996. View at Publisher · View at Google Scholar · View at Scopus
  136. P. M. Lam, T. Y. Ho, C. S. Leung, and T. T. Wong, “All-frequency lighting with multiscale spherical radial basis functions,” IEEE Transactions on Visualization and Computer Graphics, vol. 16, no. 1, pp. 43–56, 2010. View at Publisher · View at Google Scholar · View at Scopus
  137. T. Y. Ho, C. S. Leung, P. M. Lam, and T. T. Wong, “Efficient relighting of RBF-based illumination adjustable images,” IEEE Transactions on Neural Networks, vol. 20, no. 12, pp. 1987–1993, 2009. View at Publisher · View at Google Scholar · View at Scopus
  138. A. F. Sheta and K. De Jong, “Time-series forecasting using GA-tuned radial basis functions,” Information Sciences, vol. 133, no. 3-4, pp. 221–228, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  139. J. M. Vesin, “Amplitude-dependent autoregressive model based on a radial basis functions expansion,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '93), vol. 3, pp. 129–132, Minneapolis, Minn, USA, April 1993. View at Scopus
  140. M. R. Berthold, “Time delay radial basis function network for phoneme recognition,” in Proceedings of the IEEE International Conference on Neural Networks, vol. 7, pp. 4470–4472, Orlando, Fla, USA, June 1994. View at Scopus
  141. A. Waibel, T. Hanazawa, G. Hinton, K. Shikano, and K. J. Lang, “Phoneme recognition using time-delay neural networks,” IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 37, no. 3, pp. 328–339, 1989. View at Publisher · View at Google Scholar · View at Scopus
  142. S. A. Billings and X. Hong, “Dual-orthogonal radial basis function networks for nonlinear time series prediction,” Neural Networks, vol. 11, no. 3, pp. 479–493, 1998. View at Publisher · View at Google Scholar · View at Scopus
  143. S. Chen, S. A. Billings, and W. Luo, “Orthogonal least squares methods and their application to nonlinear system identification,” International Journal of Control, vol. 50, no. 5, pp. 1873–1896, 1989. View at Publisher · View at Google Scholar
  144. D. L. Yu, “A localized forgetting method for Gaussian RBFN model adaptation,” Neural Processing Letters, vol. 20, pp. 125–135, 2004. View at Publisher · View at Google Scholar
  145. P. Frasconi, M. Cori, M. Maggini, and G. Soda, “Representation of finite state automata in recurrent radial basis function networks,” Machine Learning, vol. 23, no. 1, pp. 5–32, 1996. View at Google Scholar · View at Zentralblatt MATH · View at Scopus
  146. B. Todorovic, M. Stankovic, and C. Moraga, “Extended Kalman filter trained recurrent radial basis function network in nonlinear system identification,” in Proceedings of the International Conference on Artificial Neural Networks (ICANN '95), J. R. Dorronsoro, Ed., pp. 819–824, Madrid, Spain, 2002.
  147. Z. Ryad, R. Daniel, and Z. Noureddine, “The RRBF dynamic representation of time in radial basis function network,” in Proceedings of the 8th IEEE International Conference Emerging Technologies and Factory Automation (ETFA '01), vol. 2, pp. 737–740, Juan-les-Pins Antibes, France, 2001.
  148. K. Y. Lee and S. Jung, “Extended complex RBF and its application to M-QAM in presence of co-channel interference,” Electronics Letters, vol. 35, no. 1, pp. 17–19, 1999. View at Publisher · View at Google Scholar · View at Scopus
  149. I. Cha and S. A. Kassam, “Channel equalization using adaptive complex radial basis function networks,” IEEE Journal on Selected Areas in Communications, vol. 13, no. 1, pp. 122–131, 1995. View at Publisher · View at Google Scholar · View at Scopus
  150. M. B. Li, G. B. Huang, P. Saratchandran, and N. Sundararajan, “Fully complex extreme learning machine,” Neurocomputing, vol. 68, no. 1–4, pp. 306–314, 2005. View at Publisher · View at Google Scholar · View at Scopus
  151. S. Chen, X. Hong, C. J. Harris, and L. Hanzo, “Fully complex-valued radial basis function networks: orthogonal least squares regression and classification,” Neurocomputing, vol. 71, no. 16–18, pp. 3421–3433, 2008. View at Publisher · View at Google Scholar · View at Scopus
  152. A. R. Webb and D. Lowe, “The optimised internal representation of multilayer classifier networks performs nonlinear discriminant analysis,” Neural Networks, vol. 3, no. 4, pp. 367–375, 1990. View at Publisher · View at Google Scholar · View at Scopus
  153. B. Widrow and M. A. Lehr, “30 years of adaptive neural networks: perceptron, madaline, and backpropagation,” Proceedings of the IEEE, vol. 78, no. 9, pp. 1415–1442, 1990. View at Publisher · View at Google Scholar · View at Scopus
  154. K. L. Du, X. Huang, M. Wang, B. Zhang, and J. Hu, “Robot impedance learning of the peg-in-hole dynamic assembly process,” International Journal of Robotics and Automation, vol. 15, no. 3, pp. 107–118, 2000. View at Google Scholar · View at Scopus
  155. B. Kosko, Ed., Neural Networks for Signal Processing, Prentice Hall, Englewood Cliffs, NJ, USA, 1992.
  156. S. Fabri and V. Kadirkamanathan, “Dynamic structure neural networks for stable adaptive control of nonlinear systems,” IEEE Transactions on Neural Networks, vol. 7, no. 5, pp. 1151–1167, 1996. View at Publisher · View at Google Scholar · View at Scopus
  157. M. Lehtokangas and J. Saarinen, “Centroid based multilayer perceptron networks,” Neural Processing Letters, vol. 7, no. 2, pp. 101–106, 1998. View at Publisher · View at Google Scholar · View at Scopus
  158. G. Dorffner, “Unified framework for MLPs and RBFNs: introducing conic section function networks,” Cybernetics and Systemsl, vol. 25, no. 4, pp. 511–554, 1994. View at Publisher · View at Google Scholar
  159. S. Cohen and N. Intrator, “A hybrid projection-based and radial basis function architecture: initial values and global optimisation,” Pattern Analysis and Applications, vol. 5, no. 2, pp. 113–120, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  160. D. Wedge, D. Ingram, D. McLean, C. Mingham, and Z. Bandar, “On global-local artificial neural networks for function approximation,” IEEE Transactions on Neural Networks, vol. 17, no. 4, pp. 942–952, 2006. View at Publisher · View at Google Scholar · View at Scopus
  161. S. B. Holden and P. J. W. Rayner, “Generalization and PAC learning: some new results for the class of generalized single-layer networks,” IEEE Transactions on Neural Networks, vol. 6, no. 2, pp. 368–380, 1995. View at Publisher · View at Google Scholar · View at Scopus
  162. K. M. Adeney and M. J. Korenberg, “Iterative fast orthogonal search algorithm for MDL-based training of generalized single-layer networks,” Neural Networks, vol. 13, no. 7, pp. 787–799, 2000. View at Publisher · View at Google Scholar · View at Scopus
  163. Q. Zhang and A. Benveniste, “Wavelet networks,” IEEE Transactions on Neural Networks, vol. 3, no. 6, pp. 889–898, 1992. View at Publisher · View at Google Scholar · View at Scopus
  164. J. Zhang, G. G. Walter, Y. Miao, and W. N. W. Lee, “Wavelet neural networks for function learning,” IEEE Transactions on Signal Processing, vol. 43, no. 6, pp. 1485–1497, 1995. View at Publisher · View at Google Scholar · View at Scopus
  165. T.-H. Li, “Multiscale representation and analysis of spherical data by spherical wavelets,” SIAM Journal on Scientific Computing, vol. 21, no. 3, pp. 924–953, 1999. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  166. P. J. W. Rayner and M. R. Lynch, “New connectionist model based on a non-linear adaptive filter,” in Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP '89), pp. 1191–1194, Glasgow, UK, May 1989. View at Scopus
  167. P. J. Huber, Robust Statistics, Wiley Series in Probability and Mathematical Statistic, John Wiley & Sons, New York, NY, USA, 1981.
  168. A. V. D. Sanchez, “Robustization of a learning method for RBF networks,” Neurocomputing, vol. 9, no. 1, pp. 85–94, 1995. View at Publisher · View at Google Scholar · View at Scopus
  169. C. C. Chuang, J. T. Jeng, and P. T. Lin, “Annealing robust radial basis function networks for function approximation with outliers,” Neurocomputing, vol. 56, no. 1–4, pp. 123–139, 2004. View at Publisher · View at Google Scholar · View at Scopus
  170. S. S. Watkins and P. M. Chau, “A radial basis function neuroncomputer implemented with analog VLSI circuits,” in Proceedings of the International Joint Conference on Neural Networks, vol. 2, pp. 607–612, Baltimore, Md, USA, 1992.
  171. S. Churcher, A. F. Murray, and H. M. Reekie, “Programmable analogue VLSI for radial basis function networks,” Electronics Letters, vol. 29, no. 18, pp. 1603–1605, 1993. View at Publisher · View at Google Scholar · View at Scopus
  172. D. J. Mayes, A. F. Murray, and H. M. Reekie, “Pulsed VLSI for RBF neural networks,” in Proceedings of the 5th IEEE International Conference on Microelectronics for Neural Networks and Fuzzy Systems, pp. 177–184, Lausanne, Switzerland, 1996.
  173. I. C. Cevikbas, A. S. Ogrenci, G. Dundar, and S. Balkir, “VLSI implementation of GRBF (Gaussian Radial Basis Function) networks,” in Proceedings of the IEEE International Symposium on Circuits and Systems (IEEE ISCAS '00), vol. 3, pp. 646–649, Geneva, Switzerland, 2000.
  174. P. Maffezzoni and P. Gubian, “VLSI design of radial functions hardware generator for neural computations,” in Proceedings of the 4th IEEE International Conference on Microelectronics for Neural Networks and Fuzzy Systems, pp. 252–259, Turin, Italy, 1994.
  175. M. Aberbour and H. Mehrez, “Architecture and design methodology of the RBF-DDA neural network,” in Proceedings of the IEEE International Symposium on Circuits and Systems (IEEE ISCAS '98), vol. 3, pp. 199–202, June 1998. View at Scopus