Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2010, Article ID 378652, 16 pages
http://dx.doi.org/10.1155/2010/378652
Research Article

Knowledge-Based Green's Kernel for Support Vector Regression

1Department of Electrical and Computer Engineering, Ryerson University, 350 Victoria Street, Toronto, ON, Canada M5B 2K3
2School of Information Technology Management, Ryerson University, Toronto, ON, Canada M5B 2K3

Received 19 January 2010; Accepted 19 May 2010

Academic Editor: Cristian Toma

Copyright © 2010 Tahir Farooq et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. V. N. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, NY, USA, 1995. View at Zentralblatt MATH · View at MathSciNet
  2. V. N. Vapnik, Statistical Learning Theory, John Wiley & Sons, New York, NY, USA, 1998. View at Zentralblatt MATH · View at MathSciNet
  3. K. R. Mller, A. J. Smola, G. Rtsch, B. Schlkopf, J. Kohlmorgen, and V. Vapnik, “Using support vector machines for time series prediction,” in Advances in Kernel Methods: Support Vector Machine, B. Scholkopf, J. Burges, and A. Smola, Eds., MIT Press, Cambridge, Mass, USA, 1999. View at Google Scholar
  4. J.-Y. Zhu, B. Ren, H.-X. Zhang, and Z.-T. Deng, “Time series prediction via new support vector machines,” in Proceedings of International Conference on Machine Learning and Cybernetics (ICMLC '02), pp. 364–366, November 2002. View at Scopus
  5. V. N. Vapnik, “An overview of statistical learning theory,” IEEE Transactions on Neural Networks, vol. 10, no. 5, pp. 988–999, 1999. View at Google Scholar · View at Scopus
  6. V. Vapnik, Estimation of Dependences Based on Empirical Data, Nauka, Moscow, Russia, 1979, English translation: Springer, New York, NY, USA, 1982.
  7. A. N. Tikhonov and V. Y. Arsenin, Solutions of Ill-Posed Problems, John Wiley & Sons, New York, NY, USA, 1977. View at MathSciNet
  8. A. N. Tikhonov, “Solution of incorrectly formulated problems and the regularization method,” Soviet Mathematics Doklady, vol. 4, pp. 1035–1038, 1963. View at Google Scholar
  9. T. Evgeniou, M. Pontil, and T. Poggio, “Regularization networks and support vector machines,” Advances in Computational Mathematics, vol. 13, no. 1, pp. 1–50, 2000. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  10. B. Schlkopf and A. J. Smola, Learning with Kernels, MIT Press, Cambridge, Mass, USA, 2001.
  11. A. J. Smola, B. Schölkopf, and K.-R. Müller, “The connection between regularization operators and support vector kernels,” Neural Networks, vol. 11, no. 4, pp. 637–649, 1998. View at Publisher · View at Google Scholar · View at Scopus
  12. R. V. Babu, P. Pérez, and P. Bouthemy, “Robust tracking with motion estimation and local Kernel-based color modeling,” Image and Vision Computing, vol. 25, no. 8, pp. 1205–1216, 2007. View at Publisher · View at Google Scholar · View at Scopus
  13. R. Maclin, E. Wild, J. Shavlik, L. Torrey, and T. Walker, “Refining rules incorporated into knowledge-based support vector learners via successive linear programming,” in Proceedings of the 22nd National Conference on Artificial Intelligence, vol. 1, pp. 584–589, July 2007. View at Scopus
  14. L. Yen, F. Fouss, C. Decaestecker, P. Francq, and M. Saerens, “Graph nodes clustering with the sigmoid commute-time kernel: a comparative study,” Data and Knowledge Engineering, vol. 68, no. 3, pp. 338–361, 2009. View at Publisher · View at Google Scholar · View at Scopus
  15. G. Toma, “Specific differential equations for generating pulse sequences,” Mathematical Problems in Engineering, vol. 2010, Article ID 324818, 11 pages, 2010. View at Publisher · View at Google Scholar · View at MathSciNet
  16. M. Li and J.-Y. Li, “On the predictability of long-range dependent series,” Mathematical Problems in Engineering, vol. 2010, Article ID 397454, 9 pages, 2010. View at Publisher · View at Google Scholar
  17. E. G. Bakhoum and C. Toma, “Mathematical transform of traveling-wave equations and phase aspects of quantum interaction,” Mathematical Problems in Engineering, vol. 2010, Article ID 695208, 15 pages, 2010. View at Publisher · View at Google Scholar · View at MathSciNet
  18. Z. Liu, “Chaotic time series analysis,” Mathematical Problems in Engineering, vol. 2010, Article ID 720190, 31 pages, 2010. View at Publisher · View at Google Scholar · View at Scopus
  19. T. Poggio and F. Girosi, A Theory on Networks for Approximation and Learning, MIT Press, Cambridge, Mass, USA, 1989.
  20. T. Poggio and F. Girosi, “Networks for approximation and learning,” Proceedings of the IEEE, vol. 78, no. 9, pp. 1481–1497, 1990. View at Publisher · View at Google Scholar · View at Scopus
  21. F. Girosi, M. Jones, and T. Poggio, “Regularization theory and neural networks architectures,” Neural Computation, vol. 7, pp. 219–269, 1995. View at Google Scholar
  22. F. Girosi, M. Jones, and T. Poggio, “Priors, stabilizers and basis functions: from regularization to radial, tensor and additive splines,” AI Memo no. 1430, MIT AI Lab, 1993.
  23. A. J. Smola and B. Schölkopf, “On a kernel-based method for pattern recognition, regression, approximation and operator inversion,” Algorithmica, vol. 22, no. 1-2, pp. 211–231, 1998. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  24. R. C. Williamson, A. J. Smola, and B. Schölkopf, “Generalization performance of regularization networks and support vector machines via entropy numbers of compact operators,” IEEE Transactions on Information Theory, vol. 47, no. 6, pp. 2516–2532, 2001. View at Publisher · View at Google Scholar · View at Zentralblatt MATH · View at MathSciNet
  25. R. Metzler, Y. Bar-Yam, and M. Kardar, “Information flowsystem chaotic channel: prediction and ostdiction at finite resolution,” Physical Review E, vol. 70, Article ID 026205, 2004. View at Google Scholar
  26. G. Nolte, A. Ziehe, and K.-R. Müller, “Noise robust estimates of correlation dimension and K2 entropy,” Physical Review E, vol. 64, no. 1, Article ID 016112, 10 pages, 2001. View at Google Scholar · View at Scopus
  27. V. Olshevsky and L. Sakhnovich, “Matched filtering for generalized stationary processes,” IEEE Transactions on Information Theory, vol. 51, no. 9, pp. 3308–3313, 2005. View at Publisher · View at Google Scholar · View at MathSciNet
  28. G. L. Turin, “An introduction to matched filters,” IRE Transactions on Information Theory, vol. 6, pp. 311–329, 1960. View at Google Scholar · View at MathSciNet
  29. E. S. Chng, S. Chen, and B. Mulgrew, “Gradient radial basis function networks for nonlinear and nonstationary time series prediction,” IEEE Transactions on Neural Networks, vol. 7, no. 1, pp. 190–194, 1996. View at Google Scholar · View at Scopus
  30. D. Lowe and A. R. Webb, “Time series prediction by adaptive networks. A dynamical systems perspective,” IEE Proceedings F, vol. 138, no. 1, pp. 17–24, 1991. View at Google Scholar · View at Scopus
  31. B. E. Boser, I. M. Guyon, and V. N. Vapnik, “Training algorithm for optimal margin classifiers,” in Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory, D. Haussler, Ed., pp. 144–152, July 1992. View at Scopus
  32. I. Guyon, B. Boser, and V. Vapnik, “Automatic capacity tuning of very large VC-dimension classifiers,” in Advances in Neural Information Processing Systems, S. J. Hanson, J. D. Cowan, and C. L. Giles, Eds., vol. 5, pp. 147–155, Morgan Kaufmann, San Mateo, Calif, USA, 1993. View at Google Scholar
  33. C. Cortes and V. Vapnik, “Support-vector networks,” Machine Learning, vol. 20, no. 3, pp. 273–297, 1995. View at Publisher · View at Google Scholar · View at Scopus
  34. V. Vapnik, S. Golowich, and A. Smola, “Support vector method for function approximation, regression estimation, and signal processing,” in Advances in Neural Information Processing Systems, M. Mozer, M. Jordan, and T. Petsche, Eds., vol. 9, MIT Press, Cambridge, Mass, USA, 1997. View at Google Scholar
  35. A. J. Smola and B. Schlkopf, “A tutorial on support vector regression,” Neuro COLT Tech. Rep. TR-1998-030, Royal Holloway College, 1998. View at Google Scholar
  36. M. A. Aĭzerman, È. M. Braverman, and L. I. Rozonoèr, “Theoretical foundations of the potential function method in pattern recognition learning,” Automation and Remote Control, vol. 25, pp. 821–837, 1964. View at Google Scholar
  37. N. J. Nilsson, Learning Machines: Foundations of Trainable Pattern Classifying Systems, McGraw-Hill, New York, NY, USA, 1965.
  38. G. F. Roach, Green's Functions Introductory Theory with Applications, Van Nostrand Reinhold, London, UK, 1970. View at MathSciNet
  39. J. Mercer, “Functions of positive and negative type and their connection with the theory of integral equation,” Philosophical Transactions of the Royal Society A, vol. 209, pp. 415–446, 1909. View at Google Scholar
  40. D. O. North, “An analysis of the factors which determine signal/noise discrimination in pulsed-carrier systems,” Tech. Rep. PTR-6c, RCA Lab, June 1943. View at Google Scholar
  41. D. O. North, “An analysis of the factors which determine signal/noise discrimination in pulsed-carrier systems,” Proceedings of the IEEE, vol. 51, no. 1, pp. 1016–1027, 1963. View at Google Scholar
  42. H. J. Blinchikoff and A. I. Zverev, Filtering in the Time and Frequency Domains, John Wiley & Sons, New York, NY, USA, 1976.
  43. B. V. Kumar, A. Mahalanobis, and R. D. Juday, Correlation Pattern Recognition, Cambridge University Press, New York, NY, USA, 2005.
  44. J. O. Smith, “Introduction to digital filters with audio applications,” August 2006, https://ccrma.stanford.edu/~jos/filters/.
  45. O. Akay, “Linear fractional shift invariant (LFSI) systems,” in Proceedings of the 7th International Symposium on Signal Processing and Its Applications, pp. 585–588, 2003.
  46. J. A. K. Suykens, T. V. Gestel, J. D. Brabanter, B. D. Moor, and J. Vandewalle, Least Squares Support Vector Machines, World Scientific, Singapore, 2002.
  47. S. Gunn, “Support Vector Machines for Classification and Regression,” Tech. Rep., Image Speech and Intelligent Systems Research Group, University of Southampton, 1997. View at Google Scholar
  48. M. C. Mackey and L. Glass, “Oscillation and chaos in physiological control systems,” Science, vol. 197, no. 4300, pp. 287–289, 1977. View at Google Scholar · View at Scopus