Table of Contents Author Guidelines Submit a Manuscript
Journal of Applied Mathematics
Volume 2011, Article ID 301204, 34 pages
http://dx.doi.org/10.1155/2011/301204
Research Article

Encoding Static and Temporal Patterns with a Bidirectional Heteroassociative Memory

1School of Psychology, University of Ottawa, 136 Jean-Jacques Lussier, Ottawa, ON, Canada K1N 6N5
2Département d'informatique, Université du Québec à Montréal, Case postale 8888, Succursale Centre-ville, Montréal, QC, Canada H3C 3P8

Received 15 September 2010; Accepted 8 December 2010

Academic Editor: Haydar Akca

Copyright © 2011 Sylvain Chartier and Mounir Boukadoum. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. J. J. Hopfield, “Neural networks and physical systems with emergent collective computational abilities,” Proceedings of the National Academy of Sciences of the United States of America, vol. 79, no. 8, pp. 2554–2558, 1982. View at Google Scholar · View at Scopus
  2. J. A. Anderson, J. W. Silverstein, S. A. Ritz, and R. S. Jones, “Distinctive features, categorical perception, and probability learning: some applications of a neural model,” Psychological Review, vol. 84, no. 5, pp. 413–451, 1977. View at Publisher · View at Google Scholar · View at Scopus
  3. B. Kosko, “Bidirectional associative memories,” IEEE Transactions on Systems, Man and Cybernetics, vol. 18, no. 1, pp. 49–60, 1988. View at Publisher · View at Google Scholar · View at Scopus
  4. T. Kohonen, “Correlation matrix memories,” IEEE Transactions on Computers, vol. 21, no. 4, pp. 353–359, 1972. View at Google Scholar · View at Scopus
  5. M. E. Acevedo-Mosqueda, C. Yáñez-Márquez, and I. López-Yáñez, “Alpha-Beta bidirectional associative memories: theory and applications,” Neural Processing Letters, vol. 26, no. 1, pp. 1–40, 2007. View at Publisher · View at Google Scholar · View at Scopus
  6. S. Arik, “Global asymptotic stability analysis of bidirectional associative memory neural networks with time delays,” IEEE Transactions on Neural Networks, vol. 16, no. 3, pp. 580–586, 2005. View at Publisher · View at Google Scholar · View at Scopus
  7. S. Chartier and M. Boukadoum, “A bidirectional heteroassociative memory for binary and grey-level patterns,” IEEE Transactions on Neural Networks, vol. 17, no. 2, pp. 385–396, 2006. View at Publisher · View at Google Scholar · View at Scopus
  8. S. Chartier, P. Renaud, and M. Boukadoum, “A nonlinear dynamic artificial neural network model of memory,” New Ideas in Psychology, vol. 26, no. 2, pp. 252–277, 2008. View at Publisher · View at Google Scholar · View at Scopus
  9. S. Du, Z. Chen, Z. Yuan, and X. Zhang, “Sensitivity to noise in bidirectional associative memory (BAM),” IEEE Transactions on Neural Networks, vol. 16, no. 4, pp. 887–898, 2005. View at Publisher · View at Google Scholar · View at Scopus
  10. T. D. Eom, C. Choi, and J. J. Lee, “Generalized asymmetrical bidirectional associative memory for multiple association,” Applied Mathematics and Computation, vol. 127, no. 2-3, pp. 221–233, 2002. View at Publisher · View at Google Scholar · View at Scopus
  11. H. Oh and S. C. Kothari, “Adaptation of the relaxation method for learning in bidirectional associative memory,” IEEE Transactions on Neural Networks, vol. 5, no. 4, pp. 576–583, 1994. View at Publisher · View at Google Scholar · View at Scopus
  12. C.-S. Leung, “Optimum learning for bidirectional associative memory in the sense of capacity,” IEEE Transactions on Systems, Man and Cybernetics, vol. 24, no. 5, pp. 791–796, 1994. View at Publisher · View at Google Scholar
  13. D. Shen and J. B. Cruz Jr., “Encoding strategy for maximum noise tolerance bidirectional associative memory,” IEEE Transactions on Neural Networks, vol. 16, no. 2, pp. 293–300, 2005. View at Publisher · View at Google Scholar · View at Scopus
  14. H. Shi, Y. Zhao, and X. Zhuang, “A general model for bidirectional associative memories,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 28, no. 4, pp. 511–519, 1998. View at Google Scholar · View at Scopus
  15. Y. F. Wang, J. B. Cruz Jr., and J. H. Mulligan Jr., “Two coding strategies for bidirectional associative memory,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 81–92, 1990. View at Publisher · View at Google Scholar · View at Scopus
  16. T. Wang, X. Zhuang, and X. Xing, “Weighted learning of bidirectional associative memories by global minimization,” IEEE Transactions on Neural Networks, vol. 3, no. 6, pp. 1010–1018, 1992. View at Publisher · View at Google Scholar · View at Scopus
  17. L. Wang and X. Zou, “Capacity of stable periodic solutions in discrete-time bidirectional associative memory neural networks,” IEEE Transactions on Circuits and Systems II: Express Briefs, vol. 51, no. 6, pp. 315–319, 2004. View at Publisher · View at Google Scholar · View at Scopus
  18. Y. Wu and D. A. Pados, “A feedforward bidirectional associative memory,” IEEE Transactions on Neural Networks, vol. 11, no. 4, pp. 859–866, 2000. View at Google Scholar · View at Scopus
  19. Z. B. Xu, Y. Leung, and X. W. He, “Asymmetric bidirectional associative memories,” IEEE Transactions on Systems, Man and Cybernetics, vol. 24, no. 10, pp. 1558–1564, 1994. View at Publisher · View at Google Scholar · View at Scopus
  20. X. Zhuang, Y. Huang, and S. Chen, “Better learning for bidirectional associative memory,” Neural Networks, vol. 6, no. 8, pp. 1131–1146, 1993. View at Google Scholar · View at Scopus
  21. G. Costantini, D. Casali, and R. Perfetti, “Neural associative memory storing gray-coded gray-scale images,” IEEE Transactions on Neural Networks, vol. 14, no. 3, pp. 703–707, 2003. View at Publisher · View at Google Scholar · View at Scopus
  22. C.-C. Wang, S.-M. Hwang, and J.-P. Lee, “Capacity analysis of the asymptotically stable multi-valued exponential bidirectional associative memory,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 26, no. 5, pp. 733–743, 1996. View at Google Scholar
  23. D. Zhang and S. Chen, “A novel multi-valued BAM model with improved error-correcting capability,” Journal of Electronics, vol. 20, no. 3, pp. 220–223, 2003. View at Google Scholar
  24. J. M. Zurada, I. Cloete, and E. van der Poel, “Generalized Hopfield networks for associative memories with multi-valued stable states,” Neurocomputing, vol. 13, no. 2–4, pp. 135–149, 1996. View at Publisher · View at Google Scholar · View at Scopus
  25. L. Wang, “Multi-associative neural networks and their applications to learning and retrieving complex spatio-temporal sequences,” IEEE Transactions on Systems, Man, and Cybernetics B, vol. 29, no. 1, pp. 73–82, 1999. View at Google Scholar · View at Scopus
  26. J. L. Elman, “Finding structure in time,” Cognitive Science, vol. 14, no. 2, pp. 179–211, 1990. View at Google Scholar · View at Scopus
  27. H. Wakuya and J. M. Zurada, “Bi-directional computing architecture for time series prediction,” Neural Networks, vol. 14, no. 9, pp. 1307–1321, 2001. View at Publisher · View at Google Scholar · View at Scopus
  28. G. Bradski, G. A. Carpenter, and S. Grossberg, “STORE working memory networks for storage and recall of arbitrary temporal sequences,” Biological Cybernetics, vol. 71, no. 6, pp. 469–480, 1994. View at Publisher · View at Google Scholar · View at Scopus
  29. B. B. Nasution and A. I. Khan, “A hierarchical graph neuron scheme for real-time pattern recognition,” IEEE Transactions on Neural Networks, vol. 19, no. 2, pp. 212–229, 2008. View at Publisher · View at Google Scholar · View at Scopus
  30. J. A. Starzyk and H. He, “Anticipation-based temporal sequences learning in hierarchical structure,” IEEE Transactions on Neural Networks, vol. 18, no. 2, pp. 344–358, 2007. View at Publisher · View at Google Scholar · View at Scopus
  31. D.-L. Lee, “A discrete sequential bidierectional associative memory for multi step pattern recognition,” Pattern Recognition, vol. 19, pp. 1087–1102, 1988. View at Google Scholar
  32. L. Wang, “Heteroassociations of spatio-temporal sequences with the bidirectional associative memory,” IEEE Transactions on Neural Networks, vol. 11, no. 6, pp. 1503–1505, 2000. View at Google Scholar · View at Scopus
  33. R. W. Zhou and C. Quek, “DCBAM: a discrete chainable bidirectional associative memory,” Pattern Recognition Letters, vol. 17, no. 9, pp. 985–999, 1996. View at Publisher · View at Google Scholar · View at Scopus
  34. A. A. Koronovskii, D. I. Trubetskov, and A. E. Khramov, “Population dynamics as a process obeying the nonlinear diffusion equation,” Doklady Earth Sciences, vol. 372, pp. 755–758, 2000. View at Google Scholar · View at Scopus
  35. D. Kaplan and L. Glass, Understanding Nonlinear Dynamics, Springer, New York, NY, USA, 1995.
  36. L. Personnaz, I. Guyon, and G. Dreyfus, “Information storage and retrieval in spin-glass like neural networks,” Journal of Physics Letters, vol. 46, pp. L359–L365, 1985. View at Google Scholar
  37. M. H. Hassoun, “Dynamic heteroassociative neural memories,” Neural Networks, vol. 2, no. 4, pp. 275–287, 1989. View at Google Scholar · View at Scopus
  38. S. Chartier and R. Proulx, “NDRAM: nonlinear dynamic recurrent associative memory for learning bipolar and nonbipolar correlated patterns,” IEEE Transactions on Neural Networks, vol. 16, no. 6, pp. 1393–1400, 2005. View at Publisher · View at Google Scholar · View at Scopus
  39. B. Kosko, “Unsupervised learning in noise,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 44–57, 1990. View at Publisher · View at Google Scholar · View at Scopus
  40. R. S. Sutton, “Learning to predict by the methods of temporal differences,” Machine Learning, vol. 3, no. 1, pp. 9–44, 1988. View at Publisher · View at Google Scholar · View at Scopus
  41. M. N. Dailey, G. W. Cottrel, and J. Reilly, HYPERLINK, 2001, http://www.cs.ucsd.edu/users/gary/CAFE/.
  42. K. Tabari, M. Boukadoum, S. Chartier, and H. Lounis, “Reconnaissance d'expressions faciales à l'aide d'une mémoire associative bidirectionnelle à fonction de sortie chaotique,” in Proceedings of Maghrebian Conference on Software Engineering and Artificial Intelligence, pp. 422–426, Agadir, Morocco, December 2006.
  43. S. Chartier and M. Boukadoum, “A sequential dynamic heteroassociative memory for multistep pattern recognition and one-to-many association,” IEEE Transactions on Neural Networks, vol. 17, no. 1, pp. 59–68, 2006. View at Publisher · View at Google Scholar
  44. K. Okajima, S. Tanaka, and S. Fujiwara, “A heteroassociative memory network with feedback connection,” in Proceedings of the 1st International Joint Conference on Neural Networks, pp. H.711–H.7188, San Diego, Calif, USA, 1987.
  45. M. Hagiwara, “Multidirectional associative memory,” in Proceeding of the International Joint Conference on Neural Networks, pp. 3–6, Washington, DC, USA, 1990.
  46. A. F. R. Araujo and M. Vieira, “Temporal multidirectional associative memory: adaptable, continuous, and self-connected MAM,” in Proceedings of the IEEE International Conference on Neural Networks, vol. 2, pp. 1194–1198, Houston, Tex, USA, June 1997. View at Scopus