Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2009, Article ID 785152, 17 pages
http://dx.doi.org/10.1155/2009/785152
Research Article

Bayesian Inference for Nonnegative Matrix Factorisation Models

Department of Computer Engineering, Boğaziçi University, 34342 Bebek, Istanbul, Turkey

Received 29 August 2008; Accepted 14 February 2009

Academic Editor: S. Cruces-Alvarez

Copyright © 2009 Ali Taylan Cemgil. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. D. D. Lee and H. S. Seung, “Learning the parts of objects with nonnegative matrix factorization,” Nature, vol. 401, pp. 788–791, 1999. View at Publisher · View at Google Scholar
  2. P. Paatero and U. Tapper, “Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values,” Environmetrics, vol. 5, no. 2, pp. 111–126, 1994. View at Publisher · View at Google Scholar
  3. C. M. Bishop, Pattern Recognition and Machine Learning, Springer, New York, NY, USA, 2006.
  4. T. Virtanen, Sound source separation in monaural music signals, Ph.D. thesis, Tampere University of Technology, Tampere, Finland, November 2006.
  5. H. Kameoka, Statistical approach to multipitch analysis, Ph.D. thesis, University of Tokyo, Tokyo, Japan, 2007.
  6. A. Cichocki, M. Mørup, P. Smaragdis, W. Wang, and R. Zdunek, “Advances in nonnegative matrix and tensor factorization,” Computational Intelligence and Neuroscience, vol. 2008, Article ID 852187, 3 pages, 2008. View at Publisher · View at Google Scholar
  7. J. F. C. Kingman, Poisson Processes, Oxford Science, Oxford, UK, 1993.
  8. D. D. Lee and H. S. Seung, “Algorithms for non-negative matrix factorization,” in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS '00), vol. 13, pp. 556–562, Denver, Colo, USA, October-November 2000.
  9. J. Le Roux, H. Kameoka, N. Ono, and S. Sagayama, “On the relation between divergence-based minimization and maximum-likelihood estimation for the i-divergence,” Personal Communication, 2008.
  10. T. Virtanen, A. T. Cemgil, and S. Godsill, “Bayesian extensions to non-negative matrix factorisation for audio signal modelling,” in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '08), pp. 1825–1828, Las Vegas, Nev, USA, March-April 2008. View at Publisher · View at Google Scholar
  11. E. Gaussier and C. Goutte, “Relation between PLSA and NMF and implication,” in Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 601–602, Salvador, Brazil, August 2005.
  12. A. P. Singh and G. J. Gordon, “A unified view of matrix factorization models,” in Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML PKDD '08), vol. 5212 of Lecture Notes in Computer Science, pp. 358–373, Springer, Antwerp, Belgium, September 2008. View at Publisher · View at Google Scholar
  13. M. N. Schmidt and H. Laurberg, “Nonnegative matrix factorization with Gaussian process priors,” Computational Intelligence and Neuroscience, vol. 2008, Article ID 361705, 10 pages, 2008. View at Publisher · View at Google Scholar
  14. Z. Ghahramani and M. Beal, “Propagation algorithms for variational Bayesian learning,” in Advances in Neural Information Processing Systems, vol. 13, pp. 507–513, MIT Press, Cambridge, Mass, USA, 2000. View at Google Scholar
  15. W. R. Gilks, S. Richardson, and D. J. Spiegelhalter, Eds., Markov Chain Monte Carlo in Practice, CRC Press, London, UK, 1996.
  16. J. S. Liu, Monte Carlo Strategies in Scientific Computing, Springer, New York, NY, USA, 2004.
  17. S. Chib, “Marginal likelihood from the gibbs output,” Journal of the Acoustical Society of America, vol. 90, no. 432, pp. 1313–1321, 1995. View at Google Scholar
  18. P. O. Hoyer, “Non-negative matrix factorization with sparseness constraints,” The Journal of Machine Learning Research, vol. 5, pp. 1457–1469, 2004. View at Google Scholar
  19. A. Banerjee, S. Merugu, I. S. Dhillon, and J. Ghosh, “Clustering with Bregman divergences,” Journal of Machine Learning Research, vol. 6, pp. 1705–1749, 2005. View at Google Scholar
  20. M. V. Shashanka, B. Raj, and P. Smaragdis, “Sparse overcomplete latent variable decomposition of counts data,” in Proceedings of the Conference on Advances in Neural Information Processing Systems (NIPS '07), Vancouver, Canada, December 2007.
  21. C. S. Davis, “The computer generation of multinomial random variates,” Computational Statistics and Data Analysis, vol. 16, no. 2, pp. 205–217, 1993. View at Publisher · View at Google Scholar
  22. M. A. Tanner, Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions, Springer, New York, NY, USA, 3rd edition, 1996.
  23. F. A. Quintana, J. S. Liu, and G. E. del Pino, “Monte Carlo EM with importance reweighting and its applications in random effects models,” Computational Statistics and Data Analysis, vol. 29, no. 4, pp. 429–444, 1999. View at Publisher · View at Google Scholar
  24. K. Butler and M. Stephens, “The distribution of a sum of binomial random variables,” Tech. Rep. 467, Stanford University, Stanford, Calif, USA, April 1993, prepared for the Office of Naval Research. View at Google Scholar
  25. T. Minka, Expectation propagation for approximate Bayesian inference, Ph.D. thesis, MIT Media Lab, Cambridge, Mass, USA, 2001.
  26. O. Winther and K. B. Petersen, “Bayesian independent component analysis: variational methods and non-negative decompositions,” Digital Signal Processing, vol. 17, no. 5, pp. 858–872, 2007. View at Publisher · View at Google Scholar
  27. W. Buntine, “Variational extensions to EM and multinomial PCA,” in Proceedings of the 13th European Conference on Machine Learning (ECML '02), vol. 2430 of Lecture Notes In Computer Science, pp. 23–34, Springer, Helsinki, Finland, August 2002.
  28. A. T. Cemgil, P. Peeling, O. Dikmen, and S. Godsill, “Prior structures for time-frequency energy distributions,” in Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA '07), pp. 151–154, New Paltz, NY, USA, October 2007. View at Publisher · View at Google Scholar
  29. P. Flajolet, “Singularity analysis and asymptotics of Bernoulli sums,” Theoretical Computer Science, vol. 215, no. 1-2, pp. 371–381, 1999. View at Publisher · View at Google Scholar
  30. P. Jacquet and W. Szpankowski, “Entropy computations via analytic depoissonization,” IEEE Transactions on Information Theory, vol. 45, no. 4, pp. 1072–1081, 1999. View at Publisher · View at Google Scholar