Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2008, Article ID 947438, 8 pages
http://dx.doi.org/10.1155/2008/947438
Research Article

Probabilistic Latent Variable Models as Nonnegative Factorizations

1Mars Incorporated, 800 High Street, Hackettstown, New Jersy 07840, USA
2Mitsubishi Electric Research Laboratories, 201 Broadway, Cambridge MA 02139, USA
3Adobe Systems Incorporated, 275 Grove Street, Newton MA 02466, USA

Received 21 December 2007; Accepted 13 February 2008

Academic Editor: Rafal Zdunek

Copyright © 2008 Madhusudana Shashanka et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. M. D. Plumbley and E. Oja, “A “nonnegative pca” algorithm for independent component analysis,” IEEE Transactions on Neural Networks, vol. 15, no. 1, pp. 66–76, 2004. View at Publisher · View at Google Scholar · View at PubMed
  2. M. D. Plumbley, “Geometrical methods for non-negative ICA: manifolds, lie groups and toral subalgebras,” Neurocomputing, vol. 67, pp. 161–197, 2005. View at Publisher · View at Google Scholar
  3. D. D. Lee and H. S. Seung, “Learning the parts of objects by non-negative matrix factorization,” Nature, vol. 401, no. 6755, pp. 788–791, 1999. View at Publisher · View at Google Scholar · View at PubMed
  4. M. Heiler and C. Schnörr, “Controlling sparseness in non-negative tensor factorization,” in Proceeding of the 9th European Conference on Computer Vision (ECCV '06), vol. 3951, pp. 56–67, Graz, Austria, May 2006. View at Publisher · View at Google Scholar
  5. A. Cichocki, R. Zdunek, S. Choi, R. Plemmons, and S. Amari, “Nonnegative tensor factorization using alpha and beta divergences,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '07), Honolulu, Hawaii, USA, April 2007.
  6. A. Shashua and T. Hazan, “Non-negative tensor factorization with applications to statistics and computer vision,” in Proceedings of the 22nd International Conference on Machine Learning (ICML '05), pp. 793–800, Bonn, Germany, August 2005.
  7. T. Hofmann, “Unsupervised learning by probabilistic latent semantic analysis,” Machine Learning, vol. 42, no. 1-2, pp. 177–196, 2001. View at Publisher · View at Google Scholar
  8. D. Blei, A. Ng, and M. Jordan, “Latent dirichlet allocation,” The Journal of Machine Learning Research, vol. 3, pp. 993–1022, 2003. View at Google Scholar
  9. P. Lazarsfeld and N. Henry, Latent Structure Analysis, Houghton Mifflin, Boston, Mass, USA, 1968.
  10. J. Rost and R. Langeheine, Eds., Applications of Latent Trait and Latent Class Models in the Social Sciences, J. Rost and R. Langeheine, Eds., Waxmann, New York, NY, USA, 1997.
  11. L. A. Goodman, “Exploratory latent structure analysis using both identifiable and unidentifiable models,” Biometrika, vol. 61, no. 2, pp. 215–231, 1974. View at Publisher · View at Google Scholar
  12. D. Lee and H. Seung, “Algorithms for non-negative matrix factorizatio,” in Proceedings of the 14th Annual Conference on Advances in Neural Information Processing Systems (NIPS '01), Vancouver, BC, Canada, December 2001.
  13. B. F. Green, Jr., “Latent structure analysis and its relation to factor analysis,” Journal of the American Statistical Association, vol. 47, no. 257, pp. 71–76, 1952. View at Publisher · View at Google Scholar
  14. P. Smaragdis and B. Raj, “Shift-invariant probabilistic latent component analysis,” to appear in Journal of Machine Learning Research.
  15. P. Smaragdis, B. Raj, and M. Shashanka, “Supervised and semi-supervised separation of sounds from single-channel mixtures,” in Proceedings of the 7th International Conference on Independent Component Analysis and Blind Signal Separation (ICA '07), pp. 414–421, London, UK, September 2007.
  16. P. Smaragdis, B. Raj, and M. Shashanka, “A probabilistic latent variable model for acoustic modeling,” in Proceedings of the Advances in Models for Acoustic Processing Workshop (NIPS '06), Whistler, BC, Canada, December 2006.
  17. M. Shashanka, B. Raj, and P. Smaragdis, “Sparse overcomplete latent variable decomposition of counts data,” in Proceedings of the 21th Annual Conference on Neural Information Processing Systems (NIPS '07), Vancouver, BC, Canada, December 2007.
  18. M. Shashanka, Latent variable framework for modeling and separating single-channel acoustic sources, Ph.D. dissertation, Boston University, Boston, Mass, USA, 2007.
  19. E. Gaussier and C. Goutte, “Relation between plsa and nmf and implications,” in Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '05), pp. 601–602, Salvador, Brazil, August 2005. View at Publisher · View at Google Scholar
  20. B. Raj and P. Smaragdis, “Latent variable decomposition of spectrograms for single channel speaker separation,” in Proceedings of IEEE Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA '05), pp. 17–20, New Paltz, NY, USA, October 2005. View at Publisher · View at Google Scholar
  21. M. Shashanka, B. Raj, and P. Smaragdis, “Probabilistic latent variable model for sparse decompositions of non-negative data,” to appear in IEEE Transactions on Pattern Analysis and Machine Intelligence.
  22. M. Welling and M. Weber, “Positive tensor factorization,” Pattern Recognition Letters, vol. 22, no. 12, pp. 1255–1261, 2001. View at Publisher · View at Google Scholar
  23. P. Smaragdis, B. Raj, and M. Shashanka, “Sparse and shift-invariant feature extraction from non-negative data,” in Proceedings of IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP '08), Las Vegas, Nev, USA, March-April 2008.
  24. P. Smaragdis, “Non-negative matrix factor deconvolution; extraction of multiple sound sources from monophonic inputs,” in Proceedings of the 5th International Conference on Independent Component Analysis and Blind Signal Separation (ICA '04), vol. 3195, pp. 494–499, Granada, Spain, September 2004.
  25. P. Smaragdis, “Convolutive speech bases and their application to supervised speech separation,” IEEE Transactions on Audio, Speech and Language Processing, vol. 15, no. 1, pp. 1–12, 2007. View at Publisher · View at Google Scholar
  26. P. O. Hoyer, “Non-negative matrix factorization with sparseness constraints,” The Journal of Machine Learning Research, vol. 5, pp. 1457–1469, 2004. View at Google Scholar
  27. M. Morup and M. Schmidt, “Sparse non-negative matrix factor 2-d deconvolution,” Technical University of Denmark, Lyngby, Denmark, 2006. View at Google Scholar
  28. J. Eggert and E. Korner, “Sparse coding and NMF,” in Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN '04), vol. 4, pp. 2529–2533, Budapest, Hungary, July 2004. View at Publisher · View at Google Scholar
  29. D. Donoho, “For most large undetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution,” Communications on Pure and Applied Mathematics, vol. 59, no. 7, pp. 903–934, 2006. View at Google Scholar
  30. B. A. Olshausen and D. J. Field, “Emergence of simple-cell receptive field properties by learning a sparse code for natural images,” Nature, vol. 381, no. 6583, pp. 607–609, 1996. View at Publisher · View at Google Scholar · View at PubMed
  31. M. V. S. Shashanka, B. Raj, and P. Smaragdis, “Sparse overcomplete decomposition for single channel speaker separation,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '07), vol. 2, pp. 641–644, Honolulu, Hawaii, USA, April 2007. View at Publisher · View at Google Scholar
  32. B. Raj, M. V. S. Shashanka, and P. Smaragdis, “Latent dirichlet decomposition for single channel speaker separation,” in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '06), vol. 5, Toulouse, France, May 2006. View at Publisher · View at Google Scholar
  33. D. Blei and J. Lafferty, “Correlated topic models,” in Proceedings of the 20th Annual Conference on Neural Information Processing Systems (NIPS '06), Vancouver, BC, Canada, December 2006.
  34. J. Canny, “Gap: a factor model for discrete data,” in Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '04), Sheffield, UK, July 2004.