Table of Contents Author Guidelines Submit a Manuscript
Journal of Probability and Statistics
Volume 2018, Article ID 8068196, 15 pages
https://doi.org/10.1155/2018/8068196
Research Article

A Novel Entropy-Based Decoding Algorithm for a Generalized High-Order Discrete Hidden Markov Model

1Ted Rogers School of Management, Ryerson University, 350 Victoria St., Toronto, ON, Canada M5B 2K3
2School of Mathematical Sciences, Universiti Sains Malaysia, 11800 Gelugor, Penang, Malaysia

Correspondence should be addressed to Jason Chin-Tiong Chan; ac.nosreyr@nahc.nosajgnoitnihc

Received 15 December 2017; Revised 12 February 2018; Accepted 27 February 2018; Published 2 May 2018

Academic Editor: Steve Su

Copyright © 2018 Jason Chin-Tiong Chan and Hong Choon Ong. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. V. Ciriza, L. Donini, J. Durand, and S. Girard, “Optimal timeouts for power management under renewal or hidden Markov processes for requests,” Tech. Rep., 2011, http://hal.inria.fr/hal-00412509/en. View at Google Scholar
  2. L. R. Rabiner, “Tutorial on hidden Markov models and selected applications in speech recognition,” Proceedings of the IEEE, vol. 77, no. 2, pp. 257–286, 1989. View at Publisher · View at Google Scholar · View at Scopus
  3. J. G. Proakis and M. Salehi, Communications System Engineering, Prentice-Hall, Upper Saddler River, NJ, USA, 2002.
  4. D. Hernando, V. Crespi, and G. Cybenko, “Efficient computation of the hidden Markov model entropy for a given observation sequence,” Institute of Electrical and Electronics Engineers Transactions on Information Theory, vol. 51, no. 7, pp. 2681–2685, 2005. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  5. G. S. Mann and A. McCallum, “Efficient computation of entropy gradient for semi-supervised conditional random fields,” in Proceedings of the Human Language Technologies 2007: The Conference of the North American Chapter of the Association for Computational Linguistics (NAACL ’07), pp. 109–112, Association for Computational Linguistics, Morristown, NJ, USA, April 2007. View at Publisher · View at Google Scholar
  6. V. M. Ilic, “Entropy Semiring Forward-backward Algorithm for HMM Entropy Computation,” 2011, https://arxiv.org/abs/1108.0347.
  7. U. Hadar and H. Messer, “High-order hidden Markov models—estimation and implementation,” in Proceedings of the 15th IEEE/SP Workshop on Statistical Signal Processing (SSP '09), pp. 249–252, Wales, UK, September 2009. View at Publisher · View at Google Scholar · View at Scopus
  8. J. A. du Preez, “Efficient training of high-order hidden Markov models using first-order representations,” Computer Speech and Language, vol. 12, no. 1, pp. 23–39, 1998. View at Publisher · View at Google Scholar · View at Scopus
  9. L. M. Lee and J. C. Lee, “A study on high-order hidden Markov Models and applications to speech recognition,” in Proceedings of the 19th International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, pp. 682–690, 2006. View at Publisher · View at Google Scholar
  10. R. M. Altman, “Mixed hidden MARkov models: an extension of the hidden MARkov model to the longitudinal data setting,” Journal of the American Statistical Association, vol. 102, no. 477, pp. 201–210, 2007. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  11. A. Spagnoli, R. Henderson, R. J. Boys, and J. J. Houwing-Duistermaat, “A hidden Markov model for informative dropout in longitudinal response data with crisis states,” Statistics & Probability Letters, vol. 81, no. 7, pp. 730–738, 2011. View at Publisher · View at Google Scholar · View at MathSciNet
  12. T. M. Cover and J. A. Thomas, Elements of Information Theory, Wiley Series in Telecommunications and Signal Processing, John Wiley & Sons, New York, NY, USA, 2006. View at Publisher · View at Google Scholar · View at MathSciNet