Table of Contents Author Guidelines Submit a Manuscript
Computational Intelligence and Neuroscience
Volume 2019, Article ID 8590560, 14 pages
https://doi.org/10.1155/2019/8590560
Research Article

Human Activity Recognition Using Gaussian Mixture Hidden Conditional Random Fields

1College of Computer and Information Sciences, Jouf University, Sakaka, Saudi Arabia
2Department of Computer Science, COMSATS University Islamabad, Lahore Campus, Lahore, Pakistan

Correspondence should be addressed to Muhammad Hameed Siddiqi; moc.liamg@4891iqiddis

Received 12 May 2019; Accepted 10 July 2019; Published 18 August 2019

Academic Editor: Paolo Gastaldo

Copyright © 2019 Muhammad Hameed Siddiqi et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. Z. Chang, J. Cao, and Y. Zhang, “A novel image segmentation approach for wood plate surface defect classification through convex optimization,” Journal of Forestry Research, vol. 29, no. 6, pp. 1789–1795, 2018. View at Publisher · View at Google Scholar · View at Scopus
  2. Z. S. Abdallah, M. M. Gaber, B. Srinivasan, and S. Krishnaswamy, “Adaptive mobile activity recognition system with evolving data streams,” Neurocomputing, vol. 150, pp. 304–317, 2015. View at Publisher · View at Google Scholar · View at Scopus
  3. M. S. Bakli, M. A. Sakr, and T. H. A. Soliman, “A spatiotemporal algebra in Hadoop for moving objects,” Geo-Spatial Information Science, vol. 21, no. 2, pp. 102–114, 2018. View at Publisher · View at Google Scholar · View at Scopus
  4. W. Zhao, L. Yan, and Y. Zhang, “Geometric-constrained multi-view image matching method based on semi-global optimization,” Geo-Spatial Information Science, vol. 21, no. 2, pp. 115–126, 2018. View at Publisher · View at Google Scholar · View at Scopus
  5. H. Gao, X. Zhang, J. Zhao, and D. Li, “Technology of intelligent driving radar perception based on driving brain,” CAAI Transactions on Intelligence Technology, vol. 2, no. 3, pp. 93–100, 2017. View at Publisher · View at Google Scholar
  6. Y. Wang, X. Jiang, R. Cao, and X. Wang, “Robust indoor human activity recognition using wireless signals,” Sensors, vol. 15, no. 7, pp. 17195–17208, 2015. View at Publisher · View at Google Scholar · View at Scopus
  7. J. Wang, Z. Liu, Y. Wu, and J. Yuan, “Mining actionlet ensemble for action recognition with depth cameras,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1290–1297, IEEE, Providence, RI, USA, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  8. S. Karungaru, M. Daikoku, and K. Terada, “Multi cameras based indoors human action recognition using fuzzy rules,” Journal of Pattern Recognition Research, vol. 10, no. 1, pp. 61–74, 2015. View at Publisher · View at Google Scholar
  9. S. Shukri, L. M. Kamarudin, and M. H. F. Rahiman, “Device-free localization for human activity monitoring,” in Intelligent Video Surveillance, IntechOpen, London, UK, 2018. View at Publisher · View at Google Scholar
  10. L. Fiore, D. Fehr, R. Bodor, A. Drenner, G. Somasundaram, and N. Papanikolopoulos, “Multi-camera human activity monitoring,” Journal of Intelligent and Robotic Systems, vol. 52, no. 1, pp. 5–43, 2008. View at Publisher · View at Google Scholar · View at Scopus
  11. C. Zhang and Y. Tian, “RGB-D camera-based daily living activity recognition,” Journal of Computer Vision and Image Processing, vol. 2, no. 4, pp. 1–7, 2012. View at Google Scholar
  12. M. Leo, T. D’Orazio, and P. Spagnolo, “Human activity recognition for automatic visual surveillance of wide areas,” in Proceedings of the ACM 2nd International Workshop on Video Surveillance and Sensor Networks, pp. 124–130, ACM, New York, NY, USA, October 2004. View at Publisher · View at Google Scholar
  13. C.-B. Jin, S. Li, and H. Kim, “Real-time action detection in video surveillance using sub-action descriptor with multi-CNN,” 2017, https://arxiv.org/abs/1710.03383. View at Google Scholar
  14. W. Niu, J. Long, D. Han, and Y.-F. Wang, “Human activity detection and recognition for video surveillance,” in Proceedings of the 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No. 04TH8763), vol. 1, pp. 719–722, IEEE, Taipei, Taiwan, June 2004. View at Publisher · View at Google Scholar
  15. Q. Li, M. Zheng, F. Li, J. Wang, Y.-A. Geng, and H. Jiang, “Retinal image segmentation using double-scale non-linear thresholding on vessel support regions,” CAAI Transactions on Intelligence Technology, vol. 2, no. 3, pp. 109–115, 2017. View at Publisher · View at Google Scholar
  16. L. M. G. Fonseca, L. M. Namikawa, and E. F. Castejon, “Digital image processing in remote sensing,” in Proceedings of the 2009 Tutorials of the XXII Brazilian Symposium on Computer Graphics and Image Processing, pp. 59–71, IEEE, Rio de Janeiro, Brazil, October 2009.
  17. K. Buys, C. Cagniart, A. Baksheev, T. De Laet, J. De Schutter, and C. Pantofaru, “An adaptable system for RGB-D based human body detection and pose estimation,” Journal of Visual Communication and Image Representation, vol. 25, no. 1, pp. 39–52, 2014. View at Publisher · View at Google Scholar · View at Scopus
  18. M. Sharif, M. A. Khan, T. Akram, M. Y. Javed, T. Saba, and A. Rehman, “A framework of human detection and action recognition based on uniform segmentation and combination of Euclidean distance and joint entropy-based features selection,” EURASIP Journal on Image and Video Processing, vol. 2017, no. 1, p. 89, 2017. View at Publisher · View at Google Scholar · View at Scopus
  19. K.-P. Chou, M. Prasad, D. Wu et al., “Robust feature-based automated multi-view human action recognition system,” IEEE Access, vol. 6, pp. 15283–15296, 2018. View at Publisher · View at Google Scholar · View at Scopus
  20. M. Ullah, H. Ullah, and I. M. Alseadonn, “Human action recognition in videos using stable features,” Signal and Image Processing: An International Journal, vol. 8, no. 6, pp. 1–10, 2017. View at Publisher · View at Google Scholar
  21. M. Sharif, M. A. Khan, F. Zahid, J. H. Shah, and T. Akram, “Human action recognition: a framework of statistical weighted segmentation and rank correlation-based selection,” Pattern Analysis and Applications, pp. 1–14, 2019. View at Publisher · View at Google Scholar · View at Scopus
  22. J. Zang, L. Wang, Z. Liu, Q. Zhang, G. Hua, and N. Zheng, “Attention-based temporal weighted convolutional neural network for action recognition,” in Proceedings of the IFIP International Conference on Artificial Intelligence Applications and Innovations, pp. 97–108, Springer, Rhodes, Greece, May 2018. View at Publisher · View at Google Scholar · View at Scopus
  23. V.-D. Hoang, “Multiple classifier-based spatiotemporal features for living activity prediction,” Journal of Information and Telecommunication, vol. 1, no. 1, pp. 100–112, 2017. View at Publisher · View at Google Scholar
  24. S. Dharmalingam and A. Palanisamy, “Vector space based augmented structural kinematic feature descriptor for human activity recognition in videos,” ETRI Journal, vol. 40, no. 4, pp. 499–510, 2018. View at Publisher · View at Google Scholar · View at Scopus
  25. D. Liu, Y. Yan, M.-L. Shyu, G. Zhao, and M. Chen, “Spatio-temporal analysis for human action detection and recognition in uncontrolled environments,” International Journal of Multimedia Data Engineering and Management, vol. 6, no. 1, pp. 1–18, 2015. View at Publisher · View at Google Scholar
  26. C. A. Ronao and S.-B. Cho, “Human activity recognition with smartphone sensors using deep learning neural networks,” Expert Systems with Applications, vol. 59, pp. 235–244, 2016. View at Publisher · View at Google Scholar · View at Scopus
  27. A. Tharwat, H. Mahdi, M. Elhoseny, and A. E. Hassanien, “Recognizing human activity in mobile crowdsensing environment using optimized k-NN algorithm,” Expert Systems with Applications, vol. 107, pp. 32–44, 2018. View at Publisher · View at Google Scholar · View at Scopus
  28. A. Jalal, Y.-H. Kim, Y.-J. Kim, S. Kamal, and D. Kim, “Robust human activity recognition from depth video using spatiotemporal multi-fused features,” Pattern Recognition, vol. 61, pp. 295–308, 2017. View at Publisher · View at Google Scholar · View at Scopus
  29. J. Lafferty, A. McCallum, and F. C. Pereira, “Conditional random fields: probabilistic models for segmenting and labeling sequence data,” in Proceedings of the 18th International Conference on Machine Learning (ICML-2001), pp. 282–289, Williamstown, MA, USA, June-July 2001.
  30. A. Gunawardana, M. Mahajan, A. Acero, and J. C. Platt, “Hidden conditional random fields for phone classification,” in Proceedings of the INTERSPEECH, vol. 2, pp. 1117–1120, Citeseer, Lisbon, Portugal, September 2005.
  31. L. Yang, Q. Song, Z. Wang, and M. Jiang, “Parsing r-cnn for instance-level human analysis,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 364–373, Long Beach, CA, USA, June 2019.
  32. X. Liang, Y. Wei, L. Lin et al., “Learning to segment human by watching youtube,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 39, no. 7, pp. 1462–1468, 2016. View at Publisher · View at Google Scholar · View at Scopus
  33. M. M. Requena, “Human segmentation with convolutional neural networks,” Thesis, University of Alicante, Alicante, Spain, 2018.
  34. H. Gao, S. Chen, and Z. Zhang, “Parts semantic segmentation aware representation learning for person re-identification,” Applied Sciences, vol. 9, no. 6, p. 1239, 2019. View at Publisher · View at Google Scholar
  35. C. Peng, S.-L. Lo, J. Huang, and A. C. Tsoi, “Human action segmentation based on a streaming uniform entropy slice method,” IEEE Access, vol. 6, pp. 16958–16971, 2018. View at Publisher · View at Google Scholar · View at Scopus
  36. M. H. Siddiqi, A. M. Khan, and S.-W. Lee, “Active contours level set based still human body segmentation from depth images for video-based activity recognition,” KSII Transactions on Internet and Information Systems (TIIS), vol. 7, no. 11, pp. 2839–2852, 2013. View at Publisher · View at Google Scholar · View at Scopus
  37. M. Siddiqi, R. Ali, M. Rana, E.-K. Hong, E. Kim, and S. Lee, “Video-based human activity recognition using multilevel wavelet decomposition and stepwise linear discriminant analysis,” Sensors, vol. 14, no. 4, pp. 6370–6392, 2014. View at Publisher · View at Google Scholar · View at Scopus
  38. S. Althloothi, M. H. Mahoor, X. Zhang, and R. M. Voyles, “Human activity recognition using multi-features and multiple kernel learning,” Pattern Recognition, vol. 47, no. 5, pp. 1800–1812, 2014. View at Publisher · View at Google Scholar · View at Scopus
  39. A. Jalal, S. Kamal, and D. Kim, “A depth video-based human detection and activity recognition using multi-features and embedded hidden markov models for health care monitoring systems,” International Journal of Interactive Multimedia and Artificial Intelligence, vol. 4, no. 4, p. 54, 2017. View at Publisher · View at Google Scholar
  40. T. Dobhal, V. Shitole, G. Thomas, and G. Navada, “Human activity recognition using binary motion image and deep learning,” Procedia Computer Science, vol. 58, pp. 178–185, 2015. View at Publisher · View at Google Scholar · View at Scopus
  41. S. Zhang, Z. Wei, J. Nie, L. Huang, S. Wang, and Z. Li, “A review on human activity recognition using vision-based method,” Journal of Healthcare Engineering, vol. 2017, Article ID 3090343, 31 pages, 2017. View at Publisher · View at Google Scholar · View at Scopus
  42. Y. Yang, B. Zhang, L. Yang, C. Chen, and W. Yang, “Action recognition using completed local binary patterns and multiple-class boosting classifier,” in Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 336–340, IEEE, Kuala Lumpur, Malaysia, November 2015. View at Publisher · View at Google Scholar · View at Scopus
  43. W. Lin, M. T. Sun, R. Poovandran, and Z. Zhang, “Human activity recognition for video surveillance,” in Proceedings of the 2008 IEEE International Symposium on Circuits and Systems, pp. 2737–2740, IEEE, Seattle, WA, USA, May 2008. View at Publisher · View at Google Scholar · View at Scopus
  44. H. Permuter, J. Francos, and I. Jermyn, “A study of Gaussian mixture models of color and texture features for image classification and segmentation,” Pattern Recognition, vol. 39, no. 4, pp. 695–706, 2006. View at Publisher · View at Google Scholar · View at Scopus
  45. M. Fiaz and B. Ijaz, “Vision based human activity tracking using artificial neural networks,” in Proceedings of the 2010 International Conference on Intelligent and Advanced Systems, pp. 1–5, IEEE, Kuala Lumpur, Malaysia, June 2010. View at Publisher · View at Google Scholar · View at Scopus
  46. H. Foroughi, A. Naseri, A. Saberi, and H. S. Yazdi, “An eigenspace-based approach for human fall detection using integrated time motion image and neural network,” in Proceedings of the 2008 9th International Conference on Signal Processing, pp. 1499–1503, IEEE, Beijing, China, October 2008. View at Publisher · View at Google Scholar · View at Scopus
  47. A. K. B. Sonali, “Human action recognition using support vector machine and k-nearest neighbor,” International Journal of Engineering and Technical Research, vol. 3, no. 4, pp. 423–428, 2015. View at Google Scholar
  48. V. Swarnambigai, “Action recognition using ami and support vector machine,” International Journal of Computer Science and Technology, vol. 5, no. 4, pp. 175–179, 2014. View at Google Scholar
  49. D. Das and S. Saharia, “Human gait analysis and recognition using support vector machines,” International Journal of Computer Science and Information Technology, vol. 6, no. 5, 2004. View at Publisher · View at Google Scholar
  50. K. G. M Chathuramali and R. Rodrigo, “Faster human activity recognition with SVM,” in Proceedings of the International Conference on Advances in ICT for Emerging Regions (ICTer2012), pp. 197–203, IEEE, Colombo, Sri Lanka, December 2012. View at Publisher · View at Google Scholar · View at Scopus
  51. M. Z. Uddin, D.-H. Kim, J. T. Kim, and T.-S. Kim, “An indoor human activity recognition system for smart home using local binary pattern features with hidden markov models,” Indoor and Built Environment, vol. 22, no. 1, pp. 289–298, 2013. View at Publisher · View at Google Scholar · View at Scopus
  52. M. Z. Uddin, J. Lee, and T.-S. Kim, “Independent shape component-based human activity recognition via hidden Markov model,” Applied Intelligence, vol. 33, no. 2, pp. 193–206, 2010. View at Publisher · View at Google Scholar · View at Scopus
  53. S. Kumar and M. Hebert, “Discriminative Fields for Modeling Spatial Dependencies in Natural Images,” in Proceedings of the NIPS, Vancouver, Canada, December 2003.
  54. A. Quattoni, S. Wang, L.-P. Morency, M. Collins, and T. Darrell, “Hidden conditional random fields,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 10, pp. 1848–1852, 2007. View at Publisher · View at Google Scholar · View at Scopus
  55. M. Mahajan, A. Gunawardana, and A. Acero, “Training algorithms for hidden conditional random fields,” in Proceedings of the 2006 IEEE International Conference on Acoustics Speed and Signal Processing, vol. 1, IEEE, Toulouse, France, May 2006. View at Publisher · View at Google Scholar
  56. S. Reiter, B. Schuller, and G. Rigoll, “Hidden conditional random fields for meeting segmentation,” in Proceedings of the Multimedia and Expo, 2007 IEEE International Conference, pp. 639–642, IEEE, Beijing, China, July 2007. View at Publisher · View at Google Scholar
  57. L. Gorelick, M. Blank, E. Shechtman, M. Irani, and R. Basri, “Actions as space-time shapes,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 12, pp. 2247–2253, 2007. View at Publisher · View at Google Scholar · View at Scopus
  58. I. Laptev, M. Marszalek, C. Schmid, and B. Rozenfeld, “Learning realistic human actions from movies,” in Proceedings of the 2008 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8, IEEE, Anchorage, AK, USA, June 2008. View at Publisher · View at Google Scholar · View at Scopus
  59. K. Soomro and A. R. Zamir, “Action recognition in realistic sports videos,” in Computer Vision in Sports, pp. 181–208, Springer, Berlin, Germany, 2014. View at Google Scholar
  60. D. Weinland, E. Boyer, and R. Ronfard, “Action recognition from arbitrary views using 3D exemplars,” in Proceedings of the 2007 IEEE 11th International Conference on Computer Vision, pp. 1–7, IEEE, Rio de Janeiro, Brazil, October 2007. View at Publisher · View at Google Scholar · View at Scopus
  61. M. Siddiqi, S. Lee, Y.-K. Lee, A. Khan, and P. Truc, “Hierarchical recognition scheme for human facial expression recognition systems,” Sensors, vol. 13, no. 12, pp. 16682–16713, 2013. View at Publisher · View at Google Scholar · View at Scopus
  62. M. Elmezain and A. Al-Hamadi, “Vision-based human activity recognition using ldcrfs,” International Arab Journal of Information Technology (IAJIT), vol. 15, no. 3, pp. 389–395, 2018. View at Google Scholar
  63. A. Roy, B. Banerjee, and V. Murino, “A novel dictionary learning based multiple instance learning approach to action recognition from videos,” in Proceedings of the 6th International Conference on Pattern Recognition Applications and Methods, pp. 519–526, Porto, Portugal, February 2017. View at Publisher · View at Google Scholar
  64. A. P. Sirat, “Actions as space-time shapes,” International Journal of Application or Innovation in Engineering and Management, vol. 7, no. 8, pp. 49–54, 2018. View at Google Scholar