Table of Contents Author Guidelines Submit a Manuscript
Journal of Computer Networks and Communications
Volume 2016, Article ID 8087545, 11 pages
http://dx.doi.org/10.1155/2016/8087545
Research Article

Human Depth Sensors-Based Activity Recognition Using Spatiotemporal Features and Hidden Markov Model for Smart Environments

1Pohang University of Science and Technology (POSTECH), Pohang, Republic of Korea
2KyungHee University, Suwon, Republic of Korea

Received 30 June 2016; Accepted 15 September 2016

Academic Editor: Liangtian Wan

Copyright © 2016 Ahmad Jalal et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. X. Yang and Y. Tian, “Super normal vector for activity recognition using depth sequences,” in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14), pp. 804–811, IEEE, Columbus, Ohio, USA, June 2014. View at Publisher · View at Google Scholar · View at Scopus
  2. A. Jalal, J. Kim, and T. Kim, “Human activity recognition using the labeled depth body parts information of depth silhouettes,” in Proceedings of the 6th International Symposium on Sustainable Healthy Buildings, pp. 1–8, 2012.
  3. G. Okeyo, L. Chen, and H. Wang, “An agent-mediated ontology-based approach for composite activity recognition in smart homes,” Journal of Universal Computer Science, vol. 19, no. 17, pp. 2577–2597, 2013. View at Google Scholar · View at Scopus
  4. A. Jalal, S. Lee, J. Kim, and T. Kim, “Human activity recognition via the features of labeled depth body parts,” in Proceedings of the International Conference on Smart Homes and Health Telematics, pp. 246–249, June 2012.
  5. A. Jalal, J. Kim, and T. Kim, “Development of a life logging system via depth imaging-based human activity recognition for smart homes,” in Proceedings of the 8th International Symposium on Sustainable Healthy Buildings, pp. 91–95, Seoul, Republic of Korea, September 2012.
  6. M. Zanfir, M. Leordeanu, and C. Sminchisescu, “The moving pose: an efficient 3D kinematics descriptor for low-latency action recognition and detection,” in Proceedings of the 14th IEEE International Conference on Computer Vision (ICCV '13), pp. 2752–2759, Sydney, Australia, December 2013. View at Publisher · View at Google Scholar · View at Scopus
  7. A. Jalal and Y. Kim, “Dense depth maps-based human pose tracking and recognition in dynamic scenes using ridge data,” in Proceedings of the 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS '14), pp. 119–124, IEEE, Seoul, Republic of Korea, August 2014. View at Publisher · View at Google Scholar · View at Scopus
  8. F. Xu and K. Fujimura, “Human detection using depth and gray images,” in Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), pp. 115–121, IEEE, Colorado Springs, Colo, USA, July 2003. View at Publisher · View at Google Scholar · View at Scopus
  9. A. Jalal and IjazUddin, “Security architecture for third generation (3G) using GMHS cellular network,” in Proceedings of the 3rd International Conference on Emerging Technologies (ICET '07), pp. 74–79, IEEE, Islamabad, Pakistan, November 2007. View at Publisher · View at Google Scholar · View at Scopus
  10. A. Farooq, A. Jalal, and S. Kamal, “Dense RGB-D map-based human tracking and activity recognition using skin joints features and self-organizing map,” KSII Transactions on Internet and Information Systems, vol. 9, no. 5, pp. 1856–1869, 2015. View at Publisher · View at Google Scholar · View at Scopus
  11. J. Wang, Z. Liu, Y. Wu, and J. Yuan, “Mining actionlet ensemble for action recognition with depth cameras,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '12), pp. 1290–1297, Providence, RI, USA, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  12. A. Jalal, M. Z. Uddin, J. T. Kim, and T.-S. Kim, “Recognition of human home activities via depth silhouettes and R transformation for smart homes,” Indoor and Built Environment, vol. 21, no. 1, pp. 184–190, 2012. View at Publisher · View at Google Scholar · View at Scopus
  13. A. Jalal, Y. Kim, and D. Kim, “Ridge body parts features for human pose estimation and recognition from RGB-D video data,” in Proceedings of the IEEE International Conference on Computing, Communication and Networking Technologies (ICCCNT '14), pp. 1–6, IEEE, Hefei, China, July 2014. View at Publisher · View at Google Scholar · View at Scopus
  14. A. Jalal, Z. Uddin, and T.-S. Kim, “Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home,” IEEE Transactions on Consumer Electronics, vol. 58, no. 3, pp. 863–871, 2012. View at Publisher · View at Google Scholar · View at Scopus
  15. P. Casale, O. Pujol, and P. Radeva, “Human activity recognition from accelerometer data using a wearable device,” in Proceedings of the 5th International Conference on Pattern Recognition and Image Analysis (IbPRIA '11), pp. 289–269, Las Palmas de Gran Canaria, Spain, June 2011.
  16. L. Bao and S. Intille, “Activity recognition from user-annotated acceleration data,” in Proceedings of the International Conference on Pervasive Computing, pp. 1–17, April 2004.
  17. S. Kamal and A. Jalal, “A hybrid feature extraction approach for human detection, tracking and activity recognition using depth sensors,” Arabian Journal for Science and Engineering, vol. 41, no. 3, pp. 1043–1051, 2016. View at Publisher · View at Google Scholar
  18. C. Zhang and Y. Tian, “RGB-D camera-based daily living activity recognition,” Journal of Computer Vision and Image Processing, vol. 2, no. 4, pp. 1–7, 2012. View at Google Scholar
  19. A. Jalal, N. Sarif, J. T. Kim, and T.-S. Kim, “Human activity recognition via recognized body parts of human depth silhouettes for residents monitoring services at smart home,” Indoor and Built Environment, vol. 22, no. 1, pp. 271–279, 2013. View at Publisher · View at Google Scholar · View at Scopus
  20. X. Yang and Y. L. Tian, “EigenJoints-based action recognition using Naïve-Bayes-Nearest-Neighbor,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '12), pp. 14–19, Providence, RI, USA, June 2012. View at Publisher · View at Google Scholar · View at Scopus
  21. A. Jalal, S. Kamal, and D. Kim, “Individual detection-tracking-recognition using depth activity images,” in Proceedings of the 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI '15), pp. 450–455, Goyang, Republic of Korea, October 2015. View at Publisher · View at Google Scholar
  22. W. Li, Z. Zhang, and Z. Liu, “Action recognition based on a bag of 3D points,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW '10), pp. 9–14, IEEE, San Francisco, Calif, USA, June 2010. View at Publisher · View at Google Scholar · View at Scopus
  23. A. Jalal, S. Kamal, and D. Kim, “Shape and motion features approach for activity tracking and recognition from kinect video camera,” in Proceedings of the 29th IEEE International Conference on Advanced Information Networking and Applications Workshops (WAINA '15), pp. 445–450, IEEE, Gwangiu, South Korea, March 2015. View at Publisher · View at Google Scholar · View at Scopus
  24. A. Jalal, S. Kamal, A. Farooq, and D. Kim, “A spatiotemporal motion variation features extraction approach for human tracking and pose-based action recognition,” in Proceedings of the International Conference on Informatics, Electronics and Vision (ICIEV '15), pp. 1–6, Fukuoka, Japan, June 2015. View at Publisher · View at Google Scholar
  25. A. Vieira, E. Nascimentio, G. Oliveira, Z. Liu, and M. Campos, “STOP: space-time occupancy patterns for 3d action recognition from depth map sequences,” in Proceedings of the 17th Iberoamerican Congress on Pattern Recognition, pp. 252–259, Buenos Aires, Argentina, September 2012.
  26. A. Jalal, Y. Kim, S. Kamal, A. Farooq, and D. Kim, “Human daily activity recognition with joints plus body features representation using Kinect sensor,” in Proceedings of the International Conference on Informatics, Electronics and Vision (ICIEV '15), pp. 1–6, IEEE, Fukuoka, Japan, June 2015. View at Publisher · View at Google Scholar
  27. L. Xia and J. K. Aggarwal, “Spatio-temporal depth cuboid similarity feature for activity recognition using depth camera,” in Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '13), pp. 2834–2841, IEEE, Portland, Ore, USA, June 2013. View at Publisher · View at Google Scholar · View at Scopus
  28. C. Wang, Y. Wang, and A. L. Yuille, “An approach to pose-based action recognition,” in Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '13), pp. 915–922, Portland, Ore, USA, June 2013. View at Publisher · View at Google Scholar · View at Scopus
  29. A. Eweiwi, M. S. Cheema, C. Bauckhage, and J. Gall, “Efficient pose-based action recognition,” in Computer Vision—ACCV 2014: 12th Asian Conference on Computer Vision, Singapore, Singapore, November 1–5, 2014, Revised Selected Papers, Part V, vol. 9007 of Lecture Notes in Computer Science, pp. 428–443, Springer, Berlin, Germany, 2015. View at Publisher · View at Google Scholar
  30. A. Jalal, S. Kamal, and D. Kim, “A depth video sensor-based life-logging human activity recognition system for elderly care in smart indoor environments,” Sensors, vol. 14, no. 7, pp. 11735–11759, 2014. View at Publisher · View at Google Scholar · View at Scopus
  31. A. Jalal and S. Kim, “Algorithmic implementation and efficiency maintenance of real-time environment using low-bitrate wireless communication,” in Proceedings of the IEEE International Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, pp. 1–6, April 2006.
  32. S.-S. Cho, A.-R. Lee, H.-I. Suk, J.-S. Park, and S.-W. Lee, “Volumetric spatial feature representation for view-invariant human action recognition using a depth camera,” Optical Engineering, vol. 54, no. 3, Article ID 033102, 8 pages, 2015. View at Publisher · View at Google Scholar · View at Scopus
  33. L. Liu and L. Shao, “Learning discriminative representations from RGB-D video data,” in Proceedings of the 23rd International Joint Conference on Artificial Intelligence (IJCAI '13), pp. 1493–1500, Beijing, China, August 2013. View at Scopus
  34. S. Kamal, A. Jalal, and D. Kim, “Depth images-based human detection, tracking and activity recognition using spatiotemporal features and modified HMM,” Journal of Electrical Engineering and Technology, vol. 11, no. 3, pp. 1921–1926, 2016. View at Google Scholar
  35. A. Jalal, Z. Uddin, J. Kim, and T. Kim, “Daily human activity recognition using depth silhouettes and R transformation for smart home,” in Proceedings of the 9th International Conference on Toward Useful Services for Elderly and People with Disabilities: Smart Homes and Health Telematics (ICOST '11), pp. 25–32, Montreal, Canada, June 2011.
  36. A. Jalal and S. Kim, “Advanced performance achievement using multi-algorithmic approach of video transcoder for low bit rate wireless communication,” ICGST Journal on Graphics, Vision and Image Processing, vol. 5, no. 9, pp. 27–32, 2005. View at Google Scholar
  37. A. Jalal and S. Kim, “Global security using human face understanding under vision ubiquitous architecture system,” World Academy of Science, Engineering, and Technology, vol. 13, pp. 7–11, 2006. View at Google Scholar
  38. M. Turk and A. Pentland, “Face recognition using eigenfaces,” in Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 586–591, Maui, Hawaii, USA, June 1991.
  39. A. Jalal and Y. A. Rasheed, “Collaboration achievement along with performance maintenance in video streaming,” in Proceedings of the IEEE Conference on Interactive Computer Aided Learning, pp. 1–8, Villach, Austria, 2007.
  40. A. Jalal and M. A. Zeb, “Security and QoS optimization for distributed real time environment,” in Proceedings of the 7th IEEE International Conference on Computer and Information Technology (CIT '07), pp. 369–374, Aizuwakamatsu, Japan, October 2007. View at Publisher · View at Google Scholar · View at Scopus
  41. L. Chen, P. Zhu, and G. Zhu, “Moving objects detection based on background subtraction combined with consecutive frames subtraction,” in Proceedings of the International Conference on Future Information Technology and Management Engineering (FITME '10), pp. 545–548, IEEE, Changzhou, China, October 2010. View at Publisher · View at Google Scholar · View at Scopus
  42. A. Jalal and S. Kim, “The mechanism of edge detection using the block matching criteria for the motion estimation,” in Proceedings of the Conference on Human Computer Interaction (HCI '05), pp. 484–489, January 2005.
  43. A. Jalal, S. Kim, and B. J. Yun, “Assembled algorithm in the real-time H.263 codec for advanced performance,” in Proceedings of the 7th International Workshop on Enterprise Networking and Computing in Healthcare Industry (HEALTHCOM '05), pp. 295–298, IEEE, Busan, South Korea, June 2005. View at Publisher · View at Google Scholar · View at Scopus
  44. Y.-H. Taguchi and A. Okamoto, “Principal component analysis for bacterial proteomic analysis,” in Proceedings of the IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW '11), pp. 961–963, IEEE, Atlanta, Ga, USA, November 2011. View at Publisher · View at Google Scholar · View at Scopus
  45. A. Jalal and S. Kim, “A complexity removal in the floating point and rate control phenomenon,” in Proceedings of the Conference on Korea Multimedia Society, vol. 8, pp. 48–51, January 2005.
  46. A. Jalal and A. Shahzad, “Multiple facial feature detection using vertex-modeling structure,” in Proceedings of the International Conference on Interactive Computer Aided Learning, pp. 1–7, September 2007.
  47. P. M. Baggenstoss, “A modified Baum-Welch algorithm for hidden Markov models with multiple observation spaces,” IEEE Transactions on Speech and Audio Processing, vol. 9, no. 4, pp. 411–416, 2001. View at Publisher · View at Google Scholar · View at Scopus
  48. A. Jalal, Y. Kim, Y. Kim, S. Kamal, and D. Kim, “Robust human activity recognition from depth video using spatiotemporal multi-fused features,” Pattern Recognition, vol. 61, pp. 295–308, 2017. View at Publisher · View at Google Scholar
  49. A. Jalal, S. Kamal, and D. Kim, “Depth map-based human activity tracking and recognition using body joints features and Self-Organized Map,” in Proceedings of the 5th International Conference on Computing, Communication and Networking Technologies (ICCCNT '14), pp. 1–6, IEEE, Hefei, China, July 2014. View at Publisher · View at Google Scholar · View at Scopus
  50. A. Jalal and S. Kamal, “Real-time life logging via a depth silhouette-based human activity recognition system for smart home services,” in Proceedings of the 11th IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS '14), pp. 74–80, Seoul, South Korea, August 2014. View at Publisher · View at Google Scholar · View at Scopus
  51. S.-S. Jarng, “HMM voice recognition algorithm coding,” in Proceedings of the International Conference on Information Science and Applications (ICISA '11), pp. 1–7, IEEE, Jeju, South Korea, April 2011. View at Publisher · View at Google Scholar · View at Scopus
  52. A. Jalal and M. Zeb, “Security enhancement for e-learning portal,” International Journal of Computer Science and Network Security, vol. 8, no. 3, pp. 41–45, 2008. View at Google Scholar
  53. A. Jalal, S. Kamal, and D. Kim, “Depth silhouettes context: a new robust feature for human tracking and activity recognition based on embedded HMMs,” in Proceedings of the 12th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI '15), pp. 294–299, Goyang, South Korea, October 2015. View at Publisher · View at Google Scholar
  54. A. Jalal, “IM-DailyDepthActivity dataset,” 2016, http://imlab.postech.ac.kr/databases.htm.