Table of Contents Author Guidelines Submit a Manuscript
Wireless Communications and Mobile Computing
Volume 2017, Article ID 9474806, 16 pages
https://doi.org/10.1155/2017/9474806
Research Article

Vision-Based Fall Detection with Convolutional Neural Networks

1DeustoTech, University of Deusto, Avenida de las Universidades, No. 24, 48007 Bilbao, Spain
2Department of Computer Science and Artificial Intelligence, Basque Country University, P. Manuel Lardizabal 1, 20018 San Sebastian, Spain
3Ikerbasque, Basque Foundation for Science, Maria Diaz de Haro 3, 48013 Bilbao, Spain
4Donostia International Physics Center (DIPC), P. Manuel Lardizabal 4, 20018 San Sebastian, Spain

Correspondence should be addressed to Adrián Núñez-Marcos; se.otsued@zenun.nairda

Received 14 July 2017; Revised 26 September 2017; Accepted 9 November 2017; Published 6 December 2017

Academic Editor: Wiebren Zijlstra

Copyright © 2017 Adrián Núñez-Marcos et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. A. F. Ambrose, G. Paul, and J. M. Hausdorff, “Risk factors for falls among older adults: A review of the literature,” Maturitas, vol. 75, no. 1, pp. 51–61, 2013. View at Publisher · View at Google Scholar · View at Scopus
  2. J. C. Davis, M. C. Robertson, M. C. Ashe, T. Liu-Ambrose, K. M. Khan, and C. A. Marra, “International comparison of cost of falls in older adults living in the community: A systematic review,” Osteoporosis International, vol. 21, no. 8, pp. 1295–1306, 2010. View at Publisher · View at Google Scholar · View at Scopus
  3. M. Mubashir, L. Shao, and L. Seed, “A survey on fall detection: principles and approaches,” Neurocomputing, vol. 100, pp. 144–152, 2013. View at Publisher · View at Google Scholar · View at Scopus
  4. L. Chen, J. Hoey, C. D. Nugent, D. J. Cook, and Z. Yu, “Sensor-based activity recognition,” IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews, vol. 42, no. 6, pp. 790–808, 2012. View at Publisher · View at Google Scholar · View at Scopus
  5. A. Caragliu, C. Del Bo, and P. Nijkamp, “Smart cities in Europe,” Journal of Urban Technology, vol. 18, no. 2, pp. 65–82, 2011. View at Publisher · View at Google Scholar · View at Scopus
  6. Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015. View at Publisher · View at Google Scholar
  7. J. Deng, W. Dong, and R. Socher, “ImageNet: a large-scale hierarchical image database,” in Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 248–255, Miami, Fla, USA, June 2009. View at Publisher · View at Google Scholar
  8. L. Wang and et al., Towards good practices for very deep two-stream convnets, 2015.
  9. S. Khurram, A. R. Zamir, and M. Shah, Amir Roshan Zamir, and Mubarak Shah., UCF101: A dataset of 101 human actions classes from videos in the wild, 2012.
  10. M. Vallejo, C. V. Isaza, and J. D. Lopez, “Artificial Neural Networks as an alternative to traditional fall detection methods,” in Proceedings of the 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2013, pp. 1648–1651, Japan, July 2013. View at Publisher · View at Google Scholar · View at Scopus
  11. A. Sengto and T. Leauhatong, “Human falling detection algorithm using back propagation neural network,” in Proceedings of the 5th 2012 Biomedical Engineering International Conference, BMEiCON 2012, Thailand, December 2012. View at Publisher · View at Google Scholar · View at Scopus
  12. B. Kwolek and M. Kepski, “Human fall detection on embedded platform using depth maps and wireless accelerometer,” Computer Methods and Programs in Biomedicine, vol. 117, no. 3, pp. 489–501, 2014. View at Publisher · View at Google Scholar · View at Scopus
  13. F. Harrou, N. Zerrouki, Y. Sun, and A. Houacine, “Statistical control chart and neural network classification for improving human fall detection,” in Proceedings of the 8th International Conference on Modelling, Identification and Control, ICMIC 2016, pp. 1060–1064, Algeria, November 2016. View at Publisher · View at Google Scholar · View at Scopus
  14. N. Zerrouki and A. Houacine, “Combined curvelets and hidden Markov models for human fall detection,” Multimedia Tools and Applications, pp. 1–20, 2017. View at Publisher · View at Google Scholar · View at Scopus
  15. S. Wang, L. Chen, Z. Zhou, X. Sun, and J. Dong, “Human fall detection in surveillance video based on PCANet,” Multimedia Tools and Applications, vol. 75, no. 19, pp. 11603–11613, 2015. View at Publisher · View at Google Scholar · View at Scopus
  16. K. Wang, G. Cao, D. Meng, W. Chen, and W. Cao, “Automatic fall detection of human in video using combination of features,” in Proceedings of the 2016 IEEE International Conference on Bioinformatics and Biomedicine, BIBM 2016, pp. 1228–1233, China, December 2016. View at Publisher · View at Google Scholar · View at Scopus
  17. I. Charfi, J. Miteran, J. Dubois, M. Atri, and R. Tourki, “Definition and performance evaluation of a robust SVM based fall detection solution,” in Proceedings of the 8th International Conference on Signal Image Technology and Internet Based Systems, SITIS 2012, pp. 218–224, Italy, November 2012. View at Publisher · View at Google Scholar · View at Scopus
  18. T. Lee and A. Mihailidis, “An intelligent emergency response system: Preliminary development and testing of automated fall detection,” Journal of Telemedicine and Telecare, vol. 11, no. 4, pp. 194–198, 2005. View at Publisher · View at Google Scholar · View at Scopus
  19. C. Rougier, J. Meunier, A. St-Arnaud, and J. Rousseau, “Robust video surveillance for fall detection based on human shape deformation,” IEEE Transactions on Circuits and Systems for Video Technology, vol. 21, no. 5, pp. 611–622, 2011. View at Publisher · View at Google Scholar · View at Scopus
  20. S.-G. Miaou, P.-H. Sung, and C.-Y. Huang, “A customized human fall detection system using omni-camera images and personal information,” in Proceedings of the 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, D2H2 2006, pp. 39–42, USA, April 2006. View at Publisher · View at Google Scholar · View at Scopus
  21. C.-L. Liu, C.-H. Lee, and P.-M. Lin, “A fall detection system using k-nearest neighbor classifier,” Expert Systems with Applications, vol. 37, no. 10, pp. 7174–7181, 2010. View at Publisher · View at Google Scholar · View at Scopus
  22. V. Vishwakarma, C. Mandal, and S. Sural, in Pattern Recognition and Machine Intelligence, Automatic detection of human fall in video, Ed., pp. 616–623, 2007.
  23. N. Zerrouki, F. Harrou, A. Houacine, and Y. Sun, “Fall detection using supervised machine learning algorithms: A comparative study,” in Proceedings of the 8th International Conference on Modelling, Identification and Control, ICMIC 2016, pp. 665–670, Algeria, November 2016. View at Publisher · View at Google Scholar · View at Scopus
  24. F. Harrou, N. Zerrouki, Y. Sun, and A. Houacine, “A simple strategy for fall events detection,” in Proceedings of the 14th IEEE International Conference on Industrial Informatics, INDIN 2016, pp. 332–336, France, July 2016. View at Publisher · View at Google Scholar · View at Scopus
  25. E. Auvinet, F. Multon, A. Saint-Arnaud, J. Rousseau, and J. Meunier, “Fall detection with multiple cameras: An occlusion-resistant method based on 3-D silhouette vertical distribution,” IEEE Transactions on Information Technology in Biomedicine, vol. 15, no. 2, pp. 290–300, 2011. View at Publisher · View at Google Scholar · View at Scopus
  26. S. Gasparrini, E. Cippitelli, S. Spinsante, and E. Gambi, “A depth-based fall detection system using a Kinect® sensor,” Sensors, vol. 14, no. 2, pp. 2756–2775, 2014. View at Publisher · View at Google Scholar · View at Scopus
  27. R. Planinc and M. Kampel, “Introducing the use of depth data for fall detection,” Personal and Ubiquitous Computing, vol. 17, no. 6, pp. 1063–1072, 2013. View at Publisher · View at Google Scholar · View at Scopus
  28. G. Diraco, A. Leone, and P. Siciliano, “An active vision system for fall detection and posture recognition in elderly healthcare,” in Proceedings of the Design, Automation and Test in Europe Conference and Exhibition, DATE 2010, pp. 1536–1541, deu, March 2010. View at Scopus
  29. G. Mastorakis and D. Makris, “Fall detection system using Kinect’s infrared sensor,” Journal of Real-Time Image Processing, vol. 9, no. 4, pp. 635–646, 2012. View at Publisher · View at Google Scholar · View at Scopus
  30. T.-H. Chan, K. Jia, S. Gao, J. Lu, Z. Zeng, and Y. Ma, “P{CAN}et: a simple deep learning baseline for image classification?” IEEE Transactions on Image Processing, vol. 24, no. 12, pp. 5017–5032, 2015. View at Publisher · View at Google Scholar · View at MathSciNet · View at Scopus
  31. K. Simonyan and A. Zisserman, Very deep convolutional networks for large-scale image recognition, 2014.
  32. Y. Jia, E. Shelhamer, J. Donahue et al., “Caffe: convolutional architecture for fast feature embedding,” in Proceedings of the ACM International Conference on Multimedia, pp. 675–678, ACM, Orlando, Fla, USA, November 2014. View at Publisher · View at Google Scholar
  33. S. S. Beauchemin and J. L. Barron, “The Computation of Optical Flow,” ACM Computing Surveys, vol. 27, no. 3, pp. 433–466, 1995. View at Publisher · View at Google Scholar · View at Scopus
  34. J. J. Gibson, “The Perception of Visual Surfaces,” The American Journal of Psychology, vol. 63, no. 3, p. 367, 1950. View at Publisher · View at Google Scholar
  35. F. A. Hamprecht, C. Schnörr, and B. Jähne, ““A duality based approach for realtime TV-L 1 optical flow,” in Pattern Recognition, pp. 214–223, 2007. View at Google Scholar
  36. L. Wang, Y. Xiong, Z. Wang et al., “Temporal segment networks: Towards good practices for deep action recognition,” Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics): Preface, vol. 9912, pp. 20–36, 2016. View at Publisher · View at Google Scholar · View at Scopus
  37. A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classification with deep convolutional neural networks,” in Proceedings of the 26th Annual Conference on Neural Information Processing Systems (NIPS '12), pp. 1097–1105, Lake Tahoe, Nev, USA, December 2012. View at Scopus
  38. K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2016, pp. 770–778, July 2016. View at Scopus
  39. K. Simonyan and A. Zisserman, “Two-stream convolutional networks for action recognition in videos,” in Proceedings of the 28th Annual Conference on Neural Information Processing Systems 2014, NIPS 2014, pp. 568–576, can, December 2014. View at Scopus
  40. C. François and etal., “Keras,” 2015, https://github.com/fchollet/keras.
  41. M. Oquab, L. Bottou, I. Laptev, and J. Sivic, “Learning and transferring mid-level image representations using convolutional neural networks,” in Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '14), pp. 1717–1724, IEEE, Columbus, Ohio, USA, June 2014. View at Publisher · View at Google Scholar · View at Scopus
  42. S. Herath, M. Harandi, and F. Porikli, “Going deeper into action recognition: A survey,” Image and Vision Computing, vol. 60, pp. 4–21, 2017. View at Publisher · View at Google Scholar · View at Scopus
  43. N. Srivastava, G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, “Dropout: a simple way to prevent neural networks from overfitting,” Journal of Machine Learning Research, vol. 15, no. 1, pp. 1929–1958, 2014. View at Google Scholar · View at MathSciNet
  44. R. Hecht-Nielsen, “Theory of the backpropagation neural network,” Neural Networks, vol. 1, no. 1, p. 445, 1988. View at Publisher · View at Google Scholar · View at Scopus
  45. D. Clevert, T. Unterthiner, G. Povysil, and S. Hochreiter, “Rectified factor networks for biclustering of omics data,” Bioinformatics, vol. 33, no. 14, pp. i59–i66, 2017. View at Publisher · View at Google Scholar
  46. S. Ioffe and C. Szegedy, Batch normalization: Accelerating deep network training by reducing internal covariate shift, 2015.
  47. D. Mishkin, N. Sergievskiy, and J. Matas, Systematic evaluation of CNN advances on the ImageNet, 2016.
  48. D. Kingma and J. Ba, Adam: A method for stochastic optimization, 2014.
  49. R. Girshick, J. Donahue, T. Darrell, and J. Malik, “Region-based convolutional networks for accurate object detection and segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 38, no. 1, pp. 142–158, 2016. View at Publisher · View at Google Scholar · View at Scopus