EURASIP Journal on Image and Video Processing
Volume 2008 (2008), Article ID 347050, 16 pages
doi:10.1155/2008/347050
Research Article

Activity Representation Using 3D Shape Models

Mohamed F. Abdelkader,1 Amit K. Roy-Chowdhury,2 Rama Chellappa,1 and Umut Akdemir3

1Department of Electrical and Computer Engineering and Center for Automation Research, UMIACS, University of Maryland, College Park, MD 20742, USA
2Department of Electrical Engineering, University of California, Riverside, CA 92521, USA
3Siemens Corporate Research, Princeton, NJ 08540, USA

Received 1 February 2007; Revised 9 July 2007; Accepted 25 November 2007

Academic Editor: Maja Pantic

Copyright © 2008 Mohamed F. Abdelkader et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. D. Kendall, D. Barden, T. Carne, and H. Le, “Shape and Shape Theory,” John Wiley & Sons, New York, NY, USA, 1999.
  2. I. Dryden and K. Mardia, “Statistical Shape Analysis,” John Wiley & Sons, New York, NY, USA, 1998.
  3. T. Cootes, C. Taylor, D. Cooper, and J. Graham, “Active shape models - their training and application,” Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38–59, 1995.
  4. W. Mio and A. Srivastava, “Elastic-string models for representation and analysis of planar shapes,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), vol. 2, pp. 10–15, Washington, DC, USA, June-July, 2004.
  5. T. B. Sebastian, P. N. Klein, and B. B. Kimia, “Recognition of shapes by editing their shock graphs,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 550–571, 2004.
  6. A. Srivastava, S. H. Joshi, W. Mio, and X. Liu, “Statistical shape analysis: clustering, learning, and testing,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 590–602, 2005.
  7. L. Torresani, D. Yang, E. Alexander, and C. Bregler, “Tracking and modeling non-rigid objects with rank constraints,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), vol. 1, pp. 493–500, Kauai, Hawaii, USA, December, 2001.
  8. M. Brand, “Morphable 3D models from video,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '01), vol. 2, pp. 456–463, Kauai, Hawaii, USA, December, 2001.
  9. J. Xiao, J. Chai, and T. Kanade, “A closed-form solution to non-rigid shape and motion recovery,” in Proceedings of the 8th European Conference on Computer Vision (ECCV '04), vol. 3024, pp. 573–587, Prague, Czech Republic, May, 2004.
  10. M. Brand, “A direct method for 3D factorization of nonrigid motion observed in 2D,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), vol. 2, pp. 122–128, San Diego, Calif, USA, June, 2005.
  11. Y. Sheikh, M. Sheikh, and M. Shah, “Exploring the space of a human actionin,” in Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV '05), vol. 1, pp. 144–149, Beijing, China, October, 2005.
  12. A. Veeraraghavan, A. K. Roy-Chowdhury, and R. Chellappa, “Matching shape sequences in video with applications in human movement analysis,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 12, pp. 1896–1909, 2005.
  13. N. Vaswani, A. K. Roy-Chowdhury, and R. Chellappa, ““Shape activity”: a continous-state HMM for moving/deforming shapes with application to abnormal activity detection,” IEEE Transactions on Image Processing, vol. 14, no. 10, pp. 1603–1616, 2005.
  14. A. K. Roy-Chowdhury and R. Chellappa, “Factorization approach for event recognition,” in Proceedings of CVPR Event Mining Workshop, Madison, Wis, USA, June, 2003.
  15. A. K. Roy-Chowdhury, “A measure of deformability of shapes, with applications to human motion analysis,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '05), vol. 1, pp. 398–404, San Diego, Calif, USA, June, 2005.
  16. A. K. Roy-Chowdhury, “Towards a measure of deformability of shape sequences,” Pattern Recognition Letters, vol. 28, no. 15, pp. 2164–2172, 2007.
  17. S. Tsuji, A. Morizono, and S. Kuroda, “Understanding a simple cartoon film by a computer vision system,” in Proceedings of the 5th International Joint Conference on Artificial Intelligence (IJCAI '77), pp. 609–610, Cambridge, Mass, USA, August, 1977.
  18. B. Neumann and H. Novak, “Event models for recognition and natural language descriptions of events in real-world image sequences,” in Proceedings of the 8th International Joint Conference on Artificial Intelligence (IJCAI '83), pp. 724–726, Karlsruhe, Germany, August, 1983.
  19. H. Nagel, “From image sequences towards conceptual descriptions,” Image and Vision Computing, vol. 6, no. 2, pp. 59–74, 1988.
  20. Y. Kuniyoshi and H. Inoue, “Qualitative recognition of ongoing human action sequences,” in Proceedings of the 13th International Joint Conference on Artificial Intelligence (IJCAI '93), pp. 1600–1609, Chambéry, France, August-September, 1993.
  21. C. Dousson, P. Gabarit, and M. Ghallab, “Situation recognition: representation and algorithms,” in Proceedings of the 13th International Joint Conference on Artificial Intelligence (IJCAI '93), pp. 166–172, Chambéry, France, August-September, 1993.
  22. H. Buxton and S. Gong, “Visual surveillance in a dynamic and uncertain world,” Artificial Intelligence, vol. 78, no. 1-2, pp. 431–459, 1995.
  23. J. Davis and A. Bobick, “Representation and recognition of human movement using temporal templates,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '97), pp. 928–934, San Juan, Puerto Rico, USA, June, 1997.
  24. B. F. Bremond and M. Thonnat, “Analysis of human activities described by image sequences,” in Proceedings of the 20th International Florida Artificial Intelligence Research International Symposium (FLAIRS '97), Daytona, Fla, USA, 1997.
  25. N. Rota and M. Thonnat, “Activity recognition from video sequence using declarative models,” in Proceedings of the 14th European Conference on Artificial Intelligence (ECAI '00), pp. 673–680, Berlin, Germany, August, 2000.
  26. V. Vu, F. Bremond, and M. Thonnat, “Automatic video interpretation: a recognition algorithm for temporal scenarios based on pre-compiled scenario models,” in Proceedings of IEEE International Conference on Computer Vision Systems (ICCV '03), pp. 523–533, Graz, Austria, April, 2003.
  27. C. Castel, L. Chaudron, and C. Tessier, “What is going on? A high-level interpretation of a sequence of images,” in Proceedings of the Workshop on Conceptual Descriptions from Images (ECCV '96), Cambridge, UK, April, 1996.
  28. T. Starner and A. Pentland, “Visual recognition of American sign language using hidden Markov models,” in Proceedings of the International Workshop on Face and Gesture Recognition, 1995.
  29. A. Wilson and A. Bobick, “Recognition and interpretation of parametric gesture,” in Proceedings of the IEEE 6th International Conference on Computer Vision (ICCV '98), pp. 329–336, Bombay, India, January, 1998.
  30. W. Grimson, C. Stauffer, R. Romano, and L. Lee, “Using adaptive tracking to classify and monitor activities in a site,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '98), pp. 22–29, Santa Barbara, Calif, USA, June, 1998.
  31. J. Pearl, “Probabilistic Reasoning in Intelligent Systems,” Morgan Kaufmann, San Francisco, Calif, USA, 1988.
  32. S. Intille and A. Bobick, “A framework for recognizing multi-agent action from visual evidence,” in Proceedings of the National Conference on Artificial Intelligence (AAAI '99), pp. 518–525, Orlando, Fla, USA, July, 1999.
  33. P. Remagnini, T. Tan, and K. Baker, “Agent-oriented annotation in model based visual surveillance,” in Proceedings of the International Conference on Computer Vision (ICCV '98), pp. 857–862, Bombay, India, January, 1998.
  34. G. Shaffer, “A Mathematical Theory of Evidence,” Princeton University Press, Princeton, NJ, USA, 1976.
  35. D. Ayers and R. Chellappa, “Scenario recognition from video using a hierarchy of dynamic belief networks,” in Proceedings of the 15th International Conference on Pattern Recognition (ICPR '00), vol. 1, pp. 835–838, Barcelona, Spain, September, 2000.
  36. T. Huang, D. Koller, and J. Malik, “Automatic symbolic traffic scene analysis using belief networks,” in Proceedings of the 12th National Conference on Artificial Intelligence (AAAI '94), pp. 966–972, Seattle, Wash, USA, July, 1994.
  37. S. Hongeng and R. Nevatia, “Multi-agent event recognition,” in Proceedings of the 8th IEEE International Conference on Computer Vision (ICCV '01), pp. 84–91, Vancouver, BC, Canada, July, 2001.
  38. G. Johansson, “Visual perception of biological motion and a model for its analysis,” Perception and Psychophysics, vol. 14, no. 2, pp. 201–211, 1973.
  39. E. Muybridge, “The Human Figure in Motion,” Dover, New York, NY, USA, 1901.
  40. “Human Motion Analysis: Current Applications and Future Directions,” G. Harris and P. Smith, Eds., IEEE Press, Piscataway, NJ, USA, 1996.
  41. D. Gavrila, “The visual analysis of human movement: a survey,” Computer Vision and Image Understanding, vol. 73, no. 1, pp. 82–98, 1999.
  42. W. Hu, T. Tan, L. Wang, and S. Maybank, “A survey on visual surveillance of object motion and behaviors,” IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews, vol. 34, no. 3, pp. 334–352, 2004.
  43. N. Vaswani, A. K. Roy-Chowdhury, and R. Chellappa, “Activity recognition using the dynamics of the configuration of interacting objects,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), vol. 2, pp. 633–640, Madison, Wis, USA, June, 2003.
  44. A. Veeraraghavan, A. K. Roy-Chowdhury, and R. Chellappa, “Role of shape and kinematics in human movement analysis,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), vol. 1, pp. 730–737, Washington, DC, USA, 2004.
  45. L. Campbell and A. Bobick, “Recognition of human body motion using phase space constraints,” in Proceedings of the IEEE 5th International Conference on Computer Vision (ICCV '95), pp. 624–630, Cambridge, Mass, USA, June, 1995.
  46. C. Rao, A. Yilmaz, and M. Shah, “View-invariant representation and recognition of actions,” International Journal of Computer Vision, vol. 50, no. 2, pp. 203–226, 2002.
  47. V. Parameswaran and R. Chellappa, “View invariants for human action recognition,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), vol. 2, pp. 613–619, Madison, Wis, USA, June, 2003.
  48. N. Johnson and D. Hogg, “Learning the distribution of object trajectories for event recognition,” Image and Vision Computing, vol. 14, no. 8, pp. 609–615, 1996.
  49. J. Owens and A. Hunter, “Application of the self-organizing map to trajectory classification,” in Proceedings of the IEEE International Workshop Visual Surveillance, pp. 77–83, Dublin, Ireland, July, 2000.
  50. W. Chen and S. F. Chang, “Motion trajectory matching of video objects,” in Storage and Retrieval for Media Databases, vol. 3972 of Proceedings of SPIE, pp. 544–553, San Jose, Calif, USA, January, 2000.
  51. L. Torresani and C. Bregler, “Space-time tracking,” in Proceedings of the 7th European Conference on Computer Vision (ECCV '02), Copenhagen, Denmark, May-June, 2002.
  52. P. J. Phillips, S. Sarkar, I. Robledo, P. Grother, and K. Bowyer, “The gait identification challenge problem: data sets and baseline algorithm,” in Proceedings of the 16th International Conference on Pattern Recognition (ICPR '02), vol. 16, pp. 385–388, Quebec City, Canada, August, 2002.
  53. C. Tomasi and T. Kanade, “Shape and motion from image streams under orthography: a factorization method,” International Journal of Computer Vision, vol. 9, no. 2, pp. 137–154, 1992.
  54. Z. Zhang, “A flexible new technique for camera calibration,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330–1334, 2000.
  55. R. Tsai, “A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses,” IEEE Journal of [legacy, pre - 1988] on Robotics and Automation, vol. 3, no. 4, pp. 323–344, 1987.
  56. D. Liebowitz and A. Zisserman, “Metric rectification for perspective images of planes,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '98), pp. 482–488, Santa Barbara, Calif, USA, June, 1998.
  57. R. Hartley and A. Zisserman, “Multiple View Geometry in Computer Vision,” Cambridge University Press, New York, NY, USA, 2000.
  58. M. F. Abdelkader, R. Chellappa, Q. Zheng, and A. L. Chan, “Integrated motion detection and tracking for visual surveillance,” in Proceedings of the 4th IEEE International Conference on Computer Vision Systems (ICVS '06), p. 28, New York, NY, USA, January, 2006.
  59. Cornegie mellon university graphics lab motion capture database, http://mocap.cs.cmu.edu.
  60. A. Kale, A. Sundaresan, and A. Rajagopalan, “Identification of humans using gait,” IEEE Transactions on Image Processing, vol. 13, no. 9, pp. 1163–1173, 2004.
  61. R. Tanawongsuwan and A. Bobick, “Modelling the effects of walking speed on appearance-based gait recognition,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), vol. 2, pp. 783–790, Washington, DC, USA, June-July, 2004.
  62. A. Veeraraghavan, R. Chellappa, and A. K. Roy-Chowdhury, “The function space of an activity,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '06), pp. 959–968, Washington, DC, USA, 2006.
  63. L. Rabiner and B.-H. Juang, “Fundamentals of Speech Recognition,” Prentice-Hall, Upper Saddle River, NJ, USA, 1993.