Table of Contents Author Guidelines Submit a Manuscript
International Journal of Reconfigurable Computing
Volume 2010, Article ID 480208, 17 pages
http://dx.doi.org/10.1155/2010/480208
Research Article

Robotic Mapping and Localization with Real-Time Dense Stereo on Reconfigurable Hardware

1Department of Informatics and Communications, Technological Educational Institute of Serres, Terma Magnisias, 62124 Serres, Greece
2Section of Electronics and Information Systems Technology, Department of Electrical Engineering & Computer Engineering, School of Engineering, Democritus University of Thrace, 67100 Xanthi, Greece

Received 1 March 2010; Revised 20 July 2010; Accepted 20 November 2010

Academic Editor: Viktor K. Prasanna

Copyright © 2010 John Kalomiros and John Lygouras. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. W. van der Mark and D. M. Gavrila, “Real-time dense stereo for intelligent vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 7, no. 1, pp. 38–50, 2006. View at Publisher · View at Google Scholar · View at Scopus
  2. S. Thrun, Robotic Mapping: A Survey. Exploring Artificial Intelligence in the New Millenium, Morgan Kaufmann, Boston, Mass, USA, 2002.
  3. S. Se, D. Lowe, and J. Little, “Mobile robot localization and mapping with uncertainty using scale-invariant visual landmarks,” International Journal of Robotics Research, vol. 21, no. 8, pp. 735–758, 2002. View at Google Scholar · View at Scopus
  4. M. W. M. Gamini Dissanayake, P. Newman, S. Clark, H. F. Durrant-Whyte, and M. Csorba, “A solution to the simultaneous localization and map building (SLAM) problem,” IEEE Transactions on Robotics and Automation, vol. 17, no. 3, pp. 229–241, 2001. View at Publisher · View at Google Scholar · View at Scopus
  5. A. J. Davison, I. D. Reid, N. D. Molton, and O. Stasse, “MonoSLAM: real-time single camera SLAM,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 6, pp. 1052–1067, 2007. View at Publisher · View at Google Scholar · View at PubMed · View at Scopus
  6. J. Shi and C. Tomasi, “Good features to track,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '94), pp. 593–600, June 1994. View at Scopus
  7. D. G. Lowe, “Object recognition from local scale-invariant features,” in Proceedings of the 7th IEEE International Conference on Computer Vision (ICCV '99), vol. 2, pp. 1150–1157, Kerkyra, Greece, September 1999.
  8. M. N. Dailey and M. Parnichkun, “Landmark-based simultaneous localization and mapping with stereo vision,” in Proceedings of the Asian Conference on Industrial Automation and Robotics, 2005.
  9. C. J. Harris and M. Stephens, “A combined corner and edge detector,” in Proceedings of the 4th Alvey Vision Conference, pp. 147–151, Manchester, UK, 1988.
  10. May 2010, http://cat.middlebury.edu/stereo/data.html.
  11. M. Z. Brown, D. Burschka, and G. D. Hager, “Advances in computational stereo,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 993–1008, 2003. View at Publisher · View at Google Scholar
  12. D. Scharstein and R. Szeliski, “A taxonomy and evaluation of dense two-frame stereo correspondence algorithms,” International Journal of Computer Vision, vol. 47, no. 1–3, pp. 7–42, 2002. View at Publisher · View at Google Scholar · View at Zentralblatt MATH
  13. M. Gong, R. Yang, L. Wang, and M. Gong, “A performance study on different cost aggregation approaches used in real-time stereo matching,” International Journal of Computer Vision, vol. 75, no. 2, pp. 283–296, 2007. View at Publisher · View at Google Scholar
  14. J. Kalomiros and J. Lygouras, “A reconfigurable architecture for stereo-assisted detection of point-features for robot mapping,” in Proceedings of International Conference on ReConFigurable Computing and FPGAs (ReConFig '09), pp. 404–409, Cancun, Mexico, December 2009. View at Publisher · View at Google Scholar
  15. I. J. Cox, S. L. Hingorani, S. B. Rao, and B. M. Maggs, “A maximum likelihood stereo algorithm,” Computer Vision and Image Understanding, vol. 63, no. 3, pp. 542–567, 1996. View at Publisher · View at Google Scholar · View at Scopus
  16. Y. Ohta and T. Kanade, “Stereo by intra- and inter-scanline search using dynamic programming,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 7, no. 2, pp. 139–154, 1985. View at Google Scholar
  17. J. Díaz, E. Ros, R. Carrillo, and A. Prieto, “Real-time system for high-image resolution disparity estimation,” IEEE Transactions on Image Processing, vol. 16, no. 1, pp. 280–285, 2007. View at Publisher · View at Google Scholar
  18. K. Ambrosch, W. Kubinger, M. Humenberger, and A. Steininger, “Flexible hardware-based stereo matching,” EURASIP Journal on Embedded Systems, vol. 2008, Article ID 386059, 12 pages, 2008. View at Publisher · View at Google Scholar
  19. A. Darabiha, J. Rose, and W. J. MacLean, “Video-rate stereo depth measurement on programmable hardware,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '03), vol. 1, pp. 203–210, Madison, Wis, USA, June 2003.
  20. C. K. Liang, C. C. Cheng, Y. C. Lai, L. G. Chen, and H. H. Chen, “Hardware-efficient belief propagation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR '09), pp. 80–87, Miami, Fla, USA, June 2009. View at Publisher · View at Google Scholar
  21. H. Niitsuma and T. Maruyama, Real-Time Detection of Moving Objects, vol. 3203 of Lecture Notes in Computer Science, Springer, New York, NY, USA, 2004.
  22. J. A. Kalomiros and J. Lygouras, “Hardware implementation of a stereo co-processor in a medium-scale field programmable gate array,” IET Computers and Digital Techniques, vol. 2, no. 5, pp. 336–346, 2008. View at Publisher · View at Google Scholar · View at Scopus
  23. L. Wang, M. Liao, M. Gong, R. Yang, and D. Nister, “High-quality real-time stereo using adaptive cost aggregation and dynamic programming,” in Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT '06), pp. 798–805, Washington DC, USA, June 2006. View at Publisher · View at Google Scholar
  24. M. Montemerlo, S. Thrun, D. Koller, and B. Wegbreit, “FastSLAM: a factored solution to the simultaneous localization and mapping problem,” in Proceedings of the 18th National Conference on Artificial Intelligence (AAAI '02), the 14th Innovative Applications of Artificial Intelligence Conference (IAAI '02), pp. 593–598, Edmonton, Canada, July-August 2002.
  25. K. Murphy, “Bayesian map learning in dynamic environments,” in Advances in Neural Information Processing Systems (NIPS), MIT Press, Cambridge, Mass, USA, 1999. View at Google Scholar
  26. M. Montemerlo and S. Thrun, “FastSLAM, a scalable method for the simultaneous localization and mapping problem in robotics,” in Springer Tracts in Advanced Robotics, B. Sicilinao, O. Khatib, and F. Groen, Eds., vol. 27, Springer, Berlin, Germany, 2006. View at Google Scholar
  27. M. S. Grewal and A. P. Angus, Kalman Filtering, Theory and Practice, Prentice-Hall, Upper Saddle River, NJ, USA, 1993.
  28. J. Carpenter, P. Clifford, and P. Fearnhead, “Improved particle filter for nonlinear problems,” IEE Proceedings: Radar, Sonar and Navigation, vol. 146, no. 1, pp. 2–7, 1999. View at Publisher · View at Google Scholar
  29. R. Sim, P. Elinas, M. Griffin, and J. Little, “Vision-based SLAM using the Rao-Blackwellized particle filter,” in Proceedings of IJCAI Workshop on Reasoning with Uncertainty in Robotics, pp. 9–16, Edinburgh, UK, 2005.
  30. M. H. Li, B. R. Hong, R. H. Luo, and Z. H. Wei, “Novel method for mobile robot simultaneous localization and mapping,” Journal of Zhejiang University: Science, vol. 7, no. 6, pp. 937–944, 2006. View at Publisher · View at Google Scholar
  31. Y. Miyajima and T. Maruyama, “A real-time stereo vision system with FPGA,” in Field Programmable Logic and Applications, vol. 2778 of Lecture Notes in Computer Science, pp. 448–457, Springer, Berlin, Germany, 2003. View at Google Scholar
  32. M. Hariyama, Y. Kobayashi, H. Sasaki, and M. Kameyama, “FPGA implementation of a stereo matching processor based on window-parallel-and-pixel-parallel architecture,” IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences, vol. E88-A, no. 12, pp. 3516–3521, 2005. View at Publisher · View at Google Scholar
  33. J. Woodfill and B. von Herzen, “Real-time stereo vision on the PARTS reconfigurable computer,” in Proceedings of the 5th Annual IEEE Symposium on Field-Programmable Custom Computing Machines, pp. 201–210, April 1997.
  34. K. Ambrosch, M. Humenberger, W. Kubinger, and A. Steininger, “SAD-based stereo matching using FPGAs,” in Embedded Computer Vision, Part II, B. Kisacanin, S. Bhattacharyya, and S. Chai, Eds., Springer, London, UK, 2009. View at Google Scholar
  35. D. K. Masrani and W. J. MacLean, “A real-time large disparity range stereo-system using FPGAs,” in Proceedings of the 4th IEEE International Conference on Computer Vision Systems (ICVS '06), pp. 13–20, January 2006. View at Publisher · View at Google Scholar
  36. J. Díaz, E. Ros, S. Mota, E. M. Ortigosa, and B. del Pino, “High performance stereo computation architecture,” in Proceedings of the International Conference on Field Programmable Logic and Applications (FPL '05), pp. 463–468, Tampere, Finland, August 2005. View at Publisher · View at Google Scholar
  37. C. C. Cheng, C. K. Liang, Y. C. Lai, H. H. Chen, and L. G. Chen, “Analysis of belief propagation for hardware realization,” in Proceedings of the IEEE Workshop on Signal Processing Systems (SiPS '08), pp. 152–157, Washington, DC, USA, October 2008. View at Publisher · View at Google Scholar
  38. S. Park and H. Jeong, “High-speed parallel very large scale integration architecture for global stereo matching,” Journal of Electronic Imaging, vol. 17, no. 1, Article ID 010501, 2008. View at Publisher · View at Google Scholar
  39. F. Tombari, S. Mattoccia, L. D. Stefano, and E. Addimanda, “Classification and evaluation of cost aggregation methods for stereo correspondence,” in Proceedings of the 26th IEEE Conference on Computer Vision and Pattern Recognition (CVPR '08), pp. 1–8, June 2008. View at Publisher · View at Google Scholar
  40. J. Congote, J. Barandiaran, I. Barandiaran, and O. Ruiz, “Realtime dense stereo matching with dynamic programming in CUDA,” in Proceedings of the 19th Spanish Congress of Graphical Informatics (CEIG '09), pp. 231–234, San Sebastian, Spain, September 2009.
  41. R. Sim, P. Elinas, M. Griffin, A. Shyr, and J. J. Little, “Design and analysis of a framework for real-time vision-based SLAM using Rao-Blackwellised particle filters,” in Proceedings of the 3rd Canadian Conference on Computer and Robot Vision (CRV '06), Quebec, Canada, June 2006. View at Publisher · View at Google Scholar
  42. A. Cumani, S. Denasi, A. Guiducci, and G. Quaglia, “Robot localization and mapping with stereo vision,” WSEAS Transactions on Circuits and Systems, vol. 3, no. 10, pp. 2116–2121, 2004. View at Google Scholar