Table of Contents Author Guidelines Submit a Manuscript
Mathematical Problems in Engineering
Volume 2015, Article ID 329415, 13 pages
http://dx.doi.org/10.1155/2015/329415
Research Article

Markerless Augmented Reality via Stereo Video See-Through Head-Mounted Display Device

Department of Electrical Engineering, Chang Gung University, Taoyuan 333, Taiwan

Received 14 June 2015; Revised 10 September 2015; Accepted 27 September 2015

Academic Editor: Zhiqiang Ma

Copyright © 2015 Chung-Hung Hsieh and Jiann-Der Lee. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. R. T. Azuma, “A survey of augmented reality,” Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355–385, 1997. View at Google Scholar · View at Scopus
  2. R. T. Azuma, Y. Baillot, R. Behringer, S. K. Feiner, S. Julier, and B. MacIntyre, “Recent advances in augmented reality,” IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34–47, 2001. View at Publisher · View at Google Scholar · View at Scopus
  3. T. Jebara, C. Eyster, J. Weaver, T. Starner, and A. Pentland, “Stochasticks: augmenting the billiards experience with probabilistic vision and wearable computers,” in Proceedings of the International Symposium on Wearable Computers (ISWC '97), pp. 138–145, Cambridge, Mass, USA, October 1997.
  4. S. K. Feiner, “Augmented reality: a new way of seeing,” Scientific American, vol. 286, no. 4, pp. 48–55, 2002. View at Google Scholar · View at Scopus
  5. D. W. F. van Krevelen and R. Poelman, “A survey of augmented reality technologies technologies, applications and limitations,” The International Journal of Virtual Reality, vol. 9, no. 2, pp. 1–20, 2010. View at Google Scholar
  6. T. Sielhorst, M. Feuerstein, and N. Navab, “Advanced medical displays: a literature review of augmented reality,” Journal of Display Technology, vol. 4, no. 4, pp. 451–467, 2008. View at Publisher · View at Google Scholar · View at Scopus
  7. T. Loescher, S. Y. Lee, and J. P. Wachs, “An augmented reality approach to surgical telementoring,” in Proceedings of the IEEE International Conference on Systems, Man and Cybernetics (SMC '14), pp. 2341–2346, IEEE, San Diego, Calif, USA, October 2014. View at Publisher · View at Google Scholar
  8. F. Pretto, I. H. Manssour, M. H. I. Lopes, and M. S. Pinho, “Experiences using augmented reality environment for training and evaluating medical students,” in Proceedings of the IEEE International Conference on Multimedia and Expo Workshops (ICMEW '13), pp. 1–4, San Jose, Calif, USA, July 2013. View at Publisher · View at Google Scholar · View at Scopus
  9. T. Blum, R. Stauder, E. Euler, and N. Navab, “Superman-like X-ray vision: towards brain-computer interfaces for medical augmented reality,” in Proceedings of the 11th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '12), pp. 271–272, IEEE, Atlanta, Ga, USA, November 2012. View at Publisher · View at Google Scholar · View at Scopus
  10. V. Ferrari, G. Megali, E. Troia, A. Pietrabissa, and F. Mosca, “A 3-D mixed-reality system for stereoscopic visualization of medical dataset,” IEEE Transactions on Biomedical Engineering, vol. 56, no. 11, pp. 2627–2633, 2009. View at Publisher · View at Google Scholar · View at Scopus
  11. H. Liao, T. Inomata, I. Sakuma, and T. Dohi, “3-D augmented reality for MRI-guided surgery using integral videography autostereoscopic image overlay,” IEEE Transactions on Biomedical Engineering, vol. 57, no. 6, pp. 1476–1486, 2010. View at Publisher · View at Google Scholar · View at Scopus
  12. J. Fischer, M. Neff, D. Freudenstein, and D. Bartz, “Medical augmented reality based on commercial image guided surgery,” in Proceedings of the 10th Eurographics Conference on Virtual Environments (EGVE '04), pp. 83–86, Aire-la-Ville, Switzerland, June 2004. View at Publisher · View at Google Scholar
  13. C. Bichlmeier, F. Wimmer, S. M. Heining, and N. Navab, “Contextual anatomic mimesis hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality,” in Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '07), pp. 129–138, Nara, Japan, November 2007. View at Publisher · View at Google Scholar · View at Scopus
  14. H. Kato and M. Billinghurst, “Marker tracking and HMD calibration for a video-based augmented reality conferencing system,” in Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR '99), pp. 85–94, IEEE, San Francisco, Calif, USA, 1999. View at Publisher · View at Google Scholar
  15. H. T. Regenbrecht, M. T. Wagner, and H. T. Regenbrecht, “Interaction in a collaborative augmented reality environment,” in Proceedings of the Extended Abstracts on Human Factors in Computing Systems (CHI '02), pp. 504–505, ACM, 2002.
  16. Y. Sato, M. Nakamoto, Y. Tamaki et al., “Image guidance of breast cancer surgery using 3-D ultrasound images and augmented reality visualization,” IEEE Transactions on Medical Imaging, vol. 17, no. 5, pp. 681–693, 1998. View at Publisher · View at Google Scholar · View at Scopus
  17. D. Pustka, M. Huber, C. Waechter et al., “Automatic configuration of pervasive sensor networks for augmented reality,” IEEE Pervasive Computing, vol. 10, no. 3, pp. 68–79, 2011. View at Publisher · View at Google Scholar · View at Scopus
  18. C. Tomasi and T. Kanade, “Detection and tracking of point features,” Tech. Rep., Carnegie Mellon University, CMU-CS-91-132, 1991. View at Google Scholar
  19. M. A. Fischler and R. C. Bolles, “Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography,” Communications of the ACM, vol. 24, no. 6, pp. 381–395, 1981. View at Publisher · View at Google Scholar · View at Scopus
  20. H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, “Speeded-up robust features (SURF),” Computer Vision & Image Understanding, vol. 110, no. 3, pp. 346–359, 2008. View at Publisher · View at Google Scholar · View at Scopus
  21. ARtoolkit, http://www.hitl.washington.edu/artoolkit/.
  22. H. Kato and M. Billinghurst, “Marker tracking and HMD calibration for a video-based augmented reality conferencing system,” in Second International Workshop on Augmented Reality, pp. 85–94, San Francisco, Calif, USA, 1999. View at Publisher · View at Google Scholar
  23. M. Hirzer, “Marker detection for augmented reality applications,” Research Paper, Granz University of Technology, Graz, Austria.
  24. B. Glocker, S. Izadi, J. Shotton, and A. Criminisi, “Real-time RGB-D camera relocalization,” in Proceedings of the IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR '13), pp. 173–179, IEEE, Adelaide, Australia, October 2013. View at Publisher · View at Google Scholar · View at Scopus
  25. E. Eade and T. Drummond, “Unified loop closing and recovery for real time monocular SLAM,” in Proceedings of the 19th British Machine Vision Conference (BMVC '08), pp. 6.1–6.10, September 2008. View at Publisher · View at Google Scholar · View at Scopus
  26. B. Williams, G. Klein, and I. Reid, “Automatic relocalization and loop closing for real-time monocular SLAM,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 9, pp. 1699–1712, 2011. View at Publisher · View at Google Scholar · View at Scopus
  27. O. Kutter, A. Aichert, C. Bichlmeier et al., “Real-time volume rendering for high quality visualization in augmented reality,” in Proceedings of the International Workshop on Augmented Environments for Medical Imaging Including Augmented Reality in Computer-Aided Surgery (AMI-ARCS '08), MICCAI Society, New York, NY, USA, September 2008.
  28. M. Wieczorek, A. Aichert, O. Kutter et al., “GPU-accelerated rendering for medical augmented reality in minimally-invasive procedures,” in Bildverarbeitung fuer die Medizin (BVM '10), Springer, Aachen, Germany, March 2010.
  29. H. Suenaga, H. Hoang Tran, H. Liao et al., “Real-time in situ three-dimensional integral videography and surgical navigation using augmented reality: a pilot study,” International Journal of Oral Science, vol. 5, no. 2, pp. 98–102, 2013. View at Publisher · View at Google Scholar · View at Scopus
  30. S. A. Nicolau, X. Pennec, L. Soler et al., “An augmented reality system for liver thermal ablation: design and evaluation on clinical cases,” Medical Image Analysis, vol. 13, no. 3, pp. 494–506, 2009. View at Publisher · View at Google Scholar · View at Scopus
  31. H. G. Debarba, J. Grandi, A. Maciel, and D. Zanchet, Anatomic Hepatectomy Planning Through Mobile Display Visualization and Interaction, vol. 173 of Studies in Health Technology and Informatics, MMVR, 2012.
  32. L. Maier-Hein, A. M. Franz, M. Fangerau et al., “Towards mobile augmented reality for on-patient visualization of medical images,” in Bildverarbeitung für die Medizin, H. Handels, J. Ehrhardt, T. M. Deserno, H.-P. Meinzer, and T. Tolxdorff, Eds., Informatik aktuell, pp. 389–393, Springer, Berlin, Germany, 2011. View at Publisher · View at Google Scholar
  33. T. Blum, V. Kleeberger, C. Bichlmeier, and N. Navab, “Mirracle: augmented reality in-situ visualization of human anatomy using a magic mirror,” in Proceedings of the 19th IEEE Virtual Reality Conference (VRW '12), pp. 169–170, IEEE, Costa Mesa, Calif, USA, March 2012. View at Publisher · View at Google Scholar · View at Scopus
  34. M. Meng, P. Fallavollita, T. Blum et al., “Kinect for interactive AR anatomy learning,” in Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR '13), pp. 277–278, IEEE, Adelaide, Australia, October 2013. View at Publisher · View at Google Scholar
  35. M. Macedo, A. Apolinario, A. C. Souza, and G. A. Giraldi, “High-quality on-patient medical data visualization in a markerless augmented reality environment,” SBC Journal on Interactive Systems, vol. 5, no. 3, pp. 41–52, 2014. View at Google Scholar
  36. A. C. Souza, M. C. F. Macedo, and A. L. Apolinário Jr., “Multi-frame adaptive non-rigid registration for markerless augmented reality,” in Proceedings of the 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI '14), pp. 7–16, ACM, Shenzhen, China, November-December 2014. View at Publisher · View at Google Scholar
  37. J.-D. Lee, C.-H. Huang, L.-C. Liu, S.-T. Lee, S.-S. Hsieh, and S.-P. Wang, “A modified soft-shape-context ICP registration system of 3-d point data,” IEICE Transactions on Information and Systems, vol. E90-D, no. 12, pp. 2087–2095, 2007. View at Publisher · View at Google Scholar · View at Scopus
  38. G. P. Penney, P. J. Edwards, A. P. King, J. M. Blackall, P. G. Batchelor, and D. J. Hawkes, “A stochastic iterative closest point algorithm (stochastICP),” in Medical Image Computing and Computer-Assisted Intervention—MICCAI 2001, vol. 2208 of Lecture Notes in Computer Science, pp. 762–769, Springer, Berlin, Germany, 2001. View at Publisher · View at Google Scholar
  39. J.-D. Lee, C.-H. Huang, S.-T. Wang, C.-W. Lin, and S.-T. Lee, “Fast-MICP for frameless image-guided surgery,” Medical Physics, vol. 37, no. 9, pp. 4551–4559, 2010. View at Publisher · View at Google Scholar · View at Scopus
  40. V. Lepetit, F. Moreno-Noguer, and P. Fua, “EPnP: an accurate O(n) solution to the PnP problem,” International Journal of Computer Vision, vol. 81, no. 2, pp. 155–166, 2009. View at Publisher · View at Google Scholar · View at Scopus
  41. Microscribe, http://www.emicroscribe.com/products/microscribe-g2.htm.
  42. N. M. Hamming, M. J. Daly, J. C. Irish, and J. H. Siewerdsen, “Effect of fiducial configuration on target registration error in intraoperative cone-beam CT guidance of head and neck surgery,” in Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS '08), pp. 3643–3648, IEEE, Vancouver, Canada, August 2008. View at Publisher · View at Google Scholar
  43. J. M. Fitzpatrick, J. B. West, and C. R. Maurer Jr., “Predicting error in rigid-body point-based registration,” IEEE Transactions on Medical Imaging, vol. 17, no. 5, pp. 694–702, 1998. View at Publisher · View at Google Scholar · View at Scopus