Table of Contents Author Guidelines Submit a Manuscript
Journal of Healthcare Engineering
Volume 2017, Article ID 4574172, 9 pages
https://doi.org/10.1155/2017/4574172
Review Article

Recent Development of Augmented Reality in Surgery: A Review

1Department of Surgery, University Hospital Ostrava, 17. Listopadu 1790, 708 52 Ostrava, Czech Republic
2Faculty of Medicine, University of Ostrava, Syllabova 19, 703 00 Ostrava, Czech Republic
3Faculty of Electrical Engineering and Computer Science, Technical University of Ostrava, 17. Listopadu 15/2172, 708 33 Ostrava, Czech Republic
4Department of Surgery & Cancer, Faculty of Medicine, Imperial College London, South Kensington Campus, London SW7 2AZ, UK
5Department of Surgery, Faculty of Medicine, Alexandria University, Chamblion Street, El Azareeta, Alexandria Governorate, Egypt

Correspondence should be addressed to J. Roman; zc.namornaj@liam

Received 12 February 2017; Accepted 3 July 2017; Published 21 August 2017

Academic Editor: Md. A. R. Ahad

Copyright © 2017 P. Vávra et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. L. B. Tabrizi and M. Mahvash, “Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique,” Journal of Neurosurgery, vol. 123, pp. 206–211, 2015. View at Publisher · View at Google Scholar · View at Scopus
  2. M. Sugimoto, H. Yasuda, K. Koda et al., “Image overlay navigation by markerless surface registration in gastrointestinal, hepatobiliary and pancreatic surgery,” Journal Hepato-Biliary-Pancreatic Sciences, vol. 17, pp. 629–636, 2010. View at Publisher · View at Google Scholar · View at Scopus
  3. K. A. Gavaghan, M. Peterhans, T. Oliveira-Santos, and S. Weber, “A portable image overlay projection device for computer-aided open liver surgery,” IEEE Transactions on Biomedical Engineering, vol. 58, pp. 1855–1864, 2011. View at Publisher · View at Google Scholar · View at Scopus
  4. K. Gavaghan, T. Oliveira-Santos, M. Peterhans et al., “Evaluation of a portable image overlay projector for the visualisation of surgical navigation data: phantom studies,” International Journal of Computer Assisted Radiology and Surgery, vol. 7, pp. 547–556, 2012. View at Publisher · View at Google Scholar · View at Scopus
  5. R. Wen, C. K. Chui, S. H. Ong, K. B. Lim, and S. K. Y. Chang, “Projection-based visual guidance for robot-aided RF needle insertion,” International Journal of Computer Assisted Radiology and Surgery, vol. 8, pp. 1015–1025, 2013. View at Publisher · View at Google Scholar · View at Scopus
  6. B. Kocev, F. Ritter, and L. Linsen, “Projector-based surgeon-computer interaction on deformable surfaces,” International Journal of Computer Assisted Radiology and Surgery, vol. 9, pp. 301–312, 2014. View at Publisher · View at Google Scholar · View at Scopus
  7. P. Pessaux, M. Diana, L. Soler, T. Piardi, D. Mutter, and J. Marescaux, “Towards cybernetic surgery: robotic and augmented reality-assisted liver segmentectomy,” Langenbeck’s Archives of Surgery, vol. 400, pp. 381–385, 2015. View at Publisher · View at Google Scholar · View at Scopus
  8. G. Badiali, V. Ferrari, F. Cutolo et al., “Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning,” Journal of Cranio-Maxillofacial Surgery, vol. 42, pp. 1970–1976, 2014. View at Publisher · View at Google Scholar · View at Scopus
  9. E. Watanabe, M. Satoh, T. Konno, M. Hirai, and T. Yamaguchi, “The trans-visible navigator: a see-through neuronavigation system using augmented reality,” World Neurosurgery, vol. 87, pp. 399–405, 2016. View at Publisher · View at Google Scholar · View at Scopus
  10. D. Inoue, B. Cho, M. Mori et al., “Preliminary study on the clinical application of augmented reality neuronavigation,” Journal of Neurological Surgery Part A, vol. 74, pp. 71–76, 2013. View at Publisher · View at Google Scholar · View at Scopus
  11. G. Callovini, S. Sherkat, G. Callovini, and R. Gazzeri, “Frameless nonstereotactic image-guided surgery of supratentorial lesions: introduction to a safe and inexpensive technique,” Journal of Neurological Surgery Part A, vol. 75, pp. 365–370, 2014. View at Publisher · View at Google Scholar · View at Scopus
  12. P. Pessaux, M. Diana, L. Soler, T. Piardi, D. Mutter, and J. Marescaux, “Robotic duodenopancreatectomy assisted with augmented reality and real-time fluorescence guidance,” Surgical Endoscopy, vol. 28, pp. 2493–2498, 2014. View at Publisher · View at Google Scholar · View at Scopus
  13. T. Okamoto, S. Onda, K. Yanaga, N. Suzuki, and A. Hattori, “Clinical application of navigation surgery using augmented reality in the abdominal field,” Surgery Today, vol. 45, pp. 397–406, 2015. View at Publisher · View at Google Scholar · View at Scopus
  14. J. Marescaux and M. Diana, “Inventing the future of surgery,” World Journal of Surgery, vol. 39, pp. 615–622, 2015. View at Publisher · View at Google Scholar · View at Scopus
  15. X. Kang, M. Azizian, E. Wilson et al., “Stereoscopic augmented reality for laparoscopic surgery,” Surgical Endoscopy, vol. 28, pp. 2227–2235, 2014. View at Publisher · View at Google Scholar · View at Scopus
  16. S. J. Gonzalez, Y. H. Guo, and M. C. Lee, “Feasibility of augmented reality glasses for real-time, 3-dimensional (3D) intraoperative guidance,” Journal of the American College of Surgeons, vol. 219, pp. S64–S64, 2014. View at Google Scholar
  17. R. Shekhar, O. Dandekar, V. Bhat et al., “Live augmented reality: a new visualization method for laparoscopic surgery using continuous volumetric computed tomography,” Surgical Endoscopy, vol. 24, pp. 1976–1985, 2010. View at Publisher · View at Google Scholar · View at Scopus
  18. H. G. Kenngott, M. Wagner, M. Gondan et al., “Real-time image guidance in laparoscopic liver surgery: first clinical experience with a guidance system based on intraoperative CT imaging,” Surgical Endoscopy, vol. 28, pp. 933–940, 2014. View at Publisher · View at Google Scholar · View at Scopus
  19. N. Tsutsumi, M. Tomikawa, M. Uemura et al., “Image-guided laparoscopic surgery in an open MRI operating theater,” Surgical Endoscopy, vol. 27, pp. 2178–2184, 2013. View at Publisher · View at Google Scholar · View at Scopus
  20. M. Kranzfelder, M. Bauer, M. Magg et al., “Image guided surgery,” Endoskopie Heute, vol. 27, pp. 154–158, 2014. View at Google Scholar
  21. W. H. Nam, D. G. Kang, D. Lee, J. Y. Lee, and J. B. Ra, “Automatic registration between 3D intra-operative ultrasound and pre-operative CT images of the liver based on robust edge matching,” Physics in Medicine and Biology, vol. 57, pp. 69–91, 2012. View at Publisher · View at Google Scholar · View at Scopus
  22. S. F. Shakur, C. J. Luciano, P. Kania et al., “Usefulness of a virtual reality percutaneous trigeminal rhizotomy simulator in neurosurgical training,” Operative Neurosurgery, vol. 11, pp. 420–425, 2015. View at Publisher · View at Google Scholar · View at Scopus
  23. F. Leblanc, B. J. Champagne, K. M. Augestad et al., “Colorectal Surg Training Group: a comparison of human cadaver and augmented reality simulator models for straight laparoscopic colorectal skills acquisition training,” Journal of the American College of Surgeons, vol. 211, pp. 250–255, 2010. View at Publisher · View at Google Scholar · View at Scopus
  24. N. Lelos, P. Campos, K. Sugand, C. Bailey, and K. Mirza, “Augmented reality dynamic holography for neurology,” Journal of Neurology, Neurosurgery, and Psychiatry, vol. 85, p. 1, 2014. View at Google Scholar
  25. A. M. Vera, M. Russo, A. Mohsin, and S. Tsuda, “Augmented reality telementoring (ART) platform: a randomized controlled trial to assess the efficacy of a new surgical education technology,” Surgical Endoscopy, vol. 28, pp. 3467–3472, 2014. View at Publisher · View at Google Scholar · View at Scopus
  26. V. Lahanas, C. Loukas, N. Smailis, and E. Georgiou, “A novel augmented reality simulator for skills assessment in minimal invasive surgery,” Surgical Endoscopy, vol. 29, pp. 2224–2234, 2015. View at Publisher · View at Google Scholar · View at Scopus
  27. A. C. Profeta, C. Schilling, and M. McGurk, “Augmented reality visualization in head and neck surgery: an overview of recent findings in sentinel node biopsy and future perspectives,” The British Journal of Oral & Maxillofacial Surgery, vol. 54, pp. 694–696, 2016. View at Publisher · View at Google Scholar · View at Scopus
  28. M. B. Shenai, M. Dillavou, C. Shum et al., “Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance,” Neurosurgery, vol. 68, p. 8, 2011. View at Google Scholar
  29. M. C. Davis, D. D. Can, J. Pindrik, B. G. Rocque, and J. M. Johnston, “Virtual interactive presence in global surgical education: international collaboration through augmented reality,” World Neurosurgery, vol. 86, pp. 103–111, 2016. View at Publisher · View at Google Scholar · View at Scopus
  30. A. S. Vemuri, J. C. H. Wu, K. C. Liu, and H. S. Wu, “Deformable three-dimensional model architecture for interactive augmented reality in minimally invasive surgery,” Surgical Endoscopy, vol. 26, pp. 3655–3662, 2012. View at Publisher · View at Google Scholar · View at Scopus
  31. M. Yoshino, T. Saito, T. Kin et al., “A microscopic optically tracking navigation system that uses high-resolution 3D computer graphics,” Neurologia Medico-Chirurgica, vol. 55, pp. 674–679, 2015. View at Publisher · View at Google Scholar · View at Scopus
  32. T. Okamoto, S. Onda, M. Matsumoto et al., “Utility of augmented reality system in hepatobiliary surgery,” Journal Hepato-Biliary-Pancreatic Sciences, vol. 20, pp. 249–253, 2013. View at Publisher · View at Google Scholar · View at Scopus
  33. S. Ieiri, M. Uemura, K. Konishi et al., “Augmented reality navigation system for laparoscopic splenectomy in children based on preoperative CT image using optical tracking device,” Pediatric Surgery International, vol. 28, pp. 341–346, 2012. View at Publisher · View at Google Scholar · View at Scopus
  34. M. Kersten-Oertel, I. Gerard, S. Drouin et al., “Augmented reality in neurovascular surgery: feasibility and first uses in the operating room,” International Journal of Computer Assisted Radiology and Surgery, vol. 10, pp. 1823–1836, 2015. View at Publisher · View at Google Scholar · View at Scopus
  35. T. Okamoto, S. Onda, J. Yasuda, K. Yanaga, N. Suzuki, and A. Hattori, “Navigation surgery using an augmented reality for pancreatectomy,” Digestive Surgery, vol. 32, pp. 117–123, 2015. View at Publisher · View at Google Scholar · View at Scopus
  36. M. Qu, Y. K. Hou, Y. R. Xu et al., “Precise positioning of an intraoral distractor using augmented reality in patients with hemifacial microsomia,” Journal of Cranio-Maxillofacial Surgery, vol. 43, pp. 106–112, 2015. View at Publisher · View at Google Scholar · View at Scopus
  37. J. T. Liang, T. Doke, S. Onogi et al., “A fluorolaser navigation system to guide linear surgical tool insertion,” International Journal of Computer Assisted Radiology and Surgery, vol. 7, pp. 931–939, 2012. View at Publisher · View at Google Scholar · View at Scopus
  38. S. Onda, T. Okamoto, M. Kanehira et al., “Short rigid scope and stereo-scope designed specifically for open abdominal navigation surgery: clinical application for hepatobiliary and pancreatic surgery,” Journal Hepato-Biliary-Pancreatic Sciences, vol. 20, pp. 448–453, 2013. View at Publisher · View at Google Scholar · View at Scopus
  39. S. Onda, T. Okamoto, M. Kanehira et al., “Identification of inferior pancreaticoduodenal artery during pancreaticoduodenectomy using augmented reality-based navigation system,” Journal Hepato-Biliary-Pancreatic Sciences, vol. 21, pp. 281–287, 2014. View at Publisher · View at Google Scholar · View at Scopus
  40. B. Vigh, S. Muller, O. Ristow et al., “The use of a head-mounted display in oral implantology: a feasibility study,” International Journal of Computer Assisted Radiology and Surgery, vol. 9, pp. 71–78, 2014. View at Publisher · View at Google Scholar · View at Scopus
  41. E. Wild, D. Teber, D. Schmid et al., “Robust augmented reality guidance with fluorescent markers in laparoscopic surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, pp. 899–907, 2016. View at Publisher · View at Google Scholar · View at Scopus
  42. K. Konishi, M. Hashizume, M. Nakamoto et al., “Augmented reality navigation system for endoscopic surgery based on three-dimensional ultrasound and computed tomography: application to 20 clinical cases,” in CARS 2005: Computer Assisted Radiology and Surgery, H. U. Lemke, K. Inamura, K. Doi, M. W. Vannier, and A. G. Farman, Eds., vol. 1281, pp. 537–542, Elsevier Science Bv, Amsterdam, 2005. View at Google Scholar
  43. M. Nakamoto, K. Nakada, Y. Sato, K. Konishi, M. Hashizume, and S. Tamura, “Intraoperative magnetic tracker calibration using a magneto-optic hybrid tracker for 3-D ultrasound-based navigation in laparoscopic surgery,” IEEE Transactions on Medical Imaging, vol. 27, pp. 255–270, 2008. View at Publisher · View at Google Scholar · View at Scopus
  44. R. J. Lapeer, S. J. Jeffrey, J. T. Dao et al., “Using a passive coordinate measurement arm for motion tracking of a rigid endoscope for augmented-reality image-guided surgery,” International Journal of Medical Robotics and Computer Assisted Surgery, vol. 10, pp. 65–77, 2014. View at Publisher · View at Google Scholar · View at Scopus
  45. C. Conrad, M. Fusaglia, M. Peterhans, H. X. Lu, S. Weber, and B. Gayet, “Augmented reality navigation surgery facilitates laparoscopic rescue of failed portal vein embolization,” Journal of the American College of Surgeons, vol. 223, pp. E31–E34, 2016. View at Publisher · View at Google Scholar · View at Scopus
  46. S. Nicolau, L. Soler, D. Mutter, and J. Marescaux, “Augmented reality in laparoscopic surgical oncology,” Surgical Oncology-Oxford, vol. 20, pp. 189–201, 2011. View at Publisher · View at Google Scholar · View at Scopus
  47. A. Hostettler, S. A. Nicolau, Y. Remond, J. Marescaux, and L. Soler, “A real-time predictive simulation of abdominal viscera positions during quiet free breathing,” Progress in Biophysics and Molecular Biology, vol. 103, pp. 169–184, 2010. View at Publisher · View at Google Scholar · View at Scopus
  48. N. Haouchine, J. Dequidt, M. O. Berger, and S. Cotin, “Deformation-based augmented reality for hepatic surgery,” Studies in Health Technology and Informatics, vol. 184, pp. 182–188, 2013. View at Publisher · View at Google Scholar · View at Scopus
  49. T. Kilgus, E. Heim, S. Haase et al., “Mobile markerless augmented reality and its application in forensic medicine,” International Journal of Computer Assisted Radiology and Surgery, vol. 10, pp. 573–586, 2015. View at Publisher · View at Google Scholar · View at Scopus
  50. Y. Hayashi, K. Misawa, D. J. Hawkes, and K. Mori, “Progressive internal landmark registration for surgical navigation in laparoscopic gastrectomy for gastric cancer,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, pp. 837–845, 2016. View at Publisher · View at Google Scholar · View at Scopus
  51. J. Kowalczuk, A. Meyer, J. Carlson et al., “Real-time three-dimensional soft tissue reconstruction for laparoscopic surgery,” Surgical Endoscopy, vol. 26, pp. 3413–3417, 2012. View at Publisher · View at Google Scholar · View at Scopus
  52. R. Krishnan, A. Raabe, and V. Seifert, “Accuracy and applicability of laser surface scanning as new registration technique in image-guided neurosurgery,” in Cars 2004: Computer Assisted Radiology and Surgery, H. U. Lemke, K. Inamura, K. Doi, M. W. Vannier, A. G. Farman, and R. JHC, Eds., vol. 1268, pp. 678–683, Elsevier Science Bv, Amsterdam, 2004. View at Google Scholar
  53. K. Schicho, M. Figl, R. Seemann et al., “Comparison of laser surface scanning and fiducial marker-based registration in frameless stereotaxy - technical note,” Journal of Neurosurgery, vol. 106, pp. 704–709, 2007. View at Publisher · View at Google Scholar · View at Scopus
  54. S. C. Lee, B. Fuerst, J. Fotouhi, M. Fischer, G. Osgood, and N. Navab, “Calibration of RGBD camera and cone-beam CT for 3D intra-operative mixed reality visualization,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, pp. 967–975, 2016. View at Publisher · View at Google Scholar · View at Scopus
  55. M. S. Nosrati, A. Amir-Khalili, J. M. Peyrat et al., “Endoscopic scene labelling and augmentation using intraoperative pulsatile motion and colour appearance cues with preoperative anatomical priors,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, pp. 1409–1418, 2016. View at Publisher · View at Google Scholar · View at Scopus
  56. A. Amir-Khalili, G. Hamarneh, J. M. Peyrat et al., “Automatic segmentation of occluded vasculature via pulsatile motion analysis in endoscopic robot-assisted partial nephrectomy video,” Medical Image Analysis, vol. 25, pp. 103–110, 2015. View at Publisher · View at Google Scholar · View at Scopus
  57. L. Li, J. Yang, Y. K. Chu et al., “A novel augmented reality navigation system for endoscopic sinus and skull base surgery: a feasibility study,” PLoS One, vol. 11, p. 17, 2016. View at Publisher · View at Google Scholar · View at Scopus
  58. M. Muller, M. C. Rassweiler, J. Klein et al., “Mobile augmented reality for computer-assisted percutaneous nephrolithotomy,” International Journal of Computer Assisted Radiology and Surgery, vol. 8, pp. 663–675, 2013. View at Publisher · View at Google Scholar · View at Scopus
  59. W. W. Deng, F. Li, M. N. Wang, and Z. J. Song, “Easy-to-use augmented reality neuronavigation using a wireless tablet PC,” Stereotactic and Functional Neurosurgery, vol. 92, pp. 17–24, 2014. View at Publisher · View at Google Scholar · View at Scopus
  60. D. Katic, P. Spengler, S. Bodenstedt et al., “A system for context-aware intraoperative augmented reality in dental implant surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 10, pp. 101–108, 2015. View at Publisher · View at Google Scholar · View at Scopus
  61. I. Cabrilo, P. Bijlenga, and K. Schaller, “Augmented reality in the surgery of cerebral arteriovenous malformations: technique assessment and considerations,” Acta Neurochirurgica, vol. 156, pp. 1769–1774, 2014. View at Publisher · View at Google Scholar · View at Scopus
  62. M. Riechmann, L. Kahrs, C. Ulmer, J. Raczkowsky, W. Lamadé, and H. Wörn, “Visualisierungskonzept für die projektorbasierte Erweiterte Realität in der Leberchirurgie,” Proceeding of BMT, vol. 209, pp. 1-2, 2006. View at Google Scholar
  63. F. Volonte, F. Pugin, P. Bucher, M. Sugimoto, O. Ratib, and P. Morel, “Augmented reality and image overlay navigation with OsiriX in laparoscopic and robotic surgery: not only a matter of fashion,” Journal Hepato-Biliary-Pancreatic Sciences, vol. 18, pp. 506–509, 2011. View at Publisher · View at Google Scholar · View at Scopus
  64. R. Souzaki, S. Ieiri, M. Uemura et al., “An augmented reality navigation system for pediatric oncologic surgery based on preoperative CT and MRI images,” Journal of Pediatric Surgery, vol. 48, pp. 2479–2483, 2013. View at Publisher · View at Google Scholar · View at Scopus
  65. A. Wang, S. M. Mirsattari, A. G. Parrent, and T. M. Peters, “Fusion and visualization of intraoperative cortical images with preoperative models for epilepsy surgical planning and guidance,” Computer Aided Surgery, vol. 16, pp. 149–160, 2011. View at Publisher · View at Google Scholar · View at Scopus
  66. A. Mert, K. Buehler, G. R. Sutherland et al., “Brain tumor surgery with 3-dimensional surface navigation,” Neurosurgery, vol. 71, pp. 286–294, 2012. View at Publisher · View at Google Scholar · View at Scopus
  67. I. Cabrilo, P. Bijlenga, and K. Schaller, “Augmented reality in the surgery of cerebral aneurysms: a technical report,” Neurosurgery, vol. 10, pp. 252–260, 2014. View at Publisher · View at Google Scholar · View at Scopus
  68. I. Cabrilo, A. Sarrafzadeh, P. Bijlenga, B. N. Landis, and K. Schaller, “Augmented reality-assisted skull base surgery,” Neurochirurgie, vol. 60, pp. 304–306, 2014. View at Publisher · View at Google Scholar · View at Scopus
  69. A. Schoob, D. Kundrat, L. Kleingrothe, L. A. Kahrs, N. Andreff, and T. Ortmaier, “Tissue surface information for intraoperative incision planning and focus adjustment in laser surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 10, pp. 171–181, 2015. View at Publisher · View at Google Scholar · View at Scopus
  70. N. L. Rodas and N. Padoy, “Seeing is believing: increasing intraoperative awareness to scattered radiation in interventional procedures by combining augmented reality, Monte Carlo simulations and wireless dosimeters,” International Journal of Computer Assisted Radiology and Surgery, vol. 10, pp. 1181–1191, 2015. View at Publisher · View at Google Scholar · View at Scopus
  71. R. Londei, M. Esposito, B. Diotte et al., “Intra-operative augmented reality in distal locking,” International Journal of Computer Assisted Radiology and Surgery, vol. 10, pp. 1395–1403, 2015. View at Publisher · View at Google Scholar · View at Scopus
  72. F. Y. Shen, B. L. Chen, Q. S. Guo, Y. Qi, and Y. Shen, “Augmented reality patient-specific reconstruction plate design for pelvic and acetabular fracture surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 8, pp. 169–179, 2013. View at Publisher · View at Google Scholar · View at Scopus
  73. M. Zhu, G. Chai, Y. Zhang, X. F. Ma, and J. L. Gan, “Registration strategy using occlusal splint based on augmented reality for mandibular angle oblique split osteotomy,” The Journal of Craniofacial Surgery, vol. 22, pp. 1806–1809, 2011. View at Publisher · View at Google Scholar · View at Scopus
  74. S. Weber, M. Klein, A. Hein, T. Krueger, T. C. Lueth, and J. Bier, “The navigated image viewer - evaluation in maxillofacial surgery,” in Medical Image Computing and Computer-Assisted Intervention - Miccai 2003, Pt 1, R. E. Ellis and T. M. Peters, Eds., vol. 2878, pp. 762–769, Springer-Verlag Berlin, Berlin, 2003. View at Google Scholar
  75. C. Nikou, A. M. Digioia, M. Blackwell, B. Jaramaz, and T. Kanade, “Augmented reality imaging technology for orthopaedic surgery,” Operative Techniques in Orthopaedics, vol. 10, pp. 82–86, 2000. View at Publisher · View at Google Scholar
  76. M. Blackwell, F. Morgan, and A. M. DiGioia, “Augmented reality and its future in orthopaedics,” Clinical Orthopaedics and Related Research, vol. 354, pp. 111–122, 1998. View at Publisher · View at Google Scholar
  77. A. Wagner, M. Rasse, W. Millesi, and R. Ewers, “Virtual reality for orthognathic surgery: the augmented reality environment concept,” Journal of Oral and Maxillofacial Surgery, vol. 55, pp. 456–462, 1997. View at Publisher · View at Google Scholar
  78. A. Hughes-Hallett, E. K. Mayer, P. Pratt, A. Mottrie, A. Darzi, and J. Vale, “The current and future use of imaging in urological robotic surgery: a survey of the European Association of Robotic Urological Surgeons,” International Journal of Medical Robotics and Computer Assisted Surgery, vol. 11, pp. 8–14, 2015. View at Publisher · View at Google Scholar · View at Scopus
  79. F. Volonte, F. Pugin, N. C. Buchs et al., “Console-integrated stereoscopic OsiriX 3D volume-rendered images for da Vinci colorectal robotic surgery,” Surgical Innovation, vol. 20, pp. 158–163, 2013. View at Publisher · View at Google Scholar · View at Scopus
  80. I. Cabrilo, K. Schaller, and P. Bijlenga, “Augmented reality-assisted bypass surgery: embracing minimal invasiveness,” World Neurosurgery, vol. 83, pp. 596–602, 2015. View at Publisher · View at Google Scholar · View at Scopus
  81. L. Lin, Y. Y. Shi, A. Tan et al., “Mandibular angle split osteotomy based on a novel augmented reality navigation using specialized robot-assisted arms-a feasibility study,” Journal of Cranio-Maxillofacial Surgery, vol. 44, pp. 215–223, 2016. View at Publisher · View at Google Scholar · View at Scopus
  82. M. Fischer, B. Fuerst, S. C. Lee et al., “Preclinical usability study of multiple augmented reality concepts for K-wire placement,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, pp. 1007–1014, 2016. View at Publisher · View at Google Scholar · View at Scopus
  83. D. Ntourakis, R. Memeo, L. Soler, J. Marescaux, D. Mutter, and P. Pessaux, “Augmented reality guidance for the resection of missing colorectal liver metastases: an initial experience,” World Journal of Surgery, vol. 40, pp. 419–426, 2016. View at Publisher · View at Google Scholar · View at Scopus
  84. J. Hallet, L. Soler, M. Diana et al., “Trans-thoracic minimally invasive liver resection guided by augmented reality,” Journal of the American College of Surgeons, vol. 220, pp. E55–E60, 2015. View at Publisher · View at Google Scholar · View at Scopus
  85. O. R. Brouwer, N. Van den Berg, H. Matheron et al., “Feasibility of image guided sentinel node biopsy using augmented reality and SPECT/CT-based 3D navigation,” Annals of Surgical Oncology, vol. 20, pp. S103–S103, 2013. View at Google Scholar
  86. O. Ukimura and I. S. Gill, “Imaging-assisted endoscopic surgery: Cleveland clinic experience,” Journal of Endourology, vol. 22, pp. 803–809, 2008. View at Publisher · View at Google Scholar · View at Scopus
  87. J. D'Agostino, J. Wall, L. Soler, M. Vix, Q. Y. Duh, and J. Marescaux, “Virtual neck exploration for parathyroid adenomas a first step toward minimally invasive image-guided surgery,” JAMA Surgery, vol. 148, pp. 232–238, 2013. View at Publisher · View at Google Scholar · View at Scopus
  88. J. D'Agostino, M. Diana, M. Vix et al., “Three-dimensional metabolic and radiologic gathered evaluation using VR-RENDER fusion: a novel tool to enhance accuracy in the localization of parathyroid adenomas,” World Journal of Surgery, vol. 37, pp. 1618–1625, 2013. View at Publisher · View at Google Scholar · View at Scopus
  89. J. Marescaux, F. Rubino, M. Arenas, D. Mutter, and L. Soler, “Augmented-reality-assisted laparoscopic adrenalectomy,” JAMA: The Journal of the American Medical Association, vol. 292, pp. 2214-2215, 2004. View at Publisher · View at Google Scholar
  90. C. Winne, M. Khan, F. Stopp, E. Jank, and E. Keeve, “Overlay visualization in endoscopic ENT surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 6, pp. 401–406, 2011. View at Publisher · View at Google Scholar · View at Scopus
  91. P. Mezzana, F. Scarinci, and N. Marabottini, “Augmented reality in oculoplastic surgery: first iPhone application,” Plastic and Reconstructive Surgery, vol. 127, pp. 57E–58E, 2011. View at Publisher · View at Google Scholar · View at Scopus
  92. Y. Mochizuki, A. Hosaka, H. Kamiuchi et al., “New simple image overlay system using a tablet PC for pinpoint identification of the appropriate site for anastomosis in peripheral arterial reconstruction,” Surgery Today, vol. 46, pp. 1387–1393, 2016. View at Publisher · View at Google Scholar · View at Scopus
  93. M. E. Currie, A. J. McLeod, J. T. Moore et al., “Augmented reality system for ultrasound guidance of transcatheter aortic valve implantation,” Innovations, vol. 11, pp. 31–39, 2016. View at Publisher · View at Google Scholar · View at Scopus
  94. A. Balaphas, N. C. Buchs, J. Meyer, M. E. Hagen, and P. Morel, “Partial splenectomy in the era of minimally invasive surgery: the current laparoscopic and robotic experiences,” Surgical Endoscopy, vol. 29, pp. 3618–3627, 2015. View at Publisher · View at Google Scholar · View at Scopus
  95. F. Volonte, N. C. Buchs, F. Pugin et al., “Augmented reality to the rescue of the minimally invasive surgeon. The usefulness of the interposition of stereoscopic images in the da Vinci (TM) robotic console,” International Journal of Medical Robotics and Computer Assisted Surgery, vol. 9, pp. E34–E38, 2013. View at Google Scholar
  96. J. R. Watson, N. Martirosyan, J. Skoch, G. M. Lemole, R. Anton, and M. Romanowski, “Augmented microscopy with near-infrared fluorescence detection,” in Molecular-Guided Surgery: Molecules, Devices, and Applications, B. W. Pogue and S. Gioux, Eds., vol. 9311, Spie-Int Soc Optical Engineering, Bellingham, 2015. View at Google Scholar
  97. M. Diana, P. Halvax, B. Dallemagne et al., “Real-time navigation by fluorescence-based enhanced reality for precise estimation of future anastomotic site in digestive surgery,” Surgical Endoscopy, vol. 28, pp. 3108–3118, 2014. View at Publisher · View at Google Scholar · View at Scopus
  98. M. Diana, E. Noll, P. Diemunsch et al., “Enhanced-reality video fluorescence a real-time assessment of intestinal viability,” Annals of Surgery, vol. 259, pp. 700–707, 2014. View at Publisher · View at Google Scholar · View at Scopus
  99. N. L. Martirosyan, J. Skoch, J. R. Watson, G. M. Lemole, and M. Romanowski, “Integration of indocyanine green videoangiography with operative microscope: augmented reality for interactive assessment of vascular structures and blood flow,” Operative Neurosurgery, vol. 11, pp. 252–257, 2015. View at Publisher · View at Google Scholar · View at Scopus
  100. Y. Koreeda, Y. Kobayashi, S. Ieiri et al., “Virtually transparent surgical instruments in endoscopic surgery with augmentation of obscured regions,” International Journal of Computer Assisted Radiology and Surgery, vol. 11, pp. 1927–1936, 2016. View at Publisher · View at Google Scholar · View at Scopus
  101. H. J. Marcus, P. Pratt, A. Hughes-Hallett et al., “Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study,” Journal of Neurosurgery, vol. 123, pp. 307–313, 2015. View at Publisher · View at Google Scholar · View at Scopus
  102. C. Hansen, J. Wieferich, F. Ritter, C. Rieder, and H. O. Peitgen, “Illustrative visualization of 3D planning models for augmented reality in liver surgery,” International Journal of Computer Assisted Radiology and Surgery, vol. 5, pp. 133–141, 2010. View at Publisher · View at Google Scholar · View at Scopus