Table of Contents Author Guidelines Submit a Manuscript
Applied Bionics and Biomechanics
Volume 2015, Article ID 543492, 9 pages
http://dx.doi.org/10.1155/2015/543492
Research Article

Navigating from a Depth Image Converted into Sound

1University Grenoble Alpes, LPNC, 38000 Grenoble, France
2CNRS, LPNC, 38000 Grenoble, France
3University Grenoble Alpes, GIPSA-Lab, 38000 Grenoble, France

Received 18 July 2014; Accepted 18 January 2015

Academic Editor: Simo Saarakkala

Copyright © 2015 Chloé Stoll et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Linked References

  1. G. J. Chader, J. Weiland, and M. S. Humayun, “Artificial vision: needs, functioning, and testing of a retinal electronic prosthesis,” Progress in Brain Research, vol. 175, pp. 317–332, 2009. View at Publisher · View at Google Scholar · View at Scopus
  2. J. Dowling, “Artificial human vision,” Expert Review of Medical Devices, vol. 2, no. 1, pp. 73–85, 2005. View at Publisher · View at Google Scholar · View at Scopus
  3. J. T. Kaiser, Using the Brainport for independent travel and obstacle avoidance [Ph.D. dissertation], University of Pittsburgh, Pittsburgh, Pa, USA, 2014.
  4. P. Bach-y-Rita, “Tactile sensory substitution studies,” Annals of the New York Academy of Sciences, vol. 1013, pp. 83–91, 2004. View at Google Scholar · View at Scopus
  5. C. Thinus-Blanc and F. Gaunet, “Representation of space in blind persons: vision as a spatial sense?” Psychological Bulletin, vol. 121, no. 1, pp. 20–42, 1997. View at Publisher · View at Google Scholar · View at Scopus
  6. P. B. L. Meijer, “An experimental system for auditory image representations,” IEEE Transactions on Biomedical Engineering, vol. 39, no. 2, pp. 112–121, 1992. View at Publisher · View at Google Scholar · View at Scopus
  7. M. Auvray, S. Hanneton, and J. K. O'Regan, “Learning to perceive with a visuo-auditory substitution system: localisation and object recognition with “the vOICe”,” Perception, vol. 36, no. 3, pp. 416–430, 2007. View at Publisher · View at Google Scholar · View at Scopus
  8. E. Striem-Amit, L. Cohen, S. Dehaene, and A. Amedi, “Reading with sounds: sensory substitution selectively activates the visual word form area in the blind,” Neuron, vol. 76, no. 3, pp. 640–652, 2012. View at Publisher · View at Google Scholar · View at Scopus
  9. E. Striem-Amit, M. Guendelman, and A. Amedi, “‘visual’ acuity of the congenitally blind using visual-to-auditory sensory substitution,” PLoS ONE, vol. 7, no. 3, Article ID e33136, 2012. View at Publisher · View at Google Scholar · View at Scopus
  10. J. M. Loomis, J. R. Marston, R. G. Golledge, and R. L. Klatzky, “Personal guidance system for people with visual impairment: a comparison of spatial displays for route guidance,” Journal of Visual Impairment & Blindness, vol. 99, no. 4, pp. 219–232, 2005. View at Google Scholar · View at Scopus
  11. J. M. Loomis, R. L. Klatzky, and R. G. Golledge, “Navigating without vision: basic and applied research,” Optometry and Vision Science, vol. 78, no. 5, pp. 282–289, 2001. View at Google Scholar · View at Scopus
  12. J. M. Loomis, R. G. Golledge, and R. L. Klatzky, “Navigation system for the blind: auditory display modes and guidance,” Presence: Teleoperators and Virtual Environments, vol. 7, no. 2, pp. 193–203, 1998. View at Publisher · View at Google Scholar · View at Scopus
  13. R. L. Klatzky, J. R. Marston, N. A. Giudice, R. G. Golledge, and J. M. Loomis, “Cognitive load of navigating without vision when guided by virtual sound versus spatial language,” Journal of Experimental Psychology: Applied, vol. 12, no. 4, pp. 223–232, 2006. View at Publisher · View at Google Scholar · View at Scopus
  14. A. C. Nau, C. Pintar, C. Fisher, J.-H. Jeong, and K. Jeong, “A standardized obstacle course for assessment of visual function in ultra low vision and artificial vision,” Journal of Visualized Experiments, no. 84, Article ID e51205, 2014. View at Publisher · View at Google Scholar
  15. J. Cronly-Dillon, K. Persaud, and R. P. F. Gregory, “The perception of visual images encoded in musical form: a study in cross-modality information transfer,” Proceedings of the Royal Society B: Biological Sciences, vol. 266, no. 1436, pp. 2427–2433, 1999. View at Publisher · View at Google Scholar · View at Scopus
  16. C. Capelle, C. Trullemans, P. Arno, and C. Veraart, “A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution,” IEEE Transactions on Biomedical Engineering, vol. 45, no. 10, pp. 1279–1293, 1998. View at Publisher · View at Google Scholar · View at Scopus
  17. J. L. González-Mora, A. Rodríguez-Hernández, L. F. Rodríguez-Ramos, L. Díaz-Saco, and N. Sosa, “Development of a new space perception system for blind people, based on the creation of a virtual acoustic space,” in Engineering Applications of Bio-Inspired Artificial Neural Networks, J. Mira and J. Sanchez-Andres, Eds., vol. 1607 of Lecture Notes in Computer Science, pp. 321–330, Springer, Berlin, Germany, 1999. View at Publisher · View at Google Scholar
  18. S. Hanneton, M. Auvray, and B. Durette, “The vibe: a versatile vision-to-audition sensory substitution device,” Applied Bionics and Biomechanics, vol. 7, no. 4, pp. 269–276, 2010. View at Publisher · View at Google Scholar · View at Scopus
  19. G. Bologna, B. Deville, T. Pun, and M. Vinckenbosch, “Transforming 3D coloured pixels into musical instrument notes for vision substitution applications,” EURASIP Journal on Image and Video Processing, vol. 2007, Article ID 076204, 2007. View at Publisher · View at Google Scholar
  20. D. R. Griffin, Listening in the Dark: The Acoustic Orientation of Bats and Men, Yale University Press, Oxford, UK, 1958.
  21. W. N. Kellogg, “Auditory perception of submerged objects by porpoises,” The Journal of the Acoustical Society of America, vol. 31, no. 1, pp. 1–6, 1959. View at Publisher · View at Google Scholar
  22. A. J. Kolarik, S. Cirstea, and S. Pardhan, “Evidence for enhanced discrimination of virtual auditory distance among blind listeners using level and direct-to-reverberant cues,” Experimental Brain Research, vol. 224, no. 4, pp. 623–633, 2013. View at Publisher · View at Google Scholar · View at Scopus
  23. A. Aladren, G. Lopez-Nicolas, L. Puig, and J. J. Guerrero, “Navigation assistance for the visually impaired using RGB-D sensor with range expansion,” IEEE Systems Journal, no. 99, pp. 1–11, 2014. View at Publisher · View at Google Scholar · View at Scopus
  24. S. L. Hicks, I. Wilson, L. Muhammed, J. Worsfold, S. M. Downes, and C. Kennard, “A depth-based head-mounted visual display to aid navigation in partially sighted individuals,” PLoS ONE, vol. 8, no. 7, Article ID e67695, 2013. View at Publisher · View at Google Scholar · View at Scopus
  25. Y. H. Lee and G. Medioni, “Wearable RGBD indoor navigation system for the blind,” in Proceedings of the ECCV Workshop on Assistive Computer Vision and Robotics, Zurich, Switzerland, September 2014.
  26. Y. H. Lee and G. Medioni, “A RGB-D camera Based Navigation for the Visually Impaired, RSS 2011 RGB-D: Advanced Reasoning with Depth Camera Workshop,” Los Angeles, Calif, USA, June 2011.
  27. F. Ribeiro, D. Florencio, P. A. Chou, and Z. Zhang, “Auditory augmented reality: object sonification for the visually impaired,” in Proceedings of the IEEE 14th International Workshop on Multimedia Signal Processing (MMSP '12), pp. 319–324, September 2012. View at Publisher · View at Google Scholar · View at Scopus
  28. Z. Wang, H. Liu, X. Wang, and Y. Qian, “Segment and label indoor scene based on RGB-D for the visually impaired,” in MultiMedia Modeling, C. Gurrin, F. Hopfgartner, W. Hurst, H. Johansen, H. Lee, and N. O'Connor, Eds., vol. 8325 of Lecture Notes in Computer Science, pp. 449–460, Springer, Berlin, Germany, 2014. View at Publisher · View at Google Scholar
  29. V. Fristot, J. Boucheteil, L. Granjon, D. Pellerin, and D. Alleysson, “Depth melody substitution,” in Proceedings of the 20th European Signal Processing Conference (EUSIPCO '12), Bucharest, Romania, August 2012. View at Scopus
  30. M. Brock and P. O. Kristensson, “Supporting blind navigation using depth sensing and sonification,” in Proceedings of the ACM Conference on Pervasive and Ubiquitous Computing (UbiComp '13), pp. 255–258, Adjunct, Zürich, Switzerland, September 2013. View at Publisher · View at Google Scholar · View at Scopus
  31. M. R. Andersen, T. Jensen, P. Lisouski et al., “Kinect depth sensor evaluation for computer vision applications,” Electrical and Computer Engineering, Technical Report ECE-TR-6, Department of Engineering, Electrical and Computer Engineering, Aarhus University, 2012. View at Google Scholar
  32. A. Landa-Hernández, H. Casarubias-Vargas, and E. Bayro-Corrochano, “Geometric fuzzy techniques for guidance of visually impaired people,” Applied Bionics and Biomechanics, vol. 10, no. 4, pp. 139–157, 2013. View at Publisher · View at Google Scholar · View at Scopus
  33. M. Auvray, Immersion et perception spatiale. L'exemple des dispositifs de substitution sensorielle [Ph.D. thesis], École des Hautes Études en Sciences Sociales, Paris, France, 2004.