Vision substitution and depth perception: Early blind subjects experience visual perspective through their ears

References

• Bach-y Rita P, Collins CC, Saunders F, White B, Scadden L. Vision substitution by tactile image projection. Nature 1969;221:963–964.
   PubMedGoogle Scholar
• Bach-y-Rita P, Kaczmarek KA, Tyler ME, Garcia-Lara J. Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. J Rehabil Res Dev 1998;35:427–430.
   PubMed Web of Science ®Google Scholar
• White B, Saunders FA, Scadden L, Bach-y-Rita P, Collins CC. Seeing with the skin. Percept Psychophys 1970;7:23–27.
   Google Scholar
• Capelle C, Trullemans C, Arno P, Veraart C. A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution. IEEE Trans Biomed Eng 1998;45:1279–1293.
   PubMed Web of Science ®Google Scholar
• Cronly-Dillon J, Persaud K, Gregory RP. The perception of visual images encoded in musical form: a study in cross-modality information transfer. Proc R Soc Lond B Biol Sci 1999;266:2427–2433.
   PubMed Web of Science ®Google Scholar
• Meijer PB. An experimental system for auditory image representations. IEEE Trans Biomed Eng 1992;39:112–121.
   PubMed Web of Science ®Google Scholar
• Kay L. Orientation of bats and men by ultrasonic echo-location. Br Commun Electron 1961;8:582–586.
   Google Scholar
• Kay L. The Sonic Glasses evaluated. New Outlook Blind 1973;67:7–11.
   Google Scholar
• Kay L. A sonar aid to enhance spatial perception of the blind: engineering design and evaluation. Radio Electron Eng 1974;44:605–627.
   Google Scholar
• Belardinelli MO, Federici S, Delogu F, Palmiero M. Sonification of spatial information: audio-tactile exploration strategies by normal and blind subjects. In: Stephanidis C, editor. Universal access in HCI, Part II, HCII, Berlin Heidelberg, DE: Springer-Verlag; 2009 LNCS 5615. pp 557–563.
   Google Scholar
• Sensory Substitution, definition and description from Wikipedia, the free enciclopedia Internet. Electronic Citation. http://en.wikipedia.org/wiki/Sensory_substitution. Last accessed 22 August 2009.
   Google Scholar
• Sensory Substitution – Vision Substitution, definition and description from Peter Meijer website Internet. Electronic Citation. http://www.seeingwithsound.com/sensub.htm. Last accessed 4 September 2009.
   Google Scholar
• Delogu F, Palmiero M, Federici S, Zhao H, Plaisant C, Olivetti Belardinelli M. Non-visual exploration of geographic maps: does sonification help?Disabil Rehabil Assist Technol, in press.
   Google Scholar
• Renier L, De Volder AG. Cognitive and brain mechanisms in sensory substitution of vision: a contribution to the study of human perception. J Integr Neurosci 2005;4:489–503.
   PubMedGoogle Scholar
• Bach-y-Rita P. Brain mechanisms in sensory substitution, San Diego, CA: Academic Press; 1972.
   Google Scholar
• Renier L, Laloyaux C, Collignon O, Tranduy D, Vanlierde A, Bruyer R, De Volder A, The Ponzo illusion with auditory substitution of vision in sighted and early-blind subjects. Perception 2005;34:857–867.
   PubMed Web of Science ®Google Scholar
• Renier L, Bruyer R, De Volder AG. Vertical-horizontal illusion present for sighted but not early blind humans using auditory substitution of vision. Percept Psychophys 2006;68:535–542.
   PubMedGoogle Scholar
• Amedi A, Stern WM, Camprodon JA, Bermpohl F, Merabet L, Rotman S, Hemond C, Meijer P, Pascual-Leone A. Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nat Neurosci 2007;10:687–689.
   PubMed Web of Science ®Google Scholar
• Poirier C, De Volder A, Tranduy D, Scheiber C. Pattern recognition using a device substituting audition for vision in blindfolded sighted subjects. Neuropsychologia 2007;45:1108–1121.
   PubMedGoogle Scholar
• Renier L, Collignon O, Poirier C, Tranduy D, Vanlierde A, Bol A, Veraart C, De Volder A. Cross-modal activation of visual cortex during depth perception using auditory substitution of vision. Neuroimage 2005;26:573–580.
   PubMedGoogle Scholar
• Auvray M, Hanneton S, Lenay C, O'Regan K. There is something out there: distal attribution in sensory substitution, twenty years later. J Integr Neurosci 2005;4:505–521.
   PubMedGoogle Scholar
• Bach-y-Rita P, Tyler M E, Kaczmarek KA. Seeing with the brain. Int J Hum Comp Interact 2003;15:285–295.
   Web of Science ®Google Scholar
• O'Regan JK, Noe AA. sensorimotor account of vision and visual consciousness. Behav Brain Sci 2001;24:939–973.
   PubMed Web of Science ®Google Scholar
• Arno P, De Volder AG, Vanlierde A, Wanet-Defalque M-C, Streel E, Robert A, Veraart C. Occipital activation by pattern recognition in the early blind using auditory substitution for vision. Neuroimage 2001;13:632–645.
   PubMedGoogle Scholar
• De Volder AG, Catalan-Ahumada M, Robert A, Bol A, Labar D, Coppens A, Michel C, Veraart C. Changes in occipital cortex activity in early blind humans using a sensory substitution device. Brain Res 1999;826:128–134.
   PubMed Web of Science ®Google Scholar
• Ptito M, Moesgaard SM, Gjedde A, Kupers R. Cross-modal plasticity revealed by electrotactile stimulation of the tongue in the congenitally blind. Brain 2005;128 (Pt 3):606–614.
   PubMedGoogle Scholar
• Arno P, Vanlierde A, Streel E, Wanet-Defalque MC, Sanabria-Bohorquez S, Veraart C. Auditory substitution of vision: pattern recognition by the blind. Appl Cogn Psychol 2001;15:509–519.
   Web of Science ®Google Scholar
• Sampaio E, Maris S, Bach-y-Rita P. Brain plasticity: ‘visual’ acuity of blind persons via the tongue. Brain Res 2001;908:204–207.
   PubMed Web of Science ®Google Scholar
• Bach-y-Rita P, Kercel SW. Sensory substitution and the human-machine interface. Trends Cogn Sci 2003;7:541–546.
   PubMed Web of Science ®Google Scholar
• Rauschecker JP. Compensatory plasticity and sensory substitution in the cerebral cortex. Trends Neurosci 1995;18:36–43.
   PubMed Web of Science ®Google Scholar
• Wiesel TN, Hubel DH. Comparison of the effects of unilateral and bilateral eye closure on cortical unit responses in kittens. J Neurophysiol 1965;28:1029–1040.
   PubMed Web of Science ®Google Scholar
• Wiesel TN, Hubel DH. Extent of recovery from the effects of visual deprivation in kittens. J Neurophysiol 1965;28:1060–1072.
   PubMed Web of Science ®Google Scholar
• Renier L, Anurova I, De Volder A, Carlson S, VanMeter J, Rauschecker J. Multisensory integration of sounds and vibro-tactile stimuli in processing streams for ‘what’ and ‘where’. J Neurosci 2009;29:10950–10960.
   PubMedGoogle Scholar
• Avraamides M, Loomis J, Klatzky RL, Golledge RG. Functional equivalence of spatial representations derived from vision and language: evidence from allocentric judgments. J Exp Psychol Learn 2004;30:801–814.
   Google Scholar
• Ungar S. Cognitive mapping without visual experience. In: R. Kitchin, S. Freundschuh, editors. Cogntive mapping: past, present and future, London: Routledge; 2000. pp 221–248.
   Google Scholar
• Fortin M, Voss P, Rainville C, Lassonde M, Lepore F. Impact of vision on the development of topographical orientation abilities. Neuroreport 2006;17:443–446.
   PubMedGoogle Scholar
• Benson C, Yonas A. Development of sensitivity to static pictorial depth information. Percep Psychophys 1973;13:361–366.
   Web of Science ®Google Scholar
• Granrud CE, Yonas A, Pettersen LA. Comparison of monocular and binocular depth perception in 5- and 7-month-old infants. J Exp Child Psychol 1984;38:19–32.
   PubMed Web of Science ®Google Scholar
• Yonas A, Cleaves W, Pettersen L. Development of sensitivity to pictorial depth Science 1978;200:77–79.
   Google Scholar
• Gregory RL, Wallace JG. Recovery from early blindness: a case study, Experimental Psychology Monograph, No. 2 Heffer, London 501. 1963.
   Google Scholar
• Heller MA, Calcaterra JA, Tyler LA, Burson LL. Production and interpretation of perspective drawings by blind and sighted people. Perception 1996;25:321–334.
   PubMed Web of Science ®Google Scholar
• Palmer SE. Vision science photons to phenomenology, Cambridge, MA: MIT Press; 1999.
   Google Scholar
• Locke J. An essay concerning human understanding, Oxford: Clarendon Press; 1694 (reprinted in 1979).
   Google Scholar
• Degenaar M. Molyneux's problem: three centuries of discussion on the perception of forms, London: Kluwer Academic Publishers; 1996.
   Google Scholar
• Morgan M. Molyneux's question, Cambridge: Cambridge University Press; 1977.
   Google Scholar
• Jacomuzzi A, Kobau P, Bruno N. Molyneux's question redux. Phenomenol Cogn Sci 2003;2:255–280.
   Google Scholar
• Auvray M, Hanneton S, O'Regan JK. Learning to perceive with a visuo-auditory substitution system: localisation and object recognition with ‘the vOICe’. Perception 2007;36:416–430.
   PubMed Web of Science ®Google Scholar
• Arno P, Capelle C, Wanet-Defalque M-C, Catalan-Ahumada M, Veraart C. Auditory coding of visual patterns for the blind. Perception 1999;28:1013–1029.
   PubMed Web of Science ®Google Scholar
• Inui T, Tanaka S, Okada T, Nishizawa S, Katayama M, Konishi J. Neural substrates for depth perception of the Necker cube; a functional magnetic resonance imaging study in human subjects. Neurosci Lett 2000;282:145–148.
   PubMed Web of Science ®Google Scholar
• Taira M, Nose I, Inoue K, Tsutsui K. Cortical areas related to attention to 3D surface structures based on shading: an fMRI study. Neuroimage 2001;14:959–966.
   PubMedGoogle Scholar
• Guarniero G. Experience of tactile vision. Perception 1974;3:101–104.
   PubMed Web of Science ®Google Scholar
• Guarniero G. Tactile vision: a personal view. J Vis Impair Blindness 1977;March:125–130.
   Google Scholar
• Epstein W, Hugues B, Schneider S, Bach-y-Rita P. Is there anything out there? A study of distal attribution in response to vibro-tactile stimulation. Perception 1986;15:275–284.
   PubMedGoogle Scholar
• Schneider SL, Hugues B, Epstein W, Bach-y-Rita P. The detection of length and orientation changes in dynamic vibrotactile patterns. Percept Psychophys 1986;40:290–300.
   PubMedGoogle Scholar
• Segond H, Weiss D, Sampaio E. Human navigationvia a visuo-tactile sensory substitution system. Perception 2005;34:1231–1249.
   PubMed Web of Science ®Google Scholar
• Ackroyd C, Humphrey NK, Warrington EK. Lasting effects of early blindness. A case study. Q J Exp Psychol 1974;26:114–124.
   PubMed Web of Science ®Google Scholar
• Fine I, Wade AR, Brewer AA, May MG, Goodman DF, Boynton GM, Wandell BA, MacLeod DI. Long-term deprivation affects visual perception and cortex. Nat Neurosci 2003;6:915–916.
   PubMed Web of Science ®Google Scholar
• Von Senden M. Space and sight; the perception of space and shape in the congenitally blind before and after operation (Peter Heath, Trans.), Glencoe, IL: Free Press; 1960.
   Google Scholar
• Goldreich D, Kanics IM. Tactile acuity is enhanced in blindness. J Neurosci 2003;23:3439–3445.
   PubMed Web of Science ®Google Scholar
• Collignon O, Renier L, Bruyer R, Tranduy D, Veraart C. Improved selective and divided spatial attention in early blind subjects. Brain Res 2006;1075:175–182.
   PubMed Web of Science ®Google Scholar
• Voss P, Lassonde M, Gougoux F, Fortin M, Guillemot JP, Lepore F. Early- and late-onset blind individuals show supra-normal auditory abilities in far-space. Curr Biol 2004;14:1734–1738.
   PubMed Web of Science ®Google Scholar
• Ostrovsky Y, Andalman A, Sinha P. Vision following extended congenital blindness. Psychol Sci 2006;17:1009–1014.
   PubMed Web of Science ®Google Scholar
• Goodale MA, Milner AD. Separate visual pathways for perception and action. Trends Neurosci 1992;15:20–25.
   PubMed Web of Science ®Google Scholar
• Hay JC, Pick HL Jr. Gaze-contingent prism adaptation: optical and motor factors. J Exp Psychol 1966;72:640–648.
   PubMedGoogle Scholar
• Collignon O, Lassonde M, Lepore F, Bastien D, Veraart C. Functional cerebral reorganization for auditory spatial processing and auditory substitution of vision in early blind subjects. Cereb Cortex 2007;17:457–465.
   PubMedGoogle Scholar
• Poirier C, De Volder AG, Tranduy D, Scheiber C. Neural changes in the ventral and dorsal visual streams during pattern recognition learning. Neurobiol Learn Mem 2006;85:36–43.
   PubMedGoogle Scholar