Review of visual speech perception by hearing and hearing‐impaired people: clinical implications

References

• Alegria J., Charlier B., Mattys S. The role of lip‐reading and cued speech in the processing of phonological information in French educated deaf children. European Journal of Cognitive Psychology 1999; 11((4))451–472
   Google Scholar
• American Speech Language Hearing Association, 2005, (Central) Auditory Processing Disorders. (available at: http://www.asha.org/members/) (accessed 12 March 2007)
   Google Scholar
• Auer E. The influence of the lexicon on speech read word recognition: contrasting segmental and lexical distinctiveness. Psychonomic Bulletin and Review, 2002; 9((2))341–347
   Google Scholar
• Auer E., Bernstein L. Enhanced visual perception in individuals with early onset hearing impairment. Journal of Speech, Language and Hearing Research 2007; 50: 1157–1165
   PubMed Web of Science ®Google Scholar
• Bergeson T., Pisoni D., Davis R. A longitudinal study of audio‐visual speech perception by children with hearing loss who have cochlear implants. Volta Review 2005; 103: 347–370
   Google Scholar
• Bernstein L. Phonetic processing by the speech perceiving brain. The Handbook of Speech Perception, D Pisoni, R Remez. Blackwell, Cambridge, MA 2005; 79–98
   Google Scholar
• Bernstein L., Auer E., Moore J. Modality‐specific perception of auditory and visual speech. The Handbook of Multisensory Processing, G. A Calvert, C Spence, B. E Stein. MIT Press, Cambridge, MA 2004; 203–223
   Google Scholar
• Bernstein L., Demorest M., Tucker P. What makes a good speechreader? First you have to find one. Hearing by Eye: 11. The Psychology of Speechreading and Auditory–Visual Speech, R Campbell, B Dodd, D Burnham. Psychology Press, Hove 1998; 211–228
   Google Scholar
• Bernstein L., Demorest M., Tucker P. Speech perception without hearing. Perception and Psychophysics, 2000; 62((2))233–252
   Google Scholar
• Bornstein M. H., Hahn C. S., Hayes O. M. Specific and general language performance across early childhood: Stability and gender considerations. First Language, 2004; 24((3))267–304
   Google Scholar
• Burnham D., Dodd B. Auditory–visual speech integration by prelinguistic infants: perception of an emergent consonant in the McGurk Effect. Developmental Psychobiology 2004; 45: 204–220
   PubMed Web of Science ®Google Scholar
• Calvert G., Campbell R. Reading speech from still and moving faces: the neural substrates of visible speech. Journal of Cognitive Neuroscience, 2003; 15((1))57–70
   Google Scholar
• Calvert G., Woodruff I., Wright E., Bullmore M., Brammer S., Williams P. fMRI imaging of visual and audio‐visual speech. International Journal of Psychophysiology 1997; 25: 23
   Google Scholar
• Campbell R., Dodd B. Aspects of hearing by eye. Attention and Performance, X, Control of Language Processes, H Bouma, D Bouwhuis. Lawrence Erlbaum Associates, Hillsdale, NJ 1984; 299–314
   Google Scholar
• Campbell R., Zihl J., Massaro D., Munhall K., Cohen M. Lipreading in the akinetopsic patient, L.M. Brain 1997; 120: 1793–1803
   Google Scholar
• Campbell R., Garwood J., Franklin S., Howard D., Landis T., Regard M. Neuropsychological studies of auditory‐visual fusion illusions. Four case studies and their implications. Neuropsychologia 1990; 28: 787–802
   PubMed Web of Science ®Google Scholar
• Coltheart M.. Modeling reading: the dual route approach. The Source of Reading, M Snowling, C Hulme. Blackwell, Oxford 2005; 6–23
   Google Scholar
• Conrad R. The Deaf Schoolchild. Harper & Row, London 1979
   Google Scholar
• Costello M. A study of speech reading as a developing language process in deaf and hard of hearing children. 1957, Unpublished thesis, Northwestern University
   Google Scholar
• Craig W. Effects of preschool training on the development of reading and lipreading skills of deaf children. American Annals of the Deaf 1964; 109: 280–296
   Web of Science ®Google Scholar
• De Filippo C. Memory for articulated sequences and lipreading performance of hearing‐impaired observers. Volta Review 1982; 31: 60–65
   Google Scholar
• Deafness Research UK, 2007, Auditory Processing Disorder. (available at: http://www.deafnessreseach.org.uk/) (accessed 19 September 2007)
   Google Scholar
• Desjardins R., Rogers J., Werker J. An exploration of why preschoolers perform differently than do adults in audio‐visual speech perception tasks. Journal of Experimental Child Psychology 1997; 66: 85–110
   PubMed Web of Science ®Google Scholar
• Diehl R., Kluender K. On the objects of speech perception. Ecological Psychology 1989; 1: 121–144
   Google Scholar
• Dillon H., Ching T.. What makes a good speech test?. Profound Deafness and Speech Communication, G Plant, K. E Spens. Whurr, London 1995
   Google Scholar
• Dodd B. Effects of social and vocal stimulation on infant babbling. Developmental Psychology 1972; 7: 80–83
   Web of Science ®Google Scholar
• Dodd B. The role of vision in the perception of speech. Perception and Psychophysics 1977; 6: 3140
   Google Scholar
• Dodd B. Lip reading in infants: attention to speech presented in‐ and out‐of‐synchrony. Cognitive Psychology 1979; 11: 478–484
   PubMed Web of Science ®Google Scholar
• Dodd B. Interaction of auditory and visual information in speech perception. British Journal of Psychology 1980; 71: 541–549
   Google Scholar
• Dodd B. The visual and auditory modalities in phonological acquisition. Language Acquisition in the Blind Child, A. E Mills. Croom Helm, London 1983; 57–61
   Google Scholar
• Dodd B. Lip‐reading, phonological coding and deafness. Hearing by Eye: The Psychology of Speech‐Reading, B Dodd, R Campbell. Lawrence Erlbaum Associates, Hillsdale, NJ 1987a; 177–190
   Google Scholar
• Dodd B. The acquisition of lip‐reading skills by normally hearing children. Hearing by Eye: The Psychology of Speech‐Reading, B Dodd, R Campbell. Lawrence Erlbaum Associates, Hillsdale, NJ 1987b; 163–176
   Google Scholar
• Dodd B., Burnham D. Processing speech read information. Volta Review 1988; 90: 45–60
   Google Scholar
• Dodd B., Campbell R. Hearing by Eye: The Psychology of Speech‐Reading. Lawrence Erlbaum Associates, Hillsdale, NJ 1987
   Google Scholar
• Dodd B., Hermelin B. Phonological coding by the prelinguistically deaf. Perception and Psychophysics 1977; 21: 413–417
   Web of Science ®Google Scholar
• Dodd B., McIntosh B., Erdener D., Burnham D. Perception of the auditory‐illusion in speech perception by children with phonological disorders. Clinical Linguistics and Phonetics 2008; 22: 69–82
   PubMed Web of Science ®Google Scholar
• Dodd B., Murphy J. Visual thoughts. Mental Lives: Case Studies in Cognition, R Campbell. Blackwell, Oxford 1992; 47–60
   Google Scholar
• Elphick R. Issues in comparing the lipreading abilities of hearing impaired and hearing 15 to 16 year‐old pupils. British Journal of Educational Psychology 1996; 66: 357–365
   PubMed Web of Science ®Google Scholar
• Erber N. Auditory–visual perception of speech. Journal of Speech and Hearing Disorders 1975; 40: 481–492
   PubMedGoogle Scholar
• Evans L. Psychological factors related to lipreading. Teacher of the Deaf 1965; 63: 131–136
   Google Scholar
• Ewing I., Ewing A. Speech and the Deaf Child. Manchester University Press, Manchester 1954
   Google Scholar
• Fourcin A. Language development in the absence of expressive speech. Foundations of Language Development, E Lenneberg, E Lenneberg. Academic Press, New York, NY 1975, Vol. 2
   Google Scholar
• Fowler C., Deckle D. Listening with eye and hand: crossmodal contributions to speech perception. Journal of Experimental Psychology: Human Perception and Performance 1991; 17: 816–828
   PubMed Web of Science ®Google Scholar
• Fowler C., Galantucci B.. The relation of speech perception and production. The Handbook of Speech Perception, D Pisoni, R Remez. Blackwell, Cambridge, MA 2005; 633–652
   Google Scholar
• Green K. The use of auditory information and visual information during phonetic processing: implications for theories of speech perception. Hearing by Eye. 11: Advances in the Psychology of Speechreading and Audio‐visual Speech, R Campbell, B Dodd. Psychology Press, Hove 1998; 3–25
   Google Scholar
• Green K., Holmes D. Growth of lipreading proficiency in young hearing impaired children. Volta Review 1981; October/November: 389–393
   Google Scholar
• Green K., Kuhl P., Meltzoff A., Stevens E. Integrating speech information across talkers, gender, and sensory modalities: female faces and male voices in the McGurk effect. Perception and Psychophysics 1991; 50: 524
   PubMed Web of Science ®Google Scholar
• Hall D., Fussell C., Summerfield A. Q. Reading fluent speech from talking faces: typical brain networks and individual differences. Journal of Cognitive Neuroscience, 2005; 16((6))939–954
   Google Scholar
• Jeffers J., Barley M. Lipreading. Charles C. Thomas, Springfield, IL 1971
   Google Scholar
• Jerger J., Musiek F. Report of the consensus conference on the diagnosis of auditory processing disorders in school aged children. Journal of the American Academy of Audiology 2000; 11: 467–474
   PubMedGoogle Scholar
• Johnson S. A Journey to the Western Islands of Scotland. Scholar, London 1775
   Google Scholar
• Kuhl P., Meltzoff A. The bimodal perception of speech in infancy. Science, 1982; 218((4577))1138–1141
   Google Scholar
• Lachs L., Pisoni D., Kirk K. Use of audio‐visual information in speech perception by prelingually deaf children with cochlear implants: a first report. Ear and Hearing, 2001; 22((3))236–251
   Google Scholar
• Leybaert J. Phonology acquired through the eyes and spelling in deaf children. Journal of Experimental Psychology 2000; 75: 291–318
   Google Scholar
• Liberman A., Cooper F., Shankweiler D., Studdert‐Kennedy M. Perception of the speech code. Psychological Review 1967; 74: 431–461
   PubMed Web of Science ®Google Scholar
• Liberman A., Mattingly I. The motor theory of speech perception revised. Cognition 1985; 21: 1–36
   PubMed Web of Science ®Google Scholar
• Liberman A., Whalen D. On the relation of speech to language. Trends in Cognitive Sciences 2000; 4: 187–196
   PubMed Web of Science ®Google Scholar
• Lidestam B., Lyxell B., Andersson G. Lipreading: cognitive predictors and displayed emotion. Scandinavian Audiology 1999; 28((4))211–217
   Google Scholar
• Locke A., Ginsborg J., Peers I. Development and disadvantage: implications for the early years and beyond. International Journal of Language and Communication Disorders 2002; 37: 3–15
   PubMed Web of Science ®Google Scholar
• Luce P., Pisoni D. Recognizing spoken words: the neighborhood activation model. Ear and Hearing 1998; 19((1))1–36
   Google Scholar
• MacSweeney M., Amaro E., Calvert G., Campbell R. Silent speechreading in the absence of scanner noise: an event‐related fMRI study. NeuroReport 2000; 11: 1729–1733
   PubMed Web of Science ®Google Scholar
• Markides A. Lipreading. Child: Care, Health and Development 1979; 5: 93–101
   Google Scholar
• Massaro D. Children's perception of visual and auditory speech. Child Development 1984; 55((5))1777–1788
   Google Scholar
• Massaro D. Speech Perception by Ear and Eye. Lawrence Erlbaum Associates, Hillsdale, NJ 1987
   Google Scholar
• Massaro D., Cohen M., Gesi A. Long‐term training, transfer, and retention in learning to speech‐read. Perception and Psychophysics 1993; 53((5))549–562
   Google Scholar
• Mattys S., Bernstein L., Auer E. Stimulus‐based lexical distinctiveness as a general word‐recognition mechanism. Perception and Psychophysics 2002; 64: 667–679
   PubMed Web of Science ®Google Scholar
• McGurk H., MacDonald J. Hearing lips and seeing voices. Nature 1976; 264((5588))746–748
   Google Scholar
• Meltzoff A., Moore M. Newborn infants imitate adult facial gestures. Child Development 1983; 54((3))702–709
   Google Scholar
• Meltzoff A., Moore M. Imitation of facial and manual gestures by human neonates. Science 1977; 198((4312))74–78
   Google Scholar
• Mogford K. Lipreading in the prelingually deaf. Hearing by Eye: The Psychology of Speech‐Reading, B Dodd, R Campbell. Lawrence Erlbaum Associates, Hillsdale, NJ 1987; 191–211
   Google Scholar
• Molfese D., Fonaryova Key A., Maguire M., Dove G., Molfese V.. The use of event‐related evoked potentials (ERPs) to study the brain's role in speech perception from infancy into adulthood. Handbook of Speech Perception. Blackwell, Cambridge, MA 2005; 99–112
   Google Scholar
• Neyhus A. I., Mykelbust H. R. Speechreading Failure in Deaf Children. Bureau of Education for the Handicapped, Department of Health, Education and Welfare, Washington, DC 1969
   Google Scholar
• O'Neill J., Davidson J. Relationship between lipreading and five psychological factors. Journal of Speech and Hearing Disorders 1956; 21: 478–481
   Google Scholar
• Ojanen V. Neurocognitive mechanisms of audio‐visual perception. 2005, Doctoral dissertation, Helsinki University of Technology, Helsinki
   Google Scholar
• Paul P. Language and Deafness. Singular Thomson Learning, , Ohio 2001, 3rd edn
   Google Scholar
• Reid G. A preliminary investigation in the testing of lipreading achievement. American Annals of the Deaf 1946; 91: 403–413
   Google Scholar
• Rhoades E. Research outcomes of auditory–verbal intervention: is the approach justified?. Deafness and Education International 2006; 8: 125–143
   Google Scholar
• Risberg A., Agelfors E. Information extraction and information processing in speechreading. Speech transmission Laboratory,. Quarterly Progress Report (Stockholm) 1978; 2–3: 62–82
   Google Scholar
• Rosenblum L.. Primacy of multimodal speech perception. The Handbook of Speech Perception, D Pisoni, R Remez. Blackwell, Cambridge, MA 2005
   Google Scholar
• Rosenblum L., Gordon M. The generality of specificity: some lessons from audio‐visual speech. Behavioural and Brain Sciences 2001; 24: 239–240
   Web of Science ®Google Scholar
• Rosenblum L., Miller R., Sanchez K. Lip‐read me now, hear me better later: cross‐modal transfer of talker familiarity effect. Psychological Science 2007; 18((5))392–396
   Google Scholar
• Rosenblum L., Saldaña H. An audio‐visual test of kinematic primitives for visual speech perception. Journal of Experimental Psychology: Human Perception and Performance 1996; 22: 318–331
   PubMed Web of Science ®Google Scholar
• Sekiyama K., Tohkura Y. Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America 1991; 90: 1797–1805
   PubMed Web of Science ®Google Scholar
• Sharma A., Dorman M., Spahr A. A sensitive period for the development of the central auditory system in children with cochlear implants: implications for age of implantation. Ear and Hearing 2002; 23((6))532–539
   PubMedGoogle Scholar
• Sharp E. The relationship between visual closure to speechreading. Exceptional Child 1972; 38: 729–734
   PubMed Web of Science ®Google Scholar
• Simmons A. Factors related to lipreading. Journal of Speech and Hearing Research 1959; 2: 340–352
   PubMedGoogle Scholar
• Siva N., Stevens E., Kuhl P., Meltzoff A. A comparison between cerebral‐palsied and normal adults in the perception of auditory–visual illusions. Journal of the Acoustical Society of America 1995; 98: 2983
   Google Scholar
• Smith E., Bennetto L. Audio‐visual speech integration and lip‐reading in autism. Journal of Child Psychology and Psychiatry and Allied Disciplines 2007; 48: 813–821
   PubMed Web of Science ®Google Scholar
• Summerfield A. Q. A comprehensive account of audio‐visual speech perception. Hearing by Eye: The Psychology of Lip‐Reading, B Dodd, R Campbell. Erlbaum, London 1987; 3–51
   Google Scholar
• Summerfield A. Q. Visual perception of phonetic gestures. Modularity and the Motor Theory, G Mattingly, M Studdert Kennedy. Lawrence Erlbaum Associates, Hillsdale, NJ 1991; 117–137
   Google Scholar
• Tallal P. The neuropsychology of developmental language disorders. First Symposium on Specific Language Disorders in Children. AFASIC, London 1987; 36–47
   Google Scholar
• Tallal P., Piercy M. Developmental aphasia: the perception of brief vowels and extended stop consonants. Neuropsychologia 1975; 13: 69–74
   PubMed Web of Science ®Google Scholar
• Thomas S., Jordan T. Contributions of oral and extra‐oral facial motion to visual and audio‐visual speech perception. Journal of Experimental Psychology: Human Perception and Performance 2004; 30: 873–888
   Google Scholar
• Tobey E., Geers A., Brenner C., Altuna D., Gabbert G. Factors associated with development of speech production skills in children implanted by age five. Ear and Hearing 2003; 24((1))36–45
   Google Scholar
• Werker J., Tees R. Influences on infant speech processing: toward a new synthesis. Annual Review Psychology 1999; 50: 509–535
   PubMed Web of Science ®Google Scholar
• Wilson S., Saygin A., Sereno M., Iacoboni M. Listening to speech activates motor areas involved in speech production. Nature Neuroscience 2004; 7: 701–702
   PubMed Web of Science ®Google Scholar
• Wise R., Chollet F., Hadar U., Friston K., Hoffner E., Frackowiak R. Distribution of cortical neural networks involved in word comprehension and word retrieval. Brain 1991; 114((4))1803–1817
   Google Scholar
• Woodhouse L. Speech‐reading skills and communication development in a hearing impaired cohort. 2007, Doctoral dissertation, University of Queensland
   Google Scholar
• Wundt W. Volkerpsychologie Bd. I Die Sprache. Engleman, Leipzig 1911
   Google Scholar