331
Views
13
CrossRef citations to date
0
Altmetric
Research Article

Assessing variability in audiovisual speech integration skills using capacity and accuracy measures

&
Pages 710-718 | Received 19 Sep 2013, Accepted 23 Mar 2014, Published online: 07 May 2014

References

  • Altieri N., Pisoni D.B. & Townsend J.T. 2011. Behavioral, clinical, and neurobiological constraints on theories of audiovisual speech integration: A review and suggestions for new directions. Seeing and Perceiving, 24, 513–539.
  • Altieri N., Pisoni D.B. & Townsend J.T. 2011. Some normative data on lip-reading skills. J Acoust Soc Am, 130, 1–4.
  • Altieri N. & Townsend J.T. 2011. An assessment of behavioral dynamic information processing measures in audiovisual speech perception. Frontiers in Psychology, 2, 1–15.
  • Altieri N., Townsend J.T. & Wenger M.J. 2013. A dynamic assessment function for measuring age-related sensory decline in audiovisual speech recognition. Behav Res Methods.
  • Altieri N. & Wenger M. 2013. Neural dynamics of audiovisual integration efficiency under variable listening conditions. Frontiers in Psychology, 4, 1–15.
  • Baranyaiova-Frtusova J., Winneke A. & Phillips N. 2010. The effect of audio-visual speech information on working memory in younger and older adults. Cognitive Aging Conference (CAC), Atlanta, USA.
  • Bent T., Buchwald & Pisoni D.B. 2009. Perceptual adaptation and intelligibility of multiple talkers for two types of degraded speech. J Acoust Soc Am, 126, 2660–2669.
  • Bergeson T.R. & Pisoni D.B. 2004. Audiovisual speech perception in deaf adults and children following cochlear implantation. In: G. Calvert, C. Spence, B.E. Stein (eds.), The Handbook of Multisensory Processes. Cambridge, USA: MIT Press, pp. 749–771.
  • Bergeson T.R., Pisoni D.B., Reese L. & Kirk K.I. 2003. Audiovisual speech perception in adult cochlear implant users: Effects of sudden vs. progressive hearing loss. Mid-Winter Meeting of the Association for Research in Otolaryngology; Daytona Beach, Florida.
  • Bernstein L.E., Demorest M.E. & Tucker P.E. 2000. Speech perception without hearing. Perception and Psychophysics, 62, 233–252.
  • Boothroyd A., Hanin L. & Hnath T. 1985. A Sentence Test of Speech Perception: Reliability, Set Equivalence, and Short-term Learning (internal report RCI 10). New York: City University of New York.
  • Braida L.D. 1991. Crossmodal integration in the identification of consonant segments. Quarterly Journal of Experimental Psychology, 43, 647–77.
  • Buchan J.N. & Munhall K.G. 2012. The effect of a concurrent cognitive load task and temporal offsets on the integration of auditory and visual speech information, Seeing and Perceiving, 25, 87–106.
  • Clouser R.A. 1977. Relative phoneme visibility and lipreading performance. Volta Review, Jan.27–34.
  • Erber N.P. 1969. Interaction of audition and vision in the recognition of oral speech stimuli. J Sp Hear Res, 12, 423–425.
  • Erber N.P. 1975. Auditory-visual perception of speech. Journal of Speech and Hearing Disorders, 40, 481–492.
  • Erber N.P. 2002. Hearing, Vision, Communication, and Older People. Clifton Hill, Australia: Clavis Publishing.
  • Erber N.P. 2003. Use of hearing aids by older people: Influence of non-auditory factors (vision, manual dexterity). Int J Audiol, 42, 2S21–2S26.
  • Feld J. & Sommers M.S. 2009. Lipreading, processing speed, and working memory in younger and older adults. J Sp Lang Hear Res, 52, 1555–1565.
  • Grant K.W. 2002. Measures of auditory-visual integration for speech understanding: A theoretical perspective (L). J Acoust Soc Am, 112, 30–33.
  • Grant K.W. & Seitz P.F. 1998. Measures of auditory-visual integration in nonsense syllables and sentences. J Acoust Soc Am, 104, 2438–2450.
  • Grant K.W. & Walden B.E. 1996. Evaluating the articulation index for audio-visual consonant recognition. J Acoust Soc Am, 100, 2415–2424.
  • Grant K.W., Walden B.E. & Seitz P.F. 1998. Auditory-visual speech recognition by hearing impaired subjects: Consonant recognition, sentence recognition, and auditory-visual integration. J Acoust Soc Am, 103, 2677–2690.
  • Massaro D.W. 2004. From multisensory integration to talking heads and language learning. In: G. A. Calvert, C. Spence, B.E. Stein (eds.), The Handbook of Multisensory Processes, Cambridge, USA: The MIT Press, pp. 153–176.
  • McGurk H. & Macdonald J.W. 1976. Hearing lips and seeing voices. Nature, 264, 746–748.
  • Miller J. 1982. Divided attention: Evidence for coactivation with redundant signals. Cognit Psychol, 14, 247–279.
  • Owens E. & Blazek B. 1985. Visemes observed by hearing impaired and normal hearing adults viewers. J Sp Hear Res, 28, 381–393.
  • Ratcliff R., Thapar A. & McKoon G. 2004. A diffusion model analysis of the effects of aging on recognition memory. Journal of Memory and Language, 50, 408–424.
  • Sherffert S., Lachs L. & Hernandez L.R. 1997. The Hoosier audiovisual multi-talker database. In: Research on Spoken Language Processing Progress Report No. 21, Bloomington, USA: Speech Research Laboratory, Psychology, Indiana University.
  • Sommers M., Tye-Murray N. & Spehar B. 2005. Auditory-visual speech perception and auditory-visual enhancement in normal-hearing younger and older adults. Ear Hear, 26, 263–275.
  • Sumby W.H. & Pollack I. 1954. Visual contribution to speech intelligibility in noise. J Acoust Soc Am, 26, 12–15.
  • Summerfield Q. 1987. Some preliminaries to a comprehensive account of audio-visual speech perception. In: B. Dodd, R. Campbell (eds.), The Psychology of Lip-Reading. Hillsdale, USA: LEA, pp. 3–50.
  • Townsend J.T. & Altieri N. 2012. An accuracy-response time capacity assessment function that measures performance against standard parallel predictions. Psychol Rev, 119, 500–516.
  • Townsend J.T. & Nozawa G. 1995. Spatio-temporal properties of elementary perception: An investigation of parallel, serial, and coactive theories. Journal of Mathematical Psychology, 39, 321–360.
  • Townsend J.T. & Wenger M.J. 2004. A theory of interactive parallel processing: New capacity measures and predictions for a response time inequality series. Psychol Rev, 111, 1003–1035.
  • Tye-Murray N., Sommers M. & Spehar B. 2007. Audiovisual integration and lip-reading abilities of older adults with normal and impaired hearing. Ear Hear, 28, 656–668.
  • Watson C.S., Qiu W., Chamberlain M.M. & Li X. 1996. Auditory and visual speech perception: Sources of individual differences in speech recognition. J Acoust Soc Am, 100, 1153–1162.
  • Wenger M.J., Negash S., Petersen R.C. & Petersen L. 2010. Modeling and estimating recall processing capacity: Sensitivity and diagnostic utility in application to mild cognitive impairment. Journal of Mathematical Psychology, 54, 73–89.
  • Winneke A.H. & Phillips N.A. 2011. Does audiovisual speech offer a fountain of youth for old ears? An event-related brain potential study of age differences in audiovisual speech perception. Psychology and Aging, 26, 427–438.
  • Zekveld A.A., George E.L.J., Houtgast T. & Kramer S.E. 2013. Cognitive abilities relate to-self-reported hearing disability. J Sp Lang Hear Res, 56, 1364–1372.
  • Zekveld A.A., Kramer S.E., Kessens J.M., Vlaming M.S. & Houtgast T. 2009. The influence of age, hearing, and working memory on the speech comprehension benefit derived from an automatic speech recognition system. Ear Hear, 30, 262–272.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.