The relevance of visual prosody for studies in language and speech-language pathology

References

• Adrien J. L., Lenoir P., Martineau J., Perrot A., Hameury L., Larmande C., Sauvage D. Blind ratings of early symptoms of autism based upon family home movies. Journal of the American Academy of Child and Adolescent Psychiatry 1993; 32: 617–626
   PubMed Web of Science ®Google Scholar
• Barkhuysen P., Krahmer E., Swerts M. Problem detection in human-machine interactions based on facial expressions of users. Speech Communication 2005; 45: 343–359
   Google Scholar
• Barkhuysen P., Krahmer E., Swerts M. The interplay between the auditory and visual modality for end-of-utterance detection. Journal of the Acoustical Society of America 2008; 123: 354–365
   PubMedGoogle Scholar
• Baron-Cohen S. Mindblindness: An essay on autism and theory of mind. MIT Press, Boston, MA 1995
   Google Scholar
• Baron-Cohen S., Staunton R. Do children with autism acquire the phonology of their peers? An examination of group identification through the window of bilingualism. First Language 1994; 14: 241–248
   Google Scholar
• Baron-Cohen S., Wheelwright S., Hill J., Raste Y., Plumb I. The “reading the mind in the eyes” test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. Journal of Child Psychology and Psychiatry and Allied Disciplines 2001; 42: 241–251
   PubMed Web of Science ®Google Scholar
• Cavé C., Guaïtella I., Bertrand R., Santi S., Harlay F., Espesser R. About the relationship between eyebrow movements and F0 variations. Proceedings of the International Conference on Spoken Language Processing (ICSLP), Philadelphia, PA, 1996; 2175–2179
   Google Scholar
• Chartrand T. L., Bargh J. A. The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology 1999; 76: 893–910
   PubMed Web of Science ®Google Scholar
• Crystal D. Persevering with prosody. International Journal of Speech-Language Pathology 2009; 11: 257
   Google Scholar
• Dapretto M., Davies M. S., Pfeifer J. H., Scott A. A., Sigman M., Brookheimer S. Y., Iacoboni M. Understanding emotions in others: mirror neuron dysfunction in chidren with autism spectrum disorders. Nature Neuroscience 2005; 6: 28–30
   Google Scholar
• de Gelder B., Vroomen J., van der Heide L. Face recognition and lip-reading in autism. European Journal of Cognitive Psychology 1991; 3: 69–86
   Google Scholar
• DeCasper A. J., Fifer W. P. On human bonding: Newborns prefer their mother's voices. Science 1980; 208: 1174–1176
   PubMed Web of Science ®Google Scholar
• Dijkstra C., Krahmer E., Swerts M. Manipulating uncertainty: The contribution of different audiovisual prosodic cues to the perception of confidence. Proceedings of the Speech Prosody 2006 Conference, Dresden, May, 2006
   Google Scholar
• Dohen M., Lœvenbruck H. Interaction of audition and vision for the perception of prosodic contrastive focus. Language and Speech 2009; 52: 177–206
   PubMed Web of Science ®Google Scholar
• Dohen M., Lœvenbruck H., Cathiard M.-A., Schwartz J.-L. Visual perception of contrastive focus in reiterant French speech. Speech Communication 2004; 44: 155–172
   Google Scholar
• Egenfeldt-Nielsen S. Beyond edutainment. Exploring the educational potential of computer games. 2005, PhD thesis, University of Copenhagen
   Google Scholar
• Ekman P. Emotions revealed. Understanding faces and feelings. Weidenfeld & Nicolson, London 2003
   Google Scholar
• Goswami U. Cognitive development. The learning brain. Psychology press, Hove 2008
   Google Scholar
• Hadar U., Steiner T. J., Grant E. C., Rose F. C. Head movement correlates of juncture and stress at sentence level. Language and Speech 1983; 26: 117–129
   PubMed Web of Science ®Google Scholar
• Kaiser S., Wehrle T. Situated emotional problem solving in interactive computer games. Proceedings of the IXth Conference of the International Society for Research on Emotions, Toronto. N. H. Frijda. 1996; 276–280
   Google Scholar
• E. Krahmer, Swerts, M., 2009. Special double issue on Audiovisual Prosody. Language and Speech. 52: 129–386
   Google Scholar
• Krahmer E., Swerts M. More about brows: a cross-linguistic study via analysis-by-synthesis. From brows to trust: Evaluating embodied conversational agents, Z. Ruttkay, et al. Kluwer, Dordrecht 2004; 191–216
   Google Scholar
• Krahmer E., Swerts M. How children and adults produce and perceive uncertainty in audiovisual speech. Language and Speech 2005; 48: 29–53
   PubMed Web of Science ®Google Scholar
• Krahmer E., Swerts M. The effect of visual beats on prosodic prominence: acoustic analyses, auditory perception, and visual perception. Journal of Memory and Language 2007; 57: 396–414
   Web of Science ®Google Scholar
• Magnée M. J. C. M., de Gelder B., van Engeland H., Kemner C. Atypical processing of fearful face-voice pairs in pervasive developmental disorder: An ERP study. Clinical Neurophysiology 2008a; 119: 2004–2010
   PubMedGoogle Scholar
• Magnée M. J. C. M., de Gelder B., van Engeland H., Kemner C. Audiovisual speech integration in pervasive developmental disorder: Evidence from event-related potentials. The Journal of Child Psychology and Psychiatry 2008b; 49: 995–1000
   PubMedGoogle Scholar
• Massaro D W., Bosseler A. Perceiving speech by ear and eye: Multimodal integration by children with autism. Journal on Developmental and Learning Disorders 2003; 7: 111–144
   Google Scholar
• McCann J., Peppé S. Prosody in autism spectrum disorders: A critical review. International Journal of Language and Communication Disorders 2003; 38: 325–350
   PubMed Web of Science ®Google Scholar
• McGee G., Morrier M. Clinical implications of research in nonverbal behaviour of children with autism. Nonverbal behaviour in clinical settings, P. Philippot, R. S. Feldman, E. J. Coats. Oxford University Press, Oxford 2003
   Google Scholar
• McIntosh D. N., Reichmann-Decker A., Winkielman P., Wilbarger J. When the social mirror breaks: Deficits in automatic, but not voluntary, mimicry of emotional facial expressions in autism. Developmental Science 2006; 9: 295–302
   PubMed Web of Science ®Google Scholar
• Mehler J., Lambertz G., Jusczyk P. W., Amiel-Tison C. Discrimination de la langue maternelle par le nouveau-né. Comptes rendus de l'Académie des Sciences de Paris 303, série 1986; III: 637–640
   Google Scholar
• Nakano Y. I., Reinstein G., Stocky T., Cassell J. Towards a model of face-to-face grounding. Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), SapporoJapan, 2003
   Google Scholar
• Peppé S. J. E. Why is prosody in speech-language pathology so difficult?. International Journal of Speech-Language Pathology 2009; 11: 258–271
   Google Scholar
• Peppé S., McCann J. Assessing intonation and prosody in children with atypical language development: The PEPS-C test and the revised version. Clinical Linguistics and Phonetics 2003; 17: 345–354
   PubMed Web of Science ®Google Scholar
• Pickering M. J., Garrod S. Towards a mechanistic psychology of dialogue. Behavioral and Brain Sciences 2004; 27: 169–225
   PubMed Web of Science ®Google Scholar
• Rapin I., Dunn M. Language disorders in children with autism. Seminars in Pediatric Neurology 1997; 4: 86–92
   PubMedGoogle Scholar
• Rutherford M. D., Baron-Cohen S., Wheelwright S. Reading the mind in the voice: Sensitivity in childhood psychopathology. Journal of Autism and Developmental Disorders 2002; 32: 189–194
   PubMed Web of Science ®Google Scholar
• Salen K., Zimmerman E. Rules of play. Game design fundamentals. MIT Press, Cambridge, MA 2003
   Google Scholar
• Scarborough R., Keating P., Mattys S. L., Cho T., Alwan A., Auer E. T. Optical phonetics and visual perception of lexical and phrasal stress in English. Language and Speech 2009; 52: 135–175
   Google Scholar
• Sehaba K., Estraillier P., Lambert D. Interactive educational games for autistic children with agent-based system. Lecture Notes in Computer Science (LNCS) 2005; 3711: 422–432
   Google Scholar
• Shahid S., Krahmer E., Swerts M. Audiovisual emotional speech of game playing children: Effects of age and culture. Proceedings of Interspeech 2007, Antwerp, August, 2007
   Google Scholar
• Shriberg L. D., Paul R., McSweeny J. L., Klin A., Cohen D. J., Volkmar F. R. Speech and prosody characteristics of adolescents and adults with high-functioning autism and Asperger's Syndrome. Journal of Speech, Language, and Hearing Research 2001; 44: 1097–1115
   PubMed Web of Science ®Google Scholar
• Srinivasan R, Massaro D. Perceiving prosody from the face and voice: Distinguishing statements from echoic questions in English. Language and Speech 2003; 46: 1–22
   PubMed Web of Science ®Google Scholar
• Swerts M., Krahmer E. Audiovisual prosody and feeling of knowing. Journal of Memory and Language 2005; 53: 81–94
   Web of Science ®Google Scholar
• Swerts M., Krahmer E. Facial expression and prosodic prominence: Effects of modality and facial area. Journal of Phonetics 2008; 36: 219–238
   Web of Science ®Google Scholar
• Teunisse J.-P., de Gelder B. Face processing in adolescents with autistic disorder: The inversion and composite effects. Brain and Cognition 2003; 52: 285–294
   PubMed Web of Science ®Google Scholar
• Walters A. S., Barrett R. P., Feinstein C. Social relatedness and autism: Current research, issues, directions. Research in Developmental Disabilities 1990; 11: 303–326
   PubMedGoogle Scholar
• Williams J. H. G., Massaro D. W., Peel N. J., Bosseler A., Suddendorf T. Visual-auditory integration during speech imitation in autism. Research in Developmental Disabilities 2004; 25: 595–575
   Google Scholar