Prosody in speech as a source of referential information

References

• Akmajian, A., & Jackendoff, R. (1970). Coreferentiality and stress. Linguistic Inquiry, 1(1), 124–126.
   Web of Science ®Google Scholar
• Asano, M., Imai, M., Kita, S., Kitajo, K., Okada, H., & Thierry, G. (2015). Sound symbolism scaffolds language development in preverbal infants. Cortex, 63, 196–205. doi: 10.1016/j.cortex.2014.08.025
   PubMed Web of Science ®Google Scholar
• Banse, R., & Scherer, K. R. (1996). Acoustic profiles in vocal emotion expression. Journal of Personality and Social Psychology, 70(3), 614–636. doi: 10.1037/0022-3514.70.3.614
   PubMed Web of Science ®Google Scholar
• Barsalou, L. W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences, 22(4), 577–660. doi: 10.1017/S0140525X99532147
   PubMed Web of Science ®Google Scholar
• Barsalou, L. W. (2003). Situated simulation in the human conceptual system. Language and Cognitive Processes, 18(5–6), 513–562. doi: 10.1080/01690960344000026
   Web of Science ®Google Scholar
• Beattie, G., & Shovelton, H. (1999). Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation. Semiotica, 123, 1–30. doi: 10.1515/semi.1999.123.1-2.1
   Web of Science ®Google Scholar
• Boersma, P. (1993). Accurate short-term analysis of the fundamental frequency and the harmonics-to-noise ratio of a sampled sound. Proceedings of the Institute of Phonetic Sciences, 17(1193), 97–110.
   Google Scholar
• Boersma, P., & Weenink, D. (2012). Praat: Doing phonetics by computer (Version 5.3.43) [Computer program]. Retrieved March 27, 2013, from http://www.praat.org/
   Google Scholar
• Bolinger, D., & Bolinger, D. L. M. (1986). Intonation and its parts: Melody in spoken English. Stanford: Stanford University Press.
   Google Scholar
• Bolinger, D. L. (1961). Contrastive accent and contrastive stress. Language, 37, 83–96. doi: 10.2307/411252
   Web of Science ®Google Scholar
• Broaders, S. C., & Goldin-Meadow, S. (2010). Truth is at hand: How gesture adds information during investigative interviews. Psychological Science, 21(5), 623–628. doi: 10.1177/0956797610366082
   PubMed Web of Science ®Google Scholar
• Cutler, A., Dahan, D., & van Donselaar, W. (1997). Prosody in the comprehension of spoken language: A literature review. Language and Speech, 40(2), 141–201. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9509577 doi: 10.1177/002383099704000203
   PubMed Web of Science ®Google Scholar
• Cutler, A., & Norris, D. (1988). The role of strong syllables in segmentation for lexical access. Journal of Experimental Psychology: Human Perception and Performance, 14(1), 113–121. doi: 10.1037/0096-1523.14.1.113
   Web of Science ®Google Scholar
• Dolscheid, S., Shayan, S., Majid, A., & Casasanto, D. (2013). The thickness of musical pitch: Psychophysical evidence for linguistic relativity. Psychological Science, 24(5), 613–621. doi: 10.1177/0956797612457374
   PubMed Web of Science ®Google Scholar
• Eitan, Z., & Timmers, R. (2010). Beethoven’s last piano sonata and those who follow crocodiles: Cross-domain mappings of auditory pitch in a musical context. Cognition, 114(3), 405–422. doi: 10.1016/j.cognition.2009.10.013
   PubMed Web of Science ®Google Scholar
• Evans, K. K., & Treisman, A. (2010). Natural cross-modal mappings between visual and auditory features. Journal of Vision, 10(1), 1–12. doi: 10.1167/10.1.6
   PubMed Web of Science ®Google Scholar
• Glenberg, A. M., & Kaschak, M. P. (2002). Grounding language in action. Psychonomic Bulletin and Review, 9(3), 558–565. doi: 10.3758/BF03196313
   PubMed Web of Science ®Google Scholar
• Goldin-Meadow, S., & Singer, M. A. (2003). From children’s hands to adults’ ears: Gesture’s role in the learning process. Developmental Psychology, 39(3), 509–520. doi: 10.1037/0012-1649.39.3.509
   PubMed Web of Science ®Google Scholar
• Haryu, E., & Kajikawa, S. (2012). Are higher-frequency sounds brighter in color and smaller in size? Auditory–visual correspondences in 10-month-old infants. Infant Behavior and Development, 35(4), 727–732. doi: 10.1016/j.infbeh.2012.07.015
   PubMed Web of Science ®Google Scholar
• Herold, D. S., Nygaard, L. C., Chicos, K. A., & Namy, L. L. (2011). The developing role of prosody in novel word interpretation. Journal of Experimental Child Psychology, 108(2), 229–241. doi: 10.1016/j.jecp.2010.09.005
   PubMed Web of Science ®Google Scholar
• Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews Neuroscience, 8(5), 393–402. doi: 10.1038/nrn2113
   PubMed Web of Science ®Google Scholar
• Holler, J., & Beattie, G. (2003). Pragmatic aspects of representational gestures: Do speakers use them to clarify verbal ambiguity for the listener? Gesture, 3(2), 127–154. doi:0.1075/gest.3.2.02hol doi: 10.1075/gest.3.2.02hol
   Google Scholar
• Holler, J., & Stevens, R. (2007). The effect of common ground on how speakers use gesture and speech to represent size information. Journal of Language and Social Psychology, 26(1), 4–27. doi: 10.1177/0261927X06296428
   Web of Science ®Google Scholar
• Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137(2), 297–315. doi: 10.1037/a0022128
   PubMed Web of Science ®Google Scholar
• Hubbard, T. L. (1996). Synesthesia-like mappings of lightness, pitch, and melodic interval. The American Journal of Psychology, 109, 219–238. doi: 10.2307/1423274
   PubMed Web of Science ®Google Scholar
• Imai, M., Miyazaki, M., Yeung, H. H., Hidaka, S., Kantartzis, K., Okada, H., & Kita, S. (2015). Sound symbolism facilitates word learning in 14-month-olds. Plos One, 10(2), e0116494. doi: 10.1371/journal.pone.0116494
   PubMed Web of Science ®Google Scholar
• Kelly, S. D., & Church, R. B. (1998). A comparison between children’s and adults’ ability to detect conceptual information conveyed through representational gestures. Child Development, 69(1), 85–93. doi:10.2307/1132072 doi: 10.1111/j.1467-8624.1998.tb06135.x
   PubMed Web of Science ®Google Scholar
• Kelly, S., Healey, M., Özyürek, A., & Holler, J. (2015). The processing of speech, gesture, and action during language comprehension. Psychonomic Bulletin and Review, 22(2), 517–523. doi: 10.3758/s13423-014-0681-7
   PubMed Web of Science ®Google Scholar
• Kelly, L. J., & Heit, E. (2017). Recognition memory for hue: Prototypical bias and the role of labeling. Journal of Experimental Psychology: Learning, Memory, and Cognition, 43(6), 955–971. doi: 10.1037/xlm0000357
   PubMed Web of Science ®Google Scholar
• Kovic, V., Plunkett, K., & Westermann, G. (2010). The shape of words in the brain. Cognition, 114(1), 19–28. doi: 10.1016/j.cognition.2009.08.016
   PubMed Web of Science ®Google Scholar
• Kunihira, S. (1971). Effects of the expressive voice on phonetic symbolism. Journal of Verbal Learning and Verbal Behavior, 10(4), 427–429. doi: 10.1016/S0022-5371(71)80042-7
   Google Scholar
• Laukka, P., Juslin, P., & Bresin, R. (2005). A dimensional approach to vocal expression of emotion. Cognition and Emotion, 19(5), 633–653. doi: 10.1080/02699930441000445
   Web of Science ®Google Scholar
• Lebois, L. A. M., Wilson-Mendenhall, C. D., & Barsalou, L. W. (2015). Are automatic conceptual cores the gold standard of semantic processing? The context-dependence of spatial meaning in grounded congruency effects. Cognitive Science, 39(8), 1764–1801. doi: 10.1111/cogs.12174
   PubMed Web of Science ®Google Scholar
• Levinson, S. C., & Holler, J. (2014). The origin of human multi-modal communication. Philosophical Transactions of the Royal Society B: Biological Sciences, 369(1651), 20130302. doi: 10.1098/rstb.2013.0302
   PubMed Web of Science ®Google Scholar
• Lourenco, S. F., & Longo, M. R. (2011). Origins and development of generalized magnitude representation. In S. Dehaene & E. Brannon (Eds.), Space, time and number in the brain: Searching for the foundations of mathematical thought (pp. 225–244). London: Academic.
   Google Scholar
• Lupyan, G. (2008). From chair to “chair”: A representational shift account of object labeling effects on memory. Journal of Experimental Psychology: General, 137, 348–369. doi: 10.1037/0096-3445.137.2.348
   PubMed Web of Science ®Google Scholar
• Marks, L. E., Hammeal, R. J., Bornstein, M. H., & Smith, L. B. (1987). Perceiving similarity and comprehending metaphor. Monographs of the Society for Research in Child Development, 52(1), 1–100. doi: 10.2307/1166084
   PubMed Web of Science ®Google Scholar
• Marks, L. E. (1974). On associations of light and sound: The mediation of brightness, pitch and loudness. The American Journal of Psychology, 87, 173–188. doi: 10.2307/1422011
   PubMed Web of Science ®Google Scholar
• Marks, L. E. (1987). On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology: Human Perception and Performance, 13(3), 384–394. doi: 10.1037/0096-1523.13.3.384
   PubMed Web of Science ®Google Scholar
• Martino, G., & Marks, L. E. (1999). Perceptual and linguistic interactions in speeded classification: Tests of the semantic coding hypothesis. Perception, 28(7), 903–923. doi: 10.1068/p2866
   PubMed Web of Science ®Google Scholar
• Martino, G., & Marks, L. E. (2001). Synesthesia: Strong and weak. Current Directions in Psychological Science, 10(2), 61–65. doi: 10.1111/1467-8721.00116
   Web of Science ®Google Scholar
• Mathôt, S., Grainger, J., & Strijkers, K. (2017). Pupillary responses to words that convey a sense of brightness or darkness. Psychological Science, 28(6), 1–9. doi: 10.1177/0956797617702699
   Web of Science ®Google Scholar
• Matlock, T. (2004). Fictive motion as cognitive simulation. Memory and Cognition, 32(8), 1389–1400. doi: 10.3758/BF03206329
   PubMed Web of Science ®Google Scholar
• McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
   Google Scholar
• McNeill, D., Cassell, J., & McCullough, K. E. (1994). Communicative effects of speech-mismatched gestures. Research on Language and Social Interaction, 27(3), 223–237. doi: 10.1207/s15327973rlsi2703_4
   Google Scholar
• Melara, R. D. (1989). Dimensional interaction between color and pitch. Journal of Experimental Psychology: Human Perception and Performance, 15(1), 69–79. doi: 10.1037//0096-1523.15.1.69
   PubMed Web of Science ®Google Scholar
• Mondloch, C. J., & Maurer, D. (2004). Do small white balls squeak? Pitch–object correspondences in young children. Cognitive, Affective, and Behavioral Neuroscience, 4(2), 133–136. doi: 10.3758/CABN.4.2.133
   PubMed Web of Science ®Google Scholar
• Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E. (2004). Visual prosody and speech intelligibility head movement improves auditory speech perception. Psychological Science, 15(2), 133–137. doi: 10.1111/j.0963-7214.2004.01502010.x
   PubMed Web of Science ®Google Scholar
• Namy, L. L., Gentner, D., & Clepper, L. E. (2007). How close is too close? Alignment and perceptual similarity in children’s categorization. Cognition, Brain, & Behavior, 11(4), 647–659.
   Google Scholar
• Nygaard, L. C., Herold, D. S., & Namy, L. L. (2009). The semantics of prosody: Acoustic and perceptual evidence of prosodic correlates to word meaning. Cognitive Science, 33(1), 127–146. doi: 10.1111/j.1551-6709.2008.01007.x
   PubMed Web of Science ®Google Scholar
• Nygaard, L. C., & Lunders, E. R. (2002). Resolution of lexical ambiguity by emotional tone of voice. Memory and Cognition, 30(4), 583–593. doi: 10.3758/BF03194959
   PubMed Web of Science ®Google Scholar
• Nygaard, L. C., & Queen, J. S. (2008). Communicating emotion: Linking affective prosody and word meaning. Journal of Experimental Psychology: Human Perception and Performance, 34(4), 1017–1030. doi: 10.1037/0096-1523.34.4.1017
   PubMed Web of Science ®Google Scholar
• Parise, C., & Spence, C. (2008). Synesthetic congruency modulates the temporal ventriloquism effect. Neuroscience Letters, 442(3), 257–261. doi: 10.1016/j.neulet.2008.07.010
   PubMed Web of Science ®Google Scholar
• Perlman, M., Clark, N., & Falck, M. J. (2015). Iconic prosody in story reading. Cognitive Science, 1–21. doi: 10.1111/cogs.12190
   PubMed Web of Science ®Google Scholar
• Perlman, M. (2010). Talking fast: The use of speech rate as iconic gesture. In F. Parrill, V. Tobin, & M. Turner (Eds.), Meaning, form, and body (pp. 245–262). Stanford: CSLI.
   Google Scholar
• Ramachandran, V. S., & Hubbard, E. M. (2001). Synaesthesia- A window into perception, thought and language. Journal of Consciousness Studies, 8(12), 3–34.
   Web of Science ®Google Scholar
• Reinisch, E., Jesse, A., & Nygaard, L. C. (2013). Tone of voice guides word learning in informative referential contexts. The Quarterly Journal of Experimental Psychology, 66, 1227–1240. doi: 10.1080/17470218.2012.736525
   PubMed Web of Science ®Google Scholar
• Revill, K. P., Namy, L. L., DeFife, L. C., & Nygaard, L. C. (2014). Cross-linguistic sound symbolism and crossmodal correspondence: Evidence from fMRI and DTI. Brain and Language, 128(1), 18–24. doi: 10.1016/j.bandl.2013.11.002
   PubMed Web of Science ®Google Scholar
• Schirmer, A., Kotz, S. A., & Friederici, A. D. (2002). Sex differentiates the role of emotional prosody during word processing. Cognitive Brain Research, 14(2), 228–233. doi: 10.1016/S0926-6410(02)00108-8
   PubMedGoogle Scholar
• Schneider, W., Eschman, A., & Zuccolotto, A. (2002). E-prime user’s guide. Pittsburgh: Psychology Software Tools.
   Google Scholar
• Šetić, M., & Domijan, D. (2007). The influence of vertical spatial orientation on property verification. Language and Cognitive Processes, 22(2), 297–312. doi: 10.1080/01690960600732430
   Web of Science ®Google Scholar
• Shintel, H., & Nusbaum, H. C. (2007). The sound of motion in spoken language: Visual information conveyed by acoustic properties of speech. Cognition, 105(3), 681–690. doi: 10.1016/j.cognition.2006.11.005
   PubMed Web of Science ®Google Scholar
• Shintel, H., & Nusbaum, H. C. (2008). Moving to the speed of sound: Context modulation of the effect of acoustic properties of speech. Cognitive Science, 32(6), 1063–1074. doi: 10.1080/03640210801897831
   PubMed Web of Science ®Google Scholar
• Shintel, H., Nusbaum, H. C., & Okrent, A. (2006). Analog acoustic expression in speech communication. Journal of Memory and Language, 55(2), 167–177. doi: 10.1016/j.jml.2006.03.002
   Web of Science ®Google Scholar
• Smith, L. B., & Sera, M. D. (1992). A developmental analysis of the polar structure of dimensions. Cognitive Psychology, 24(1), 99–142. doi: 10.1016/0010-0285(92)90004-L
   PubMed Web of Science ®Google Scholar
• Spence, C. (2011). Crossmodal correspondences: A tutorial review. Attention, Perception, & Psychophysics, 73(4), 971–995. doi: 10.3758/s13414-010-0073-7
   PubMed Web of Science ®Google Scholar
• Walker, P., Bremner, J. G., Mason, U., Spring, J., Mattock, K., Slater, A., & Johnson, S. P. (2010). Preverbal infants’ sensitivity to synaesthetic cross-modality correspondences. Psychological Science, 21(1), 21–25. doi: 10.1177/0956797609354734
   PubMed Web of Science ®Google Scholar
• Waxman, S., & Booth, A. (2003). The origins and evolution of links between word learning and conceptual organization: New evidence from 11-month-olds. Developmental Science, 6(2), 128–135. doi: 10.1111/1467-7687.00262
   Web of Science ®Google Scholar
• Wurm, L. H., Vakoch, D. A., Strasser, M. R., Calin-Jageman, R., & Ross, S. E. (2001). Speech perception and vocal expression of emotion. Cognition and Emotion, 15(6), 831–852. doi: 10.1080/02699930143000086
   Web of Science ®Google Scholar
• Zollinger, S. A., Podos, J., Nemeth, E., Goller, F., & Brumm, H. (2012). On the relationship between, and measurement of, amplitude and frequency in birdsong. Animal Behaviour, 84(4), e1–e9. doi: 10.1016/j.anbehav.2012.04.026
   Web of Science ®Google Scholar
• Zwaan, R. A., Madden, C. J., Yaxley, R. H., & Aveyard, M. E. (2004). Moving words: Dynamic representations in language comprehension. Cognitive Science, 28(4), 611–619. doi: 10.1016/j.cogsci.2004.03.004
   Web of Science ®Google Scholar
• Zwaan, R. A., Stanfield, R. A., & Yaxley, R. H. (2002). Language comprehenders mentally represent the shapes of objects. Psychological Science, 13(2), 168–171. doi: 10.1111/1467-9280.00430
   PubMed Web of Science ®Google Scholar