The emotion of sound target modulates the auditory gaze cueing effect

References

• Adams, R. B., Jr. & Kleck, R. E. (2003). Perceived gaze direction and the processing of facial displays of emotion. Psychological Science, 14(6), 644–647. https://doi.org/10.1046/j.0956-7976.2003.psci_1479.x
   PubMed Web of Science ®Google Scholar
• Adams, R. B., & Kleck, R. E. (2005). Effects of direct and averted gaze on the perception of facially communicated emotion. Emotion, 5(1), 3–11. https://doi.org/10.1037/1528-3542.5.1.3
   PubMed Web of Science ®Google Scholar
• Bayless, S. J., Glover, M., Taylor, M. J., & Itier, R. J. (2011). Is it in the eyes? Dissociating the role of emotion and perceptual features of emotionally expressive faces in modulating orienting to eye gaze. Visual Cognition, 19(4), 483–510. https://doi.org/10.1080/13506285.2011.552895
   PubMed Web of Science ®Google Scholar
• Bayliss, A. P., Schuch, S., & Tipper, S. P. (2010). Gaze cueing elicited by emotional faces is influenced by affective context. Visual Cognition, 18(8), 1214–1232. https://doi.org/10.1080/13506285.2010.484657
   PubMed Web of Science ®Google Scholar
• Belin, P., Fillion-Bilodeau, S., & Gosselin, F. (2008). The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods, 40(2), 531–539. https://doi.org/10.3758/BRM.40.2.531
   PubMed Web of Science ®Google Scholar
• Bindemann, M., Mike Burton, A., & Langton, S. R. (2008). How do eye gaze and facial expression interact? Visual Cognition, 16(6), 708–733. https://doi.org/10.1080/13506280701269318
   Web of Science ®Google Scholar
• Bliss-Moreau, E., Owren, M. J., & Barrett, L. F. (2010). I like the sound of your voice: Affective learning about vocal signals. Journal of Experimental Social Psychology, 46(3), 557–563. https://doi.org/10.1016/j.jesp.2009.12.017
   PubMed Web of Science ®Google Scholar
• Borjon, J. I., Shepherd, S. V., Todorov, A., & Ghazanfar, A. A. (2011). Eye-gaze and arrow cues influence elementary sound perception. Proceedings of the Royal Society B: Biological Sciences, 278(1714), 1997–2004. https://doi.org/10.1098/rspb.2010.2306
   PubMed Web of Science ®Google Scholar
• Breil, C., Raettig, T., Pittig, R., van der Wel, R. P. R. D., Welsh, T., & Böckler, A. (2022). Don’t look at me like that: Integration of gaze direction and facial expression. Journal of Experimental Psychology: Human Perception and Performance, 48(10), 1083–1098. https://doi.org/10.1037/xhp0001046
   PubMed Web of Science ®Google Scholar
• Brosch, T., Grandjean, D., Sander, D., & Scherer, K. R. (2008). Behold the voice of wrath: Cross-modal modulation of visual attention by anger prosody. Cognition, 106(3), 1497–1503. https://doi.org/10.1016/j.cognition.2007.05.011
   PubMed Web of Science ®Google Scholar
• Capellini, R., Riva, P., Ricciardelli, P., & Sacchi, S. (2019). Turning away from averted gazes: The effect of social exclusion on gaze cueing. Frontiers in Psychology, 10, 1000. https://doi.org/10.3389/fpsyg.2019.01000
   PubMed Web of Science ®Google Scholar
• Capozzi, F., Becchio, C., Willemse, C., & Bayliss, A. P. (2016). Followers are not followed: Observed group interactions modulate subsequent social attention. Journal of Experimental Psychology: General, 145(5), 531–535. https://doi.org/10.1037/xge0000167
   PubMed Web of Science ®Google Scholar
• Carlson, J. M., Conger, S., & Sterr, J. (2018). Auditory distress signals potentiate attentional bias to fearful faces: Evidence for multimodal facilitation of spatial attention by emotion. Journal of Nonverbal Behavior, 42(4), 417–426. https://doi.org/10.1007/s10919-018-0282-7
   Web of Science ®Google Scholar
• Corneil, B. D., & Munoz, D. P. (1996). The influence of auditory and visual distractors on human orienting gaze shifts. The Journal of Neuroscience, 16(24), 8193–8207. https://doi.org/10.1523/JNEUROSCI.16-24-08193.1996
   PubMed Web of Science ®Google Scholar
• Dalmaso, M., Galfano, G., & Castelli, L. (2015). The impact of same- and other-race gaze distractors on the control of saccadic eye movements. Perception, 44(8-9), 1020–1028. https://doi.org/10.1177/0301006615594936
   PubMed Web of Science ®Google Scholar
• Ethofer, T., Anders, S., Erb, M., Droll, C., Royen, L., Saur, R., Reiterer, S., Grodd, W., & Wildgruber, D. (2006a). Impact of voice on emotional judgment of faces: An event-related fMRI study. Human Brain Mapping, 27(9), 707–714. https://doi.org/10.1002/hbm.20212
   PubMed Web of Science ®Google Scholar
• Ethofer, T., Pourtois, G., & Wildgruber, D. (2006b). Investigating audiovisual integration of emotional signals in the human brain. Progress in Brain Research, 156, 345–361. https://doi.org/10.1016/S0079-6123(06)56019-4
   PubMed Web of Science ®Google Scholar
• Farroni, T., Massaccesi, S., Pividori, D., & Johnson, M. H. (2004). Gaze following in newborns. Infancy, 5(1), 39–60. https://doi.org/10.1207/s15327078in0501_2
   Web of Science ®Google Scholar
• Faul, F., Erdfelder, E., Lang, A. G., & Buchner, A. (2007). G*power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods, 39(2), 175–191. https://doi.org/10.3758/BF03193146
   PubMed Web of Science ®Google Scholar
• Friesen, C. K., Halvorson, K. M., & Graham, R. (2011). Emotionally meaningful targets enhance orienting triggered by a fearful gazing face. Cognition and Emotion, 25(1), 73–88. https://doi.org/10.1080/02699931003672381
   PubMed Web of Science ®Google Scholar
• Friesen, C. K., & Kingstone, A. (1998). The eyes have it! Reflexive orienting is triggered by nonpredictive gaze. Psychonomic Bulletin & Review, 5(3), 490–495. https://doi.org/10.3758/BF03208827
   Web of Science ®Google Scholar
• Gerdes, A. B., Wieser, M. J., Bublatzky, F., Kusay, A., Plichta, M. M., & Alpers, G. W. (2013). Emotional sounds modulate early neural processing of emotional pictures. Frontiers in Psychology, 4, 741. https://doi.org/10.3389/fpsyg.2013.00741
   PubMed Web of Science ®Google Scholar
• Graham, R., Kelland Friesen, C., Fichtenholtz, H. M., & LaBar, K. S. (2010). Modulation of reflexive orienting to gaze direction by facial expressions. Visual Cognition, 18(3), 331–368. https://doi.org/10.1080/13506280802689281
   Web of Science ®Google Scholar
• Hawk, S. T., Van Kleef, G. A., Fischer, A. H., & Van Der Schalk, J. (2009). “Worth a thousand words”: Absolute and relative decoding of nonlinguistic affect vocalizations. Emotion, 9(3), 293–305. https://doi.org/10.1037/a0015178
   PubMed Web of Science ®Google Scholar
• Hietanen, J. K. (2018). Affective eye contact: An integrative review. Frontiers in Psychology, 9, 1587. https://doi.org/10.3389/fpsyg.2018.01587
   PubMed Web of Science ®Google Scholar
• Hietanen, J. K., Leppänen, J. M., Nummenmaa, L., & Astikainen, P. (2008). Visuospatial attention shifts by gaze and arrow cues: An ERP study. Brain Research, 1215, 123–136. https://doi.org/10.1016/j.brainres.2008.03.091
   PubMed Web of Science ®Google Scholar
• Ho, H. T., Schröger, E., & Kotz, S. A. (2015). Selective attention modulates early human evoked potentials during emotional face–voice processing. Journal of Cognitive Neuroscience, 27(4), 798–818. https://doi.org/10.1162/jocn_a_00734
   PubMed Web of Science ®Google Scholar
• Hori, E., Tazumi, T., Umeno, K., Kamachi, M., Kobayashi, T., Ono, T., & Nishijo, H. (2005). Effects of facial expression on shared attention mechanisms. Physiology & Behavior, 84(3), 397–405. https://doi.org/10.1016/j.physbeh.2005.01.002
   PubMed Web of Science ®Google Scholar
• Hudson, M., Nijboer, T. C., & Jellema, T. (2012). Implicit social learning in relation to autistic-like traits. Journal of Autism and Developmental Disorders, 42(12), 2534–2545. https://doi.org/10.1007/s10803-012-1510-3
   PubMed Web of Science ®Google Scholar
• Itier, R. J., & Batty, M. (2009). Neural bases of eye and gaze processing: The core of social cognition. Neuroscience & Biobehavioral Reviews, 33(6), 843–863. https://doi.org/10.1016/j.neubiorev.2009.02.004
   PubMed Web of Science ®Google Scholar
• Joyce, K., Schenke, K., Bayliss, A., & Bach, P. (2016). Looking ahead: Anticipatory cueing of attention to objects others will look at. Cognitive Neuroscience, 7(1-4), 74–81. https://doi.org/10.1080/17588928.2015.1053443
   PubMed Web of Science ®Google Scholar
• Kawai, N. (2011). Attentional shift by eye gaze requires joint attention: Eye gaze cues are unique to shift attention1. Japanese Psychological Research, 53(3), 292–301. https://doi.org/10.1111/j.1468-5884.2011.00470.x
   Web of Science ®Google Scholar
• Kreifelts, B., Ethofer, T., Grodd, W., Erb, M., & Wildgruber, D. (2007). Audiovisual integration of emotional signals in voice and face: An event-related fMRI study. Neuroimage, 37(4), 1445–1456. https://doi.org/10.1016/j.neuroimage.2007.06.020
   PubMed Web of Science ®Google Scholar
• Lassalle, A., & Itier, R. J. (2013). Fearful, surprised, happy, and angry facial expressions modulate gaze-oriented attention: Behavioral and ERP evidence. Social Neuroscience, 8(6), 583–600. https://doi.org/10.1080/17470919.2013.835750
   PubMed Web of Science ®Google Scholar
• Lassalle, A., & Itier, R. J. (2015a). Autistic traits influence gaze-oriented attention to happy but not fearful faces. Social Neuroscience, 10(1), 70–88. https://doi.org/10.1080/17470919.2014.958616
   PubMed Web of Science ®Google Scholar
• Lassalle, A., & Itier, R. J. (2015b). Emotional modulation of attention orienting by gaze varies with dynamic cue sequence. Visual Cognition, 23(6), 720–735. https://doi.org/10.1080/13506285.2015.1083067
   PubMed Web of Science ®Google Scholar
• Liu, J., Shi, Y., Whitaker, L., Tian, Y., & Hu, Z. (2019). Facial expressions modulate the gaze orienting effect on sound localization judgement. Visual Cognition, 27(2), 109–119. https://doi.org/10.1080/13506285.2019.1606128
   Web of Science ®Google Scholar
• Mathews, A., Fox, E., Yiend, J., & Calder, A. (2003). The face of fear: Effects of eye gaze and emotion on visual attention. Visual Cognition, 10(7), 823–835. https://doi.org/10.1080/13506280344000095
   PubMed Web of Science ®Google Scholar
• McCrackin, S. D., & Itier, R. J. (2018). Both fearful and happy expressions interact with gaze direction by 200 ms SOA to speed attention orienting. Visual Cognition, 26(4), 231–252. https://doi.org/10.1080/13506285.2017.1420118
   Web of Science ®Google Scholar
• McCrackin, S. D., & Itier, R. J. (2019). Individual differences in the emotional modulation of gaze-cuing. Cognition and Emotion, 33(4), 768–800. https://doi.org/10.1080/02699931.2018.1495618
   PubMed Web of Science ®Google Scholar
• Middlebrooks, J. C., & Green, D. M. (1991). Sound localization by human listeners. Annual Review of Psychology, 42(1), 135–159. https://doi.org/10.1146/annurev.ps.42.020191.001031
   PubMed Web of Science ®Google Scholar
• Neath, K., Nilsen, E. S., Gittsovich, K., & Itier, R. J. (2013). Attention orienting by gaze and facial expressions across development. Emotion, 13(3), 397–408. https://doi.org/10.1037/a0030463
   PubMed Web of Science ®Google Scholar
• Newport, R., & Howarth, S. (2009). Short article: Social gaze cueing to auditory locations. Quarterly Journal of Experimental Psychology, 62(4), 625–634. https://doi.org/10.1080/17470210802486027
   Web of Science ®Google Scholar
• Pecchinenda, A., & Petrucci, M. (2016). Emotion unchained: Facial expression modulates gaze cueing under cognitive load. PLoS One, 11(12), e0168111. https://doi.org/10.1371/journal.pone.0168111
   PubMed Web of Science ®Google Scholar
• Petersen, A., Petersen, A. H., Bundesen, C., Vangkilde, S., & Habekost, T. (2017). The effect of phasic auditory alerting on visual perception. Cognition, 165, 73–81. https://doi.org/10.1016/j.cognition.2017.04.004
   PubMed Web of Science ®Google Scholar
• Ponari, M., Trojano, L., Grossi, D., & Conson, M. (2013). Avoiding or approaching eyes”? introversion/extraversion affects the gaze-cueing effect. Cognitive Processing, 14(3), 293–299. https://doi.org/10.1007/s10339-013-0559-z
   PubMed Web of Science ®Google Scholar
• Pool, E., Brosch, T., Delplanque, S., & Sander, D. (2016). Attentional bias for positive emotional stimuli: A meta-analytic investigation. Psychological Bulletin, 142(1), 79–106. https://doi.org/10.1037/bul0000026
   PubMed Web of Science ®Google Scholar
• Pourtois, G., de Gelder, B., Bol, A., & Crommelinck, M. (2005). Perception of facialexpressions and voices and of their combination in the human brain. Cortex, 41(1), 49–59. https://doi.org/10.1016/S0010-9452(08)70177-1
   PubMed Web of Science ®Google Scholar
• Pourtois, G., De Gelder, B., Vroomen, J., Rossion, B., & Crommelinck, M. (2000). The time-course of intermodal binding between seeing and hearing affective information. Neuroreport, 11(6), 1329–1333. https://doi.org/10.1097/00001756-200004270-00036
   PubMed Web of Science ®Google Scholar
• Rigoulot, S., & Pell, M. D. (2014). Emotion in the voice influences the way we scan emotional faces. Speech Communication, 65, 36–49. https://doi.org/10.1016/j.specom.2014.05.006
   Web of Science ®Google Scholar
• Rogers, R. D., Bayliss, A. P., Szepietowska, A., Dale, L., Reeder, L., Pizzamiglio, G., & Tipper, S. P. (2014). I want to help you, but I am not sure why: Gaze-cuing induces altruistic giving. Journal of Experimental Psychology: General, 143(2), 763–777. https://doi.org/10.1037/a0033677
   PubMed Web of Science ®Google Scholar
• Schilbach, L. (2015). Eye to eye, face to face and brain to brain: Novel approaches to study the behavioral dynamics and neural mechanisms of social interactions. Current Opinion in Behavioral Sciences, 3, 130–135. https://doi.org/10.1016/j.cobeha.2015.03.006
   Web of Science ®Google Scholar
• Selinger, L., Domínguez-Borràs, J., & Escera, C. (2013). Phasic boosting of auditory perception by visual emotion. Biological Psychology, 94(3), 471–478. https://doi.org/10.1016/j.biopsycho.2013.09.004
   PubMed Web of Science ®Google Scholar
• Senju, A., & Johnson, M. H. (2009). The eye contact effect: Mechanisms and development. Trends in Cognitive Sciences, 13(3), 127–134. https://doi.org/10.1016/j.tics.2008.11.009
   PubMed Web of Science ®Google Scholar
• Senju, A., Tojo, Y., Dairoku, H., & Hasegawa, T. (2004). Reflexive orienting in response to eye gaze and an arrow in children with and without autism. Journal of Child Psychology and Psychiatry, 45(3), 445–458. https://doi.org/10.1111/j.1469-7610.2004.00236.x
   PubMed Web of Science ®Google Scholar
• Smilek, D., Birmingham, E., Cameron, D., Bischof, W., & Kingstone, A. (2006). Cognitive ethology and exploring attention in real-world scenes. Brain Research, 1080(1), 101–119. https://doi.org/10.1016/j.brainres.2005.12.090
   PubMed Web of Science ®Google Scholar
• Stoyanova, R. S., Ewbank, M. P., & Calder, A. J. (2010). “You talkin’to me?” Self-relevant auditory signals influence perception of gaze direction. Psychological Science, 21(12), 1765–1769. https://doi.org/10.1177/0956797610388812
   PubMed Web of Science ®Google Scholar
• Takagi, S., Hiramatsu, S., Tabei, K.-i., & Tanaka, A. (2015). Multisensory perception of the six basic emotions is modulated by attentional instruction and unattended modality. Frontiers in Integrative Neuroscience, 9, 1. https://doi.org/10.3389/fnint.2015.00001
   PubMed Web of Science ®Google Scholar
• Talsma, D., Doty, T. J., & Woldorff, M. G. (2007). Selective attention and audiovisual integration: Is attending to both modalities a prerequisite for early integration? Cerebral Cortex, 17(3), 679–690. https://doi.org/10.1093/cercor/bhk016
   PubMed Web of Science ®Google Scholar
• Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14(9), 400–410. https://doi.org/10.1016/j.tics.2010.06.008
   PubMed Web of Science ®Google Scholar
• Tipples, J. (2006). Fear and fearfulness potentiate automatic orienting to eye gaze. Cognition & Emotion, 20(2), 309–320. https://doi.org/10.1080/02699930500405550
   Web of Science ®Google Scholar
• Tollenaar, M. S., Chatzimanoli, M., van der Wee, N. J., & Putman, P. (2013). Enhanced orienting of attention in response to emotional gaze cues after oxytocin administration in healthy young men. Psychoneuroendocrinology, 38(9), 1797–1802. https://doi.org/10.1016/j.psyneuen.2013.02.018
   PubMed Web of Science ®Google Scholar
• Triesch, J., Teuscher, C., Deák, G. O., & Carlson, E. (2006). Gaze following: Why (not) learn it? Developmental Science, 9(2), 125–147. https://doi.org/10.1111/j.1467-7687.2006.00470.x
   PubMed Web of Science ®Google Scholar
• Van Dessel, P., & Vogt, J. (2012). When does hearing laughter draw attention to happy faces? Task relevance determines the influence of a crossmodal affective context on emotional attention. Frontiers in Human Neuroscience, 6, 294. https://doi.org/10.3389/fnhum.2012.00294
   PubMed Web of Science ®Google Scholar
• Wang, Y. M., Xiao, R. Q., & Luo, C. (2019). Mechanisms underlying auditory and cross-modal emotional attentional biases: Engagement with and disengagement from aversive auditory stimuli. Motivation and Emotion, 43(2), 354–369. https://doi.org/10.1007/s11031-018-9739-6
   Web of Science ®Google Scholar
• Wu, Q., & Cui, L. (2020). The “watching-eyes effect” in cooperative behavior: Potential mechanisms and limiting factors. Advances in Psychological Science, 28(6), 994–1003. https://doi.org/10.3724/SP.J.1042.2020.00994
   Google Scholar
• Zhao, S., Uono, S., Yoshimura, S., Kubota, Y., & Toichi, M. (2013). Can gaze-cueing be helpful for detecting sound in autism spectrum disorder? Research in Autism Spectrum Disorders, 7(10), 1250–1256. https://doi.org/10.1016/j.rasd.2013.07.001
   Web of Science ®Google Scholar
• Zhao, S., Uono, S., Yoshimura, S., & Toichi, M. (2015). Is impaired joint attention present in non-clinical individuals with high autistic traits? Molecular Autism, 6(1), 1–9. https://doi.org/10.1186/s13229-015-0059-3
   PubMedGoogle Scholar