Language-emotion interaction modulates selective attention to a speaker’s eyes and mouth: evidence from Chinese-English bilinguals

References

• Anooshian, L. J., and P. T. Hertel. 1994. “Emotionality in Free Recall: Language Specificity in Bilingual Memory.” Cognition & Emotion 8 (6): 503–514.
   Web of Science ®Google Scholar
• Bagby, R. M., G. J. Taylor, and J. D. A. Parker. 1994. “The Twenty-Item Toronto Alexithymia Scale—II. Convergent, Discriminant, and Concurrent Validity.” Journal of Psychosomatic Research 38 (1): 33–40.
   PubMed Web of Science ®Google Scholar
• Bal, E., E. Harden, D. Lamb, A. V. Van Hecke, J. W. Denver, and S. W. Porges. 2010. “Emotion Recognition in Children with Autism Spectrum Disorders: Relations to eye Gaze and Autonomic State.” Journal of Autism and Developmental Disorders 40 (3): 358–370.
   PubMed Web of Science ®Google Scholar
• Barenholtz, E., L. Mavica, and D. J. Lewkowicz. 2016. “Language Familiarity Modulates Relative Attention to the Eyes and Mouth of a Talker.” Cognition 147: 100–105.
   PubMed Web of Science ®Google Scholar
• Baron-Cohen, S., S. Wheelwright, and T. Jolliffe. 1997. “Is There a” Language of the Eyes"? Evidence from Normal Adults, and Adults with Autism or Asperger Syndrome.” Visual Cognition 4 (3): 311–331.
   Web of Science ®Google Scholar
• Baron-Cohen, S., S. Wheelwright, R. Skinner, J. Martin, and E. Clubley. 2001. “The Autism-Spectrum Quotient (AQ): Evidence from Asperger Syndrome/High-functioning Autism, Males and Females, Scientists and Mathematicians.” Journal of Autism and Developmental Disorder 31 (1): 5–17.
   PubMed Web of Science ®Google Scholar
• Barzy, M., H. Ferguson, and D. Williams. 2019. “Perspective Influences eye Movements During Real-Life Conversation: Mentalising About Self vs. Others in Autism.” Autism 24 (8): 2153–2165.
   Web of Science ®Google Scholar
• Baumeister, J. C., F. Foroni, M. Conrad, R. I. Rumiati, and P. Winkielman. 2017. “Embodiment and Emotional Memory in First vs. Second Language.” Frontiers in Psychology 8: 394–394.
   PubMed Web of Science ®Google Scholar
• Beck, A. T., R. A. Steer, and G. K. Brown. 1996. Beck Depression Inventory (BDI-II) (Vol. 10). London, UK: Pearson.
   Google Scholar
• Birulés, J., L. Bosch, R. Brieke, F. Pons, and D. J. Lewkowicz. 2019. “Inside Bilingualism: Language Background Modulates Selective Attention to a Talker's Mouth.” Developmental Science 22 (3): e12755.
   PubMed Web of Science ®Google Scholar
• Birulés, J., L. Bosch, F. Pons, and D. J. Lewkowicz. 2020. “Highly Proficient L2 Speakers Still Need to Attend to a Talker’s Mouth When Processing L2 Speech.” Language, Cognition and Neuroscience 35 (10): 1314–1325.
   Web of Science ®Google Scholar
• Bond, M. H., and T. M. Lai. 1986. “Embarrassment and Code-Switching Into a Second Language.” The Journal of Social Psychology 126 (2): 179–186.
   Web of Science ®Google Scholar
• Buchan, J. N., M. Paré, and K. G. Munhall. 2007. “Spatial Statistics of Gaze Fixations During Dynamic Face Processing.” Social Neuroscience 2 (1): 1–13.
   PubMed Web of Science ®Google Scholar
• Caldwell-Harris, C. L. 2015. “Emotionality Differences Between a Native and Foreign Language: Implications for Everyday Life.” Current Directions in Psychological Science 24 (3): 214–219.
   Web of Science ®Google Scholar
• Caseras, X., M. Garner, B. P. Bradley, and K. Mogg. 2007. “Biases in Visual Orienting to Negative and Positive Scenes in Dysphoria: An eye Movement Study.” Journal of Abnormal Psychology 116 (3): 491–497.
   PubMed Web of Science ®Google Scholar
• Cheek, J. M. 1983. The Revised Cheek and Buss Shyness Scale (RCBS). Wellesley College, Wellesley, MA.
   Google Scholar
• Chen, P., J. Lin, B. Chen, C. Lu, and T. Guo. 2015. “Processing Emotional Words in two Languages with one Brain: Erp and fMRI Evidence from Chinese–English Bilinguals.” Cortex 71: 34–48.
   PubMed Web of Science ®Google Scholar
• Conner, K. M., J. R. Davidson, L. E. Churchill, A. Sherwood, R. H. Weisler, and E. Foa. 2000. “Psychometric properties of the Social Phobia Inventory (SPIN): New self-rating scale.” The British Journal of Psychiatry 176 (4): 379–386.
   PubMedGoogle Scholar
• Cook, S. R., and J.-M. Dewaele. 2022. “‘The English Language Enables me to Visit my Pain’. Exploring Experiences of Using a Later-Learned Language in the Healing Journey of Survivors of Sexuality Persecution.” International Journal of Bilingualism 26 (2): 125–139.
   Web of Science ®Google Scholar
• Dalton, K. M., B. M. Nacewicz, T. Johnstone, H. S. Schaefer, M. A. Gernsbacher, H. H. Goldsmith, A. L. Alexander, and R. J. Davidson. 2005. “Gaze Fixation and the Neural Circuitry of Face Processing in Autism.” Nature Neuroscience 8 (4): 519–526.
   PubMed Web of Science ®Google Scholar
• Dewaele, J.-M. 2004. “The Emotional Force of Swearwords and Taboo Words in the Speech of Multilinguals.” Journal of Multilingual and Multicultural Development 25 (2-3): 204–222.
   Google Scholar
• Dewaele, J.-M. 2008. “The Emotional Weight of I Love you in Multilinguals’ Languages.” Journal of Pragmatics 40 (10): 1753–1780.
   Web of Science ®Google Scholar
• Dewaele, J.-M. 2010. ““Christ fucking shit merde!” Language Preferences for Swearing among Maximally Proficient Multilinguals.” Sociolinguistic Studies 4 (3): 595–614.
   Google Scholar
• Dewaele, J.-M. 2013. Emotions in Multiple Languages. 2nd ed. London: Palgrave Macmillan UK.
   Google Scholar
• Dewaele, J.-M., P. Lorette, L. Rolland, and I. Mavrou. 2021. “Differences in Emotional Reactions of Greek, Hungarian, and British Users of English When Watching Television in English.” International Journal of Applied Linguistics 31 (3): 345–361.
   Web of Science ®Google Scholar
• Dewaele, J.-M., and P. Moxsom-Turnbull. 2020. “Visual Cues and Perception of Emotional Intensity among L1 and LX Users of English.” International Journal of Multilingualism 17 (4): 499–515.
   Web of Science ®Google Scholar
• Dolcos, F., Y. Katsumi, M. Moore, N. Berggren, B. de Gelder, N. Derakshan, A. O. Hamm, et al. 2020. “Neural Correlates of Emotion-Attention Interactions: From Perception, Learning, and Memory to Social Cognition, Individual Differences, and Training Interventions.” Neuroscience and Biobehavioral Reviews 108: 559–601.
   PubMed Web of Science ®Google Scholar
• Eilola, T. M., and J. Havelka. 2011. “Behavioural and Physiological Responses to the Emotional and Taboo Stroop Tasks in Native and non-Native Speakers of English.” International Journal of Bilingualism 15 (3): 353–369.
   Web of Science ®Google Scholar
• Eilola, T. M., J. Havelka, and D. Sharma. 2007. “Emotional Activation in the First and Second Language.” Cognition and Emotion 21 (5): 1064–1076.
   Web of Science ®Google Scholar
• Emery, N. J. 2000. “The Eyes Have it: The Neuroethology, Function and Evolution of Social Gaze.” Neuroscience and Biobehavioral Reviews 24 (6): 581–604.
   PubMed Web of Science ®Google Scholar
• Faul, F., E. Erdfelder, A.-G. Lang, and A. Buchner. 2007. “G*Power 3: A Flexible Statistical Power Analysis Program for the Social, Behavioral, and Biomedical Sciences.” Behavior Research Methods 39 (2): 175–191.
   PubMed Web of Science ®Google Scholar
• Ferré, P., T. García, I. Fraga, R. Sánchez-Casas, and M. Molero. 2010. “Memory for Emotional Words in Bilinguals: Do Words Have the Same Emotional Intensity in the First and in the Second Language?” Cognition and Emotion 24 (5): 760–785.
   Web of Science ®Google Scholar
• Ferré, P., M. Guasch, H. Stadthagen-Gonzalez, and M. Comesaña. 2022. “Love me in L1, but Hate me in L2: How Native Speakers and Bilinguals Rate the Affectivity of Words When Feeling or Thinking About Them.” Bilingualism: Language and Cognition 25 (5): 786–800.
   Web of Science ®Google Scholar
• Fujiwara, E. 2018. “Looking at the Eyes Interferes with Facial Emotion Recognition in Alexithymia.” Journal of Abnormal Psychology 127 (6): 571–577.
   PubMed Web of Science ®Google Scholar
• Gao, S., L. Luo, and T. Gou. 2020. “Criticism in a Foreign Language Hurts Less.” Cognition & Emotion 34 (4): 822–830.
   PubMed Web of Science ®Google Scholar
• Gao, S., O. Zika, R. D. Rogers, and G. Thierry. 2015. “Second Language Feedback Abolishes the “hot Hand” Effect During Even-Probability Gambling.” Journal of Neuroscience 35 (15): 5983–5989.
   PubMed Web of Science ®Google Scholar
• Geipel, J. 2015. Foreign Language Effects on Judgment and Decision Making." PhD diss., University of Trento, Trentino.
   Google Scholar
• Gotlib, I. H., E. Krasnoperova, D. N. Yue, and J. Joormann. 2004. “Attentional Biases for Negative Interpersonal Stimuli in Clinical Depression.” Journal of Abnormal Psychology 113 (1): 121–135.
   PubMed Web of Science ®Google Scholar
• Hall, J. K., S. B. Hutton, and M. J. Morgan. 2010. “Sex Differences in Scanning Faces: Does Attention to the Eyes Explain Female Superiority in Facial Expression Recognition?” Cognition & Emotion 24 (4): 629–637.
   Web of Science ®Google Scholar
• Harris, C. L., A. Ayçíçeğí, and J. B. Gleason. 2003. “Taboo Words and Reprimands Elicit Greater Autonomic Reactivity in a First Language Than in a Second Language.” Applied Psycholinguistics 24 (4): 561–579.
   Web of Science ®Google Scholar
• Horley, K., L. M. Williams, C. Gonsalvez, and E. Gordon. 2004. “Face to Face: Visual Scanpath Evidence for Abnormal Processing of Facial Expressions in Social Phobia.” Psychiatry Research 127 (1): 43–53.
   PubMed Web of Science ®Google Scholar
• Hsu, C.-T., A. M. Jacobs, and M. Conrad. 2015. “Can Harry Potter Still put a Spell on us in a Second Language? An fMRI Study on Reading Emotion-Laden Literature in Late Bilinguals.” Cortex 63: 282–295.
   PubMed Web of Science ®Google Scholar
• Hu, J., X. Li, J. Li, W. Zhang, Y. Lan, Z. Gao, and S. Gao. 2022. “Valence-differential Mechanisms of the Foreign Language Effect in Decision-Making Under Risk.” Journal of Multilingual and Multicultural Development. doi:10.1080/01434632.2022.2043333
   PubMed Web of Science ®Google Scholar
• Iacozza, S., A. Costa, and J. A. Duñabeitia. 2017. “What do Your Eyes Reveal About Your Foreign Language? Reading Emotional Sentences in a Native and Foreign Language.” PloS One 12 (10): e0186027.
   PubMed Web of Science ®Google Scholar
• Jankowiak, K., and P. Korpal. 2018. “On Modality Effects in Bilingual Emotional Language Processing: Evidence from Galvanic Skin Response.” Journal of Psycholinguistic Research 47 (3): 663–677.
   PubMed Web of Science ®Google Scholar
• Jones, W., K. Carr, and A. Klin. 2008. “Absence of Preferential Looking to the Eyes of Approaching Adults Predicts Level of Social Disability in 2-Year-old Toddlers with Autism Spectrum Disorder.” Archives of General Psychiatry 65 (8): 946–954.
   PubMed Web of Science ®Google Scholar
• Keysar, B., S. L. Hayakawa, and S. G. An. 2012. “The Foreign-Language Effect: Thinking in a Foreign Tongue Reduces Decision Biases.” Psychological Science 23 (6): 661–668.
   PubMed Web of Science ®Google Scholar
• Kim, P., J. Arizpe, B. H. Rosen, V. Razdan, C. T. Haring, S. E. Jenkins, C. M. Deveney, et al. 2013. “Impaired Fixation to Eyes During Facial Emotion Labelling in Children with Bipolar Disorder or Severe Mood Dysregulation.” Journal of Psychiatry & Neuroscience: Japan 38 (6): 407.
   PubMed Web of Science ®Google Scholar
• Klin, A., W. Jones, R. Schultz, F. Volkmar, and D. Cohen. 2002. “Visual Fixation Patterns During Viewing of Naturalistic Social Situations as Predictors of Social Competence in Individuals with Autism.” Archives of General Psychiatry 59 (9): 809–816.
   PubMed Web of Science ®Google Scholar
• Król, M. E. 2018. “Auditory Noise Increases the Allocation of Attention to the Mouth, and the Eyes pay the Price: An eye-Tracking Study.” PloS One 13 (3): e0194491.
   PubMed Web of Science ®Google Scholar
• Lewkowicz, D. J., and A. M. Hansen-Tift. 2012. “Infants Deploy Selective Attention to the Mouth of a Talking Face When Learning Speech.” Proceedings of the National Academy of Sciences 109 (5): 1431–1436.
   PubMed Web of Science ®Google Scholar
• McGurk, H., and J. MacDonald. 1976. “Hearing Lips and Seeing Voices.” Nature 264 (5588): 746–748.
   PubMed Web of Science ®Google Scholar
• Opitz, B., and J. Degner. 2012. “Emotionality in a Second Language: It's a Matter of Time.” Neuropsychologia 50 (8): 1961–1967.
   PubMed Web of Science ®Google Scholar
• Ożańska-Ponikwia, K. 2019. “Expression and Perception of Emotions by Polish-English Bilinguals I Love you vs. Kocham Cię.” International Journal of Bilingual Education and Bilingualism 22 (4): 493–504.
   Web of Science ®Google Scholar
• Parker, J. D., G. J. Taylor, and M. Bagby. 1993. “Alexithymia and the Recognition of Facial Expressions of Emotion.” Psychotherapy and Psychosomatics 59 (3-4): 197–202.
   PubMed Web of Science ®Google Scholar
• Pavlenko, A. 2005. Emotions and Bilingualism. New York: Cambridge University Press.
   Google Scholar
• Pons, F., L. Bosch, and D. J. Lewkowicz. 2015. “Bilingualism Modulates Infants’ Selective Attention to the Mouth of a Talking Face.” Psychological Science 26 (4): 490–498.
   PubMed Web of Science ®Google Scholar
• Pons, F., M. Sanz-Torrent, L. Ferinu, J. Birulés, and L. Andreu. 2018. “Children with SLI Can Exhibit Reduced Attention to a Talker's Mouth.” Language Learning 68: 180–192.
   Web of Science ®Google Scholar
• Pratto, F., and O. P. John. 1991. “Automatic Vigilance: The Attention-Grabbing Power of Negative Social Information.” Journal of Personality and Social Psychology 61 (3): 380–391.
   PubMed Web of Science ®Google Scholar
• Reisberg, D. 1978. “Looking Where you Listen: Visual Cues and Auditory Attention.” Acta Psychologica 42 (4): 331–341.
   PubMed Web of Science ®Google Scholar
• Reisberg, D., J. McLean, and A. Goldfield. 1987. “Easy to Hear but Hard to Understand: A lip-Reading Advantage with Intact Auditory Stimuli.” In Hearing by eye: The Psychology of lip-Reading, edited by B. Dodd and R. Campbell, 97–113. Mahwah: Lawrence Erlbaum Associates, Inc.
   Google Scholar
• Schurgin, M., J. Nelson, S. Iida, H. Ohira, J. Chiao, and S. Franconeri. 2014. “Eye Movements During Emotion Recognition in Faces.” Journal of Vision 14 (13): 14–14.
   PubMed Web of Science ®Google Scholar
• Sheikh, N. A., and D. Titone. 2016. “The Embodiment of Emotional Words in a Second Language: An eye-Movement Study.” Cognition and Emotion 30 (3): 488–500.
   PubMed Web of Science ®Google Scholar
• Smith, E. G., and L. Bennetto. 2007. “Audiovisual Speech Integration and Lipreading in Autism.” Journal of Child Psychology and Psychiatry 48 (8): 813–821.
   PubMed Web of Science ®Google Scholar
• Smith, N. K., J. T. Cacioppo, J. T. Larsen, and T. L. Chartrand. 2003. “May I Have Your Attention, Please: Electrocortical Responses to Positive and Negative Stimuli.” Neuropsychologia 41 (2): 171–183.
   PubMed Web of Science ®Google Scholar
• Susa-Erdogan, G., O. Benga, and C. Colonnesi. 2022. “Expressions of Positive and Negative Shyness in Preschool-age Children: Temperamental Correlates and Visual Attention to Emotions.” Journal of Experimental Child Psychology 215: 105315.
   PubMed Web of Science ®Google Scholar
• Tenderini, M. S., E. de Leeuw, T. M. Eilola, and M. T. Pearce. 2022. “Reduced Cross-Modal Affective Priming in the L2 of Late Bilinguals Depends on L2 Exposure.” Journal of Experimental Psychology: Learning, Memory, and Cognition 48 (2): 284–303.
   PubMed Web of Science ®Google Scholar
• Toivo, W., and C. Scheepers. 2019. “Pupillary Responses to Affective Words in Bilinguals’ First Versus Second Language.” PloS One 14 (4): e0210450.
   PubMed Web of Science ®Google Scholar
• Vélez-Uribe, I., and M. Rosselli. 2017. “The Auditory and Visual Appraisal of Emotion-Related Words in Spanish–English Bilinguals.” Bilingualism: Language and Cognition 22 (1): 30–46.
   Web of Science ®Google Scholar
• Vermeulen, N. 2010. “Current Positive and Negative Affective States Modulate Attention: An Attentional Blink Study.” Personality and Individual Differences 49 (5): 542–545.
   Web of Science ®Google Scholar
• Watson, D., L. A. Clark, and A. Tellegen. 1988. “Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales.” Journal of Personality and Social Psychology 54 (6): 1063–1070.
   PubMed Web of Science ®Google Scholar
• Wegrzyn, M., M. Vogt, B. Kireclioglu, J. Schneider, and J. Kissler. 2017. “Mapping the Emotional Face. How Individual Face Parts Contribute to Successful Emotion Recognition.” PloS One 12 (5): e0177239.
   PubMed Web of Science ®Google Scholar