244
Views
0
CrossRef citations to date
0
Altmetric
Articles

Moment-by-moment tracking of audience brain responses to an engaging public speech: Replicating the reverse-message engineering approach

, , , , , , & show all
Pages 31-55 | Received 18 Jan 2023, Accepted 17 Jul 2023, Published online: 10 Aug 2023

References

  • Abelson, R., & Schank, R. C. (1977). Scripts, plans, goals and understanding: An inquiry into human knowledge structures.
  • Abelson, R. P. (1983). Commentary points. Behavioral and Brain Sciences, 6(4), 591–592. https://doi.org/10.1017/S0140525X00017532
  • Amir, O., Biederman, I., Wang, Z., & Xu, X. (2015). Ha ha! Versus aha! A direct comparison of humor to nonhumorous insight for determining the neural correlates of mirth. Cerebral Cortex, 25(5), 1405–1413. https://doi.org/10.1093/cercor/bht343
  • Areni, C. S. (2003). The effects of structural and grammatical variables on persuasion: An elaboration likelihood model perspective. Psychology and Marketing, 20(4), 349–375. https://doi.org/10.1002/mar.10077
  • Bartlett, F. C. (1932). Remembering: A study in experimental and social psychology. Cambridge University Press.
  • Belin, P., Zatorre, R. J., Hoge, R., Evans, A. C., & Pike, B. (1999). Event-related fMRI of the auditory cortex. NeuroImage, 10(4), 417–429. https://doi.org/10.1006/nimg.1999.0480
  • Bruner, J. (1986). Actual minds, possible worlds. Harvard University Press. https://doi.org/10.4159/9780674029019
  • Busselle, R., & Cutietta, N. (2019). Narrative engagement. Oxford Bibliography Communication. https://doi.org/10.1093/obo/9780199756841-0223
  • Carter, R. M., & Huettel, S. A. (2013). A nexus model of the temporal–parietal junction. Trends in Cognitive Sciences, 17(7), 328–336. https://doi.org/10.1016/j.tics.2013.05.007
  • Castricato, L., Biderman, S., Cardona-Rivera, R. E., & Thue, D. (2021). Towards a formal model of narratives. arXiv preprint arXiv:2103.12872. https://doi.org/10.48550/arXiv.2103.12872
  • Chien, H. Y. S., & Honey, C. J. (2020). Constructing and forgetting temporal context in the human cerebral cortex. Neuron, 106(4), 675–686.e11. https://doi.org/10.1016/j.neuron.2020.02.013
  • Clark, H. H. (1973). The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning and Verbal Behavior, 12(4), 335–359. https://doi.org/10.1016/S0022-5371(73)80014-3
  • Colley, R. (1961). Defining advertising goals for measured advertising results. New York: Association of National Advertisers, Inc.
  • Coronel, J. C., O’Donnell, M. B., Pandey, P., Delli Carpini, M. X., & Falk, E. B. (2021). Political humor, sharing, and remembering: Insights from neuroimaging. Journal of Communication, 71(1), 129–161. https://doi.org/10.1093/joc/jqaa041
  • Decety, J., & Lamm, C. (2007). The role of the right temporoparietal junction in social interaction: How low-level computational processes contribute to meta-cognition. The Neuroscientist, 13(6), 580–593. https://doi.org/10.1177/1073858407304654
  • de la Vega, A., Rocca, R., Blair, R. W., Markiewicz, C. J., Mentch, J., Kent, J. D., Herholz, P., Ghosh, S. S., Poldrack, R. A., & Yarkoni, T. (2022). Neuroscout, a unified platform for generalizable and reproducible fMRI research. eLife, 11, e79277. https://doi.org/10.7554/eLife.79277
  • Dmochowski, J. P., Bezdek, M. A., Abelson, B. P., Johnson, J. S., Schumacher, E. H., & Parra, L. C. (2014). Audience preferences are predicted by temporal reliability of neural processing. Nature Communications, 5(1), 4567. https://doi.org/10.1038/ncomms5567
  • Esteban, O., Markiewicz, C. J., Blair, R. W., Moodie, C. A., Ilkay Isik, A., Erramuzpe, A., Kent, J. D., Goncalves, M., DuPre, E., Snyder, M., Oya, H., Ghosh, S. S., Wright, J., Durnez, J., Poldrack, R. A., & Gorgolewski, K. J. (2019). fMRIPrep: A robust preprocessing pipeline for functional MRI. Nature Methods, 16(1), 111–116. https://doi.org/10.1038/s41592-018-0235-4
  • Falk, E. B., Berkman, E. T., Mann, T., Harrison, B., & Lieberman, M. D. (2010). Predicting persuasion-induced behavior change from the brain. Journal of Neuroscience, 30(25), 8421–8424. https://doi.org/10.1523/JNEUROSCI.0063-10.2010
  • Falk, E. B., Cascio, C. N., & Coronel, J. C. (2015). Neural prediction of communication-relevant outcomes. Communication Methods and Measures, 9(1-2), 30–54. https://doi.org/10.1080/19312458.2014.999750
  • Ferstl, E. C., Neumann, J., Bogler, C., & von Cramon, D. Y. (2008). The extended language network: A meta-analysis of neuroimaging studies on text comprehension. Human Brain Mapping, 29(5), 581–593. https://doi.org/10.1002/hbm.20422
  • Fisch, S. M. (2014). Children's learning from educational television: Sesame Street and beyond. New York: Routledge.
  • Fiske, S. T., & Taylor, S. E. (2013). Social cognition: From brains to culture. SAGE.
  • Floyd, K., & Weber, R. (2020). The handbook of communication science and biology. New York: Routledge. https://doi.org/10.4324/9781351235587
  • Geng, J. J., & Vossel, S. (2013). Re-evaluating the role of TPJ in attentional control: Contextual updating? Neuroscience & Biobehavioral Reviews, 37(10 Pt 2), 2608–2620. https://doi.org/10.1016/j.neubiorev.2013.08.010
  • Grady, S. M., Schmälzle, R., & Baldwin, J. (2022). Examining the relationship between story structure and audience response. Projections, 16(3), 1–28. https://doi.org/10.3167/proj.2022.160301
  • Grall, C., Tamborini, R., Weber, R., & Schmälzle, R. (2021). Stories collectively engage listeners’ brains: Enhanced intersubject correlations during reception of personal narratives. Journal of Communication, 71(2), 332–355. https://doi.org/10.1093/joc/jqab004
  • Green, M. C., Strange, J. J., & Brock, T. C. (2003). Narrative impact: Social and cognitive foundations. Psychology Press.
  • Hasson, U., Nir, Y., Levy, I., Fuhrmann, G., & Malach, R. (2004). Intersubject synchronization of cortical activity during natural vision. Science, 303(5664), 1634–1640. https://doi.org/10.1126/science.1089506
  • Heider, F., & Simmel, M. (1944). An experimental study of apparent behavior. The American Journal of Psychology, 57(2), 243–259. https://doi.org/10.2307/1416950
  • Hickok, G., & Poeppel, D. (2007). The cortical organization of speech processing. Nature Reviews Neuroscience, 8(5), 393–402. https://doi.org/10.1038/nrn2113
  • Hopp, F. R., Fisher, J. T., Cornell, D., Huskey, R., & Weber, R. (2021). The extended Moral Foundations Dictionary (eMFD): Development and applications of a crowd-sourced approach to extracting moral intuitions from text. Behavior Research Methods, 53(1), 232–246. https://doi.org/10.3758/s13428-020-01433-0
  • Hunter, J. E. (2001). The desperate need for replications. Journal of Consumer Research, 28(1), 149–158. https://doi.org/10.1086/321953
  • Huskey, R., Bue, A. C., Eden, A., Grall, C., Meshi, D., Prena, K., Schmälzle, R., Scholz, C., Turner, B., & Wilcox, S. (2020). Marr’s tri-level framework integrates biological explanation across communication subfields. Journal of Communication, 70(3), 356–378. https://doi.org/10.1093/joc/jqaa007
  • Imhof, M. A., Schmälzle, R., Renner, B., & Schupp, H. T. (2020). Strong health messages increase audience brain coupling. NeuroImage, 216, 116527. https://doi.org/10.1016/j.neuroimage.2020.116527
  • Jackson, S., & Jacobs, S. (1983). Generalizing about messages: Suggestions for design and analysis of experiments. Human Communication Research, 9(2), 169–191. https://doi.org/10.1111/j.1468-2958.1983.tb00691.x
  • Kintsch, W. (1998). Comprehension: A paradigm for cognition. Cambridge University Press.
  • Koolstra, C. M., Van Zanten, J., Lucassen, N., & Ishaak, N. (2004). The formal pace of Sesame Street over 26 years. Perceptual and Motor Skills, 99(1), 354–360. https://doi.org/10.2466/pms.99.1.354-360
  • Lazarsfeld, P. F. (1940). Radio and the printed page; an introduction to the study of radio and its role in the communication of ideas. Duell, Sloan, & Pearce.
  • Lewis Jr, N. A. (2020). Open communication science: A primer on why and some recommendations for how. Communication Methods and Measures, 14(2), 71–82. https://doi.org/10.1080/19312458.2019.1685660
  • Lorch, E. P., & Anderson, D. R. (1979). The relationship of visual attention to children's comprehension of television. Child Development, 50(3), 722–727. https://doi.org/10.2307/1128938
  • Lucas, S., & Stob, P. (2004). The art of public speaking. New York: McGraw-Hill.
  • Luyten, P., Malcorps, S., Fonagy, P., & Ensink, K. (2019). Assessment of mentalizing. In A. Bateman, & P. Fonagy (Eds.), Handbook of mentalizing in mental health practice (pp. 37–62).
  • Lynch, O. H. (2002). Humorous communication: Finding a place for humor in communication research. Communication Theory, 12(4), 423–445. https://doi.org/10.1111/j.1468-2885.2002.tb00277.x
  • Mar, R. A. (2011). The neural bases of social cognition and story comprehension. Annual Review of Psychology, 62(1), 103–134. https://doi.org/10.1146/annurev-psych-120709-145406
  • Mar, R. A., & Oatley, K. (2008). The function of fiction is the abstraction and simulation of social experience. Perspectives on Psychological Science, 3(3), 173–192. https://doi.org/10.1111/j.1745-6924.2008.00073.x
  • McCroskey, J. C., & Richmond, V. P. (2001). Rhetorical communication. Boston: Pearson.
  • McEwan, B., Carpenter, C. J., & Westerman, D. (2018). On replication in communication science. Communication Studies, 69(3), 235–241. https://doi.org/10.1080/10510974.2018.1464938
  • McNamara, Q., De La Vega, A., & Yarkoni, T. (2017). Developing a comprehensive framework for multimodal feature extraction. In Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (pp. 1567–1574). https://doi.org/10.1145/3097983.3098075
  • Meyer, J. C. (2015). Understanding humor through communication: Why be funny, anyway? Lexington Books.
  • Mosenthal, J. H. (1987). The reader's affective response to narrative text. In R. Tierney, P. Anders, & J. Mitchell (Eds.), Understanding readers' understanding (pp. 95–105). Hillsdale, NJ: Erlbaum. https://doi.org/10.4324/9780203056837
  • Nastase, S. A., Liu, Y. F., Hillman, H., Zadbood, A., Hasenfratz, L., Keshavarzian, N., Chen, J., Honey, C. J., Yeshurun, Y., Regev, M., Nguyen, M., Chang, C. H. C., Baldassano, C., Lositsky, O., Simony, E., Chow, M. A., Leong, Y. C., Brooks, P. P., Micciche, E., … Hasson, U. (2021). The “Narratives” fMRI dataset for evaluating models of naturalistic language comprehension. Scientific Data, 8(1), 1–22. https://doi.org/10.1038/s41597-021-01033-3
  • Neuendorf, K. A., & Fennell, T. (1988). A social facilitation view of the generation of humor and mirth reactions: Effects of a laugh track. Central States Speech Journal, 39(1), 37–48. https://doi.org/10.1080/10510978809363233
  • Nguyen, M., Vanderwal, T., & Hasson, U. (2019). Shared understanding of narratives is correlated with shared neural responses. Neuroimage, 184, 161–170. https://doi.org/10.1016/j.neuroimage.2018.09.010.
  • Petty, R. E., & Cacioppo, J. T. (1986). Advances in experimental social psychology. Advances in Experimental Social Psychology, 19, 123–205. https://doi.org/10.1016/S0065-2601(08)60214-2
  • Poeppel, D., Mangun, G. R., & Gazzaniga, M. S. (2020). The cognitive neurosciences. MIT Press.
  • Provine, R. R. (1993). Laughter punctuates speech: Linguistic, social and gender contexts of laughter. Ethology, 95(4), 291–298. https://doi.org/10.1111/j.1439-0310.1993.tb00478.x
  • Saxe, R., & Kanwisher, N. (2003). People thinking about thinking people. The role of the temporo-parietal junction in “theory of mind”. NeuroImage, 19(4), 1835–1842. https://doi.org/10.1016/S1053-8119(03)00230-1
  • Schank, R. C. (1995). Tell me a story: Narrative and intelligence. Northwestern University Press.
  • Schmälzle, R. (2022). Theory and method for studying How media messages prompt shared brain responses along the sensation-to-cognition continuum. Communication Theory, 32(4), 450–460. https://doi.org/10.1093/ct/qtac009
  • Schmälzle, R., Häcker, F., Honey Christopher, J., & Hasson, U. (2015). Engaged listeners: Shared neural processing of powerful political speeches. Social Cognitive and Affective Neuroscience, 10(8), 1137–1143. https://doi.org/10.1093/scan/nsu168
  • Schmälzle, R., & Huskey, R. (2023). Integrating media content analysis, reception analysis, and media effects studies. Frontiers in Neuroscience, 17, 1155750. https://doi.org/10.3389/fnins.2023.1155750
  • Schmälzle, R., & Meshi, D. (2020). Communication neuroscience: Theory, methodology and experimental approaches. Communication Methods and Measures, 14(2), 105–124. https://doi.org/10.1080/19312458.2019.1708283
  • Schnupp, J., Nelken, I., & King, A. (2011). Auditory neuroscience: Making sense of sound. MIT Press.
  • Schurz, M., Tholen, M. G., Perner, J., Mars, R. B., & Sallet, J. (2017). Specifying the brain anatomy underlying temporo-parietal junction activations for theory of mind: A review using probabilistic atlases from different imaging modalities. Human Brain Mapping, 38(9), 4788–4805. https://doi.org/10.1002/hbm.23675
  • Shen, X., Tokoglu, F., Papademetris, X., & Constable, R. T. (2013). Groupwise whole-brain parcellation from resting-state fMRI data for network node identification. NeuroImage, 82, 403–415. https://doi.org/10.1016/j.neuroimage.2013.05.081
  • Sliwa, J., & Freiwald, W. A. (2017). A dedicated network for social interaction processing in the primate brain. Science, 356(6339), 745–749. https://doi.org/10.1126/science.aam6383
  • Stein, N. L. (1982). The definition of a story. Journal of Pragmatics, 6(5–6), 487–507. https://doi.org/10.1016/0378-2166(82)90022-4
  • Stiff, J. B. (1986). Cognitive processing of persuasive message cues: A meta-analytic review of the effects of supporting information on attitudes. Communication Monographs, 53(1), 75–89. https://doi.org/10.1080/03637758609376128
  • VanDyke, M. S., & Callison, C. (2018). Using continuous response and self-report measures to understand spokesperson evaluation processes during water crises. Journal of Contemporary Water Research & Education, 164(1), 71–79. https://doi.org/10.1111/j.1936-704X.2018.03285.x
  • Ward, J. (2016). The student’s guide to social neuroscience. Psychology Press.
  • Weber, R. (2015). Brain, mind, and media. Journal of Media Psychology, 27(3), 89–92. https://doi.org/10.1027/1864-1105/a000162
  • Weber, R., Sherry, J., & Mathiak, K. (2008). The neurophysiological perspective in mass communication research. In M. J. Beatty, J. C. McCroskey, & K. Floyd (Eds.), Biological dimensions of communication: Perspectives, methods, and research (pp. 41–71).
  • West, R. L., Turner, L. H., & Zhao, G. (2010). Introducing communication theory: Analysis and application (Vol. 2). New York, NY: McGraw-Hill.
  • Wilensky, R. (1983). Story grammars versus story points. Behavioral and Brain Sciences, 6(4), 579–591. https://doi.org/10.1017/S0140525X00017520
  • Willems, R. M., Nastase, S. A., & Milivojevic, B. (2020). Narratives for neuroscience. Trends in Neurosciences, 43(5), 271–273. https://doi.org/10.1016/j.tins.2020.03.003
  • Xu, D., Agarwal, M., Gupta, E., Fekri, F., & Sivakumar, R. (2021). Accelerating Reinforcement Learning using EEG-based implicit human feedback. Neurocomputing, 460, 139–153. https://doi.org/10.1016/j.neucom.2021.06.064
  • Yeshurun, Y., Nguyen, M., & Hasson, U. (2021). The default mode network: where the idiosyncratic self meets the shared social world. Nature Reviews Neuroscience, 22(3), 181–192. https://doi.org/10.1038/s41583-020-00420-w
  • Zhao, X., Strasser, A., Cappella, J. N., Lerman, C., & Fishbein, M. (2011). A measure of perceived argument strength: Reliability and validity. Communication Methods and Measures, 5(1), 48–75. doi:10.1080/19312458.2010.547822

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.