The Automatic Analysis of Emotion in Political Speech Based on Transcripts

References

• Amir, S., Astudillo, R. F., Ling, W., Martins, B., Silva, M., & Trancoso, I. (2015). INESC-ID: A regression model for large scale twitter sentiment lexicon inuction. Proceedings of the 9th International Workshop on Semantic Evaluation (SemEval 2015),Denver, Colorado.
   Google Scholar
• Bänziäer, T., & Scherer, K. R. (2005). The role of intonation in emotional expressions. Speech Communication, 46(3–4), 252–267. https://doi.org/10.1016/j.specom.2005.02.016
   Web of Science ®Google Scholar
• Baccianella, S., Esuli, A., & Sebastiani, F. (2010, May). Sentiwordnet 3.0: An enhanced lexical resource for sentiment analysis and opinion mining. In Nicolette Calzolari, Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odiijk, Stelios Piperidis, Mike Rosner, Daniel Tapias (Eds.), Proceedings of the seventh international conference on language resources and evaluation (LREC’10). European Language Resources Association (ELRA), 2200-2204.
   Google Scholar
• Beelen, K., Thijm, T. A., Cochrane, C., Halvemaan, K., Hirst, G., Kimmins, M., Lijbrink, S., Marx, M., Naderi, N., Rheault, L., Polyanovsky, R., & Whyte, T. (2017). Digitization of the Canadian parliamentary debates. Canadian Journal of Political Science, 50(3), 849–864. https://doi.org/10.1017/S0008423916001165
   Web of Science ®Google Scholar
• Benoit, K. (2019). Text as data: An overview. In L. Curini & R. Franzese (Eds.), The sage handbook of research methods in political science and international relations. (pp. 461-497). SAGE Publishing.
   Google Scholar
• Brooks, J. A., Shablack, H., Gendron, M., Satpute, A. B., Parrish, M. H., & Lindquist, K. A. (2017). The role of language in the experience and perception of emotion: A neuroimaging meta-analysis. Social Cognitive and Affective Neuroscience, 12(2), 169–183. https://doi.org/10.1093/scan/nsw121
   PubMed Web of Science ®Google Scholar
• Cambria, E., Schuller, B., Xia, Y., & Havasi, C. (2013). New avenues in opinion mining and sentiment analysis. IEEE Intelligent Systems, 28(2), 15–21. https://doi.org/10.1109/MIS.2013.30
   Web of Science ®Google Scholar
• Casas, A., & Webb Williams, N. (2019). Images that matter: Online protests and the mobilizing role of pictures. Political Research Quarterly, 72(2), 360–375. https://doi.org/10.1177/1065912918786805
   Web of Science ®Google Scholar
• Chaovalit, P., & Zhou, L. (2005, January). Movie review mining: A comparison between supervised and unsupervised classification approaches. Proceedings of the 38th Hawaii International Conference on System Sciences, Big Island, HI, United States.
   Google Scholar
• Cicchetti, D. V. (1994). Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological Assessment, 6(4), 284–290. https://doi.org/10.1037/1040-3590.6.4.284
   Google Scholar
• Crabtree, C., Golder, M., Gschwend, T., & Indriason, I. H. (2020). It is not only what you say, it is also how you say it: The strategic use of campaign sentiment. The Journal of Politics, 82(3). https://doi.org/10.1086/707613
   Google Scholar
• Daku, M., Soroka, S., & Young, L. (2015). Lexicoder 3.0. http://lexicoder.com with http://www.snsoroka.com/data-lexicoder/
   Google Scholar
• Dang-Xuan, L., Stieglitz, S., Wladarsch, J., & Neuberger, C. (2013). An investigation of influentials and the role of sentiment in political communication on twitter during election periods. Information, Communication & Society, 16(5), 795–825. https://doi.org/10.1080/1369118X.2013.783608
   Web of Science ®Google Scholar
• de Gelder, B., de Borst, A. W., & Watson, R. (2015). The perception of emotion in body expressions. Wiley Interdisciplinary Reviews: Cognitive Science, 6(2), 149–158. https://doi.org/10.1002/wcs.1335
   PubMed Web of Science ®Google Scholar
• Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. arXiv eprint arXiv:1810.04805. https://arxiv.org/abs/1810.04805
   Google Scholar
• Diermeier, D., Godbout, J.-F., Yu, B., & Kaufmann, S. (2012, January). Language and ideology in congress. British Journal of Political Science, 42(1), 31–55. https://doi.org/10.1017/S0007123411000160
   Google Scholar
• Dietrich, B. J., Enos, R. D., & Sen, M. (2019). Emotional arousal predicts voting on the U.S. supreme court. Political Analysis, 27(2), 237–243. https://doi.org/10.1017/pan.2018.47
   Web of Science ®Google Scholar
• Dietrich, B. J., Hayes, M., & O’Brien, D. Z. (2019). Pitch perfect: Vocal pitch and the emotional intensity of congressional speech. American Political Science Review, 113(4), 941–962. https://doi.org/10.1017/S0003055419000467
   Web of Science ®Google Scholar
• Duval, D., & Pétry, F. (2016). L’analyse automatisée du ton médiatique: Construction et utilisation de la version française du Lexicoder Sentiment Dictionary. Canadian Journal of Political Science, 49(2), 197–220. https://doi.org/10.1017/S000842391600055X
   Google Scholar
• Eberl, J.-M., Tolochko, P., Jost, P., Heidenreich, T., & Boomgaarden, H. G. (2020). What’s in a post? How sentiment and issue salience affect users’ emotional reactions on Facebook. Journal of Information Technology & Politics, 17(1), 48–65. https://doi.org/10.1080/19331681.2019.1710318
   Web of Science ®Google Scholar
• Ekman, P. (1992). Facial expression and emotion. American Psychologist, 48(4), 384–392. https://doi.org/10.1037/0003-066X.48.4.384
   Web of Science ®Google Scholar
• Ekman, P., Davidson, R. J., & Friesen, W. V. (1990). The duchenne smile: Emotion expression and brain physiology. Journal of Personality and Social Psychology, 58(2), 342–353. https://doi.org/10.1037/0022-3514.58.2.342
   PubMed Web of Science ®Google Scholar
• Ekman, P., & Friesen, W. V. (1969, February). Nonverbal leakage and clues to deception. Psychiatry: Journal for the Study of Interpersonal Processes, 32(1), 88–106. https://doi.org/10.1080/00332747.1969.11023575
   PubMed Web of Science ®Google Scholar
• Ekman, P., O’Sullivan, M., Friesen, W. V., & Scherer, K. R. (1991). Face, voice, and body in detecting deceipt. Journal of Nonverbal Behaviour, 15(2), 125–135. https://doi.org/10.1007/BF00998267
   Web of Science ®Google Scholar
• Esuli, A., & Sebastiani, F. (2006). SentiWordNet: A publicly available lexical resource for opinion mining. Proceedings of the 5th International Conference on Language Resources and Evaluation,Genoa, Italy. 417–422. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.61.7217
   Google Scholar
• Ethayarajh, K., Duvenaud, D., & Hirst, G. (2018). Towards understanding linear word analogies. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2018) (pp. 3253–3262), Florence, Italy.
   Google Scholar
• Fast, E., Chen, B., & Bernstein, M. S. (2016). Empath: Understanding topic signals in large-scale text. Proceedings of the 2016 Chi Conference on Human Factors in Computing Systems (pp. 4647–4657), San Jose, CA, United States.
   Google Scholar
• Flores, R. D. (2017). Do anti-immigrant laws shape public sentiment? A study of Arizona’s SB 1070 using twitter data. The American Journal of Sociology, 123(2), 333. https://doi.org/10.1086/692983
   Web of Science ®Google Scholar
• Griffiths, P. E. (1997). What emotions really are. University of Chicago Press.
   Google Scholar
• Grimmer, J., & Stewart, B. M. (2013). Text as data: The promise and pitfalls of automatic content analysis methods for political texts. Political Analysis, 21(3), 267–297. https://doi.org/10.1093/pan/mps028
   Web of Science ®Google Scholar
• Hall, T. H. (2015). Emotional diplomacy: Official emotion on the international stage. Cornell University Press.
   Google Scholar
• Hamilton, W. L., Clark, K., Leskovec, J., & Jurafsky, D. (2016). Inducing domain-specific sentiment lexicons from unlabeled corpora. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing (Emnlp 2016), 2016, Austin, Texas, 595-605. https://aclanthology.org/D16-1057.pdf
   Google Scholar
• Hatzivassiloglou, V., & McKeown, K. R. (1997). Predicting the semantic orientation of adjectives. Proceedings of the 35th Annual Meeting of the ACL and the 8th Conference of the European Chapter of the ACL (pp. 174–181), Madrid, Spain.
   Google Scholar
• Hirst, G., Riabinin, Y., Graham, J., Boizot-Roche, M., & Morris, C. (2014). Text to ideology or text to party status? In B. Kaal, I. Maks, & A. Van Elfrinkhof (Eds.), From text to political positions: Text analysis across disciplines. (pp. 93-116). John Benjamins.
   Google Scholar
• Hopkins, D. J., & King, G. (2010). A method of automated nonparametric content analysis for social science. American Journal of Political Science, 54(1), 229–247. https://doi.org/10.1111/j.1540-5907.2009.00428.x
   Web of Science ®Google Scholar
• Hu, M., & Liu, B. (2004). Mining opinion features in customer reviews. Proceedings of the 19th National Conference on Artifical Intelligence (pp. 755–760). San Jose, CA, United States: AAAI Press. http://dl.acm.org/citation.cfm?id=1597148.1597269
   Google Scholar
• Hutto, C. J., & Gilbert, E. (2014). VADER: A parsimonious rule-based model for sentiment analysis of social media text. Proceedings of the 8th International AAAI Conference on Weblogs and Social Media (ICWSM-2014) (pp. 216–225), Ann Arbor, Michigan, United States.
   Google Scholar
• Hwang, J., Imai, K., & Tarr, A. (2019). Automated coding of political campaign advertisement videos: An empirical validation study. 2019 Annual Meeting of the Society for Political Methodology (Polmeth xxxvi), Cambridge, MA, United States.
   Google Scholar
• Jockers, M. L. (2015). Extracts sentiment and sentiment-derived plot arcs from text. Cran-R, 1–12. https://cran.r-project.org/web/packages/syuzhet/syuzhet.pdf
   Google Scholar
• Kennedy, A. L. K., & Inkpen, D. I. I. (2006). Sentiment classification of movie reviews using contextual valence shifters. Computational Intelligence, 22(2), 1–23. https://doi.org/10.1111/j.1467-8640.2006.00277.x
   Web of Science ®Google Scholar
• Knox, D., & Lucas, C. (2019). A dynamic model of speech for the social sciences (pp. 1–31). Available at ssrn: https://ssrn.com/abstract=3490753
   Google Scholar
• Kralj Novak, P., Smailović, J., Sluban, B., & Mozetič, I. (2015, December). Sentiment of emojis. PLOS ONE, 10 (12), 1–22. https://doi.org/10.1371/journal.pone.0144296
   Web of Science ®Google Scholar
• Lak, P., & Turetken, O. (2014, January). Star ratings versus sentiment analysis – A comparison of explicit and implicit measures of opinions. 47th Hawaii International Conference on System Sciences (pp. 796–805), Waikoloa, Hawaii, United States.
   Google Scholar
• Laver, M., & Benoit, K. (2002). Locating TDs in policy spaces: The computational text analysis of D´ail speeches. Irish Political Studies, 17(1), 59–73. https://doi.org/10.1080/714003143
   Google Scholar
• Lowe, W., & Benoit, K. (2013). Validating estimates of latent traits from textual data using human judgment as a Benchmark. Political Analysis, 21(3), 298–313. https://doi.org/10.1093/pan/mpt002
   Web of Science ®Google Scholar
• Lupia, A., Soroka, S., & Beatty, A. (2020). What does congress want from the national science foundation? A content analysis of remarks from 1995 to 2018. Science Advances, 6(33), eaaz6300. https://doi.org/10.1126/sciadv.aaz6300
   PubMed Web of Science ®Google Scholar
• Manning, C. D., Ragahvan, P., & Schutze, H. (2009). An introduction to information retrieval. Cambridge University Press.
   Google Scholar
• Meeren, H. K. M., van Heijnsbergen, C. C. R. J., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences, 102(45), 16518–16523. https://doi.org/10.1073/pnas.0507650102
   PubMed Web of Science ®Google Scholar
• Meyer-Gutbrod, J., & Woolley, J. (2020). New conflicts in the briefing room: Using sentiment analysis to evaluate administration-press relations from Clinton through Trump. Political Communication, 1–19. https://doi.org/10.1080/10584609.2020.1763527
   Google Scholar
• Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). distributed representations of words and phrases and their compositionality. In C. J. C. Burges, L. Bottou, M. Welling, Z. Ghahramani, & K. Q. Weinberger (Eds.), Advances in neural information processing systems 26 (pp. 3111–3119). Curran Associates, Inc.
   Google Scholar
• Mikolov, T., Corrado, G., Chen, K., & Dean, J. (2013). Efficient estimation of word representations in vector space. Proceedings of the International Conference on Learning Representations (ICLR 2013), arXiV:1301, 38(3), 1–12. http://arxiv.org/pdf/1301.3781v3.pdf
   Google Scholar
• Mohammad, S. M., & Turney, P. D. (2012). Crowdsourcing a word-emotion association Lexicon. Computational Intelligence, 29(3), 436–465. https://doi.org/10.1111/j.1467-8640.2012.00460.x
   Web of Science ®Google Scholar
• Monroe, B. L., & Schrodt, P. A. (2018). Introduction to the special issue: The statistical analysis of political text. Political Analysis, 16(4), 351–355. https://doi.org/10.1093/pan/mpn017
   Google Scholar
• Oliveira, D. J., Bermejo, P. H., & dos Santos, P. A. (2017). Can social media reveal the preferences of voters? A comparison between sentiment analysis and traditional opinion polls. Journal of Information Technology & Politics, 14(1), 34–45. https://doi.org/10.1080/19331681.2016.1214094
   Web of Science ®Google Scholar
• Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2(1–2), 1–135. https://doi.org/10.1561/1500000011
   Google Scholar
• Pang, B., Lee, L., & Vaithyanathan, S. (2002, July). Thumbs up? sentiment classification using machine learning techniques. Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing (EMNLP 2002) (pp. 79–86). Association for Computational Linguistics, Philadelphia, PA, United States. https://www.aclweb.org/anthology/W02-1011
   Google Scholar
• Pennington, J., Socher, R., & Manning, C. D. (2014, October). Glove: Global vectors for word representation. In Alessandro Moschitti, Bo Pang, & Walter Daelemans (Eds.), Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) (pp. 1532–1543). Association for Computational Linguistics. https://www.aclweb.org/anthology/D14-1162
   Google Scholar
• Proksch, S.-O., Lowe, W., W¨ackerle, J., & Soroka, S. (2019). Multilingual sentiment analysis: A new approach to measuring conflict in legislative speeches. Legislative Studies Quarterly, 44(1), 97–131. https://doi.org/10.1111/lsq.12218
   Web of Science ®Google Scholar
• Proksch, S.-O., & Slapin, J. B. (2015). The politics of parliamentary debate: Parties, rebels, and representation. Cambridge University Press.
   Google Scholar
• Quinn, K. M., Monroe, B. L., Colaresi, M., Crespin, M. H., & Radev, D. R. (2010). How to analyze political attention with minimal assumptions and costs. American Journal of Political Science, 54(1), 209–228. https://doi.org/10.1111/j.1540-5907.2009.00427.x
   Web of Science ®Google Scholar
• Rauh, C., Bes, B. J., & Schoonvelde, M. J. (2020). Undermining, defusing or defending european integration? Assessing public communication of European executives in times of EU politicisation. European Journal of Political Research, 59(2), 397–423. https://doi.org/10.1111/1475-6765.12350
   Web of Science ®Google Scholar
• Rheault, L. (2016). Expressions of anxiety in political texts. Proceedings of 2016 EMNLP Workshop on Natural Language Processing and Computational Social Science (pp. 92–101), Austin, Texas, United States.
   Google Scholar
• Rheault, L., Beelen, K., Cochrane, C., & Hirst, G. (2016). Measuring emotion in parliamentary debates with automated textual analysis. PLoS ONE, 11(12), 1–18. https://doi.org/10.1371/journal.pone.0168843
   Web of Science ®Google Scholar
• Rheault, L., & Cochrane, C. (2020). Word embeddings for the analysis of ideological placement in parliamentary corpora. Political Analysis, 28(1), 1–22. https://doi.org/10.1017/pan.2019.26
   Web of Science ®Google Scholar
• Rice, D. R., & Zorn, C. (2021). Corpus-based dictionaries for sentiment analysis of specialized vocabularies. Political Science Research and Methods, 9(1): 20-35.https://doi.org/10.1017/psrm.2019.10
   Google Scholar
• Rinker, T., Higgins, J., Ward, G., Possel, H., Mechura, M. B., Hu, M., & Malaescu, I. (2019). Lexicon: Lexicons for text analysis. CRAN. https://cran.r-project.org/web/packages/lexicon/lexicon.pdf
   Google Scholar
• Rodman, E. (2020). A timely intervention: Tracking the changing meanings of political concepts with word vectors. Political Analysis, 28(1), 87–111. https://doi.org/10.1017/pan.2019.23
   Web of Science ®Google Scholar
• Ruder, S., Vuli´c, I., & Søgaard, A. (2019). A survey of cross-lingual word embedding models. Journal of Artificial Intelligence Research, 65(2019), 569–631. https://doi.org/10.1613/jair.1.11640
   Web of Science ®Google Scholar
• Russell, J. (1980). A circumplex model of affect. Journal of Personality and Social Psychology, 39(6), 1161–1178. https://doi.org/10.1037/h0077714
   Web of Science ®Google Scholar
• Russell, J., & Barrett, L. (1999). Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. Journal of Personality and Social Psychology, 76(5), 805–819. https://doi.org/10.1037/0022–3514.76.5.805
   PubMed Web of Science ®Google Scholar
• Scherer, K. R., Ladd, D. R., & Silverman, K. E. A. (1984). Vocal cues to speaker affect: Testing two models. The Journal of the Acoustical Society of America, 76(5), 1346–1356. https://doi.org/10.1121/1.391450
   Web of Science ®Google Scholar
• Schlosberg, H. (1954). Three dimensions of emotion. Psychological Review, 61(2), 81–88. https://doi.org/10.1037/h0054570
   PubMed Web of Science ®Google Scholar
• Schwarz, D., Traber, D., & Benoit, K. (2017). Estimating intra-party preferences: Comparing speeches to votes. Political Science Research and Methods, 5(2), 379–396. https://doi.org/10.1017/psrm.2015.77
   Web of Science ®Google Scholar
• Soroka, S., Penner, E., & Blidook, K. (2009). Constituency influence in parliament. Canadian Journal of Political Science, 42(3), 563–591. https://doi.org/10.1017/S0008423909990059
   Web of Science ®Google Scholar
• Soroka, S., Young, L., & Balmas, M. (2015). Bad news or mad news? Sentiment scoring of negativity, fear, and anger in news content. The ANNALS of the American Academy of Political and Social Science, 659(1), 108–121. https://doi.org/10.1177/0002716215569217
   Web of Science ®Google Scholar
• Spirling, A., & Rodriguez, P. (in press). Word embeddings: What works, what doesn’t, and how to tell the difference for applied research. The Journal of Politics. https://doi.org/10.1086/715162
   Google Scholar
• Stockmann, D. (2011). Race to the bottom: Media marketization and increasing negativity toward the United States in China. Political Communication, 28(3), 268–290. https://doi.org/10.1080/10584609.2011.572447
   Web of Science ®Google Scholar
• Tang, D., Wei, F., Yang, N., Zhou, M., Liu, T., & Qin, B. (2014). Learning sentiment-specific word embedding for twitter sentiment classification. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (ACL 2014) (pp. 1555–1565), Baltimore, Maryland, United States.
   Google Scholar
• Turney, P. D. (2002). Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (ACL) (pp. 417–424), Philadelphia, Pennsylvania, United States.
   Google Scholar
• Turney, P. D., & Littman, M. L. (2003). Measuring praise and criticism. ACM Transactions on Information Systems, 21 (4), 315–346. https://dl.acm.org/doi/10.1145/944012.944013
   Web of Science ®Google Scholar
• Turney, P. D., & Pantel, P. (2010). From frequency to meaning: Vector space models of semantics. Journal of Artificial Intelligence Research, 37(2010), 141–188. https://doi.org/10.1613/jair.2934
   Google Scholar
• Van den Stock, J., Righart, R., & de Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487–494. https://doi.org/10.1037/1528-3542.7.3.487
   PubMed Web of Science ®Google Scholar
• Vapnik, V. N. (1998). Statistical learning theory. John Wiley & Sons.
   Google Scholar
• Weber, R., Mangus, J. M., Huskey, R., Hopp, F. R., Amir, O., Swanson, R., Khooshabeh, P., Hahn, L., Tamborini, R., & Gordon, A. (2018). Extracting latent moral information from text narratives: Relevance, challenges, and solutions. Communication Methods and Measures, 12(2–3), 119–139. https://doi.org/10.1080/19312458.2018.1447656
   Web of Science ®Google Scholar
• Wilkerson, J., & Casas, A. (2017). Large-scale computerized text analysis in political science: Opportunities and challenges. Annual Review of Political Science, 20(1), 529–544. https://doi.org/10.1146/annurev-polisci-052615-025542
   Web of Science ®Google Scholar
• Winston, P. H. (2014). Lecture 16: Learning support vector machines. MIT OpenCourseWare. https://www.youtube.com/watch?v=PwhiWxHK8o
   Google Scholar
• Wittgenstein, L. (2009). Philosophical investigations (4th ed.). Blackwell Publishing.
   Google Scholar
• Wlezien, C., & Soroka, S. (2019). Mass media and electoral preferences during the 2016 US presidential race. Political Behavior, 41(4), 945–970. https://doi.org/10.1007/s11109-018-9478-0
   Web of Science ®Google Scholar
• Yarchi, M., Baden, C., & Kligler-Vilenchik, N. (2020). Political polarization on the digital sphere: A cross-platform, over-time analysis of interactional, positional, and affective polarization on social media. Political Communication, 38(1-2), 98–139. https://doi.org/10.1080/10584609.2020.1785067
   Google Scholar
• Young, L., & Soroka, S. (2012). Affective news: The automated coding of sentiment in political texts. Political Communication, 29(2), 205–231. https://doi.org/10.1080/10584609.2012.671234
   Web of Science ®Google Scholar
• Zavattaro, S. M., French, P. E., & Mohanty, S. D. (2015). A sentiment analysis of U.S. local government tweets: The connection between tone and citizen involvement. Government Information Quarterly, 32(3), 333–341. https://doi.org/10.1016/j.giq.2015.03.003
   Web of Science ®Google Scholar
• Zhang, L., & Liu, B. (2017). Sentiment analysis and opinion mining. In C. Sammut & G. I. Webb (Eds.), Encyclopedia of machine learning and data mining (pp. 1152–1161). Springer US. https://doi.org/10.1007/978-1-4899-7687-1907
   Google Scholar