491
Views
1
CrossRef citations to date
0
Altmetric
Articles

A community resilience linguistic framework for risk assessment: using second order moral foundations and emotion on social media

, &
Pages 269-286 | Received 30 Jul 2021, Accepted 17 Jul 2022, Published online: 18 Aug 2022

References

  • Alizadeh, M., Weber, I., Cioffi-Revilla, C., Fortunato, S., & Macy, M. (2019). Psychology and morality of extremists: Evidence from Twitter language analysis of alt-right and Antifa. EPJ Data Science, 8(17), 1–35. doi:10.1140/epjds/s13688-019-0193-9
  • Allport, G. W. (1954). The nature of prejudice. Cambridge, MA: Perseus Books Publishers.
  • Asker, D., & Dinas, E. (2019). Thinking fast and furious: Emotional intensity and opinion polarization in online media. Public Opinion Quarterly, 83(3), 487–509.
  • Baldino, D. (2021). ASIO, sticky ideologies, and anti-government movements. Australian Institute of International Affairs. Retrieved June 29, 2021, from https://www.internationalaffairs.org.au/australianoutlook/asio-sticky-ideologies-and-anti-government-movements/
  • Beckett, L. (2021, March 4). The misogynist incel movement is spreading. Should it be classified as a terror threat? The Guardian. Retrieved March 19, 2021, from https://www.theguardian.com/lifeandstyle/2021/mar/03/incel-movement-terror-threat-canada
  • Berger, J. M. (2018). Extremism. MIT Press. doi:10.7551/mitpress/11688.001.0001
  • Brady, W. J., Wills, J. A., Jost, J. T., Tucker, J. A., & Van Bavel, J. J. (2017). Emotion shapes the diffusion of moralized content in social networks. Proceedings of the National Academy of Science, 114(28), 7313–7318.
  • Brehm, J. W. (1999). The intensity of emotion. Personality and Social Psychology Review, 3(1), 2–22.
  • Brewer, M. B. (2003). Optimal distinctiveness, social identity, and the self.
  • Bruns, A. (2017, September). Echo chamber? What echo chamber? Reviewing the evidence. Sixth Biennial Future of Journalism Conference (FOJ17).
  • Bruns, A., Angus, D., Graham, T., & Keller, T. R. (2020, March 18). When a virus goes viral: pros and cons to the coronavirus spread on social media. The Conversation. Retrieved January 10, 2022, from https://theconversation.com/when-a-virus-goes-viral-pros-and-cons-to-the-coronavirus-spread-on-social-media-133525
  • Buder, J., Rabl, L., Feiks, M., Badermann, M., & Zurstiege, G. (2021). Does negatively toned language use on social media lead to attitude polarization? Computers in Human Behavior, 116, 106663.
  • Burgess, M. (2021, March 17). Director-General’s Annual Threat Assessment 2021, Australian Security Intelligence Organisation.
  • Christakis, N. A., & Fowler, J. H. (2009). Connected: The surprising power of our social networks and how they shape our lives. New York: Little, Brown and Company.
  • Cockerill, M. (2019). Convergence on common ground: MRAs, memes and transcultural contexts of digital misogyny. In Debbie Ging & Eugenia Siapera (Eds.), Gender hate online (pp. 87–110). Cham: Palgrave Macmillan.
  • Cole Wright, J., Cullum, J., & Schwab, N. (2008). The cognitive and affective dimensions of moral conviction: Implications for attitudinal and behavioral measures of interpersonal tolerance. Personality and Social Psychology Bulletin, 34(11), 1461–1476.
  • Conway, M., Scrivens, R., & McNair, L. (2019). Right-wing extremists’ persistent online presence: history and contemporary trends.
  • Crothers, C., & O’Brien, T. (2020). The contexts of the Christchurch terror attacks: Social science perspectives.
  • Davies, C. L., Sibley, C. G., & Liu, J. H. (2014). Confirmatory factor analysis of the Moral Foundations Questionnaire. Social Psychology, 45(6), 431.
  • Del Vicario, M., Vivaldo, G., Bessi, A., Zollo, F., Scala, A., Caldarelli, G., & Quattrociocchi, W. (2016). Echo chambers: Emotional contagion and group polarization on Facebook. Scientific Reports, 6(1), 1–12.
  • Dudenhoefer, A.-L., Niesse, C., Görgen, T., Tampe, L., Megler, M., Gröpler, C., & Bondü, R. (2021). Leaking in terrorist attacks: A review. Aggression and Violent Behavior, 58, 101582.
  • Durkheim, E. (1973). Emile Durkheim on morality and society. Chicago, IL: University of Chicago Press.
  • Feldman, R. (2012). Oxytocin and social affiliation in humans. Hormones and Behavior, 61(3), 380–391.
  • Floridi, L. (2014). The fourth revolution: How the infosphere is reshaping human reality. OUP Oxford.
  • Fiske, S. T., Gilbert, D. T., & Lindzey, G. (2004). Handbook of social psychology. John Wiley & Sons, Inc.
  • Fowler, J. H., & Christakis, N. A. (2008). Dynamic spread of happiness in a large social network: Longitudinal analysis over 20 years in the Framingham Heart Study. BMJ, 337, a2338.
  • Frimer, J. A., Boghrati, R., Haidt, J., Graham, J., & Dehgani, M. (2019a). Moral Foundations Dictionary for Linguistic Analyses 2.0. Unpublished manuscript. Retrieved from https://osf.io/ezn37/
  • Frimer, J. A., Brandt, M. J., Melton, Z., & Motyl, M. (2019b). Extremists on the left and right use angry, negative language. Personality and Social Psychology Bulletin, 45(8), 1216–1231. doi:10.1177/0146167218809705
  • Gilbert, E., Bergstrom, T., & Karahalios, K. (2009, January). Blogs are echo chambers: Blogs are echo chambers. In 2009 42nd Hawaii International Conference on System Sciences (pp. 1–10). Waikoloa, Hawaii: IEEE.
  • Goto, N., & Schaefer, A. (2020). Emotional intensity. In Virgil Zeigler-Hill & Todd K. Shackelford (Eds.), Encyclopedia of personality and individual differences (pp. 1311–1319). Denmark: Springer.
  • Graham, J., Haidt, J., & Nosek, B. A. (2009). Liberals and conservatives rely on different sets of moral foundations. Journal of Personality and Social Psychology, 96(5), 1029.
  • Graham, J., Nosek, B. A., Haidt, J., Iyer, R., Koleva, S., & Ditto, P. H. (2011). Mapping the moral domain. Journal of Personality and Social Psychology, 101(2), 366.
  • Haidt, J. (2001). The emotional dog and its rational tail: A social intuitionist approach to moral judgment. Psychological Review, 108, 814–834.
  • Haidt, J. (2003). The moral emotions. In R. J. Davidson, K. R. Scherer, & H. H. Goldsmith (Eds.), Handbook of affective sciences (pp. 852–870). Oxford: Oxford University Press.
  • Haidt, J., & Joseph, C. (2004). Intuitive ethics: How innately prepared intuitions generate culturally variable virtues. Daedalus, 133(4), 55–66. In S. T. Fiske, D. T. Gilbert, & G. Lindzey (Eds.), Handbook of social psychology (pp. 797–832). John Wiley & Sons, Inc. doi:10.1002/9780470561119.socpsy002022
  • Harris-Hogan, S. (2020). How to evaluate a program working with terrorists? Understanding Australia’s countering violent extremism early intervention program. Journal of Policing, Intelligence and Counter Terrorism, 15(2), 97–116.
  • Herzog-Evans, M. (2018). A comparison of two structured professional judgment tools for violent extremism and their relevance in the French context. European Journal of Probation, 10(1), 3–27.
  • Hess, U., & Fischer, A. (2013). Emotional mimicry as social regulation. Personality and Social Psychology Review, 17, 142–157.
  • Hoffman, B., Ware, J., & Shapiro, E. (2020). Assessing the threat of incel violence. Studies in Conflict & Terrorism, 43(7), 565–587.
  • Horberg, E. J., Oveis, C., & Keltner, D. (2011). Emotions as moral amplifiers: An appraisal tendency approach to the influences of distinct emotions upon moral judgment. Emotion Review, 3(3), 237–244.
  • Horta Ribeiro, M., Blackburn, J., Bradlyn, B., De Cristofaro, E., Stringhini, G., Long, S., … Zannettou, S. (2020). The evolution of the Manosphere across the web. arXiv preprint arXiv:2001.07600.
  • Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert scale: Explored and explained. British Journal of Applied Science & Technology, 7(4), 396–403.
  • Kaati, L., Shrestha, A., & Cohen, K. (2016). Linguistic analysis of lone offender manifestos. In 2016 IEEE International Conference on CyberCrime and Computer Forensics (ICCCF). doi:10.1109/icccf.2016.7740427
  • Knapp, A., & Wright, V. (2006). The government and politics of France. London: Routledge.
  • Koch, A., Yzerbyt, V., Abele, A., Ellemers, N., & Fiske, S. T. (2021). Social evaluation: Comparing models across interpersonal, intragroup, intergroup, several-group, and many-group contexts. Advances in Experimental Social Psychology, 63, 1–68.
  • Kohlberg, L. (1969). Stage and sequence: The cognitive-developmental approach to socialization. In D. A. Goslin (Ed.), Handbook of socialization: Theory and research (pp. 347–480). Chicago: RandMcNally.
  • Kramer, A. D., Guillory, J. E., & Hancock, J. T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences, 111, 8788–8790.
  • Kupper, J., & Meloy, J. R. (2021). TRAP-18 indicators validated through the forensic linguistic analysis of targeted violence manifestos. Journal of Threat Assessment and Management, doi:10.1037/tam0000165
  • Lazer, D. M., Pentland, A., Watts, D. J., Aral, S., Athey, S., Contractor, N., … Wagner, C. (2020). Computational social science: Obstacles and opportunities. Science, 369(6507), 1060–1062.
  • Leslie, S., & Kernot, D. (2021). The threat from the right: Linguistic analysis of the ideological spectrum. Joint and Operations Analysis Division, Defence Science and Technology Group.
  • Lipsitz, K. (2018). Playing with emotions: The effect of moral appeals in elite rhetoric. Political Behavior, 40(1), 57–78.
  • Lloyd, M., & Dean, C. (2015). The development of structured guidelines for assessing risk in extremist offenders. Journal of Threat Assessment and Management, 2(1), 40–52.
  • Logan, C., & Lloyd, M. (2019). Violent extremism: A comparison of approaches to assessing and managing risk. Legal and Criminological Psychology, 24(1), 141–161.
  • Louis, W. R., Lizzio-Wilson, M., Cibich, M., McGarty, C., Thomas, E. F., Amiot, C. E., … Moghaddam, F. (2022). Failure leads protest movements to support more radical tactics. Social Psychological and Personality Science, 13(3), 675–687.
  • Matsumoto, D., Frank, M. G., & Hwang, H. C. (2015). The role of intergroup emotions in political violence. Aps, 24(5), 369–373. doi:10.1177/0963721415595023
  • Matsumoto, D., Hwang, H. C., & Frank, M. G. (2017). Emotion and aggressive intergroup cognitions: The ANCODI hypothesis. Aggressive Behavior, 43(1), 93–107. doi:10.1002/ab.21666
  • McPherson, M., Smith-Lovin, L., & Cook, J. M. (2001). Birds of a feather: Homophily in social networks. Annual Review of Sociology, 415–444.
  • Meloy, J. R., & Gill, P. (2016). The lone-actor terrorist and the TRAP-18. Journal of Threat Assessment and Management, 3(1), 37–52.
  • Meloy, J. R., & O'toole, M. E. (2011). The concept of leakage in threat assessment. Behavioral Sciences & The Law, 29(4), 513–527.
  • Mill, J. S. (1848). Principles of political economy. Boston: D. Appleton.
  • Mitts, T. (2019). From isolation to radicalization: Anti-Muslim hostility and support for ISIS in the west. American Political Science Review, 113(1), 173–194.
  • Mohammad, S. M. (2018, May). Word affect intensities. Proceedings of the 11th Edition of the Language Resources and Evaluation (LREC) Conference, Miyazaki, Japan. arXiv:1704.08798
  • Mooijman, M., Hoover, J., Lin, Y., Ji, H., & Dehghani, M. (2018). Moralization in social networks and the emergence of violence during protests. Nature Human Behaviour, 2(6), 389–396.
  • Monahan, J. (2012). The individual risk assessment of terrorism. Psychology, Public Policy, and Law, 18(2), 167–205.
  • Monahan, J. (2015). The individual risk assessment of terrorism: Recent developments. (Public Law and Legal Theory Research Paper Series – 57 September). VA: University of Virginia School of Law.
  • Mullen, E., & Skitka, L. J. (2006). Exploring the psychological underpinnings of the moral mandate effect: Motivated reasoning, group differentiation, or anger? Journal of Personality and Social Psychology, 90, 629–643.
  • Napier, J. L., & Luguri, J. B. (2013). Moral mind-sets: Abstract thinking increases a preference for “individualizing” over “binding” moral foundations. Social Psychological and Personality Science, 4(6), 754–759. doi:10.1177/1948550612473783
  • Powis, B., Randhawa, K., & Bishopp, D. (2019). The structural properties of the extremism risk guidelines (ERG22+): A structured formulation tool for extremist offenders. Ministry of Justice, HM Government.
  • Pressman, D. E., & Flockton, J. (2010). Risk assessment decisions for violent political extremism. Consultative Version 2. Unpublished manuscript.
  • Rathje, S., Van Bavel, J. J., & van der Linden, S. (2021). Out-group animosity drives engagement on social media. Proceedings of the National Academy of Sciences of the United States of America, 118(26), 1–9.
  • Rev. (2021). FBI Director Christopher Wray testified before the Senate on March 2, 2021 on the January 6 riot at the US Capitol and domestic terrorism. Retrieved June 29, 2021. FBI Director Christopher Wray Testifies on Capitol Attack, Domestic Terrorism Full Hearing Transcript March 2 – Rev.
  • Rozin, P., Lowery, L., Imada, S., & Haidt, J. (1999). The CAD triad hypothesis: A mapping between three moral emotions (contempt, anger, disgust) and three moral codes (community, autonomy, divinity). Journal of Personality and Social Psychology, 76, 574–586.
  • RTI International. (2018). Countering violent extremism: The application of risk assessment tools in the criminal justice and rehabilitation process. Literature Review. https://www.dhs.gov/sites/default/files/publications/OPSR_TP_CVE-Application-Risk-Assessment-Tools-Criminal-Rehab-Process_2018Feb-508.Pdf
  • Salojärvi, E., Rantanen, M., Nieminen, E., Juote, A., & Hanhela, H. (2020). The ‘Incel’ phenomenon in the digital era–how echo chambers have fueled the Incel movement.
  • Schuurman, B., Lindekilde, L., Malthaner, S., O'Connor, F., Gill, P., & Bouhana, N. (2019). End of the lone wolf: The typology that should not have been. Studies in Conflict & Terrorism, 42(8), 771–778.
  • Seyle, D. C. (2007). Identity fusion and the psychology of political extremism (Doctoral dissertation). University of Texas. Retrieved from https://repositories.lib.utexas.edu/bitstream/handle/2152/3027/seyled55689.pdf?sequence=2
  • Shaikh, S. (2019). Understanding the neurobiological processing of violent extremists. Digital Frontiers. Retrieved from https://www.orfonline.org/expert-speak/understanding-neurobiological-processing-violent-extremists-54179/
  • Shweder, R. A., Mahapatra, M., & Miller, J. G. (1987). Culture and moral development. In James W. Stigler, Richard A. Shweder, & Gilbert Herdt (Eds.) The emergence of morality in young children (pp. 1–83). Chicago, London: Uiversity of Chicago Press.
  • Skitka, L. J., Bauman, C. W., & Sargis, E. G. (2005). Moral conviction: Another contributor to attitude strength or something more? Journal of Personality and Social Psychology, 88, 895–917.
  • Skitka, L. J., & Wisneski, D. C. (2011). Moral conviction and emotion. Emotion Review, 3(3), 328–330. doi:10.1177/1754073911402374
  • Social, W. A. (2020). Digital in 2020. Recuperado de: https://wearesocial.com/digital-2020
  • Sowell, T. (2012). Intellectuals and society. London: Hachette UK.
  • Steiger, R. L., & Reyna, C. (2017). Trait contempt, anger, disgust, and moral foundation values. Personality and Individual Differences, 113, 125–135. doi:10.1016/j.paid.2017.02.071
  • Swann, W. B., Gómez, A., Seyle, D. C., Morales, J., & Huici, C. (2009). Identity fusion: The interplay of personal and social identities in extreme group behavior. Journal of Personality and Social Psychology, 96(5), 995–1011. doi:10.1037/a0013668
  • Wheatley, T., & Haidt, J. (2005). Hypnotic disgust makes moral judgments more severe. Psychological Science, 16, 780–784.
  • White, K. (2012). Identifying the antecedents of moral conviction (Doctoral dissertation, University of Texas at El Paso). Retrieved from https://digitalcommons.utep.edu/open_etd/2216
  • Wollebæk, D., Karlsen, R., Steen-Johnsen, K., & Enjolras, B. (2019). Anger, fear, and echo chambers: The emotional basis for online behavior. Social Media+ Society, 5(2), 2056305119829859.
  • Wray, C. (2021). Oversight of the Federal Bureau of Investigation: The January 6 Insurrection, Domestic Terrorism, and Other Threats. Federal Bureau of Investigation, United States Government. Testimony — FBI.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.