“The Boundaries are Blurry…”: How Comment Moderators in Germany See and Respond to Hate Comments

References

• Bahador, B., and D. Kerchner. 2019. Monitoring Hate Speech in the US Media. Working Paper. https://mediapeaceproject.smpa.gwu.edu/report/.
   Google Scholar
• Bakker, P. 2014. “Mr. Gates Returns. Curation, Community Management and Other New Roles for Journalists.” Journalism Studies 15 (5): 596–606. doi:https://doi.org/10.1080/1461670X.2014.901783.
   Web of Science ®Google Scholar
• Binns, A. 2017. “Fair Game? Journalists’ Experiences of Online Abuse.” Journal of Applied Journalism & Media Studies 6 (2): 183–206. doi:https://doi.org/10.1386/ajms.6.2.183_1.
   Web of Science ®Google Scholar
• Bliuc, A.-M., N. Faulkner, A. Jakubowicz, and C. McGarty. 2018. “Online Networks of Racial Hate: A Systematic Review of 10 Years of Research on Cyber-Racism.” Computers in Human Behavior 87: 75–86. doi:https://doi.org/10.1016/j.chb.2018.05.026.
   Web of Science ®Google Scholar
• Boberg, S., T. Schatto-Eckrodt, L. Frischlich, and T. Quandt. 2018. “The Moral Gatekeeper? Moderation and Deletion of User-Generated Content in a Leading News Forum.” Media and Communication 6 (4): 58–69. doi:https://doi.org/10.17645/mac.v6i4.1493.
   Web of Science ®Google Scholar
• Braun, J., and T. Gillespie. 2011. “Hosting the Public Discource, Hosting the Public. When Online News and Social Media Converge.” Journalism Practice 5 (4): 383–398. doi:https://doi.org/10.1080/17512786.2011.557560.
   Google Scholar
• Brown, A. 2017. “What is Hate Speech? Part 1: The Myth of Hate.” Law and Philosophy 36 (4): 419–468. doi:https://doi.org/10.1007/s10982-017-9297-1.
   Web of Science ®Google Scholar
• Brugger, W. 2003a. “The Treatment of Hate Speech in German Constitutional Law (Part I).” German Law Journal 4 (1): 1–22. doi:https://doi.org/10.1017/S2071832200015716.
   Google Scholar
• Brugger, W. 2003b. “The Treatment of Hate Speech in German Constitutional Law (Part II).” German Law Journal 4 (1): 23–44. doi:https://doi.org/10.1017/S2071832200015728.
   Google Scholar
• Chen, G. M., A. Muddiman, T. Wilner, E. Pariser, and N. J. Stroud. 2019. “We Should Not Get Rid of Incivility Online.” Social Media + Society 5 (3): 1–5. doi:https://doi.org/10.1177/2056305119862641.
   Web of Science ®Google Scholar
• Chen, G. M., and P. Pain. 2017. “Normalizing Online Comments.” Journalism Practice 11 (7): 876–892. doi:https://doi.org/10.1080/17512786.2016.1205954.
   Web of Science ®Google Scholar
• Chen, G. M., P. Pain, V. Y. Chen, M. Mekelburg, N. Springer, and F. Troger. 2020. “‘You Really Have to Have a Thick Skin’: A Cross-Cultural Perspective on How Online Harassment Influences Female Journalists.” Journalism 21 (5): 877–895. doi:https://doi.org/10.1177/1464884918768500.
   Google Scholar
• Coe, K., K. Kenski, and S. A. Rains. 2014. “Online and Uncivil? Patterns and Determinants of Incivility in Newspaper Website Comments.” Journal of Communication 64 (4): 658–679. doi:https://doi.org/10.1111/jcom.12104.
   Web of Science ®Google Scholar
• Domingo, D. 2011. “Managing Audience Participation. Practices, Workflows and Strategies.” In Participatory Journalism: Guarding Open Gates at Online Newspapers, edited by J. B. Singer, D. Domingo, A. Heinonen, A. Hermida, S. Paulussen, T. Quandt, Z. Reich, and M. Vujnovic, 76–95. Oxford: Wiley-Blackwell.
   Google Scholar
• Ferrucci, P., and J. Wolfgang. 2021. “Inside Or Out? Perceptions of How Differing Types of Comment Moderation Impact Practice.” Journalism Studies 22 (8): 1010–1027. doi:https://doi.org/10.1080/1461670X.2021.1913628.
   Web of Science ®Google Scholar
• Fortuna, P., and S. Nunes. 2018. “A Survey on Automatic Detection of Hate Speech in Text.” ACM Computing Surveys 51 (4): 1–30. doi:https://doi.org/10.1145/3232676.
   Web of Science ®Google Scholar
• Frischlich, L., S. Boberg, and T. Quandt. 2019. “Comment Sections as Tagrets of Dark Participation? Journalists’ Evaluation and Moderation of Deviant User Comments.” Journalism Studies 20 (14): 2014–2033. doi:https://doi.org/10.1080/1461670X.2018.1556320.
   Web of Science ®Google Scholar
• German Press Council. 2017. “German Press Code. Guidelines for Journalistic Work as Recommended by the German Press Council – Complaints Procedure.” https://www.presserat.de/en.html?file=files/presserat/dokumente/download/Press%20Code.pdf.
   Google Scholar
• Harlow, S. 2015. “Story-Chatterers Stirring Up Hate: Racist Discourse in Reader Comments on U.S. Newspaper Websites.” Howard Journal of Communications 26 (1): 21–42. doi:https://doi.org/10.1080/10646175.2014.984795.
   Web of Science ®Google Scholar
• Hinterleitner, G. 2020. Weit mehr als eine nerdige Idee: Wie DER STANDARD vor 25 Jahren ins Internet fand [Much More Than Just a Nerdy Idea: How DER STANDARD Found Its Way Into the Internet 25 Years Ago]. https://www.derstandard.de/story/2000114009456/weit-mehr-als-eine-nerdige-ideewie-der-standard-vor-25.
   Google Scholar
• Hosseini, H., S. Kannan, B. Zhang, and R. Poovendran. 2017. “Deceiving Google’s Perspective API built for detecting toxic comments.” https://arxiv.org/abs/1702.08138.
   Google Scholar
• Jigsaw. 2021. “Perspective: What If Technology Could Help Improve Conversations Online?” https://www.perspectiveapi.com.
   Google Scholar
• Keipi, T., M. Näsi, A. Oksanen, and P. Räsänen. 2017. Online Hate and Harmful Content. Cross-National Perspectives. London: Routledge.
   Google Scholar
• Loosen, W., and J.-H. Schmidt. 2012. “(Re-)Discovering the Audience: The Relationship Between Journalism and Audience in Networked Digital Media.” Information, Communication & Society 15 (6): 867–887. doi:https://doi.org/10.1080/1369118X.2012.665467.
   Web of Science ®Google Scholar
• Matsuda, M. J. 1989. “Public Response to Racist Speech: Considering the Victim’s Story.” Michigan Law Review 87 (8): 2320–2381. doi:https://doi.org/10.2307/1289306.
   Web of Science ®Google Scholar
• Muddiman, A., and N. J. Stroud. 2017. “News Values, Cognitive Biases, and Partisan Incivility in Comment Sections.” Journal of Communication 67 (4): 586–609. doi:https://doi.org/10.1111/jcom.12312.
   Web of Science ®Google Scholar
• Paasch-Colberg, S., C. Strippel, L. Laugwitz, M. Emmer, and J. Trebbe. 2020. “Moderationsfaktoren: ein Ansatz zur Analyse von Selektionsentscheidungen im Community Management.” [Moderation Factors: An Approach to the Analysis of Selection Decisions in Community Management]. In Integration durch Kommunikation. Jahrbuch der Deutschen Gesellschaft für Publizistik- und Kommunikationswissenschaft 2019, edited by V. Gehrau, A. Waldherr, and A. Scholl, 109–119. doi:https://doi.org/10.21241/ssoar.67858.
   Google Scholar
• Papacharissi, Z. 2004. “Democracy Online: Civility, Politeness, and the Democratic Potential of Online Political Discussion Groups.” New Media & Society 6 (2): 259–283. doi:https://doi.org/10.1177/1461444804041444.
   Web of Science ®Google Scholar
• Parekh, B. 2006. “Hate Speech: Is There a Case for Banning?” Public Policy Research 12 (4): 213–223. doi:https://doi.org/10.1017/CBO9781139042871.006.
   Google Scholar
• Pöyhtäri, R. 2014. “Limits of Hate Speech and Freedom of Speech on Moderated News Websites in Finland, Sweden, The Netherlands and the UK.” Annales. Series historia et sociologia Izhaja Štirikrat Letno 24 (3): 513–524.
   Google Scholar
• Quandt, T. 2018. “Dark Participation.” Media and Communication 6 (4): 36–48. doi:https://doi.org/10.17645/mac.v6i4.1519.
   Web of Science ®Google Scholar
• Reich, Z. 2011. “User Comments: The Transformation of Participatory Space.” In Participatory Journalism: Guarding Open Gates at Online Newspapers, edited by J. B. Singer, D. Domingo, A. Heinonen, A. Hermida, S. Paulussen, T. Quandt, Z. Reich, and M. Vujnovic, 96–117. Oxford: Wiley-Blackwell.
   Google Scholar
• Ross, B., M. Rist, G. Carbonell, B. Cabrera, N. Kurowsky, and M. Wojatzki. 2016. “Measuring the Reliability of Hate Speech Annotations: The Case of the European Refugee Crisis.” Proceedings of NLP4CMC III: 3rd Workshop on Natural Language Processing for Computer-Mediated Communication (Bochum), 6–9. doi:https://doi.org/10.17185/duepublico/42132.
   Google Scholar
• Saleem, H. M., K. P. Dillon, S. Benesch, and D. Ruths. 2017. “A Web of Hate: Tackling Hateful Speech in Online Social Spaces.” https://arxiv.org/abs/1709.10159.
   Google Scholar
• Schreier, M. 2014. “Qualitative Content Analysis.” In The SAGE Handbook of Qualitative Data Analysis, edited by U. Flick, 1–19. Sage.
   Google Scholar
• Schulz, W., T. Held, S. Dreyer, and T. Wind. 2008. “Regulation of Broadcasting and Internet Services in Germany: A Brief Overview.” doi:https://doi.org/10.21241/ssoar.71697.
   Google Scholar
• Sellars, A. F. 2016. Defining Hate Speech. Research Publication No. 2016–20. Berkman Klein Center. doi:https://doi.org/10.2139/ssrn.2882244.
   Google Scholar
• Shoemaker, P., and S. Reese. 2014. Mediating the Message in the 21st Century. A Media Sociology Perspective. 3rd ed. Routledge.
   Google Scholar
• Springer, N., I. Engelmann, and C. Pfaffinger. 2015. “User Comments: Motives and Inhibitors to Write and Read.” Information, Communication & Society 18 (7): 798–815. doi:https://doi.org/10.1080/1369118X.2014.997268.
   Web of Science ®Google Scholar
• Strippel, C., S. Paasch-Colberg, M. Emmer, and J. Trebbe. 2021. “Guidance: User Comments and Hate Speech. Expert Interviews With Comment Moderators of German-Language Online News Services.” https://osf.io/6uwyh/.
   Google Scholar
• Stryker, R., B. A. Conway, and J. T. Danielson. 2016. “What is Political Incivility?” Communication Monographs 83 (4): 535–556. doi:https://doi.org/10.1080/03637751.2016.1201207.
   Web of Science ®Google Scholar
• Su, L. Y.-F., M. A. Xenos, K. M. Rose, C. Wirz, D. A. Scheufele, and D. Brossard. 2018. “Uncivil and Personal? Comparing Patterns of Incivility in Comments on the Facebook Pages of News Outlets.” New Media & Society 20 (10): 3678–3699. doi:https://doi.org/10.1177/1461444818757205.
   Web of Science ®Google Scholar
• Tworek, H., and P. Leerssen. 2019. An Analysis of Germany’s NetzDG Law. Working Paper. https://cdn.annenbergpublicpolicycenter.org/wp-content/uploads/2020/06/NetzDG_TWG_Tworek_April_2019.pdf.
   Google Scholar
• United Nations. 2020. “United Nations Strategy and Plan of Action on Hate Speech.” https://www.un.org/en/genocideprevention/documents/UN%20Strategy%20and%20PoA%20on%20Hate%20Speech_Guidance%20on%20Addressing%20in%20field.pdf.
   Google Scholar
• van Aken, B., J. Risch, R. Krestel, and A. Löser. 2018. “Challenges for Toxic Comment Classification: An In-Depth Error Analysis.” Paper Presented at the Proceedings of the 2nd Workshop on Abusive Language Online (ALW2). https://arxiv.org/abs/1809.07572.
   Google Scholar
• Wintterlin, F., T. Schatto-Eckrodt, L. Frischlich, S. Boberg, and T. Quandt. 2020. “How to Cope With Dark Participation: Moderation Practices in German Newsrooms.” Digital Journalism 8: 904–924. doi:https://doi.org/10.1080/21670811.2020.1797519.
   Web of Science ®Google Scholar
• Xiang, G., B. Fan, L. Wang, J. I. Hong, and C. P. Rose. 2012. “Detecting Offensive Tweets via Topical Feature Discovery Over a Large Scale Twitter Corpus.” CIKM ‘12 – Proceedings of the 21st ACM International Conference on Information and Knowledge Management, 1980–1984. doi:https://doi.org/10.1145/2396761.2398556.
   Google Scholar
• Ziegele, M. 2016. Nutzerkommentare als Anschlusskommunikation. Theorie und qualitative Analyse des Diskussionswerts von Online-Nachrichten. Wiesbaden: Springer VS.
   Google Scholar
• Ziegele, M., and P. B. Jost. 2020. “Not Funny? The Effects of Factual Versus Sarcastic Journalistic Responses to Uncivil User Comments.” Communication Research 47 (6): 891–920. doi:https://doi.org/10.1177/0093650216671854.
   Web of Science ®Google Scholar
• Ziegele, M., P. Jost, M. Bormann, and D. Heinbach. 2018. “Journalistic Counter-Voices in Comment Sections: Patterns, Determinants, and Potential Consequences of Interactive Moderation of Uncivil User Comments.” Studies in Communication and Media 7 (4): 525–554. doi:https://doi.org/10.5771/2192-4007-2018-4-525.
   Google Scholar
• Ziegele, M., M. Weber, O. Quiring, and T. Breiner. 2018. “The Dynamics of Online News Discussions: Effects of News Articles and Reader Comments on Users’ Involvement, Willingness to Participate, and the Civility of Their Contributions.” Information, Communication & Society 21 (10): 1419–1435. doi:https://doi.org/10.1080/1369118X.2017.1324505.
   Web of Science ®Google Scholar