Is Automated Journalistic Writing Less Biased? An Experimental Test of Auto-Written and Human-Written News Stories

References

• Anderson, Christopher W. 2013a. “Towards a Sociology of Computational and Algorithmic Journalism.” New Media & Society 15 (7): 1005–1021.
   Web of Science ®Google Scholar
• Anderson, Christopher W. 2013b. “What Aggregators do: Towards a Networked Concept of Journalistic Expertise in the Digital age.” Journalism 14 (8): 1008–1023.
   Web of Science ®Google Scholar
• Anderson, Christopher William. 2018. Apostles of Certainty: Data Journalism and the Politics of Doubt. Oxford: Oxford University Press.
   Google Scholar
• Appelman, Alyssa, and S. Shyam Sundar. 2016. “Measuring Message Credibility: Construction and Validation of an Exclusive Scale.” Journalism and Mass Communication Quarterly 93 (1): 59–79.
   Web of Science ®Google Scholar
• Austin, Erica Weintraub, and Qingwen Dong. 1994. “Source v. Content Effects on Judgments of News Believability.” Journalism & Mass Communication Quarterly 71 (4): 973–983.
   Web of Science ®Google Scholar
• Barnhurst, Kevin G., and John Nerone. 2002. The Form of News: A History. New York, NY: Guilford Press.
   Google Scholar
• Barrat, James. 2013. Our Final Invention: Artificial Intelligence and the end of the Human era. London: Macmillan.
   Google Scholar
• Bentler, Peter M. 1990. “Comparative fit Indexes in Structural Models.” Psychological Bulletin 107 (2): 238.
   PubMed Web of Science ®Google Scholar
• Broussard, Meredith. 2015. “Artificial Intelligence for Investigative Reporting: Using an Expert System to Enhance Journalists’ Ability to Discover Original Public Affairs Stories.” Digital Journalism 3 (6): 814–831.
   Web of Science ®Google Scholar
• Bryant, Jennings, and Mary Beth Oliver. 2009. Media Effects: Advances in Theory and Research. Abingdon: Routledge.
   Google Scholar
• Bucy, Erik P. 2003. “Media Credibility Reconsidered: Synergy Effects Between on-air and Online News.” Journalism & Mass Communication Quarterly 80 (2): 247–264.
   Web of Science ®Google Scholar
• Carlson, Matt. 2015. “The Robotic Reporter: Automated Journalism and the Redefinition of Labor, Compositional Forms, and Journalistic Authority.” Digital Journalism 3 (3): 416–431.
   Web of Science ®Google Scholar
• Carlson, Matt. 2017. Journalistic Authority: Legitimating News in the Digital Era. New York, NY: Columbia University Press.
   Google Scholar
• Carlson, Matt. 2018. “Automating Judgment? Algorithmic Judgment, News Knowledge, and Journalistic Professionalism.” New Media & Society 20 (5): 1755–1772.
   Web of Science ®Google Scholar
• Caswell, David, and Konstantin Dörr. 2017. “Automated Journalism 2.0: Event-Driven Narratives: From Simple Descriptions to Real Stories.” Journalism Practice 12 (4): 477–496.
   Web of Science ®Google Scholar
• Cleary, Johanna, and Meredith Cochie. 2011. “Core Skill set Remains Same in Newspaper job ads.” Newspaper Research Journal 32 (4): 68–82.
   Google Scholar
• Clerwall, Christer. 2014. “Enter the Robot Journalist: Users’ Perceptions of Automated Content.” Journalism Practice 8 (5): 519–531.
   Google Scholar
• Delia, Jesse G. 1976. “A Constructivist Analysis of the Concept of Credibility.” Quarterly Journal of Speech 62 (4): 361–375.
   Web of Science ®Google Scholar
• DellaVigna, Stefano, and Ethan Kaplan. 2007. “The Fox News Effect: Media Bias and Voting.” The Quarterly Journal of Economics 122 (3): 1187–1234.
   Web of Science ®Google Scholar
• Deuze, Mark. 2005a. “Towards Professional Participatory Storytelling in Journalism and Advertising.” First Monday 10: 7.
   Google Scholar
• Deuze, Mark. 2005b. “What is Journalism? Professional Identity and Ideology of Journalists Reconsidered.” Journalism 6 (4): 442–464.
   Google Scholar
• Diakopoulos, Nicholas. 2015. “Algorithmic Accountability: Journalistic Investigation of Computational Power Structures.” Digital Journalism 3 (3): 398–415.
   Web of Science ®Google Scholar
• Donsbach, Wolfgang, and Bettina Klett. 1993. “Subjective Objectivity. How Journalists in Four Countries Define a key Term of Their Profession.” Gazette (Leiden, Netherlands) 51 (1): 53–83.
   Google Scholar
• Dörr, Konstantin Nicholas. 2016. “Mapping the Field of Algorithmic Journalism.” Digital Journalism 4 (6): 700–722.
   Web of Science ®Google Scholar
• Dörr, Konstantin Nicholas, and Katharina Hollnbuchner. 2017. “Ethical Challenges of Algorithmic Journalism.” Digital Journalism 5 (4): 404–419.
   Web of Science ®Google Scholar
• Ellul, Jacques. 1964. The Technological Society. New York: Knopf.
   Google Scholar
• Flanagin, Andrew J., and Miriam J. Metzger. 2000. “Perceptions of Internet Information Credibility.” Journalism & Mass Communication Quarterly 77 (3): 515–540.
   Web of Science ®Google Scholar
• Fogg, B. J., and Hsiang Tseng. 1999. “The Elements of Computer Credibility.” Proceedings of the SIGCHI conference on Human Factors in Computing Systems.
   Google Scholar
• Fritch, John W., and Robert L. Cromwell. 2001. “Evaluating Internet Resources: Identity, Affiliation, and Cognitive Authority in a Networked World.” Journal of the American Society for Information Science and Technology 52 (6): 499–507.
   Web of Science ®Google Scholar
• Gaziano, Cecilie, and Kristin McGrath. 1986. “Measuring the Concept of Credibility.” Journalism Quarterly 63 (3): 451–462.
   Web of Science ®Google Scholar
• Gillespie, Tarleton. 2014. “The Relevance of Algorithms.” Media Technologies: Essays on Communication, Materiality, and Society 167–167.
   Google Scholar
• Glahn, Harry R. 1970. “Computer-produced Worded Forecasts.” Bulletin of the American Meteorological Society 51 (12): 1126–1131.
   Google Scholar
• Graefe, Andreas. 2016. Guide to Automated Journalism. New York, NY: Tow Center for Digital Journalism, Columbia Journalism School.
   Google Scholar
• Graefe, Andreas, Mario Haim, Bastian Haarmann, and Hans-Bernd Brosius. 2018. “Readers’ Perception of Computer-Generated News: Credibility, Expertise, and Readability.” Journalism 19 (5): 595–610.
   Web of Science ®Google Scholar
• Groeling, Tim. 2008. “Who's the Fairest of Them all? An Empirical Test for Partisan Bias on ABC, CBS, NBC, and Fox News.” Presidential Studies Quarterly 38 (4): 631–657.
   Google Scholar
• Haim, Mario, and Andreas Graefe. 2017. “Automated News: Better Than Expected?” Digital Journalism 5 (8): 1044–1059.
   Web of Science ®Google Scholar
• Hassan, Isyaku, and Mohd Nazri Latiff Azmi. 2018. “Islam-related News Credibility in Selected Nigerian and Malaysian Newspapers”.
   Google Scholar
• Hernon, Peter. 1995. “Disinformation and Misinformation Through the Internet: Findings of an Exploratory Study.” Government Information Quarterly 12 (2): 133–139.
   Web of Science ®Google Scholar
• Hovland, Carl I, and Walter Weiss. 1951. “The Influence of Source Credibility on Communication Effectiveness.” Public Opinion Quarterly 15 (4): 635–650.
   Web of Science ®Google Scholar
• Ingram, Mathew. 2018. “Most Americans say They Have Lost Trust in the Media.” Columbia Journalism Review. https://www.cjr.org/the_media_today/trust-in-media-down.php.
   Google Scholar
• Johnson, Thomas J, and Barbara K. Kaye. 1998. “Cruising is Believing?: Comparing Internet and Traditional Sources on Media Credibility Measures.” Journalism & Mass Communication Quarterly 75 (2): 325–340.
   Web of Science ®Google Scholar
• Kaczmarek, Adam L. 2008. “Automatic Evaluation of Information Credibility in Semantic Web and Knowledge Grid.” WEBIST (2).
   Google Scholar
• Kim, Soomin, JongHwan Oh, and Joonhwan Lee. 2016. “Automated News Generation for TV Program Ratings.” Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video.
   Google Scholar
• Kiousis, Spiro. 2001. “Public Trust or Mistrust? Perceptions of Media Credibility in the Information age.” Mass Communication & Society 4 (4): 381–403.
   Google Scholar
• Kline, Paul. 1979. Psychometrics and Psychology. Cambridge, MA: Academic Press Inc.
   Google Scholar
• Lang, Annie. 2000. “The Limited Capacity Model of Mediated Message Processing.” Journal of Communication 50 (1): 46–70.
   Web of Science ®Google Scholar
• Latar, Noam Lemelshtrich. 2015. “The Robot Journalist in the Age of Social Physics: The End of Human Journalism?” In The New World of Transitioned Media, 65–80. Springer.
   Google Scholar
• Latzer, M., K. Hollnbuchner, N. Just, and F. Saurwein. 2016. “The Economics of Algorithmic Selection on the Internet.” In Handbook on the Economics of the Internet, edited by J. Bauer and M. Latzer, 395–425. Cheltenham: Edward Elgar.
   Google Scholar
• Lavenda, D. 2016. “Artificial Intelligence vs. Intelligence Augmentation.” Network World (Online). http://search/. proquest. com/docview/1809109037.
   Google Scholar
• Lazer, David, Ryan Kennedy, Gary King, and Alessandro Vespignani. 2014. “The Parable of Google Flu: Traps in big Data Analysis.” Science 343 (6176): 1203–1205.
   PubMed Web of Science ®Google Scholar
• Lee, Angela M., Seth C. Lewis, and Matthew Powers. 2014. “Audience Clicks and News Placement: A Study of Time-Lagged Influence in Online Journalism.” Communication Research 41 (4): 505–530.
   Web of Science ®Google Scholar
• Levy, Steven. 2012. “Can an Algorithm Write a better News Story than a Human Reporter? Wired.” Accessed 0224. https://www.wired.com/2012/04/can-an-algorithm-write-a-better-news-story-than-a-human-reporter/.
   Google Scholar
• Lewis, Seth C., Andrea L. Guzman, and Thomas R. Schmidt. 2019. “Automation, Journalism, and Human–Machine Communication: Rethinking Roles and Relationships of Humans and Machines in News.” Digital Journalism 7 (4): 409–427.
   Web of Science ®Google Scholar
• Lewis, Seth C., and Oscar Westlund. 2015. “Big Data and Journalism: Epistemology, Expertise, Economics, and Ethics.” Digital Journalism 3 (3): 447–466.
   Web of Science ®Google Scholar
• Linden, Carl-Gustav. 2017a. “Decades of Automation in the Newsroom: Why are There Still so Many Jobs in Journalism?” Digital Journalism 5 (2): 123–140.
   Web of Science ®Google Scholar
• Linden, Tommy Carl-Gustav. 2017b. “Algorithms for Journalism.” The Journal of Media Innovations 4 (1): 60–76.
   Google Scholar
• Linden, Tommy Carl-Gustav, Hanna Emilia Tuulonen, Asta Bäck, Nicholas Diakopoulos, Mark Granroth-Wilding, Lauri Haapanen, Leo Juhani Leppänen, Magnus Melin, Tom Arne Moring, and Myriam Douce Munezero. 2019. “News Automation: The Rewards, Risks and Realities of'machine Journalism’”.
   Google Scholar
• Liu, Xiaomo, Armineh Nourbakhsh, Quanzhi Li, Sameena Shah, Robert Martin, and John Duprey. 2017. “Reuters Tracer: Toward Automated News Production using Large Scale Social Media Data.” 2017 IEEE International Conference on Big Data (Big Data).
   Google Scholar
• Liu, Bingjie, and Lewen Wei. 2018. “Reading Machine-Written News: Effect of Machine Heuristic and Novelty on Hostile Media Perception.” International Conference on Human-Computer Interaction.
   Google Scholar
• Marconi, Francesco, Alex Siegman, and Machine Journalist. 2017. The Future of Augmented Journalism: A Guide for Newsrooms in the age of Smart Machines. New York: Associated Press.
   Google Scholar
• McDonald, David D. 2010. “Natural Language Generation.” Handbook of Natural Language Processing 2: 121–144.
   Google Scholar
• Melin, Magnus, Asta Bäck, Caj Södergård, Myriam D. Munezero, Leo J. Leppänen, and Hannu Toivonen. 2018. “No Landslide for the Human Journalist-An Empirical Study of Computer-Generated Election News in Finland.” IEEE Access 6: 43356–43367.
   Web of Science ®Google Scholar
• Metzger, Miriam J., Andrew J. Flanagin, Keren Eyal, Daisy R. Lemus, and Robert M. McCann. 2003. “Credibility for the 21st Century: Integrating Perspectives on Source, Message, and Media Credibility in the Contemporary Media Environment.” Communication Yearbook 27: 293–336.
   Google Scholar
• Meyer, Timothy J. 1974. “Media Credibility: The State of the Research.” Public Telecommunications Review 2 (4): 48–52.
   Google Scholar
• Meyer, Philip. 1988. “Defining and Measuring Credibility of Newspapers: Developing an Index.” Journalism & Mass Communication Quarterly 65 (3): 567–574.
   Google Scholar
• Meyer, Hans K., Doreen Marchionni, and Esther Thorson. 2010. “The Journalist Behind the News: Credibility of Straight, Collaborative, Opinionated, and Blogged “News”.” American Behavioral Scientist 54 (2): 100–119.
   Web of Science ®Google Scholar
• Mindich, David T. Z. 2000. Just the Facts: How” Objectivity” Came to Define American Journalism. New York, NY: NYU Press.
   Google Scholar
• Neuberger, Christoph. 1996. Journalism as Problem Processing. Objectivity and Relevance in Public Communication. UVK: Konstanz.
   Google Scholar
• Newhagen, John, and Clifford Nass. 1989. “Differential Criteria for Evaluating Credibility of Newspapers and TV News.” Journalism Quarterly 66 (2): 277.
   Web of Science ®Google Scholar
• Oosterhoff, Benjamin, Natalie J. Shook, and Cameron Ford. 2018. “Is That Disgust I see? Political Ideology and Biased Visual Attention.” Behavioural Brain Research 336: 227–235.
   PubMed Web of Science ®Google Scholar
• Örnebring, H., and R. F. Conill. 2016. “Outsourcing Newswork.” In The SAGE Handbook of Digital Journalism, edited by T. Witschge, C. Anderson, and D. Domingo, 207–221. London: Sage.
   Google Scholar
• Parasie, Sylvain, and Eric Dagiral. 2013. “Data-driven Journalism and the Public Good:“Computer-Assisted-Reporters” and “Programmer-Journalists” in Chicago.” New Media & Society 15 (6): 853–871.
   Web of Science ®Google Scholar
• Patterson, Thomas E., and Wolfgang Donsbagh. 1996. “News Decisions: Journalists as Partisan Actors.” Political Communication 13 (4): 455–468.
   Web of Science ®Google Scholar
• Pavlik, John. 2016. “Cognitive Computing and Journalism: Implications of Algorithms, Artificial Intelligence and Data for the News Media and Society.” Brazilian Journal of Technology, Communication, and Cognitive Science 4 (2): 1–14.
   Google Scholar
• Perloff, Richard M. 1993. The Dynamics of Persuasion: Communication and Attitudes in the 21st Century. Abingdon: Routledge.
   Google Scholar
• Quandt, Thorsten. 2000. “The End of Journalism? Online Com- Munication as a Challenge for Journalism Research.” In Theories of Journalism, edited by Martin Lo ¨ffelholz, 483–509. Westdeutscher Verlag: Wiesbaden.
   Google Scholar
• Reeves, Joshua. 2016. “Automatic for the People: The Automation of Communicative Labor.” Communication and Critical/Cultural Studies 13 (2): 150–165.
   Web of Science ®Google Scholar
• Reiter, Ehud, and Robert Dale. 1997. “Building Applied Natural Language Generation Systems.” Natural Language Engineering 3 (1): 57–87.
   Google Scholar
• Rieh, Soo Young. 2010. “Credibility and Cognitive Authority of Information.” Encyclopedia of Library and Information Sciences 1 (1): 1337–1344.
   Google Scholar
• Rieh, Soo Young, and Nicholas J. Belkin. 1998. “Understanding Judgment of Information Quality and Cognitive Authority in the WWW.” Proceedings of the 61st annual meeting of the american society for information science.
   Google Scholar
• Shudson, Michael. 1978. “Discovering the News.” A Social History of American Newspapers.
   Google Scholar
• Slater, Michael D., and Donna Rouner. 1996. “How Message Evaluation and Source Attributes may Influence Credibility Assessment and Belief Change.” Journalism & Mass Communication Quarterly 73 (4): 974–991.
   Web of Science ®Google Scholar
• Stavelin, Eirik. 2014. “Computational Journalism. When Journalism Meets Programming”.
   Google Scholar
• Streckfuss, Richard. 1990. “Objectivity in Journalism: A Search and a Reassessment.” Journalism Quarterly 67 (4): 973–983.
   Web of Science ®Google Scholar
• Sundar, S. Shyam. 1999. “Exploring Receivers’ Criteria for Perception of Print and Online News.” Journalism & Mass Communication Quarterly 76 (2): 373–386.
   Web of Science ®Google Scholar
• Sundar, S. Shyam. 2008. “The MAIN Model: A Heuristic Approach to Understanding Technology Effects on Credibility.” In Digital Media, Youth, and Credibility. Vol. 7., edited by Miriam J. Metzger and Andrew J. Flanagin, 73–100. The John D. and Catherine T. MacArthur Foundation Series on Digital Media and Learning. Cambridge, MA: The MIT Press.
   Google Scholar
• Teel, Cynthia, and Joyce A. Verran. 1991. “Focus on Psychometrics. Factor Comparison Across Studies.” Research in Nursing & Health 14 (1): 67–72.
   PubMed Web of Science ®Google Scholar
• Thomson, Elizabeth A., Peter R. R. White, and Philip Kitley. 2008. ““Objectivity” and “Hard News” Reporting Across Cultures: Comparing the News Report in English, French, Japanese and Indonesian Journalism.” Journalism Studies 9 (2): 212–228.
   Web of Science ®Google Scholar
• Thurman, Neil, Konstantin Dörr, and Jessica Kunert. 2017. “When Reporters Get Hands-on with Robo-Writing: Professionals Consider Automated Journalism’s Capabilities and Consequences.” Digital Journalism 5 (10): 1240–1259.
   Web of Science ®Google Scholar
• Toraman, Cagri, and Fazli Can. 2015. “A Front-Page News-Selection Algorithm Based on Topic Modelling Using raw Text.” Journal of Information Science 41 (5): 676–685.
   Web of Science ®Google Scholar
• Van Dalen, Arjen. 2012. “The Algorithms Behind the Headlines: How Machine-Written News Redefines the Core Skills of Human Journalists.” Journalism Practice 6 (5–6): 648–658.
   Google Scholar
• Van der Kaa, Hille, and Emiel Krahmer. 2014. “Journalist Versus News Consumer: The Perceived Credibility of Machine Written News.” Proceedings of the Computation+ Journalism Conference, Columbia University, New York.
   Google Scholar
• Waddell, T. Franklin. 2018. “A Robot Wrote This? How Perceived Machine Authorship Affects News Credibility.” Digital Journalism 6 (2): 236–255.
   Web of Science ®Google Scholar
• Wann, D. 2006. “The Causes and Consequences of Sport Team Identification.” In Handbook of Sports and Media, edited by A. Raney and J. Bryant, 331–352. New York: Routledge.
   Google Scholar
• Weaver, David H., and Lars Willnat. 2012. The Global Journalist in the 21st Century. Abingdon: Routledge.
   Google Scholar
• Wilson, Patrick. 1983. “Second-hand Knowledge: An inquiry into Cognitive Authority”.
   Google Scholar
• Wölker, Anja, and Thomas E. Powell. 2018. “Algorithms in the Newsroom? News Readers’ Perceived Credibility and Selection of Automated Journalism.” Journalism 1–18. doi:10.1177/1464884918757072.
   Google Scholar
• Wu, Shangyuan, Edson C. Tandoc Jr, and Charles T. Salmon. 2018. “Journalism Reconfigured: Assessing Human–Machine Relations and the Autonomous Power of Automation in News Production.” Journalism Studies. 1–18.
   Web of Science ®Google Scholar
• Young, Mary Lynn, and Alfred Hermida. 2015. “From Mr. and Mrs. Outlier to Central Tendencies: Computational Journalism and Crime Reporting at the Los Angeles Times.” Digital Journalism 3 (3): 381–397.
   Web of Science ®Google Scholar