Seek and you shall find? A content analysis on the diversity of five search engines’ results on political queries

References

• Aslama, M., Hellman, H., & Sauri, T. (2004). Does market-entry regulation matter? Competition in television broadcasting and programme diversity in Finland, 1993–2002. Gazette: The International Journal for Communication Studies, 66(2), 113–132. https://doi.org/https://doi.org/10.1177/0016549204041473.
   Google Scholar
• Beiler, M. (2013). Nachrichtensuche im Internet: Inhaltsanalyse zur journalistischen Qualität von Nachrichtensuchmaschinen [Searching for news on the Internet: Content analysis on journalistic quality comparing five news search engines]. UVK.
   Google Scholar
• Benson, R. (2009). What makes news more multiperspectival? A field analysis. Poetics, 37(5–6), 402–418. https://doi.org/https://doi.org/10.1016/j.poetic.2009.09.002
   Web of Science ®Google Scholar
• d'Haenens, L., van der Wurff, R., van Cuilenburg, J., Vettehen, P. H., Vergeer, M., Huysmans, F., & de Haan, J. (2005). Media Diversity. Communications, 30(3), 293–324. https://doi.org/https://doi.org/10.1515/comm.2005.30.3.293.
   Google Scholar
• Donohue, T. R., & Glasser, T. L. (1978). Homogeneity in coverage of Connecticut newspapers. Journalism Quarterly, 55(3), 592–596. https://doi.org/https://doi.org/10.1177/107769907805500328
   Web of Science ®Google Scholar
• Dutton, W. H., Reisdorf, B. C., Dubois, E., & Blank, G. (2017). Search and politics: The uses and impacts of search in Britain, France, Germany, Italy, Poland, Spain, and the United States (Quello Center Working Paper No. 5-1-17).
   Google Scholar
• Epstein, R., & Robertson, R. E. (2015). The search engine manipulation effect (SEME) and its possible impact on the outcomes of elections. PNAS, 112(33), E4512–E4521. https://doi.org/https://doi.org/10.1073/pnas.1419828112
   PubMed Web of Science ®Google Scholar
• European Commission. (2010). Communication from the commission to the European Parliament, the Council, the European Economic and Social Committee and the Committee of the regions: A digital agenda for Europe. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52010DC0245R(01)&from=EN
   Google Scholar
• Fletcher, R., & Nielsen, R. K. (2018). Automated serendipity: The effect of using search engines on news repertoire balance and diversity. Digital Journalism, 6(8), 976–989. https://doi.org/https://doi.org/10.1080/21670811.2018.1502045
   Web of Science ®Google Scholar
• Fuchs, C. (2019, March 11). Geplanter Medienstaatsvertrag: Mischung für Millionen [Draft of the, interstate treaty on media: Mixture for millions]. Sueddeutsche.de. https://www.sueddeutsche.de/medien/geplanter-medienstaatsvertrag-mischung-fuer-millionen-1.4364339
   Google Scholar
• Geiß, S. (2015). Die Aufmerksamkeitsspanne der Öffentlichkeit: Eine Studie zur Dauer und Intensität von Meinungsbildungsprozessen [The public attention span: A study on the duration and intensity of opinion-forming processes]. Nomos.
   Google Scholar
• Gerhart, S. (2004). Do web search engines suppress controversy? First Monday, 9(1). https://doi.org/https://doi.org/10.5210/fm.v9i1.1111
   Google Scholar
• Granka, L. (2010). The politics of search: A decade retrospective. The Information Society, 26(5), 364–374. https://doi.org/https://doi.org/10.1080/01972243.2010.511560
   Web of Science ®Google Scholar
• Haas, A., & Unkel, J. (2017). Ranking versus reputation: Perception and effects of search result credibility. Behaviour & Information Technology, 36(12), 1285–1298. https://doi.org/https://doi.org/10.1080/0144929X.2017.1381166
   Web of Science ®Google Scholar
• Haim, M., Graefe, A., & Brosius, H.-B. (2018). Burst of the filter bubble? Effects of personalization on the diversity of Google news. Digital Journalism, 6(3), 330–343. https://doi.org/https://doi.org/10.1080/21670811.2017.1338145
   Web of Science ®Google Scholar
• Hannák, A., Sapieżyński, P., Molavi Kakhki, A., Krishnamurthy, B., Lazer, D., Mislove, A., & Wilson, C. (2013). Measuring personalization of web search. WWW ’13: Proceedings of the 22nd international conference on World Wide Web (pp. 527–537). https://doi.org/https://doi.org/10.1145/2488388.2488435
   Google Scholar
• Hargittai, E. (2000). Open portals or closed gates? Channeling content on the World Wide Web. Poetics, 27(4), 233–253. https://doi.org/https://doi.org/10.1016/S0304-422X(00)00006-1
   Web of Science ®Google Scholar
• Haßler, J., Maurer, M., & Oschatz, C. (2014). Media logic and political logic online and offline. Journalism Practice, 8(3), 326–341. https://doi.org/https://doi.org/10.1080/17512786.2014.889451
   Google Scholar
• Helberger, N. (2011). Diversity by design. Journal of Information Policy, 1, 441–469. https://doi.org/https://doi.org/10.5325/jinfopoli.1.2011.0441
   Google Scholar
• Hu, D., Jiang, S. E., Robertson, R., & Wilson, C. (2019). Auditing the partisanship of Google search snippets. WWW ’19: Proceedings of the World Wide Web conference (pp. 693–704). https://doi.org/https://doi.org/10.1145/3308558.3313654
   Google Scholar
• Humprecht, E., & Esser, F. (2018). Diversity in online news. Journalism Studies, 19(12), 1825–1847. https://doi.org/https://doi.org/10.1080/1461670X.2017.1308229
   Web of Science ®Google Scholar
• Ieong, S., Mishra, N., Sadikov, E., & Zhang, L. (2012). Domain bias in web search. WSDM ’12: Proceedings of the fifth ACM international conference on web search and data mining (pp. 413–422). https://doi.org/https://doi.org/10.1145/2124295.2124345
   Google Scholar
• Jacobi, C., Kleinen-von Königslöw, K., & Ruigrok, N. (2016). Political news content in online and print newspapers: Are online editions better by electoral democratic standards? Digital Journalism, 4(6), 723–742. https://doi.org/https://doi.org/10.1080/21670811.2015.1087810
   Web of Science ®Google Scholar
• Jandura, O., & Friedrich, K. (2014). The quality of political media coverage. In C. Reinemann (Ed.), Political communication (pp. 351–373). de Gruyter.
   Google Scholar
• Jansen, B., & Spink, A. (2006). How are we searching the world wide web? A comparison of nine search engine transaction logs. Information Processing and Management, 42(1), 248–263. https://doi.org/https://doi.org/10.1016/j.ipm.2004.10.007
   Web of Science ®Google Scholar
• Jürgens, P., & Stark, B. (2017). The power of default on Reddit: A general model to measure the influence of information intermediaries. Policy & Internet, 9(4), 395–419. https://doi.org/https://doi.org/10.1002/poi3.166.
   Web of Science ®Google Scholar
• Just, N. (2009). Measuring media concentration and diversity: New approaches and instruments in Europe and the US. Media Culture Society, 31(1), 97–117. https://doi.org/https://doi.org/10.1177/0163443708098248
   Web of Science ®Google Scholar
• Karppinen, K. E. (2006). Media diversity and the politics of criteria: Diversity assessment and technocratisation of European media policy. Nordicom Review, 27(2), 53–68. https://doi.org/https://doi.org/10.1515/nor-2017-0230
   Google Scholar
• Kulshrestha, J., Eslami, M., Messias, J., Zafar, M. B., Ghosh, S., Gummadi, K. P., & Karahalios, K. (2019). Search bias quantification: Investigating political bias in social media and web search. Information Retrieval Journal, 22(1), 188–227. https://doi.org/https://doi.org/10.1007/s10791-018-9341-2
   Web of Science ®Google Scholar
• Latzer, M., Hollnbuchner, K., Just, N., & Saurwein, F. (2016). The economics of algorithmic selection on the Internet. In J. M. Bauer & M. Latzer (Eds.), Handbook on the economics of the Internet (pp. 395–425). Edward Elgar.
   Google Scholar
• Li, N., Anderson, A. A., Brossard, D., & Scheufele, D. A. (2014). Channeling science information seekers’ attention? A content analysis of top-ranked vs. lower-ranked sites in Google. Journal of Computer-Mediated Communication, 19(3), 562–575. https://doi.org/https://doi.org/10.1111/jcc4.12043
   Web of Science ®Google Scholar
• Magin, M., Steiner, M., Heinbach, D., Bosold, S., Pieper, A., Felka, E.-M., & Stark, B. (2015). Suchmaschinen auf dem Prüfstand – eine vergleichende Inhaltsanalyse der Qualität von Trefferlisten [Search engines put to the test – a comparative content analysis of the quality of result pages]. Medien & Kommunikationswissenschaft, 63(4), 495–516. https://doi.org/https://doi.org/10.5771/1615-634X-2015-4.
   Google Scholar
• Magin, M., Steiner, M., & Stark, B. (2019). Suche im Netz – einseitige oder vielfältige Informationsquelle? Eine Inhaltsanalyse der politischen Informationsvielfalt von Suchmaschinenergebnissen [Searching the net - one-sided or multiple sources of information? A content analysis of the political information diversity of search engines]. Media Perspektiven, (9), 421–429. https://www.ard-werbung.de/media-perspektiven/fachzeitschrift/2019/detailseite-2019/suche-im-netz-einseitige-oder-vielfaeltige-informationsquelle/.
   Google Scholar
• Masini, A., van Aelst, P., Zerback, T., Reinemann, C., Mancini, P., Mazzoni, M., Damiani, M., & Coen, S. (2018). Measuring and explaining the diversity of voices and viewpoints in the news. Journalism Studies, 19(15), 2324–2343. https://doi.org/https://doi.org/10.1080/1461670X.2017.1343650
   Web of Science ®Google Scholar
• McDonald, D. G., & Dimmick, J. (2003). The conceptualization and measurement of diversity. Communication Research, 30(1), 60–79. https://doi.org/https://doi.org/10.1177/0093650202239026
   Web of Science ®Google Scholar
• McMahon, C., Johnson, I., & Hecht, B. (2017). The substantial interdependence of Wikipedia and Google: A case study on the relationship between peer production communities and information technologies. Proceedings of the eleventh international AAAI conference on web and social media, ICWSM 2017 (pp. 142–151). AAAI Press.
   Google Scholar
• McQuail, D. (1992). Media performance: Mass communication and the public interest. Sage.
   Google Scholar
• Metaxas, P. T., & Pruksachatkun, Y. (2017). Manipulation of search engine results during the 2016 US congressional elections. Proceedings of the ICIW 2017, Venice, Italy.
   Google Scholar
• Möller, J., Helberger, N., & Makhortykh, M. (2019). Filter bubbles in the Netherlands? https://www.ivir.nl/publicaties/download/Filter-bubbles-in-the-Netherlands.pdf
   Google Scholar
• Möller, J., Trilling, D., Helberger, N., & van Es, B. (2018). Do not blame it on the algorithm: An empirical assessment of multiple recommender systems and their impact on content diversity. Information, Communication & Society, 21(7), 959–977. https://doi.org/https://doi.org/10.1080/1369118X.2018.1444076
   Web of Science ®Google Scholar
• Mowshowitz, A., & Kawaguchi, A. (2002). Assessing bias in search engines. Information Processing & Management, 38(1), 141–156. https://doi.org/https://doi.org/10.1016/S0306-4573(01)00020-6
   Web of Science ®Google Scholar
• Napoli, P. M. (1999). Deconstructing the diversity principle. Journal of Communication, 49(4), 7–34. https://doi.org/https://doi.org/10.1111/j.1460-2466.1999.tb02815.x
   Web of Science ®Google Scholar
• Neuberger, C., & Lobigs, F. (2010). Die Bedeutung des Internets im Rahmen der Vielfaltssicherung: Gutachten im Auftrag der Kommission zur Ermittlung der Konzentration im Medienbereich [The role of the Internet for safeguarding diversity. Report on behalf of the commission of media concentration monitoring]. Vistas.
   Google Scholar
• Newman, N., Fletcher, R., Kalogeropoulos, A., & Nielsen, R. K. (2019). Reuters Institute digital news report 2019. https://reutersinstitute.politics.ox.ac.uk/sites/default/files/2019-06/DNR_2019_FINAL_0.pdf
   Google Scholar
• O'Hare, R. (2016, June 24). Google search spike suggests many people don't know why they voted for Brexit. Daily Mail. http://www.dailymail.co.uk/sciencetech/article-3657997/Britain-s-Google-searches-hint-people-didn-t-know-voting-for.html
   Google Scholar
• Pan, B., Hembrooke, H., Joachims, T., Lorigo, L., Gay, G., & Granka, L. (2007). In Google we trust: Users’ decisions on rank, position, and relevance. Journal of Computer-Mediated Communication, 12(3), 801–823. https://doi.org/https://doi.org/10.1111/j.1083-6101.2007.00351.x
   Web of Science ®Google Scholar
• Pariser, E. (2011). The filter bubble: What the internet is hiding from you. Penguin Books.
   Google Scholar
• Quarfoot, D., & Levine, R. A. (2016). How robust are multirater interrater reliability indices to changes in frequency distribution? The American Statistician, 70(4), 373–384. https://doi.org/https://doi.org/10.1080/00031305.2016.1141708
   Web of Science ®Google Scholar
• Robertson, R. E., Jiang, S., Joseph, K., Friedland, L., Lazer, D., & Wilson, C. (2018). Auditing partisan audience bias within Google search. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW). https://doi.org/https://doi.org/10.1145/3274417
   Google Scholar
• Saurwein, F., Just, N., & Latzer, M. (2015). Governance of algorithms: Options and limitations. Info, 17(6), 35–49. https://doi.org/https://doi.org/10.1108/info-05-2015-0025
   Google Scholar
• SEO. (2017). Suchmaschinen – Liste & Marktanteile: Entwicklung und Marktanteile der beliebtesten Suchmaschinen in Deutschland [Search engines and their market shares: Development and market shares of the most popular search engines in Germany]. Retrieved September 26, 2017, from https://seo-summary.de/suchmaschinen/
   Google Scholar
• Shannon, C. E., & Weaver, W. (1949). The mathematical theory of communication. University of Illinois Press.
   Google Scholar
• Stark, B. (2014). „Don’t be evil“. Die Macht von Google und die Ohnmacht der Nutzer und Regulierer ["Don't be evil". The power of Google and the powerlessness of users and regulators]. In B. Stark, D. Dörr, & S. Aufenanger (Eds.), Die „Googleisierung“ der Informationssuche. Suchmaschinen zwischen Nutzung und Regulierung (pp. 1–19). Berlin: de Gruyter.
   Google Scholar
• Trevisan, F., Hoskins, A., Oates, S., & Mahlouly, D. (2018). The Google voter: Search engines and elections in the new media ecology. Information, Communication & Society, 21(1), 111–128. https://doi.org/https://doi.org/10.1080/1369118X.2016.1261171
   Web of Science ®Google Scholar
• Trielli, D., & Diakopoulos, N. (2019). Search as news curator: The role of Google in shaping attention to news information. Proceedings of the 2019 CHI conference on human factors in computing systems, CHI’19. https://doi.org/https://doi.org/10.1145/3290605.3300683
   Google Scholar
• Unkel, J., & Haim, M. (2019). Googling politics: Parties, sources, and issue ownerships on Google in the 2017 German federal Election campaign. Social Science Computer Review. Advance online publication. https://doi.org/https://doi.org/10.1177/0894439319881634
   Google Scholar
• van Cuilenburg, J. (2000). On measuring media competition and media diversity: Concepts, theories and methods. In R. G. Picard (Ed.), Measuring media content, quality and diversity: Approaches and issues in content research (pp. 51–84). Turku School for Economics and Business Administration.
   Google Scholar
• van Cuilenburg, J. (2007). Media diversity, competition and concentration: Concepts and theories. In E. de Bens, C. Hamelink, K. Jakkubowicz, K. Nordenstreng, J. van Cuilenburg, & R. van der Wurff (Eds.), Media between culture and commerce (pp. 25–54). Intellect.
   Google Scholar
• van Hoboken, J. (2012). Search engine freedom: On the implications of the right to freedom of expression for the legal governance of web search engines [Doctoral dissertation, University of Amsterdam]. UvA-DARE (Digital Academic Repository). https://pure.uva.nl/ws/files/1769429/104098_thesis.pdf
   Google Scholar