Beyond the Bubble: Assessing the Diversity of Political Search Results

References

• Alexa. 2018. The top 500 sites on the web. https://www.alexa.com/topsites
   Google Scholar
• AlgorithmWatch. 2017. Datenspende: BTW 17. Accessed November 12, 2018. https://datenspende.algorithmwatch.org/.
   Google Scholar
• Ananny, M., and K. Crawford. 2018. “Seeing Without Knowing: Limitations of the Transparency Ideal and Its Application to Algorithmic Accountability.” New Media & Society 20 (3): 973–989. doi:10.1177/1461444816676645
   Web of Science ®Google Scholar
• Bakshy, E., S. Messing, and L. Adamic. 2015. “Exposure to Ideologically Diverse News and Opinion on Facebook.” Science 58 (4): 707–731. doi:10.1126/science.aaa1160
   Google Scholar
• Bar-Ilan, J. 2007. “Google Bombing from a Time Perspective.” Journal of Computer-Mediated Communication 12 (3): 910–938. doi:10.1111/j.1083-6101.2007.00356.x.
   Web of Science ®Google Scholar
• Bennett, P. N., R. W. White, W. Chu, S. T. Dumais, P. Bailey, F. Borisyuk, and X. Cui. 2012. “Modeling the Impact of Short- and Long-term Behavior on Search Personalization.” Paper presented at Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval - SIGIR ’12, 185, ACM Press, New York, USA. doi:10.1145/2348283.2348312.
   Google Scholar
• Borra, E., and I. Weber. 2012. “Political Insights: Exploring Partisanship in Web Search.” First Monday 17 (7): 1–15. doi:10.5210/fm.v17i7.4070.
   Google Scholar
• Bozdag, E. 2013. “Bias in Algorithmic Filtering and Personalization.” Ethics and Information Technology 15 (3): 209–227. doi:10.1007/s10676-013-9321-6.
   Web of Science ®Google Scholar
• Bucher, T. 2012. “Want to be on the Top? Algorithmic Power and the Threat of Invisibility on Facebook.” New Media & Society 14 (7): 1164–1180. doi:10.1177/1461444812440159.
   Web of Science ®Google Scholar
• Carlson, M. 2015. “The Robotic Reporter.” Digital Journalism 3 (3): 416–431. doi:10.1080/21670811.2014.976412.
   Web of Science ®Google Scholar
• Coddington, M. 2015. “Clarifying Journalism’s Quantitative Turn.” Digital Journalism 3 (3): 331–348. doi:10.1080/21670811.2014.976400.
   Web of Science ®Google Scholar
• Cox, T. F., and M. A. A. Cox. 2000. Multidimensional Scaling. Boca Raton: Chapman & Hall/CRC Press.
   Google Scholar
• Diakopoulos, N., and M. Koliska. 2017. “Algorithmic Transparency in the News Media.” Digital Journalism 5 (7): 809–828. doi:10.1080/21670811.2016.1208053.
   Web of Science ®Google Scholar
• Dubois, E., and G. Blank. 2018. “The Echo Chamber is Overstated: The Moderating Effect of Political Interest and Diverse Media.” Information Communication and Society 21 (5): 729–745. doi:10.1080/1369118X.2018.1428656.
   Web of Science ®Google Scholar
• Edelman, B. 2010. Hard-Coding Bias in Google “Algorithmic” Search Results. http://www.benedelman.org/hardcoding/.
   Google Scholar
• Edelman, B. 2011. “Bias in Search Results: Diagnosis and Response.” Indian Journal of Law and Technology 7: 16–32. doi:10.1525/sp.2007.54.1.23.
   Google Scholar
• Edelman, B., and B. Lockwood. 2011. Measuring Bias in “Organic” Web Search. http://www.benedelman.org/searchbias/.
   Google Scholar
• Epstein, R., and R. E. Robertson. 2015. “The Search Engine Manipulation Effect (SEME) and Its Possible Impact on the Outcomes of Elections.” Proceedings of the National Academy of Sciences United States of America 112 (33): E4512–E4521. doi:10.1073/pnas.1419828112.
   PubMed Web of Science ®Google Scholar
• Feuz, M., M. Fuller, and F. Stalder. 2011. “Personal Web Searching in the Age of Semantic Capitalism: Diagnosing the Mechanisms of Personalisation.” First Monday 16 (2). http://firstmonday.org/article/view/3344/2766.
   Google Scholar
• Flaxman, S., S. Goel, and J. M. Rao. 2016. “Filter Bubbles, Echo Chambers, and Online News Consumption.” Public Opinion Quarterly 80 (1): 298–320. doi:10.1093/poq/nfw006.
   Web of Science ®Google Scholar
• Fletcher, R., and R. K. Nielsen. 2018. “Are People Incidentally Exposed to News on Social Media? A Comparative Analysis.” New Media & Society 20 (7): 2450–2468. doi:10.1177/1461444817724170.
   Web of Science ®Google Scholar
• Ford, H., E. Dubois, and C. Puschmann. 2016. “Keeping Ottawa Honest – One Tweet at a Time? Politicians, Journalists, Wikipedians, and their Twitter Bots.” International Journal of Communication 10 (24): 4891–4914. http://ijoc.org/index.php/ijoc/article/view/6183/1803.
   Google Scholar
• Gerhart, S. L. 2004. “Do Web Search Engines Suppress Controversy?” First Monday 9 (1): 1–18. doi:10.5210/fm.v9i1.1111.
   Google Scholar
• Gillespie, T. 2014. “The Relevance of Algorithms.” In Media Technologies: Essays on Communication, Materiality, and Society, edited by T. Gillespie, P. Boczkowski, & K. Foot, 167–194. Cambridge, MA: MIT Press.
   Google Scholar
• Gillespie, T. 2010. “The Politics of ‘Platforms’.” New Media & Society 12 (3): 347–364. doi:10.1177/1461444809342738.
   Web of Science ®Google Scholar
• Giomelakis, D., and A. Veglis. 2016. “Investigating Search Engine Optimization Factors in Media Websites: The case of Greece.” Digital Journalism 4 (3): 379–400. doi:10.1080/21670811.2015.1046992.
   Web of Science ®Google Scholar
• Goldman, E. 2006. “Search Engine Bias and the Demise of Search Engine Utopianism.” Yale Journal of Law and Technology 188 (8): 121–133. doi:10.1007/978-3-540-75829-7_8.
   Google Scholar
• Granka, L. A. 2010. “The Politics of Search: A Decade Retrospective.” Information Society 26 (5): 364–374. doi:10.1080/01972243.2010.511560.
   Web of Science ®Google Scholar
• Haim, M., A. Graefe, and H. B. Brosius. 2018. “Burst of the Filter Bubble? Effects of Personalization on the Diversity of Google News.” Digital Journalism 6 (3): 330–343. doi:10.1080/21670811.2017.1338145.
   Web of Science ®Google Scholar
• Hannak, A., P. Sapiezynski, A. Molavi Kakhki, B. Krishnamurthy, D. Lazer, A. Mislove, and C. Wilson. 2013. “Measuring Personalization of Web Search.” Paper presented at Proceedings of the 22nd international conference on World Wide Web – WWW ’13, 527–538, ACM Press, New York, USA. doi:10.1145/2488388.2488435.
   Google Scholar
• Hargittai, E. 2007. “The Social, Political, Economic, and Cultural Dimensions of Search Engines: An Introduction.” Journal of Computer-Mediated Communication 12 (3): 769–777. doi:10.1111/j.1083-6101.2007.00349.x.
   Web of Science ®Google Scholar
• Hothorn, T., K. Hornik, and A. Zeileis. 2015. “ctree: Conditional Inference Trees.” The Comprehensive R Archive Network (Quinlan 1993), 1–34. https://cran.r-project.org/web/packages/partykit/vignettes/ctree.pdf.
   Google Scholar
• Introna, L. D., and H. Nissenbaum. 2000. “Shaping the Web: Why the Politics of Search Engines Matters.” Information Society 16 (3): 169–185. doi:10.1080/01972240050133634.
   Web of Science ®Google Scholar
• Just, N., and M. Latzer. 2017. “Governance by Algorithms: Reality Construction by Algorithmic Selection on the Internet.” Media, Culture & Society 39 (2): 238–258. doi:10.1177/0163443716643157.
   Web of Science ®Google Scholar
• Karnowski, V., A. S. Kümpel, L. Leonhard, and D. J. Leiner. 2017. “From Incidental News Exposure to News Engagement. How Perceptions of the News Post and News Usage Patterns Influence Engagement with News Articles Encountered on Facebook.” Computers in Human Behavior 76: 42–50. doi:10.1016/j.chb.2017.06.041.
   Web of Science ®Google Scholar
• Kitchin, R. 2017. “Thinking Critically About and Researching Algorithms.” Information, Communication & Society 20 (1): 14–29. doi:10.1080/1369118X.2016.1154087.
   Web of Science ®Google Scholar
• Kliman-Silver, C., A. Hannak, D. Lazer, C. Wilson, and A. Mislove. 2015. “Location, Location, Location.” Paper presented at Proceedings of the 2015 ACM Conference on Internet Measurement Conference - IMC ’15, 121–127, ACM Press, New York, USA. doi:10.1145/2815675.2815714.
   Google Scholar
• Krafft, T. D., M. Gamer, M. Laessing, and K. A. Zweig. 2017. Filterblase Geplatzt ? Kaum Raum für Personalisierung bei Google-Suchen zur Bundestagswahl 2017. Berlin: AlgorithmWatch.
   Google Scholar
• Mowshowitz, A., and A. Kawaguchi. 2002a. “Bias on the Web.” Communications of the ACM 45 (9): 56–60. doi:10.1145/567498.567527.
   PubMed Web of Science ®Google Scholar
• Mowshowitz, A., and A. Kawaguchi. 2002b. “Assessing Bias in Search Engines.” Information Processing and Management 38 (1): 141–156. doi:10.1016/S0306-4573(01)00020-6.
   Web of Science ®Google Scholar
• Mowshowitz, A., and A. Kawaguchi. 2005. “Measuring Search Engine Bias.” Information Processing and Management 41 (5): 1193–1205. doi:10.1016/j.ipm.2004.05.005.
   Web of Science ®Google Scholar
• Newman, N., R. Fletcher, A. Kalogeropoulos, D. A. L. Levy, and R. K. Nielsen. 2018. Reuters Institute Digital News Report 2018. Oxford: Reuters Institute for the Study of Journalism. http://media.digitalnewsreport.org/wp-content/uploads/2018/06/digital-news-report-2018.pdf.
   Google Scholar
• Nielsen, R. K., and S. A. Ganter. 2018. “Dealing with Digital Intermediaries: A Case Study of the Relations Between Publishers and Platforms.” New Media & Society 20 (4): 1600–1617. doi:10.1177/1461444817701318.
   Web of Science ®Google Scholar
• Nuernbergk, C., and J. Conrad. 2016. “Conversations and Campaign Dynamics in a Hybrid Media Environment: Use of Twitter by Members of the German Bundestag.” Social Media + Society 2 (1). doi:10.1177/2056305116628888.
   Web of Science ®Google Scholar
• Ørmen, J. 2016. “Googling the News: Opportunities and Challenges in Studying News Events Through Google Search. Digital Journalism 4 (1): 107–124. doi:10.1080/21670811.2015.1093272.
   Web of Science ®Google Scholar
• Pan, B., H. Hembrooke, T. Joachims, L. Lorigo, G. Gay, and L. Granka. 2007. “In Google We Trust: Users’ Decisions on Rank, Position, and Relevance.” Journal of Computer-Mediated Communication 12 (3): 801–823. doi:10.1111/j.1083-6101.2007.00351.x.
   Web of Science ®Google Scholar
• Pariser, E. 2012. The Filter Bubble: How the New Personalized Web is Changing What We Read and How We Think. New York: Penguin.
   Google Scholar
• Radlinski, F., and S. Dumais. 2006. “Improving Personalized Web Search Using Result Diversification.” Paper presented at Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval – SIGIR ’06, 691. ACM Press, New York, USA. doi:10.1145/1148170.1148320.
   Google Scholar
• Rieder, B., and G. Sire. 2014. “Conflicts of Interest and Incentives to Bias: A Microeconomic Critique of Google’s Tangled Position on the Web.” New Media and Society 16 (2): 195–211. doi:10.1177/1461444813481195.
   Web of Science ®Google Scholar
• Röhle, T. 2007. “Desperately Seeking the Consumer: Personalized Search Engines and the Commercial Exploitation of User Data.” First Monday 12 (9): 1–10.
   Google Scholar
• Satariano, A., D. Wakabayashi, and C. Kang. (2018, August 28). “Trump Accuses Google of Burying Conservative News in Search Results.” The New York Times. https://www.nytimes.com/2018/08/28/business/media/google-trump-news-results.html.
   Google Scholar
• Schmidt, J.-H. 2017. “Twitter-Nutzung von Kandidierenden der Bundestagswahl 2017. Verbreitung, Aktivität und Informationsquellen.” Media Perspektiven 12: 616–629.
   Google Scholar
• Schröder, J. 2012. Analyse: der typische Spiegel-Online-Nutzer. http://meedia.de/2012/11/29/analyse-der-typische-spiegel-online-nutzer/.
   Google Scholar
• Spink, A., B. J. Jansen, C. Blakely, and S. Koshman. 2006. “A Study of Results Overlap and Uniqueness Among Major Web Search Engines.” Information Processing and Management 42 (5): 1379–1391. doi:10.1016/j.ipm.2005.11.001.
   Web of Science ®Google Scholar
• Statista. 2017. So dominant ist Google in Europa. https://de-1statista-1com-100b48b610069.emedien3.sub.uni-hamburg.de/infografik/4696/marktanteile-von-google-in-europa/.
   Google Scholar
• Sunstein, C. R. 2001. Republic.com. Princeton, NJ: Princeton University Press.
   Google Scholar
• Toff, B., and R. K. Nielsen. 2018. “‘I Just Google It’: Folk Theories of Distributed Discovery.” Journal of Communication 68 (3): 636–657. doi:10.1093/joc/jqy009.
   Web of Science ®Google Scholar
• Trevisan, F., A. Hoskins, S. Oates, and D. Mahlouly. 2018. “The Google Voter: Search Engines and Elections in the New Media Ecology.” Information, Communication & Society 21 (1): 111–128. doi:10.1080/1369118X.2016.1261171.
   Web of Science ®Google Scholar
• Van Couvering, E. 2007. Is Relevance Relevant? Market, Science, and War: Discourses of Search Engine Quality. Journal of Computer-Mediated Communication 12 (3): 866–887. doi:10.1111/j.1083-6101.2007.00354.x.
   Google Scholar
• van Couvering, E. 2009. Search Engine Bias. http://etheses.lse.ac.uk/41/.
   Google Scholar
• van der Loo, M. 2014. {stringdist}: An {R} Package for Approximate String Matching. The R Journal 6 (1): 111–122.
   Google Scholar
• Van Leuven, S., S. Kruikemeier, S. Lecheler, and L. Hermans. 2018. “Online and Newsworthy.” Digital Journalism 6 (7): 798–806. doi:10.1080/21670811.2018.1498747.
   Web of Science ®Google Scholar
• Vaughan, L., and M. Thelwall. 2004. “Search Engine Coverage Bias: Evidence and Possible Causes.” Information Processing and Management 40 (4): 693–707. doi:10.1016/S0306-4573(03)00063-3.
   Web of Science ®Google Scholar
• Welch, M. J., J. Cho, and C. Olston. 2011. “Search Result Diversity for Informational Queries.” Paper presented at Proceedings of the 20th International Conference on World Wide Web – WWW ’11, 237. New York: ACM. doi:10.1145/1963405.1963441.
   Google Scholar
• Westlund, O. 2013. “Mobile News: A Review and Model of Journalism in an Age of Mobile Media.” Digital Journalism 1 (1): 6–26. doi:10.1080/21670811.2012.740273.
   Web of Science ®Google Scholar
• Yeung, K. 2017. “‘Hypernudge’: Big Data as a Mode of Regulation by Design.” Information, Communication & Society 20 (1): 118–136. doi:10.1080/1369118X.2016.1186713.
   Web of Science ®Google Scholar
• Zimmer, M. 2008. “The Externalities of Search 2.0: The Emerging Privacy Threats when the Drive for the Perfect Search Engine meets Web 2.0.” First Monday 13 (3): 1–12. doi:10.5210/fm.v13i3.2136.
   Google Scholar
• Zuiderveen Borgesius, F. J., D. Trilling, J. Möller, B. C. H. Bodó, de Vreese, and N. Helberger. 2016. “Should We Worry About Filter Bubbles?” Internet Policy Review 5 (1): 1–16. doi:10.14763/2016.1.401.
   Web of Science ®Google Scholar