Linking Survey and Media Content Data: Opportunities, Considerations, and Pitfalls

References

• Achen, C. H. (2000, July). Why lagged dependent variables can suppress the explanatory power of other independent variables. Paper presented at the Annual Meeting of the Midwest Political Science Association, Chicago.
   Google Scholar
• Adriaansen, M. L., Van Praag, P., & De Vreese, C. H. (2010). Substance matters: How news content can reduce political cynicism. International Journal of Public Opinion Research, 22(4), 433–457. doi:10.1093/ijpor/edq033
   Web of Science ®Google Scholar
• Althaus, S. L., & Tewksbury, D. H. (2007). Toward a new generation of media use measures for the ANES: Report to the Board of Overseers (ANES Pilot Study Report No. nes011903). Retrieved from: http://www.electionstudies.org/Library/papers/Pilot2006/nes011903.pdf
   Google Scholar
• Andersen, K., De Vreese, C. H., & Albæk, E. (2016). Measuring media diet in a high-choice environment: Testing the list-frequency technique. Communication Methods and Measures, 10(23), 81–98. doi:10.1080/19312458.2016.1150973
   Web of Science ®Google Scholar
• Angrist, J. D., & Pischke, J. S. (2008). Mostly harmless econometrics: An empiricist’s companion. Princeton, NJ: Princeton University Press.
   Google Scholar
• Arendt, F., & Brantner, C. (2015). Toward an implicit cognition account of attribute agenda setting. International Journal of Communication. 9, 2735–2756. Retrieved from http://ijoc.org/index.php/ijoc/article/view/4001
   Web of Science ®Google Scholar
• Bachl, M., & Scharkow, M. (2017). Correcting measurement error in content analysis. Communication Methods & Measures, 11, 87–104. forthcoming 10.1080/19312458.2017.1305103
   Web of Science ®Google Scholar
• Banducci, S., Giebler, H., & Kritzinger, S. (2015). Knowing more from less: How the information environment increases knowledge of party positions. British Journal of Political Science, 1–18. doi:10.1017/S0007123415000204
   Web of Science ®Google Scholar
• Baltagi, B. H. (2001). Econometric Analysis of Panel Data (second ed.) John Wiley & Sons.
   Google Scholar
• Baumgartner, S., Van Der Schur, W., Lemmens, J., & Te Poel, F. (2017). The relationship between media multitasking and attention problems in adolescents: Results of two longitudinal studies. Human Communication Research, forthcoming, doi:10.1111/hcre.12111
   Google Scholar
• Boomgaarden, H. G., Van Spanje, J., Vliegenthart, R., & De Vreese, C. H. (2011). Covering the crisis: Media coverage of the economic crisis and citizens’ economic expectations. Acta Politica, 46(4), 353–379. doi:10.1057/ap.2011.18
   Web of Science ®Google Scholar
• Boomgaarden, H. G., Vliegenthart, R., & De Vreese, C. H. (2012). A worldwide presidential election: The impact of the media on candidate and campaign evaluations. International Journal of Public Opinion Research, 24(1), 42–61. doi:10.1093/ijpor/edr041
   Web of Science ®Google Scholar
• Bos, L., Van Der Brug, W., & De Vreese, C. H. (2011). How the media shape perceptions of right-wing populist leaders. Political Communication, 28(2), 182–206. doi:10.1080/10584609.2011.564605
   Web of Science ®Google Scholar
• Boukes, M., & Vliegenthart, R. (2017). A general pattern of newsworthiness? Analyzing news values in popular, quality, regional and financial newspapers. Journalism. Advance online publication. doi:10.1177/1464884917725989
   Web of Science ®Google Scholar
• Burscher, B., Van Spanje, J., & De Vreese, C. H. (2015). Owning the issues of crime and immigration: The relation between immigration and crime news and anti-immigrant voting in 11 countries. Electoral Studies, 38, 59–69. doi:10.1016/j.electstud.2015.03.001
   Web of Science ®Google Scholar
• Damstra, A., & Boukes, M. (forthcoming). The economy, the news and the public: A longitudinal study of the impact of economic news on economic evaluations and expectations. Communication Research.
   Google Scholar
• De Vreese, C. H., Van Spanje, J. H. P., Schuck, A. R. T., Boomgaarden, H. G., Vliegenthart, R., Azrout, R., & Elenbaas, M. (2010). 2009 European election campaign study, scenario I: Data and documentation. University of Amsterdam.
   Google Scholar
• De Vreese, C. H. (2014). Kombination af indholdsanalyse og spørgeskemadata. In D. N. Hopmann, & M. Skovsgaard (Eds.), Forskningsmetoder i journalistik og politisk kommunikation (pp. 339–356). Copenhagen: Hans Reitzels Forlag.
   Google Scholar
• De Vreese, C. H., Azrout, R., & Möller, J. (2016). Cross road elections: Change in EU performance evaluations during the European Parliament elections 2014. Politics and Governance, 4(1), 69–82. doi:10.17645/pag.v4i1.462
   Web of Science ®Google Scholar
• De Vreese, C. H., Esser, F., & Hopmann, D. N. (2016). Comparing political journalism. New York: Routledge.
   Google Scholar
• De Vreese, C. H., & Neijens, P. (2016). Measuring media exposure in a changing communications environment. Communication Methods and Measures, 10(2–3), 69–80. doi:10.1080/19312458.2016.1150441
   Web of Science ®Google Scholar
• De Vreese, C. H., & Semetko, H. A. (2004). News matters: Influences on the vote in the Danish 2000 Euro referendum campaign. European Journal of Political Research, 43(5), 699–722. doi:10.1111/j.0304-4130.2004.00171.x
   Web of Science ®Google Scholar
• Desmet, P., Van Spanje, J., & De Vreese, C. H. (2015). Discussing the democratic deficit: Effects of media and interpersonal communication on satisfaction with democracy in the European Union. International Journal of Communication, 9, 3177–3198.
   Google Scholar
• Dilliplane, S., Goldman, S. K., & Mutz, D. C. (2013). Televised exposure to politics: New measures for a fragmented media environment. American Journal of Political Science, 57(1), 236–248. doi:10.1111/j.1540-5907.2012.00600.x
   Web of Science ®Google Scholar
• Druckman, J. N. (2005). Media matter: How newspapers and television news cover campaigns and influence voters. Political Communication, 22(4), 463–481. doi:10.1080/10584600500311394
   Web of Science ®Google Scholar
• Elenbaas, M., Boomgaarden, H. G., Schuck, A. R. T., & De Vreese, C. H. (2013). The impact of media coverage and motivation on performance-relevant information. Political Communication, 30(1), 1–16. doi:10.1080/10584609.2012.737411
   Web of Science ®Google Scholar
• Erbring, L., Goldenberg, E. N., & Miller, A. H. (1980). Front-page news and real-world cues: A new look at agenda-setting by the media. American Journal of Political Science, 24(1), 16–49. doi:10.2307/2110923
   Web of Science ®Google Scholar
• Eveland, J. W., & Scheufele, D. A. (2000). Connecting news media use with gaps in knowledge and participation. Political Communication, 17(3), 215–237. doi:10.1080/105846000414250
   Web of Science ®Google Scholar
• Eveland, W. P., Jr, & Morey, A. C. (2011). Challenges and opportunities of panel designs. In E. P. Bucy, & R. L. Holbert (Eds.), The sourcebook for political communication research: Methods, measures, and analytical techniques (pp. 19–33). New York, NY: Routledge.
   Google Scholar
• Fretwurst, B. (2015). Lotus Manual: Reliability and accuracy with SPSS. Zürich, Switzerland: Institut für angewandten Kommunikationsforschung.
   Google Scholar
• Garz, M. (2012). Job insecurity perceptions and media coverage of labor market policy. Journal of Labor Research, 33(4), 528–544. doi:10.1007/s12122-012-9146-9
   Web of Science ®Google Scholar
• Geers, S., & Bos, L. (2016). Priming issues, party visibility, and party evaluations: The impact on vote switching. Political Communication, 1–23. doi:10.1080/10584609.2016.1201179
   Web of Science ®Google Scholar
• Geiss, S. (2016). Media effects or method artifacts? Comparing strategies for linking content analysis and survey data. Paper presented to the Annual conference of the section Methods of Communication Research, DGPuK, Amsterdam.
   Google Scholar
• Gelman, A. (2015). The connection between varying treatment effects and the crisis of unreplicable research: A Bayesian perspective. Journal of Management, 41(2), 632–643. doi:10.1177/0149206314525208
   Web of Science ®Google Scholar
• Gelman, A., & Loken, E. (2013). The garden of forking paths: Why multiple comparisons can be a problem, even when there is no “fishing expedition” or “p-hacking” and the research hypothesis was posited ahead of time ( Unpublished manuscript). Department of Statistics, Columbia University, New York.
   Google Scholar
• Gil De Zúñiga, H., Jung, N., & Valenzuela, S. (2012). Social media use for news and individuals’ social capital, civic engagement and political participation. Journal of Computer‐Mediated Communication, 17(3), 319–336. doi:10.1111/j.1083-6101.2012.01574.x
   Web of Science ®Google Scholar
• Graber, D. (2004). Mediated politics and citizenship in the twenty-first century. Annual Review of Psychology, 55, 545–571. doi:10.1146/annurev.psych.55.090902.141550
   PubMed Web of Science ®Google Scholar
• Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. (2015). A critique of the cross-lagged panel model. Psychological Methods, 20(1), 102–116. doi:10.1037/a0038889
   PubMed Web of Science ®Google Scholar
• Hester, J. B., & Gibson, R. (2003). The economy and second-level agenda setting: A time-series analysis of economic news and public opinion about the economy. Journalism & Mass Communication Quarterly, 80(1), 73–90. doi:10.1177/107769900308000106
   Web of Science ®Google Scholar
• Hobolt, S., & Tilley, J. (2014). Responsibility without accountability in the European Union. Oxford: Oxford University Press.
   Google Scholar
• Hopmann, D. N., Shehata, A., & Strömbäck, J. (2015). Contagious media effects: How media use and exposure to game-framed news influence media trust. Mass Communication and Society, 18(6), 776–798. doi:10.1080/15205436.2015.1022190
   Web of Science ®Google Scholar
• Hopmann, D. N., Van Aelst, P., & Legnante, G. (2011, May). Partisan bias in the news. Paper presented at the Annual Conference of the International Communication Association, Boston.
   Google Scholar
• Hopmann, D. N., Vliegenthart, R., De Vreese, C. H., & Albæk, E. (2010). Effects of election news coverage: How visibility and tone influence party choice. Political Communication, 27(4), 389–405. doi:10.1080/10584609.2010.516798
   Web of Science ®Google Scholar
• Jebril, N., De Vreese, C. H., Van Dalen, A., & Albæk, E. (2013). The effects of human interest and conflict news frames on the dynamics of political knowledge gains. Scandinavian Political Studies, 36(3), 201–226. doi:10.1111/1467-9477.12003
   Web of Science ®Google Scholar
• Johnson, R., & Brady, H. E. (2002). The rolling cross-section design. Electoral Studies, 21(2), 283–295. doi:10.1016/S0261-3794(01)00022-1
   Web of Science ®Google Scholar
• Kalogeropoulos, A., Albæk, E., De Vreese, C. H., & Van Dalen, A. (2016). News priming and the changing economy: How economic news influences government evaluations. International Journal of Public Opinion Research. doi:10.1093/ijpor/edv048
   Web of Science ®Google Scholar
• Kepplinger, H. M., Brosius, H.-B., & Staab, J. F. (1991). Opinion formation in mediated conflicts and crises: A theory of cognitive-affective media effects. International Journal of Public Opinion Research, 3(2), 132–156. doi:10.1093/ijpor/3.2.132
   Google Scholar
• Kepplinger, H. M., Geiss, S., & Siebert, S. (2012). Framing scandals: Cognitive and emotional media effects. Journal of Communication, 62(4), 659–681. doi:10.1111/j.14602466.2012.01653.x
   Web of Science ®Google Scholar
• Kiousis, S. (2011). Agenda-setting and attitudes: Exploring the impact of media salience on perceived salience and public attitude strength of US presidential candidates from 1984 to 2004. Journalism Studies, 12(3), 359–374. doi:10.1080/1461670X.2010.501149
   Web of Science ®Google Scholar
• Lazarsfeld, P. F., Berelson, B., & Gaudet, H. (1944). The people’s choice: How the voter makes up his mind in a presidential election. New York, NY: Duell, Sloan and Pearce.
   Google Scholar
• Lengauer, G., & Höller, I. (2012). Contest framing and its effects on voter (de)mobilisation: News exposure and its impact on voting turnout in the 2008 Austrian elections. Javnost - the Public: Journal of the European Institute for Communication and Culture, 19(4), 73–91. doi:10.1080/13183222.2012.11009097
   Web of Science ®Google Scholar
• Matthes, J. (2012). Exposure to counterattitudinal news coverage and the timing of voting decisions. Communication Research, 39(2), 147–169. doi:10.1177/0093650211402322
   Web of Science ®Google Scholar
• Möller, J., & De Vreese, C. (2015). Spiral of political learning: The reciprocal relationship of news media use and political knowledge among adolescents. Communication Research, 1–17. doi:10.1177/0093650215605148
   Web of Science ®Google Scholar
• Moon, S. J. (2013). Attention, attitude, and behavior second-level agenda-setting effects as a mediator of media use and political participation. Communication Research, 40(5), 698–719. doi:10.1177/0093650211423021
   Web of Science ®Google Scholar
• Nagelhout, G. E., Van Den Putte, B., De Vries, H., Crone, M., Fong, G. T., & Willemsen, M. C. (2012). The influence of newspaper coverage and a media campaign on smokers’ support for smoke-free bares and restaurants and on second-hand smoke harm awareness. Tobacco Control, 21(1), 24–29. doi:10.1136/tc.2010.040477
   PubMed Web of Science ®Google Scholar
• Nir, L., & Druckman, J. N. (2008). Campaign mixed-message flows and timing of vote decision. International Journal of Public Opinion Research, 20(3), 326–346. doi:10.1093/ijpor/edn035
   Web of Science ®Google Scholar
• Noelle-Neumann, E. (1973). Return to the concept of the powerful mass media. Studies in Broadcasting, 9, 67–112.
   Google Scholar
• Peter, J. (2004). Our long ‘return to the concept of powerful mass media’: A cross-national comparative investigation of the effects of consonant media coverage. International Journal of Public Opinion Research, 16(2), 144–168. doi:10.1093/ijpor/16.2.144
   Web of Science ®Google Scholar
• Price, V., & Zaller, J. (1993). Who gets the news? Alternative measures of news reception and their implications for research. Public Opinion Quarterly, 57(2), 133–164. doi:10.1086/269363
   Web of Science ®Google Scholar
• Prior, M. (2009). The immensely inflated news audience: Assessing bias in self-reported news exposure. Public Opinion Quarterly, 73(1), 130–143. doi:10.1093/poq/nfp002
   Web of Science ®Google Scholar
• Romer, D., Kenski, K., Winneg, K., Adasiewicz, C., & Jamieson, K. H. (2006). Capturing campaign dynamics, 2000 and 2004: The national Annenberg election survey. Philadelphia, PA: University of Pennsylvania Press.
   Google Scholar
• Rössler, P. (1999). The individual agenda-designing process: How interpersonal communication, egocentric networks, and mass media shape the perception of political issues by individuals. Communication Research, 26(6), 666–700. doi:10.1177/00936509902600600
   Web of Science ®Google Scholar
• Scharkow, M., & Bachl, M. (2016). How measurement error in content analysis and self-reported media use leads to minimal media effect findings in linkage analysis: A simulation study. Political Communication, Advance online publication. doi:10.1080/10584609.2016.1235640
   PubMed Web of Science ®Google Scholar
• Schmitt-Beck, R., Bytzek, E., Rittinger, H., Roßteutscher, S., & Weßels, B. (2009, May 21–25). The German longitudinal election study (GLES). Paper prepared for delivery at the 2009 Annual Conference of the International Communication Association (ICA), New Opportunities and New Choices for Campaign and Election Studies, Chicago.
   Google Scholar
• Schuck, A. R. T., Boomgaarden, H. G., & De Vreese, C. H. (2013). Cynics all around? The impact of election news on political cynicism in comparative perspective. Journal of Communication, 63(2), 287–311. doi:10.1111/jcom.12023
   Web of Science ®Google Scholar
• Schuck, A. R. T., & De Vreese, C. H. (2008). The Dutch no to the EU constitution: Assessing the role of EU skepticism and the campaign. Journal of Elections, Public Opinion and Parties, 18(1), 101–128. doi:10.1080/17457280701858656
   Google Scholar
• Schuck, A. R. T., & De Vreese, C. H. (2009). Reversed mobilization in referendum campaigns: How positive news framing can mobilize the skeptics. The International Journal of Press/Politics, 14(1), 40–66. doi:10.1177/1940161208326926
   Web of Science ®Google Scholar
• Schuck, A. R. T., Vliegenthart, R., & De Vreese, C. H. (2016a). Who’s afraid of conflict? The mobilizing effect of conflict framing in campaign news. British Journal of Political Science, 46(1), 177–194. doi:10.1017/S0007123413000525
   Web of Science ®Google Scholar
• Schuck, A. R. T., Vliegenthart, R., & De Vreese, C. H. (2016b). Matching theory and data: Why combining media content with survey data matters. British Journal of Political Science, 46(1), 205–213. doi:10.1017/S0007123415000228
   Web of Science ®Google Scholar
• Shehata, A. (2014). Game frames, issue frames, and mobilization: Disentangling the effects of frame exposure and motivated news attention on political cynicism and engagement. International Journal of Public Opinion Research, 26(2), 157–177. doi:10.1093/ijpor/edt034
   Web of Science ®Google Scholar
• Shoemaker, P., & Reese, S. D. (1990). Exposure to what? Integrating media content and effects studies. Journalism & Mass Communication Quarterly, 67(4), 649–652.
   Google Scholar
• Slater, M. D. (2004). Operationalizing and analyzing exposure: The foundation of media effects research. Journalism and Mass Communication Quarterly, 81(1), 168–183. doi:10.1177/107769900408100112
   Web of Science ®Google Scholar
• Slater, M. D. (2016). Combining content analysis and assessment of exposure through self-report, spatial, or temporal variation in media effects research. Communication Methods & Measures, 10(2–3), 173–175. doi:10.1080/19312458.2016.1150969
   Web of Science ®Google Scholar
• Statham, P., & Tumber, H. (2013). Relating news analysis and public opinion: Applying a communications method as a ‘tool’ to aid interpretation of survey results. Journalism, 14(6), 737–753. doi:10.1177/1464884913491044
   Web of Science ®Google Scholar
• Van Spanje, J., & De Vreese, C. (2014). Europhile media and eurosceptic voting: Effects of news media coverage on eurosceptic voting in the 2009 European parliamentary elections. Political Communication, 31(2), 325–354. doi:10.1080/10584609.2013.828137
   Web of Science ®Google Scholar
• Vermeulen, I., Beukeboom, C. Batenburg, A., Avramiea, A., Stoyanov, D., van de Velde, B., & Oegema, D. (2016). Blinded by the Light: how a focus on statistical “significance” may cause p-value misreporting and an excess of p-values just below .05 in communication science. Communication Methods & Measures, 9(4), 253–279.
   Web of Science ®Google Scholar
• Vliegenthart, R., & Boomgaarden, H. G. (2007). Real-world indicators and the coverage of immigration and the integration of minorities in Dutch newspapers. European Journal of Communication, 22(3), 293–314. doi:10.1177/0267323107079676
   Web of Science ®Google Scholar
• Vliegenthart, R., Schuck, A. R. T., Boomgaarden, H. G., & De Vreese, C. H. (2008). News coverage and support for European integration, 1990–2006. International Journal of Public Opinion Research, 20(4), 415–439. doi:10.1093/ijpor/edn044
   Web of Science ®Google Scholar
• Wilson, S. E., & Butler, D. M. (2007). A lot more to do: The sensitivity of time-series cross-section analyses to simple alternative specifications. Political Analysis, 15(2), 101–123. doi:10.1093/pan/mpl012
   Web of Science ®Google Scholar
• Wolling, J. (2002). Methodenkombination in der Medienwirkungsforschung: Der Entscheidungsprozess bei der Verknüpfung von Umfrage- und Inhaltsanalysedaten. ZUMA Nachrichten. 50, 54–85. Retrieved from http://nbn-resolving.de/urn:nbn:de:0168-ssoar-207905
   Google Scholar
• Yanovitzky, I., & Cappella, J. N. (2001). Effect of call-in political talk radio shows on their audiences: Evidence from a multi-wave panel analysis. International Journal of Public Opinion Research, 13(4), 377–397. doi:10.1093/ijpor/13.4.377
   Web of Science ®Google Scholar