How Measurement Error in Content Analysis and Self-Reported Media Use Leads to Minimal Media Effect Findings in Linkage Analyses: A Simulation Study

References

• Allen, R. L. (1981). The reliability and stability of television exposure. Communication Research, 8(2), 233–256. doi:10.1177/009365028100800205
   Web of Science ®Google Scholar
• Ansolabehere, S., & Iyengar, S. (1995). Messages forgotten: Misreporting in surveys and the bias toward minimal effects. Retrieved from http://pcl.stanford.edu/common/docs/research/ansolabehere/1995/messages.pdf
   Google Scholar
• Arceneaux, K. (2010). The benefits of experimental methods for the study of campaign effects. Political Communication, 27(2), 199–215. doi:10.1080/10584601003709407
   Web of Science ®Google Scholar
• Bartels, L. M. (1993). Messages received: The political impact of media exposure. American Political Science Review, 87(2), 267–285. doi:10.2307/2939040
   Web of Science ®Google Scholar
• Bennett, W. L., & Iyengar, S. (2008). A new era of minimal effects? The changing foundations of political communication. Journal of Communication, 58(4), 707–731. doi:10.1111/j.1460-2466.2008.00410.x
   Web of Science ®Google Scholar
• Benoit, K., Laver, M., & Mikhaylov, S. (2009). Treating words as data with error: Uncertainty in text statements of policy positions. American Journal of Political Science, 53(2), 495–513. doi:10.1111/j.1540-5907.2009.00383.x
   Web of Science ®Google Scholar
• Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: Wiley.
   Google Scholar
• Boomgaarden, H. G., van Spanje, J., Vliegenthart, R., & de Vreese, C. H. (2011). Covering the crisis: Media coverage of the economic crisis and citizens’ economic expectations. Acta Politica, 46(4), 353–379. doi:10.1057/ap.2011.18
   Web of Science ®Google Scholar
• Burscher, B., van Spanje, J., & de Vreese, C. H. (2015). Owning the issues of crime and immigration: The relation between immigration and crime news and anti-immigrant voting in 11 countries. Electoral Studies, 38, 59–69. doi:10.1016/j.electstud.2015.03.001
   Web of Science ®Google Scholar
• Chaffee, S. H., & Schleuder, J. (1986). Measurement and effects of attention to media news. Human Communication Research, 13(1), 76–107. doi:10.1111/j.1468-2958.1986.tb00096.x
   Web of Science ®Google Scholar
• Cook, J. R., & Stefanski, L. A. (1994). Simulation-extrapolation estimation in parametric measurement error models. Journal of the American Statistical Association, 89(428), 1314–1328. doi:10.1080/01621459.1994.10476871
   Web of Science ®Google Scholar
• Dalton, R. J., Beck, P. A., & Huckfeldt, R. (1998). Partisan cues and the media: Information flows in the 1992 presidential election. American Political Science Review, 91(1), 111–126. doi:10.2307/2585932
   Web of Science ®Google Scholar
• Desmet, P., van Spanje, J., & de Vreese, C. H. (2015). Discussing the democratic deficit: Effects of media and interpersonal communication on satisfaction with democracy in the European Union. International Journal of Communication, 9, 3177–3198. doi:1932–8036/20150005
   Google Scholar
• de Vreese, C. H., & Neijens, P. (2016). Measuring media exposure in a changing communications environment. Communication Methods and Measures, 10(2–3), 69–80. doi:10.1080/19312458.2016.1150441
   Web of Science ®Google Scholar
• de Vreese, C. H., & Semetko, H. A. (2004). News matters: Influences on the vote in the Danish 2000 Euro referendum campaign. European Journal of Political Research, 43(5), 699–722. doi:10.1111/j.0304-4130.2004.00171.x
   Web of Science ®Google Scholar
• Dilliplane, S., Goldman, S. K., & Mutz, D. C. (2013). Televised exposure to politics: New measures for a fragmented media environment. American Journal of Political Science, 57(1), 236–248. doi:10.1111/j.1540-5907.2012.00600.x
   Web of Science ®Google Scholar
• Dosemeci, M., Wacholder, S., & Lubin, J. (1990). Does nondifferential misclassification of exposure always bias a true effect toward the null value? American Journal of Epidemiology, 132(4), 746–748.
   PubMed Web of Science ®Google Scholar
• Elenbaas, M., Boomgaarden, H. G., Schuck, A. R. T., & de Vreese, C. H. (2013). The impact of media coverage and motivation on performance-relevant information. Political Communication, 30(1), 1–16. doi:10.1080/10584609.2012.737411
   Web of Science ®Google Scholar
• Elenbaas, M., & de Vreese, C. H. (2008). The effects of strategic news on political cynicism and vote choice among young voters. Journal of Communication, 58(3), 550–567. doi:10.1111/j.1460-2466.2008.00399.x
   Web of Science ®Google Scholar
• Erbring, L., Goldenberg, E. N., & Miller, A. H. (1980). Front-page news and real-world cues: A new look at agenda-setting by the media. American Journal of Political Science, 24(1), 16–49. doi:10.2307/2110923
   Web of Science ®Google Scholar
• Fazekas, Z., & Larsen, E. G. (2016). Media content and political behavior in observational research: A critical assessment. British Journal of Political Science, 46(1), 195–204. doi:10.1017/S000712341500006X
   Web of Science ®Google Scholar
• Franz, M. M., & Ridout, T. N. (2007). Does political advertising persuade? Political Behavior, 29(4), 465–491. doi:10.1007/s11109-007-9032-y
   Web of Science ®Google Scholar
• Freedman, P., & Goldstein, K. (1999). Measuring media exposure and the effects of negative campaign ads. American Journal of Political Science, 43(4), 1189–1208. doi:10.2307/2991823
   Web of Science ®Google Scholar
• Fuller, W. A. (1987). Measurement error models. New York, NY: Wiley.
   Google Scholar
• Goldman, S. K., Mutz, D. C., & Dilliplane, S. (2013). All virtue is relative: A response to Prior. Political Communication, 30(4), 635–653. doi:10.1080/10584609.2013.819540
   Web of Science ®Google Scholar
• Goldstein, K., & Freedman, P. (2002). Lessons learned: Campaign advertising in the 2000 elections. Political Communication, 19(1), 5–28. doi:10.1080/105846002317246461
   Web of Science ®Google Scholar
• Hardin, J. W., & Carroll, R. J. (2003). Measurement error, GLMs, and notational conventions. Stata Journal, 3(4), 329–341.
   Google Scholar
• Heise, D. R. (1969). Separating reliability and stability in test-retest correlation. American Sociological Review, 34(1), 93–101. doi:10.2307/2092790
   Web of Science ®Google Scholar
• Hillard, D., Purpura, S., & Wilkerson, J. (2008). Computer-assisted topic classification for mixed-methods social science research. Journal of Information Technology & Politics, 4(4), 31–46. doi:10.1080/19331680801975367
   Google Scholar
• Hügel, R., Degenhardt, W., & Weiss, H.-J. (1989). Structural equation models for the analysis of the agenda-setting process. European Journal of Communication, 4(2), 191–210. doi:10.1177/0267323189004002005
   Google Scholar
• Iyengar, S. (2001). The method is the message: The current state of political communication research. Political Communication, 18(2), 225–229. doi:10.1080/105846001750322998
   Web of Science ®Google Scholar
• Iyengar, S. (2011). Experimental designs for political communication research: Using new technology and online participant pools to overcome the problem of generalizability. In E. P. Bucy & R. L. Holbert (Eds.), Sourcebook for political communication research. Methods, measures, and analytical techniques (pp. 129–148). New York, NY: Routledge.
   Google Scholar
• Iyengar, S., & Simon, A. F. (2000). New perspectives and evidence on political communication and campaign effects. Annual Review of Psychology, 51(1), 149–169. doi:10.1146/annurev.psych.51.1.149
   PubMed Web of Science ®Google Scholar
• Jebril, N., de Vreese, C. H., Dalen, A. V., & Albæk, E. (2013). The effects of human interest and conflict news frames on the dynamics of political knowledge gains: Evidence from a cross-national study. Scandinavian Political Studies, 36(3), 201–226. doi:10.1111/1467-9477.12003
   Web of Science ®Google Scholar
• Kepplinger, H. M., Brosius, H.-B., & Staab, J. F. (1991). Opinion formation in mediated conflicts and crises: A theory of cognitive-affective media effects. International Journal of Public Opinion Research, 3(2), 132–156. doi:10.1093/ijpor/3.2.132
   Google Scholar
• Kepplinger, H. M., Geiss, S., & Siebert, S. (2012). Framing scandals: Cognitive and emotional media effects. Journal of Communication, 62(4), 659–681. doi:10.1111/j.1460-2466.2012.01653.x
   Web of Science ®Google Scholar
• Kleinnijenhuis, J. (1991). Newspaper complexity and the knowledge gap. European Journal of Communication, 6(4), 499–522. doi:10.1177/0267323191006004006
   Google Scholar
• Krippendorff, K. (2013). Content analysis: An introduction to its methodology (3rd ed.). Thousand Oaks, CA: Sage.
   Google Scholar
• LaCour, M. J., & Vavreck, L. (2014). Improving media measurement: Evidence from the field. Political Communication, 31(3), 408–420. doi:10.1080/10584609.2014.921258
   Web of Science ®Google Scholar
• Lazarsfeld, P. F., Berelson, B., & Gaudet, H. (1968). The people’s choice: How the voter makes up his mind in a presidential campaign (3rd ed.). New York, NY: Columbia University Press.
   Google Scholar
• Lee, C.-J., Hornik, R., &, M. (2008). The reliability and stability of general media exposure measures. Communication Methods and Measures, 2(1–2), 6–22. doi:10.1080/19312450802063024
   Google Scholar
• Matthes, J. (2012). Exposure to counterattitudinal news coverage and the timing of voting decisions. Communication Research, 39(2), 147–169. doi:10.1177/0093650211402322
   Web of Science ®Google Scholar
• McGuire, W. J. (1986). The myth of massive media impact: Savagings and salvagings. In G. Comstock (Ed.), Public communication and behavior (vol. 1, pp. 173–257). Orlando, FL: Academic Press.
   Google Scholar
• Miller, A. H., Goldenberg, E. N., & Erbring, L. (1979). Type-set politics: Impact of newspapers on public confidence. American Political Science Review, 73(1), 67–84. doi:10.2307/1954731
   Web of Science ®Google Scholar
• Mutz, D. C. (1992). Mass media and the depoliticization of personal experience. American Journal of Political Science, 36(2), 483–508. doi:10.2307/2111487
   Web of Science ®Google Scholar
• Peter, J. (2003). Country characteristics as contingent conditions of agenda setting: The moderating influence of polarized elite opinion. Communication Research, 30(6), 683–712. doi:10.1177/0093650203257844
   Web of Science ®Google Scholar
• Price, V., & Zaller, J. (1990). Evaluation of media exposure items in the 1989 NES Pilot Study. Retrieved from http://www.electionstudies.org/Library/papers/documents/nes002283.pdf
   Google Scholar
• Price, V., & Zaller, J. (1993). Who gets the news? Alternative measures of news reception and their implications for research. Public Opinion Quarterly, 57(2), 133–164. doi:10.1086/269363
   Web of Science ®Google Scholar
• Prior, M. (2009). The immensely inflated news audience: Assessing bias in self-reported news exposure. Public Opinion Quarterly, 73(1), 130–143. doi:10.1093/poq/nfp002
   Web of Science ®Google Scholar
• Prior, M. (2013). The challenge of measuring media exposure: Reply to Dilliplane, Goldman, and Mutz. Political Communication, 30(4), 620–634. doi:10.1080/10584609.2013.819539
   Web of Science ®Google Scholar
• Romantan, A., Hornik, R., Price, V., Cappella, J., & Viswanath, K. (2008). A comparative analysis of the performance of alternative measures of exposure. Communication Methods and Measures, 2(1–2), 80–99. doi:10.1080/19312450802062539
   Google Scholar
• Rössler, P. (1999). The individual agenda-designing process: How interpersonal communication, egocentric networks, and mass media shape the perception of political issues by individuals. Communication Research, 26(6), 666–700. doi:10.1177/009365099026006002
   Web of Science ®Google Scholar
• Scharkow, M. (2016). The accuracy of self-reported Internet use: A validation study using client log data. Communication Methods and Measures, 10(1), 13–27. doi:10.1080/19312458.2015.1118446
   Web of Science ®Google Scholar
• Schemer, C. (2012). The influence of news media on stereotypic attitudes toward immigrants in a political campaign. Journal of Communication, 62(5), 739–757. doi:10.1111/j.1460-2466.2012.01672.x
   Web of Science ®Google Scholar
• Schuck, A. R. T., Boomgaarden, H. G., & de Vreese, C. H. (2013). Cynics all around? The impact of election news on political cynicism in comparative perspective. Journal of Communication, 63(2), 287–311. doi:10.1111/jcom.12023
   Web of Science ®Google Scholar
• Schuck, A. R. T., Vliegenthart, R., & de Vreese, C. H. (2016a). Matching theory and data: Why combining media content with survey data matters. British Journal of Political Science, 46(1), 205–213. doi:10.1017/S0007123415000228
   Web of Science ®Google Scholar
• Schuck, A. R. T., Vliegenthart, R., & de Vreese, C. H. (2016b). Who’s afraid of conflict? The mobilizing effect of conflict framing in campaign news. British Journal of Political Science, 46(1), 177–194. doi:10.1017/s0007123413000525
   Web of Science ®Google Scholar
• Schwartz, J. (1985). The neglected problem of measurement error in categorical data. Sociological Methods & Research, 13(4), 435–466. doi:10.1177/0049124185013004001
   Web of Science ®Google Scholar
• Schwarz, N., &, D. (2001). Asking questions about behavior: Cognition, communication, and questionnaire construction. American Journal of Evaluation, 22(2), 127–160. doi:10.1177/109821400102200202
   Web of Science ®Google Scholar
• Shoemaker, P. J., & Reese, S. D. (1990). Exposure to what? Integrating media content and effects studies. Journalism & Mass Communication Quarterly, 67(4), 649–652. doi:10.1177/107769909006700418
   Web of Science ®Google Scholar
• Slater, M. D. (2004). Operationalizing and analyzing exposure: The foundation of media effects research. Journalism & Mass Communication Quarterly, 81(1), 168–183. doi:10.1177/107769900408100112
   Web of Science ®Google Scholar
• Slater, M. D. (2016). Combining content analysis and assessment of exposure through self-report, spatial, or temporal variation in media effects research. Communication Methods and Measures, 10(2–3), 173–175. doi:10.1080/19312458.2016.1150969
   Web of Science ®Google Scholar
• Takens, J., Kleinnijenhuis, J., Hoof, A. V., & Atteveldt, W. V. (2015). Party leaders in the media and voting behavior: Priming rather than learning or projection. Political Communication, 32(2), 249–267. doi:10.1080/10584609.2014.944319
   Web of Science ®Google Scholar
• Valkenburg, P. M., & Peter, J. (2013). Five challenges for the future of media-effects research. International Journal of Communication, 7, 197–215. doi:1932–8036/2013FEA0002
   Web of Science ®Google Scholar
• van Spanje, J., & de Vreese, C. (2014). Europhile media and Eurosceptic voting: Effects of news media coverage on Eurosceptic voting in the 2009 European parliamentary elections. Political Communication, 31(2), 325–354. doi:10.1080/10584609.2013.828137
   Web of Science ®Google Scholar
• Vavreck, L. (2007). The exaggerated effects of advertising on turnout: The dangers of self-reports. Quarterly Journal of Political Science, 2(4), 325–343. doi:10.1561/100.00006005
   Web of Science ®Google Scholar
• Wiley, D. E., & Wiley, J. A. (1970). The estimation of measurement error in panel data. American Sociological Review, 35(1), 112–117. doi:10.2307/2093858
   Web of Science ®Google Scholar
• Wonneberger, A., & Irazoqui, M. (2016). Explaining response errors of self-reported frequency and duration of TV exposure through individual and contextual factors. Journalism & Mass Communication Quarterly. Advance online publication. doi:10.1177/1077699016629372
   Web of Science ®Google Scholar
• Zaller, J. (2002). The statistical power of election studies to detect media exposure effects in political campaigns. Electoral Studies, 21(2), 297–329. doi:10.1016/S0261-3794(01)00023-3
   Web of Science ®Google Scholar