Conceptual, Empirical, and Practical Issues in Developing Valid Measures of Public Communication Campaign Exposure

REFERENCES

• Anderson, P. A., Buller, D. B., Voeks, J. H., Walkosz, B. J., Scott, M. D., Cutter, G. R., & Dignan, M. B. (2008). Testing the long–term effects of the Go Sun Smart worksite health communication campaign: A group–randomized experimental study. Journal of Communication, 58, 447–471.
   Web of Science ®Google Scholar
• Annenberg Media Exposure Research Group (2008). Linking measures of media exposure to sexual cognitions and behavior: A review. Communication Methods and Measures, 2(1–2), 23–42.
   Google Scholar
• Avery, R. J., Eisenberg, M. D., & Simon, K. I. (2012). The impact of direct–to–consumer television and magazine advertising on antidepressant use. Journal of Health Economics, 31(5), 705–718.
   PubMed Web of Science ®Google Scholar
• Avery, R. J., Kenkel, D., Lillard, D., & Mathios, A. D. (2007). Public profits and public health: Does advertising smoking cessation products encourage smokers to quit? Journal of Political Economy, 115(3), 447–481.
   Web of Science ®Google Scholar
• Balamurugan, A., Rivera, M., Sutphin, K., & Campbell, D. (2007). Health communications in rural America: Lessons learned from an arthritis campaign in rural Arkansas. The Journal of Rural Health, 23(3), 270–275.
   PubMed Web of Science ®Google Scholar
• Biener, L., Wakefield, M., Shiner, C. M., & Siegel, M. (2008). How broadcast volume and emotional content affect youth recall of anti–tobacco advertising. American Journal of Preventive Medicine, 35(1), 14–19.
   PubMed Web of Science ®Google Scholar
• Brown, J. D., Bauman, K. E., & Padgett, C. A. (1990). A validity problem in measuring exposure to mass media campaigns. Health Education Quarterly, 17(3), 299–306.
   PubMedGoogle Scholar
• Cappella, J. N. (2006). Integrating message effects and behavior change theories: Organizing comments and unanswered questions. Journal of Communication, 56 (S1), S265– 279.
   Google Scholar
• Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Sage University Paper Series on Quantitative Applications in the Social Sciences (07–017). Newbury Park, CA: Sage.
   Google Scholar
• Carpenter, C. J., & Boster, F. J. (2013). The relationship between message recall and persuasion: More complex than it seems. Journal of Communication, 63, 661–681.
   Web of Science ®Google Scholar
• Carpenter, C. S., & Pechmann, C. (2011). Exposure to above the influence antidrug advertisements and adolescent marijuana use in the United States, 2006–2008. American Journal of Public Health, 101, 948–954.
   PubMed Web of Science ®Google Scholar
• Collins, R. L. (2008). Media multitasking: issues posed in measuring the effects of television sexual content exposure. Communication Methods and Measures, 2(1–2), 65–79.
   PubMedGoogle Scholar
• Cowling, D. W., Modayil, M. V., & Stevens, C. (2010). Assessing the relationship between ad volume and awareness of a tobacco education media campaign. Tobacco Control, 19(S1), i37–42.
   PubMedGoogle Scholar
• Davis, K C., Farrelly, M. C., Messeri, P., & Duke, J. (2011). The impact of national smoking prevention campaigns on tobacco–related beliefs, intentions to smoke, and smoking initiation: Results from a longitudinal survey of youth in the United States. International Journal of Environmental Research and Public Health, 6, 722–740.
   Web of Science ®Google Scholar
• Dunlop, S. M., Perez, D., & Cotter, T. (2012). The natural history of antismoking advertising recall: The influence of broadcasting parameters, emotional intensity, and executional features. Tobacco Control. Retrieved from http://tobaccocontrol.bmj.com/content/early/2012/11/09/tobaccocontrol–2011–050256.short
   Google Scholar
• Dunlop, S. M., Wakefield, M., & Kashima, Y. (2008). The contribution of antismoking advertising to quitting: Intra– and Interpersonal processes. Journal of Health Communication, 13(3), 250–266.
   PubMed Web of Science ®Google Scholar
• du Plessis, E. (1994). Recognition versus recall. Journal of Advertising Research, 34(3), 75–91.
   Web of Science ®Google Scholar
• Farquhar, J. W., Fortmann, S. P., Flora, J. A., Taylor, C. B., Haskell, W. L., Williams, P. T., … Wood, P. D. (1990). Effects of community wide education on cardiovascular disease risk factors: The Stanford Five–City Project. Journal of the American Medical Association, 264(3), 359–365.
   PubMed Web of Science ®Google Scholar
• Farrelly, M. C., Davis, K. C., Haviland, M. L., Messeri, P., & Healton, C. G. (2005). Evidence of a dose–response relationship between “truth” antismoking ads and youth smoking prevalence. American Journal of Public Health, 95(3), 425–431.
   PubMed Web of Science ®Google Scholar
• Farrelly, M. C., Davis, K. C., Nonnemaker, J. M., Kamyab, K., & Jackson, C. (2011). Promoting calls to a quitline: Quantifying the influence of message theme, strong negative emotions and graphic images in television advertisements. Tobacco Control, 20, 279–284.
   PubMed Web of Science ®Google Scholar
• Farrelly, M. C., Healton, C. G., Davis, K. C., Messeri, P., Hersey, J. C., & Haviland, L. M. (2002). Getting to the Truth: Evaluating national tobacco countermarketing campaigns. American Journal of Public Health, 92(6), 901–907.
   PubMed Web of Science ®Google Scholar
• Fishbein, M., & Hornik, R. (2008). Measuring media exposure: An introduction to the special issue. Communication Methods and Measures, 2(1–2), 1–5.
   Google Scholar
• Freedman, P., & Goldstein, K. (1999). Measuring media exposure and the effects of negative campaign ads. American Journal of Political Science, 43(4), 1189–1208.
   Web of Science ®Google Scholar
• Helme, D. W., Noar, S. M., Allard, S., Zimmerman, R. S., Palmgreen, P., & McClanahan, K. J. (2011). In–depth investigation of interpersonal discussions in response to a safer sex mass media campaign. Health Communication, 26, 366–378.
   PubMed Web of Science ®Google Scholar
• Holder, H. D., & Treno, A. J. (1997). Media advocacy in community prevention: News as a means to advance policy change. Addiction, 92(S2), S189–199.
   Google Scholar
• Hornik, R. C. (1991). Alternative models of behavior change. In J. Wasserheit, S. O. Aral, & K. K. Holmes ( Eds.), Research issues in human behavior and sexually transmitted diseases in the AIDS era ( pp. 201–217). Washington, DC: American Society for Microbiology.
   Google Scholar
• Hornik, R. C. ( Ed.) (2002a). Public health communication: Evidence for behavior change. Mahwah, NJ: Erlbaum.
   Google Scholar
• Hornik, R. C. (2002b). Public health communication: Making sense of contradictory evidence. In R. C. Hornik ( Ed.), Public health communication: Evidence for behavior change ( pp. 1–19). Mahwah, NJ: Erlbaum.
   Google Scholar
• Hornik, R. C. (2002c). Evaluation design for public health communication programs. In R. C. Hornik ( Ed.), Public health communication: Evidence for behavior change ( pp. 385–405). Mahwah, NJ: Erlbaum.
   Google Scholar
• Hornik, R. C., Jacobsohn, L., Orwin, R., Piesse, A., & Kalton, G. (2008). Effects of the National Youth Anti–Drug Media Campaign on youths. American Journal of Public Health, 98(12), 2229–2236.
   Web of Science ®Google Scholar
• Huhman, M., Potter, L. D., Duke, J. C., Judkins, D. R., Heitzler, C. D.,& Wong, F. L. (2007). Evaluation of a national physical activity intervention for children: VERB campaign, 2002–2004. American Journal of Preventive Medicine, 32(1), 38–43.
   PubMed Web of Science ®Google Scholar
• Hwang, Y. (2012). Social diffusion of campaign effects: Campaign–generated interpersonal communication as a mediator of anti-tobacco campaign effects. Communication Research, 39, 120–141.
   Web of Science ®Google Scholar
• Kelly, B. J., Niederdeppe, J., & Hornik, R. C. (2009). Validating measures of scanned information exposure in the context of cancer prevention and screening behaviors. Journal of Health Communication, 14, 721–740.
   PubMed Web of Science ®Google Scholar
• Kerlinger, F. N. (1986). Foundations of behavioral research ( 3rd ed.). New York, NY: CBS College.
   Google Scholar
• Krippendorff, K. (2008). Validity. In W. Donsbach (Ed.), The international encyclopedia of communication. Hoboken, NJ: Blackwell Publishing. Retrieved from http://www.communicationencyclopedia.com/subscriber/tocnode.html?id=g9781405131995_yr2011_chunk_g978140513199527_ss1–1
   Google Scholar
• Lang, A. (2000). The limited capacity model of mediated message processing. Journal of Communication, 50, 47–70.
   Google Scholar
• Lee, C.-J., Hornik. R., & Hennessy, M. (2008). The reliability and stability of general media exposure measures. Communication Methods and Measures, 2(1–2), 6–22.
   Google Scholar
• Lee, S., & Cappella, J. N. (2012). Distraction effects of smoking cues in antismoking messages: Examining resource allocation to message processing as a function of smoking cues and argument strength. Media Psychology, 16, 154–176.
   Web of Science ®Google Scholar
• Luepker, R. V., Murray, D. M., Jacobs, D. R., Mittelmark, M. B., Bracht, N., Carlaw, R., … Folsom, A. R. (1994). Community education for cardiovascular disease prevention: Risk factor changes in the Minnesota Heart Health Program. American Journal of Public Health, 84(9), 1383–1393.
   PubMed Web of Science ®Google Scholar
• Mitchell, A., Rosenstiel, T., & Christian, L. (2012). The state of the news media, 2012: Mobile devices and news consumption: Some good signs for journalism. Washington, DC: Pew Research Center’s Project for Excellence in Journalism. Retrieved from http://stateofthemedia.org/2012/mobile–devices–and–news–consumption–some–good–signs–for–journalism/
   Google Scholar
• Morris, D. S., Rooney, M. P., Wray, R. J., & Kreuter, M. W. (2009). Measuring exposure to health messages in community–based intervention studies: A systematic review of current practices. Health Education and Behavior, 36, 979–998.
   PubMed Web of Science ®Google Scholar
• Niederdeppe, J. (2005). Assessing the validity of confirmed ad recall measures for public health communication campaign evaluation. Journal of Health Communication, 10(7), 635–650.
   PubMed Web of Science ®Google Scholar
• Niederdeppe, J., Farrelly, M. C., & Haviland, M. L. (2004). Confirming “truth”: More evidence of a successful tobacco countermarketing campaign in Florida. American Journal of Public Health, 94(2), 255–257.
   PubMed Web of Science ®Google Scholar
• Niederdeppe, J., Farrelly, M. C., Hersey, J. C., & Davis, K. C. (2008). Consequences of dramatic reductions in state tobacco control funds: Florida, 1998–2000. Tobacco Control, 17, 205–210.
   PubMed Web of Science ®Google Scholar
• Niederdeppe, J., Fiore, M. C., Baker, T. B., & Smith, S. S. (2008). Smoking–cessation media campaigns and their effectiveness among socioeconomically advantaged and disadvantaged populations. American Journal of Public Health, 98(5), 916–924.
   PubMed Web of Science ®Google Scholar
• Noar, S. M. (2009). Challenges in evaluating health communication campaigns: Defining the issues. Communication Methods and Measures, 3(1–2), 1–11.
   Google Scholar
• Noar, S. M., Palmgreen, P., & Zimmerman, R. S. (2009). Reflections on evaluating health communication campaigns. Communication Methods and Measures, 3(1–2), 105–114.
   Google Scholar
• Palmgreen, P., Donohew, L., Lorch, E., Hoyle, R., & Stephenson, M. (2001). Television campaigns and adolescent marijuana use: Tests of sensation seeking targeting. American Journal of Public Health, 91, 292–295.
   PubMed Web of Science ®Google Scholar
• Pew Research Center’s Project for Excellence in Journalism. (2012). The state of the news media 2012: An annual report on American journalism. Retrieved from http://www.pewresearch.org/2012/03/19/state–of–the–news–media–2012/
   Google Scholar
• Potter, W. J. (2008). The importance of considering exposure states when designing survey research studies. Communication Methods and Measures, 2(1–2), 152–166.
   Google Scholar
• Price, V., & Zaller, J. (1993). Who gets the news? Alternative measures of news reception and their implications for research. Public Opinion Quarterly, 57(2), 133–164.
   Web of Science ®Google Scholar
• Randolph, W., & Viswanath, K. (2004). Lessons learned from public health mass media campaigns: Marketing health in a crowded media world. Annual Review of Public Health, 25, 419–437.
   PubMed Web of Science ®Google Scholar
• Reyna, V. F., & Brainerd, C. J. (1995). Fuzzy trace theory: An interim synthesis. Learning and Individual Differences, 7, 1–75.
   Web of Science ®Google Scholar
• Romantan, A., Hornik, R., Price, V., Cappella, J., & Viswanath, K. (2008). A comparative analysis of the performance of alternative measures of exposure. Communication Methods and Measures, 2(1–2), 80–99.
   Google Scholar
• Shadish, W. R., Cook, T. D., & Campbell, D. T. (2002). Experimental and quasi–experimental designs for generalized causal inference. Boston, MA: Houghton Mifflin Company.
   Google Scholar
• Singh, S. N., Rothschild, M. L., & Churchill, G. A. (1998). Recognition versus recall as measures of television commercial forgetting. Journal of Marketing Research, 25, 72–80.
   Google Scholar
• Slater, M. D. (2004). Operationalizing and analyzing exposure: The foundation of media effects research. Journalism and Mass Communication Quarterly, 81(1), 168–183.
   Web of Science ®Google Scholar
• Sly, D. F., Heald, G. R., & Ray, S. (2001). The Florida “truth” anti–tobacco media evaluation: Design, first year results, and implications for planning future state media evaluations. Tobacco Control, 10, 9–15.
   PubMed Web of Science ®Google Scholar
• Sly, D. F., Heald, G. R., & Ray, S. (2002). Evidence of the dose effects of an anti-tobacco counteradvertising campaign. Preventive Medicine, 35(5), 511–518.
   PubMed Web of Science ®Google Scholar
• Snyder, L. B., Fleming Milici, F., Slater, M., Sun, H., & Strizhakova, Y. (2006). Effects of alcohol advertising exposure on drinking among youth. Archives of Pediatric Adolescent Medicine, 160, 18–24.
   PubMed Web of Science ®Google Scholar
• Southwell, B. G. (2005). Between messages and people: A multilevel model of memory for television content. Communication Research, 32(1), 112–140.
   Web of Science ®Google Scholar
• Southwell, B. G., Barmada, C. H., Hornik, R. C., & Maklan, D. M. (2002). Can we measure encoded exposure? Validation evidence from a national campaign. Journal of Health Communication, 7, 445–453.
   PubMed Web of Science ®Google Scholar
• Southwell, B. G., & Langteau, R. (2008). Age, memory changes, and the varying utility of recognition as a media effects pathway. Communication Methods and Measures, 2(1–2), 100–114.
   Google Scholar
• Southwell, B. G., & Torres, A. (2006). Connecting interpersonal and mass communication: Science news exposure, perceived ability to understand science, and conversation. Communication Monographs, 73(3), 334–350.
   Web of Science ®Google Scholar
• Southwell, B. G, & Yzer, M. C. (2007). The roles of interpersonal communication in mass media campaigns. Communication Yearbook, 31, 420–462.
   Google Scholar
• Stapel, J. (1998). Recall and recognition: A very close relationship. Journal of Advertising Research, 38(4), 41–45.
   Web of Science ®Google Scholar
• Stephenson, M. T., Morgan, S. E., Lorch, E. P., Palmgreen, P., Donohew, L., & Hoyle, R. H. (2001). Predictors of exposure from an antimarijuana media campaign: Outcome research assessing sensation seeking targeting. Health Communication, 14(1), 23–43.
   Web of Science ®Google Scholar
• Thrasher, J., Huang, L., Perez, R., Niederdeppe, J., Santillan, E. A., & Alday, J. (2011). Evaluation of a social marketing campaign to support Mexico City’s comprehensive smoke–free law. American Journal of Public Health, 101(2), 328–335.
   PubMed Web of Science ®Google Scholar
• Van den Putte, B., Yzer, M., & Southwell, B. G. (2011). Interpersonal communication as an indirect pathway for the effect of antismoking media content on smoking cessation. Journal of Health Communication, 16(5), 470–485.
   PubMed Web of Science ®Google Scholar
• Voas, R. B., Holder, H. D., & Gruenewald, P. J. (1997). The effect of drinking and driving interventions on alcohol–involved traffic crashes within a comprehensive community trial. Addiction, 92(S2), S221–S236.
   Google Scholar
• Wakefield, M. C., Durkin, S., Spittal, M. J., Siahpush, M., Scollo, M., Simpson, J. A., … Hill, D. (2008). Impact of tobacco control policies and mass media campaigns on monthly adult smoking prevalence. American Journal of Public Health, 98(8), 1443–1450.
   PubMed Web of Science ®Google Scholar
• Weber, R., Westcott–Baker, A., & Anderson, G. (2013). A multilevel analysis of antimarijuana public service announcement effectiveness. Communication Monographs. Retrieved August 14, 2013 from http://dx.doi.org/10.1080/03637751.2013.788254
   Google Scholar
• Zimmerman, R. S., Palmgreen, P., Noar, S. M., Lustria, M. L. A., Lu, H. Y., & Horosewski, M. L. (2007). Effects of a televised two–city safer sex mass media campaign targeting high sensation–seeking and impulsive decision–making young adults. Health Education & Behavior, 34(5), 810–826.
   PubMed Web of Science ®Google Scholar