Message Pretesting Using Perceived Persuasiveness Measures: Reconsidering the Correlational Evidence

References

• Alvaro, E. M., Crano, W. D., Siegel, J. T., Hohman, Z., Johnson, I., & Nakawaki, B. (2013). Adolescents’ attitudes toward antimarijuana ads, usage intentions, and actual marijuana usage. Psychology of Addictive Behaviors, 27, 1027–1035. doi:10.1037/a0031960
   PubMed Web of Science ®Google Scholar
• Biener, L., Ji, M., Gilpin, E. A., & Albers, A. B. (2004). The impact of emotional tone, message, and broadcast parameters in youth anti-smoking advertisements. Journal of Health Communication, 9, 259–274. doi:10.l080/10810730490447084
   PubMed Web of Science ®Google Scholar
• Biener, L., McCallum-Keeler, G., & Nyman, A. L. (2000). Adults’ response to Massachusetts anti-tobacco television advertisements: Impact of viewer and advertisement characteristics. Tobacco Control, 9, 401–407. doi:10.1136/tc.9.4.401
   PubMed Web of Science ®Google Scholar
• Bigsby, E., Cappella, J. N., & Seitz, H. H. (2013). Efficiently and effectively evaluating public service announcements: Additional evidence for the utility of perceived effectiveness. Communication Monographs, 80, 1–23. doi:10.1080/03637751.2012.739706
   PubMed Web of Science ®Google Scholar
• Brennan, E., Durkin, S. J., Wakefield, M. A., & Kashima, Y. (2014). Assessing the effectiveness of antismoking television advertisements: Do audience ratings of perceived effectiveness predict changes in quitting intentions and smoking behaviours? Tobacco Control, 23, 412–418. doi:10.1136/tobaccocontrol-2012-050949
   PubMed Web of Science ®Google Scholar
• Cappella, J. N. (2018). Perceived message effectiveness meets the requirements of a reliable, valid, and efficient measure of persuasiveness. Journal of Communication, 68, 994–997. doi:10.1093/joc/jqy044
   PubMed Web of Science ®Google Scholar
• Chen, M.-J., Grube, J. W., Bersamin, M., Waiters, E., & Keefe, D. B. (2005). Alcohol advertising: What makes it attractive to youth? Journal of Health Communication, 10, 553–565. doi:10.1080/10810730500228904
   PubMed Web of Science ®Google Scholar
• Choi, J., & Cho, H. (2016). Perceived message effectiveness, attitude toward messages, and perceived realism. In D. K. Kim & J. W. Dearing (Eds.), Health communication research measures (pp. 139–152). New York, NY: Peter Lang.
   Google Scholar
• Dailey, R. M., McCracken, A. A., & Romo, L. K. (2011). Confirmation and weight management: Predicting effective levels of acceptance and challenge in weight management messages. Communication Monographs, 78, 185–211. doi:10.1080/03637751.2011.564638
   Web of Science ®Google Scholar
• Davis, K. C., Duke, J., Shafer, P., Patel, D., Rodes, R., & Beistle, D. (2017). Perceived effectiveness of antismoking ads and association with quit attempts among smokers: Evidence from the tips from former smokers campaign. Health Communication, 32, 931–938. doi:10.1080/10410236.2016.1196413
   PubMed Web of Science ®Google Scholar
• Davis, K. C., & Duke, J. C. (2018). Evidence of the real-world effectiveness of public health media campaigns reinforces the value of perceived message effectiveness in campaign planning. Journal of Communication, 68, 998–1000. doi:10.1093/joc/jqy045
   Web of Science ®Google Scholar
• Davis, K. C., Nonnemaker, J., Duke, J., & Farrelly, M. C. (2013). Perceived effectiveness of cessation advertisements: The importance of audience reactions and practical implications for media campaign planning. Health Communication, 28, 461–472. doi:10.1080/10410236.2012.69653
   PubMed Web of Science ®Google Scholar
• Davis, K. C., Nonnemaker, J. M., Farrelly, M. C., & Niederdeppe, J. (2011). Exploring differences in smokers’ perceptions of the effectiveness of cessation media messages. Tobacco Control, 20, 26–33. doi:10.1136/tc.2009.035568
   PubMed Web of Science ®Google Scholar
• Davis, K. C., Uhrig, J., Bann, C., Rupert, D., & Fraze, J. (2011). Exploring African American women’s perceptions of a social marketing campaign to promote HIV testing. Social Marketing Quarterly, 17(3), 39–60. doi:10.1080/15245004.2011.595536
   Google Scholar
• Dillard, J. P. (2013). The effects of prior behavior on judgments of perceived message effectiveness: Evaluating HPV vaccine messages. Journal of Vaccines and Vaccination, 4, 193. doi:10.4172/2157-7560.1000193
   Google Scholar
• Dillard, J. P., Weber, K. M., & Vail, R. G. (2007). The relationship between the perceived and actual effectiveness of persuasive messages: A meta-analysis with implications for formative campaign research. Journal of Communication, 57, 613–631. doi:10.1111/j.1460-2466.2007.00360.x
   Web of Science ®Google Scholar
• Donovan, R. J., Leivers, S., & Hannaby, L. (1999). Smokers’ responses to anti-smoking advertisements by stage of change. Social Marketing Quarterly, 5(2), 56–65. doi:10.1080/15245004.1999.9961046
   Google Scholar
• Duncan, D. R., & Litwiller, B. H. (2004). The constancy of the correlation coefficient with respect to linear transformations. Alabama Journal of Mathematics, 28, 9–13.
   Google Scholar
• Durkin, S., Bayly, M., Cotter, T., Mullin, S., & Wakefield, M. (2013). Potential effectiveness of anti-smoking advertisement types in ten low and middle income countries: Do demographics, smoking characteristics and cultural differences matter? Social Science & Medicine (1982), 98, 204–213. doi:10.1016/j.socscimed.2013.09.022
   PubMed Web of Science ®Google Scholar
• Edell, J. A., & Burke, M. C. (1987). The power of feelings in understanding advertising effects. Journal of Consumer Research, 14, 421–433. doi:10.1086/209124
   Web of Science ®Google Scholar
• Firebaugh, G. (2015). Ecological fallacy, statistics of. International encyclopedia of the social & behavioral sciences (Vol. 6, 2nd ed., pp. 865–867). doi:10.1016/B978-0-08-097086-8.44017-1
   Google Scholar
• Grummon, A. H., Hall, M. G., Taillie, L. S., & Brewer, N. T. (2019). How should sugar-sweetened beverage health warnings be designed? A randomized experiment. Preventive Medicine, 121, 158–166. doi:10.1016/j.ypmed.2019.02.010
   PubMed Web of Science ®Google Scholar
• Guillaumier, A., Bonevski, B., Paul, C., D’Este, C., Durkin, S., & Doran, C. M. (2017). Which type of antismoking advertisement is perceived as more effective? An experimental study with a sample of Australian socially disadvantaged welfare recipients. American Journal of Health Promotion, 31, 209–216. doi:10.4278/ajhp.141125-QUAN-593
   PubMed Web of Science ®Google Scholar
• Hitchman, S. C., Mons, U., Nagelhout, G. E., Guignard, R., Mcneill, A., Willemsen, M. C., … Fong, G. T. (2012). Effectiveness of the European Union text-only cigarette health warnings: Findings from four countries. European Journal of Public Health, 22, 693–699. doi:10.1093/eurpub/ckr099
   PubMed Web of Science ®Google Scholar
• Lienemann, B. A., Rose, S. W., Unger, J. B., Meissner, H. I., Byron, M. J., Baezconde-Garbanati, L., … Cruz, T. B. (2019). Tobacco advertisement liking, vulnerability factors, and tobacco use among young adults. Nicotine & Tobacco Research, 21, 300–308. doi:10.1093/ntr/nty220
   PubMed Web of Science ®Google Scholar
• Lingwall, C., Nehl, E., Topuridze, M., Sturua, L., Maglakelidze, N., & Berg, C. J. (2018). Perceived effectiveness of differing health warning label messaging strategies among adults in the Republic of Georgia: One size does not fit all. International Journal of Environmental Research and Public Health, 15, 2221. doi:10.3390/ijerph15102221
   Web of Science ®Google Scholar
• Mackert, M., Lazard, A., Champlin, S., Liang, M. C., Mabry, A., Stroever, S., … Watkins, L. (2014). “Take time. save lives. clean hands protect”: A comparison of two hand hygiene health promotion posters. American Journal of Infection Control, 42, 530–532. doi:10.1016/j.ajic.2014.01.017
   PubMed Web of Science ®Google Scholar
• Messmer, D. J. (1979). Repetition and attitudinal discrepancy effects on the affective response to television advertising. Journal of Business Research, 7, 75–93. doi:10.1016/0148-2963(79)90027-4
   Web of Science ®Google Scholar
• Mouneyrac, A., Le Floch, V., Lemercier, C., Py, J., & Roumegue, M. (2017). Promoting responsible gambling via prevention messages: Insights from the evaluation of actual European messages. International Gambling Studies, 17, 426–441. doi:10.1080/14459795.2017.1350198
   Web of Science ®Google Scholar
• Mowbray, F., Marcu, A., Godinho, C. A., Michie, S., & Yardley, L. (2016). Communicating to increase public uptake of pandemic flu vaccination in the UK: Which messages work? Vaccine, 34, 3268–3274. doi:10.1016/j.vaccine.2016.05.006
   PubMed Web of Science ®Google Scholar
• Niederdeppe, J., Farrelly, M. C., Nonnemaker, J., Davis, K. C., & Wagner, L. (2011). Socioeconomic variation in recall and perceived effectiveness of campaign advertisements to promote smoking cessation. Social Science & Medicine, 72, 773–780. doi:10.1016/j.socscimed.2010.12.025
   PubMed Web of Science ®Google Scholar
• Noar, S. M. (2017). Transtheoretical model and stages of change in health and risk messaging. Oxford Research Encyclopedia of Communication. doi:10.1093/acrefore/9780190228613.013.324
   Google Scholar
• Noar, S. M., Barker, J., Bell, T., & Yzer, M. C. (in press). Does perceived message effectiveness predict the actual effectiveness of tobacco education messages? A systematic review and meta-analysis. Health Communication. doi:10.1080/10410236.2018.1547675
   Web of Science ®Google Scholar
• Noar, S. M., Barker, J., & Yzer, M. (2018). Measurement and design heterogeneity in perceived message effectiveness studies: A call for research. Journal of Communication, 68, 990–993. doi:10.1093/joc/jqy047
   PubMed Web of Science ®Google Scholar
• Noar, S. M., Bell, T., Kelley, D., Barker, J., & Yzer, M. C. (2018). Perceived message effectiveness measures in tobacco education campaigns: A systematic review. Communication Methods and Measures, 12, 295–313. doi:10.1080/19312458.2018.1483017
   PubMed Web of Science ®Google Scholar
• Noar, S. M., Hall, M. G., Francis, D. B., Ribisl, K. M., Pepper, J. K., & Brewer, N. T. (2016). Pictorial cigarette pack warnings: A meta-analysis of experimental studies. Tobacco Control, 25, 341–354. doi:10.1136/tobaccocontrol-2014-051978
   PubMed Web of Science ®Google Scholar
• Noar, S. M., Palmgreen, P., Zimmerman, R. S., Lustria, M. L. A., & Lu, H.-Y. (2010). Assessing the relationship between perceived message sensation value and perceived message effectiveness: Analysis of PSAs from an effective campaign. Communication Studies, 61, 21–45. doi:10.1080/10510970903396477
   PubMedGoogle Scholar
• O’Donnell, N. H., & Willoughby, J. F. (2017). Photo-sharing social media for eHealth: Analysing perceived message effectiveness of sexual health information on Instagram. Journal of Visual Communication in Medicine, 40, 149–159. doi:10.1080/17453054.2017.1384995
   PubMed Web of Science ®Google Scholar
• O’Keefe, D. J. (2018a). Message pretesting using assessments of expected or perceived persuasiveness: Evidence about diagnosticity of relative actual persuasiveness. Journal of Communication, 68, 120–142. doi:10.1093/joc/jqx009
   Web of Science ®Google Scholar
• O’Keefe, D. J. (2018b). Whistling past the graveyard: Response to commentaries. Journal of Communication, 68, 1001–1005. doi:10.1093/joc/jqy046
   Web of Science ®Google Scholar
• Pollard, C. M., Howat, P. A., Pratt, I. S., Boushey, C. J., Delp, E. J., & Kerr, D. A. (2016). Preferred tone of nutrition text messages for young adults: Focus group testing. JMIR Mhealth and Uhealth, 4, 252–265. doi:10.2196/mhealth.4764
   Web of Science ®Google Scholar
• Popova, L., Neilands, T. B., & Ling, P. M. (2014). Testing messages to reduce smokers’ openness to using novel smokeless tobacco products. Tobacco Control, 23, 313–321. doi:10.1136/tobaccocontrol-2012-050723
   PubMed Web of Science ®Google Scholar
• Prochaska, J. O., & Velicer, W. F. (1997). The transtheoretical model of health behavior change. American Journal of Health Promotion, 12, 38–48. doi:10.4278/0890-1171-12.1.38
   PubMed Web of Science ®Google Scholar
• Ramsay, I. S., Yzer, M. C., Luciana, M., Vohs, K. D., & MacDonald, A. W., III. (2013). Affective and executive network processing associated with persuasive antidrug messages. Journal of Cognitive Neuroscience, 25, 1136–1147. doi:10.1162/jocn_a_00391
   PubMed Web of Science ®Google Scholar
• Record, R. A., Harrington, N. G., Helme, D. W., & Savage, M. W. (2018). Using the theory of planned behavior to guide focus group development of messages aimed at increasing compliance with a tobacco-free policy. American Journal of Health Promotion, 32, 143–152. doi:10.1177/0890117116687467
   PubMed Web of Science ®Google Scholar
• Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15, 351–357. doi:10.2307/2087176
   Web of Science ®Google Scholar
• Santa, A. F., & Cochran, B. N. (2008). Does the impact of anti-drinking and driving Public Service Announcements differ based on message type and viewer characteristics? Journal of Drug Education, 38, 109–129. doi:10.2190/DE.38.2.b
   PubMed Web of Science ®Google Scholar
• Sidhu, A. N. (2011). Affective responses towards anti-tobacco advertisement concepts ( master’s thesis). Retrieved from ProQuest Dissertations and Theses Global ( ProQuest no. 1507182).
   Google Scholar
• Sobani, Z., Nizami, S., Raza, E., Ul Ain Baloch, N., & Khan, J. A. (2010). Graphic tobacco health warnings: Which genre to choose? International Journal of Tuberculosis and Lung Disease, 14, 356–361.
   PubMed Web of Science ®Google Scholar
• Thrasher, J. F., Arillo-Santillán, E., Villalobos, V., Pérez-Hernández, R., Hammond, D., Carter, J., … Regalado-Piñeda, J. (2012). Can pictorial warning labels on cigarette packages address smoking-related health disparities? Field experiments in Mexico to assess pictorial warning label content. Cancer Causes and Control, 23(S1), 69–80. doi:10.1007/s10552-012-9899-8
   PubMedGoogle Scholar
• Unger, J. A., Johnson, C. A., & Rohrbach, L. A. (1995). Recognition and liking of tobacco and alcohol advertisements among adolescents: Relationships with susceptibility to substance use. Preventive Medicine, 24, 461–466. doi:10.1006/pmed.1995.1074
   PubMed Web of Science ®Google Scholar
• Van Dessel, P., Smith, C. T., & De Houwer, J. (2018). Graphic cigarette pack warnings do not produce more negative implicit evaluations of smoking compared to text-only warnings. PLoS ONE, 13, e0194627. article no. e0194627. doi:10.1371/journal.pone.0194627
   PubMed Web of Science ®Google Scholar
• Weber, R., Westcott-Baker, A., & Anderson, G. L. (2013). A multilevel analysis of antimarijuana public service announcement effectiveness. Communication Monographs, 80, 302–330. doi:10.1080/03637751.2013.788254
   Web of Science ®Google Scholar
• Willemsen, M. C. (2005). The new EU cigarette health warnings benefit smokers who want to quit the habit: Results from the dutch continuous survey of smoking habits. European Journal of Public Health, 15, 389–392. doi:10.1093/eurpub/cki061
   PubMed Web of Science ®Google Scholar
• Wyllie, A., Zhang, J. F., & Casswell, S. (1998). Positive responses to televised beer advertisements associated with drinking and problems reported by 18 to 29-year-olds. Addiction, 93, 749–760. doi:10.1046/j.1360-0443.1998.93574911.x
   PubMed Web of Science ®Google Scholar
• Yzer, M., LoRusso, S., & Nagler, R. H. (2015). On the conceptual ambiguity surrounding perceived message effectiveness. Health Communication, 30, 125–134. doi:10.1080/10410236.2014.974131
   PubMed Web of Science ®Google Scholar
• Yzer, M., Rhodes, K., McCann, M., Harjo, J., Nagler, R. H., LoRusso, S. M., & Gollust, S. E. (2018). Effects of cultural cues on perceptions of HPV vaccination messages among parents and guardians of American Indian youth. Preventive Medicine, 115, 104–109. doi:10.1016/j.ypmed.2018.08.021
   PubMed Web of Science ®Google Scholar
• Zhao, X., Strasser, A., Cappella, J. N., Lerman, C., & Fishbein, M. (2011). A measure of perceived argument strength: Reliability and validity. Communication Methods and Measures, 5, 48–75. doi:10.1080/19312458.2010.547822
   PubMedGoogle Scholar