Using Text Mining to Compare Online Pro- and Anti-Vaccine Headlines: Word Usage, Sentiments, and Online Popularity

References

• Alhabash, S., McAlister, A. R., Hagerstrom, A., Quilliam, E. T., Rifon, N. J., & Richards, J. I. (2013). Between likes and shares: Effects of emotional appeal and virality on the persuasiveness of anticyberbullying messages on facebook. Cyberpsychology, Behavior, and Social Networking, 16(3), 175–182. doi:10.1089/cyber.2012.0265
   Google Scholar
• Anderson, K., Dixon, P. W., Karr, L. M., & Yudko, E. (2004). Reaction times to words vs. symbols for both hands. Perceptual and Motor Skills, 99(3), 754–756. doi:10.2466/pms.99.3.754-756
   PubMed Web of Science ®Google Scholar
• Arora, N. K., Hesse, B. W., Rimer, B. K., Viswanath, K., Clayman, M. L., & Croyle, R. T. (2008). Frustrated and confused: The American public rates its cancer-related information-seeking experiences. Journal of General Internal Medicine, 23(3), 223–228. doi:10.1007/s11606-007-0406-y
   PubMed Web of Science ®Google Scholar
• Asur, S., & Huberman, B. A. (2010). Predicting the future with social media. 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, (1), 492–499.
   Google Scholar
• Atwell, J. E., Van Otterloo, J., Zipprich, J., Winter, K., Harriman, K., Salmon, D. A., … Omer, S. B. (2013). Nonmedical vaccine exemptions and pertussis in California, 2010. Pediatrics, 132(4), 624–630. doi:10.1542/peds.2013-0878
   PubMed Web of Science ®Google Scholar
• Bean, S. J. (2011). Emerging and continuing trends in vaccine opposition website content. Vaccine, 29(10), 1874–1880. doi:10.1016/j.vaccine.2011.01.003
   PubMed Web of Science ®Google Scholar
• Bell, A. (1991). The Language of News Media. Oxford, England: Blackwell.
   Google Scholar
• Bhattacharya, G. (2012). Self-management of type 2 diabetes among African Americans in the Arkansas Delta: A strengths perspective in social-cultural context. Journal of Health Care for the Poor and Underserved, 23(1), 161–178. doi:10.1353/hpu.2012.0035
   PubMed Web of Science ®Google Scholar
• Buller, D. B., Borland, R. L., & Burgoon, M. (1998). Impact of behavioral intention on effectiveness of message features: Evidence from the family sun safety project. Human Communication Research, 24(3), 433–453. doi:10.1111/hcre.1998.24.issue-3
   Web of Science ®Google Scholar
• Buller, D. B., Burgoon, M., Hall, J. R., Levine, N., Taylor, A. M., Beach, B. H., … Bergen, A. (2000). Using language intensity to increase the success of a family intervention to protect children from ultraviolet radiation: Predictions from language expectancy theory. Preventive Medicine, 30(2), 103–114. doi:10.1006/pmed.1999.0600
   PubMed Web of Science ®Google Scholar
• Burgoon, J. K., Blair, J. P., Qin, T., & Nunamaker, J. F. (2003). Detecting deception through linguistic analysis. In Chen, H., Miranda, R., Zeng, D. D., Demchek, C., Schroeder, J., Madhusudan, T., (Eds.), Intelligence and securityinformatics ISI 2003. Lecture Notes in Computer Science, (Vol. 2665, pp. 91–101). Berlin, Germany: Springer.
   Google Scholar
• Burgoon, M., Jones, S. B., & Stewart, D. (1975). Toward a message‐centered theory of persuasion: Three empirical investigations of language intensity. Human Communication Research, 1(3), 240–256. doi:10.1111/hcre.1975.1.issue-3
   Google Scholar
• Cacioppo, J. T., & Berntson, G. G. (1994). Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. Psychological Bulletin, 115(3), 401–423. doi:10.1037/0033-2909.115.3.401
   Web of Science ®Google Scholar
• Centers for Disease Control and Prevention. (2011). Epidemiology and prevention of vaccine-preventable diseases (12th ed.). W. Atkinson, S. Wolfe, & J. Hamborsky (Eds), Washington, DC: Public Health Foundation.
   Google Scholar
• comScore. (2016). comScore releases February 2016 U.S. desktop search engine rankings. Retrieved from https://www.comscore.com/Insights/Rankings/comScore-Releases-February-2016-US-Desktop-Search-Engine-Rankings
   Google Scholar
• Conrick, T. (2016). CDC “nose” that live attenuated influenza vaccine is dangerous. Retrieved from http://www.ageofautism.com/2016/10/cdc-nose-that-live-attenuate-influenza-vaccine-is-dangerous.html
   Google Scholar
• Conroy, N. J., Rubin, V. L., & Chen, Y. (2015). Automatic deception detection: Methods for finding fake news. Proceedings of the Association for Information Science and Technology, 52(1), 1–4. doi:10.1002/pra2.2015.145052010082
   Google Scholar
• Davies, P., Chapman, S., & Leask, J. (2002). Antivaccination activists on the world wide web. Archives of Disease in Childhood, 87, 22–25. doi:10.1136/adc.87.1.22
   PubMed Web of Science ®Google Scholar
• Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., … Quattrociocchi, W. (2016). The spreading of misinformation online. Proceedings of the National Academy of Sciences, 113(3), 554–559. doi:10.1073/pnas.1517441113
   PubMed Web of Science ®Google Scholar
• Dmitry, B. (2017). Trump warns flu shots are the greatest “scam” in medical history. Retrieved from http://yournewswire.com/trump-flu-shot-scam/%0D
   Google Scholar
• Dodds, P. S., & Danforth, C. M. (2010). Measuring the happiness of large-scale written expression: Songs, blogs, and presidents. Journal of Happiness Studies, 11(4), 441–456. doi:10.1007/s10902-009-9150-9
   Web of Science ®Google Scholar
• Egede, L. E., & Michel, Y. (2006). Medical mistrust, diabetes self-management, and glycemic control in an indigent population with type 2 diabetes. Diabetes Care, 29(1), 131–132. doi:10.2337/diacare.29.01.06.dc05-1642
   PubMed Web of Science ®Google Scholar
• Eysenbach, G., & Kohler, C. (2002). How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. British Medical Journal, 324, 573–577. doi:10.1136/bmj.324.7337.573
   PubMed Web of Science ®Google Scholar
• Fox, S. (2011). The social life of health information. Pew Internet & American Life Project, 1–33. Retrieved from http://www.pewinternet.org/files/old-media/Files/Reports/2011/PIP_Social_Life_of_Health_Info.pdf
   Google Scholar
• Gonzales, A. L., Hancock, J. T., & Pennebaker, J. W. (2010). Language style matching as a predictor of social dynamics in small groups. Communication Research, 37(1), 3–19. doi:10.1177/0093650209351468
   Web of Science ®Google Scholar
• Greaves, F., Ramirez-Cano, D., Millett, C., Darzi, A., & Donaldson, L. (2013). Use of sentiment analysis for capturing patient experience from free-text comments posted online. Journal of Medical Internet Research, 15(11), e239. doi:10.2196/jmir.2721
   PubMed Web of Science ®Google Scholar
• Gupta, V., & Lehal, G. S. (2009). A survey of text mining techniques and applications. Journal of Emerging Technologies in Web Intelligence, 1(1), 60–76. doi:10.4304/jetwi.1.1.60-76
   Google Scholar
• Haelle, T. (2014). Delaying vaccines increases risks—With no added benefits. Retrieved from https://www.scientificamerican.com/article/delaying-vaccines-increases-risks-with-no-added-benefits/
   Google Scholar
• Howard, J. (2017). Anti-vaccine groups blamed in Minnesota measles outbreak. Retrieved from http://www.cnn.com/2017/05/08/health/measles-minnesota-somali-anti-vaccine-bn/index.html
   Google Scholar
• Jolley, D., & Douglas, K. M. (2014). The effects of anti-vaccine conspiracy theories on vaccination intentions. PLoS ONE, 9(2), e89177. doi:10.1371/journal.pone.0089177
   PubMed Web of Science ®Google Scholar
• Jones, A. M., Omer, S. B., Bednarczyk, R. A., Halsey, N. A., Moulton, L. H., & Salmon, D. (2012). Parents’ source of vaccine information and impact on vaccine attitudes, beliefs, and nonmedical exemptions. Advances in Preventive Medicine, 2012, 1–8. doi:10.1155/2012/932741
   Google Scholar
• Kata, A. (2010). A postmodern Pandora’s box: Anti-vaccination misinformation on the Internet. Vaccine, 28(7), 1709–1716. doi:10.1016/j.vaccine.2009.12.022
   PubMed Web of Science ®Google Scholar
• Kata, A. (2012). Anti-vaccine activists, Web 2.0, and the postmodern paradigm - An overview of tactics and tropes used online by the anti-vaccination movement. Vaccine, 30(25), 3778–3789. doi:10.1016/j.vaccine.2011.11.112
   PubMed Web of Science ®Google Scholar
• Kreps, G. L., & Neuhauser, L. (2010). New directions in eHealth communication: Opportunities and challenges. Patient Education and Counseling, 78(3), 329–336. doi:10.1016/j.pec.2010.01.013
   PubMed Web of Science ®Google Scholar
• Lazarus, R. S. (1991). Emotion & adaptation. New York, NY: Oxford University Press.
   Google Scholar
• Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J. (2012). Misinformation and its correction: Continued influence and successful debiasing. Psychological Science in the Public Interest, 13(3), 106–131. doi:10.1177/1529100612451018
   PubMed Web of Science ®Google Scholar
• Lewandowsky, S., Oberauer, K., & Gignac, G. E. (2013). NASA faked the moon landing —Therefore, (climate) science is a hoax: An anatomy of the motivated rejection of science. Psychological Science, 24(5), 622–633. doi:10.1177/0956797612457686
   PubMed Web of Science ®Google Scholar
• Majumder, M. S., Cohn, E. L., Mekaru, S. R., Huston, J. E., & Brownstein, J. S. (2015). Substandard vaccination compliance and the 2015 measles outbreak. JAMA Pediatrics, 169(5), 494–495. doi:10.1001/jamapediatrics.2015.0384
   PubMed Web of Science ®Google Scholar
• Mazzocut, M., Truccolo, I., Antonini, M., Rinaldi, F., Omero, P., Ferrarin, E., … Tasso, C. (2016). Web conversations about complementary and alternative medicines and cancer: Content and sentiment analysis. Journal of Medical Internet Research, 18(6), e120. doi:10.2196/jmir.5521
   PubMed Web of Science ®Google Scholar
• Mohammad, S. M. (2012). #emotional tweets. Proceedings of the First Joint Conference on Lexical and Computational Semantics–Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (pp. 246–255), Association for Computational Linguistics, Stroudsburg, PA.
   Google Scholar
• Mohammad, S. M., & Turney, P. D. (2010). Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. Proceedings of the NAACL-HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text (pp. 26–34), Los Angeles, California.
   Google Scholar
• Mohammad, S. M., & Turney, P. D. (2013). Crowdsourcing a word-emotion association lexicon. Computational Intelligence, 29, 436–465. doi:10.1111/j.1467-8640.2012.00460.x
   Web of Science ®Google Scholar
• Moran, M. B., Lucas, M., Everhart, K., Morgan, A., & Prickett, E. (2016). What makes anti-vaccine websites persuasive? A content analysis of techniques used by anti-vaccine websites to engender anti-vaccine sentiment. Journal of Communication in Healthcare, 9(3), 151–163. doi:10.1080/17538068.2016.1235531
   Google Scholar
• Mostafa, M. M. (2013). More than words: Social networks’ text mining for consumer brand sentiments. Expert Systems with Applications, 40(10), 4241–4251. doi:10.1016/j.eswa.2013.01.019
   Web of Science ®Google Scholar
• Mulroy, Z. (2017). Distraught mum’s powerful vaccination message to parents after baby’s tragic death. Retrieved from http://www.mirror.co.uk/lifestyle/family/distraught-mums-powerful-vaccination-message-9610620
   Google Scholar
• Nagler, R. H. (2014). Adverse outcomes associated with media exposure to contradictory nutrition messages. Journal of Health Communication, 19(1), 24–40. doi:10.1080/10810730.2013.798384
   PubMed Web of Science ®Google Scholar
• Newman, M. L., Pennebaker, J. W., Berry, D. S., & Richards, J. M. (2003). Lying words: Predicting deception from linguistic styles. Personality and Social Psychology Bulletin, 29(5), 665–675. doi:10.1177/0146167203029005010
   PubMed Web of Science ®Google Scholar
• Nyhan, B., Reifler, J., Richey, S., & Freed, G. L. (2014). Effective messages in vaccine promotion: A randomized trial. Pediatrics, 133(4), e835–e842. doi:10.1542/peds.2013-2365
   PubMed Web of Science ®Google Scholar
• Omer, S. B., Richards, J. L., Ward, M., & Bednarczyk, R. A. (2012). Vaccination policies and rates of exemption from immunization, 2005–2011. New England Journal of Medicine, 367(12), 1170–1171. doi:10.1056/NEJMc1209037
   PubMed Web of Science ®Google Scholar
• Omer, S. B., Salmon, D. A., Orenstein, W. A., deHart, M. P., & Halsey, N. (2009). Vaccine refusal, mandatory immunization, and the risks of vaccine-preventable diseases. New England Journal of Medicine, 360(19), 1981–1988. doi:10.1056/NEJMsa0806477
   PubMed Web of Science ®Google Scholar
• Ott, M., Choi, Y., Cardie, C., & Hancock, J. T. (2011). Finding deceptive opinion spam by any stretch of the imagination. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1 (pp. 309–319).
   Google Scholar
• Pang, B., & Lee, L. (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 1(2), 91–231.
   Google Scholar
• Phadke, V. K., Bednarczyk, R. A., Salmon, D. A., & Omer, S. B. (2016). Association between vaccine refusal and vaccine-preventable diseases in the United States: A review of measles and pertussis. Jama, 315(11), 1149–1158. doi:10.1001/jama.2016.1353
   PubMed Web of Science ®Google Scholar
• Piotrkowicz, A., Dimitrova, V., Otterbacher, J., & Markert, K. (2017, May). The impact of news values and linguistic style on the popularity of headlines on Twitter and Facebook. Proceedings of the Second International Workshop on News and Public Opinion, Association for the Advancement of Artificial Intelligence.
   Google Scholar
• Raghunathan, R., & Trope, Y. (2002). Walking the tightrope between feeling good and being accurate: Mood as a resource in processing persuasive messages. Journal of Personality and Social Psychology, 83(3), 510–525. doi:10.1037/0022-3514.83.3.510
   PubMed Web of Science ®Google Scholar
• Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V. (2014). SemEval-2014 Task 9: Sentiment analysis in Twitter. Proceedings of the 8th International Workshop on Semantic Evaluation, (pp. 73–80).
   Google Scholar
• Salmon, D. A., Moulton, L. H., Omer, S. B., DeHart, M. P., Stokley, S., & Halsey, N. A. (2005). Factors associated with refusal of childhood vaccines among parents of school-aged children: A case-control study. Archives of Pediatrics & Adolescent Medicine, 159(5), 470–476. doi:10.1001/archpedi.159.5.470
   PubMedGoogle Scholar
• Silge, J., & Robinson, D. (2017). Text Mining with R: A tidy approach. Boston, MA: O’Reilly Media.
   Google Scholar
• Summers, D. (2014). Pediatrician: Vaccinate your kids—Or get out of my office. Retrieved from http://www.thedailybeast.com/articles/2014/01/30/the-real-reason-pediatricians-want-you-to-vaccinate-your-kids.html
   Google Scholar
• Wolfe, R. M., & Sharp, L. K. (2005). Vaccination or immunization? The impact of search terms on the internet. Journal of Health Communication, 10(6), 537–551. doi:10.1080/10810730500228847
   PubMed Web of Science ®Google Scholar
• Wolfe, R. M., Sharp, L. K., & Lipsky, M. S. (2002). Content and design attributes of antivaccination web sites. JAMA, 287(24), 3245–3248. doi:10.1001/jama.287.24.3245
   PubMed Web of Science ®Google Scholar
• Wong, C. A., Sap, M., Schwartz, A., Town, R., Baker, T., Ungar, L., & Merchant, R. M. (2015). Twitter sentiment predicts affordable care act marketplace enrollment. Journal of Medical Internet Research, 17(2), e51. doi:10.2196/jmir.3812
   PubMedGoogle Scholar
• World Health Organization. (2013). Global action plan for the prevention and control of noncommunicable diseases 2013–2020. Geneva, Switzerland: Author.
   Google Scholar
• Xu, Z., & Guo, H. (2017). A meta-analysis of the effectiveness of guilt on health-related attitudes and intentions. Health Communication, 1–7. doi:10.1080/10410236.2017.1278633
   PubMedGoogle Scholar
• Younis, E. M. G. (2015). Sentiment analysis and text mining for social media microblogs using open source tools: An empirical study. International Journal of Computer Applications, 112(5), 44–48.
   Google Scholar
• Zhou, L., Burgoon, J. K., Nunamaker, J. F., & Twitchell, D. (2004). Automating linguistics-based cues for detecting deception in text-based asynchronous computer-mediated communications. Group Decision and Negotiation, 13(1), 81–106. doi:10.1023/B:GRUP.0000011944.62889.6f
   Web of Science ®Google Scholar
• Zhou, X., Tao, X., Yong, J., & Yang, Z. (2013). Sentiment analysis on tweets for social events. In Shen, W., Li, W., Barthes, J-P., Luo, J., Zhu, H., Yong, J., Li, X. (Eds.), Proceedings of the 2013 IEEE 17th International Conference on Computer Supported Cooperative Work in Design (pp. 557–562). Piscataway, NJ: IEEE.
   Google Scholar
• Zhu, X., Kiritchenko, S., & Mohammad, S. M. (2014, August 23–24). NRC-Canada-2014: Recent improvements in the sentiment analysis of tweets. Proceedings of the Eighth International Workshop on Semantic Evaluation Exercises (SemEval-2014), Dublin, Ireland, pp. 443–447.
   Google Scholar
• Zimmerman, R. K., Wolfe, R. M., Fox, D. E., Fox, J. R., Nowalk, M. P., Troy, J. A., & Sharp, L. K. (2005). Vaccine criticism on the world wide web. Journal of Medical Internet Research, 7(2), e17. doi:10.2196/jmir.7.2.e17
   PubMed Web of Science ®Google Scholar