Using machine learning techniques to investigate learner engagement with TikTok media literacy campaigns

References

• Anderson, T. (2003). Modes of interaction in distance education: Recent developments and research questions. In M. G. Moore & W. G. Anderson (Eds.), Handbook of distance education (pp. 129–144). Lawrence Erlbaum Associates Inc.
   Google Scholar
• Aufderheide, P. (2018). Media literacy: From a report of the national leadership conference on media literacy. In Media literacy in the information age (pp. 79–86) Routledge.
   Google Scholar
• Austin, E. W., Austin, B. W., Willoughby, J. F., Amram, O., & Domgaard, S. (2021). How media literacy and science media literacy predicted the adoption of protective behaviors amidst the COVID-19 pandemic. Journal of Health Communication, 26(4), 239–252. https://doi.org/10.1080/10810730.2021.1899345
   PubMed Web of Science ®Google Scholar
• Banko, M., & Brill, E. (2001, July). Scaling to very very large corpora for natural language disambiguation. In Proceedings of the 39th Annual Meeting of the Association for Computational Linguistics (pp. 26–33). https://doi.org/10.3115/1073012.1073017
   Google Scholar
• Berger, J. (2011). Arousal increases social transmission of information. Psychological Science, 22(7), 891–893. https://doi.org/10.1177/0956797611413294
   PubMed Web of Science ®Google Scholar
• Bhandari, A., & Bimo, S. (2020). TikTok and the “algorithmized self”: A new model of online interaction. AoIR Selected Papers of Internet Research. https://spir.aoir.org/ojs/index.php/spir/article/view/11172
   Google Scholar
• Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993–1022. https://doi.org/10.5555/944919.944937
   Web of Science ®Google Scholar
• Bordac, S. (2014). Introduction to media literacy history. Journal of Media Literacy Education, 6(2), 1–2. https://doi.org/10.23860/jmle-6-2-1
   PubMedGoogle Scholar
• Breakstone, J., Smith, M. A. R. K., Wineburg, S. (2019). Students’ civic online reasoning. A national portrait. Retrieved May 16, 2020, from https://stacks.stanford.edu/file/gf151tb4868/Civic%20Online%20Reasoning%20National%20Portrait.pdf
   Google Scholar
• Breakstone, J., Smith, M., Wineburg, S., Rapaport, A., Carle, J., Garland, M., & Saavedra, A. (2021). Students’ civic online reasoning: A national portrait. Educational Researcher, 50(8), 505–515. https://doi.org/10.3102/0013189X211017495
   Web of Science ®Google Scholar
• Buller, D. B., Pagoto, S., Henry, K. L., Baker, K., Walkosz, B. J., Hillhouse, J., Berteletti, J., & Bibeau, J. (2022). Effects of engagement with a social media campaign for mothers to prevent indoor tanning by teens in a randomized trial. Journal of Health Communication, 27(6), 394–406. https://doi.org/10.1080/10810730.2022.2113839
   PubMed Web of Science ®Google Scholar
• Chai, C., & Li, G. (2020). Human-in-the-loop techniques in machine learning. IEEE Data Engineering Bulletin, 43(3), 37–52.
   Google Scholar
• Coiro, J., Coscarelli, C., Maykel, C., & Forzani, E. (2015). Investigating criteria that seventh graders use to evaluate the quality of online information. Journal of Adolescent & Adult Literacy, 59(3), 287–297. https://doi.org/10.1002/jaal.448
   Web of Science ®Google Scholar
• Corbu, N., Bârgăoanu, A., Buturoiu, R., & Ștefăniță, O. (2020). Does fake news lead to more engaging effects on social media? Evidence from Romania. Communications, 45(s1), 694–717. https://doi.org/10.1515/commun-2019-0152
   Google Scholar
• Das, S., Dey, A., Pal, A., & Roy, N. (2015). Applications of artificial intelligence in machine learning: Review and prospect. International Journal of Computer Applications, 115(9), 31–41. https://doi.org/10.5120/20182-2402
   Google Scholar
• De Mauro, A., Greco, M., & Grimaldi, M. (2016). A formal definition of big data based on its essential features. Library Review, 65(3), 122–135. https://doi.org/10.1108/LR-06-2015-0061
   Web of Science ®Google Scholar
• Dey, P. (2019). Characterization of online social network. In Enabling technologies and architectures for next-generation networking capabilities (pp. 272–299). IGI Global. https://doi.org/10.4018/978-1-5225-6023-4.ch013
   Google Scholar
• Dickerson, K. (2021, April 13). YouTubes new ‘media literacy’ ads will teach you to spot bogus info. Retrieved from https://www.androidheadlines.com/2021/04/youtubes-new-media-literacy-ads-will-teach-you-to-spot-bogus-info.html
   Google Scholar
• Dragseth, M. R. (2020). Building student engagement through social media. Journal of Political Science Education, 16(2), 243–256. https://doi.org/10.1080/15512169.2018.1550421
   Web of Science ®Google Scholar
• Du, H., Nguyen, L., Yang, Z., Abu-Gellban, H., Zhou, X., Xing, W., Cao, G., & Jin, F. (2019, July). Twitter vs news: Concern analysis of the 2018 California wildfire event. In 2019 IEEE 43rd Annual Computer Software and Applications Conference (COMPSAC) (Vol. 2, pp. 207–212). IEEE. https://doi.org/10.1109/COMPSAC.2019.10208
   Google Scholar
• Du, H., Xing, W., & Zhu, G. (2023). Mining teacher informal online learning networks: Insights from massive educational chat tweets. Journal of Educational Computing Research, 61(1), 127–150. https://doi.org/10.1177/07356331221103764
   Web of Science ®Google Scholar
• Feldman, R. (2013). Techniques and applications for sentiment analysis. Communications of the ACM, 56(4), 82–89. https://doi.org/10.1145/2436256.2436274
   Web of Science ®Google Scholar
• Fergie, G., Hunt, K., & Hilton, S. (2013). What young people want from health-related online resources: A focus group study. Journal of Youth Studies, 16(5), 579–596. https://doi.org/10.1080/13676261.2012.744811
   PubMed Web of Science ®Google Scholar
• Ferreira-Mello, R., André, M., Pinheiro, A., Costa, E., & Romero, C. (2019). Text mining in education. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 9(6), e1332.
   Web of Science ®Google Scholar
• Fredricks, J. A., Blumenfeld, P. C., & Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74(1), 59–109. https://doi.org/10.3102/00346543074001059
   Web of Science ®Google Scholar
• Gee, J. P. (2006). The new literacy studies and the social turn. 1999.
   Google Scholar
• Gee, J. P. (2010). A situated-sociocultural approach to literacy and technology. The New Literacies: Multiple Perspectives on Research and Practice, 165, 193.
   Google Scholar
• Greenhow, C., & Lewin, C. (2016). Social media and education: Reconceptualizing the boundaries of formal and informal learning. Learning, Media and Technology, 41(1), 6–30. https://doi.org/10.1080/17439884.2015.1064954
   Web of Science ®Google Scholar
• Goldie, J. G. S. (2016). Connectivism: A knowledge learning theory for the digital age? Medical Teacher, 38(10), 1064–1069. https://doi.org/10.3109/0142159X.2016.1173661
   PubMed Web of Science ®Google Scholar
• Hagey, K., Horwitz, J. (2021). Facebook files: Facebook tried to make its platform a healthier place. It got angrier instead. The Wall Street Journal. Retrieved from https://www.wsj.com/articles/facebook-algorithm-change-zuckerberg-11631654215?mod=article_inline
   Google Scholar
• Hind, S. (2020, July 16). TikTok’s “be informed” series stars TikTok creators to educate users about media literacy. Retrieved from https://newsroom.tiktok.com/en-us/tiktoks-be-informed-series-stars-tiktok-creators-to-educate-users-about-media-literacy
   Google Scholar
• Hobbs, R. (1996). Media literacy, media activism and the big tent. Telemedium, 42(3), ii–iv.
   Google Scholar
• Hobbs, R. (1998). The seven great debates in the media literacy education movement. Journal of Communication, 48(1), 16–32. https://doi.org/10.1111/j.1460-2466.1998.tb02734.x
   Web of Science ®Google Scholar
• Hobbs, R., & Jensen, A. (2009). The past, present, and future of media literacy education. Journal of Media Literacy Education, 1(1), 1. https://doi.org/10.23860/jmle-1-1-1
   Google Scholar
• Huang, Y., & Yoon, H. J. (2022). Prosocial native advertising on social media: Effects of ad-context congruence, ad position and ad type. Journal of Social Marketing, 12(2), 105–123. https://doi.org/10.1108/JSOCM-05-2021-0105
   Web of Science ®Google Scholar
• Illia, F., Eugenia, M. P., & Rutba, S. A. (2022). Sentiment analysis on PeduliLindungi application using TextBlob and VADER library. Proceedings of the International Conference on Data Science and Official Statistics, 2021(1), 278–288. https://doi.org/10.34123/icdsos.v2021i1.236
   Google Scholar
• Jan, S. K., Vlachopoulos, P., & Parsell, M. (2019). Social network analysis and online learning communities in higher education: A systematic literature review. Online Learning, 23(1), 249–264. https://doi.org/10.24059/olj.v23i1.1398
   Web of Science ®Google Scholar
• Kanthawala, S., Cotter, K., Foyle, K., & DeCook, J. R. (2022, January). It’s the methodology for me: A systematic review of early approaches to studying TikTok. In HICSS (pp. 1–17).
   Google Scholar
• Kalaivani, K., & Kuppuswami, P. (2019). Use of NLP based combined features for sentiment classification. International Journal of Engineering and Advanced Technology, 9(1), 621–626. https://doi.org/10.35940/ijeat.F8290.109119
   Google Scholar
• Kenan, J. (2022, June 6). TikTok comments everything you need to know to drive engagement. SproutSocial. Retrieved from https://sproutsocial.com/insights/tiktok-comments/
   Google Scholar
• Kresovich, A., & Noar, S. M. (2020). The power of celebrity health events: Meta-analysis of the relationship between audience involvement and behavioral intentions. Journal of Health Communication, 25(6), 501–513. https://doi.org/10.1080/10810730.2020.1818148
   PubMed Web of Science ®Google Scholar
• Kim, S. C., Vraga, E. K., & Cook, J. (2021). An eye tracking approach to understanding misinformation and correction strategies on social media: The mediating role of attention and credibility to reduce HPV vaccine misperceptions. Health Communication, 36(13), 1687–1696. https://doi.org/10.1080/10410236.2020.1787933
   PubMed Web of Science ®Google Scholar
• Kimmons, R., & Veletsianos, G. (2016). Education scholars’ evolving uses of twitter as a conference backchannel and social commentary platform. British Journal of Educational Technology, 47(3), 445–464. https://doi.org/10.1111/bjet.12428
   Web of Science ®Google Scholar
• Kumaresan, C., & Thangaraju, P. (2023). Sentiment analysis in multiple languages: A review of current approaches and challenges. REST Journal on Data Analytics and Artificial Intelligence, 12(1), 8–15. https://doi.org/10.46632/jdaai/2/1/2
   Google Scholar
• Lear, J. L., Ansorge, C., & Steckelberg, A. (2010). Interactivity/community process model for the online education environment. Journal of Online Learning and Teaching, 6(1), 71–77.
   Google Scholar
• Lewandowsky, S., Ecker, U. K., Seifert, C. M., Schwarz, N., & Cook, J. (2012). Misinformation and its correction: Continued influence and successful debiasing. Psychological Science in the Public Interest, 13(3), 106–131. https://doi.org/10.1177/1529100612451018
   PubMed Web of Science ®Google Scholar
• Lewis, S. C., Zamith, R., & Hermida, A. (2013). Content analysis in an era of Big Data: A hybrid approach to computational and manual methods. Journal of Broadcasting & Electronic Media, 57(1), 34–52. https://doi.org/10.1080/08838151.2012.761702
   Web of Science ®Google Scholar
• Lin, S.-Y., Cheng, X., Zhang, J., Yannam, J. S., Barnes, A. J., Koch, J. R., Hayes, R., Gimm, G., Zhao, X., Purohit, H., & Xue, H. (2023). Social media data mining of antitobacco campaign messages: Machine learning analysis of Facebook posts. Journal of Medical Internet Research, 25, e42863. https://doi.org/10.2196/42863
   PubMed Web of Science ®Google Scholar
• Literat, I., Abdelbagi, A., Law, N. Y., Cheung, M. Y., & Tang, R. (2021). Research note: Likes, sarcasm and politics: Youth responses to a platform-initiated media literacy campaign on social media. Harvard Kennedy School Misinformation Review, 2(3), 1–10. https://doi.org/10.37016/mr-2020-67
   Google Scholar
• Lopes, D., Prada, M., Gaspar, R., & Garrido, M. V. (2018). Lisbon Emoji and Emoticon Database (LEED): Norms for emoji and emoticons in seven evaluative dimensions. Behavior Research Methods, 50(1), 392–405. https://doi.org/10.3758/s13428-017-0878-6
   PubMed Web of Science ®Google Scholar
• Longo, L. (2019, September). Empowering qualitative research methods in education with artificial intelligence. In World Conference on Qualitative Research (pp. 1–21). Springer International Publishing.
   Google Scholar
• Manca, S., Bocconi, S., & Gleason, B. (2021). “Think globally, act locally”: A global approach to the development of social media literacy. Computers & Education, 160, 104025. https://doi.org/10.1016/j.compedu.2020.104025
   Web of Science ®Google Scholar
• Manganello, J., Bleakley, A., & Schumacher, P. (2020). Pandemics and PSAs: Rapidly changing information in a new media landscape. Health Communication, 35(14), 1711–1714. https://doi.org/10.1080/10410236.2020.1839192
   PubMed Web of Science ®Google Scholar
• Martin, F., & Bolliger, D. U. (2018). Engagement matters: Student perceptions on the importance of engagement strategies in the online learning environment. Online Learning, 22(1), 205–222. https://doi.org/10.24059/olj.v22i1.1092
   Web of Science ®Google Scholar
• Maynard, D. G., Greenwood, M. A. (2014, March). Who cares about sarcastic tweets? investigating the impact of sarcasm on sentiment analysis. In LREC 2014 Proceedings. ELRA.
   Google Scholar
• Medina Serrano, J. C., Papakyriakopoulos, O., & Hegelich, S. (2020, July). Dancing to the partisan beat: A first analysis of political communication on TikTok. In 12th ACM Conference on Web Science (pp. 257–266). https://doi.org/10.1145/3394231.3397916
   Google Scholar
• Meta (2020, June 24). Investing in US Media Literacy Initiatives. Meta Journalism Project. Retrieved from https://www.facebook.com/journalismproject/media-literacy-initiatives
   Google Scholar
• McGrew, S., Ortega, T., Breakstone, J., & Wineburg, S. (2017). The challenge that’s bigger than fake news: Civic reasoning in a social media environment. American Educator, 41(3), 4.
   Google Scholar
• Mistry, D. A. (2018). Topic detection IN Twitter with data mining. International Journal for Research in Applied Science and Engineering Technology, 6(4), 2893–2897. https://doi.org/10.22214/ijraset.2018.4482
   Google Scholar
• Mosseri, A. (2017, April 6). A new educational tool against misinformation. Retrieved from https://about.fb.com/news/2017/04/a-new-educational-tool-against-misinformation/
   Google Scholar
• National Association for Media Literacy Education (2007, November). The core principles of media literacy education. Retrieved from https://namle.net/resources/core-principles/
   Google Scholar
• National Association for Media Literacy Education (2019). What is Media Literacy Week? Media Literacy Week. Retrieved from https://medialiteracyweek.us/about/
   Google Scholar
• National Association for Media Literacy Education (2021, October 27). A conversation on digital & media literacy with TikTok. [Video]. YouTube. Retrieved from https://www.youtube.com/watch?v=5HXmR2WFz6s
   Google Scholar
• National Association for Media Literacy Education (2023). About. [Website]. Retrieved from https://namle.net/about/
   Google Scholar
• Nay, J., & Strandburg, K. J. (2019). Generalizability: Machine learning and humans-in-the-loop. In Research handbook on big data law (R. Vogl, Ed., 2020 Forthcoming). NYU School of Law, Public Law Research Paper 20–27. Edward Elgar.
   Google Scholar
• Newmann, F. M., Wehlage, G. G., & Lamborn, S. D. (1992). The significance and sources of student engagement. In F. Newmann (Ed.), Student engagement and achievement in American secondary schools (pp. 11–39). Teachers College Press.
   Google Scholar
• Noble, S. U. (2018). Algorithms of oppression: How search engines reinforce racism. NYU Press. Retrieved from
   Google Scholar
• Plaza-Del-Arco, F. M., Martínez-Cámara, E., Martin, M., & López, L. (2018). SINAI at IEST 2018: Neural encoding of emotional external knowledge for emotion classification. https://doi.org/10.18653/v1/w18-6227
   Google Scholar
• Polanco-Levicán, K., & Salvo-Garrido, S. (2022). Understanding social media literacy: A Systematic review of the concept and its competences. International Journal of Environmental Research and Public Health, 19(14), 8807. https://doi.org/10.3390/ijerph19148807
   PubMed Web of Science ®Google Scholar
• Radovanović, M., & Ivanović, M. (2008). Text mining: Approaches and applications. Novi Sad Journal of Mathematics, 38(3), 227–234.
   Google Scholar
• Rayward, A. T., Vandelanotte, C., Corry, K., Van Itallie, A., & Duncan, M. J. (2019). Impact of a social media campaign on reach, uptake, and engagement with a free web-and app-based physical activity intervention: The 10,000 steps Australia program. International Journal of Environmental Research and Public Health, 16(24), 5076. https://doi.org/10.3390/ijerph16245076
   PubMed Web of Science ®Google Scholar
• Ritter, S., Anderson, J. R., Koedinger, K. R., & Corbett, A. (2007). Cognitive tutor: Applied research in mathematics education. Psychonomic Bulletin & Review, 14(2), 249–255. https://doi.org/10.3758/bf03194060
   PubMed Web of Science ®Google Scholar
• Rivers, C. M., & Lewis, B. L. (2014). Ethical research standards in a world of big data. F1000Research, 3, 38. https://doi.org/10.12688/f1000research.3-38.v2
   Google Scholar
• Rocca, R., Tamagnone, N., Fekih, S., Contla, X., & Rekabsaz, N. (2023). Natural language processing for humanitarian action: Opportunities, challenges, and the path toward humanitarian NLP. Frontiers in Big Data, 6, 1082787. https://doi.org/10.3389/fdata.2023.1082787
   PubMedGoogle Scholar
• Röder, M., Both, A., & Hinneburg, A. (2015). Exploring the space of topic coherence measures. In Web Search and Data Mining. https://doi.org/10.1145/2684822.2685324
   Google Scholar
• Sarica, S., & Luo, J. (2021). Stopwords in technical language processing. PLOS One, 16(8), e0254937. https://doi.org/10.1371/journal.pone.0254937
   PubMed Web of Science ®Google Scholar
• Schuh, K. L., & Barab, S. A. (2008). Philosophical perspectives. In Handbook of research on educational communications and technology (pp. 67–82). Routledge.
   Google Scholar
• Shahiri, A. M., Husain, W., & Rashid, N. A. (2015). A review on predicting student’s performance using data mining techniques. Procedia Computer Science, 72, 414–422. https://doi.org/10.1016/j.procs.2015.12.157
   Google Scholar
• Shiha, M. O., & Ayvaz, S. (2017). The effects of emoji in sentiment analysis. International Journal of Computer and Electrical Engineering, 9(1), 360–369. https://doi.org/10.17706/IJCEE.2017.9.1.360-369
   Google Scholar
• Siemens, G. (2005). Connectivism: Learning as network-creation. ASTD Learning News, 10(1), 1–28.
   Google Scholar
• Street, B. V. (1984). Literacy in theory and practice. Cambridge University Press.
   Google Scholar
• TikTok Communications [@TikTokComms] (2021, October 25). In recognition of Media Literacy Week, we’ve teamed up with @MediaLiteracyEd to create videos with tips to help everyone have a richer, more informed online experience. [Tweet]. Twitter. Retrieved from https://twitter.com/TikTokComms/status/1452704941009559553
   Google Scholar
• TikTokTips [@TikTokTips] (n.d.). We’re on a mission to promote privacy, safety, and positive vibes! Retrieved from https://www.tiktok.com/@tiktoktips?lang=en
   Google Scholar
• Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16(10), 837–851. https://doi.org/10.1177/1077800410383121
   Web of Science ®Google Scholar
• Turner, K. H., Hicks, T., & Zucker, L. (2020). Connected reading: A framework for understanding how adolescents encounter, evaluate, and engage with texts in the digital age. Reading Research Quarterly, 55(2), 291–309. https://doi.org/10.1002/rrq.271
   Web of Science ®Google Scholar
• United Nations Educational, Scientific and Cultural Organization (n.d.). About media and information literacy. Retrieved from https://www.unesco.org/en/communication-information/media-information-literacy/about
   Google Scholar
• United Nations Educational, Scientific and Cultural Organization (1982). Grunwald declaration on media education. Retrieved from https://milobs.pt/wp-content/uploads/2018/06/The-Grünwald-Declaration-on-Media-Education.pdf
   Google Scholar
• Vogels, E. A., Gelles-Watnick, R., & Massarat, N. (2022). Teens, social media and technology 2022. Policy Commons. Retrieved from https://policycommons.net/artifacts/2644169/teens-social-media-and-technology-2022/3667002/
   Google Scholar
• Vygotsky, L. S., & Cole, M. (1978). Mind in society: Development of higher psychological processes. Harvard University Press.
   Google Scholar
• Weisberg, L., Wan, X., Wusylko, C., & Kohnen, A. M. (2023). Critical Online Information Evaluation (COIE): A comprehensive model for curriculum and assessment design. Journal of Media Literacy Education, 15(1), 14–30. https://doi.org/10.23860/JMLE-2023-15-1-2
   Google Scholar
• Weiss, J. K., & Cohen, E. L. (2019). Clicking for change: The role of empathy and negative affect on engagement with a charitable social media campaign. Behaviour & Information Technology, 38(12), 1185–1193. https://doi.org/10.1080/0144929X.2019.1578827
   Web of Science ®Google Scholar
• Wineburg, S., Breakstone, J., McGrew, S., Smith, M. D., & Ortega, T. (2022). Lateral reading on the open Internet: A district-wide field study in high school government classes. Journal of Educational Psychology, 114(5), 893–909. https://doi.org/10.1037/edu0000740
   Web of Science ®Google Scholar
• Xiao, Y., & Yu, S. (2022). Using humor to promote social distancing on TikTok during the COVID-19 pandemic. Frontiers in Psychology, 13, 887744. https://doi.org/10.3389/fpsyg.2022.887744
   PubMed Web of Science ®Google Scholar