Mouse tracking and consumer experience: exploring the associations between mouse movements, consumer emotions, brand awareness and purchase intent

References

• Abou-Shouk, M., and M. Soliman. 2021. “The Impact of Gamification Adoption Intention on Brand Awareness and Loyalty in Tourism: The Mediating Effect of Customer Engagement.” Journal of Destination Marketing and Management 20: 100559. https://doi.org/10.1016/j.jdmm.2021.100559.
   Web of Science ®Google Scholar
• Anderson, B. B., A. Vance, C. B. Kirwan, J. L. Jenkins, and D. Eargle. 2016. “Fro Warning to Wallpaper: Why the Brain Habituates to Security Warnings and What Can Be Done About It.” Journal of Management Information Systems 33 (3): 713–743. https://doi.org/10.1080/07421222.2016.1243947.
   Web of Science ®Google Scholar
• Appelbaum, M., H. Cooper, R. B. Kline, E. Mayo-Wilson, A. M. Nezu, and S. M. Rao. 2018. “Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report.” American Psychologist 73 (1): 3–25. https://doi.org/10.1037/amp0000191.
   PubMed Web of Science ®Google Scholar
• Arapakis, I., M. Lalmas, and G. Valkanas. 2014. “Understanding Within-Content Engagement through Pattern Analysis of Mouse Gestures.” Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. https://doi.org/10.1145/2661829.2661909.
   Google Scholar
• Arapakis, I., and L. A. Leiva. 2016. “Predicting User Engagement with Direct Displays Using Mouse Mouse Information.” Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval. https://doi.org/10.1145/2911451.2911505.
   Google Scholar
• Chand, V. S., and C. Fei. 2021. “Self-brand Connection and Intention to Purchase a Counterfeit Luxury Brand in Emerging Economies.” Journal of Consumer Behaviour 20 (2): 399–411. https://doi.org/10.1002/cb.1871.
   Web of Science ®Google Scholar
• Coombes, S. A., K. M. Gamble, J. H. Cauraugh, and C. M. Janelle. 2008. “Emotional States Alter Force Control During a Feedback Occluded Motor Task.” Emotion, 8 (1): 104–113. https://doi.org/10.1037/1528-3542.8.1.104.
   PubMed Web of Science ®Google Scholar
• Dale, R., and N. D. Duran. 2011. “The Cognitive Dynamics of Negated Sentence Verification.” Cognitive Science 35 (5): 983–996. https://doi.org/10.1111/j.1551-6709.2010.01164.x.
   PubMed Web of Science ®Google Scholar
• Dessart, L., and V. Pitardi. 2019. “How Stories Generate Consumer Engagement: An Exploratory Study.” Journal of Business Research, Elsevier 104 (C): 183–195. https://doi.org/10.1016/j.jbusres.2019.06.045.
   Google Scholar
• Dias da Silva, M. R., and M. Postma. 2020. “Wandering Minds, Wandering Mice: Computer Mouse Tracking as a Method to Detect Mind Wandering.” Computers in Human Behavior 112:106453. https://doi.org/10.1016/j.chb.2020.106453.
   Web of Science ®Google Scholar
• Ding, Y., and T. Zhao. 2020. “Emotions, Engagement, and Self-Perceived Achievement in a Small Private Online Course.” Journal of Computer Assisted Learning 36 (4): 449–457. https://doi.org/10.1111/jcal.12410.
   Web of Science ®Google Scholar
• Duran, N. D., S. P. Nicholson, and R. Dale. 2017. “The Hidden Appeal and Aversion to Political Conspiracies as Revealed in the Response Dynamics of Partisans.” Journal of Experimental Social Psychology 73: 268–278. https://doi.org/10.1016/j.jesp.2017.07.008.
   Web of Science ®Google Scholar
• Faulkenberry, T. J., and A. E. Rey. 2014. “Extending the Reach of Mousetracking in Numerical Cognition: A Comment on Fischer and Hartmann (2014).” Frontiers in Psychology 5:1436. https://doi.org/10.3389/fpsyg.2014.01436.
   PubMed Web of Science ®Google Scholar
• Fitts, P. M. 1954. “The Information Capacity of the Human Motor System in Controlling the Amplitude of Movement.” Journal of Experimental Psychology 47 (6): 381–391. https://doi.org/10.1037/h0055392.
   PubMedGoogle Scholar
• Freeman, J. B., and N. Ambady. 2010. “MouseTracker: Software for Studying Real-Time Mental Processing Using a Computer Mouse-Tracking Method.” Behavior Research Methods 42 (1): 226–241. https://doi.org/10.3758/BRM.42.1.226.
   PubMed Web of Science ®Google Scholar
• Freihaut, P., and A. S. Göritz. 2021. “Using the Computer Mouse for Stress Measurement – An Empirical Investigation and Critical Review.” International Journal of Human Computer Studies 145 (January 2020): 102520. https://doi.org/10.1016/j.ijhcs.2020.102520.
   Google Scholar
• Gatti, D., M. Marelli, and L. Rinaldi. 2021. “Predicting Hand Movements with Distributional Semantics: Evidence from Predicting Hand Movements with Distributional Semantics: Evidence from Mouse-Tracking”, April 1–18.
   Google Scholar
• Ghosh, S., K. Hiware, N. Ganguly, B. Mitra, and P. De. 2019. “Emotion Detection from Touch Interactions During Text Entry on Smartphones.” International Journal of Human Computer Studies 130 (August 2018): 47–57. https://doi.org/10.1016/j.ijhcs.2019.04.005.
   Google Scholar
• Griffiths, L., and Z. Chen. 2007. “Investigating the Differences in Web Browsing Behaviour of Chinese and European Users Using Mouse Tracking.” Usability and Internationalization. HCI and Culture, 4559:502–512. https://doi.org/10.1007/978-3-540-73287-7_59.
   Google Scholar
• Grimes, G. M., J. L. Jenkins, and J. S. Valacich. 2013. “Exploring the Effect of Arousal and Valence on Mouse Interaction.” International Conference on Information Systems (ICIS 2013): Reshaping Society Through Information Systems Design 2:1634–1648. https://doi.org/10.5465/amr.2012.0429.
   Google Scholar
• Guo, Q., and E. Agichtein. 2008. “Exploring Mouse Movements for Inferring Query Intent.” Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR ‘08. https://doi.org/10.1145/1390334.1390462.
   Google Scholar
• Guo, Q., and E. Agichtein. 2012. “Beyond Dwell Time.” Proceedings of the 21st International Conference on World Wide Web - WWW ‘12. https://doi.org/10.1145/2187836.2187914.
   Google Scholar
• Guo, Q., D. Lagun, and E. Agichtein. 2012. “Predicting Web Search Success with Fine Grained Interaction Data.” Proceedings of the 21st ACM International Conference on Information and Knowledge Management - CIKM ‘12. https://doi.org/10.1145/2396761.2398570.
   Google Scholar
• Hehman, E., R. M. Stolier, and J. B. Freeman. 2014. “Advanced Mouse-Tracking Analytic Techniques for Enhancing Psychological Science.” Group Processes & Intergroup Relations 18 (3): 384–401. https://doi.org/10.1177/1368430214538325.
   Web of Science ®Google Scholar
• Heinonen, K. 2011. “Consumer Activity in Social Media: Managerial Approaches to Consumers’ Social Media Behavior.” Journal of Consumer Behaviour 10 (6): 356–364. https://doi.org/10.1002/cb.376.
   Web of Science ®Google Scholar
• Hertzum, M. 2010. Frustration: A Common User Experience. DHRS2010: Proceedings of the Tenth Danish Human-Computer Interaction Research Symposium, May 11–14. http://citeseerx.ist.psu.edu/viewdoc/summary?doi = 10.1.1.418.5740&rank = 248.
   Google Scholar
• Hibbeln, M., J. L. Jenkins, C. Schneider, J. S. Valacich, and M. Weinmann. 2017. “How Is Your User Feeling? Inferring Emotion Through Human-Computer Interaction Devices.” MIS Quarterly 41 (1): 1–21. https://doi.org/10.25300/MISQ/2017/41.1.01.
   Web of Science ®Google Scholar
• Hoeppner, B. B., J. F. Kelly, K. A. Urbanoski, and V. Slaymaker. 2011. “Comparative Utility of a Single-Item Versus Multiple-Item Measure of Self-Efficacy in Predicting Relapse among Young Adults.” Journal of Substance Abuse Treatment 41 (3): 305–312. https://doi.org/10.1016/j.jsat.2011.04.005.
   PubMed Web of Science ®Google Scholar
• Høgenhaug, P. S. 2012. “Gamification And UX: Where Users Win Or Lose.” Smashing Magazine, 1–26. http://www.smashingmagazine.com/2012/04/gamification-uxusers-win-lose/.
   Google Scholar
• Hollebeek, L. D. 2011. “Demystifying Customer Brand Engagement: Exploring the Loyalty Nexus.” Journal of Marketing Management 27 (7-8): 785–807. https://doi.org/10.1080/0267257X.2010.500132.
   Google Scholar
• Huang, J., R. W. White, and S. Dumais. 2011. “No Clicks, No Problem.” Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/1978942.1979125.
   Google Scholar
• Jung, S. G., J. Salminen, and B. Jansen. 2021. “Persona Analytics: Implementing Mouse-Tracking for an Interactive Persona System.” Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/3411763.3451773.
   Google Scholar
• Kaklauskas, A., E. K. Zavadskas, M. Seniut, G. Dzemyda, V. Stankevic, C. Simkevičius, T. Stankevic, et al. 2011. “Web-based Biometric Computer Mouse Advisory System to Analyze a User's Emotions and Work Productivity.” Engineering Applications of Artificial Intelligence 24 (6): 928–945. https://doi.org/10.1016/j.engappai.2011.04.006.
   Web of Science ®Google Scholar
• Kieslich, P. J., and B. E. Hilbig. 2014. “Cognitive Conflict in Social Dilemmas: An Analysis of Response Dynamics.” Judgment and Decision Making 9 (6): 510–522. https://doi.org/10.1017/S1930297500006392.
   Web of Science ®Google Scholar
• Kirsh, I., M. Joy, and Y. Kirsh. 2020. “Horizontal Mouse Movements (HMMs) on Web Pages as Indicators of User Interest.” Communications in Computer and Information Science, 1293:416–423. https://doi.org/10.1007/978-3-030-60700-5_53.
   Google Scholar
• Klein, J., Y. Moon, and R. Picard. 2002. “This Computer Responds to User Frustration.” Interacting with Computers 14 (2): 119–140. https://doi.org/10.1016/S0953-5438(01)00053-4.
   Web of Science ®Google Scholar
• Koop, G. J., and A. H. Criss. 2016. “The Response Dynamics of Recognition Memory: Sensitivity and Bias.” Journal of Experimental Psychology: Learning, Memory, and Cognition 42 (5): 671–685. https://doi.org/10.1037/xlm0000202.
   PubMed Web of Science ®Google Scholar
• Kuo, Y. F., S. T. Yen, and L. H. Chen. 2011. “Online Auction Service Failures in Taiwan: Typologies and Recovery Strategies.” Electronic Commerce Research and Applications 10 (2): 183–193. https://doi.org/10.1016/j.elerap.2009.09.003.
   Web of Science ®Google Scholar
• Land, S. 2019. “A Review of Mouse-Tracking Applications in Economic Studies.” Journal of Economics and Behavioral Studies 11 (6): 1–9. ISSN: 2220-6140.
   Google Scholar
• Lang, P. J., and M. M. Bradley. 2007. “The International Affective Picture System (IAPS) in the Study of Emotion and Attention.” In Handbook of Emotion Elicitation and Assessment, edited by J. A. Coan, and J. J. B. Allen, 29–46. New York: Oxford University Press.
   Google Scholar
• Leckie, C., M. W. Nyadzayo, and L. W. Johnson. 2016. “Antecedents of Consumer Brand Engagement and Brand Loyalty.” Journal of Marketing Management 32 (5-6): 558–578. https://doi.org/10.1080/0267257X.2015.1131735.
   Web of Science ®Google Scholar
• Liu, Y., C. Wang, K. Zhou, J. Nie, M. Zhang, and S. Ma. 2014. “From Skimming to Reading.” Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. https://doi.org/10.1145/2661829.2661907.
   Google Scholar
• Maithri, M., U. Raghavendra, A. Gudigar, J. Samanth, P. D. Barua, M. Murugappan, Y. Chakole, and U. R. Acharya. 2022. “Automated Emotion Recognition: Current Trends and Future Perspectives.” Computer Methods and Programs in Biomedicine 215:106646. https://doi.org/10.1016/j.cmpb.2022.106646.
   PubMed Web of Science ®Google Scholar
• Maldonado, M., E. Dunbar, and E. Chemla. 2019. “Mouse Tracking as a Window Into Decision Making.” Behavior Research Methods 51 (3): 1085–1101. https://doi.org/10.3758/s13428-018-01194-x.
   PubMed Web of Science ®Google Scholar
• Navalpakkam, V., and E. Churchill. 2012. “Mouse Tracking: Measuring and Predicting Users' Experience of Web-Based Content.” In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12), 2963–2972. New York, NY, USA: Association for Computing Machinery. https://doi.org/10.1145/2207676.2208705.
   Google Scholar
• Navalpakkam, V., L. Jentzsch, R. Sayres, S. Ravi, A. Ahmed, and A. Smola. 2013. “Measurement and Modeling of Eye-Mouse Behavior in the Presence of Nonlinear Page Layouts.” Proceedings of the 22nd International Conference on World Wide Web - WWW ‘13. https://doi.org/10.1145/2488388.2488471.
   Google Scholar
• Norfarah, N., and A. K. Siti-Nabiha. 2018. “Private Label Brand Purchase Intention: A Malaysian Study.” Global Business and Management Research: An International Journal 10: 197–215.
   Google Scholar
• Pimenta, A., D. Carneiro, P. Novais, and J. Neves. 2013. “Monitoring Mental Fatigue Through the Analysis of Keyboard and Mouse Interaction Patterns.” Lecture Notes in Computer Science, 8073:222–231. https://doi.org/10.1007/978-3-642-40846-5_23.
   Google Scholar
• Rather, R. A., L. D. Hollebeek, T. VO-THANH, H. Ramkissoon, A. Leppiman, and D. Smith. 2022. “Shaping Customer Brand Loyalty During the Pandemic: The Role of Brand Credibility, Value Congruence, Experience, Identification, and Engagement.” Journal of Consumer Behaviour, 21 (5):1–15. https://doi.org/10.1002/cb.2070.
   Web of Science ®Google Scholar
• Rodden, K., X. Fu, A. Aula, and I. Spiro. 2008. “Eye-Mouse Coordination Patterns on Web Search Results Pages.” CHI ‘08 Extended Abstracts on Human Factors in Computing Systems. https://doi.org/10.1145/1358628.1358797.
   Google Scholar
• Routledge, H. 2015. Why Games Are good for Business - How to Leverage the Power of Serious Games, Gamification and Simulations.
   Google Scholar
• Sailer, M., J. U. Hense, S. K. Mayr, and H. Mandl. 2017. “How Gamification Motivates: An Experimental Study of the Effects of Specific Game Design Elements on Psychological Need Satisfaction.” Computers in Human Behavior 69:371–380. https://doi.org/10.1016/j.chb.2016.12.033.
   Web of Science ®Google Scholar
• Salmeron-Majadas, S., O. C. Santos, and J. G. Boticario. 2014. “An Evaluation of Mouse and Keyboard Interaction Indicators Towards Non-Intrusive and Low Cost Affective Modeling in an Educational Context.” Procedia Computer Science 35:691–700. https://doi.org/10.1016/j.procs.2014.08.151.
   Google Scholar
• Schoemann, M., D. O’Hora, R. Dale, et al. 2021. “Using Mouse Cursor Tracking to Investigate Online Cognition: Preserving Methodological Ingenuity While Moving Toward Reproducible Science.” Psychonomic Bulletin & Review 28 (3): 766–787. https://doi.org/10.3758/s13423-020-01851-3.
   PubMed Web of Science ®Google Scholar
• Seelye, A., S. Hagler, N. Mattek, D. B. Howieson, K. Wild, H. H. Dodge, and J. A. Kaye. 2015. “Computer Mouse Movement Patterns: A Potential Marker of Mild Cognitive Impairment.” Alzheimer’s and Dementia: Diagnosis, Assessment and Disease Monitoring 1 (4): 472–480. https://doi.org/10.1016/j.dadm.2015.09.006.
   PubMedGoogle Scholar
• Shapiro, S. S., and M. B. Wilk. 1965. “An Analysis of Variance Test for Normality (Complete Samples).” Biometrika 52 (3-4): 591–611. https://doi.org/10.1093/biomet/52.3-4.591.
   Web of Science ®Google Scholar
• Shen, W., and X. Wei. 2022. “Tracking the Effectiveness of Creative ads with a Computer Mouse.” PsyCh Journal 11 (1): 51–54. https://doi.org/10.1002/pchj.497.
   PubMed Web of Science ®Google Scholar
• Spivey, M. J. 2007. The Continuity of Mind. Oxford, UK: Oxford University Press.
   Google Scholar
• Spivey, M. J., and R. Dale. 2004. “On the Continuity of Mind: Toward a Dynamical Account of Cognition.” Psychology of Learning and Motivation 45: 87–142. https://doi.org/10.1016/S0079-7421(03)45003-2.
   Web of Science ®Google Scholar
• Stillman, P. E., D. Medvedev, and M. J. Ferguson. 2017. “Resisting Temptation: Tracking How Self-Control Conflicts Are Successfully Resolved in Real Time.” Psychological Science 28 (9): 1240–1258. https://doi.org/10.1177/0956797617705386.
   PubMed Web of Science ®Google Scholar
• Stillman, P. E., X. Shen, and M. J. Ferguson. 2018. “How Mouse-Tracking Can Advance Social Cognitive Theory.” Trends in Cognitive Sciences 22 (6): 531–543. https://doi.org/10.1016/j.tics.2018.03.012.
   PubMed Web of Science ®Google Scholar
• Tzafilkou, K., D. Karapiperis, and V. S. Verykios. 2022. “Empowering Affect-Aware Systems by Monitoring Mouse Speed and Acceleration.” IEEE International Smart Cities Conference (ISC2), Pafos, Cyprus, 1–7. https://doi.org/10.1109/ISC255366.2022.9921873.
   Google Scholar
• Tzafilkou, K., M. Perifanou, and A. A. Economides. 2021. “Negative Emotions, Cognitive Load, Acceptance, and Self-Perceived Learning Outcome in Emergency Remote Education During COVID-19.” Education and Information Technologies 26 (6): 7497–7521. https://doi.org/10.1007/s10639-021-10604-1.
   PubMed Web of Science ®Google Scholar
• Tzafilkou, K., and N. Protogeros. 2018. “Mouse Behavioral Patterns and Keystroke Dynamics in End-User Development: What Can They Tell us About Users’ Behavioral Attributes?” Computers in Human Behavior 83: 288–305. https://doi.org/10.1016/j.chb.2018.02.012.
   Web of Science ®Google Scholar
• Tzafilkou, K., and N. Protogeros. 2020. “Monitoring Mouse Behavior in e-Learning Activities to Diagnose Students’ Acceptance Items of Perceived Usefulness and Ease of Use.” The European Educational Researcher 3 (1): 21–27. https://doi.org/10.31757/euer.312.
   Google Scholar
• Tzafilkou, K., N. Protogeros, and C. Yakinthos. 2014. “Mouse Tracking for Web Marketing: Enhancing User Experience in Web Application Software by Measuring Self-Efficacy and Hesitation Levels.” International Journal of Strategic Innovative Marketing 01:233–247. https://doi.org/10.15556/ijsim.01.04.005.
   Google Scholar
• Tzeng, J. Y. 2004. “Toward a More Civilized Design: Studying the Effects of Computers That Apologize.” International Journal of Human-Computer Studies 61 (3): 319–345. https://doi.org/10.1016/j.ijhcs.2004.01.002.
   Web of Science ®Google Scholar
• van Galen, G. P., M. L. Müller, R. G. Meulenbroek, and A. W. Van Gemmert. 2002. “Forearm EMG Response Activity During Motor Performance in Individuals Prone to Increased Stress Reactivity.” American Journal of Industrial Medicine 41 (5): 406–419. https://doi.org/10.1002/ajim.10051.
   PubMed Web of Science ®Google Scholar
• Vizer, L. M., L. Zhou, and A. Sears. 2009. “Automated Stress Detection Using Keystroke and Linguistic Features: An Exploratory Study.” International Journal of Human Computer Studies 67 (10): 870–886. https://doi.org/10.1016/j.ijhcs.2009.07.005.
   Web of Science ®Google Scholar
• Weinmann, M., C. Schneider, and S. Robra-Bissantz. 2011. “MOUSEREC—Monitoring Online Users’ Emotions by Recording and Evaluating Mouse Movements.” ItAIS 2013:1–8.
   Google Scholar
• Wuryandari, N. E. R., P. Vincentiar, and D. Permana. 2019. “Buying Intention Through User Interface Design.” European Research Studies Journal XXII (Issue 3): 470–479. https://doi.org/10.35808/ersj/1492.
   Google Scholar
• Yamauchi, T., and C. Bowman. 2015. “Mining Mouse Motions to Find the Gender, Experience, and Feelings of Computer Users.” IEEE International Conference on Data Mining Workshops, ICDMW, 2015-Janua (January), 221–230. https://doi.org/10.1109/ICDMW.2014.131.
   Google Scholar
• Yamauchi, T., and K. Xiao. 2018. “Reading Emotion from Mouse Mouse Motions: Affective Computing Approach.” Cognitive Science 42 (3): 771–819. https://doi.org/10.1111/cogs.12557.
   PubMed Web of Science ®Google Scholar
• Zavadskas, E., A. Kaklauskas, M. Seniut, G. Dzemyda, S. Ivanikovas, V. Stankevic, C. Simkevičius, and A. Jaruševičius. 2008. “Web-Based Biometric Mouse Intelligent System for Analysis of Emotional State and Labour Productivity.” ISARC 2008 - Proceedings from the 25th International Symposium on Automation and Robotics in Construction, 429–434. https://doi.org/10.3846/isarc.20080626.429.
   Google Scholar
• Zimmermann, P., S. Guttormsen, B. Danuser, and P. Gomez. 2003. “Affective Computing – A Rationale for Measuring Mood with Mouse and Keyboard.” International Journal of Occupational Safety and Ergonomics 9 (4): 539–551. https://doi.org/10.1080/10803548.2003.11076589.
   PubMedGoogle Scholar