Evaluating Photoplethysmogram as a Real-Time Cognitive Load Assessment during Game Playing

References

• Allen, J. (2007). Photoplethysmography and its application in clinical physiological measurement. Physiological Measurement, 28(3), R1–R39. doi:10.1088/0967-3334/28/3/R01
   PubMed Web of Science ®Google Scholar
• Berntson, G. G., Cacioppo, J. T., & Quigley, K. S. (1991). Autonomic determinism : The modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint. Psychological Review, 98(4), 459–487. doi:10.1037/0033-295X.98.4.459
   PubMed Web of Science ®Google Scholar
• Biondi, M., & Picardi, A. (1999). Psychological stress and neuroendocrine function in humans: The last two decades of research. Psychotherapy and Psychosomatics, 68(3), 114–150. doi:10.1159/000012323
   PubMed Web of Science ®Google Scholar
• Bousefsaf, F., Maaoui, C., & Pruski, A. (2014). Remote detection of mental workload changes using cardiac parameters assessed with a low-cost webcam. Computers in Biology and Medicine, 53, 154–163. doi:10.1016/j.compbiomed.2014.07.014
   PubMed Web of Science ®Google Scholar
• Brouwer, A., Hogervorst, M. A., Holewijn, M., & van Erp, J. B. F. (2014). Evidence for effects of task difficulty but not learning on neurophysiological variables associated with effort. International Journal of Psychophysiology, 93(2), 242–252. doi:10.1016/j.ijpsycho.2014.05.004
   PubMed Web of Science ®Google Scholar
• Brouwer, A.-M., Hogervorst, M. A., van Erp, J. B., Heffelaar, T., Zimmerman, P. H., & Oostenveld, R. (2012). Estimating workload using EEG spectral power and ERPs in the n-back task. Journal of Neural Engineering, 9(4), 045008. doi:10.1088/1741-2560/9/4/045008
   PubMed Web of Science ®Google Scholar
• Carter, J. R., Durocher, J. J., Larson, R. A., Dellavalla, J. P., & Yang, H. (2012). Sympathetic neural responses to 24-hour sleep deprivation in humans: Sex differences. American Journal of Physiology-Heart and Circulatory Physiology, 302(10), H1991–H1997. doi:10.1152/ajpheart.01132.2011
   PubMed Web of Science ®Google Scholar
• Carter, J. R., & Ray, C. A. (2009). Sympathetic neural responses to mental stress: Responders, nonresponders and sex differences. American Journal of Physiology-Heart and Circulatory Physiology, 296(3), H847–H853. doi:10.1152/ajpheart.01234.2008
   PubMed Web of Science ®Google Scholar
• Challoner, A. V. J. (1979). Photoelectric plethysmography for estimating cutaneous blood flow. In P. Rolfe (Ed.), Noninvasive Physiological Measurements (pp. 125–151). London, UK: Academic Press.
   Google Scholar
• Chen, C. C., Lin, S. C., Young, M. S., & Yang, C. L. (2014). Accumulated mental stress study using the meridians of traditional Chinese medicine with photoplethysmography. Journal of Alternative and Complementary Medicine, 20(11), 860–867. doi:10.1089/acm.2013.0421
   PubMed Web of Science ®Google Scholar
• Choi, Y., Kim, M., & Chun, C. (2015). Measurement of occupants’ stress based on electroencephalograms (EEG) in twelve combined environments. Building and Environment, 88, 65–72. doi:10.1016/j.buildenv.2014.10.003
   Web of Science ®Google Scholar
• Durocher, J. J., Schwartz, C. E., & Carter, J. R. (2009). Sympathetic neural responses to mental stress during acute simulated microgravity. Journal of Applied Physiology, 107(2), 518–522. doi:10.1152/japplphysiol.00284.2009
   PubMed Web of Science ®Google Scholar
• Elgendi, M. (2012). On the analysis of fingertip photoplethysmogram signals. Current Cardiology Reviews, 8(1), 14–25. doi:10.2174/157340312801215782
   PubMedGoogle Scholar
• Graham, G. (2009). FUN INC: Why games are the 21st Century’s most serious business. Logos, 20(1), 171–173. doi:10.1163/095796509X12777334632663
   Google Scholar
• Harris, C. W., Edwards, J. L., Baruch, A., Riley, W. A., Pusser, B. E., Rejeski, W. J., & Herrington, D. M. (2000). Effects of mental stress on brachial artery flow-mediated vasodilation in healthy normal individuals. American Heart Journal, 139(3), 405–411.
   PubMed Web of Science ®Google Scholar
• Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In A. H. Peter & M. Najmedin (Eds.), Advances in psychology (Vol. Volume 52, pp. 139–183). Oxford, UK: North-Holland.
   Google Scholar
• Hjortskov, N., Rissen, D., Blangsted, A. K., Fallentin, N., Lundberg, U., & Sogaard, K. (2004). The effect of mental stress on heart rate variability and blood pressure during computer work. European Journal of Applied Physiology, 92(1–2), 84–89. doi:10.1007/s00421-004-1055-z
   PubMed Web of Science ®Google Scholar
• Iani, C., Gopher, D., & Lavie, P. (2004). Effects of task difficulty and invested mental effort on peripheral vasoconstriction. Psychophysiology, 41(5), 789–798. doi:10.1111/psyp.2004.41.issue-5
   PubMed Web of Science ®Google Scholar
• Klein, J. C., Crandall, C. G., & Carter, J. R. (2010). Combined heat and mental stress alters neurovascular control in humans. Journal of Applied Physiology, 109(6), 1880–1886. doi:10.1152/japplphysiol.00779.2010
   PubMed Web of Science ®Google Scholar
• Kreibig, S. D. (2010). Autonomic nervous system activity in emotion: A review. Biological Psychology, 84(3), 394–421. doi:10.1016/j.biopsycho.2010.03.010
   PubMed Web of Science ®Google Scholar
• Luo, L., Xiao, L., Miao, D., & Luo, X. (2012). The relationship between mental stress induced changes in cortisol levels and vascular responses quantified by waveform analysis: Investigating stress-dependent indices of vascular changes. International Conference on Biomedical Engineering and Biotechnology, (pp. 929–933). Macao, China: IEEE.
   Google Scholar
• Lyu, Y., Luo, X., Zhou, J., Yu, C., Miao, C., Wang, T., … Kameyama, K. (2015). Measuring photoplethysmogram-based stress-induced vascular response index to assess cognitive load and stress. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15), (pp. 857–866). New York, NY: ACM. doi: 10.1145/2702123.2702399
   Google Scholar
• Mandryk, R. L., & Atkins, M. S. (2007). A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies. International Journal of Human-Computer Studies, 65(4), 329–347. doi:10.1016/j.ijhcs.2006.11.011
   Web of Science ®Google Scholar
• Mcduff, D., Hernandez, J., Gontarek, S., & Picard, R. W. (2016). COGCAM: Contact-free measurement of cognitive stress during computer tasks with a digital camera. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16) (pp. 4000-4004). New York, NY: ACM. doi: 10.1145/2858036.2858247
   Google Scholar
• Nacke, L., & Drachen, A. (2011). Towards a framework of player experience research (Pre-print). Bordeaux, France: Foundations of Digital Games Conference.
   Google Scholar
• Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63–71. doi:10.1207/S15326985EP3801_8
   Web of Science ®Google Scholar
• Petkar, H., Dande, S., Yadav, R., Zeng, Y., & Nguyen, T. A. (2009). A pilot study to assess designer’s mental stress using eye gaze system and electroencephalogram. ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (pp. 899–909, 1650). American Society of Mechanical Engineers. doi:10.1115/detc2009-86542
   Google Scholar
• Picard, R. W. (2000). SmartCar: Detecting driver stress. International Conference on Pattern Recognition (Vol.4, pp.4218). IEEE Computer Society.
   Google Scholar
• Ray, C. A., & Carter, J. R. (2010). Effects of aerobic exercise training on sympathetic and renal responses to mental stress in humans. American Journal of Physiology-Heart and Circulatory Physiology, 298(1), H229–H234. doi:10.1152/ajpheart.00880.2009
   PubMed Web of Science ®Google Scholar
• Sengupta, J., Baviskar, N., & Shukla, S. (2013). <Biosignal acquisition system for stress monitoring.pdf>. doi:10.1007/978-3-642-35864-7_69
   Google Scholar
• Seo, S. H., & Lee, J. T. (2010). Stress and EEG. Convergence and Hybrid Information Technologies. InTech.
   Google Scholar
• Sun, D., Paredes, P., & Canny, J. (2014). MouStress: Detecting stress from mouse motion. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14) (pp. 61–70). New York, NY: ACM. doi:10.1145/2556288.2557243
   Google Scholar
• Sun, F. T., Kuo, C., Cheng, H. T., Buthpitiya, S., Collins, P., & Griss, M. (2010). Activity-aware mental stress detection using physiological sensors. Lecture Notes of the Institute for Computer Sciences Social Informatics & Telecommunications Engineering, 23(13), 211–230.
   Google Scholar
• Taelman, J., Vandeput, S., Spaepen, A., & Huffel, S. V. (2008). Influence of mental stress on heart rate and heart rate variability. Ifmbe Proceedings, 22, 1366–1369.
   Google Scholar
• Tan, C. S. S., Schöning, J., Luyten, K., & Coninx, K. (2014). Investigating the effects of using biofeedback as visual stress indicator during video-mediated collaboration. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14) (pp.71–80). New York, NY: ACM. doi:10.1145/2556288.2557038
   Google Scholar
• Thayer, J. F., Ahs, F., Fredrikson, M., Sollers, J. J., 3rd, & Wager, T. D. (2012). A meta-analysis of heart rate variability and neuroimaging studies: Implications for heart rate variability as a marker of stress and health. Neuroscience and Biobehavioral Reviews, 36(2), 747–756. doi:10.1016/j.neubiorev.2011.11.009
   PubMed Web of Science ®Google Scholar
• Wang, L., Pickwellmacpherson, E., Liang, Y., & Zhang, Y. T. (2009). Noninvasive cardiac output estimation using a novel photoplethysmogram index. International Conference of the IEEE Engineering in Medicine & Biology Society, 2009 (EMBC 2009), 2009, 1746–1749. IEEE.
   Google Scholar
• Wijsman, J., Grundlehner, B., Liu, H., & Hermens, H. (2011). Towards mental stress detection using wearable physiological sensors. International Conference of the IEEE Engineering in Medicine & Biology Society. 2011, 1798–1801.
   Google Scholar
• Yoo, K. S., & Lee, W. H. (2011). Mental stress assessment based on pulse photoplethysmography. IEEE International Symposium on Consumer Electronics (ISCE), Singapore, (pp. 323–326). doi:10.1109/ISCE.2011.5973841
   Google Scholar