Physiological Data for User Experience and Quality of Experience: A Systematic Review (2018–2022)

References

• Ajenaghughrure, I. B., Sousa, S. C., Kosunen, I. J., & Lamas, D. (2019). Predictive model to assess user trust: A psycho-physiological approach [Paper presentation].10th Indian Conference on Human-Computer Interaction, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3364183.3364195
   Google Scholar
• Al-Ashwal, W., Asadi, H., Mohamed, S., Alsanwy, S., Kooijman, L., Nahavandi, D., … Nahavandi, S. (2021). Cybersickness measurement and evaluation during flying a helicopter in different weather conditions in virtual reality [Paper presentation].2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), In (p. 2152–2157). https://doi.org/10.1109/SMC52423.2021.9659215
   Google Scholar
• Alqahtani, F., Katsigiannis, S., & Ramzan, N. (2019). Ecg-based affective computing for difficulty level prediction in intelligent tutoring systems. In 2019 uk/china emerging technologies (ucet). (p. 1–4).
   Google Scholar
• Alves, T., Gama, S., & Melo, F. S. (2018). Flow adaptation in serious games for health [Paper presentation].2018 IEEE 6th International Conference on Serious Games and Applications for Health (SeGAH), In (p. 1–8). https://doi.org/10.1109/SeGAH.2018.8401382
   Google Scholar
• Aqajari, S. A. H., Naeini, E. K., Mehrabadi, M. A., Labbaf, S., Rahmani, A. M., Dutt, N. (2020). GSR analysis for stress: Development and validation of an open source tool for noisy naturalistic GSR data. arXiv. Retrieved from https://arxiv.org/abs/2005.01834
   Google Scholar
• Athif, M., Rathnayake, B. L. K., Nagahapitiya, S. M. D. B. S., Samarasinghe, S. A. D. A. K., Samaratunga, P. S., Peiris, R. L., & De Silva, A. C. (2020). Using biosignals for objective measurement of presence in virtual reality environments [Paper presentation]. In 2020 42nd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC), (p. 3035–3039). https://doi.org/10.1109/EMBC44109.2020.9176022
   Google Scholar
• Babaei, E., Tag, B., Dingler, T., & Velloso, E. (2021). A critique of electrodermal activity practices at CHI [Paper presentation].2021 CHI Conference on Human Factors in Computing Systems, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3411764.3445370
   Google Scholar
• Baka, E., Stavroulia, K. E., Magnenat-Thalmann, N., & Lanitis, A. (2018). An eeg-based evaluation for comparing the sense of presence between virtual and physical environments. In [Paper presentation]. Proceedings of Computer Graphics International 2018, (p. 107–116). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3208159.3208179
   Google Scholar
• Barathi, S. C., Proulx, M., O’Neill, E., & Lutteroth, C. (2020). Affect recognition using psychophysiological correlates in high intensity vr exergaming [Paper presentation].2020 CHI Conference on Human Factors in Computing Systems, In (p. 1–15). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3313831.3376596
   Google Scholar
• Beşkardeşler, K., & Arslan, R. B. (2019). Web-based evaluation of user stress using stroop test and wearable hardware [Paper presentation].2019 11th International Conference on Electrical and Electronics Engineering (ELECO), In (p. 959–962). https://doi.org/10.23919/ELECO47770.2019.8990655
   Google Scholar
• Bruun, A. (2018). It’s not complicated: A study of non-specialists analyzing gsr sensor data to detect ux related events [Paper presentation]. 10th Nordic Conference on Human-Computer Interaction, In (p. 170–183). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3240167.3240183
   Google Scholar
• Cao, Z. (2020). A review of artificial intelligence for EEG-based brain-computer interfaces and applications. Brain Science Advances, 6(3), 162–170. Retrieved from https://doi.org/10.26599/BSA.2020.9050017
   Google Scholar
• Carrera-Rivera, A., Ochoa, W., Larrinaga, F., & Lasa, G. (2022). How-to conduct a systematic literature review: A quick guide for computer science research. MethodsX, 9, 101895. Retrieved from https://www.sciencedirect.com/science/article/pii/S2215016122002746 https://doi.org/10.1016/j.mex.2022.101895
   PubMedGoogle Scholar
• Certický, M., Čertický, M., Sinčák, P., Magyar, G., Vaščák, J., & Cavallo, F. (2019). Psychophysiological indicators for modeling user experience in interactive digital entertainment. Sensors, 19(5). Retrieved from https://www.mdpi.com/1424-8220/19/5/989 https://doi.org/10.3390/s19050989
   PubMed Web of Science ®Google Scholar
• Chauhan, U., Reithinger, N., & Mackey, J. R. (2018). Real-time stress assessment through ppg sensor for vr biofeedback [Paper presentation].20th International Conference on Multimodal Interaction: Adjunct, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3281151.3281156
   Google Scholar
• Che, X., Ma, S., Yu, Q., & Yue, C. (2019). An event-based user experience evaluation method for virtual reality applications [Paper presentation]. In 2019 IEEE Smartworld, Ubiquitous Intelligence Computing, Advanced Trusted Computing, Scalable Computing Communications, Cloud Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), (p. 767–774).
   Google Scholar
• Chen, C., Yao, L., Li, G., Wang, L., Liu, K., Wang, G., & Chen, X. (2021). Research on the relationship between virtual reality content and physiological response. Journal of Physics: Conference Series. 2026(1), 012014. https://doi.org/10.1088/1742-6596/2026/1/012014
   Google Scholar
• Chen, S., & Epps, J. (2020). Multimodal coordination measures to understand users and tasks. ACM Transactions on Computer-Human Interaction. 27(6), 1–26. https://doi.org/10.1145/3412365
   Web of Science ®Google Scholar
• Cho, H., Powell, D., Pichon, A., Kuhns, L. M., Garofalo, R., & Schnall, R. (2019). Eye-tracking retrospective think-aloud as a novel approach for a usability evaluation. International Journal of Medical Informatics, 129, 366–373. Retrieved from https://www.sciencedirect.com/science/article/pii/S1386505619302291 https://doi.org/10.1016/j.ijmedinf.2019.07.010
   PubMed Web of Science ®Google Scholar
• Ciolacu, M. I., & Svasta, P. (2021). Education 4.0: Ai empowers smart blended learning process with biofeedback [Paper presentation].2021 IEEE Global Engineering Education Conference (EDUCON), In (p. 1443–1448). https://doi.org/10.1109/EDUCON46332.2021.9453959
   Google Scholar
• Cipresso, P., Giglioli, I. A. C., Raya, M. A., & Riva, G. (2018). The past, present, and future of virtual and augmented reality research: A network and cluster analysis of the literature. Frontiers in Psychology, 9, 2086. https://doi.org/10.3389/fpsyg.2018.02086
   PubMed Web of Science ®Google Scholar
• Collins, J., Regenbrecht, H., Langlotz, T., Said Can, Y., Ersoy, C., & Butson, R. (2019). Measuring cognitive load and insight: A methodology exemplified in a virtual reality learning context [Paper presentation].2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), In (p. 351–362). https://doi.org/10.1109/ISMAR.2019.00033
   Google Scholar
• Corneille, O., & Mertens, G. (2020). Behavioral and physiological evidence challenges the automatic acquisition of evaluations. Current Directions in Psychological Science, 29(6), 569–574. Retrieved from https://doi.org/10.1177/0963721420964111
   Web of Science ®Google Scholar
• Courtemanche, F., Léger, P.-M., Dufresne, A., Fredette, M., Labonté-Lemoyne, E., & Sénécal, S. (2018). Physiological heatmaps: A tool for visualizing users’ emotional reactions. Multimedia Tools Appl, 77(9), 11547–11574. Retrieved from https://doi.org/10.1007/s11042-017-5091-1
   Web of Science ®Google Scholar
• Darzi, A., McCrea, S. M., & Novak, D. (2021). User experience with dynamic difficulty adjustment methods for an affective exergame: Comparative laboratory-based study. JMIR Serious Games, 9(2), e25771. Retrieved from https://doi.org/10.2196/25771
   PubMed Web of Science ®Google Scholar
• Darzi, A., Wondra, T., McCrea, S., & Novak, D. (2019). Classification of multiple psychological dimensions in computer game players using physiology, performance, and personality characteristics. Frontiers in Neuroscience, 13, 1278. https://doi.org/10.3389/fnins.2019.01278
   PubMed Web of Science ®Google Scholar
• Daylamani-Zad, D., Spyridonis, F., & Al-Khafaaji, K. (2022). A framework and serious game for decision making in stressful situations; a fire evacuation scenario. International Journal of Human-Computer Studies, 162, 102790. https://doi.org/10.1016/j.ijhcs.2022.102790
   Web of Science ®Google Scholar
• de Santana, V. F., & Otani, L. M. F. (2021). Measuring quantitative situated user experience with a mobile galvanic skin response sensor [Paper presentation]. XX Brazilian Symposium on Human Factors in Computing Systems, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3472301.3484339
   Google Scholar
• Dey, A., Phoon, J., Saha, S., Dobbins, C., & Billinghurst, M. (2020a). A neurophysiological approach for measuring presence in immersive virtual environments [Paper presentation].2020 IEEE International Symposium on Mixed and Augmented Reality (Ismar), In (p. 474–485). https://doi.org/10.1109/ISMAR50242.2020.00072
   Google Scholar
• Dey, A., Phoon, J., Saha, S., Dobbins, C., & Billinghurst, M. (2020b). Neurophysiological effects of presence in calm virtual environments [Paper presentation].2020 IEEE Conference on Virtual Reality and 3d User Interfaces Abstracts and Workshops (VRW), In (p. 744–745). https://doi.org/10.1109/VRW50115.2020.00223
   Google Scholar
• Dhaouadi, S., & Ben Khelifa, M. M. (2020). A multimodal physiological-based stress recognition: Deep learning models’ evaluation in gamers’ monitoring application [Paper presentation].2020 5th International Conference on Advanced Technologies for Signal and Image Processing (Atsip), In (p. 1–6). https://doi.org/10.1109/ATSIP49331.2020.9231666
   Google Scholar
• Ding, Y., Cao, Y., Qu, Q., & Duffy, V. G. (2020). An exploratory study using electroencephalography (EEG) to measure the smartphone user experience in the short term. International Journal of Human-Computer Interaction, 36(11), 1008–1021. Retrieved from https://doi.org/10.1080/10447318.2019.1709330
   Web of Science ®Google Scholar
• Drachen, A., Nacke, L. E., Yannakakis, G., & Pedersen, A. L. (2010). Correlation between heart rate, electrodermal activity and player experience in first-person shooter games [Paper presentation].5th ACM Siggraph Symposium on Video Games, In (p. 49–54). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/1836135.1836143
   Google Scholar
• Du, G., Long, S., & Yuan, H. (2020). Non-contact emotion recognition combining heart rate and facial expression for interactive gaming environments. IEEE Access. 8, 11896–11906. https://doi.org/10.1109/ACCESS.2020.2964794
   Web of Science ®Google Scholar
• Du, R., Zhu, S., Ni, H., Mao, T., Li, J., & Wei, R. (2023). Valence-arousal classification of emotion evoked by chinese ancient-style music using 1D-CNN-BiLSTM model on EEG signals for college students. Multimedia Tools and Applications, 82(10), 15439–15456. https://doi.org/10.1007/s11042-022-14011-7
   PubMed Web of Science ®Google Scholar
• Elor, A., Powell, M., Mahmoodi, E., Hawthorne, N., Teodorescu, M., & Kurniawan, S. (2020). On shooting stars: Comparing CAVE and HMD immersive virtual reality exergaming for adults with mixed ability. ACM Trans. Comput. Healthcare, 1(4), 1–22. https://doi.org/10.1145/3396249
   Google Scholar
• Ergan, S., Radwan, A., Zou, Z., Tseng, H.-A., & Han, X. (2019). Quantifying human experience in architectural spaces with integrated virtual reality and body sensor networks. Journal of Computing in Civil Engineering. 33(2), 04018062. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000812
   Web of Science ®Google Scholar
• Frey, J., Ostrin, G., Grabli, M., & Cauchard, J. R. (2020). Physiologically driven storytelling: Concept and software tool [Paper presentation].2020 CHI Conference on Human Factors in Computing Systems, In (p. 1–13). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3313831.3376643
   Google Scholar
• Georges, V., Courtemanche, F., Fredette, M., & Doyon-Poulin, P. (2020). Emotional maps for user experience research in the wild. In [Paper presentation]. Extended Abstracts of the 2020 Chi Conference on Human Factors in Computing Systems, (p. 1–8). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3334480.3383042
   Google Scholar
• Ghinea, G., Andres, F., & Gulliver, S. (2011). Multiple sensorial media advances and applications: New developments in mulsemedia. IGI Global.
   Google Scholar
• Giannakakis, G., Grigoriadis, D., Giannakaki, K., Simantiraki, O., Roniotis, A., & Tsiknakis, M. (2019). Review on psychological stress detection using biosignals. IEEE Transactions on Affective Computing, 13(1), 440–460. https://doi.org/10.1109/TAFFC.2019.2927337
   Google Scholar
• Giannakos, M. N., Sharma, K., Pappas, I. O., Kostakos, V., & Velloso, E. (2019). Multimodal data as a means to understand the learning experience. International Journal of Information Management, 48, 108–119. Retrieved from https://www.sciencedirect.com/science/article/pii/S0268401218312751 https://doi.org/10.1016/j.ijinfomgt.2019.02.003
   Web of Science ®Google Scholar
• Grassini, S., Laumann, K., Thorp, S., & Topranin, V. d M. (2021). Using electrophysiological measures to evaluate the sense of presence in immersive virtual environments: An event-related potential study. Brain and Behavior, 11(8), e2269. https://doi.org/10.1002/brb3.2269
   PubMed Web of Science ®Google Scholar
• Greinacher, R., Kojić, T., Meier, L., Parameshappa, R. G., Möller, S., & Voigt-Antons, J.-N. (2020). Impact of tactile and visual feedback on breathing rhythm and user experience in VR exergaming [Paper presentation].2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), In (p. 1–6). https://doi.org/10.1109/QoMEX48832.2020.9123141
   Google Scholar
• Gruenewald, A., Kroenert, D., Poehler, J., Brueck, R., Li, F., Littau, J., … Niehaves, B. (2018). [regular paper] biomedical data acquisition and processing to recognize emotions for affective learning. In IEEE 18th International Conference on Bioinformatics and Bioengineering (Bibe 2018) (p. 126–132.).
   Google Scholar
• Gupta, K., Hajika, R., Pai, Y. S., Duenser, A., Lochner, M., & Billinghurst, M. (2020). Measuring human trust in a virtual assistant using physiological sensing in virtual reality [Paper presentation].2020 IEEE Conference on Virtual Reality and 3d User Interfaces (VR), In (p. 756–765). https://doi.org/10.1109/VR46266.2020.00099
   Google Scholar
• Gurita, A. E., Soliman, M., Neetson-Lemkes, W., Chung, V., Hansen, N. B., Korte, G., & Vosmeer, M. (2019). Exploring states of mind: Emotion visualization with bio-feedback sensors in a 3d environment. In [Paper presentation]. Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion, (p. 33–36). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3301019.3325150
   Google Scholar
• Haratian, R., & Timotijevic, T. (2018). On-body sensing and signal analysis for user experience recognition in human-machine interaction [Paper presentation].2018 4th International Conference on Frontiers of Signal Processing (ICFSP), In (p. 50–55). https://doi.org/10.1109/ICFSP.2018.8552058
   Google Scholar
• He, H., She, Y., Xiahou, J., Yao, J., Li, J., Hong, Q., & Ji, Y. (2018). Real-time eye-gaze based interaction for human intention prediction and emotion analysis [Paper presentation]. Proceedings of Computer Graphics International 2018, In (p. 185–194). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3208159.3208180
   Google Scholar
• He, L., Li, H., Xue, T., Sun, D., Zhu, S., & Ding, G. (2018). Am i in the theater? usability study of live performance based virtual reality [Paper presentation].24th ACM Symposium on Virtual Reality Software and Technology, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3281505.3281508
   Google Scholar
• Holman, M., & Adebesin, F. (2019). Taking the subjectivity out of ux evaluation with emotiv epoc+ [Paper presentation]. South African Institute of Computer Scientists and Information Technologists 2019, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3351108.3351139
   Google Scholar
• Hossain, E., & Kulshreshth, A. K. (2019). Exploring the effects of stereoscopic 3d on gaming experience using physiological sensors [Paper presentation]. Symposium on Spatial User Interaction, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3357251.3358751
   Google Scholar
• Houzangbe, S., Christmann, O., Gorisse, G., & Richir, S. (2019). Effects of voluntary heart rate control on user engagement in virtual reality [Paper presentation].2019 IEEE Conference on Virtual Reality and 3d User Interfaces (VR), In (p. 982–983). https://doi.org/10.1109/VR.2019.8797759
   Google Scholar
• Houzangbe, S., Christmann, O., Gorisse, G., & Richir, S. (2020). Effects of voluntary heart rate control on user engagement and agency in a virtual reality game. Virtual Reality, 24(4), 665–681. Retrieved from https://doi.org/10.1007/s10055-020-00429-7
   Web of Science ®Google Scholar
• Hussain, J., Khan, W. A., Hur, T., Bilal, H. S. M., Bang, J., Hassan, A. U., … Lee, S. (2018). A multimodal deep log-based user experience (UX) platform for UX evaluation. Sensors, 18(5). Retrieved from https://www.mdpi.com/1424-8220/18/5/1622 https://doi.org/10.3390/s18051622
   Web of Science ®Google Scholar
• Huynh, S., Kim, S., Ko, J., Balan, R. K., & Lee, Y. (2018). Engagemon: Multi-modal engagement sensing for mobile games. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol, 2(1), 1–27. https://doi.org/10.1145/3191745
   Google Scholar
• Hynes, E., Flynn, R., Lee, B., & Murray, N. (2019). A quality of experience evaluation comparing augmented reality and paper based instruction for complex task assistance [Paper presentation].2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP), In (p. 1–6). https://doi.org/10.1109/MMSP.2019.8901705
   Google Scholar
• Isiaka, F. M., Adamu, A., & Adamu, Z. (2021). Integration of biosensor to a window-based control system for user emotion detection to static and dynamic visual contents of webpages. International Journal of Crowd Science. 5(3), 257–270. https://doi.org/10.1108/IJCS-06-2021-0018
   Google Scholar
• Islam, A., Ma, J., Gedeon, T., Hossain, M. Z., & Liu, Y.-H. (2019). Measuring user responses to driving simulators: A galvanic skin response based study [Paper presentation].2019 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), In (p. 33–337). https://doi.org/10.1109/AIVR46125.2019.00015
   Google Scholar
• Islam, R., Ang, S., & Quarles, J. (2021). Cybersense: A closed-loop framework to detect cybersickness severity and adaptively apply reduction techniques [Paper presentation].2021 IEEE Conference on Virtual Reality and 3d User Interfaces Abstracts and Workshops (VRW), In (p. 148–155). https://doi.org/10.1109/VRW52623.2021.00035
   Google Scholar
• Kalatzis, A., Stanley, L., & Prabhu, V. G. (2021). Affective state classification in virtual reality environments using electrocardiogram and respiration signals [Paper presentation].2021 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR). IEEE, In. https://doi.org/10.1109/AIVR52153.2021.00037
   Google Scholar
• Kaluarachchi, T. I., Sapkota, S., Taradel, J., Thevenon, A., Matthies, D. J., & Nanayakkara, S. (2021). Eyeknowyou: A DIY toolkit to support monitoring cognitive load and actual screen time using a head-mounted webcam [Paper presentation]. In Adjunct Publication of the 23rd International Conference on Mobile Human-Computer Interaction,. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3447527.3474850
   Google Scholar
• Katada, S., Okada, S., Hirano, Y., & Komatani, K. (2020). Is she truly enjoying the conversation? analysis of physiological signals toward adaptive dialogue systems [Paper presentation].2020 International Conference on Multimodal Interaction, In (p. 315–323). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3382507.3418844
   Google Scholar
• Katsigiannis, S., Willis, R., & Ramzan, N. (2019). A QoE and simulator sickness evaluation of a smart-exercise-bike virtual reality system via user feedback and physiological signals. IEEE Transactions on Consumer Electronics, 65(1), 119–127. https://doi.org/10.1109/TCE.2018.2879065
   Web of Science ®Google Scholar
• Keighrey, C., Flynn, R., Murray, S., & Murray, N. (2021). A physiology-based QoE comparison of interactive augmented reality, virtual reality and tablet-based applications. IEEE Transactions on Multimedia, 23, 333–341. https://doi.org/10.1109/TMM.2020.2982046
   Web of Science ®Google Scholar
• Kim, H.-G., Lee, G. Y., & Kim, M.-S. (2021). Dual-function integrated emotion-based music classification system using features from physiological signals. IEEE Transactions on Consumer Electronics, 67(4), 341–349. https://doi.org/10.1109/TCE.2021.3120445
   Web of Science ®Google Scholar
• Kitchenham, B. A., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. (Tech. Rep. No. EBSE 2007-001) Keele University and Durham University Joint Report.
   Google Scholar
• Klarkowski, M., Johnson, D., Wyeth, P., Phillips, C., & Smith, S. (2018). sweat the small stuff: The effect of challenge-skill manipulation on electrodermal activity [Paper presentation].2018 Annual Symposium on Computer-Human Interaction in Play, Don’t In (p. 231–242). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3242671.3242714
   Google Scholar
• Korn, O., & Rees, A. (2019). Affective effects of gamification: Using biosignals to measure the effects on working and learning users [Paper presentation].12th ACM International Conference on Pervasive Technologies Related to Assistive Environments, In (p. 1–10). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3316782.3316783
   Google Scholar
• Lee, S., Ryu, H., Park, B., & Yun, M. H. (2020). Using physiological recordings for studying user experience: Case of conversational agent-equipped tv. International Journal of Human-Computer Interaction, 36(9), 815–827. Retrieved from https://doi.org/10.1080/10447318.2019.1693166
   Web of Science ®Google Scholar
• Lee-Cultura, S., Sharma, K., Papavlasopoulou, S., & Giannakos, M. (2020). Motion-based educational games: Using multi-modal data to predict player’s performance. In [Paper presentation].2020 IEEE Conference on Games (Cog), (p. 17–24). https://doi.org/10.1109/CoG47356.2020.9231892
   Google Scholar
• Li, Z., Geng, B., Tao, X., Duan, Y., Gao, D., & Hu, S. (2021). Video quality measurement for buffering time based on eeg frequency feature [Paper presentation].2021 IEEE International Conference on Image Processing (ICIP), In (p. 1424–1428). https://doi.org/10.1109/ICIP42928.2021.9506401
   Google Scholar
• Liapis, A., Katsanos, C., Karousos, N., Sotiropoulos, D., Xenos, M., & Orphanoudakis, T. (2020). Stress heatmaps: A fuzzy-based approach that uses physiological signals. In A. Marcus & E. Rosenzweig (Eds.), Design, user experience, and usability. case studies in public and personal interactive systems (pp. 268–277). Springer International Publishing.
   Google Scholar
• Liapis, A., Katsanos, C., Karousos, N., Xenos, M., & Orphanoudakis, T. (2021). User experience evaluation: A validation study of a tool-based approach for automatic stress detection using physiological signals. Int. J. Hum. Comput. Interact, 37(5), 470–483. https://doi.org/10.1080/10447318.2020.1825205
   Web of Science ®Google Scholar
• Liapis, A., Katsanos, C., & Xenos, M. (2018). Don’t leave me alone: Retrospective think aloud supported by real-time monitoring of participant’s physiology. In M. Kurosu (Ed.), Human-computer interaction. theories, methods, and human issues (pp. 148–158). Springer International Publishing.
   Google Scholar
• Ma, J., Chen, C.-C., & Lin, Y.-C. (2018). Emotional and cognitive assessment of use of functional animation [Paper presentation]. International Conference on Machine Vision and Applications, In (p. 61–65). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3220511.3220516
   Google Scholar
• Magalie, O., Sameer, J., & Philippe, B. (2018). Toward an automatic prediction of the sense of presence in virtual reality environment [Paper presentation].6th International Conference on Human-Agent Interaction, In (p. 161–166). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3284432.3284452
   Google Scholar
• Maier, M., Elsner, D., Marouane, C., Zehnle, M., & Fuchs, C. (2019). DeepFlow: Detecting optimal user experience from physiological data using deep neural networks [Paper presentation]. Twenty-Eighth International Joint Conference on Artificial Intelligence. International Joint Conferences on Artificial Intelligence Organization,. Retrieved from In https://doi.org/10.24963/ijcai.2019/196
   Google Scholar
• Manjunatha, H., Distefano, J. P., Jani, A., Ghassemi, P., Chowdhury, S., Dantu, K., … Esfahani, E. T. (2020). Using physiological measurements to analyze the tactical decisions in human swarm teams [Paper presentation].2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), In (p. 256–261). https://doi.org/10.1109/SMC42975.2020.9282845
   Google Scholar
• Markova, V., Ganchev, T., & Kalinkov, K. (2018). Detection of negative emotions and high-arousal negative-valence states on the move [Paper presentation].2018 Advances in Wireless and Optical Communications (RTUWO), In (p. 61–65). https://doi.org/10.1109/RTUWO.2018.8587888
   Google Scholar
• Martin, N., Mathieu, N., Pallamin, N., Ragot, M., & Diverrez, J.-M. (2020). Virtual reality sickness detection: An approach based on physiological signals and machine learning [Paper presentation].2020 IEEE International Symposium on Mixed and Augmented Reality (Ismar), In (p. 387–399). https://doi.org/10.1109/ISMAR50242.2020.00065
   Google Scholar
• Mavridou, I., Seiss, E., Kostoulas, T., Hamedi, M., Balaguer-Ballester, E., & Nduka, C. (2019). Introducing the EmteqVR interface for affect detection in virtual reality [Paper presentation].2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW)., In IEEE. https://doi.org/10.1109/ACIIW.2019.8925297
   Google Scholar
• McKee, M. G. (2008). Biofeedback: An overview in the context of heart-brain medicine. Cleveland Clinic Journal of Medicine, 75 Suppl 2(Suppl_2), S31–S34. https://doi.org/10.3949/ccjm.75.suppl_2.s31
   PubMedGoogle Scholar
• Mesfin, G., Hussain, N., Covaci, A., & Ghinea, G. (2019). Using eye tracking and heart-rate activity to examine crossmodal correspondences QoE in mulsemedia. ACM Transactions on Multimedia Computing Communications and Applications. 15(2), 1–22. https://doi.org/10.1145/3303080
   Web of Science ®Google Scholar
• Mesfin, G., Hussain, N., Kani-Zabihi, E., Covaci, A., Saleme, E. B., & Ghinea, G. (2020). QoE of cross-modally mapped mulsemedia: An assessment using eye gaze and heart rate. Multimedia Tools and Applications, 79(11-12), 7987–8009. Retrieved from https://doi.org/10.1007/s11042-019-08473-5
   Web of Science ®Google Scholar
• Mesfin, G., Saleme, E. B., Ademoye, O. A., Kani-Zabihi, E., Santos, C. A., & Ghinea, G. (2021). Less is (just as good as) more - an investigation of odor intensity and hedonic valence in mulsemedia qoe using heart rate and eye tracking. IEEE Transactions on Multimedia, 23, 1095–1105. https://doi.org/10.1109/TMM.2020.2992948
   Web of Science ®Google Scholar
• Mijović, P., Milovanović, M., Ković, V., Mijović, B., Gligorijević, I., Minović, M., & Živanović Mačužić, I. (2019). Communicating the user state: Introducing cognition-aware computing in industrial settings. Safety Science, 119, 375–384. Retrieved from https://www.sciencedirect.com/science/article/pii/S092575351732043X https://doi.org/10.1016/j.ssci.2017.12.024
   Web of Science ®Google Scholar
• Min, S., Moon, J-g., Cho, C.-H., & Kim, G. J. (2020). Effects of immersive virtual reality content type to mindfulness and physiological parameters [Paper presentation].26th ACM Symposium on Virtual Reality Software and Technology, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3385956.3418942
   Google Scholar
• Moinnereau, M.-A., Oliveira, A., & Falk, T. H. (2020). Saccadic eye movement classification using exg sensors embedded into a virtual reality headset [Paper presentation].2020 IEEE International Conference on Systems, Man, and Cybernetics (SMC), In (p. 3494–3498). https://doi.org/10.1109/SMC42975.2020.9283019
   Google Scholar
• Moraes, A. N., Flynn, R., Hines, A., & Murray, N. (2020). Evaluating the user in a sound localisation task in a virtual reality application [Paper presentation].2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), In (p. 1–6). https://doi.org/10.1109/QoMEX48832.2020.9123136
   Google Scholar
• Moraes, A. N., Flynn, R., Hines, A., & Murray, N. (2021). The role of physiological responses in a VR-based sound localization task. IEEE Access. 9, 122082–122091. https://doi.org/10.1109/ACCESS.2021.3108446
   Web of Science ®Google Scholar
• Ninaus, M., Tsarava, K., & Moeller, K. (2019). A pilot study on the feasibility of dynamic difficulty adjustment in game-based learning using heart-rate. In A. Liapis, G. N. Yannakakis, M. Gentile, & M. Ninaus (Eds.), Games and learning alliance (pp. 117–128). Springer International Publishing.
   Google Scholar
• Oliveira, T., Noriega, P., Carvalhais, J., Rebelo, F., & Lameira, V. (2020). How deep is a virtual reality experience? virtual environments, emotions and physiological measures. In F. Rebelo & M. M. Soares (Eds.), Advances in ergonomics in design (pp. 462–471). Springer International Publishing.
   Google Scholar
• Pei, W., Guo, X., & Lo, T. (2021). Biofeedback in the dynamic vr environments: A method to evaluate the influence of architectural elements on human spatial perception [Paper presentation].2021 Workshop on Algorithm and Big Data, In (p. 27–33). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3456389.3456400
   Google Scholar
• Peruzzini, M., Grandi, F., Pellicciari, M., & Campanella, C. E. (2018). User experience analysis based on physiological data monitoring and mixed prototyping to support human-centre product design. In Advances in ergonomics in design (pp. 401–412). Springer International Publishing.
   Google Scholar
• Petrescu, L., Petrescu, C., Mitruț, O., Moise, G., Moldoveanu, A., Moldoveanu, F., & Leordeanu, M. (2020). Integrating biosignals measurement in virtual reality environments for anxiety detection. Sensors, 20(24), 7088. Retrieved from https://www.mdpi.com/1424-8220/20/24/7088 https://doi.org/10.3390/s20247088
   PubMed Web of Science ®Google Scholar
• Pinto, J., Fred, A., & da Silva, H. P. (2019). Biosignal-based multimodal emotion recognition in a valence-arousal affective framework applied to immersive video visualization [Paper presentation]. In 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), (p. 3577–3583). https://doi.org/10.1109/EMBC.2019.8857852
   Google Scholar
• Pinto, M., Melo, M., & Bessa, M. (2018). Use of the physiological response to improve the gaming experience [Paper presentation].2018 International Conference on Graphics and Interaction (ICGI), (p. 1, In -7). https://doi.org/10.1109/ITCGI.2018.8602977
   Google Scholar
• Posner, J., Russell, J. A., & Peterson, B. S. (2005). The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and Psychopathology, 17(3), 715–734. Retrieved from https://doi.org/10.1017/s0954579405050340
   PubMed Web of Science ®Google Scholar
• Putze, S., Alexandrovsky, D., Putze, F., Höffner, S., Smeddinck, J. D., & Malaka, R. (2020). Breaking the experience: Effects of questionnaires in vr user studies [Paper presentation].2020 CHI Conference on Human Factors in Computing Systems, In (p. 1–15). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3313831.3376144
   Google Scholar
• Rahman, J. S., Gedeon, T., Caldwell, S., Jones, R., & Jin, Z. (2021). Towards effective music therapy for mental health care using machine learning tools: Human affective reasoning and music genres. Journal of Artificial Intelligence and Soft Computing Research, 11(1), 5–20. Retrieved from https://doi.org/10.2478/jaiscr-2021-0001
   Web of Science ®Google Scholar
• Rahman, J. S., Hossain, M. Z., & Gedeon, T. (2020). Measuring observers’ EDA responses to emotional videos [Paper presentation].31st australian Conference on Human-Computer-Interaction, In (p. 457–461). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3369457.3369516
   Google Scholar
• Riaz, M., Majid, M., & Mir, J. (2021). Emotion recognition using electroencephalography in response to high dynamic range videos [Paper presentation].2021 International Conference on Information Technology (ICIT), In (p. 565–570). https://doi.org/10.1109/ICIT52682.2021.9491662
   Google Scholar
• Roy, Y., Banville, H., Albuquerque, I., Gramfort, A., Falk, T. H., & Faubert, J. (2019). Deep learning-based electroencephalography analysis: A systematic review. Journal of Neural Engineering, 16(5), 051001. https://doi.org/10.1088/1741-2552/ab260c
   PubMed Web of Science ®Google Scholar
• Safikhani, S., Holly, M., Kainz, A., & Pirker, J. (2021). The influence of in-vr questionnaire design on the user experience [Paper presentation].27th ACM Symposium on Virtual Reality Software and Technology, In. New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3489849.3489884
   Google Scholar
• Salgado, D. P., Martins, F. R., Rodrigues, T. B., Keighrey, C., Flynn, R., Naves, E. L. M., & Murray, N. (2018). A QoE assessment method based on EDA, heart rate and EEG of a virtual reality assistive technology system [Paper presentation].9th ACM Multimedia Systems Conference, In (p. 517–520). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3204949.3208118
   Google Scholar
• Sandeep Vara Sankar, D., & Ko, L.-W. (2020). Evaluation of fatigue and attention levels in multi-target scenario using cnn [Paper presentation].2020 International Computer Symposium (ICS), In (p. 247–251). https://doi.org/10.1109/ICS51289.2020.00057
   Google Scholar
• Santamaria-Granados, L., Mendoza-Moreno, J. F., Chantre-Astaiza, A., Munoz-Organero, M., & Ramirez-Gonzalez, G. (2021). Tourist experiences recommender system based on emotion recognition with wearable data. Sensors, 21(23). Retrieved from https://www.mdpi.com/1424-8220/21/23/7854 https://doi.org/10.3390/s21237854
   PubMed Web of Science ®Google Scholar
• Satti, F. A., Hussain, M., Hussain, J., Kim, T.-S., Lee, S., & Chung, T. (2021). User stress modeling through galvanic skin response [Paper presentation].2021 15th International Conference on Ubiquitous Information Management and Communication (IMCOM) (, p. 1, In -6). https://doi.org/10.1109/IMCOM51814.2021.9377380
   Google Scholar
• Schmidt, S., Uhrig, S., & Reuschel, D. (2020). Investigating the relationship of mental immersion and physiological measures during cloud gaming [Paper presentation].2020 Twelfth International Conference on Quality of Multimedia Experience (QoMEX), In (p. 1–6). https://doi.org/10.1109/QoMEX48832.2020.9123133
   Google Scholar
• Silveira, A., Raisamo, R., Spyridonis, F., Covaci, A., Ghinea, G., & Santos, C. A. S. (2023). Guidelines for conducting biofeedback-enhanced qoe studies in mulsemedia-enhanced virtual reality [Paper presentation]. Brazilian Symposium on Multimedia and the Web, In (p. 32–40). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3617023.3617029
   Google Scholar
• Silveira, A. C., & Santos, C. A. S. (2022). Ongoing challenges of evaluating mulsemedia QoE [Paper presentation].Workshop on Multisensory Experiences (SensoryX’22), In 2nd. Porto Alegre, RS, Brasil: SBC. Retrieved from https://sol.sbc.org.br/index.php/sensoryx/article/view/20005 https://doi.org/10.5753/sensoryx.2022.20005
   Google Scholar
• Souza, V. C. d., Nedel, L., Kopper, R., Maciel, A., & Tagliaro, L. (2018). The effects of physiologically-adaptive virtual environment on user’s sense of presence [Paper presentation]. In 2018 20th Symposium on Virtual and Augmented Reality (SVR), (p. 133–142). https://doi.org/10.1109/SVR.2018.00029
   Google Scholar
• Suni-Lopez, F., Condori-Fernandez, N., & Catala, A. (2020). Understanding implicit user feedback from multisensorial and physiological data: A case study [Paper presentation]. IEEE/ACM 42nd International Conference on Software Engineering Workshops, In (p. 563–569). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3387940.3391466
   Google Scholar
• Tateyama, N., Ueda, K., & Nakao, M. (2019). Development of an active sensing system for distress detection using skin conductance response [Paper presentation].2019 8th International Conference on Affective Computing and Intelligent Interaction (ACII)., In IEEE. https://doi.org/10.1109/ACII.2019.8925442
   Google Scholar
• Tremmel, C., Herff, C., Sato, T., Rechowicz, K., Yamani, Y., & Krusienski, D. J. (2019). Estimating cognitive workload in an interactive virtual reality environment using EEG. Frontiers in Human Neuroscience, 13, 401. https://www.frontiersin.org/article/10<?sch-permit JATS-0034-007?>.3389/fnhum.2019.00401
   PubMed Web of Science ®Google Scholar
• Tsai, T.-C., Pan, T.-Y., & Hu, M.-C. (2021). Investigating the affective state of vr hmd user when watching videos displayed in different formats [Paper presentation].2021 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), In (p. 242–246). https://doi.org/10.1109/AIVR52153.2021.00055
   Google Scholar
• Voigt-Antons, J.-N., Spang, R., Kojić, T., Meier, L., Vergari, M., & Möller, S. (2021). worry be happy - using virtual environments to induce emotional states measured by subjective scales and heart rate parameters [Paper presentation].2021 IEEE Virtual Reality and 3d User Interfaces (VR), Don’t In (p. 679–686). https://doi.org/10.1109/VR50410.2021.00094
   Google Scholar
• Wan, X., Zhang, K., Ramkumar, S., Deny, J., Emayavaramban, G., Siva Ramkumar, M., & Hussein, A. F. (2019). A review on electroencephalogram based brain computer interface for elderly disabled. IEEE Access. 7, 36380–36387. https://doi.org/10.1109/ACCESS.2019.2903235
   Web of Science ®Google Scholar
• Wang, X., & Lin, L. (2020). Research on the construction of product material perceptual evaluation model based on EEG physiological cognition. E3S Web Conf, 179, 01016. https://doi.org/10.1051/e3sconf/202017901016
   Google Scholar
• Wang, Y., Fischer, N., & Bry, F. (2019). Pervasive persuasion for stress self-regulation [Paper presentation].2019 IEEE International Conference on Pervasive Computing and Communications Workshops (Percom Workshops), In (p. 724–730). https://doi.org/10.1109/PERCOMW.2019.8730850
   Google Scholar
• Wechsung, I., & De Moor, K. (2014). Quality of experience versus user experience. In S. Möller & A. Raake (Eds.), Quality of experience: Advanced concepts, applications and methods (pp. 35–54). Springer International Publishing.
   Google Scholar
• Wulvik, A. S., Dybvik, H., & Steinert, M. (2020). Investigating the relationship between mental state (workload and affect) and physiology in a control room setting (ship bridge simulator). Cognition, Technology & Work, 22(1), 95–108. https://doi.org/10.1007/s10111-019-00553-8
   Web of Science ®Google Scholar
• Yang, W., Rifqi, M., Marsala, C., & Pinna, A. (2018). Towards better understanding of player’s game experience [Paper presentation].2018 ACM International Conference on Multimedia Retrieval, In (p. 442–449). New York, NY, USA: ACM. Retrieved from https://doi.org/10.1145/3206025.3206072
   Google Scholar
• Ye, X., Ning, H., Backlund, P., & Ding, J. (2021). Flow experience detection and analysis for game users by wearable-devices-based physiological responses capture. IEEE Internet of Things Journal, 8(3), 1373–1387. https://doi.org/10.1109/JIOT.2020.3010853
   Web of Science ®Google Scholar
• Zou, Z., & Ergan, S. (2021). Evaluating the effectiveness of biometric sensors and their signal features for classifying human experience in virtual environments. Advanced Engineering Informatics, 49, 101358. Retrieved from https://www.sciencedirect.com/science/article/pii/S1474034621001117 https://doi.org/10.1016/j.aei.2021.101358
   Web of Science ®Google Scholar