Characterizing UX Assessment in the Context of Immersive Experiences: A Systematic Mapping Study

References

• Alves, F., Aguiar, B., Monteiro, V., Almeida, E., Marques, L., Gadelha, B., & Conte, T. (2021). Immersive UX: A UX evaluation framework for digital immersive experiences in the context of entertainment. In Proceedings of the 23nd International Conference on Enterprise Information Systems, Vol. 17.
   Google Scholar
• Balijepally, V., Mangalaraj, G., & Iyengar, K. (2011). Are we wielding this hammer correctly? A reflective review of the application of cluster analysis in information systems research. Journal of the Association for Information Systems, 12(5), 375–413. https://doi.org/10.17705/1jais.00266
   Web of Science ®Google Scholar
• Brennand, C. V., Brennand, C. A., Duarte, E. F., Cecília, M., & Baranauskas, C. (2019). Evaluating the user experience in interactive installations: A case study. In Proceedings of the 18th Brazilian Symposium on Human Factors in Computing Systems (pp. 1–10).
   Google Scholar
• Brown, E., & Cairns, P. (2004). A grounded investigation of game immersion [Paper presentation]. CHI’04 Extended Abstracts on Human Factors in Computing Systems (pp. 1297–1300). https://doi.org/10.1145/985921.986048
   Google Scholar
• Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. https://doi.org/10.1177/001316446002000104
   Web of Science ®Google Scholar
• Costley, K. C. (2014). The positive effects of technology on teaching and student learning. Online submission (2014).
   Google Scholar
• Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience.
   Google Scholar
• Dirin, A., & Laine, T. H. (2018). User experience in mobile augmented reality: Emotions, challenges, opportunities and best practices. Computers, 7(2), 33. 2018https://doi.org/10.3390/computers7020033
   Google Scholar
• Dyba, T., Dingsoyr, T., & Hanssen, G. K. (2007). Applying systematic reviews to diverse study types: An experience report [Paper presentation]. First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007) (pp. 225–234). IEEE.
   Google Scholar
• Gonçalves, G., Coelho, H., Monteiro, P., Melo, M., & Bessa, M. (2022). Systematic review of comparative studies of the impact of realism in immersive virtual experiences. ACM Computing Surveys, 55(6), 1–36. https://doi.org/10.1145/3533377
   Web of Science ®Google Scholar
• Gonçalves, G., Melo, M., Vasconcelos-Raposo, J., & Bessa, M. (2020). A novel method to enhance the touristic 360 promotional video experience. Multimedia Tools and Applications, 79(31-32), 22905–22927. https://doi.org/10.1007/s11042-020-09026-x
   Web of Science ®Google Scholar
• Hassenzahl, M. (2018). The thing and I (summer of’17 remix). In Funology 2 (pp. 17–31). Springer.
   Google Scholar
• Huang, T.-L., & Liao, S. (2015). A model of acceptance of augmented-reality interactive technology: The moderating role of cognitive innovativeness. Electronic Commerce Research, 15(2), 269–295. https://doi.org/10.1007/s10660-014-9163-2
   Web of Science ®Google Scholar
• International Organization for Standardization. (2018). ISO 9241-11: 2018—Ergonomics of human-system interaction—Part 11: Usability: Definitions and concepts.
   Google Scholar
• Jokinen, J. P. P. (2015). Emotional user experience: Traits, events, and states. International Journal of Human-Computer Studies, 76, 67–77. https://doi.org/10.1016/j.ijhcs.2014.12.006
   Web of Science ®Google Scholar
• Jokinen, J. P. P. (2015). User psychology of emotional user experience [PhD dissertation]. University of Jyväskylä.
   Google Scholar
• Kitchenham, B. A., Budgen, D., & Brereton, P. (2015). Evidence-based software engineering and systematic reviews (Vol. 4). CRC press.
   Google Scholar
• Kitchenham, B., Madeyski, L., & Budgen, D. (2022). SEGRESS: Software engineering guidelines for reporting secondary studies. IEEE Transactions on Software Engineering, 49(3), 1273–1298. https://doi.org/10.1109/TSE.2022.3174092
   Web of Science ®Google Scholar
• Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
   PubMed Web of Science ®Google Scholar
• Lee, H., Jung, T. H., Dieck, M. C. t., & Chung, N. (2020). Experiencing immersive virtual reality in museums. Information & Management, 57(5), 103229. https://doi.org/10.1016/j.im.2019.103229
   Web of Science ®Google Scholar
• Lee, H.-G., Chung, S., & Lee, W.-H. (2013). Presence in virtual golf simulators: The effects of presence on perceived enjoyment, perceived value, and behavioral intention. New Media & Society, 15(6), 930–946. https://doi.org/10.1177/1461444812464033
   Web of Science ®Google Scholar
• Marques, L., Amazonas, M., Castro, T., Assuncao, W., Zaina, L., Gadelha, B., & Conte, T. (2020). UX trek: A post-interaction journey from immersive experience logs. In Proceedings of the 19th Brazilian Symposium on Human Factors in Computing Systems (pp. 1–6).
   Google Scholar
• Marques, L., Matsubara, P. G., Nakamura, W. T., Ferreira, B. M., Wiese, I. S., Gadelha, B. F., Zaina, L. M., Redmiles, D., & Conte, T. U. (2021). Understanding UX better: A new technique to go beyond emotion assessment. Sensors, 21(21), 7183. 2021https://doi.org/10.3390/s21217183
   PubMed Web of Science ®Google Scholar
• Marques, L., Nakamura, W., Valentim, N., Rivero, L., & Conte, T. (2018). Do scale type techniques identify problems that affect user experience?. In Proceedings of the the 30th International Conference on Software Engineering and Knowledge Engineering (pp. 451–501). https://doi.org/10.18293/SEKE2018-161
   Google Scholar
• McCarthy, J., & Wright, P. (2004). Technology as experience. Interactions, 11(5), 42–43. https://doi.org/10.1145/1015530.1015549
   Google Scholar
• Mendes, E., Wohlin, C., Felizardo, K., & Kalinowski, M. (2020). When to update systematic literature reviews in software engineering. Journal of Systems and Software, 167, 110607. https://doi.org/10.1016/j.jss.2020.110607
   Web of Science ®Google Scholar
• Minge, M., & Thüring, M. (2018). Hedonic and pragmatic halo effects at early stages of user experience. International Journal of Human-Computer Studies, 109(2018), 13–25. https://doi.org/10.1016/j.ijhcs.2017.07.007
   Web of Science ®Google Scholar
• Nicovich, S. G., Boller, G. W., & Cornwell, T. B. (2005). Experienced presence within computer-mediated communications: Initial explorations on the effects of gender with respect to empathy and immersion. Journal of Computer-Mediated Communication, 10(2), JCMC1023. https://doi.org/10.1111/j.1083-6101.2005.tb00243.x
   Web of Science ®Google Scholar
• Nur, A. I., Santoso, H. B., & Hadi Putra, P. O. (2021). The method and metric of user experience evaluation: A systematic literature review [Paper presentation]. 2021 10th International Conference on Software and Computer Applications (pp. 307–317). https://doi.org/10.1145/3457784.3457832
   Google Scholar
• O’Brien, H. L., Cairns, P., & Hall, M. (2018). A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human-Computer Studies, 112(2018), 28–39. https://doi.org/10.1016/j.ijhcs.2018.01.004
   Google Scholar
• Oyedele, Y., Greunen, D., & Veldsman, A. (2018). UX Engagement and Interaction. In 2018 7th International Conference on Reliability, Infocom Technologies and Optimization (Trends and Future Directions) (ICRITO) (pp. 792–798). IEEE.
   Google Scholar
• Petersen, K., Vakkalanka, S., & Kuzniarz, L. (2015). Guidelines for conducting systematic mapping studies in software engineering: An update. Information and Software Technology, 64(2015), 1–18. https://doi.org/10.1016/j.infsof.2015.03.007
   Web of Science ®Google Scholar
• Pettersson, I., Lachner, F., Frison, A.-K., Riener, A., & Butz, A. (2018). A Bermuda triangle? A review of method application and triangulation in user experience evaluation. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–16).
   Google Scholar
• Pyae, A., & Joelsson, T. N. (2018). Investigating the usability and user experiences of voice user interface: A case of Google home smart speaker. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (pp. 127–131).
   Google Scholar
• Rebelo, F., Noriega, P., Duarte, E., & Soares, M. (2012). Using virtual reality to assess user experience. Human Factors, 54(6)2012), 964–982. https://doi.org/10.1177/0018720812465006
   PubMed Web of Science ®Google Scholar
• Rivero, L., & Conte, T. (2017). A systematic mapping study on research contributions on UX evaluation technologies. In Proceedings of the XVI Brazilian Symposium on Human Factors in Computing Systems (pp. 1–10). https://doi.org/10.1145/3160504.3160512
   Google Scholar
• Rogers, Y. (2009). The changing face of human-computer interaction in the age of ubiquitous computing. In Symposium of the Austrian HCI and Usability Engineering Group (pp. 1–19). Springer.
   Google Scholar
• Santos, R. M., de Oliveira, K. M., Andrade, R., Santos, I. S., & Lima, E. R. (2013). A quality model for human-computer interaction evaluation in ubiquitous systems. In Latin American conference on human computer interaction (pp. 63–70). Springer.
   Google Scholar
• Shin, D. (2019). How do users experience the interaction with an immersive screen? Computers in Human Behavior, 98(2019), 302–310. https://doi.org/10.1016/j.chb.2018.11.010
   Web of Science ®Google Scholar
• Shin, D.-H. (2011). Understanding e-book users: Uses and gratification expectancy model. New Media & Society, 13(2), 260–278. https://doi.org/10.1177/1461444810372163
   Web of Science ®Google Scholar
• Shin, D.-H., Biocca, F., & Choo, H. (2013). Exploring the user experience of three-dimensional virtual learning environments. Behaviour & Information Technology, 32(2), 203–214. https://doi.org/10.1080/0144929X.2011.606334
   Web of Science ®Google Scholar
• Slater, M. (2003). A note on presence terminology. Presence Connect, 3(3), 1–5.
   Google Scholar
• Suh, A., & Prophet, J. (2018). The state of immersive technology research: A literature analysis. Computers in Human Behavior, 86(2018), 77–90. https://doi.org/10.1016/j.chb.2018.04.019
   Google Scholar
• Tcha-Tokey, K., Christmann, O., Loup-Escande, E., Loup, G., & Richir, S. (2018). Towards a model of user experience in immersive virtual environments. Advances in Human-Computer Interaction, 2018, 1–10. https://doi.org/10.1155/2018/7827286
   Web of Science ®Google Scholar
• Teng, C.-I. (2010). Customization, immersion satisfaction, and online gamer loyalty. Computers in Human Behavior, 26(6), 1547–1554. https://doi.org/10.1016/j.chb.2010.05.029
   Web of Science ®Google Scholar
• Torres, A., Carmichael, C., Wang, W., Paraskevakos, M., Uribe-Quevedo, A., Giles, P., & Yawney, J. L. (2020). A 360 video editor framework for interactive training. In 2020 IEEE 8th International Conference on Serious Games and Applications for Health (SeGAH) (pp. 1–7). IEEE.
   Google Scholar
• Väänänen-Vainio-Mattila, K., Olsson, T., & Häkkilä, J. (2015). Towards deeper understanding of user experience with ubiquitous computing systems: Systematic literature review and design framework. In IFIP conference on human-computer interaction (pp. 384–401). Springer.
   Google Scholar
• Vermeeren, A. P., Law, E. L.-C., Roto, V., Obrist, M., Hoonhout, J., & Väänänen-Vainio-Mattila, K. (2010). User experience evaluation methods: Current state and development needs. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (pp. 521–530).
   Google Scholar
• Wiemeyer, J., Nacke, L., Moser, C., & Mueller, F. (2016). Player experience (1st ed., pp. 243–271). Springer. https://doi.org/10.1007/978-3-319-40612-1_9
   Google Scholar
• Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering [Paper presentation]. Proceedings of the 18th International Conference on Evaluation and Assessment in Software Engineering, Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/2601248.2601268
   Google Scholar
• Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2012). Experimentation in software engineering.
   Google Scholar
• Zarour, M., & Alharbi, M. (2017). User experience framework that combines aspects, dimensions, and measurement methods. Cogent Engineering, 4(1), 1421006. https://doi.org/10.1080/23311916.2017.1421006
   Web of Science ®Google Scholar
• Zhang, C. (2020). The why, what, and how of immersive experience. IEEE Access, 8, 90878–90888. https://doi.org/10.1109/ACCESS.2020.2993646
   Web of Science ®Google Scholar
• Zhang, H., Babar, M. A., & Tell, P. (2011). Identifying relevant studies in software engineering. Information and Software Technology, 53(6), 625–637. https://doi.org/10.1016/j.infsof.2010.12.010
   Web of Science ®Google Scholar