Gamified Mobile Sensing Storytelling Application for Enhancing Remote Cultural Experience and Engagement

References

• Almeida, A., & Alves, A. (2017). Activity recognition for movement-based interaction in mobile games. Proceedings of the International Conference on Human-Computer Interaction with Mobile Devices and Services, 55, 1–8. https://doi.org/10.1145/3098279.3125443
   Google Scholar
• Bangsø, O., Jensen, O. G., Jensen, F. V., Andersen, P. B., & Kocka, T. (2004). Non-linear interactive storytelling. Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education, Reading, United Kingdom.
   Google Scholar
• Barghi, R., Zakaria, Z., Hamzah, A., & Hashim, N. (2017). Heritage education in the Primary School Standard Curriculum of Malaysia. Teaching and Teacher Education, 61, 124–131. https://doi.org/10.1016/j.tate.2016.10.012
   Web of Science ®Google Scholar
• Bekele, M. K., Pierdicca, R., Frontoni, E., Malinverni, E., & Gain, J. (2018). A survey of augmented, virtual, and mixed reality for cultural heritage. Journal on Computing and Cultural Heritage, 11(2), 1–36. https://doi.org/10.1145/3145534
   Google Scholar
• Bousbahi, F., & Boreggah, B. (2018). Mobile augmented reality adaptation through smartphone device based hybrid tracking to support cultural heritage experience. Proceedings of the 2nd International Conferenceon Smart Digital Environment, 48–55. https://doi.org/10.1145/3289100.3289109
   Google Scholar
• Carvalho, L., & Sofia, R. (2020). A review on scaling mobile sensing platforms for human activity recognition: Challenges and recommendations for future research. IoT, 1(2), 451–473. https://doi.org/10.3390/iot1020025
   Google Scholar
• Chai, J. X., & Fan, K. K. (2016). Mobile inverted constructivism: Education of interaction technology in social media. Eurasia Journal of Mathematics, Science & Technology Education, 12(5), 1425–1442. https://doi.org/10/12973/eurasia.2016.1522a
   Web of Science ®Google Scholar
• Colley, A., Thebault-Spieker, J., Lin, A., Degraen, D., Fischman, B., Häkkilä, J., Kuehl, K., Nisi, V., Nunes, N. J., Wenig, N., Hecht, B., & Schöning, J. (2017). The geography of Pokémon GO: Beneficial and problematic effects on places and movement. Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, 1179–1192. https://doi.org/10.1145/3025453.3025495
   Google Scholar
• Criollo-C, S., Guerrero-Arias, A., Jaramillo-Alcázar, Á., & Luján-Mora, S. (2021). Mobile learning technologies for education: Benefits and pending issues. Applied Sciences, 11(9), 4111. https://doi.org/10.3390/app11094111
   Google Scholar
• Deterding, S., Dixon, D., Khaled, R., Nacke, L., Sicart, M., & O’Hara, K. (2011). Gamification: Using game design elements in non-game contexts. Proceedings of the 2011 Annual Conference Extended Abstracts on Human Factors in Computing Systems (CHI 2011), 2425–2428. https://doi.org/10.1145/1979742.1979575
   Google Scholar
• Dichev, C., & Dicheva, D. (2017). Gamifying education: What is known, what is believed and what remains uncertain: A critical Dragan, E. (2020). Interactive Educational Game Using Machine Learning. International Journal of Educational Technology in Higher Education, 14(1), 9. https://doi.org/10.1186/s41239-017-0042-5
   Web of Science ®Google Scholar
• Dragan, E. (2020). Interactive educational game using machine learning. Proceedings of the 2020 ACM Interaction Design and Children Conference: Extended Abstracts, 272–275. https://doi.org/10.1145/3397617.3402035
   Google Scholar
• Ekonomou, T., & Vosinakis, S. (2018). Mobile augmented reality games as an engaging tool for cultural heritage dissemination: A case study. Scientific Culture, 4(2), 97–107. https://doi.org/10.5281/zenodo.1214569
   Google Scholar
• Fontanella, F., Molinara, M., Gallozzi, A., Cigola, M., Senatore, L. J., Florio, R., Clini, P., & Celis D’Amico, F. (2021). HeGO, a social game as a tool for cultural heritage valorization: The case study of the Atina historical centre. Journal on Computing and Cultural Heritage, 14(2), 1–16. https://doi.org/10/1145/3431926
   Google Scholar
• Fosnot, C. T., & Perry, R. S. (1996). Constructivism: A psychological theory of learning. Constructivism, 2, 8–33.
   Google Scholar
• Ghasemi, Y., Jeong, H., Choi, S. H., Park, K., & Lee, J. (2022). Deep learning-based object detection in augmented reality: A systematic review. Computers in Industry, 139(12), 103661. https://doi.org/10/1016/j.compind.2022.103661
   Web of Science ®Google Scholar
• Giariskanis, F., Kritikos, Y., Protopapadaki, E., Papanastasiou, A., Papadopoulou, E., Mania, K. (2022). The augmented Museum: A multimodal, game-based, augmented reality narrative for cultural heriage. Proceedings of the ACM International Conference on Interactive Media Experiences (IMX’22), 281–286.
   Google Scholar
• Hakulinen, L., Auvinen, T., & Korhonen, A. (2015). The effect of achievement badges on students’ behavior: An empirical study in a university-level computer science course. International Journal of Emerging Technologies in Learning, 10(1), 18–29. https://doi.org/10.3991/ijet.v10i1.4221
   Web of Science ®Google Scholar
• Howard, A., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M. & Adam, H. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. https://arxiv.org/pdf/1704.04861.pdf.
   Google Scholar
• Huang, H., & Ng, K. (2021). Designing for cultural learning and reflection using IoT serious game approach. Personal and Ubiquitous Computing, 25(3), 509–524. https://doi.org/10.1007/s00779-020-01482-4
   Web of Science ®Google Scholar
• Huang, H., Lo, W., Ng, K., Brailsford, T., O’Malley, C. (2018). Enhancing reflective learning experiences in museums through interactive installations. Proceedings of the 13th International Conference of the Learning Sciences (ICLS) 2018, 776–783.
   Google Scholar
• Huynh, S., Kim, S., Ko, S., Balan, R., Lee, Y. (2018). EngageMon: Multimodal engagement sensing for mobile games. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2(1), 1–27. https://doi.org/10.1145/3191745
   Google Scholar
• Indans, R., Hauthal, E., & Burghardt, D. (2019). Towards an audio-locative mobile application for immersive storytelling. KN - Journal of Cartography and Geographic Information, 69(1), 41–50. https://doi.org/10.1007/s42489-019-00007-1
   Google Scholar
• Iqbal, M., & Campbell, A. (2021). Touchless hand interaction and machine learning agents to support Kinesthetic learning in augmented reality. Proceedings of the 52nd ACM Technical Symposium on Computer Science Education. https://doi.org/10.1145/3408877.3439627
   Google Scholar
• ISO/IEC 9126. (2001). Quality characteristics and guidelines for the user. International Organization for Standardization.
   Google Scholar
• Jaafar, M., Noor, S. M., & Rasoolimanesh, S. M. (2014). Awareness and willingness for engagement of youth on World Heritage Site: A study on Lenggong Archaeological Site. Asian Social Science, 10(22), 29. https://doi.org/10.5539/ass.v10n22p29
   Google Scholar
• Jablonsky, N., McKenzie, S., Bangay, S., Wilkin, T. (2017). Evaluating sensor placement and modality for activity recognition in active games. Proceedings of the Australasian Computer Science Week Multiconference (ACSW’17), ACM, 61, 1–8.
   Google Scholar
• Kalmpourtzis, G. (2018). In: Peters AK, editor. Educational game design fundamentals: A journey to creating intrinsically motivating learning experiences. AK Peters/CRC Press.
   Google Scholar
• Katifori, A., Perry, S., Vayanou, M., Antoniou, A., Ioannidis, I., McKinney, S., Chrysanthi, A., & Ioannidis, Y. (2020). “Let’s Them Talk!”: Exploring guided group interaction in digital storytelling experiences. Journal on Computing and Cultural Heritage, 13(3), 1–30. https://doi.org/10.1145/3382773
   Google Scholar
• Ketchell, S., Chinthammit, W., & Engelke, U. (2019). Situated storytelling with SLAM enabled augmented reality. Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry. https://doi.org/10.1145/3359997.3365681
   Google Scholar
• Khan, W. Z., Xiang, Y., Aalsalem, M. Y., & Arshad, Q. (2013). Mobile phone sensing systems: A survey. IEEE Communications Surveys & Tutorials, 15(1), 402–427. https://doi.org/10.1109/SURV.2012.031412.00077
   Web of Science ®Google Scholar
• Laine, T., & Lindberg, R. (2020). Designing engaging games for education: A systematic literature review on game motivators and design principles. IEEE Transactions on Learning Technologies, 13(4), 804–821. https://doi.org/10.1109/TLT.2020.3018503
   Web of Science ®Google Scholar
• Landers, R. N., & Landers, A. K. (2015). An empirical test of the theory of gamified learning: The effect of leaderboards on time-on-task and academic performance. Simulation & Gaming, 45(6), 769–785. https://doi.org/10.1177/1046878114563662
   Google Scholar
• Lee, W., & Lee, D. (2019). Cultural Heritage and the intelligent internet of things. Journal on Computing and Cultural Heritage, 12(3), 1–14. https://doi.org/10.1145/3316414
   Google Scholar
• Lentonsaari, M., Selin, J. (2019). Nonlinear storytelling method for interdisciplinary and cross expertise-level communication of knowledge. Proceedings of the International Conference on Interdisciplinarity of Knowledge, Education and Research (IKER 2019).
   Google Scholar
• Letonsaari, M. (2019). Nonlinear storytelling method and tools for low-Threshold game development. Seminar.net, 15(1), 1–17. https://doi.org/10.7577/seminar.3074
   Google Scholar
• Letonsaari, M., & Selin, J. (2017). Modeling computational algorithms using nonlinear storytelling methods of computer game design. Procedia Computer Science, 119, 131–138. https://doi.org/10.1016/j.procs.2017.11.169
   Google Scholar
• Liestoel, G. (2019). Augmented reality storytelling – Narrative design and reconstruction of a historical event in situ. International Journal of Interactive Mobile Technologies, 13(12), 196–209. https://doi.org/10.3991/ijim.v13i12.11560
   Google Scholar
• Luiro, E., Hannula, P., Launne, E., Mustonen, S., Westerlund, T., & Häkkilä, J. (2019). Exploring local history and cultural heritage through a mobile game. Proceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia (Abstract). https://doi.org/10.1145/3365610.3368411
   Google Scholar
• Mack, N., Cummings, R., Rembert, D., & Gilbert, J. (2019). Co-designing an intelligent conversational history tutor with children. Proceedings of the Interaction Design and Children on ZZZ – IDC’19. https://doi.org/10.1145/3311927.3325336
   Google Scholar
• Malegiannaki, I., Daradoumis, T., & Retalis, S. (2021). Using a story-driven board game to engage students and adults with cultural heritage. International Journal of Game-Based Learning, 11(2), 1–19. https://doi.org/10.4018/IJGBL.2021040101
   Web of Science ®Google Scholar
• Mezirow, J. (1994). Understanding transformation theory. Adult Education Quarterly, 44(4), 222–232. https://doi.org/10.1177/074171369404400403
   Web of Science ®Google Scholar
• Ng, K., Huang, H., & O’Malley, C. (2018). Treasure codes: Augmenting learning from physical museum exhibits through treasure hunting. Personal and Ubiquitous Computing, 22(4), 739–750. https://doi.org/10.1007/s00779-018-1126-5
   Web of Science ®Google Scholar
• Nicholson, S. (2015). A RECIPE for meaningful gamification. In L. Wood & T. Reiners (Eds.), Gamification in education and business (pp. 1–20). Springer.
   Google Scholar
• O’Brien, H., Cairns, P., & Hall, M. (2018). A practical approach to measuring user engagement with the refined user engagement scale (UES) and new UES short form. International Journal of Human-Computer Studies, 112, 28–39. https://doi.org/10.1016/j.ijhcs.2018.01.004
   Web of Science ®Google Scholar
• O’Keefe, B., Benyon, D., Chandwani, C., Menon, M., Duke, R. (2014). A blended space for heritage storytelling. Proceedings of the 28th International BCS Human Computer Interaction Conference on HCI 2014, 90–99. https://doi.org/10.14236/ewic/hci2014.10
   Google Scholar
• Othman, M. K., Aman, S., Anuar, N., & Ahmad, I. (2021). Improving children’s cultural heritage experience using game-based learning at a living Museum. Journal on Computing and Cultural Heritage, 14(3), 1–24. https://doi.org/10.1145/3453073
   Google Scholar
• Palmárová, V., & Lovászová, G. (2012). Mobile technology used in an adventurous outdoor learning activity: A case study. Problems of Education in the 21st Century, 44(1), 64–71. https://doi.org/10.33225/pec/12.44.64
   Google Scholar
• Pan, J., Qian, X., & Zhang, B. (2017). Design and implementation of applications based on smartphone sensors. Proceedings of the 2017 International Conference on Telecommunications and Communication Engineering (ICTCE’17). https://doi.org/10.1145/3145777.3145797
   Google Scholar
• Quah, C., & Ng, K. (2021). A systematic literature review on digital storytelling authoring tool in education: January 2010 to January 2020. International Journal of Human-Computer Interaction, 38(9), 851–867. https://doi.org/10.1080/10447318.2021.1972608
   Web of Science ®Google Scholar
• Reeves, S., Benford, S., O’Malley, C., & Fraser, M. (2005). Designing the spectator experience. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI’05). https://doi.org/10.1145/1054972.1055074
   Google Scholar
• Richter, G., Raban, D., & Rafaeli, S. (2014). Studying gamification: The effect of rewards and incentives on motivation. Gamification in Education and Business, 2014, 21–46. https://doi.org/10.1007/978-3-319-10208-5_2
   Google Scholar
• Rubino, I., Barberis, C., Xhembulla, J., & Malnati, G. (2015). Integrating a location-based mobile game in the Museum Visit: Evaluating visitors’ behaviour and learning. Journal on Computing and Cultural Heritage, 8(3), 1–18. https://doi.org/10.1145/2724723
   Google Scholar
• Schrepp, M. (2019). User experience questionnaire handbook (8th ed.). https://www.ueq-online.org/Material/Handbook.pdf
   Google Scholar
• Sperlí, G. (2020). A deep learning based Chatbot for Cultural Heritage. Proceedings of the 35th Annual ACM Symposium on Applied Computing, 935–937. https://doi.org/10.1145/3341105.3374129
   Google Scholar
• Stone, G., Duerden, M., Duffy, L., Hill, B., & Witesman, E. (2017). Measurement of transformative learning in study abroad: An application of the learning activities survey. Journal of Hospitality, Leisure, Sport & Tourism Education, 21, 23–32. https://doi.org/10.1016/j.jhlste.2017.05.003
   Web of Science ®Google Scholar
• Suárez, A., Specht, M., Prinsen, F., Kalz, M., & Ternier, S. (2018). A review of the types of mobile activities in mobile inquiry-based learning. Computers & Education, 118, 38–55. https://doi.org/10.1016/j.compedu.2017.11.004
   Web of Science ®Google Scholar
• TensorFlow. (2021). Object detection. https://www.tensorflow.org/lite/examples/object_detection/overview.
   Google Scholar
• Torsi, S., Ardito, C., & Rebek, C. (2020). An interactive narrative to improve cultural heritage experience in elementary school children. Journal on Computing and Cultural Heritage, 13(3), 1–14. https://doi.org/10.1145/3382771
   Google Scholar
• Valtolina, S. (2016). A storytelling-driven framework for cultural heritage dissemination. Data Science and Engineering, 1(2), 114–123. https://doi.org/10.1007/s41019-016-0007-z
   Google Scholar
• Vanoverschelde, F. (2019). No story without a Backstory: The role and importance of the backstory in an augmented reality application for cultural heritage. Proceedings of the 8th International Workshop on Narrative and Hypertext (NHT’19). https://doi.org/10.1145/3345511.3349282
   Google Scholar
• Vlahakis, V., Karigiannis, J., Tsotros, M., Gounaris, M., Almeida, L., Stricker, D., Gleue, T., Christou, I., Carlucci, R., & Ioannidis, N. (2001). Archeoguide: First results of an augmented reality, mobile computing system in cultural heritage sites. Virtual Reality, Archeology, and Cultural Heritage, 131–140. https://doi.org/10.1145/584993.585015
   Google Scholar
• Wetherell, J. (2011). Android-heart-rate-monitor. Google Code Archive. Retrieved 9 April 2021, from https://code.google.com/archive/p/android-heart-rate-monitor/.
   Google Scholar
• Yakar, Ü., Sülü, A., Porgalı, M., & Çalış, N. (2020). From constructivist educational technology to mobile constructivism: How mobile learning serves constructivism? International Journal of Academic Research in Education, 6(1), 56–75. https://doi.org/10.17985/ijare.818487
   Google Scholar