Gamified Mobile Sensing Storytelling Application for Enhancing Remote Cultural Experience and Engagement

Abstract

Previous studies have highlighted a lack of practical strategies in mobile learning that effectively enhance learners’ agency with mobile technology. The paper aims to engage and interest learners in cultural issues by exploring the capacity of mobile technology. In this paper, we report the design and development of a prototype story game app, The Story of Praya Lane that combines use of mobile sensing, machine learning and augmented reality (AR) to engage users in physical mobile activities as part of a gamified, non-linear storytelling application. We took a multidisciplinary approach to involve cultural heritage stakeholders to preserve and share the cultural stories of the Kristang community in Praya Lane, Malacca, a UNESCO World Heritage Site. The results of user study show promise in promoting interest and engagement in cultural learning and reflection. From our findings, we recommend design guidelines for future interactive story games to support cultural learning and engagement.

Acknowledgements

We would like to thank Miss Melissa Chan for her collaboration in this research project. In addition, we thank Ashley Song and Chia Yi Quah for their help and support.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Notes on contributors

Song Ning Tan

Song Ning Tan is an undergraduate research assistant at the University of Nottingham Malaysia. She holds a BSc (Hons) degree in Computer Science from the University of Nottingham. Her research interests include digital storytelling and AI.

Kher Hui Ng

Kher Hui Ng is an Associate Professor at the University of Nottingham Malaysia. She holds a PhD from the University of Nottingham. Her research interests include mobile and mixed reality technologies, and IoT.