1,938
Views
4
CrossRef citations to date
0
Altmetric
Research Articles

How to Design Audio-Gamification for Language Learning with Amazon Alexa?—A Long-Term Field Experiment

ORCID Icon & ORCID Icon
Pages 2343-2360 | Received 18 Aug 2022, Accepted 12 Dec 2022, Published online: 29 Dec 2022

References

  • Adams, S. (2019, August 31). Game of tongues: How duolingo built a $700 million business with its addictive language-learning app. Forbes. https://www.forbes.com/sites/susanadams/2019/07/16/game-of-tongues-how-duolingo-built-a-700-million-business-with-its-addictive-language-learning-app/
  • Antin, J., & Churchill, E. F. (2011). Badges in social media: A social psychological perspective. In CHI 2011 Gamification Workshop Proceedings (pp. 1–4).
  • Babic, S., Orehovacki, T., & Etinger, D. (2018). Perceived user experience and performance of intelligent personal assistants employed in higher education settings. In 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (pp. 830–834). https://doi.org/10.23919/MIPRO.2018.8400153
  • Bai, S., Hew, K. F., & Huang, B. (2020). Does gamification improve student learning outcome? Evidence from a meta-analysis and synthesis of qualitative data in educational contexts. Educational Research Review, 30, 100322. https://doi.org/10.1016/j.edurev.2020.100322
  • Benner, D., Schöbel, S., Süess, C., Baechle, V., Janson, A. (2022). Level-up your learning – Introducing a framework for gamified educational conversational agents. In Wirtschaftsinformatik 2022 Proceedings. https://aisel.aisnet.org/wi2022/hci/hci/5
  • Bouchrika, I., Harrati, N., Wanick, V., & Wills, G. (2021). Exploring the impact of gamification on student engagement and involvement with E-learning systems. Interactive Learning Environments, 29(8), 1244–1257. https://doi.org/10.1080/10494820.2019.1623267
  • Bräuer, P., & Mazarakis, A. (2019). Badges or a leaderboard? How to gamify an augmented reality warehouse setting. In J. Koivisto & Hamari (Eds.), Proceedings of the 3rd International GamiFIN Conference—GamiFIN 2019 (Vol. 2359, pp. 229–240). CEUR-WS.org.
  • Bräuer, P., & Mazarakis, A. (2022). “Alexa, can we design gamification without a screen?”—Implementing cooperative and competitive audio-gamification for intelligent virtual assistants. Computers in Human Behavior, 135, 107362. https://doi.org/10.1016/j.chb.2022.107362
  • Cermak-Sassenrath, D. (2019). Current challenges in gamification identified in empirical studies. In R. Ørngreen, M. Buhl, & B. Meyer (Eds.), Proceedings of the 18th European Conference on e-Learning (ECEL) (pp. 119–127). Academic Conferences and Publishing International Limited.
  • Change the language of Google Assistant—Android—Google Nest Help (2021). https://support.google.com/googlenest/answer/7550584?hl=en&co=GENIE.Platform%3DAndroid#zippy=%2Cgoogle-nest-mini-nd-gen
  • Chen, H. H.-J., Yang, C. T.-Y., & Lai, K. K.-W. (2020). Investigating college EFL learners’ perceptions toward the use of Google Assistant for foreign language learning. Interactive Learning Environments, 1–16. https://doi.org/10.1080/10494820.2020.1833043
  • Christy, K. R., & Fox, J. (2014). Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women’s math performance. Computers & Education, 78, 66–77. https://doi.org/10.1016/j.compedu.2014.05.005
  • Cicció, J. A., & Quesada, L. (2018). Framework for creating audio games for intelligent personal assistants. In T. Ahram & C. Falcão (Eds.), Advances in human factors in wearable technologies and game design (pp. 204–214). Springer International Publishing. https://doi.org/10.1007/978-3-319-60639-2_21
  • Clark, L., Doyle, P., Garaialde, D., Gilmartin, E., Schlögl, S., Edlund, J., Aylett, M., Cabral, J., Munteanu, C., Edwards, J., & R Cowan, B. (2019). The state of speech in HCI: Trends, themes and challenges. Interacting with Computers, 31(4), 349–371. https://doi.org/10.1093/iwc/iwz016
  • Codish, D., & Ravid, G. (2017). Gender moderation in gamification: Does one size fit all? In Hawaii International Conference on System Sciences. https://doi.org/10.24251/HICSS.2017.244
  • Cowan, B. R., Pantidi, N., Coyle, D., Morrissey, K., Clarke, P., Al-Shehri, S., Earley, D., & Bandeira, N. (2017). “What can I help you with?”: Infrequent users’ experiences of intelligent personal assistants. In Proceedings of the 19th International Conference on Human–Computer Interaction with Mobile Devices and Services (pp. 1–12). https://doi.org/10.1145/3098279.3098539
  • de Barcelos Silva, A., Gomes, M. M., da Costa, C. A., da Rosa Righi, R., Barbosa, J. L. V., Pessin, G., De Doncker, G., & Federizzi, G. (2020). Intelligent personal assistants: A systematic literature review. Expert Systems with Applications, 147, 113193. https://doi.org/10.1016/j.eswa.2020.113193
  • Deci, E. L., & Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11(4), 227–268. https://doi.org/10.1207/S15327965PLI1104_01
  • Dehghanzadeh, H., Fardanesh, H., Hatami, J., Talaee, E., & Noroozi, O. (2021). Using gamification to support learning English as a second language: A systematic review. Computer Assisted Language Learning, 34(7), 934–957. https://doi.org/10.1080/09588221.2019.1648298
  • Denny, P., McDonald, F., Empson, R., Kelly, P., & Petersen, A. (2018). Empirical support for a causal relationship between gamification and learning outcomes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–13). https://doi.org/10.1145/3173574.3173885
  • Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining “gamification”. In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments (pp. 9–15). https://doi.org/10.1145/2181037.2181040
  • Develop Skills in Multiple Languages | Alexa Skills Kit (2021). Amazon (Alexa). https://developer.amazon.com/de-DE/docs/alexa/custom-skills/develop-skills-in-multiple-languages.html
  • Dichev, C., & Dicheva, D. (2017). Gamifying education: What is known, what is believed and what remains uncertain: A critical review. International Journal of Educational Technology in Higher Education, 14(1), 9. https://doi.org/10.1186/s41239-017-0042-5
  • Dicheva, D., Dichev, C., Agre, G., & Angelova, G. (2015). Gamification in education: A systematic mapping study. Educational Technology & Society, 18(3), 75–88.
  • Dizon, G. (2017). Using intelligent personal assistants for second language learning: A case study of Alexa. TESOL Journal, 8(4), 811–830. https://doi.org/10.1002/tesj.353
  • Dizon, G. (2020). Evaluating intelligent personal assistants for L2 listening and speaking development. Language Learning & Technology, 24(1), 16–26. http://hdl.handle.net/10125/44705
  • Dizon, G. (2021). Affordances and constraints of intelligent personal assistants for second-language learning. RELC Journal, 003368822110205. https://doi.org/10.1177/00336882211020548
  • Dizon, G., Tang, D., & Yamamoto, Y. (2022). A case study of using Alexa for out-of-class, self-directed Japanese language learning. Computers and Education: Artificial Intelligence, 3, 100088. https://doi.org/10.1016/j.caeai.2022.100088
  • Field, A. (2017). Discovering statistics using IBM SPSS statistics (5th ed.). SAGE Publications.
  • Friberg, J., & Gärdenfors, D. (2004). Audio games: New perspectives on game audio. In Proceedings of the 2004 ACM SIGCHI International Conference on Advances in Computer Entertainment Technology – ACE’04 (pp. 148–154). https://doi.org/10.1145/1067343.1067361
  • Garcia, F. E., de Almeida Neris, V. P., Garcia, F. E., & de Almeida Neris, V. P. (2013). Design guidelines for audio games. In M. Kurosu & M. Kurosu (Eds.), Proceedings of the 15th International Conference on Human–Computer Interaction (Vol. 8005, pp. 229–238). Springer. https://doi.org/10.1007/978-3-642-39262-7_26
  • Govender, T., & Arnedo-Moreno, J. (2021). An analysis of game design elements used in digital game-based language learning. Sustainability, 13(12), 6679. https://doi.org/10.3390/su13126679
  • Groening, C., & Binnewies, C. (2019). “Achievement unlocked!”—The impact of digital achievements as a gamification element on motivation and performance. Computers in Human Behavior, 97, 151–166. https://doi.org/10.1016/j.chb.2019.02.026
  • Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does gamification work? – A literature review of empirical studies on gamification. In 47th Hawaii International Conference on System Sciences (HICSS) (pp. 3025–3034). https://doi.org/10.1109/HICSS.2014.377
  • Hsu, H.-L., Chen, H. H.-J., & Todd, A. G. (2021). Investigating the impact of the Amazon Alexa on the development of L2 listening and speaking skills. Interactive Learning Environments, 1–14. https://doi.org/10.1080/10494820.2021.2016864
  • Huang, R., Ritzhaupt, A. D., Sommer, M., Zhu, J., Stephen, A., Valle, N., Hampton, J., & Li, J. (2020). The impact of gamification in educational settings on student learning outcomes: A meta-analysis. Educational Technology Research and Development, 68(4), 1875–1901. https://doi.org/10.1007/s11423-020-09807-z
  • IOS and iPadOS-Feature Availability (2021). Apple. https://www.apple.com/ios/feature-availability/
  • Istrate, A. M. (2019). The impact of the virtual assistant (VA) on language classes (1.0, 163840. B) [Data set]. ADLRO. https://doi.org/10.12753/2066-026X-19-040
  • Jent, S., & Janneck, M. (2018). Using gamification to enhance user motivation: The influence of gender and age. In L. E. Freund & W. Cellary (Eds.), Advances in the human side of service engineering (Vol. 601, pp. 3–10). Springer International Publishing. https://doi.org/10.1007/978-3-319-60486-2_1
  • Jun, E., Hsieh, G., & Reinecke, K. (2017). Types of motivation affect study selection, attention, and dropouts in online experiments. Proceedings of the ACM on Human–Computer Interaction, 1(CSCW), 1–15. https://doi.org/10.1145/3134691
  • Kapp, K. M. (2012). The gamification of learning and instruction: Game-based methods and strategies for training and education. John Wiley & Sons.
  • Kinsella, B. (2019, March 7). U.S. smart display user base grew 558% in 2018 and more than doubled in second half of the year, Amazon holds two-thirds market share. Voicebot.Ai. https://voicebot.ai/2019/03/07/u-s-smart-display-user-base-grew-558-in-2018-and-more-than-doubled-in-second-half-of-the-year-amazon-holds-two-thirds-market-share/
  • Koivisto, J., & Hamari, J. (2019). The rise of motivational information systems: A review of gamification research. International Journal of Information Management, 45, 191–210. https://doi.org/10.1016/j.ijinfomgt.2018.10.013
  • La Guardia, J. G., Ryan, R. M., Couchman, C. E., & Deci, E. L. (2000). Within-person variation in security of attachment: A self-determination theory perspective on attachment, need fulfillment, and well-being. Journal of Personality and Social Psychology, 79(3), 367–384. https://doi.org/10.1037/0022-3514.79.3.367
  • Landers, R. N. (2014). Developing a theory of gamified learning: linking serious games and gamification of learning. Simulation & Gaming, 45(6), 752–768. https://doi.org/10.1177/1046878114563660
  • Landers, R. N., & Landers, A. K. (2014). An empirical test of the theory of gamified learning: The effect of leaderboards on time-on-task and academic performance. Simulation & Gaming, 45(6), 769–785. https://doi.org/10.1177/1046878114563662
  • Lau, J., Zimmerman, B., & Schaub, F. (2018). Alexa, are you listening?: Privacy perceptions, concerns and privacy-seeking behaviors with smart speakers. Proceedings of the ACM on Human–Computer Interaction, 2(CSCW), 1–31. https://doi.org/10.1145/3274371
  • Legaki, N.-Z., Xi, N., Hamari, J., Karpouzis, K., & Assimakopoulos, V. (2020). The effect of challenge-based gamification on learning: An experiment in the context of statistics education. International Journal of Human–Computer Studies, 144, 102496. https://doi.org/10.1016/j.ijhcs.2020.102496
  • Leung, A. C. M., Santhanam, R., Kwok, R. C.-W., & Yue, W. T. (2022). Could gamification designs enhance online learning through personalization? Lessons from a field experiment. Information Systems Research, 1–23. https://doi.org/10.1287/isre.2022.1123
  • Liao, Y., Vitak, J., Kumar, P., Zimmer, M., & Kritikos, K. (2019). Understanding the role of privacy and trust in intelligent personal assistant adoption. In N. G. Taylor, C. Christian-Lamb, M. H. Martin, & B. Nardi (Eds.), Information in contemporary society (Vol. 11420, pp. 102–113). Springer International Publishing. https://doi.org/10.1007/978-3-030-15742-5_9
  • Liu, D., Santhanam, R., & Webster, J. (2017). Toward meaningful engagement: A framework for design and research of gamified information systems. MIS Quarterly, 41(4), 1011–1034. https://doi.org/10.25300/MISQ/2017/41.4.01
  • Looyestyn, J., Kernot, J., Boshoff, K., Ryan, J., Edney, S., & Maher, C. (2017). Does gamification increase engagement with online programs? A systematic review. PLOS One, 12(3), e0173403. https://doi.org/10.1371/journal.pone.0173403
  • Lopatovska, I., Griffin, A. L., Gallagher, K., Ballingall, C., Rock, C., & Velazquez, M. (2020). User recommendations for intelligent personal assistants. Journal of Librarianship and Information Science, 52(2), 577–591. https://doi.org/10.1177/0961000619841107
  • Luger, E., & Sellen, A. (2016). “Like having a really bad PA”: The gulf between user expectation and experience of conversational agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 5286–5297). https://doi.org/10.1145/2858036.2858288
  • Maeda, J. (n.d.). Frequency level checker. Retrieved January 16, 2022, from https://chuta.cegloc.tsukuba.ac.jp/flc/index.html
  • Majuri, J., Koivisto, J., Hamari, J. (2018). Gamification of education and learning: A review of empirical literature. In Proceedings of the 2nd International GamiFIN Conference, GamiFIN 2018 (pp. 11–19).
  • Marczewski, A. (2018). Even Ninja monkeys like to play: Gemification, game thinking and motivational design (Unicorn ed.).
  • Mazarakis, A. (2015). Using gamification for technology enhanced learning: The case of feedback mechanisms. Bulletin of the IEEE Technical Committee on Learning Technology, 4(17), 6–9. https://tc.computer.org/tclt/wp-content/uploads/sites/5/2018/01/2_Mazarakis.pdf
  • Mazarakis, A. (2021). Gamification reloaded: Current and future trends in gamification science. i-com, 20(3), 279–294. https://doi.org/10.1515/icom-2021-0025
  • Mazarakis, A., & Bräuer, P. (2018). Gamification is working, but which one exactly? Results from an experiment with four game design elements. In Proceedings of the Technology, Mind, and Society (Vol. 22, p. 1). https://doi.org/10.1145/3183654.3183667
  • Mazarakis, A., & Bräuer, P. (2022). Gamification is working, but which one exactly? Results from an experiment with four game design elements. International Journal of Human–Computer Interaction, 1–16. https://doi.org/10.1080/10447318.2022.2041909
  • McTear, M., Callejas, Z., & Griol, D. (2016). The conversational interface. Springer International Publishing. https://doi.org/10.1007/978-3-319-32967-3
  • Mekler, E. D., Brühlmann, F., Tuch, A. N., & Opwis, K. (2017). Towards understanding the effects of individual gamification elements on intrinsic motivation and performance. Computers in Human Behavior, 71, 525–534. https://doi.org/10.1016/j.chb.2015.08.048
  • Monterrat, B., Desmarais, M., Lavoué, É., & George, S. (2015). A player model for adaptive gamification in learning environments. In C. Conati, N. Heffernan, A. Mitrovic, & M. F. Verdejo (Eds.), Artificial intelligence in education (Vol. 9112, pp. 297–306). Springer International Publishing. https://doi.org/10.1007/978-3-319-19773-9_30
  • Moussalli, S., & Cardoso, W. (2020). Intelligent personal assistants: Can they understand and be understood by accented L2 learners? Computer Assisted Language Learning, 33(8), 865–890. https://doi.org/10.1080/09588221.2019.1595664
  • Murad, C., Munteanu, C., Clark, L., & Cowan, B. R. (2018). Design guidelines for hands-free speech interaction. In Proceedings of the 20th International Conference on Human–Computer Interaction with Mobile Devices and Services Adjunct – MobileHCI’18 (pp. 269–276). https://doi.org/10.1145/3236112.3236149
  • Namaghi, S. A. O., Safaee, S. E., & Sobhanifar, A. (2015). The effect of shyness on English speaking scores of Iranian EFL learners. Journal of Literature, Language and Linguistics, 12, 22–28.
  • Nobles, A. L., Leas, E. C., Caputi, T. L., Zhu, S.-H., Strathdee, S. A., & Ayers, J. W. (2020). Responses to addiction help-seeking from Alexa, Siri, Google Assistant, Cortana, and Bixby intelligent virtual assistants. NPJ Digital Medicine, 3(1), 11. https://doi.org/10.1038/s41746-019-0215-9
  • Ortiz‐Rojas, M., Chiluiza, K., & Valcke, M. (2019). Gamification through leaderboards: An empirical study in engineering education. Computer Applications in Engineering Education, 27(4), 777–788. https://doi.org/10.1002/cae.12116
  • Planner, A. (2018, July 5). How many users should you expect for your voice skill? https://www.screenmedia.co.uk/news/how-many-users-should-you-expect-for-your-voice-skill/
  • Plonsky, L., & Oswald, F. L. (2014). How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64(4), 878–912. https://doi.org/10.1111/lang.12079
  • Pyae, A., & Scifleet, P. (2018). Investigating differences between native English and non-native English speakers in interacting with a voice user interface: A case of Google Home. In Proceedings of the 30th Australian Conference on Computer-Human Interaction (pp. 548–553). https://doi.org/10.1145/3292147.3292236
  • Pyae, A., & Scifleet, P. (2019). Investigating the role of user’s English language proficiency in using a voice user interface: A case of Google Home smart speaker. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–6). https://doi.org/10.1145/3290607.3313038
  • Robson, K., Plangger, K., Kietzmann, J. H., McCarthy, I., & Pitt, L. (2015). Is it all a game? Understanding the principles of gamification. Business Horizons, 58(4), 411–420. https://doi.org/10.1016/j.bushor.2015.03.006
  • Ruan, S., Jiang, L., Xu, J., Tham, B. J.-K., Qiu, Z., Zhu, Y., Murnane, E. L., Brunskill, E., & Landay, J. A. (2019). QuizBot: A dialogue-based adaptive learning system for factual knowledge. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–13). https://doi.org/10.1145/3290605.3300587
  • Ruan, S., Jiang, L., Xu, Q., Liu, Z., Davis, G. M., Brunskill, E., & Landay, J. A. (2021). EnglishBot: An AI-powered conversational system for second language learning. In 26th International Conference on Intelligent User Interfaces (pp. 434–444). https://doi.org/10.1145/3397481.3450648
  • Ryan, R. M., & Deci, E. L. (2000). Intrinsic and extrinsic motivations: Classic definitions and new directions. Contemporary Educational Psychology, 25(1), 54–67. https://doi.org/10.1006/ceps.1999.1020
  • Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. Guilford Publications.
  • Sailer, M., & Homner, L. (2020). The gamification of learning: A meta-analysis. Educational Psychology Review, 32(1), 77–112. https://doi.org/10.1007/s10648-019-09498-w
  • Sailer, M., & Sailer, M. (2021). Gamification of in‐class activities in flipped classroom lectures. British Journal of Educational Technology, 52(1), 75–90. https://doi.org/10.1111/bjet.12948
  • Sailer, M., Hense, J. U., Mayr, S. K., & Mandl, H. (2017). How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction. Computers in Human Behavior, 69, 371–380. https://doi.org/10.1016/j.chb.2016.12.033
  • Seaborn, K., & Fels, D. I. (2015). Gamification in theory and action: A survey. International Journal of Human–Computer Studies, 74, 14–31. https://doi.org/10.1016/j.ijhcs.2014.09.006
  • Skidmore, L., & Moore, R. K. (2019). Using Alexa for flashcard-based learning. In Interspeech 2019 (pp. 1846–1850). https://doi.org/10.21437/Interspeech.2019-2893
  • Speech Synthesis Markup Language (SSML) Reference | Alexa Skills Kit (n.d.). Amazon (Alexa). Retrieved July 17, 2021, from https://developer.amazon.com/en-US/docs/alexa/custom-skills/speech-synthesis-markup-language-ssml-reference.html
  • Tan, M., & Hew, K. F. (2016). Incorporating meaningful gamification in a blended learning research methods class: Examining student learning, engagement, and affective outcomes. Australasian Journal of Educational Technology, 32(5), 19–34. https://doi.org/10.14742/ajet.2232
  • Tejedor-Garcia, C., Escudero-Mancebo, D., Cardenoso-Payo, V., & Gonzalez-Ferreras, C. (2020). Using challenges to enhance a learning game for pronunciation training of English as a second language. IEEE Access, 8, 74250–74266. https://doi.org/10.1109/ACCESS.2020.2988406
  • Tejedor-Garcia, C., Escudero-Mancebo, D., Gonzalez-Ferreras, C., Cámara-Arenas, E., & Cardenoso-Payo, V. (2016). Improving L2 production with a gamified computer-assisted pronunciation training tool, Tiptoptalk! In Proceedings of IberSPEECH (pp. 177–186).
  • Thiebes, S., Lins, S., & Basten, D. (2014). Gamifying information systems—A synthesis of gamification mechanics and dynamics. In ECIS 2014 Proceedings (pp. 1–17).
  • Tyack, A., & Mekler, E. D. (2020). Self-determination theory in HCI games research: Current uses and open questions. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1–22). https://doi.org/10.1145/3313831.3376723
  • Vansteenkiste, M., & Ryan, R. M. (2013). On psychological growth and vulnerability: Basic psychological need satisfaction and need frustration as a unifying principle. Journal of Psychotherapy Integration, 23(3), 263–280. https://doi.org/10.1037/a0032359
  • Vitkauskaitė, E., & Gatautis, R. (2018). Points for posts and badges to brand advocates: The role of gamification in consumer brand engagement. In Hawaii International Conference on System Sciences. https://doi.org/10.24251/HICSS.2018.143
  • Werbach, K., & Hunter, D. (2012). For the win: How game thinking can revolutionize your business. Wharton Digital Press.
  • Wu, Y., Rough, D., Bleakley, A., Edwards, J., Cooney, O., Doyle, P. R., Clark, L., & Cowan, B. R. (2020). See what I’m saying? Comparing intelligent personal assistant use for native and non-native language speakers. In 22nd International Conference on Human–Computer Interaction with Mobile Devices and Services (pp. 1–9). https://doi.org/10.1145/3379503.3403563
  • Young, H. (2014, November 7). Do young people care about learning foreign languages? The Guardian. https://www.theguardian.com/education/2014/nov/07/-sp-do-young-people-care-about-learning-foreign-languages-data
  • Zellou, G., Cohn, M., & Ferenc Segedin, B. (2021). Age- and gender-related differences in speech alignment toward humans and voice-AI. Frontiers in Communication, 5, 600361. https://doi.org/10.3389/fcomm.2020.600361
  • Zichermann, G., & Cunningham, C. (2011). Gamification by design: Implementing game mechanics in web and mobile apps. O’Reilly Media.