791
Views
1
CrossRef citations to date
0
Altmetric
Research Article

Toward a Mid-Range Design Theory for Developing Pedagogically Effective Serious Games

, &

References

  • Abeele, V. V., Schutter, B. D., Geurts, L., Desmet, S., Wauters, J., Husson, J., Audenaeren, L. V. D., Broeckhoven, F. V., Annema, J.-H., & Geerts, D. (2011). P-iii: A player-centered, iterative, interdisciplinary and integrated framework for serious game design and development. In. S. Wannemacker, S. Vandercruysse, & G. Clarebout (Eds.), Joint Conference of the Interdisciplinary Research Group on Technology, Education, and Communication, and the Scientific Network on Critical Flexible Thinking, Ghent, Belgium.
  • Agogué, M., Levillain, K., & Hooge, S. (2015). Gamification of creativity: Exploring the usefulness of serious games for ideation. Creativity and Innovation Management, 24(3), 415–429. https://doi.org/10.1111/caim.12138
  • Allied Market. (2022). Serious games market by gaming platform, application, industry vertical, and region: Global opportunity analysis and industry forecast, 2021 - 2030. Allied Market Research. Retrieved 19.09.2022. from https://www.alliedmarketresearch.com/serious-games-market#:~:text=The%20serious%20games%20market%20was,a%20purpose%20other%20than%20entertainment
  • An, B., Brown, D., & Guerlain, S. (2019). The evaluation of a serious game to improve cross-cultural competence. IEEE Transactions on Learning Technologies, 12(3), 429–441. https://doi.org/10.1109/TLT.2018.2865411
  • Andresen, M., & Bergdolt, F. (2017). A systematic literature review on the definitions of global mindset and cultural intelligence – merging two different research streams. The International Journal of Human Resource Management, 28(1), 170–195. https://doi.org/10.1080/09585192.2016.1243568
  • Ang, S., & Van Dyne, L. (2015). Handbook of cultural intelligence: Theory, measurement, and applications. Routledge.
  • Ang, S., Van Dyne, L., Koh, C., Ng, K. Y., Templer, K. J., Tay, C., & Chandrasekar, N. A. (2007). Cultural intelligence: Its measurement and effects on cultural judgment and decision making, cultural adaptation and task performance. Management and Organization Review, 3(3), 335–371. https://doi.org/10.1111/j.1740-8784.2007.00082.x
  • Annetta, L. A. (2010). The “I’s” have it: A framework for serious educational game design. Review of General Psychology, 14(2), 105–112. https://doi.org/10.1037/a0018985
  • Arnab, S., Berta, R., Earp, J., De Freitas, S., Popescu, M., Romero, M., Stanescu, I., & Usart, M. (2012). Framing the adoption of serious games in formal education. Electronic Journal of E-Learning, 10(2), 159–171.
  • Arnab, S., Lim, T., Carvalho, M. B., Bellotti, F., de Freitas, S., Louchart, S., Suttie, N., Berta, R., & De Gloria, A. (2015). Mapping learning and game mechanics for serious games analysis. British Journal of Educational Technology, 46(2), 391–411. https://doi.org/10.1111/bjet.12113
  • Aslan, S., & Balci, O. (2015). Gamed: Digital educational game development methodology. Simulation, 91(4), 307–319. https://doi.org/10.1177/0037549715572673
  • Ávila-Pesántez, D., Rivera, L. A., & Alban, M. S. (2017). Approaches for serious game design: A systematic literature review. The ASEE Computers in Education (CoED) Journal, 8(3), 1–11.
  • Barbosa, A. F., Pereira, P. N., Dias, J. A., & Silva, F. G. (2014). A new methodology of design and development of serious games. International Journal of Computer Games Technology, 2014(2), 1–8. https://doi.org/10.1155/2014/817167
  • Baskerville, R., Baiyere, A., Gregor, S., Hevner, A., & Rossi, M. (2018). Design science research contributions: Finding a balance between artifact and theory. Journal of the Association for Information Systems, 19(5), 358–376. https://doi.org/10.17705/1JAIS.00495
  • Baskerville, R., & Pries-Heje, J. (2010). Explanatory design theory. Business & Information Systems Engineering, 2, 271–282. https://doi.org/10.1007/s12599-010-0118-4
  • Bass, B. M., & Riggio, R. E. (2006). Transformational Leadership (2nd ed.). Taylor & Francis.
  • Bedwell, W. L., Pavlas, D., Heyne, K., Lazzara, E. H., & Salas, E. (2012). Toward a taxonomy linking game attributes to learning: An empirical study. Simulation & Gaming, 43(6), 729–760. https://doi.org/10.1177/1046878112439444
  • Bellotti, F., Ott, M., Arnab, S., Berta, R., de Freitas, S., Kiili, K., & De Gloria, A. (2011). Designing serious games for education: From pedagogical principles to game mechanisms. In D. Gouscos & M. Meimaris (Eds.), Proceedings of the 5th European Conference on Games Based Learning, Athens, Greece.
  • Bennion, J., Cannon, B., Hill, B., Nelson, R., & Ricks, M. (2020). Asking the right questions: Using reflective essays for experiential assessment. The Journal of Experiential Education, 43(1), 37–54. https://doi.org/10.1177/1053825919880202
  • Bergin, S., Reilly, R., & Traynor, D. (2005). Examining the role of self-regulated learning on introductory programming performance. In R. Anderson, S. A. Fincher, & M. Guzdial (Eds.), Proceedings of the first international workshop on Computing education research, Seattle, WA.
  • Bird, A., Morley, M. J., Mendenhall, M., Stevens, M. J., & Oddou, G. (2010). Defining the content domain of intercultural competence for global leaders. Journal of Managerial Psychology, 25(8), 810–828. https://doi.org/10.1108/02683941011089107
  • Böckle, M., Bick, M., & Novak, J. (2021). Toward a design theory of user-centered score mechanics for gamified competency development. Information Systems Management, 40(1), 2–28. https://doi.org/10.1080/10580530.2021.1975852
  • Bohn, J., Eibl, M., Berger, A., & Müller, S. (2014). Study-town – a game for cultural awareness. In T. Baranowski, M. Claypool, R. Dörner, & F. Mueller (Eds.), Proceedings of the 2014 ACM International Workshop on Serious Games, Orlando, FL.
  • Boyle, E. A., Hainey, T., Connolly, T. M., Gray, G., Earp, J., Ott, M., Lim, T., Ninaus, M., Ribeiro, C., & Pereira, J. (2016). An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games. Computers & Education, 94, 178–192. https://doi.org/10.1016/j.compedu.2015.11.003
  • Braad, E., Žavcer, G., & Sandovar, A. (2016). Processes and models for serious game design and development. In R. Dörner, S. Göbel, M. Kickmeier, M. Masuch, & K. A. Zweig (Eds.), Entertainment computing and serious games (pp. 92–118). Springer.
  • Brom, C., Buchtova, M., Šisler, V., Děchtěrenko, F., Palme, R., & Glenk, L. M. (2014). Flow, social interaction anxiety and salivary cortisol responses in serious games: A quasi-experimental study. Computers & Education, 79, 69–100. https://doi.org/10.1016/j.compedu.2014.07.001
  • Brown, A. R., & Voltz, B. D. (2005). Elements of effective e-learning design. International Review of Research in Open & Distributed Learning, 6(1), 1–10. https://doi.org/10.19173/irrodl.v6i1.217
  • Bruner, J. S. (1966). Toward a theory of instruction (Vol. 59). Harvard University Press.
  • Calabor, M. S., Mora, A., & Moya, S. (2019). The future of’serious games’ in accounting education: A delphi study. Journal of Accounting Education, 46, 43–52. https://doi.org/10.1016/j.jaccedu.2018.12.004
  • Calderón, A., & Ruiz, M. (2015). A systematic literature review on serious games evaluation: An application to software project management. Computers & Education, 87, 396–422. https://doi.org/10.1016/j.compedu.2015.07.011
  • Campbell, D. T., & Stanley, J. C. (2015). Experimental and quasi-experimental designs for research. Houghton Mifflin Company.
  • Cano, S., Arteaga, J. M., Collazos, C. A., Gonzalez, C. S., & Zapata, S. (2016). Toward a methodology for serious games design for children with auditory impairments. IEEE Latin America Transactions, 14(5), 2511–2521. https://doi.org/10.1109/TLA.2016.7530453
  • Carvalho, M. B., Bellotti, F., Berta, R., De Gloria, A., Sedano, C. I., Hauge, J. B., Hu, J., & Rauterberg, M. (2015). An activity theory-based model for serious games analysis and conceptual design. Computers & Education, 87, 166–181. https://doi.org/10.1016/j.compedu.2015.03.023
  • Clark, D. B., Tanner-Smith, E. E., & Killingsworth, S. S. (2016). Digital games, design, and learning: A systematic review and meta-analysis. Review of Educational Research, 86(1), 79–122. https://doi.org/10.3102/0034654315582065
  • Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers & Education, 59(2), 661–686. https://doi.org/10.1016/j.compedu.2012.03.004
  • Craighead, J., Burke, J., & Murphy, R. (2008). Using the unity game engine to develop SARGE: A case study. Proceedings of the 2008 Simulation Workshop at the International Conference on Intelligent Robots and Systems (IROS 2008), Nice, France.
  • Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. Harper & Row.
  • de Almeida, J. L. F., & dos Santos Machado, L. (2021). Design requirements for educational serious games with focus on player enjoyment. Entertainment Computing, 38, 100413. https://doi.org/10.1016/j.entcom.2021.100413
  • Deaton, J. E., Barba, C., Santarelli, T., Rosenzweig, L., Souders, V., McCollum, C., Seip, J., Knerr, B. W., & Singer, M. J. (2005). Virtual environment cultural training for operational readiness (VECTOR). Virtual Reality, 8(3), 156–167. https://doi.org/10.1007/s10055-004-0145-x
  • De Freitas, S. (2006). Learning in immersive worlds: A review of game-based learning. M. University.
  • De Freitas, S. (2018). Are games effective learning tools? A review of educational games. Journal of Educational Technology & Society, 21(2), 74–84. http://www.jstor.org/stable/26388380
  • De Freitas, S., & Neumann, T. (2009). The use of ‘exploratory learning’for supporting immersive learning in virtual environments. Computers & Education, 52(2), 343–352. https://doi.org/10.1016/j.compedu.2008.09.010
  • de Jong, M., & Warmelink, H. (2017). Oasistan: An intercultural role-playing simulation game to recognize cultural dimensions. Simulation & Gaming, 48(2), 178–198. https://doi.org/10.1177/1046878117691076
  • De Lope, R. P., Arcos, J. R. L., Medina-Medina, N., Paderewski, P., & Gutiérrez-Vela, F. (2017). Design methodology for educational games based on graphical notations: Designing Urano. Entertainment Computing, 18, 1–14. https://doi.org/10.1016/j.entcom.2016.08.005
  • Dowling, P. J., Festing, M., & Engle, A. D. (2017). International human resource management (7th ed.). Cengage Learning.
  • Durlach, P. J., Wansbury, T. G., & Wilkinson, J. G. (2008). Cultural awareness and negotiation skills training: Evaluation of a prototype semi-immersive system. In J. A. Parmentola & D. Szkrybalo (Eds.), 26th Army Science Conference, Orlando, FL.
  • Earley, C. P., & Ang, S. (2003). Cultural intelligence: Individual interactions across cultures. Stanford University Press.
  • El Arroum, F.-Z., Hanoune, M., & Zidoun, Y. (2020). Serious game design: Presenting a new generic creative reflection framework. International Journal of Emerging Technologies in Learning (IJET), 15(19), 247–255. https://doi.org/10.3991/ijet.v15i19.15603
  • El Kechaï, H., & Pierrot, L. (2015). Participatory design in EU-TOPIA: A serious game for intercultural competences during work mobility. In D. G. Sampson, R. Huang, G.-J. Hwang, T.-C. Liu, N.-S. Chen, Kinshuk, & C.-C. Tsai (Eds.), 2015 IEEE 15th International Conference on Advanced Learning Technologies, Hualien, Taiwan.
  • Fischer, A., Greiff, S., Wüstenberg, S., Fleischer, J., Buchwald, F., & Funke, J. (2015). Assessing analytic and interactive aspects of problem solving competency. Learning & Individual Differences, 39, 172–179. https://doi.org/10.1016/j.lindif.2015.02.008
  • Fischer, R., & Schwartz, S. (2010). Whence differences in value priorities? Individual, cultural, or artifactual sources. Journal of Cross-Cultural Psychology, 42(7), 1127–1144. https://doi.org/10.1177/0022022110381429
  • Fishwick, P. A., Coffrey, A. J., Kamhai, R., & Henderson, J. (2010). An experimental design and preliminary results for a cultural training system simulation. In B. Johansson, S. Jain, J. Montoya-Torres, & E. Yücesan (Eds.), Winter Simulation Conference, Baltimore, MA.
  • Flood, S., Cradock-Henry, N. A., Blackett, P., & Edwards, P. (2018). Adaptive and interactive climate futures: Systematic review of ‘serious games’ for engagement and decision-making. Environmental Research Letters, 13(6), 063005. https://doi.org/10.1088/1748-9326/aac1c6
  • Freire, P. (1970). Pedagogy of the oppressed. Routledge.
  • Froschauer, J., Seidel, I., Gärtner, M., Berger, H., & Merkl, D. (2010, October 20–23). Design and evaluation of a serious game for immersive cultural training. In N. Henze, P. Woźniak, K. Väänänen, J. Williamson, & S. Schneegass (Eds.), Proceedings of the 16th International Conference on Virtual Systems and Multimedia, VSMM, Seoul, South Korea.
  • Garris, R., Ahlers, R., & Driskell, J. E. (2002). Games, motivation, and learning: A research and practice model. Simulation & gaming, 33(4), 441–467. https://doi.org/10.1177/1046878102238607
  • Gelfand, M. J., Aycan, Z., Erez, M., & Leung, K. (2017). Cross-cultural industrial organizational psychology and organizational behavior: A hundred-year journey. Journal of Applied Psychology, 102(3), 514–529. https://doi.org/10.1037/apl0000186
  • Gill, T. G., & Hevner, A. R. (2013). A fitness-utility model for design science research. ACM Transactions on Management Information Systems (TMIS), 4(2), 1–24. https://doi.org/10.1145/2499962.2499963
  • Goodman, R. S., Patrinely, J. R., Osterman, T., Wheless, L., & Johnson, D. B. (2023). On the cusp: Considering the impact of artificial intelligence language models in healthcare. Medicine (Baltimore), 4(3), 139–140. https://doi.org/10.1016/j.medj.2023.02.008
  • Gouveia, D., Lopes, D., & de Carvalho, C. V. (2011). Serious gaming for experiential learning. Proceedings of the 2011 Frontiers in Education Conference (FIE), Rapid City, SD.
  • Graafland, M., Schraagen, J. M., & Schijven, M. P. (2012). Systematic review of serious games for medical education and surgical skills training. Journal of British Surgery, 99(10), 1322–1330. https://doi.org/10.1002/bjs.8819
  • Granic, I., Lobel, A., & Engels, R. C. (2014). The benefits of playing video games. The American psychologist, 69(1), 66–78. https://doi.org/10.1037/a0034857
  • Greenberg, B. S., Sherry, J., Lachlan, K., Lucas, K., & Holmstrom, A. (2010). Orientations to video games among gender and age groups. Simulation & Gaming, 41(2), 238–259. https://doi.org/10.1177/1046878108319930
  • Gregor, S. (2006). The nature of theory in information systems. MIS Quarterly, 30(3), 611–642. https://doi.org/10.2307/25148742
  • Gregor, S., Chandra Kruse, L., & Seidel, S. (2020). Research perspectives: The anatomy of a design principle. Journal of the Association for Information Systems, 21(6), 1622–1652. https://doi.org/10.17705/1jais.00649
  • Gregor, S., & Hevner, A. R. (2013). Positioning and presenting design science research for maximum impact. MIS Quarterly, 37(2), 337–355. https://doi.org/10.25300/MISQ/2013/37.2.01
  • Gregor, S., & Jones, D. (2007). The anatomy of a design theory. Journal of the Association for Information Systems, 8(5), 312–335.
  • Griffith, R. L., Wolfeld, L., Armon, B. K., Rios, J., & Liu, O. L. (2016). Assessing intercultural competence in higher education: Existing research and future directions. ETS Research Report Series, 2016(2), 1–44. https://doi.org/10.1002/ets2.12112
  • Grund, C. K., & Schelkle, M. (2019). Developing serious games with integrated debriefing. Business & Information Systems Engineering, 62(2), 87–101. https://doi.org/10.1007/s12599-019-00579-2
  • Guillén-Nieto, V., & Aleson-Carbonell, M. (2012). Serious games and learning effectiveness: The case of it’s a deal!. Computers & Education, 58(1), 435–448. https://doi.org/10.1016/j.compedu.2011.07.015
  • Gummesson, E. (2000). Qualitative methods in management research. Sage.
  • Gupta, M., George, J. F., & Xia, W. (2019). Relationships between it department culture and agile software development practices: An empirical investigation. International Journal of Information Management, 44, 13–24. https://doi.org/10.1016/j.ijinfomgt.2018.09.006
  • Hendrix, M., Bellamy-Wood, T., McKay, S., Bloom, V., & Dunwell, I. (2018). Implementing adaptive game difficulty balancing in serious games. IEEE transactions on Games, 11(4), 320–327. https://doi.org/10.1109/TG.2018.2791019
  • Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004). Design science in information systems research. MIS Quaterly, 28(1), 75–105. https://doi.org/10.2307/25148625
  • Hollebeek, L. D., Das, K., & Shukla, Y. (2021). Game on! How gamified loyalty programs boost customer engagement value. International Journal of Information Management, 61, 102308. https://doi.org/10.1016/j.ijinfomgt.2021.102308
  • House, R. J., Dorfman, P. W., Javidan, M., Hanges, P. J., & De Luque, M. F. S. (2013). Strategic leadership across cultures: GLOBE study of CEO leadership behavior and effectiveness in 24 countries. Sage Publications.
  • House, R. J., Hanges, P. J., Javidan, M., Dorfman, P. W., & Gupta, V. (2004). Culture, leadership, and organizations: The GLOBE study of 62 societies. Sage Publications.
  • Hunicke, R., LeBlanc, M., & Zubek, R. (2004). MDA: A formal approach to game design and game research. Proceedings of the AAAI Workshop on Challenges in Game AI, San Jose, CA.
  • Ibrahim, R., & Jaafar, A. (2009). Educational games (EG) design framework: Combination of game design, pedagogy and content modeling. In M. J. Nordin, K. Jumari, & Suwarno (Eds.), 2009 International Conference on Electrical Engineering and Informatics, Bangi, Malaysia.
  • Iivari, J. (2020). A critical look at theories in design science research. Journal of the Association for Information Systems, 21(3), 10. https://doi.org/10.17705/1jais.00610
  • Johnson, W. L., & Valente, A. (2009). Tactical language and culture training systems: Using AI to teach foreign languages and cultures. AI Magazine, 30(2), 72–83. https://doi.org/10.1609/aimag.v30i2.2240
  • Kalelioğlu, F. (2015). A new way of teaching programming skills to k-12 students: Code.Org. Computers in Human Behavior, 52, 200–210. https://doi.org/10.1016/j.chb.2015.05.047
  • Kayes, D. C. (2002). Experiential learning and its critics: Preserving the role of experience in management learning and education. Academy of Management Learning & Education, 1(2), 137–149. https://doi.org/10.5465/AMLE.2002.8509336
  • Kiili, K. (2005). Digital game-based learning: Towards an experiential gaming model. The Internet and Higher Education, 8(1), 13–24. https://doi.org/10.1016/j.iheduc.2004.12.001
  • Kiili, K., de Freitas, S., Arnab, S., & Lainema, T. (2012). The design principles for flow experience in educational games. Procedia Computer Science, 15, 78–91. https://doi.org/10.1016/j.procs.2012.10.060
  • Kiili, K., Perttula, A., Lindstedt, A., Arnab, S., & Suominen, M. (2014). Flow experience as a quality measure in evaluating physically activating collaborative serious games. International Journal of Serious Games, 1(3), 35–49. https://doi.org/10.17083/ijsg.v1i3.23
  • Klapztein, S., & Cipolla, C. (2016). From game design to service design: A framework to gamify services. Simulation & Gaming, 47(5), 566–598. https://doi.org/10.1177/104687811664186
  • Kolb, D. A. (1984). Experiential learning: Experience as the source of learning and development (1st ed.). Prentice-Hall.
  • Kolb, D., Lublin, S., Spoth, J., & Baker, R. (1986). Strategic management development: Using experiential learning theory to assess and develop managerial competencies. Journal of Management Development, 5(3), 13–24. https://doi.org/10.1108/eb051612
  • Krath, J., Schürmann, L., & Von Korflesch, H. F. (2021). Revealing the theoretical basis of gamification: A systematic review and analysis of theory in research on gamification, serious games and game-based learning. Computers in Human Behavior, 125, 106963. https://doi.org/10.1016/j.chb.2021.106963
  • Krathwohl, D. R. (2002). A revision of bloom’s taxonomy: An overview. Theory into Practice, 41(4), 212–218. https://doi.org/10.1207/s15430421tip4104_2
  • Kuechler W., & Vaishnavi V. (2012). A Framework for Theory Development in Design Science Research: Multiple Perspectives. Journal of the Association for Information Systems, 13(6), 395–423. https://doi.org/10.17705/1jais.00300
  • Kummer, T.-F., Leimeister, J. M., & Bick, M. (2012). On the importance of national culture for the design of information systems. Business & Information Systems Engineering, 4(6), 317–330. https://doi.org/10.1007/s12599-012-0236-2
  • Lamb, R. L., Annetta, L., Firestone, J., & Etopio, E. (2018). A meta-analysis with examination of moderators of student cognition, affect, and learning outcomes while using serious educational games, serious games, and simulations. Computers in Human Behavior, 80, 158–167. https://doi.org/10.1016/j.chb.2017.10.040
  • LeBreton, J. M., & Senter, J. L. (2008). Answers to 20 questions about interrater reliability and interrater agreement. Organizational Research Methods, 11(4), 815–852. https://doi.org/10.1177/1094428106296642
  • Li, M., Mobley, W. H., & Kelly, A. (2013). When do global leaders learn best to develop cultural intelligence? An investigation of the moderating role of experiential learning style. Academy of Management Learning & Education, 12(1), 32–50. https://doi.org/10.5465/amle.2011.0014
  • Lopes, R., & Bidarra, R. (2011). Adaptivity challenges in games and simulations: A survey. IEEE Transactions on Computational Intelligence and AI in Games, 3(2), 85–99. https://doi.org/10.1109/TCIAIG.2011.2152841
  • Lund, B. D., & Wang, T. (2023). Chatting about chatgpt: How may ai and gpt impact academia and libraries?. Library Hi Tech News, 40(3), 26–29. https://doi.org/10.2139/ssrn.4333415
  • Marne, B., Wisdom, J., Huynh-Kim-Bang, B., & Labat, J.-M. (2012). The six facets of serious game design: A methodology enhanced by our design pattern library. In A. Ravenscroft, S. Leindstaedt, C. D. Kloos, & D. Hernández-Leo (Eds.), European Conference on Technology Enhanced Learning, Saarbrücken, Germany.
  • Mäyrä, F. (2015). Mobile games. In R. Mansell, & P. Hwa Ang (Eds.), The international encyclopedia of digital communication and society (1st ed., pp. 1–6). John Wiley & Sons, Inc.
  • Mayring, P. (2004). Qualitative content analysis. In U. Flick, E. von Kardorff, & I. Steinke (Eds.), A companion to qualitative research (pp. 266–270). SAGE Publications.
  • Miljanovic, M. A., & Bradbury, J. S. (2018). A review of serious games for programming. In S. Göbel, A. Garcia-Agundez, T. Tregel, M. Ma, J. B. Hauge, M. Oliveira, T. Marsh, & P. Caserman (Eds.), Serious Games: 4th Joint International Conference (JCSG 2018), Darmstadt, Germany.
  • Mortara, M., Catalano, C. E., Bellotti, F., Fiucci, G., Houry-Panchetti, M., & Petridis, P. (2014). Learning cultural heritage by serious games. Journal of Cultural Heritage, 15(3), 318–325. https://doi.org/10.1016/j.culher.2013.04.004
  • Nadolski, R., Hummel, H., Van den Brink, H., Hoefakker, R., Slootmaker, A., Kurvers, H., & Storm, J. (2008). Emergo: Methodology and toolkit for efficient development of serious games in higher education. Simulations & Gaming, 39(3), 338–352.
  • Nederhof, A. J. (1985). Methods of coping with social desirability bias: A review. European Journal of Social Psychology, 15(3), 263–280. https://doi.org/10.1002/ejsp.2420150303
  • Newman, J. (2012). Ports and patches: Digital games as unstable objects. Convergence, 18(2), 135–142. https://doi.org/10.1177/1354856511433688
  • Niehaves, B., & Ortbach, K. (2016). The inner and the outer model in explanatory design theory: The case of designing electronic feedback systems. European Journal of Information Systems, 25(4), 303–316. https://doi.org/10.1057/ejis.2016.3
  • Ninaus, M., & Nebel, S. (2021). A systematic literature review of analytics for adaptivity within educational video games. Frontiers in Education, 5, 611072. https://doi.org/10.3389/feduc.2020.611072
  • Ott, D. L., & Michailova, S. (2018). Cultural intelligence: A review and new research avenues. International Journal of Management Reviews, 20(1), 99–119. https://doi.org/10.1111/ijmr.12118
  • Padilla-Zea, N., Gutiérrez, F. L., López-Arcos, J. R., Abad Arranz, A., & Paderewski, P. (2014). Modeling storytelling to be used in educational video games. Computers in Human Behavior, 31, 461–474. https://doi.org/10.1016/j.chb.2013.04.020
  • Paik, S.-H., Cho, H., Chun, J.-W., Jeong, J.-E., & Kim, D.-J. (2017). Gaming device usage patterns predict internet gaming disorder: Comparison across different gaming device usage patterns. International Journal of Environmental Research and Public Health, 14(12), 1512. https://doi.org/10.3390/ijerph14121512
  • Peffers, K., Tuunanen, T., & Niehaves, B. (2018). Design science research genres: Introduction to the special issue on exemplars and criteria for applicable design science research. European Journal of Information Systems, 27(2), 129–139. https://doi.org/10.1080/0960085X.2018.1458066
  • Peirce, N., Conlan, O., & Wade, V. (2008). Adaptive educational games: Providing non-invasive personalised learning experiences. In M. Eisenberg, Kinshuk, M. Chang, & R. McGreal (Eds.), 2008 second IEEE international conference on digital game and intelligent toy enhanced learning, Banff, Canada.
  • Perttula, A., Kiili, K., Lindstedt, A., & Tuomi, P. (2017). Flow experience in game based learning–a systematic literature review. International Journal of Serious Games, 4(1), 57–72. https://doi.org/10.17083/ijsg.v4i1.151
  • Poldner, E., Simons, P., Wijngaards, G., & Van der Schaaf, M. (2012). Quantitative content analysis procedures to analyse students’ reflective essays: A methodological review of psychometric and edumetric aspects. Educational Research Review, 7(1), 19–37. https://doi.org/10.1016/j.edurev.2011.11.002
  • Prat, N., Comyn-Wattiau, I., & Akoka, J. (2015). A taxonomy of evaluation methods for information systems artifacts. Journal of Management Information Systems, 32(3), 229–267. https://doi.org/10.1080/07421222.2015.1099390
  • Prøitz, T. S. (2010). Learning outcomes: What are they? Who defines them? When and where are they defined?. Educational Assessment, Evaluation and Accountability, 22(2), 119–137. https://doi.org/10.1007/s11092-010-9097-8
  • Ravyse, W. S., Seugnet Blignaut, A., Leendertz, V., & Woolner, A. (2017). Success factors for serious games to enhance learning: A systematic review. Virtual reality, 21(1), 31–58. https://doi.org/10.1007/s10055-016-0298-4
  • Raybourn, E. M. (2009). Intercultural competence game that fosters metacognitive agility and reflection. In A. A. Ozok & P. Zaphiris (Eds.), Online communities and social computing (Vol. 5621, pp. 603–612). Springer. https://doi.org/10.1007/978-3-642-02774-1_65
  • Riopel, M., Nenciovici, L., Potvin, P., Chastenay, P., Charland, P., Sarrasin, J. B., & Masson, S. (2019). Impact of serious games on science learning achievement compared with more conventional instruction: An overview and a meta-analysis. Studies in Science Education, 55(2), 169–214. https://doi.org/10.1080/03057267.2019.1722420
  • Robertson, B. J. (2015). Holacracy: The new management system for a rapidly changing world. Henry Holt and Company.
  • Romero, M., Usart, M., & Ott, M. (2015). Can serious games contribute to developing and sustaining 21st century skills?. Games and Culture, 10(2), 148–177. https://doi.org/10.1177/1555412014548919
  • Rončević Zubković, B., Kolić-Vehovec, S., Smojver-Ažić, S., Martinac Dorčić, T., & Pahljina-Reinić, R. (2022). The role of experience during playing bullying prevention serious game: Effects on knowledge and compassion. Behaviour & Information Technology, 41(2), 401–415. https://doi.org/10.1080/0144929X.2020.1813332
  • Rooney, P. (2012). A theoretical framework for serious game design. International Journal of Game-Based Learning, 2(4), 41–60. https://doi.org/10.4018/ijgbl.2012100103
  • Sahay, S., Nicholson, B., & Krishna, S. (2003). Global IT outsourcing: Software development across borders. Cambridge University Press.
  • Sandberg, J. (2005). How do we justify knowledge produced within interpretive approaches?. Organizational Research Methods, 8(1), 41–68. https://doi.org/10.1177/1094428104272000
  • Sitzmann, T. (2011). A meta‐analytic examination of the instructional effectiveness of computer‐based simulation games. Personnel Psychology, 64(2), 489–528. https://doi.org/10.1111/j.1744-6570.2011.01190.x
  • Sobania, D., Briesch, M., Hanna, C., & Petke, J. (2023). An analysis of the automatic bug fixing performance of chatgpt. arXiv, 2301.08653. https://doi.org/10.48550/arXiv.2301.08653
  • Sonnenberg, C., & Vom Brocke, J. (2012). Evaluations in the science of the artificial–reconsidering the build-evaluate pattern in design science research. In K. Pfeffers, M. Rothenberger, & B. Kuechler (Eds.), International Conference on Design Science Research in Information Systems, Las Vegas, NV.
  • Starks, K. (2014). Cognitive behavioral game design: A unified model for designing serious games. Frontiers in Psychology, 5(28), 1–10. https://doi.org/10.3389/fpsyg.2014.00028
  • Steinrücke, J., Veldkamp, B. P., & De Jong, T. (2019). Determining the effect of stress on analytical skills performance in digital decision games towards an unobtrusive measure of experienced stress in gameplay scenarios. Computers in Human Behavior, 99, 144–155. https://doi.org/10.1016/j.chb.2019.05.014
  • Sternberg, R. J., & Detterman, D. K. (1986). What is intelligence?: Contemporary viewpoints on its nature and definition. Praeger Pub Text.
  • Streicher, A., & Smeddinck, J. D. (2016). Personalized and adaptive serious games. In R. Dörner, S. Göbel, M. Kickmeier-Rust, M. Masuch, & K. Zweig (Eds.), Entertainment Computing and Serious Games: International GI-Dagstuhl Seminar 15283 (pp. 332–377). Dagstuhl Castle, Germany: Springer International Publishing.
  • Teng, C.-I., Huang, T.-L., Yang, Z.-H., Wu, W.-J., & Liao, G.-Y. (2022). How strategic, offensive, and defensive engagement impact gamers’ need satisfaction, loyalty, and game usage. International Journal of Information Management, 66, 102515. https://doi.org/10.1016/j.ijinfomgt.2022.102515
  • Teng, C.-I., Shiau, W.-L., Cheng, T., & Huang, H.-Y. (2022). Drawing goals nearer: Using the goal-gradient perspective to increase online game usage. International Journal of Information Management, 66, 102522. https://doi.org/10.1016/j.ijinfomgt.2022.102522
  • Theodosiou, S., & Karasavvidis, I. (2015). Serious games design: A mapping of the problems novice game designers experience in designing games. Journal of E-Learning and Knowledge Society, 11(3). https://doi.org/10.20368/1971-8829/1071
  • Tijs, T., Brokken, D., & IJsselsteijn, W. (2008). Creating an emotionally adaptive game. In S. M. Stevens & S. J. Saldamarco (Eds.), Entertainment Computing-ICEC 2008: 7th International Conference, Pittsburgh, PA.
  • Treviño-Guzmán, N., & Pomales-García, C. (2014). How can a serious game impact student motivation and learning? IIE Annual Conference, Montréal, Canada.
  • Vallon, R., da Silva Estacio, B. J., Prikladnicki, R., & Grechenig, T. (2018). Systematic literature review on agile practices in global software development. Information and Software Technology, 96, 161–180. https://doi.org/10.1016/j.infsof.2017.12.004
  • Venable, J. (2006). The role of theory and theorising in design science research. Proceedings of the 1st international conference on design science in information systems and technology (DESRIST 2006), Claremont, CA.
  • Venable, J. R. (2013). Rethinking design theory in information systems. In J. Brocke, R. Hekkala, S. Ram, & M. Rossi (Eds.), Design Science at the Intersection of Physical and Virtual Design: 8th International Conference, Helsinki, Finland.
  • Venable, J., Pries-Heje, J., & Baskerville, R. (2016). FEDS: A framework for evaluation in design science research. European Journal of Information Systems, 25(1), 77–89. https://doi.org/10.1057/ejis.2014.36
  • Venaik, S., & Midgley, D. F. (2015). Mindscapes across landscapes: Archetypes of transnational and subnational culture. Journal of International Business Studies, 46(9), 1051–1079. https://doi.org/10.1057/JIBS.2015.11
  • Vogel, J. J., Vogel, D. S., Cannon-Bowers, J., Bowers, C. A., Muse, K., & Wright, M. (2006). Computer gaming and interactive simulations for learning: A meta-analysis. Journal of Educational Computing Research, 34(3), 229–243. https://doi.org/10.2190/FLHV-K4WA-WPVQ-H0YM
  • Walls, J. G., Widmeyer, G. R., & El Sawy, O. A. (1992). Building an information system design theory for vigilant eis. Information Systems Research, 3(1), 36–59. https://doi.org/10.1287/isre.3.1.36
  • Watt, K., & Smith, T. (2021). Research-based game design for serious games. Simulation & Gaming, 52(5), 601–613. https://doi.org/10.1177/10468781211006758
  • Weber, R. (2012). Evaluating and developing theories in the information systems discipline. Journal of the Association for Information Systems, 13(1), 2. https://doi.org/10.17705/1jais.00284
  • Werbach, K., & Hunter, D. (2012). For the win: How game thinking can revolutionize your business (Vol. 1). Wharton Digital Press Philadelphia.
  • Westera, W. (2019). Why and how serious games can become far more effective: Accommodating productive learning experiences, learner motivation and the monitoring of learning gains. Journal of Educational Technology & Society, 22(1), 59–69.
  • Westera, W., Nadolski, R. J., Hummel, H. G., & Wopereis, I. G. (2008). Serious games for higher education: A framework for reducing design complexity. Journal of Computer Assisted Learning, 24(5), 420–432. https://doi.org/10.1111/j.1365-2729.2008.00279.x
  • Wiggins, B. E. (2012). Toward a model for intercultural communication in simulations. Simulation & Gaming, 43(4), 550–572. https://doi.org/10.1177/1046878111414486
  • Winn, B. M. (2009). The design, play, and experience framework. In R. E. Ferdig (Ed.), Handbook of research on effective electronic gaming in education (pp. 1010–1024). IGI Global.
  • Wouters, P., Van der Spek, E. D., & Van Oostendorp, H. (2009). Current practices in serious game research: A review from a learning outcomes perspective. In T. Connolly, M. Stansfield, & L. Boyle (Eds.), Games-based learning advancements for multi-sensory human computer interfaces: Techniques and effective practices (pp. 232–250). IGI Global.
  • Wouters, P., van Nimwegen, C., van Oostendorp, H., & van der Spek, E. D. (2013). A meta-analysis of the cognitive and motivational effects of serious games. Journal of Educational Psychology, 105(2), 249–265. https://doi.org/10.1037/a0031311
  • Wouters, P., & Van Oostendorp, H. (2017). Overview of instructional techniques to facilitate learning and motivation of serious games. In P. Wouters & H. Van Oostendorp (Eds.), Instructional techniques to facilitate learning and motivation of serious games (pp. 1–16). Springer.
  • Yusoff, A., Crowder, R., & Gilbert, L. (2010). Validation of serious games attributes using the technology acceptance model. In K. Debattista, M. Dickey, A. Proença, & L. P. Santos (Eds.), 2010 Second International Conference on Games and Virtual Worlds for Serious Applications, Braga, Portugal.
  • Zhang, Y., Weng, Q., & Zhu, N. (2018). The relationships between electronic banking adoption and its antecedents: A meta-analytic study of the role of national culture. International Journal of Information Management, 40, 76–87. https://doi.org/10.1016/j.ijinfomgt.2018.01.015
  • Zhonggen, Y. (2019). A meta-analysis of use of serious games in education over a decade. International Journal of Computer Games Technology, 2019(1), 1–8. https://doi.org/10.1155/2019/4797032
  • Zhu, Y., & Bargiela-Chiappini, F. (2013). Balancing emic and etic: Situated learning and ethnography of communication in cross-cultural management education. Academy of Management Learning & Education, 12(3), 380–395. https://doi.org/10.5465/amle.2012.0221
  • Zumbach, J., Rammerstorfer, L., & Deibl, I. (2020). Cognitive and metacognitive support in learning with a serious game about demographic change. Computers in Human Behavior, 103, 120–129. https://doi.org/10.1016/j.chb.2019.09.026