Exploring Intuitive Visuo-Tactile Interaction Design for Culture Education: A Chinese-Chess-Based Case Study

References

• Agner, L., Renzi, A. B., Viegas, N., Buares, P., & Zanfagnini, V. (2015, July 21). Evaluating interaction design in Brazilian tablet journalism: Gestural interfaces and affordance communicability. In Design, user experience, and usability: Users and interactions (pp. 393–402). Springer International Publishing. https://doi.org/10.1007/978-3-319-20898-5_38
   Google Scholar
• Alloqmani, A., Alsaedi, O., Bahatheg, N., Alnanih, R., & Elrefaei, L. (2022). Design principles-based interactive learning tool for solving nonlinear equations. Computer Systems Science and Engineering, 40(3), 1023–1042. https://doi.org/10.32604/csse.2022.019704
   Web of Science ®Google Scholar
• Alnanih, R., & Ormandjieva, O. (2016). Mapping HCI principles to design quality of mobile user interfaces in healthcare applications. Procedia Computer Science, 94, 75–82. https://doi.org/10.1016/j.procs.2016.08.014
   Google Scholar
• Bai, W., Cao, Y., & Dong, J. (2021). Research on the application of low-polygon design to Chinese chess: Take the Chinese chess “knight” as an example. In 2021 The 3rd World Symposium on Software Engineering (pp. 199–204). Association for Computing Machinery. https://doi.org/10.1145/3488838.3488872
   Google Scholar
• Barboza, E. J. S., & da Silva, M. T. (2016, September 3–7). The importance of timely feedback to interactivity in online education. In IFIP Advances in Information and Communication Technology. IFIP Working Group 5.7 International Conference on Advances in Production Management Systems (APMS), Brazil (pp. 307–314). https://doi.org/10.1007/978-3-319-51133-7_37
   Google Scholar
• Bikos, M., Itoh, Y., Klinker, G., & Moustakas, K. (2015, October 7–9). An interactive augmented reality chess game using bare-hand pinch gestures. In 2015 International Conference on Cyberworlds (CW) (pp. 355–358). https://doi.org/10.1109/CW.2015.15
   Google Scholar
• Bimber, O., & Raskar, R. (2005). Spatial augmented reality: Merging real and virtual worlds. CRC Press.
   Google Scholar
• Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
   Google Scholar
• Caporusso, N., Mkrtchyan, L., & Badia, L. (2010). A multimodal interface device for online board games designed for sight-impaired people. IEEE Transactions on Information Technology in Biomedicine, 14(2), 248–254. https://doi.org/10.1109/TITB.2009.2034739
   PubMedGoogle Scholar
• Carbini, S., Delphin-Poulat, L., Perron, L., & Viallet, J. E. (2006). From a wizard of Oz experiment to a real time speech and gesture multimodal interface. Signal Processing, 86(12), 3559–3577. https://doi.org/10.1016/j.sigpro.2006.04.001
   Web of Science ®Google Scholar
• Chen, J. C., Tseng, W. J., Wu, I. C., & Wei, T. H. (2020). Comparison training for computer Chinese chess. IEEE Transactions on Games, 12(2), 169–176. https://doi.org/10.1109/TG.2019.2893430
   Web of Science ®Google Scholar
• Chen, X., Twomey, K. E., & Westermann, G. (2022). Curiosity enhances incidental object encoding in 8-month-old infants. Journal of Experimental Child Psychology, 223, 105508. https://doi.org/10.1016/j.jecp.2022.105508
   PubMed Web of Science ®Google Scholar
• Chen, Y. (2019). Exploring design guidelines of using user-centered design in gamification development: A Delphi study. International Journal of Human–Computer Interaction, 35(13), 1170–1181. https://doi.org/10.1080/10447318.2018.1514823
   Web of Science ®Google Scholar
• Chin, K.-Y., Kao, Y.-C., & Wang, C.-S. (2020). Effects of augmented reality technology in a mobile touring system on university students’ learning performance and interest. Australasian Journal of Educational Technology, 37(1), 27–42. https://doi.org/10.14742/ajet.5841
   Web of Science ®Google Scholar
• Doe-Hyung, L., & Kwang-Seok, H. (2010, November 30–December 2). Game interface using hand gesture recognition. In 5th International Conference on Computer Sciences and Convergence Information Technology (pp. 1092–1097). https://doi.org/10.1109/ICCIT.2010.5711226
   Google Scholar
• Dong, Q., & Miao, R. (2020). A comparative study of chess online educational products. In Blended learning. Education in a smart learning environment (pp. 101–113). Springer International Publishing.
   Google Scholar
• Dorfmuller-Ulhaas, K., & Schmalstieg, D. (2001, October 29–30). Finger tracking for interaction in augmented environments. In Proceedings of IEEE and ACM International Symposium on Augmented Reality (pp. 55–64). https://doi.org/10.1109/ISAR.2001.970515
   Google Scholar
• Duan, X. Y., Kang, S. J., Choi, J. I., & Kim, S. K. (2020). Mixed reality system for virtual chemistry lab. KSII Transactions on Internet and Information Systems, 14(4), 1673–1688. https://doi.org/10.3837/tiis.2020.04.014
   Web of Science ®Google Scholar
• Ejaz, A., Syed, D., Yasir, M., & Farhan, D. (2019). Graphic user interface design principles for designing augmented reality applications. International Journal of Advanced Computer Science and Applications, 10(2), 209–216. https://doi.org/10.14569/IJACSA.2019.0100228
   Web of Science ®Google Scholar
• Eppmann, R., Bekk, M., & Klein, K. (2018). Gameful experience in gamification: Construction and validation of a Gameful Experience Scale [GAMEX]. Journal of Interactive Marketing, 43(1), 98–115. https://doi.org/10.1016/j.intmar.2018.03.002
   Google Scholar
• Epps, J., Lichman, S., & Wu, M. (2006, April). A study of hand shape use in tabletop gesture interaction. In CHI'06 Extended Abstracts on Human Factors in Computing Systems (pp. 748–753). https://doi.org/10.1145/1125451.1125601
   Google Scholar
• Feng, Z., Yang, B., Liu, H., Lv, N., Yang, X., Yin, J., Zhang, Y., & Zhao, X. (2016). An HCI paradigm fusing flexible object selection and AOM-based animation. Information Sciences, 369, 368–387. https://doi.org/10.1016/j.ins.2016.06.052
   Web of Science ®Google Scholar
• Fleck, S., & Hachet, M. (2016). Making tangible the intangible: Hybridization of the real and the virtual to enhance learning of abstract phenomena. Frontiers in ICT, 3, 1–13. https://doi.org/10.3389/fict.2016.00030
   Google Scholar
• Floryan, M., Chow, P. I., Schueller, S. M., & Ritterband, L. M. (2020). The model of gamification principles for digital health interventions: Evaluation of validity and potential utility. Journal of Medical Internet Research, 22(6), e16506. https://doi.org/10.2196/16506
   PubMed Web of Science ®Google Scholar
• Gao, L., Wan, B., Liu, G., Xie, G., Huang, J., & Meng, G. (2021). Investigating the effectiveness of virtual reality for culture learning. International Journal of Human–Computer Interaction, 37(18), 1771–1781. https://doi.org/10.1080/10447318.2021.1913858
   Web of Science ®Google Scholar
• Garrido-Jurado, S., Muñoz-Salinas, R., Madrid-Cuevas, F. J., & Marín-Jiménez, M. J. (2014). Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition, 47(6), 2280–2292. https://doi.org/10.1016/j.patcog.2014.01.005
   Web of Science ®Google Scholar
• Gibbs, G., & Simpson, C. (2005). Conditions under which assessment supports students’ learning. Learning and Teaching in Higher Education, (1), 3–31.
   Google Scholar
• Gibson, J. J. (2014). The theory of affordances. In J. J. Gieseking, W. Mangold, C. Katz, S. Low, & S. Saegert (Eds.), The people, place, and space reader (pp. 90–94). Routledge.
   Google Scholar
• Green-Demers, I., Pelletier, L. G., Stewart, D. G., & Gushue, N. R. (1998). Coping with the less interesting aspects of training: Toward a model of interest and motivation enhancement in individual sports. Basic and Applied Social Psychology, 20(4), 251–261. https://doi.org/10.1207/s15324834basp2004_2
   Web of Science ®Google Scholar
• Günther, S., Müller, F., Schmitz, M., Riemann, J., Dezfuli, N., Funk, M., Schön, D., & Mühlhäuser, M. (2018, April). CheckMate: Exploring a tangible augmented reality interface for remote interaction. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–6). https://doi.org/10.1145/3170427.3188647
   Google Scholar
• Halamish, V., Madmon, I., & Moed, A. J. E. P. (2019). Motivation to learn: The long-term mnemonic benefit of curiosity in intentional learning. Experimental Psychology, 66(5), 319. https://doi.org/10.1027/1618-3169/a000455
   Google Scholar
• Hartson, R. (2003). Cognitive, physical, sensory, and functional affordances in interaction design. Behaviour & Information Technology, 22(5), 315–338. https://doi.org/10.1080/01449290310001592587
   Web of Science ®Google Scholar
• Högberg, J., Hamari, J., & Wästlund, E. (2019). Gameful Experience Questionnaire (GAMEFULQUEST): An instrument for measuring the perceived gamefulness of system use. User Modeling and User-Adapted Interaction, 29(3), 619–660. https://doi.org/10.1007/s11257-019-09223-w
   Web of Science ®Google Scholar
• Hostetter, A. B., Murch, S. H., Rothschild, L., & Gillard, C. S. (2018). Does seeing gesture lighten or increase the load?: Effects of processing gesture on verbal and visuospatial cognitive load. Gesture, 17(2), 268–290. https://doi.org/10.1075/gest.17017.hos
   Web of Science ®Google Scholar
• Huang, H.-M., Rauch, U., & Liaw, S.-S. (2010). Investigating learners’ attitudes toward virtual reality learning environments: Based on a constructivist approach. Computers & Education, 55(3), 1171–1182. https://doi.org/10.1016/j.compedu.2010.05.014
   Web of Science ®Google Scholar
• Hung, C. Y., Lin, Y. R., Huang, K. Y., Yu, P. T., & Sun, J. C. Y. (2017). Collaborative game-based learning with motion-sensing technology: Analyzing students’ motivation, attention, and relaxation levels. International Journal of Online Pedagogy and Course Design, 7(4), 53–64. https://doi.org/10.4018/IJOPCD.2017100104
   Google Scholar
• Ijaz, K., Ahmadpour, N., Wang, Y., & Calvo, R. A. (2020). Player experience of needs satisfaction (PENS) in an immersive virtual reality exercise platform describes motivation and enjoyment. International Journal of Human–Computer Interaction, 36(13), 1195–1204. https://doi.org/10.1080/10447318.2020.1726107
   Web of Science ®Google Scholar
• IJsselsteijn, W., De Kort, Y., Poels, K., Jurgelionis, A., & Bellotti, F. (2007). Characterising and measuring user experiences in digital games. In International Conference on Advances in Computer Entertainment Technology (p. 27).
   Google Scholar
• Jin, S., Fan, M., & Kadir, A. (2022). Immersive spring morning in the Han palace: Learning traditional Chinese art via virtual reality and multi-touch tabletop. International Journal of Human–Computer Interaction, 38(3), 213–226. https://doi.org/10.1080/10447318.2021.1930389
   Web of Science ®Google Scholar
• Juliano, J. M., Schweighofer, N., & Liew, S.-L. (2022). Increased cognitive load in immersive virtual reality during visuomotor adaptation is associated with decreased long-term retention and context transfer. Journal of NeuroEngineering and Rehabilitation, 19(1), 106. https://doi.org/10.1186/s12984-022-01084-6
   PubMed Web of Science ®Google Scholar
• Juul, J., & Norton, M. (2009). Easy to use and incredibly difficult: On the mythical border between interface and gameplay. In Proceedings of the 4th International Conference on Foundations of Digital Games (pp. 107–112).
   Google Scholar
• Kapoor, K. K., Tamilmani, K., Rana, N. P., Patil, P., Dwivedi, Y. K., & Nerur, S. (2018). Advances in social media research: Past, present and future. Information Systems Frontiers, 20(3), 531–558. https://doi.org/10.1007/s10796-017-9810-y
   Web of Science ®Google Scholar
• Kassuba, T., Klinge, C., Hölig, C., Röder, B., & Siebner, H. R. (2013). Vision holds a greater share in visuo-haptic object recognition than touch. NeuroImage, 65, 59–68. https://doi.org/10.1016/j.neuroimage.2012.09.054
   PubMed Web of Science ®Google Scholar
• Keebler, J. R., Shelstad, W. J., Smith, D. C., Chaparro, B. S., & Phan, M. H. (2020). Validation of the GUESS-18: A short version of the Game User Experience Satisfaction Scale (GUESS). Journal of Usability Studies, 16(1), 49–62.
   Web of Science ®Google Scholar
• Kim, L., Cho, H. C., Park, S., & Han, M. C. (2007, July 22–27). A tangible user interface with multimodal feedback. In Lecture Notes in Computer Science. 12th International Conference on Human–Computer Interaction (HCI International 2007) (p. 94).
   Google Scholar
• Kulikov, V. (2020). Preferential engagement and what can we learn from online chess? Minds and Machines, 30(4), 617–636. https://doi.org/10.1007/s11023-020-09550-7
   Web of Science ®Google Scholar
• Künn, S., Seel, C., & Zegners, D. (2022). Cognitive performance in remote work: Evidence from professional chess. The Economic Journal, 132(643), 1218–1232. https://doi.org/10.1093/ej/ueab094
   Web of Science ®Google Scholar
• Laine, T. H., & Lindberg, R. S. N. (2020). Designing engaging games for education: A systematic literature review on game motivators and design principles. IEEE Transactions on Learning Technologies, 13(4), 804–821. https://doi.org/10.1109/TLT.2020.3018503
   Web of Science ®Google Scholar
• Larsson, A., Ekblad, J., Alvarez, A., & Font, J. (2020). A comparative UX analysis between tabletop games and their digital counterparts. In Extended Abstracts of the 2020 Annual Symposium on Computer–Human Interaction in Play (pp. 301–305). https://doi.org/10.1145/3383668.3419899
   Google Scholar
• Likert, R. (1932). A technique for the measurement of attitudes. Archives of Psychology, 22(140), 1–55.
   Google Scholar
• Lin, J., Harris-Adamson, C., & Rempel, D. (2019). The design of hand gestures for selecting virtual objects. International Journal of Human–Computer Interaction, 35(18), 1729–1735. https://doi.org/10.1080/10447318.2019.1571783
   Web of Science ®Google Scholar
• Liu, S., Wang, H., Wei, Y., & Pan, C. (2015). BB-homography: Joint binary features and bipartite graph matching for homography estimation. IEEE Transactions on Circuits and Systems for Video Technology, 25(2), 239–250. https://doi.org/10.1109/TCSVT.2014.2339591
   Web of Science ®Google Scholar
• Mack, N. A., Rembert, D. G. M., Cummings, R., & Gilbert, J. E. (2019). Co-designing an intelligent conversational history tutor with children. In Proceedings of the 18th ACM International Conference on Interaction Design and Children (pp. 482–487). https://doi.org/10.1145/3311927.3325336
   Google Scholar
• McCarthy, J. (2016). Global learning partnerships in the Café: Peer feedback as a formative assessment tool for animation students. Interactive Learning Environments, 24(6), 1298–1318. https://doi.org/10.1080/10494820.2014.994532
   Web of Science ®Google Scholar
• Mory, E. H. (2013). Feedback research revisited. In D. H. Jonassen (Ed.), Handbook of research on educational communications and technology (2nd ed., pp. 738–776). Routledge.
   Google Scholar
• Norman, D. A. (1988). The psychology of everyday things. Basic Books.
   Google Scholar
• Norman, D. A. (1999). Affordance, conventions, and design. Interactions, 6(3), 38–43. https://doi.org/10.1145/301153.301168
   Google Scholar
• Okoye, J. N. (2020). Universal design & usability investigation into flat design and skeuomorphic interfaces: Case study of a news website [Master’s thesis, OsloMet-storbyuniversitetet]. Institutt for informasjonsteknologi. https://oda.oslomet.no/oda-xmlui/bitstream/handle/10642/9253/okoye_mauu2020.pdf
   Google Scholar
• Ötting, S. K., Masjutin, L., Steil, J. J., & Maier, G. W. (2022). Let’s work together: A meta-analysis on robot design features that enable successful human–robot interaction at work. Human Factors, 64(6), 1027–1050. https://doi.org/10.1177/0018720820966433
   PubMed Web of Science ®Google Scholar
• Panchaphongsaphak, B., & Riener, R. (2007, March 10–11). Tokens and board user interface based on a force-torque sensing technique. In 2007 IEEE Symposium on 3D User Interfaces (p. 1). https://doi.org/10.1109/3DUI.2007.340787
   Google Scholar
• Pereira, A., Martinho, C., Leite, I., & Paiva, A. (2008). iCat, the chess player: The influence of embodiment in the enjoyment of a game. In Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems (Vol. 3, pp. 1253–1256).
   Google Scholar
• Preece, J., Rogers, Y., & Sharp, H. (2015). Interaction design: Beyond human–computer interaction (4th ed.). Wiley.
   Google Scholar
• Ramadan, M. Z. (2017). The effects of industrial protective gloves and hand skin temperatures on hand grip strength and discomfort rating. International Journal of Environmental Research and Public Health, 14(12), 1506. https://doi.org/10.3390/ijerph14121506
   PubMed Web of Science ®Google Scholar
• Rayar, F., Boas, D., & Patrizio, R. (2015). ART-chess: A tangible augmented reality chess on tabletop. In Proceedings of The 2015 International Conference on Interactive Tabletops & Surfaces (pp. 229–233). https://doi.org/10.1145/2817721.2823485
   Google Scholar
• Reul, F. M. H. J. T. U. (2009). New architectures in computer chess.
   Google Scholar
• Salami, A., Ghassemi, F., & Moradi, M. H. (2017, November 30–December 1). A criterion to evaluate feature vectors based on ANOVA statistical analysis. In 24th National Iranian Conference on Biomedical Engineering/2nd International Iranian Conference on Biomedical Engineering (ICBME) (pp. 67–71). IEEE.
   Google Scholar
• Shin, J., & Yoon, J. (2019). Interaction design and information processor of users: A study on information entropy and the human processor model in interaction design. Journal of Basic Design & Art, 20(4), 247–261. https://doi.org/10.47294/KSBDA.20.4.18
   Google Scholar
• Singh, A., & Manjaly, J. A. (2022). Using curiosity to improve learning outcomes in schools. SAGE Open, 12(1), 21582440211069392. https://doi.org/10.1177/21582440211069392
   Web of Science ®Google Scholar
• Sloan, S. (1989). Chinese chess for beginners. Ishi Press International.
   Google Scholar
• Sriboonruang, Y., Kumhom, P., & Chamnongthai, K. (2006, June 28–July 1). Visual hand gesture interface for computer board game control. In 2006 IEEE International Symposium on Consumer Electronics (pp. 1–5). https://doi.org/10.1109/ISCE.2006.1689527
   Google Scholar
• Sung-Euk, P. (2012, December 16–19). Research of color affordance concept and applying to design. In Communications in Computer and Information Science. Conference on Education and Learning/Int Conf on Database Theory and Application/Int Conf on u-Service and e-Service, Science and Technology (pp. 283–288).
   Google Scholar
• Tan, S. N., & Ng, K. H. (2022). Gamified mobile sensing storytelling application for enhancing remote cultural experience and engagement. International Journal of Human–Computer Interaction. Advance online publication. https://doi.org/10.1080/10447318.2022.2144121
   Web of Science ®Google Scholar
• Ullmer, B., & Ishii, H. (2000). Emerging frameworks for tangible user interfaces. IBM Systems Journal, 39(3.4), 915–931. https://doi.org/10.1147/sj.393.0915
   Google Scholar
• Westfall, J. (Ed.). (2011). Using your phone with Xbox LIVE. In Windows phone 7 made simple (pp. 383–393). Apress. https://doi.org/10.1007/978-1-4302-3313-8_26
   Google Scholar
• Wong, C. W., Tsai, A., Jonas, J. B., Ohno-Matsui, K., Chen, J., Ang, M., & Ting, D. S. W. (2021). Digital screen time during the COVID-19 pandemic: Risk for a further myopia boom? American Journal of Ophthalmology, 223, 333–337. https://doi.org/10.1016/j.ajo.2020.07.034
   PubMed Web of Science ®Google Scholar
• Wu, Y., Cui, T., Liu, N., Deng, Y., & Guo, J. (2018). Demystifying continuous participation in game applications at social networking sites. Internet Research, 28(2), 374–392. https://doi.org/10.1108/IntR-11-2016-0347
   Web of Science ®Google Scholar
• Xianghua, L., & Kwang-Seok, H. (2012, April 24–26). Korean chess game implementation by hand gesture recognition using stereo camera. In 2012 8th International Conference on Computing Technology and Information Management (NCM and ICNIT) (pp. 741–744).
   Google Scholar
• Yan, H., Ling, Y., Zhang, Q., & Fan, L. (2015, August 26–27). Unified gesture interaction method in multi-devices space. In 2015 7th International Conference on Intelligent Human-Machine Systems and Cybernetics (pp. 529–532). https://doi.org/10.1109/IHMSC.2015.88
   Google Scholar
• Yanaka, K., & Ishiguro, D. (2015). Natural user interface for board games using lenticular display and leap motion. In HCI International 2015 – Posters’ extended abstracts (pp. 552–557), Springer International Publishing. https://doi.org/10.1007/978-3-319-21380-4_94
   Google Scholar
• Yusof, C. S., Low, T. S., Ismail, A. W., & Sunar, M. S. (2019, November 19–21). Collaborative augmented reality for chess game in handheld devices. In 2019 IEEE Conference on Graphics and Media (GAME) (pp. 32–37). https://doi.org/10.1109/GAME47560.2019.8980979
   Google Scholar
• Zhao, K., Gao, L., Pi, R., Xu, X., Sun, S., & Li, G. (2020). IWannaPlay-an eye-tracking based AI tutoring Chinese chess system. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems (pp. 699–700).
   Google Scholar
• Zu, R. Z., & Hao, W. D. (2021). Color collocation of creative products considering personality psychology. Psychiatria Danubina, 33(Suppl. 6), S417–S422.
   Web of Science ®Google Scholar