Examining the Effectiveness of Gamification in Human Computation

References

• Ahn, T., Ryu, S., & Han, I. (2007). The impact of web quality and playfulness on user acceptance of online retailing. Information & Management, 44 (3), 263–275.
   Web of Science ®Google Scholar
• Ajzen, I., & Fishbein, M. (1977). Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychological Bulletin, 84 (5), 888–918.
   Web of Science ®Google Scholar
• Aljanaki, A., Wiering, F., & Veltkamp, R. C. (2016). Studying emotion induced by music through a crowdsourcing game. Information Processing & Management, 52 (1), 115–128.
   Web of Science ®Google Scholar
• Baranowski, T., Buday, R., Thompson, D. I., & Baranowski, J. (2008). Playing for real: Video games and stories for health-related behavior change. American Journal of Preventive Medicine, 34 (1), 74–82.
   PubMed Web of Science ®Google Scholar
• Bray, J. H., & Maxwell, S. E. (1985). Multivariate analysis of variance. Newbury Park, CA: SAGE Publications.
   Google Scholar
• Brockmyer, J. H., Fox, C. M., Curtiss, K. A., McBroom, E., Burkhart, K. M., & Pidruzny, J. N. (2009). The development of the Game Engagement Questionnaire: A measure of engagement in video game-playing. Journal of Experimental Social Psychology, 45(4), 624–634.
   Web of Science ®Google Scholar
• Cechanowicz, J., Gutwin, C., Brownell, B., & Goodfellow, L. (2013, October). Effects of gamification on participation and data quality in a real-world market research domain. Proceedings of the First International Conference on Gameful Design, Research, and Applications, Toronto, Canada.
   Google Scholar
• Cohen, J. (1992). A power primer. Psychological Bulletin, 112 (1), 155–159.
   PubMed Web of Science ®Google Scholar
• Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012). A systematic literature review of empirical evidence on computer games and serious games. Computers & Education, 59 (2), 661–686.
   Web of Science ®Google Scholar
• Davis, F. D. (1993). User acceptance of information technology: System characteristics, user perceptions and behavioral impacts. International Journal of Man-Machine Studies, 38 (3), 475–487.
   Google Scholar
• Davis, R., & Lang, B. (2012). Modeling game usage, purchase behavior and ease of use. Entertainment Computing, 3 (2), 27–36.
   Google Scholar
• Deci, E. L., & Ryan, R. M. (1985). The general causality orientations scale: Self-determination in personality. Journal of Research in Personality, 19 (2), 109–134.
   Web of Science ®Google Scholar
• DeLone, W. H., & McLean, E. R. (1992). Information systems success: The quest for the dependent variable. Information Systems Research, 3 (1), 60–95.
   Web of Science ®Google Scholar
• De-Marcos, L., Domínguez, A., Saenz-de-Navarrete, J., & Pagés, C. (2014). An empirical study comparing gamification and social networking on e-learning. Computers & Education, 75, 82–91.
   Web of Science ®Google Scholar
• Deterding, S., Canossa, A., Harteveld, C., Cooper, S., Nacke, L. E., & Whitson, J. R. (2015, April). Gamifying research: Strategies, opportunities, challenges, ethics. Proceedings of the CHI’15 Extended Abstracts on Human Factors in Computing Systems, Seoul, Korea.
   Google Scholar
• Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011, September). From game design elements to gamefulness: Defining “gamification”. Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, Tampere, Finland.
   Google Scholar
• Dillon, A., & Morris, M. G. (1996). User acceptance of new information technology: Theories and models. Annual Review of Information Science and Technology, 14 (4), 3–32.
   Google Scholar
• Eagly, A. H., & Chaiken, S. (1993). The psychology of attitudes. Fort Worth, TX: Harcourt Brace Jovanovich.
   Google Scholar
• Geiger, D., & Schader, M. (2014). Personalized task recommendation in crowdsourcing information systems: Current state of the art. Decision Support Systems, 65, 3–16.
   Web of Science ®Google Scholar
• Girard, C., Ecalle, J., & Magnan, A. (2013). Serious games as new educational tools: How effective are they? A meta-analysis of recent studies. Journal of Computer Assisted Learning, 29 (3), 207–219.
   Web of Science ®Google Scholar
• Goh, D. H. L., Ang, R. P., Lee, C. S., & Chua, A. Y. K. (2011). Fight or unite: Investigating game genres for image tagging. Journal of the American Society for Information Science and Technology, 62 (7), 1311–1324.
   Web of Science ®Google Scholar
• Goh, D. H. L., & Lee, C. S. (2011). Perceptions, quality and motivational needs in image tagging human computation games. Journal of Information Science, 37 (5), 515–531.
   Web of Science ®Google Scholar
• Goh, D. H. L., Lee, C. S., & Low, G. (2012). “I played games as there was nothing else to do”: Understanding motivations for using mobile content sharing games. Online Information Review, 36 (6), 784–806.
   Web of Science ®Google Scholar
• Hamari, J. (2015). Do badges increase user activity? A field experiment on the effects of gamification. Computers in Human Behavior, Advance online publication. doi:10.1016/j.chb.2015.03.036
   Web of Science ®Google Scholar
• Hamari, J., Keronen, L., & Alha, K. (2015, January). Why do people play games? A review of studies on adoption and use. Proceedings of the 48th Annual Hawaii International Conference on System Sciences, Kauai, HI.
   Google Scholar
• Hamari, J., & Koivisto, J. (2015). “Working out for likes”: An empirical study on social influence in exercise gamification. Computers in Human Behavior, 50, 333–347.
   Web of Science ®Google Scholar
• Hamari, J., Koivisto, J., & Sarsa, H. (2014, January). Does gamification work? —A literature review of empirical studies on gamification. Proceeding of 47th Hawaii International Conference on System Sciences, Kauai, HI.
   Google Scholar
• Huotari, K., & Hamari, J. (2016). A definition for gamification: Anchoring gamification in the service marketing literature. Electronic Markets, Advance online publication. doi:10.1007/s12525-015-0212-z
   Web of Science ®Google Scholar
• Kim, S. S., & Son, J. Y. (2009). Out of dedication or constraint? A dual model of post-adoption phenomena and its empirical test in the context of online services. MIS Quarterly, 33 (1), 49–70.
   Web of Science ®Google Scholar
• Koivisto, J., & Hamari, J. (2014). Demographic differences in perceived benefits from gamification. Computers in Human Behavior, 35, 179–188.
   Web of Science ®Google Scholar
• Landers, R. N., Bauer, K. N., & Callan, R. C. (2015). Gamification of task performance with leaderboards: A goal setting experiment. Computers in Human Behavior, Advance online publication. doi:10.1016/j.chb.2015.08.008
   Web of Science ®Google Scholar
• Law, E., & Von Ahn, L. (2011). Human computation. Synthesis Lectures on Artificial Intelligence and Machine Learning, 5 (3), 1–121.
   Google Scholar
• Lee, C. S., Goh, D. H. L., Chua, A. Y. K., & Ang, R. P. (2010). Indagator: Investigating perceived gratifications of an application that blends mobile content sharing with gameplay. Journal of the American Society for Information Science and Technology, 61 (6), 1244–1257.
   Web of Science ®Google Scholar
• Lee, M. C., & Tsai, T. R. (2010). What drives people to continue to play online games? An extension of technology model and theory of planned behavior. International Journal of Human–Computer Interaction, 26 (6), 601–620.
   Web of Science ®Google Scholar
• Lee, M. K., Cheung, C. M., & Chen, Z. (2005). Acceptance of Internet-based learning medium: The role of extrinsic and intrinsic motivation. Information & Management, 42 (8), 1095–1104.
   Web of Science ®Google Scholar
• Lee, T. Y., Dugan, C., Geyer, W., Ratchford, T., Rasmussen, J. C., Shami, N. S., & Lupushor, S. (2013, July). Experiments on motivational feedback for crowdsourced workers. Proceedings of the Seventh International Conference on Weblogs and Social Media, Cambridge, MA.
   Google Scholar
• Lewis, J. R. (1995). IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. International Journal of Human–Computer Interaction, 7 (1), 57–78.
   Web of Science ®Google Scholar
• Lewis, J. R. (2002). Psychometric evaluation of the PSSUQ using data from five years of usability studies. International Journal of Human–Computer Interaction, 14 (3–4), 463–488.
   Web of Science ®Google Scholar
• Mekler, E. D., Brühlmann, F., Opwis, K., & Tuch, A. N. (2013). Disassembling gamification: The effects of points and meaning on user motivation and performance. Presented at CHI’13 Extended Abstracts on Human Factors in Computing Systems (pp. 1137–1142), Paris, France
   Google Scholar
• Mollick, E. R., & Rothbard, N. (2014). Mandatory fun: Consent, gamification and the impact of games at work. The Wharton School research paper series. Retrieved from: http://ssrn.com/abstract=2277103.
   Google Scholar
• Morschheuser, B., Hamari, J., Koivisto, J., & Morschheuser, B. (2016, January). Gamification in crowdsourcing: A review. Proceedings of the 49th Annual Hawaii International Conference on System Sciences, Kauai, HI.
   Google Scholar
• Morton, B. G., Speck, J. A., Schmidt, E. M., & Kim, Y. E. (2010, July). Improving music emotion labeling using human computation. Proceedings of the ACM SIGKDD Workshop on Human Computation, Washington, DC.
   Google Scholar
• Nabi, R. L., & Krcmar, M. (2004). Conceptualizing media enjoyment as attitude: Implications for mass media effects research. Communication Theory, 14 (4), 288–310.
   Web of Science ®Google Scholar
• O’Brien, H. L., & Toms, E. G. (2013). Examining the generalizability of the User Engagement Scale (UES) in exploratory search. Information Processing & Management, 49 (5), 1092–1107.
   Web of Science ®Google Scholar
• Oh, J. C., & Yoon, S. J. (2014). Predicting the use of online information services based on a modified UTAUT model. Behaviour & Information Technology, 33 (7), 716–729.
   Web of Science ®Google Scholar
• Pe-Than, E. P. P., Goh, D. H. L., & Lee, C. S. (2013). A typology of human computation games: An analysis and a review of current games. Behaviour & Information Technology, 34 (8), 809–824.
   Web of Science ®Google Scholar
• Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006). The motivational pull of video games: A self-determination theory approach. Motivation and Emotion, 30 (4), 344–360.
   Web of Science ®Google Scholar
• Šimko, J., Tvarožek, M., & Bieliková, M. (2013). Human computation: Image metadata acquisition based on a single-player annotation game. International Journal of Human–Computer Studies, 71 (10), 933–945.
   Web of Science ®Google Scholar
• Sonderegger, A., & Sauer, J. (2010). The influence of design aesthetics in usability testing: Effects on user performance and perceived usability. Applied Ergonomics, 41 (3), 403–410.
   PubMed Web of Science ®Google Scholar
• Sweetser, P., & Wyeth, P. (2005). GameFlow: A model for evaluating player enjoyment in games. Computers in Entertainment, 3, 3. doi:10.1145/1077246.1077253
   Google Scholar
• Turner, M., Kitchenham, B., Brereton, P., Charters, S., & Budgen, D. (2010). Does the technology acceptance model predict actual use? A systematic literature review. Information and Software Technology, 52 (5), 463–479.
   Web of Science ®Google Scholar
• Vasilescu, B., Serebrenik, A., Devanbu, P., & Filkov, V. (2014, February). How social Q&A sites are changing knowledge sharing in open source software communities. Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing, Baltimore, MD.
   Google Scholar
• Von Ahn, L., & Dabbish, L. (2008). Designing games with a purpose. Communications of the ACM, 51 (8), 58–67.
   Web of Science ®Google Scholar
• Wang, X., Goh, D. H. L., Lim, E. P., & Vu, A. W. L. (2016). Understanding the determinants of human computation game acceptance: The effects of aesthetic experience and output quality. Online Information Review, 40 (4), 481–496.
   Web of Science ®Google Scholar
• Wiebe, E. N., Lamb, A., Hardy, M., & Sharek, D. (2014). Measuring engagement in video game-based environments: Investigation of the User Engagement Scale. Computers in Human Behavior, 32, 123–132.
   Web of Science ®Google Scholar
• Yuen, M. C., Chen, L. J., & King, I. (2009, August). A survey of human computation systems. Proceedings of the 2009 International Conference on Computational Science and Engineering, Vancouver, British Columbia, Canada.
   Google Scholar