SpaceMaze: incentivizing correct mobile crowdsourced sensing behaviour with a sensified minigame

References

• Andrew Sheppard, S, and Loren Terveen. 2011. “Quality is a Verb: The Operationalization of Data Quality in a Citizen Science Community.” In Proceedings of the 7th International Symposium on Wikis and Open Collaboration (WikiSym'11), 29–38, Mountain View California, USA. ACM.
   Google Scholar
• Antonio Muratori, Ludovico, Paola Salomoni, and Giovanni Pau. “Feeling the Pack: Strategies for an Optimal Participatory System to Sense and Recognize Noise Pollution.” In 2011 IEEE International Conference on Consumer Electronics, 17–21. Berlin: ICCE.
   Google Scholar
• Björk, Staffan. 2016. Gameplay design pattern collection, 2009. http://www.gameplaydesignpatterns.org/. Accessed May 4.
   Google Scholar
• Björk, Staffan, and Jussi Holopainen. 2004. Patterns in Game Design. Boston, MA: Charles River Media.
   Google Scholar
• Björk, Staffan, Sus Lundgren, and Jussi Holopainen. 2003. “Game Design Patterns.” In Proceedings of the 2003 DiGRA International Conference: Level Up (DIGRA '03), Utrecht, The Netherlands, 180–193. Wordware Publishing, ISSN 2342-9666.
   Google Scholar
• Bowser, Anne, Derek Hansen, Yurong He Carol Boston, Matthew Reid, Logan Gunnell, and Jennifer Preece. 2013. “Using Gamification to Inspire New Citizen Science Volunteers.” In Proceedings of the First International Conference on Gameful Design, Research, and Applications, 18–25, Toronto, Ontario, Canada, ACM.
   Google Scholar
• Brooke, John. 1996. “SUS – A Quick and Dirty Usability Scale.” Usability Evaluation in Industry 189 (194): 4–7.
   Google Scholar
• Budde, Matthias. Distributed, Low-Cost, Non-Expert Fine Dust Sensing with Smartphones. Doctoral diss., Karlsruhe Institute of Technology (KIT), January. https://doi.org/https://doi.org/10.5445/IR/1000092736.
   Google Scholar
• Budde, Matthias, Marcel Köpke, and Michael Beigl. 2015. “Robust In-situ Data Reconstruction from Poisson Noise for Low-cost, Mobile, Non-expert Environmental Sensing.” In 19th International Symposium on Wearable Computers (ISWC'15), Osaka, Japan. ACM. doi:https://doi.org/10.1145/2802083.2808406.
   Google Scholar
• Budde, Matthias, Rikard Öxler, Michael Beigl, and Jussi Holopainen. 2016. “Sensified Gaming – Design Patterns and Game Design Elements for Gameful Environmental Sensing.” In 13th International Conference on Advances in Computer Entertainment Technology (ACE2016), Osaka, Japan. ACM. doi:https://doi.org/10.1145/3001773.3001832.
   Google Scholar
• Budde, Matthias, Till Riedel, Michael Beigl, Klaus Schäfer, Stefan Emeis, Josef Cyrys, Jürgen Schnelle-Kreis, Andreas Philipp, Volker Ziegler, and Hans Grimm. 2017b. “SmartAQnet: Remote and In-Situ Sensing of Urban Air Quality.” In Proc. SPIE 10424, Remote Sensing of Clouds and the Atmosphere XXII, Warsaw, Poland, 104240C. SPIE.
   Google Scholar
• Budde, Matthias, Andrea Schankin, Julien Hoffmann, Marcel Danz, Till Riedel, and Michael Beigl. 2017. “Participatory Sensing Or Participatory Nonsense? – Mitigating the Effect of Human Error on Data Quality in Citizen Science.” Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 1 (3). doi:https://doi.org/10.1145/3131900
   Google Scholar
• Burke, Jeffrey A, Deborah Estrin, Mark Hansen, Andrew Parker, Nithya Ramanathan, Sasank Reddy, and Mani B Srivastava. 2006. Participatory sensing. Center for Embedded Network Sensing.
   Google Scholar
• Cohen, Jacob. 1988. Statistical Power Analysis for the Behavioral Sciences. Hillsdale: Erlbaum.
   Google Scholar
• Crowston, Kevin, and Nathan R Prestopnik. 2013. “Motivation and Data Quality in a Citizen Science Game: A Design Science Evaluation.” In System Sciences (HICSS), 2013 46th Hawaii International Conference on, Maui, Hawaii, USA, 450–459. IEEE
   Google Scholar
• Deterding, Sebastian, Dan Dixon, Rilla Khaled, and Lennart Nacke. 2011. “From Game Design Elements to Gamefulness: Defining ‘Gamification’.” In Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, Tampere, Finland, 9–15. ACM.
   Google Scholar
• Flatla, David R, Carl Gutwin, Lennart E Nacke, Scott Bateman, and Regan L Mandryk. 2011. “Calibration Games: Making Calibration Tasks Enjoyable by Adding Motivating Game Elements.” In Proceedings of the 24th annual ACM symposium on User interface software and technology, Santa Barbara, California, USA, 403–412. ACM
   Google Scholar
• Gibb, Steven K. 2015. “Volunteers Against Pollution.” Chemical & Engineering News (C&EN) 93 (36): 9–1.
   Web of Science ®Google Scholar
• Han, Kyungsik, Eric A Graham, Dylan Vassallo, and Deborah Estrin. 2011. “Enhancing Motivation in a Mobile Participatory Sensing Project Through Gaming.” In Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third International Conference on Social Computing (SocialCom), 2011 IEEE Third International Conference on, Boston, Massachusetts, USA, 1443–1448. IEEE
   Google Scholar
• Harding, Mike, Bran Knowles, Nigel Davies, and Mark Rouncefield. 2015. “Hci, Civic Engagement & Trust.” In 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI '15, 2833–2842, New York, NY, USA: ACM. ISBN 978-1-4503-3145-6.
   Google Scholar
• Iacovides, Ioanna, Charlene Jennett, Cassandra Cornish-Trestrail, and Anna L Cox. 2013. “Do Games Attract or Sustain Engagement in Citizen Science? A Study of Volunteer Motivations.” In CHI'13 Extended Abstracts on Human Factors in Computing Systems, Paris, France, 1101–1106. ACM
   Google Scholar
• Kanjo, Eiman. 2010. “Noisespy: A Real-time Mobile Phone Platform for Urban Noise Monitoring and Mapping.” Mobile Networks and Applications 15 (4): 562–574. doi: https://doi.org/10.1007/s11036-009-0217-y
   Web of Science ®Google Scholar
• Kayali, Fares, Naemi Luckner, Peter Purgathofer, Katta Spiel, and Geraldine Fitzpatrick. 2018. “Design Considerations Towards Long-Term Engagement in Games for Health.” In Proceedings of the 13th International Conference on the Foundations of Digital Games, Malmö, Sweden, 1–8. ACM.
   Google Scholar
• Kumar, Janaki. 2013. Gamification At Work: Designing Engaging Business Software. In International conference of design, user experience, and usability., 528–537. Las Vegas, Nevada, USA: Springer.
   Google Scholar
• Kumar Rana, Rajib, Chun Tung Chou, Salil S Kanhere, Nirupama Bulusu, and Wen Hu. 2010. “Ear-Phone: An End-to-End Participatory Urban Noise Mapping System.” In 9th ACM/IEEE International Conference on Information Processing in Sensor Networks, Stockholm, Sweden, 105–116. ACM.
   Google Scholar
• Lafourcade, Mathieu, Alain Joubert, and Nathalie Le Brun. 2015. Games with a Purpose (GWAPS). John Wiley & Sons.
   Google Scholar
• Laugwitz, Bettina, Theo Held, and Martin Schrepp. 2008. “Construction and Evaluation of a User Experience Questionnaire.” In Symposium of the Austrian HCI and Usability Engineering Group, Graz, Austria, 63–76. Springer.
   Google Scholar
• Maisonneuve, Nicolas, Matthias Stevens, and Bartek Ochab. 2010. “Participatory Noise Pollution Monitoring Using Mobile Phones.” Information Polity 15: 51–71. doi:https://doi.org/10.3233/IP-2010-0200
   Google Scholar
• Mass, Clifford F, and Luke E Madaus. 2014. “Surface Pressure Observations From Smartphones: A Potential Revolution for High-resolution Weather Prediction?.” Bulletin of the American Meteorological Society 95 (9): 1343–1349. doi: https://doi.org/10.1175/BAMS-D-13-00188.1
   Web of Science ®Google Scholar
• Matyas, Sebastian, Peter Kiefer, Christoph Schlieder, and Sara Kleyer. 2011. “Wisdom about the Crowd: Assuring Geospatial Data Quality Collected in Location-Based Games.” In International Conference on Entertainment Computing (ICEC 2011), Vancouver, Canada, 331–336, Springer.
   Google Scholar
• Mekler, Elisa D, Florian Brühlmann, Klaus Opwis, and Alexandre N Tuch. 2013. “Do Points, Levels and Leaderboards Harm Intrinsic Motivation?: An Empirical Analysis of Common Gamification Elements.” In Proceedings of the First International Conference on gameful design, research, and applications, Toronto, Ontario, Canada, 66–73. ACM
   Google Scholar
• Montola, Markus, Annika Waern, Jussi Kuittinen, and Jaakko Stenros. 2006. IPerG – Integrated Project on Pervasive Gaming, Work Package WP5: Design and Evaluation Deliverable D5.5: Ethics of Pervasive Gaming. Public project report. Release date: October 13, 2006.
   Google Scholar
• Morschheuser, Benedikt, Juho Hamari, Jonna Koivisto, and Alexander Maedche. 2017. “Gamified Crowdsourcing: Conceptualization, Literature Review, and Future Agenda.” International Journal of Human-Computer Studies 106: 26–43. doi: https://doi.org/10.1016/j.ijhcs.2017.04.005
   Web of Science ®Google Scholar
• Norman, Donald A. April 1983. “Design Rules Based on Analyses of Human Error.” Communications of the ACM 26 (4): 254–258. ISSN 0001–0782. doi: https://doi.org/10.1145/2163.358092
   Web of Science ®Google Scholar
• Prestopnik, Nathan, Kevin Crowston, and Jun Wang. 2014. Exploring Data Quality in Games with a Purpose. iConference 2014 Proceedings.
   Google Scholar
• Restuccia, Francesco, Sajal K Das, and Jamie Payton. 2016. “Incentive Mechanisms for Participatory Sensing: Survey and Research Challenges.” ACM Transactions on Sensor Networks (TOSN) 12 (2): 1–40. doi: https://doi.org/10.1145/2888398
   Web of Science ®Google Scholar
• Schweizer, Immanuel, Roman Bärtl, Axel Schulz, Florian Probst, and Max Mühläuser. 2011. “Noisemap – Real-Time Participatory Noise Maps.” In Proceedings of Second International Workshop on Sensing Applications on Mobile Phones (PhoneSense 11), Seattle, Washington, USA, 1-5. ACM
   Google Scholar
• See, Linda, Alexis Comber, Carl Salk, Steffen Fritz, Marijn van der Velde, Christoph Perger, Christian Schill, Ian McCallum, Florian Kraxner, and Michael Obersteiner. 2013. “Comparing the Quality of Crowdsourced Data Contributed by Expert and Non-experts.” PloS One 8 (7). doi: https://doi.org/10.1371/journal.pone.0069958
   Web of Science ®Google Scholar
• Simperl, Elena, Neal Reeves, Chris Phethean, Todd Lynes, and Ramine Tinati. June 2018. “Is Virtual Citizen Science a Game?.” Transactions on Social Computing 1 (2): 61–639. ISSN 2469-7818. http://doi.acm.org/https://doi.org/10.1145/3209960.
   Google Scholar
• Snik, Frans, Jeroen H. H. Rietjens, Arnoud Apituley, Hester Volten, Bas Mijling, Antonio Di Noia, Stephanie Heikamp, Ritse C Heinsbroek, Otto P Hasekamp, and J Martijn Smit, et al. 2014. “Mapping Atmospheric Aerosols with a Citizen Science Network of Smartphone Spectropolarimeters.” Geophysical Research Letters 41 (20): 7351–7358. doi: https://doi.org/10.1002/2014GL061462
   Web of Science ®Google Scholar
• Tuite, Kathleen, Noah Snavely, Dun-yu Hsiao, Nadine Tabing, and Zoran Popovic. 2011. “Photocity: Training Experts at Large-Scale Image Acquisition Through a Competitive Game.” In SIGCHI Conference on Human Factors in Computing Systems, CHI '11, Vancouver, British Columbia, Canada. ACM, ISBN 978-1-4503-0228-9
   Google Scholar
• Turner, Joanna, Alfio V Parisi, Damien P Igoe, and Abdurazaq Amar. 2017. “Detection of Ultraviolet B Radiation with Internal Smartphone Sensors.” Instrumentation Science & Technology 45 (6): 618–638. doi: https://doi.org/10.1080/10739149.2017.1298042
   Web of Science ®Google Scholar
• van Berkel, Niels, Matthias Budde, Senuri Wijenayake, and Jorge Goncalves. 2018. “Improving Accuracy in Mobile Human Contributions: An Overview.” In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers, Singapore, Singapore. ACM. 594–599
   Google Scholar
• Van Berkel, Niels, Jorge Goncalves, Simo Hosio, and Vassilis Kostakos. 2017. “Gamification of Mobile Experience Sampling Improves Data Quality and Quantity.” Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1 (3): 1–21. doi: https://doi.org/10.1145/3130972
   Google Scholar
• Von Ahn, Luis. 2006. “Games with a Purpose.” Computer 39 (6): 92–94. doi: https://doi.org/10.1109/MC.2006.196
   Web of Science ®Google Scholar
• Wickens, Christopher D, John Lee, Yili D Liu, and Sallie Gordon-Becker. 2014. Introduction to Human Factors Engineering: Pearson New International Edition. 2nd ed., Pearson Higher Ed.
   Google Scholar
• Word Medical Association. Declaration of Helsinki – Ethical Principles for Medical Research Involving Human Subjects. Bulletin of the World Health Organization, 2001, 79, 1964. https://www.who.int/bulletin/archives/79(4)373.pdf.
   Google Scholar