Evaluating PPGIS Usability in a Multi-National Field Study Combining Qualitative Surveys and Eye-Tracking

References

• Aditya, T. (2010) “Usability Issues in Applying Participatory Mapping for Neighborhood Infrastructure Planning” Transactions in GIS 14 (3) pp.119–147 DOI:https://doi.org/10.1111/j.1467-9671.2010.01206.x.
   Web of Science ®Google Scholar
• Arnstein, S.R. (1969) “A Ladder of Citizen Participation” Journal of the American Institute of Planners 35 (4) pp.216–224 DOI:https://doi.org/10.1080/01944366908977225.
   Web of Science ®Google Scholar
• Atzmanstorfer, K., Eitzinger, A., Marin, B.E., Parra Arteaga, A., Gonzalez Quintero, B. and Resl, R. (2016) “HCI-Evaluation of the GeoCitizen-reporting App for Citizen Participation in Spatial Planning and Community Management Among Members of Marginalized Communities in Cali, Colombia” GI_Forum 1 pp.117–132 DOI:https://doi.org/10.1553/giscience2016_01_s117.
   Google Scholar
• Atzmanstorfer, K., Resl, R., Eitzinger, A. and Izurieta, X. (2014) “The GeoCitizen-approach: Community-based Spatial planning – an Ecuadorian Case Study” Cartography and Geographic Information Science 41 (3) pp.248–259 DOI:https://doi.org/10.1080/15230406.2014.890546.
   PubMed Web of Science ®Google Scholar
• Ballatore, A. and Bertolotto, M. (2015) “Personalizing Maps” Communications of the ACM 58 (12) pp.68–74 DOI:https://doi.org/10.1145/2756546.
   Web of Science ®Google Scholar
• Bevan, N. (1995) “Human-Computer Interaction Standards” In Anzai, Y., Ogawa, K. and Mori, H. (Eds) Advances in Human Factors/Ergonomics: Symbiosis of Human and Artifact Elsevier, pp.885–890.
   Google Scholar
• Bugs, G. (2012) “Assessment of Online PPGIS Study Cases in Urban Planning” In Lecture Notes in Computer Science. Computational Science and Its Applications – ICCSA 2012 (Vol. 7333) Berlin, Heidelberg: Springer, pp.477–490 DOI:https://doi.org/10.1007/978-3-642-31125-3_36.
   Google Scholar
• Bugs, G., Granell, C., Fonts, O., Huerta, J. and Painho, M. (2010) “An Assessment of Public Participation GIS and Web 2.0 Technologies in Urban Planning Practice in Canela, Brazil” Cities 27 (3) pp.172–181 DOI:https://doi.org/10.1016/j.cities.2009.11.008.
   Web of Science ®Google Scholar
• Campbell, S.W. and Kwak, N. (2011) “Mobile Communication and Civil Society: Linking Patterns and Places of Use to Engagement with Others in Public” Human Communication Research 37 (2) pp.207–222 DOI:https://doi.org/10.1111/j.1468-2958.2010.01399.x.
   Web of Science ®Google Scholar
• Çöltekin, A., Heil, B., Garlandini, S. and Fabrikant, S.I. (2009) “Evaluating the Effectiveness of Interactive Map Interface Designs: A Case Study Integrating Usability Metrics with Eye-Movement Analysis” Cartography and Geographic Information Science 36 (1) pp.5–17 DOI:https://doi.org/10.1559/152304009787340197.
   Web of Science ®Google Scholar
• Corbett, J.M. and Keller, C.P. (2005) “An Analytical Framework to Examine Empowerment Associated with Participatory Geographic Information Systems (PGIS)” Cartographica: The International Journal for Geographic Information and Geovisualization 40 (4) pp.91–102 DOI:https://doi.org/10.3138/J590-6354-P38V-4269.
   Google Scholar
• Dey, A.K. and Abowd, G.D. (1999) “Towards a Better Understanding of Context and Context-Awareness” HUC ‘99: Proceedings of the 1st International Symposium on Handheld and Ubiquitous Computing Berlin: Springer-Verlag, pp.304–307. Available at: https://link.springer.com/chapter/https://doi.org/10.1007/3-540-48157-5_29 (Accessed: February 2021).
   Google Scholar
• Eitzinger, A., Cock, J., Atzmanstorfer, K., Binder, C.R., Läderach, P., Bonilla-Findji, O., Bartling, M., Mwongera, C., Zurita, L. and Jarvis, A. (2019) “Geofarmer: A Monitoring and Feedback System for Agricultural Development Projects” Computers and Electronics in Agriculture 158 pp.109–121 DOI:https://doi.org/10.1016/j.compag.2019.01.049.
   PubMed Web of Science ®Google Scholar
• Evans-Cowley, J. (2010) “Planning in the Real-Time City: The Future of Mobile Technology” Journal of Planning Literature 25 (2) pp.136–149 DOI:https://doi.org/10.1177/0885412210394100.
   Web of Science ®Google Scholar
• Fiorino, D.J. (1990) “Citizen Participation and Environmental Risk: A Survey of Institutional Mechanisms” Science, Technology, & Human Values 15 (2) pp.226–243 DOI:https://doi.org/10.1177/016224399001500204.
   Web of Science ®Google Scholar
• Gartner, G., Bennett, D.A. and Morita, T. (2007) “Towards Ubiquitous Cartography” Cartography and Geographic Information Science 34 (4) pp.247–257 DOI:https://doi.org/10.1559/152304007782382963.
   Google Scholar
• Gottwald, S., Laatikainen, T.E. and Kyttä, M. (2016) “Exploring the Usability of PPGIS Among Older Adults: Challenges and Opportunities” International Journal of Geographical Information Science 30 (12) pp.2321–2338 DOI:https://doi.org/10.1080/13658816.2016.1170837.
   Web of Science ®Google Scholar
• Haklay, M. and Tobón, C. (2003) “Usability Evaluation and PPGIS: Towards a User-Centred Design Approach” International Journal of Geographical Information Science 17 (6) pp.577–592 DOI:https://doi.org/10.1080/1365881031000114107.
   Web of Science ®Google Scholar
• International Organization for Standardization (1992) ISO 9241 Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) Geneva, Switzerland: ISO.
   Google Scholar
• Irvin, R.A. and Stansbury, J. (2004) “Citizen Participation in Decision Making: Is It Worth the Effort?” Public Administration Review 64 (1) pp.55–65 DOI:https://doi.org/10.1111/j.1540-6210.2004.00346.x.
   Web of Science ®Google Scholar
• Jones, C.E. and Weber, P. (2012) “Towards Usability Engineering for Online Editors of Volunteered Geographic Information: A Perspective on Learnability” Transactions in GIS 16 (4) pp.523–544 DOI:https://doi.org/10.1111/j.1467-9671.2012.01319.x.
   Web of Science ®Google Scholar
• Kiefer, P., Giannopoulos, I., Athanasios Anagnostopoulos, V., Schöning, J. and Raubal, M. (2017) “Controllability Matters: The User Experience of Adaptive Maps” Geoinformatica: An International Journal on Advances of Computer Science for Geographic Information Systems 21 pp.619–641 DOI:https://doi.org/10.1007/s10707-016-0282-x.
   Web of Science ®Google Scholar
• Kiefer, P., Giannopoulos, I. and Raubal, M. (2014) “Where Am I? Investigating Map Matching During Self-Localization With Mobile Eye Tracking in an Urban Environment” Transactions in GIS 18 (5) pp.660–686 DOI:https://doi.org/10.1111/tgis.12067.
   Web of Science ®Google Scholar
• King, C.S., Feltey, K.M. and Susel, B.O.N. (1998) “The Question of Participation: Toward Authentic Public Participation in Public Administration” Public Administration Review 58 (4) pp.317 DOI:https://doi.org/10.2307/977561.
   Web of Science ®Google Scholar
• McNaughton, D. and Light, J. (2013) “The iPad and Mobile Technology Revolution: Benefits and Challenges for Individuals Who Require Augmentative and Alternative Communication” Augmentative and Alternative Communication (Baltimore, MD, 1985) 29 (2) pp.107–116 DOI:https://doi.org/10.3109/07434618.2013.784930.
   PubMed Web of Science ®Google Scholar
• Meng, L. and Malczewski, J. (2009a) “Usability Evaluation for a Web-based Public Participatory GIS: A Case Study in Canmore, Alberta” Cybergeo: European Journal of Geography, DOI:https://doi.org/10.4000/cybergeo.22849.
   Google Scholar
• Meng, L. and Malczewski, J. (2009b) “Web-PPGIS Usability and Public Engagement: A Case Study in Canmore, Alberta, Canada” URISA Journal, 22 (1), pp.57–64. Available at: https://www.urisa.org/clientuploads/directory/Documents/Journal/ (Accessed: February 2021).
   Google Scholar
• Nayebi, F., Desharnais, J.-M. and Abran, A. (2012) “The State of The Art of Mobile Application Usability Evaluation” 2012 25th IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), Montreal, Canada, 29th April-2nd May, IEEE, pp.1–4 Available at: https://ieeexplore.ieee.org/document/6334930 (Accessed: February 2021).
   Google Scholar
• Newman, G., Zimmerman, D., Crall, A., Laituri, M., Graham, J. and Stapel, L. (2010) “User-friendly Web Mapping: Lessons from a Citizen Science Website” International Journal of Geographical Information Science 24 (12) pp.1851–1869 DOI:https://doi.org/10.1080/13658816.2010.490532.
   Web of Science ®Google Scholar
• Nielsen, J. (2001) “Usability Metrics” Available at: https://www.nngroup.com/articles/usability-metrics/* (Accessed: 21st May 2019).
   Google Scholar
• Poole, A. and Ball, L.J. (2005) “Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects” In Ghaoui, C. (Ed.) Encyclopedia of Human-Computer Interaction Pennsylvania: Idea Group, Inc., pp.211–219.
   Google Scholar
• Poplin, A. (2015) “How User-Friendly Are Online Interactive Maps? Survey Based on Experiments with Heterogeneous Users” Cartography and Geographic Information Science 42 (4) pp.358–376 DOI:https://doi.org/10.1080/15230406.2014.991427.
   Web of Science ®Google Scholar
• Reichenbacher, T. (2001) “Adaptive Concepts for a Mobile Cartography” Journal of Geographical Sciences 11 (S1) pp.43–53 DOI:https://doi.org/10.1007/BF02837443.
   Google Scholar
• Reichenbacher, T. (2005) “Adaptive Egocentric Maps for Mobile Users” In Meng, L. (Ed.) Map-based Mobile Services. Theories, Methods and Implementations Berlin: Springer, pp.141–158.
   Google Scholar
• Schilit, B., Adams, N. and Want, R. (1994) “Context-Aware Computing Applications” 1994 First Workshop on Mobile Computing Systems and Applications Santa Cruz, CA, 8th-9th December, Berlin: IEEE. pp.189–194. Available at: https://ieeexplore.ieee.org/document/4624429 (Accessed: February 2021).
   Google Scholar
• Sey, A. and Fellows, M. (2011) “Loose strands: searching for evidence of public access ICT impact on development” Conference '11 Seattle, Washington, USA, 8th–11th February, Grandville, MI: iSchools, pp.189–194. Available at: https://dl.acm.org/doi/https://doi.org/10.1145/1940761.1940787 (Accessed: February 2021).
   Google Scholar
• Sieber, R. (2006) “Public Participation Geographic Information Systems: A Literature Review and Framework” Annals of the Association of American Geographers 96 (3) pp.491–507 DOI:https://doi.org/10.1111/j.1467-8306.2006.00702.x.
   Web of Science ®Google Scholar
• Stivers, C. (2016) “The Public Agency as Polis” Administration & Society 22 (1) pp.86–105 DOI:https://doi.org/10.1177/009539979002200105.
   Web of Science ®Google Scholar
• Wang, Y., Liu, Y., Chen, X. and Chen, Y. (2001) “Adaptive Geovisualization: An Approach Towards the Design of Intelligent Geovisualization Systems” Journal of Geographical Sciences 11 (5s) p.1 DOI:https://doi.org/10.1007/BF02837439.
   Google Scholar
• Warner, S.L. (1965) “Randomized Response: A Survey Technique for Eliminating Evasive Answer Bias” Journal of the American Statistical Association 60 (309) pp.63–69 DOI:https://doi.org/10.1080/01621459.1965.10480775.
   PubMed Web of Science ®Google Scholar
• World Bank (2016) “World Development Report 2016: Digital Dividends” Main Messages 53 (9) DOI:https://doi.org/10.1596/978-1-4648-0671-1.
   Google Scholar