Advanced search
Publication Cover
International Journal of Cartography Volume 3, 2017 - Issue sup1: Research Special Issue
Submit an article Journal homepage
11,654
Views
89
CrossRef citations to date
0
Altmetric
Articles

User studies in cartography: opportunities for empirical research on interactive maps and visualizations

Robert E. RothUW Cartography Lab, Department of Geography, University of Wisconsin-Madison, Madison, WI, USACorrespondence[email protected]
ORCID Iconhttp://orcid.org/0000-0003-1241-318X
ORCID Icon,
Arzu ÇöltekinGeographic Information Visualization and Analysis (GIVA) Unit, Department of Geography, University of Zurich, Zurich, SwitzerlandORCID Iconhttp://orcid.org/0000-0002-3178-3509
ORCID Icon,
Luciene DelazariDepartment of Geomatics, Federal University of Paraná, Curitiba, Brazil
,
Homero Fonseca FilhoGeospatial Computing Lab, Environmental Management Department, University of Sao Paulo, Sao Paulo, BrazilORCID Iconhttp://orcid.org/0000-0003-4737-9938
ORCID Icon,
Amy GriffinSchool of Physical, Environmental and Mathematical Sciences, University of New South Wales, Canberra, AustraliaORCID Iconhttp://orcid.org/0000-0001-6548-7970
ORCID Icon,
Andreas HallDepartment of Real Estate, Planning and Geoinformatics, Aalto University, Aalto, FinlandORCID Iconhttp://orcid.org/0000-0002-8512-7048
ORCID Icon,
Jari KorpiDepartment of Real Estate, Planning and Geoinformatics, Aalto University, Aalto, Finland
,
Ismini LokkaGeographic Information Visualization and Analysis (GIVA) Unit, Department of Geography, University of Zurich, Zurich, Switzerland
,
André MendonçaSchool of Technology, Amazonas State University, Manaus, BrazilORCID Iconhttp://orcid.org/0000-0003-2006-1233
ORCID Icon,
Kristien OomsDepartment of Geography, Ghent University, Ghent, BelgiumORCID Iconhttp://orcid.org/0000-0003-4921-7553
ORCID Icon &
Corné P.J.M. van ElzakkerGeo-information Processing, University of Twente, Enschede, Netherlands
 show all
Pages 61-89 | Received 07 Jun 2016, Accepted 26 Jan 2017, Published online: 24 May 2017

References

  • Alexander, A. (2013). Smartphone usage statistics 2013. Retrieved from http://ansonalex.com/infographics/smartphone-usage-statistics-and-trends-2013-infographic/.
  • Andrienko, G., Andrienko, N., Jankowski, P., Keim, D., Kraak, M.-J., & MacEachren, A. (2007). Geovisual analytics for spatial decision support: Setting the research agenda. International Journal of Geographical Information Science, 21(8), 839–857. doi: 10.1080/13658810701349011
  • Andrienko, N., & Andrienko, G. (2013). Visual analytics of movement: An overview of methods, tools, and procedures. Information Visualization, 12(1), 3–24. doi: 10.1177/1473871612457601
  • Andrienko, N., & Andrienko, G. (2006). The complexity challenge to creating useful and usability geovisualization tools. GIScience (pp. 23–27). Park City.
  • Andrienko, N., Andrienko, G., & Gatalsky, P. (2003). Exploratory spatio-temporal visualization: An analytical review. Journal of Visual Languages and Computing, 14, 503–541. doi: 10.1016/S1045-926X(03)00046-6
  • Appert, C., Beaudouin-Lafon, M., & Mackay, W. (2004). Context matters : Evaluating interaction techniques with the CIS model. Human-Computer Interaction (pp. 279–295). London: Springer Verlag.
  • Barkhuus, L., & Rode, J. A. (2007). From mice to men – 24 years of evaluation in CHI. SIGCHI Conference on Human Factors in Computing Systems. San Jose.
  • Behrens, J., Elzakker, C. P.J.M.v., & Schmidt, M. (2015). Testing the usability of OpenStreetMap's iD tool. The Cartographic Journal, 52(2), 177–184. doi: 10.1080/00087041.2015.1119457
  • Bleisch, S. (2011). Evaluating the appropriateness of visually combining abstract quantitative data representations with 3D desktop virtual environments using mixed methods. (PhD dissertation). City University London, London.
  • Borkin, M. A., Gajos, K. Z., Peters, A., Mitsouras, D., Melchionna, S., & Rybicki, F. J. (2011). Evaluation of artery visualizations for heart disease diagnosis. IEEE Transactions on Visualization and Computer Graphics, 17(12), 2479–2488. doi:10.1109/TVCG.2011.192. doi: 10.1109/TVCG.2011.192
  • Brewer, C. A., & Buttenfield, B. P. (2007). Framing guidelines for multi-scale map design using databases at multiple resolutions. Cartographic and Geographic Information Science, 34(1), 3–15. doi: 10.1559/152304007780279078
  • Brewer, I., & McNeese, M. D. (2004). Supporting work in hurricane management centers: An application of cognitive systems engineering techniques. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 48(20), 2426–2430. doi: 10.1177/154193120404802011
  • Brodlie, K. W., Carpenter, L. A., Earnshaw, R. A., Gallop, J. R., Hubbold, R. J., & Mumford, A. M. (1992). Scientific visualization: Techniques and applications. Berlin: Spring-Verlag.
  • Buxton, W. (2001). Less-is-more (more or less). In P. Denning (Ed.), The invisible future: The seamless integration of technology in everyday life (pp. 145–179). New York, NY: McGraw Hill.
  • Cairns, P., & Cox, A. L. (2008). Research methods for human-computer interaction. Cambridge: Cambridge University Press.
  • Card, S. K., English, W. K., & Burr, B. J. (1978). Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT. Ergonomics, 21(8), 601–613. doi: 10.1080/00140137808931762
  • Carpendale, S. (2008). Evaluating information visualizations. Lecture notes in computer science (Vol. 4950, pp. 19–45). Heidelberg: Springer-Verlag.
  • Carrasco, M. (2011). Visual attention: The past 25 years. Vision Research, 51(13), 1484–1525. doi:10.1016/j.visres.2011.04.012. doi: 10.1016/j.visres.2011.04.012
  • Cartwright, W. (2012). Neocartography: Opportunities, issues, and prospects. South African Journal of Geomatics, 1(1), 14–31.
  • Cartwright, W., Crampton, J., Gartner, G., Miller, S., Mitchell, K., & Siekierska, E. (2001). Geospatial information visualization user interface issues. Cartography and Geographic Information Science, 28(1), 45–60. doi: 10.1559/152304001782173961
  • Chae, M., & Kim, J. (2004). Do size and structure matter to mobile users? An empirical study of the effects of screen size, information structure, and task complexity on user activities with standard web phones. Behaviour & Information Technology, 23(3), 165–181. doi: 10.1080/01449290410001669923
  • Chandrasekharan, S., & Nersessian, N. J. (2011). Building cognition: The construction of external representations for discovery. In L. Carlson, C. Hoelscher, & T. F. Shipley (Eds.), Annual meeting of the cognitive science society (pp. 1727–1763). Boston, MA.
  • Chang, R., Ziemkiewicz, C., Green, T. M., & Ribarsky, W. (2009). Defining insight for visual analytics. Computer Graphics and Applications, 29(2), 14–17. doi: 10.1109/MCG.2009.22
  • Clifton, B. (2012). Advanced web metrics with Google Analytics (3rd ed.). Indianapolis, IN: John Wiley & Sons.
  • Çöltekin, A., Heil, B., Garlandini, S., & Fabrikant, S. I. (2009). Evaluating the effectiveness of interactive map interface designs: A case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36(1), 5–17. doi: 10.1559/152304009787340197
  • Çöltekin, A., Lokka, I., & Zahner, M. (2016). On the usability and usefulness of 3D (geo)visualizations -- A focus on virtual reality environments. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLI-B2, 387–392. doi: 10.5194/isprsarchives-XLI-B2-387-2016
  • Committee, M. S. (2003). Weaving a national Map: A review of the U.S. Geological survey concept of The National Map. Washington, DC: The National Academies Press.
  • Crampton, J. W. (2002). Interactivity types in geographic visualization. Cartography and Geographic Information Science, 29(2), 85–98. doi: 10.1559/152304002782053314
  • Crampton, J. W. (2009). Cartography: Maps 2.0. Progress in Human Geography, 33(1), 91–100. doi: 10.1177/0309132508094074
  • Crampton, J. W. (2010). Cartographic rationality and the politics of geosurveillance and security. Cartography and Geographic Information Science, 30(2), 135–148. doi: 10.1559/152304003100011108
  • Crampton, J. W. (2015). Collect it all: National security, big data and governance. GeoJournal, 80(4), 519–531. doi: 10.1007/s10708-014-9598-y
  • Crampton, J. W., Graham, M., Poorthuis, A., Shelton, T., Stephens, M., & Wilson, M. W. (2013). Beyond the geotag: Situating ‘big data’ and leveraging the potential of the geoweb. Cartography and Geographic Information Science, 40(2), 130–139. doi: 10.1080/15230406.2013.777137
  • Davies, C. (1998). Analysing ‘work’ in complex system tasks: An exploratory study with GIS. Behaviour and Information Technology, 17(4), 218–230. doi: 10.1080/014492998119427
  • Davies, J., Goel, A. K., & Nersessian, N. J. (2009). A computational model of visual analogies in design. Cognitive Systems Research, 10, 204–215. doi: 10.1016/j.cogsys.2008.09.006
  • Demšar, U. (2007). Combining formal and exploratory methods for evaluation of an exploratory geovisualization application in a low-cost usability experiment. Cartography and Geographic Information Science, 34(1), 29–45. doi: 10.1559/152304007780279069
  • D’Ignazio, C., & Klein, L. F. (2016). Feminist data visualization. Workshop on Visualization for the Digital Humanities (VIS4DH), Baltimore. IEEE.
  • Duchêne, C., Christophe, S., & Ruas, A. (2011). Generalisation, symbol specification and map evaluation: Feedback from research done at COGIT laboratory, IGN France. International Journal of Digital Earth, 4(Supplement 1), 25–41. doi: 10.1080/17538947.2010.510305
  • Edsall, R., Andrienko, G., Andrienko, N., & Buttenfield, B. (2008). Interactive maps for exploring spatial data. In M. Madden (Eds.), Manual of geographic information systems (pp. 837–858). Bethesda, MD: ASPRS.
  • Edsall, R. M. (2007). Iconic maps in American political discourse. Cartographica, 42(4), 335–347. doi: 10.3138/carto.42.4.335
  • Edsall, R. M., & Larson, K. L. (2009). Effectiveness of a semi-immersive virtual environment in understanding human-environment interactions. Cartography and Geographic Information Science, 36(4), 367–384. doi: 10.1559/152304009789786317
  • Ellis, P. D. (2010). The essential guide to effect sizes: Statistical power, meta-analysis, and the interpretation of research results. Cambridge: Cambridge University Press.
  • Elwood, S. (2009). Integrating participatory action research and GIS education: Negotiating methodologies, politics, and technologies. Journal of Geography in Higher Education, 33(1), 51–65. doi: 10.1080/03098260802276565
  • Elwood, S. (2010). Geographic information science: Visualization, visual methods, and the geoweb. Progress in Human Geography, 35(3), 401–408. doi: 10.1177/0309132510374250
  • Elzakker, C. P.J.M.v., & Griffin, A. L. (2013). Focus on geoinformation users: Cognitive and use/user issues in contemporary cartography. GIM International, 27(8), 20–23.
  • Elzakker, C. P.J.M.v., & Wealands, K. (2007). Use and users of multimedia cartography. In W. Cartwright, M. Peterson, & G. Gartner (Eds.), Multimedia cartography (pp. 487–504). Heidelberg: Springer.
  • Engelbart, D. C., & English, W. K. (1968). A research center for augmenting human intellect. Fall Joint Computer Conference, San Francisco, CA.
  • Fabrikant, S. I., Christophe, S., Papestefanou, G., & Maggi, S. (2013). How to measure and visualize emotion when using maps. International Cartography Conference, Dresden.
  • Fabrikant, S. I., Rebich-Hespanha, S., Andrienko, N., Andrienko, G., & Montello, D. R. (2008). Novel method to measure inference affordance in static small-multiple map displays representing dynamic processes. The Cartographic Journal, 45(3), 201–215. doi: 10.1179/000870408X311396
  • Fairbairn, D., Andrienko, G., Andrienko, N., Buziek, G., & Dykes, J. (2001). Representation and its relationship with cartographic visualization. Cartography and Geographic Information Science, 28(1), 13–28. doi: 10.1559/152304001782174005
  • Fish, C., Goldsberry, K. P., & Battersby, S. (2011). Change blindness in animated choropleth maps: An empirical study. Cartography and Geographic Information Science, 38(4), 350–362. doi: 10.1559/15230406384350
  • Fish, C. S., & Calvert, K. (2015). Understanding map design for energy policy, planning, and technology implementation. International Cartographic Conference, Rio de Janiero.
  • Flanagin, A. J., & Metzger, M. J. (2008). The credibility of volunteered geographic information. GeoJournal, 72(3), 137–148. doi: 10.1007/s10708-008-9188-y
  • Forsell, C., & Cooper, M. (2014). An introduction and guide to evaluation of visualization techniques through user studies. In W. Huang (Eds.), Handbook of human centric visualization (pp. 285–313). New York, NY: Springer Science + Business Media.
  • Fuhrmann, S., Holzbach, M. E., & Black, R. (2015). Developing interactive geospatial holograms for spatial decision-making. Cartography and Geographic Information Science, 42(Supplement 1), 27–33. doi: 10.1080/15230406.2015.1059174
  • Fuhrmann, S., & Pike, W. (2005). User-centered design of collaborative geovisualization tools. In J. Dykes, A. M. MacEachren, & M. J. Kraak (Eds.), Exploring geovisualization (pp. 591–610). Amsterdam: Elsevier Science.
  • Gabbard, J. L., Hix, D., & Swan, J. E. (1999). User-centered design and evaluation of virtual environments. IEEE Computer Graphics and Applications, 19(6), 51–59. doi: 10.1109/38.799740
  • Gahegan, M., Wachowicz, M., Harrower, M., & Rhyne, T.-M. (2001). The integration of geographic visualization and knowledge discovery in databases and geocomputation. Cartography and Geographic Information Science, 28(1), 29–44. doi: 10.1559/152304001782173952
  • Garrett, J. J. (2010). The elements of user experience: User-centered design for the Web and beyond. Thousand Oaks, CA: New Riders Publishing.
  • Gartner, G., Bennett, D. A., & Morita, T. (2007). Towards ubiquitous cartography. Cartography and Geographic Information Science, 34(4), 247–257. doi: 10.1559/152304007782382963
  • Gleicher, M. (2012). Why ask why? Considering motivation in visualization evaluation. BELIV workshop (pp. 10). Seattle: ACM.
  • Greenberg, S., & Buxton, B. (2008). Usability evaluation considered harmful (Some of the time). SIGCHI Conference on Human Factors in Computing Systems (pp. 111–120), Florence.
  • Griffin, A., & McQuoid, J. (2012). At the intersection of maps and emotion: The challenges of spatially representing experience. Kartographische Nachrichten, 62(6), 291–299.
  • Griffin, A. L. (2004). Understanding how scientists use data-display devices for interactive visual computing with geographical models. (PhD dissertation), Penn State University Park, University Park.
  • Griffin, A. L., & Robinson, A. C. (2015). Comparing color and leader line highlighting strategies in coordinated view geovisualizations. Transactions on Visualization & Computer Graphics, 21(3), 339–349. doi: 10.1109/TVCG.2014.2371858
  • Griffin, A. L., Robinson, A. C., & Roth, R. E. (2017). Envisioning the future of cartographic research. International Journal of Cartography. Advance online publication. doi: 10.1080/23729333.2017.1316466
  • Griffin, A. L., White, T., Fish, C., Tomio, B., Huang, H., Sluter, C. R., … Picanço, P. (2017). Designing across map use contexts: a research agenda. International Journal of Cartography. Advance online publication. doi: 10.1080/23729333.2017.1315988
  • Haklay, M., Singleton, A., & Parker, C. (2008). Web mapping 2.0: The neogeography of the geoweb. Geography Compass, 2(6), 2011–2039. doi: 10.1111/j.1749-8198.2008.00167.x
  • Haklay, M., & Zafiri, A. (2008). Usability engineering for GIS: Learning from a screenshot. The Cartographic Journal, 45(2), 87–97. doi: 10.1179/174327708X305085
  • Harley, J. B. (1989). Deconstructing the map. Cartographica, 26(2), 1–20. doi: 10.3138/E635-7827-1757-9T53
  • Harmon, E., & Nersessian, N. J. (2008). Cognitive partnerships on the bench top: Designing to support scientific researchers. Designing Interactive Systems (pp. 119–128). Cape Town: ACM.
  • Harrower, M., Keller, C. P., & Hocking, D. (1997). Cartography on the Internet: Thoughts and a preliminary user survey. Cartographic Perspectives, 27(Winter), 27–37. doi: 10.14714/CP26.718
  • Harrower, M., & Sheesley, B. (2005). Designing better map interfaces: A framework for panning and zooming. Transactions in GIS, 9(2), 77–89. doi: 10.1111/j.1467-9671.2005.00207.x
  • Hayes, G. R. (2011). The relationship of action research to human-computer interaction. ACM Transactions Computer-Human Interaction, 18(3), 1–20. doi: 10.1145/1993060.1993065
  • Hecht, B., Schöning, J., Haklay, M., Capra, L., Mashhadi, A. J., & Terveen, L. (2013). Geographic human-computer interaction CHI (pp. i-iv). Paris: ACM.
  • Heer, J., & Bostock, M. (2010). Crowdsourcing graphical perception: Using mechanical Turk to assess visualization design. SIGCHI Conference on Human Factors in Computing Systems (pp. 203–212). Atlanta: ACM.
  • Heer, J., Bostock, M., & Ogievetsky, V. (2010). A tour through the visualization zoo. Communications of the ACM, 53(6), 59–67. doi:10.1145/1743546.1743567. doi: 10.1145/1743546.1743567
  • Hegarty, M., Montello, D. R., Richardson, A. E., Ishikawa, T., & Lovelace, K. (2006). Spatial abilities at different scales: Individual differences in aptitude-test performance and spatial-layout learning. Intelligence, 34(2), 151–176. doi:10.1016/j.intell.2005.09.005. doi: 10.1016/j.intell.2005.09.005
  • Hess, D. (2001). Ethnography and the development of science and technology studies. In P. Atkinson, A. Coffey, S. Delamont, J. Lofland, & L. Lofland (Eds.), Handbook of ethnography (pp. 234–245). Thousand Oaks, CA: SAGE Publications.
  • Hollan, J., Hutchins, E., & Kirsh, D. (2000). Distributed cognition: Toward a new foundation for human-computer interaction research. ACM Transactions in Computer-Human Interaction, 7(2), 174–196. doi: 10.1145/353485.353487
  • Howard, D. L., & MacEachren, A. M. (1996). Interface design for geographic visualization: Tools for representing reliability. Cartography and Geographic Information Science, 23(2), 59–77. doi: 10.1559/152304096782562109
  • Howard, G., Blick, G., & McNamara, F. (2009). A truly automated system for New Zealand’s topographic maps. International Cartography Conference, Santiago.
  • Huang, H., Schmidt, M., & Gartner, G. (2012). Spatial knowledge acquisition with mobile maps, augmented reality and voice in the context of GPS-based pedestrian navigation: Results from a field test. Cartography and Geographic Information Science, 39(2), 107–116. doi: 10.1559/15230406392107
  • Ingensand, J., & Golay, F. (2011). Remote-evaluation of user interaction with WebGIS. In J. D. Carswell, S. Fotheringham, & G. McArdle (Eds.), Web and wireless geographical information systems (pp. 188–202). Heidelberg: Springer.
  • Isenberg, T., Isenberg, P., Chen, J., Sedlmair, M., & Möller, T. (2013). A systematic review on the practice of evaluating visualization. IEEE Transactions on Visualization and Computer Graphics, 19(12), 2818–2827. doi: 10.1109/TVCG.2013.126
  • Jones, C. E., Haklay, M., Griffiths, S., & Vaughan, L. (2009). A less-is-more approach to geovisualization: Enhancing knowledge construction across multidisciplinary teams. International Journal of Geographical Information Science, 23(8), 1077–1093. doi: 10.1080/13658810802705723
  • Kahneman, D. (2003). Maps of bounded rationality: Psychology for behavioral economics. The American Economic Review, 93(5), 1449–1475. doi: 10.1257/000282803322655392
  • Keehner, M., Hegarty, M., Cohen, C., Khooshabeh, P., & Montello, D. R. (2008). Spatial reasoning with external visualizations: What matters is what you see, not whether you interact. Cognitive Science, 32, 1099–1132. doi: 10.1080/03640210801898177
  • Kiefer, P., Giannopoulos, I., & Raubal, M. (2014). Where am I? Investigating map matching during self-localization with mobile eye tracking in an urban environment. Transactions in GIS, 18(5), 660–686. doi: 10.1111/tgis.12067
  • Kinkeldey, C., MacEachren, A. M., & Schiewe, J. (2014). How to assess visual communication of uncertainty? A systematic review of geospatial uncertainty visualisation user studies. The Cartographic Journal, 51(4), 372–386. doi: 10.1179/1743277414Y.0000000099
  • Kitchin, R., & Tate, N. (2013). Conducting research in human geography: Theory, methodology and practice. New York, NY: Routledge.
  • Klippel, A., Weaver, C., & Robinson, A. C. (2011). Analyzing cognitive conceptualizations using interactive visual environments. Cartography and Geographic Information Science, 38(1), 52–68. doi: 10.1559/1523040638152
  • Kosara, R., Healey, C., Interrante, V., Laidlaw, D. H., & Ware, C. (2003). User studies: Why, how and when? IEEE Computer Graphics & Applications, 23(4), 20–25. doi: 10.1109/MCG.2003.1210860
  • Kosara, R., & Ziemkiewicz, C. (2010). Do mechanical Turks dream of square pie charts? BELIV workshop (pp. 63-70). New York, NY: ACM.
  • Kraak, M.-J. (1998). The cartographic visualization process: From presentation to exploration. The Cartographic Journal, 35(1), 11–15. doi: 10.1179/caj.1998.35.1.11
  • Kumar, N. (2000). Automation and democratization of cartography: An example of a mapping system at CEM, University of Durham. The Cartographic Journal, 37(1), 65–77. doi: 10.1179/caj.2000.37.1.65
  • Kveladze, I., Kraak, M.-J., & Elzakker, C. P.M.J.v. (2013). A methodological framework for researching the usability of the space-time cube. Cartographic Journal, 50(3), 201–210. doi: 10.1179/1743277413Y.0000000061
  • Kwan, M.-P. (2004). Beyond difference: From canonical geography to hybrid geographies. Annals of the Association of American Geographers, 94(4), 756–763.
  • Lam, H., Bertini, E., Isenberg, P., Plaisant, C., & Carpendale, S. (2012). Empirical studies in information visualization: Seven scenarios. IEEE Transactions on Visualization and Computer Graphics, 18(9), 1520–1536. doi:10.1109/TVCG.2011.279. doi: 10.1109/TVCG.2011.279
  • Landauer, T. K. (1995). The trouble with computers: Usefulness, usability, and productivity. Cambridge, MA: MIT Press.
  • Leszczynski, A. (2012). Situating the geoweb in political economy. Progress in Human Geography, 36(1), 72–89. doi: 10.1177/0309132511411231
  • Leszczynski, A., & Wilson, M. W. (2013). Guest editorial: Theorizing the geoweb. GeoJournal, 78(6), 915–919. doi: 10.1007/s10708-013-9489-7
  • Liben, L. S., & Downs, R. M. (1993). Understanding person-space-map relations: Cartographic and developmental perspectives. Developmental Psychology, 29(4), 739–752. doi:10.1037/0012-1649.29.4.739. doi: 10.1037/0012-1649.29.4.739
  • Lisak, J. (2012). How we consume content from brands. Retrieved from http://www.marketingtechblog.com/how-we-consume-co.
  • Liu, Z., & Stasko, J. T. (2010). Mental models, visual reasoning and interaction in information visualization: A top-down perspective. IEEE Visualization and Computer Graphics, 16(6), 999–1008. doi: 10.1109/TVCG.2010.177
  • Lloyd, D., & Dykes, J. (2011). Human-centered approaches in geovisualization design: Investigating multiple methods through a long-term case study. IEEE Transactions on Visualization and Computer Graphics, 17(12), 2498–2507. doi: 10.1109/TVCG.2011.209
  • Lloyd, D., Dykes, J., & Radburn, R. (2007). Understanding geovisualization users and their requirements – a user-centred approach. (pp. 209–214). Maynooth: GIS research UK.
  • Lokka, I., & Çöltekin, A. (2016). Simulating navigation with virtual 3D geovisualizations - A focus on memory related factors. International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XLI-B2, 671–673. doi: 10.5194/isprsarchives-XLI-B2-671-2016
  • Loomis, J. M., Blascovich, J. J., & Beall, A. C. (1999). Immersive virtual environment technology as a basic research tool in psychology. Behavior Research Methods, Instruments, & Computers, 31(4), 557–564. doi: 10.3758/BF03200735
  • MacEachren, A. M. (1982). The role of complexity and symbolization method in thematic map effectiveness. Annals of the Association of American Geographers, 72(4), 495–513. doi: 10.1111/j.1467-8306.1982.tb01841.x
  • MacEachren, A. M. (1994). Visualization in modern cartography: Setting the agenda. Oxford: Pergamon.
  • MacEachren, A. M. (1995). How maps work. New York, NY: The Guilford Press.
  • MacEachren, A. M. (2015). Distributed cognition: A conceptual framework for understanding map-based reasoning. International Cartography Conference, Rio de Janeiro.
  • MacEachren, A. M., Boscoe, F. P., Haug, D., & Pickle, L. W. (1998). Geographic visualization: Designing manipulable maps for exploring temporally varying georeferenced statistics. Information Visualization (pp. 87–94). Raleigh, NC: IEEE.
  • MacEachren, A. M., & Brewer, I. (2004). Developing a conceptual framework for visually-enabled geocollaboration. International Journal of Geographical Information Science, 18(1), 1–34. doi: 10.1080/13658810310001596094
  • MacEachren, A. M., Buttenfield, B. P., Campbell, J. C., & Monmonier, M. S. (1992). Visualization. In R. Abler, M. Marcus, & J. Olson (Eds.), Geography’s inner worlds: Pervasive themes in contemporary American geography (pp. 101–137). New Brunswick, NJ: Rutgers University Press.
  • MacEachren, A. M., Cai, G., Sharma, R., Rauschert, I., Brewer, I., & Bolelli, L. (2005). Enabling collaborative geoinformation access and decision-making through a natural, multimodal interface. International Journal of Geographical Information Science, 19, 293–317. doi: 10.1080/13658810412331280158
  • MacEachren, A. M., Gahegan, M., Pike, W., Brewer, I., Cai, G., & Lengerich, E. (2004). Geovisualization for knowledge construction and decision support. Computer Graphics and Applications, 24(1), 13–17. doi: 10.1109/MCG.2004.1255801
  • MacEachren, A. M., Jaiswal, A., Robinson, A. C., Pezanowski, S., Savelyev, A., & Mitra, P. (2011). Senseplace2: Geotwitter analytics support for situational awareness. Visual Analytics Science and Technology (pp. 181–190). Providence, RI: IEEE.
  • MacEachren, A. M., & Kraak, M.-J. (2001). Research challenges in geovisualization. Cartography and Geographic Information Science, 28(1), 3–12. doi: 10.1559/152304001782173970
  • MacKenzie, I. S. (1992). Fitts’ Law as a research and design tool in human-computer interaction. Human-Computer Interaction, 7(1), 91–139. doi:10.1207/s15327051hci0701_3. doi: 10.1207/s15327051hci0701_3
  • Maggi, S., & Fabrikant, S. I. (2014). Triangulating eye movement data of animated displays. ET4S Workshop at GIScience (pp. 27–31). Vienna.
  • Malik, S., Ranjan, A., & Balakrishnan, R. (2005). Interacting with large displays from a distance with vision-tracked multi-finger gestural input. Symposium on User Interface Software and Technology (pp. 43–52). Seattle: ACM.
  • Manson, S. M., Kne, L., Dyke, K. R., Shannon, J., & Eria, S. (2012). Using eye-tracking and mouse metrics to test usability of web mapping navigation. Cartography and Geographic Information Science, 39(1), 48–60. doi: 10.1559/1523040639148
  • Marcotte, E. (2010). Responsive web design. Retrieved from http://alistapart.com/article/responsive-web-design/.
  • Marsh, S. L., & Haklay, M. (2010). Evaluation and deployment. In M. Haklay (Eds.), Interacting with geospatial technologies (pp. 199–221). West Sussex: Wiley-Blackwell.
  • McCall, M. K., & Dunn, C. E. (2012). Geo-information tools for participatory spatial planning: Fulfilling the criteria for ‘good’ governance. Geoforum, 43(1), 81–94. doi: 10.1016/j.geoforum.2011.07.007
  • McConchie, A. (2015). Hacker cartography: Crowdsourced geography, OpenStreetMap, and the hacker political imaginary. ACME: An International E-Journal for Critical Geographies, 14(3), 874–898.
  • McGuinness, C. (1994). Expert/novice use of visualization tools. In A. M. MacEachren, & D. R. F. Taylor (Eds.), Visualization in modern cartography (pp. 185–199). Oxford: Pergamon.
  • Mead, R. (2014). Expert perspectives on the design and use of learning materials for neocartographic interfaces. (M.Sc. thesis), UW-Madison, Madison.
  • Mendonça, A. L.A.d., & Delazari, L. S. (2012). Remote evaluation of the execution of spatial analysis tasks with interactive web maps: A functional and quantitative approach. Cartographic Journal, 49(1), 7–20. doi: 10.1179/1743277411Y.0000000020
  • Mendonça, A. L.A.d., & Delazari, L. S. (2014). Testing subjective preference and map use performance: Use of web maps for decision making in the public health sector. Cartographica, 49(2), 114–126. doi: 10.3138/carto.49.2.1455
  • Meng, L. (2005). Egocentric design of map-based mobile services. The Cartographic Journal, 42(1), 5–13. doi: 10.1179/000870405X57275
  • Miyake, A., Friedman, N. P., Rettinger, D. A., Shah, P., & Hegarty, M. (2001). How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. Journal of Experimental Psychology: General, 130(4), 621–640. doi: 10.1037/0096-3445.130.4.621
  • Monmonier, M. (1985). Technological transition in cartography. Madison: University of Wisconsin Press.
  • Montello, D. R. (2002). Cognitive map-design research in the twentieth century: Theoretical and empirical approaches. Cartography and Geographic Information Science, 29(3), 283–304. doi: 10.1559/152304002782008503
  • Montello, D. R. (2009). Cognitive research in GIScience: Recent achievements and future prospects. Geography Compass, 3(5), 1824–1840. doi: 10.1111/j.1749-8198.2009.00273.x
  • Montello, D. R., & Sutton, P. C. (2013). An introduction to scientific research methods in geography and environmental studies (2nd ed.). Thousand Oaks, CA: SAGE Publications.
  • Morrison, J. L. (1997). Topographic mapping for the twenty first century. In D. Rhind (Ed.), Framework for the world (pp. 14–27). Cambridge: Geoinformation International.
  • Muehlenhaus, I. (2013). Web cartography: Map design for interactive and mobile devices. Boca Raton, FL: CRC Press.
  • Munzner, T. (2009). A nested model for visualization design and validation. IEEE Transactions on Visualization and Computer Graphics, 15(6), 921–928. doi: 10.1109/TVCG.2009.111
  • Munzner, T. (2014). Visualization analysis and design. Boca Raton, FL: CRC Press.
  • Munzner, T. (2016). On Conventions Between Fields in Experimental Design and Analysis. Retrieved from https://tamaramunzner.wordpress.com/2016/01/16/on-conventions-between-fields-in-experimental-design-and-analysis/.
  • Nagi, R. (2014). Cartographic visualizaton for mobile appliations. (M.Sc.). Enschede: International Institute for Geo-information Science and Earth Observation.
  • Nielsen, J. (1992). The usability engineering life cycle. Computer, 25(3), 12–22. doi: 10.1109/2.121503
  • Nielsen, J. (1993). Usability engineering. San Francisco, CA: Morgan Kaufmann.
  • Nivala, A.-M., Sarjakoski, T. L., & Sarjakoski, T. (2007). Usability methods’ familiarity among map application developers. International Journal of Human-Computer Studies, 65(9), 784–795. doi: 10.1016/j.ijhcs.2007.04.002
  • North, C. (2006). Toward measuring visualization insight. IEEE Computer Graphics and Applications, 26(3), 6–9. doi: 10.1109/MCG.2006.70
  • Olson, J. M. (1979). Cognitive cartographic experimentation. The Canadian Cartographer, 16(1), 34–44. doi: 10.3138/R342-258H-5K6N-4351
  • Ooms, K., Andrienko, G., Andrienko, N., Maeyer, P. D., & Fack, V. (2012). Analysing the spatial dimension of eye movement data using a visual analytic approach. Expert Systems with Applications, 39(1), 1324–1332. doi: 10.1016/j.eswa.2011.08.013
  • Ooms, K., Coltekin, A., Maeyer, P. D., Dupont, L., Fabrikant, S., & Incoul, A. (2015). Combining user logging with eye tracking for interactive and dynamic applications. Behavioral Research, 47(4), 977–993. doi:10.3758/s13428-014-0542-3. doi: 10.3758/s13428-014-0542-3
  • Pickles, J. (Ed.). (1995). Ground truth: The social implications of geographic information systems. New York, NY: Guilford Press.
  • Pivar, M., Fredkin, E., & Stommel, H. (1963). Computer-compiled oceanographic Atlas: An experiment in man-machine interaction. Proceedings of the National Academy of Sciences, 50(2), 396–398. doi: 10.1073/pnas.50.2.396
  • Plaisant, C. (2004). The challenge of information visualization Working Conference on Advanced Visual Intefaces (pp. 109–116). Gallipoli: ACM.
  • Pohl, M., Smuc, M., & Mayr, E. (2012). The user puzzle: Explaining the interaction with visual analytics systems. IEEE Visualization and Computer Graphics, 18(12), 2908–2916. doi: 10.1109/TVCG.2012.273
  • Rädle, R., Jetter, H.-C., Butscher, S., & Reiterer, H. (2013). The effect of egocentric body movements on users’ navigation performance and spatial memory in zoomable user interfaces. ACM International Conference on Interactive Tabletops and Surfaces (pp. 23–32). New York, NY : ACM Press.
  • Ricker, B., Daniel, S., & Hedley, N. (2014). Fuzzy boundaries: Hybridizing location-based services, volunteered geographic information, and geovisualization literature. Geography Compass, 8(7), 490–504. doi: 10.1111/gec3.12138
  • Robertson, G., Ebert, D., Eick, S., Keim, D., & Joy, K. (2009). Scale and complexity in visual analytics. Information Visualization, 8(4), 247–253. doi: 10.1057/ivs.2009.23
  • Robinson, A. C. (2011). Highlighting in geovisualization. Cartography and Geographic Information Science, 38(3), 332–334. doi: 10.1559/15230406382332
  • Robinson, A. C., Chen, J., Lengerich, E. J., Meyer, H. G., & MacEachren, A. M. (2005). Combining usability techniques to design geovisualization tools for epidemiology. Cartography and Geographic Information Science, 32(4), 243–255. doi: 10.1559/152304005775194700
  • Robinson, A. C., Demšar, U., Moore, A. B., Buckley, A., Jiang, B., & Field, K. (2017). Geospatial big data and cartography: research challenges and opportunities for making maps that matter. International Journal of Cartography. Advance online publication. doi: 10.1080/23729333.2016.1278151
  • Robinson, A. C., Roth, R. E., & MacEachren, A. M. (2011). Understanding user needs for map symbol standardization in emergency management. Journal of Homeland Security and Emergency Management, 8(1), 33.
  • Robinson, A. H. (1952). The look of maps: An examination of cartographic design. Madison: University of Wisconsin Press.
  • Robinson, A. H., & Petchenik, B. B. (1975). The map as a communication system. The Cartographic Journal, 12(1), 7–15. doi: 10.1179/caj.1975.12.1.7
  • Rød, J. K., Ormeling, F., & Elzakker, C. V. (2001). An agenda for democratising cartographic visualisation. Norsk Geografisk Tidsskrift-Norwegian Journal of Geography, 55, 38–41. doi: 10.1080/00291950120034
  • Rogers, Y., Connelly, K., Tedesco, L., Hazlewood, W., Kurtz, A., & Hall, R. E. (2007). Why it’s worth the hassle: The value of in-situ studies when designing ubicomp. In J. Krumm, G. D. Abowd, A. Seneviratne, & T. Strang (Eds.), Ubicomp 2007: Ubiquitious computing (pp. 336–353). Heidelberg: Springer.
  • Roth, R. E. (2013a). An empirically-derived taxonomy of interaction primitives for interactive cartography and geovisualization. Transactions on Visualization & Computer Graphics, 19(12), 2356–2365. doi: 10.1109/TVCG.2013.130
  • Roth, R. E. (2013b). Interactive maps: What we know and what we need to know. The Journal of Spatial Information Science, 6, 59–115.
  • Roth, R. E. (2015). Interactivity and cartography: A contemporary perspective on user interface and user experience design from geospatial professionals. Cartographica, 50(2), 94–115. doi: 10.3138/cart.50.2.2427
  • Roth, R. E., Donohue, R. G., Sack, C. M., Wallace, T. R., & Buckingham, T. M. A. (2014). A process for keeping pace with evolving web mapping technologies. Cartographic Perspectives 78, 25–52.
  • Roth, R. E., Finch, B. G., Blanford, J. I., Klippel, A., Robinson, A. C., & MacEachren, A. M. (2011). Card sorting for cartographic research and practice. Cartography and Geographic Information Science, 38(2), 89–99. doi: 10.1559/1523040638289
  • Roth, R. E., & MacEachren, A. M. (2016). Geovisual analytics and the science of interaction: An empirical study. Cartography and Geographic Information Science, 43(1), 30–54. doi: 10.1080/15230406.2015.1021714
  • Roth, R. E., Ross, K. S., & MacEachren, A. M. (2015). User-centered design for interactive maps: A case study in crime analysis. International Journal of GeoInformation, 4, 262–301. doi:10.3390/ijgi4010262.
  • Rubin, J., & Chisnell, D. (2008). Handbook of usability testing. How to plan, design and conduct effective tests. Indianapolis, IN: Wiley Publishing.
  • Sack, C. (2013). Online participatory mapping: Volunteered geographic information tools for local empowerment over land use. 26th International Cartographic Conference. Dresden, Germany.
  • Saraiya, P., North, C., & Duca, K. (2004). An evaluation of microarray visualization tools for biological insight (pp. 1–8). Austin, TX: IEEE Computer Society.
  • Schmalstieg, D., & Reitmayr, G. (2007). The world as a user interface: Augmented reality for ubiquitous computing. In Location Based Services and TeleCartography (pp. 369–391). Heidelberg: Springer.
  • Schöning, J., Hecht, B., Raubal, M., Krüger, A., Marsh, M., & Rohs, M. (2008). Improving interaction with virtual globes through spatial thinking: Helping users ask why? Intelligent user interfaces (pp. 129–138). Canary Islands, Spain: ACM.
  • Sedlmair, M., Meyer, M., & Munzner, T. (2012). Design study methodology: Reflections from the trenches and the stacks. IEEE Transactions on Visualization and Computer Graphics, 18(12), 2431–2440. doi: 10.1109/TVCG.2012.213
  • Sheppard, E. (2005). Knowledge production through critical GIS: Genealogy and prospects. Cartographica, 40(4), 5–21. doi: 10.3138/GH27-1847-QP71-7TP7
  • Shneiderman, B. (1996). The eyes have it: A task by data type taxonomy for information visualization. IEEE Conference on Visual Languages (pp. 336–343). Boulder, CO: IEEE Computer Society Press.
  • Shneiderman, B., & Plaisant, C. (2006). Strategies for evaluating information visualization tools: Multi-dimensional in-depth long-term case studies. 2006 BELIV workshop (pp. 1–7). Venice: ACM Press.
  • Shneiderman, B., & Plaisant, C. (2010). Designing the user interface: Strategies for effective human-computer interaction (5th ed.). Boston, MA: Addison-Wesley.
  • Sidlar, C. L., & Rinner, C. (2009). Utility assessment of a map-based online geo-collaboration tool. Journal of Environmental Management, 90, 2020–2026. doi: 10.1016/j.jenvman.2007.08.030
  • Slocum, T., Cliburn, D., Feddema, J., & Miller, J. (2003). Evaluating the usability of a tool for visualizing the uncertainty of the future global water balance. Cartography and Geographic Information Science, 30(4), 299–317. doi: 10.1559/152304003322606210
  • Slocum, T. A., Blok, C., Jian, B., Koussoulakou, A., Montello, D. R., & Fuhrmann, S. (2001). Cognitive and usability issues in geovisualization. Cartography and Geographic Information Science, 28(1), 61–75. doi: 10.1559/152304001782173998
  • Smith, J. M., Retchless, D., & Klippel, A. (2016). Domains of uncertainty visualization research: A visual summary approach. Cartography and Geographic Information Science, 44(4), 296–309. doi: 10.1080/15230406.2016.1154804
  • Stephens, M. (2013). Gender and the GeoWeb: Divisions in the production of user-generated cartographic information. GeoJournal, 78(6), 981–996. doi: 10.1007/s10708-013-9492-z
  • Stoter, J. E. (2005). Generalisation within NMA's in the 21st century International Cartographic Conference (pp. 1–11), A Coruña, Spain.
  • Suchan, T. A., & Brewer, C. A. (2000). Qualitative methods for research on mapmaking and map use. Professional Geographer, 52(1), 145–154. doi: 10.1111/0033-0124.00212
  • Sui, D., Goodchild, M., & Elwood, S. (2013). Volunteered geographic information, the exaflood, and the growing digital divide. In D. Sui, S. Elwood, & M. Goodchild (Eds.), Crowdsourcing geographic knowledge (pp. 1–12). Amsterdam: Springer.
  • Sweeney, M., Maguire, M., & Shackel, B. (1993). Evaluating user-computer interaction: A framework. International Journal of Man-Machine Studies, 38, 689–711. doi: 10.1006/imms.1993.1032
  • Thatcher, J. (2014). Living on fumes: Digital footprints, data fumes, and the limitations of spatial big data. International Journal of Communication, 8, 1765–1783.
  • Thomas, J. J., Cook, K. A., Bartoletti, A., Card, S., Carr, D., & Dill, J. (2005). Illuminating the path: The research and development agenda for visual analytics. Los Alamitos, CA: IEEE CS Press.
  • Tobler, W. R. (1976). Analytical cartography. The American Cartographer, 3(1), 21–31. doi: 10.1559/152304076784080230
  • Tolochko, R. C. (2016). Contemporary professional practices in interactive web map design. (M.Sc. thesis), UW-Madison, Madison.
  • Tsou, M.-H., & Curran, J. M. (2008). User-centered design approaches for web mapping applications: A case study with USGS hydrological data in the United States. In M. P. Peterson (Eds.), International perspectives on maps and the Internet (pp. 301–321). Heidelberg: Springer.
  • Tullis, T., & Wood, L. (2004). How many users are enough for a card-sorting study? Usability Professionals Association. Minneapolis, MN.
  • Turner, A. J. (2006). Introduction to neogeography: O’Reilly. Retrieved from https://protect-us.mimecast.com/s/6RQOBqherXpdiV?domain=brainoff.com; http://brainoff.com/iac2009/IntroductionToNeogeography.pdf
  • Veregin, H., & Wortley, A. J. (2014). Using web analytics to evaluate the effectiveness of online maps for community outreach. Journal fo Web Librarianship, 8(2), 125–146. doi: 10.1080/19322909.2014.873659
  • Virrantaus, K., Fairbairn, D., & Kraak, M. J. (2009). ICA research agenda on cartography and GIScience. Cartography and Geographic Information Science, 36(2), 209–222. doi: 10.1559/152304009788188772
  • Wiener, J. M., Hölscher, C., Büchner, S., & Konieczny, L. (2012). Gaze behaviour during space perception and spatial decision making. Psychological Research, 76(6), 713–729. doi: 10.1007/s00426-011-0397-5
  • Wijk, J. J.v. (2005). The value of visualization. Visualization (Vol. 79–86). Minneapolis: IEEE.
  • Wilson, M. W. (2012). Location-based services, conspicuous mobility, and the location-aware future. Geoforum, 43(6), 1266–1275. doi:10.1016/j.geoforum.2012.03.014. doi: 10.1016/j.geoforum.2012.03.014
  • Wood, J., Dykes, J., Slingsby, A., & Clarke, K. (2007). Interactive visual exploration of a large spatio-temporal dataset: Reflections on a geovisualization mashup. IEEE Transactions on Visualization and Computer Graphics, 13(6), 1176–1183. doi: 10.1109/TVCG.2007.70570
  • You, M., Chen, C., Liu, H., & Lin, H. (2007). A usability evaluation of web map zoom and pan functions. International Journal of Design, 1(1), 15–25.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.