Eye-tracking in map use, map user and map usability research: what are we looking for?

References

• Baxter, K., Courage, C., & Caine, K. (2015). Understanding your users: A practical guide to user research methods (2nd ed.). Morgan Kaufmann.
   Google Scholar
• Bergstrom, J., Duda, S., Hawkins, D., & McGill, M. (2014). Physiological response measurements. Ch. 4 In J. Bergstrom & A. Schall (Eds.), Eye tracking in user experience design (pp. 81–108). Amsterdam.
   Google Scholar
• Bleisch, S. (2011) Evaluating the appropriateness of visually combining abstract quantitative data representations with 3D desktop virtual environments using mixed methods, PhD thesis, City University, London, UK. https://openaccess.city.ac.uk/id/eprint/1092/
   Google Scholar
• Borys, M., & Plechawska-Wójcik, M. (2017). Eye-tracking metrics in perception and visual attention research. European Journal of Medical Technologies, 3(16), 11–23.
   Google Scholar
• Brus, J., Kučera, M., & Popelka, S. (2019). Intuitiveness of geospatial uncertainty visualizations: A user study on point symbols. Geografie-Sbornik CGS, 124(2), 163–185. https://doi.org/10.37040/geografie2019124020163
   Web of Science ®Google Scholar
• Brychtova, A., & Çöltekin, A. (2016). An empirical user study for measuring the influence of colour distance and font size in map Reading using eye-tracking. Cartographic Journal, 53(3), 202–212. https://doi.org/10.1179/1743277414Y.0000000103
   Web of Science ®Google Scholar
• Burch, M. (2021). Eye tracking and visual analytics. River.
   Google Scholar
• Cairns, P., & Cox, A. (2012). Research methods for human-computer interaction (2nd ed.). Cambridge University Press.
   Google Scholar
• Carter, B. T., & Luke, S. G. (2020). Best practices in eye-tracking research. International Journal of Psychophysiology, 155, 49–62. https://doi.org/10.1016/J.IJPSYCHO.2020.05.010
   PubMed Web of Science ®Google Scholar
• Chekaluk, E., & Llewellyn, K. (Eds) (1992). The role of eye movements in perceptual processes, Advances in Psychology Book Series Vol. 88. Elsevier.
   Google Scholar
• Chen, J., Tong, Y., Gray, W., & Ji, Q. (2008). A robust 3D eye gaze tracking system using noise reduction. ETRA ‘08: Proceedings of the 2008 Symposium on Eye-Tracking Research and Applications, 189–196. https://doi.org/10.1145/1344471.1344518
   Google Scholar
• Cotton, D., & Gresty, K. (2006). Reflecting on the think-aloud method for evaluating e-learning. British Journal of Educational Technology, 37(1), 45–54. https://doi.org/10.1111/J.1467-8535.2005.00521.X
   Web of Science ®Google Scholar
• Cui, W. (2021). A critique of Eye-tracking approach in translation process research. Journal of Literature and Art Studies, 11(3), 190–195. https://doi.org/10.17265/2159-5836/2021.03.010
   Google Scholar
• Cyr, J. (2019). Focus groups for the social science researcher. Cambridge University Press.
   Google Scholar
• Çöltekin, A., Brychtová, A., Griffin, A., Robinson, A., Imhof, M., & Pettit, C. (2017). Perceptual complexity of soil-landscape maps: A user evaluation of color organization in legend designs using eye-tracking. International Journal of Digital Earth, 10(6), 560–581. https://doi.org/10.1080/17538947.2016.1234007
   Web of Science ®Google Scholar
• Çöltekin, A., Fabrikant, S. I., & Lacayo, M. (2010). Exploring the efficiency of users’ visual analytics strategies based on sequence analysis of eye movement recordings. International Journal of Geographical Information Science, 24(10), 1559–1575. https://doi.org/10.1080/13658816.2010.511718
   Web of Science ®Google Scholar
• Çöltekin, A., Heil, B., Garlandini, S., & Fabrikant, S. (2009). Evaluating the effectiveness of interactive map interface designs: A case study integrating usability metrics with eye-movement analysis. Cartography and Geographic Information Science, 36(1), 5–17. https://doi.org/10.1559/152304009787340197
   Web of Science ®Google Scholar
• Davis, R., & Sikorskii, A. (2020). Eye-tracking analysis of visual cues during wayfinding in early stage Alzheimer’s disease. Dementia and Geriatric Cognitive Disorders, 49(1), 91–97. https://doi.org/10.1159/000506859
   PubMed Web of Science ®Google Scholar
• Dogusoy-Taylan, B., & Cagiltay, K. (2014). Cognitive analysis of experts’ and novices’ concept mapping processes: An eye-tracking study. Computers in Human Behavior, 36, 82–93. https://doi.org/10.1016/j.chb.2014.03.036
   Web of Science ®Google Scholar
• Duchowski, A. T. (2017). Eye-tracking methodology: Theory and practice (3rd ed.). Springer. https://doi.org/10.1007/978-3-319-57883-5
   Google Scholar
• Eckert, M. (1907). Die Kartographie als Wissenschaft. In Zeitschrift der Gesellschaft für Erdkunde zu Berlin (pp. 213–227). Gesellschaft für Erdkunde.
   Google Scholar
• Edler, D., Keil, J., Tuller, M.-C., Bestgen, A.-K., & Dickmann, F. (2020). Searching for the ‘right’ legend: The impact of legend position on legend decoding in a cartographic memory task. Cartographic Journal, 57(1), 6–17. https://doi.org/10.1080/00087041.2018.1533293
   Web of Science ®Google Scholar
• Ericsson, K. A., & Simon, H. A. (1993). Protocol analysis: Verbal reports as data. MIT Press.
   Google Scholar
• Fairbairn, D., Gartner, G., & Peterson, M. P. (2021). Epistemological thoughts on the success of maps and the role of cartography. International Journal of Cartography, 7(3). https://doi.org/10.1080/23729333.2021.1972909
   Google Scholar
• Fuhrmann, S., Holzbach, M. E., & Black, R. (2015). Developing interactive geospatial holograms for spatial decision-making. Cartography and Geographic Information Science, 42(1), S27–S33. https://doi.org/10.1080/15230406.2015.1059174
   Google Scholar
• Gholami, Y., Taghvaei, S., Norouzian-Maleki, S., & Sepehr, R. (2021). Identifying the stimulus of visual perception based on eye-tracking in Urban Parks: Case study of Mellat Park in Tehran. Journal of Forest Research, 26(2), 91–100. https://doi.org/10.1080/13416979.2021.1876286
   Web of Science ®Google Scholar
• Göbel, F., & Kiefer, P. (2019). “POITrack: Improving map-based planning with implicit POI tracking”. ETRA ‘19: Proceedings of the 11th ACM Symposium on Eye-Tracking Research and Applications, 87, 1–9. https://doi.org/10.1145/3317959.3321491
   Google Scholar
• Havelková, L., & Gołębiowska, I. M. (2019). What went wrong for bad solvers during thematic map analysis? Lessons learned from an eye-tracking study. International Journal of Geo-Information, 9(1), https://doi.org/10.3390/ijgi9010009
   Google Scholar
• Henderson, J. M., & Ferreira, F. (2004). The interface of language, vision, and action: Eye movements and the visual world. Psychology Press.
   Google Scholar
• Hepburn, J., Fairbairn, D., James, P., & Ford, A. (2021). Do we need legends? An eye-tracking study. Proceedings of 29th Annual GIS Research UK Conference (GISRUK), https://doi.org/10.5281/zenodo.4665195
   Google Scholar
• Hertzum, M., Borlund, P., & Kristoffersen, K. B. (2015). What do thinking-aloud participants Say? A comparison of moderated and unmoderated usability sessions. International Journal of Human–Computer Interaction, 31(9), 557–570. https://doi.org/10.1080/10447318.2015.1065691
   Web of Science ®Google Scholar
• Holmqvist, K., & Andersson, R. (2017). Eye tracking: A comprehensive guide to methods, paradigms, and measures. Lund Eye-Tracking Research Institute.
   Google Scholar
• Holmqvist, K., Nystrom, M., Andersson, R., Dewhurst, R., Jarodzka, H., & van de Weijer, J. (2011). Eye tracking: A comprehensive guide to methods and measures (1st ed.). Oxford University Press.
   Google Scholar
• Johnson, R. B., & Onwuegbuzie, A. J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher, 33(7), 14–26. https://doi.org/10.3102/0013189X033007014
   Google Scholar
• Just, M. A., & Carpenter, P. A. (1976). Eye fixations and cognitive processes. Cognitive Psychology, 8(4), 441–480. https://doi.org/10.1016/0010-0285(76)90015-3
   Web of Science ®Google Scholar
• Keskin, M., Ooms, K., Dogru, A., & De Maeyer, P. (2020). Exploring the cognitive load of expert and novice map users using EEG and eye-tracking. International Journal of Geo-Information, 9(7), 429. https://doi.org/10.3390/ijgi9070429
   Web of Science ®Google Scholar
• Keskin, M., Ooms, K., Dogru, A. O., & De Maeyer, P. (2018). Digital sketch maps and eye-tracking statistics as instruments to obtain insights into spatial cognition. Journal of Eye Movement Research, 11(3), 1–20. https://doi.org/10.16910/JEMR.11.3.4
   Web of Science ®Google Scholar
• Kettunen, P., & Oksanen, J. (2018). Effects of unsupervised participation over the internet on a usability study about Map animation. Ch.7 In A. Robinson & A. Moore (Eds.), New directions in geovisual analytics: Visualization, computation, and evaluation (Proceedings of GVIZ 2018).
   Google Scholar
• Kiefer, P., Giannopoulos, I., Raubal, M., & Duchowski, A. (2017). Eye tracking for spatial research: Cognition, computation, challenges. Spatial Cognition and Computation, 17(1–2), 1–19. https://doi.org/10.1080/13875868.2016.1254634
   Web of Science ®Google Scholar
• Kieslich, P. J., Schoemann, M., Grage, T., Hepp, J., & Scherbaum, S. (2020). Design factors in mouse-tracking: What makes a difference? Behavior Research Methods, 52(1), 317–341. https://doi.org/10.3758/s13428-019-01228-y
   PubMed Web of Science ®Google Scholar
• Klingner, J., Kumar, R., & Hanrahan, P. (2008). Measuring the task-evoked pupillary response with a remote Eye-tracker. ETRA ‘08: Proceedings of the 2008 Symposium on Eye-Tracking Research and Applications: 69–72, https://doi.org/10.1145/1344471.1344489
   Google Scholar
• Koletsis, E., van Elzakker, C., Kraak, M.-J., Cartwright, W., Arrowsmith, C., & Field, K. (2017). An investigation into challenges experienced when route planning, navigating and wayfinding. International Journal of Cartography, 3(1), 4–18. https://doi.org/10.1080/23729333.2017.1300996
   Google Scholar
• Konovalov, A., & Krajbich, I. (2020). Mouse tracking reveals structure knowledge in the absence of model-based choice. Nature Communication, 11(1), 1893. https://doi.org/10.1038/s41467-020-15696-w
   PubMed Web of Science ®Google Scholar
• Koop, G., & Johnson, J. (2011). Response dynamics: A new window on the decision process. Judgment & Decision Making, 6(8), 750–758. https://doi.org/10.1017/S1930297500004186
   Web of Science ®Google Scholar
• Krassanakis, V., & Cybulski, P. (2019). A review on eye movement analysis in map Reading process: The status of the last decade. Geodesy and Cartography, 68(1), 191–209. https://doi.org/10.24425/gac.2019.126088
   Web of Science ®Google Scholar
• Krassanakis, V., & Cybulski, P. (2021). Eye-tracking research in cartography: Looking into the future. International Journal of Geo-Information, 10(6), 411. https://doi.org/10.3390/IJGI10060411
   Web of Science ®Google Scholar
• Krassanakis, V., & Kesidis, A. L. (2020). Matmouse: A mouse movements tracking and analysis toolbox for visual search experiments. Multimodal Technologies and Interaction, 4(4), 83. https://doi.org/10.3390/MTI4040083
   Google Scholar
• Lei, T.-C., Wu, S.-C., Chao, C.-W., & Lee, S.-H. (2014). Evaluating differences in spatial visual attention in wayfinding strategy when using 2D and 3D electronic maps. GeoJournal, 81(2), 153–167. https://doi.org/10.1007/S10708-014-9605-3
   Google Scholar
• Leube, A., Rifai, K., & Wahl, S. (2017). Sampling rate influences saccade detection in mobile eye-tracking of a Reading task. Journal of Eye Movement Research, 10(3), https://doi.org/10.16910/JEMR.10.3.3
   Google Scholar
• MacEachren, A. M., & Kraak, M.-J. (2001). Research challenges in geovisualization. Cartography and Geographic Information Science, 28(1), 3–12. https://doi.org/10.1559/152304001782173970
   Google Scholar
• Medyńska-Gulij, B., Gulij, J., Cybulski, P., Zagata, K., Zawadzki, J., & Horbinski, T. (2022). Map design and usability of a simplified topographic 2D Map on the smartphone in landscape and portrait orientations. International Journal of Geo-Information, 11(11), 577. https://doi.org/10.3390/ijgi11110577
   Web of Science ®Google Scholar
• Merriam, M. (1971). The role of the user in the map communication process: Eye noise and map design. Cartographica, 8(2), 22–28. https://doi.org/10.3138/H545-71X2-47G6-L1UK
   Google Scholar
• Mohd Said, M. S. & Forrest, D. (2019). User preferences for bus map design: evidence from a map usability study. In Proceedings of ICA Vol. 2. Copernicus GmbH. https://doi.org/10.5194/ica-proc-2-88-2019
   Google Scholar
• Montello, D. (2009). Cognitive research in GIScience: Recent achievements and future prospects. Geography Compass, 3(5), 1824–1840. https://doi.org/10.1111/j.1749-8198.2009.00273.x
   Google Scholar
• Morita, T. (1987). Measurement of eye movements for map design evaluation. Proceedings of 13th International Cartographic Conference (Morelia, Mexico) Vol. 1. 578–590. International Cartographic Association.
   Google Scholar
• Nielsen, J. (1993). Usability engineering. Academic Press.
   Google Scholar
• Nielsen, J. (2012). How many test users in a usability study? User Testing. https://www.nngroup.com/articles/how-many-test-users/.
   Google Scholar
• Olsen, A., & Matos, R. (2012). Identifying parameter values for an I-VT fixation filter suitable for handling data sampled with various sampling frequencies. Proceedings of ETRA 12 Symposium on Eye-Tracking Research and Applications: 317–320, https://doi.org/10.1145/2168556.2168625
   Google Scholar
• Ooms, K. (2016). Cartographic user research in the 21st century: Mixing and interacting. Paper 38 In T. Bandrova & M. Konecny (Eds.), Proceedings of 6th international conference on cartography and GIS (pp. 367–377). Bulgarian Cartographic Association.
   Google Scholar
• Ooms, K., de Maeyer, P., & Fack, V. (2014). Study of the attentive behavior of novice and expert map users using eye-tracking. Cartography and Geographic Information Science, 41(1), 37–54. https://doi.org/10.1080/15230406.2013.860255
   Web of Science ®Google Scholar
• Ooms, K., de Maeyer, P., & Fack, V. (2015). Listen to the Map user: Cognition, memory, and expertise. Cartographic Journal, 52(1), 3–19. https://doi.org/10.1179/1743277413Y.0000000068
   Web of Science ®Google Scholar
• Ooms, K., de Maeyer, P., Fack, V., Van Assche, E., & Witlox, F. (2012). Interpreting maps through the eyes of expert and novice users. International Journal of Geographical Information Science, 26(10), 1773–1788. https://doi.org/10.1080/13658816.2011.642801
   Web of Science ®Google Scholar
• Ooms, K., & Krassanakis, V. (2018). Measuring the spatial noise of a low-cost eye tracker to enhance fixation detection. Journal of Imaging, 4(8), 96. https://doi.org/10.3390/jimaging4080096
   Web of Science ®Google Scholar
• Opach, T., Gołe¸biowska, I., & Fabrikant, S. I. (2014). How do people view multi-component animated maps? Cartographic Journal, 51(4), 330–342. https://doi.org/10.1179/1743277413Y.0000000049
   Web of Science ®Google Scholar
• Pápay, G. (2017). Max Eckert and the foundations of modern cartographic praxis. Ch. 1 In A. Kent & P. Vujakovic (Eds.), The Routledge handbook of mapping and cartography (pp. 9–28). Routledge. https://doi.org/10.4324/9781315736822-2.
   Google Scholar
• Popelka, S., & Brychtova, A. (2013). Eye-tracking study on different perception of 2D and 3D terrain visualisation. Cartographic Journal, 50(3), 240–246. https://doi.org/10.1179/1743277413Y.0000000058
   Web of Science ®Google Scholar
• Popelka, S., Brychtova, A., Brus, J., & Voženílek, V. (2012). Advanced map optimalization based on eye-tracking. Ch. 5 In A. Bateira (Ed.), Cartography - A tool for spatial analysis. https://doi.org/10.5772/46190
   Google Scholar
• Popelka, S., Vondrakova, A., & Hujnakova, P. (2019). Eye-tracking evaluation of weather Web maps. International Journal of Geo-Information, 8(6), 256. https://doi.org/10.3390/ijgi8060256
   Web of Science ®Google Scholar
• Putto, K., Kettunen, P., Torniainen, J., Krause, C., & Sarjakoski, T. (2014). Effects of cartographic elevation visualizations and map-reading tasks on eye movements. Cartographic Journal, 51(3), 225–236. https://doi.org/10.1179/1743277414Y.0000000087
   Web of Science ®Google Scholar
• Qin, T., & Huang, H. (2022). Visual attention and neuro-cognitive processes in map use. Abstracts of ICA, 5, 114. https://doi.org/10.5194/ica-abs-5-114-2022
   Google Scholar
• Robinson, A. (1952). The look of maps. University of Wisconsin Press.
   Google Scholar
• Roth, R., Çöltekin, A., Delazari, L., Fonseca Filho, H., Griffin, A., Hall, A., Korpi, J., Lokka, I., Mendonça, A., Ooms, K., & van Elzakker, C. (2017). User studies in cartography: Opportunities for empirical research on interactive maps and visualizations. International Journal of Cartography, 3(Supp.1), 61–89. https://doi.org/10.1080/23729333.2017.1288534
   Google Scholar
• Scott, N., Green, C., & Fairley, S. (2016). Investigation of the use of eye-tracking to examine tourism advertising effectiveness. Current Issues in Tourism, 19(7), 634–642. https://doi.org/10.1080/13683500.2014.1003797
   Web of Science ®Google Scholar
• Siegrist, M., Ung, C.-Y., Zank, M., Marinello, M., Kunz, A., Hartmann, C., & Menozzi, M. (2019). Consumers’ food selection behaviors in three-dimensional (3D) virtual reality. Food Research International, 117, 50–59. https://doi.org/10.1016/J.FOODRES.2018.02.033
   PubMed Web of Science ®Google Scholar
• Slocum, T. A., Blok, C., Jiang, B., Koussoulakou, A., Montello, D., Fuhrmann, S., & Hedley, N. (2001). Cognitive and usability issues in geovisualization. Cartography and Geographic Information Science, 28(1), 61–75. https://doi.org/10.1559/152304001782173998
   Google Scholar
• Steinke, T. (1987). Eye movement studies in cartography and related fields. Cartographica, 24(2), 40–73. https://doi.org/10.3138/J166-635U-7R56-X2L1
   Google Scholar
• Šašinka, Č, Stachoň, Z., Čeněk, J., Šašinková, A., Popelka, S., Ugwitz, P., & Lacko, D. (2021). Comparison of the performance on extrinsic and intrinsic cartographic visualizations through correctness, response time and cognitive processing. PLoS ONE. Public Library of Science, 16(4), 1–23. https://doi.org/10.1371/journal.pone.0250164
   Web of Science ®Google Scholar
• usability.gov. (2019). Usability Testing | Usability.gov. Retrieved February 16, 2022. https://www.usability.gov/how-to-and-tools/methods/usability-testing.html.
   Google Scholar
• Valtakari, N., Hooge, I., Viktorsson, C., Nyström, P., Falck-Ytter, T., & Hessels, R. (2021). Eye tracking in human interaction: Possibilities and limitations. Behavioural Research, 53(4), 1592–1608. https://doi.org/10.3758/s13428-020-01517-x
   PubMed Web of Science ®Google Scholar
• van Elzakker, C. P. J. M., & Delikostidis, I. (2010). Use, user, and usability research for mobile geo-applications for personal orientation and navigation. IEEE International Professional Communication Conference, 121–130. https://doi.org/10.1109/IPCC.2010.5529824
   Google Scholar
• van Elzakker, C. P. J. M., & Ooms, K. (2017). Understanding map uses and users. Ch. 4 In A. Kent & P. Vujakovic (Eds.), The Routledge handbook of mapping and cartography (pp. 55–67). Routledge. https://doi.org/10.4324/9781315736822-6
   Google Scholar
• Wang, C., Chen, Y., Zheng, S., & Liao, H. (2019). Gender and age differences in using indoor maps for wayfinding in real environments. International Journal of Geo-Information, 8(1), 11. https://doi.org/10.3390/ijgi8010011
   Web of Science ®Google Scholar
• Wang, F. S., Wolf, J., Farshad, M., Meboldt, M., & Lohmeyer, Q. (2021). Object-Gaze distance: Quantifying near- peripheral gaze behavior in real-world application. Journal of Eye Movement Research, 14(1), https://doi.org/10.16910/jemr.14.1.5
   Google Scholar
• Wang, J., Antonenko, P., Celepkolu, M., Jimenez, Y., Fieldman, E., & Fieldman, A. (2019). Exploring relationships between Eye-tracking and traditional usability testing data. International Journal of Human–Computer Interaction, 35(6), 483–494. https://doi.org/10.1080/10447318.2018.1464776
   Web of Science ®Google Scholar
• Wang, S., Chen, Y., Yuan, Y., Ye, H., & Zheng, S. (2016). Visualizing the intellectual structure of Eye movement research in cartography. International Journal of Geo-Information, 5(10), 168. https://doi.org/10.3390/ijgi5100168
   Web of Science ®Google Scholar
• Wielebski, Ł, & Medyńska-Gulij, B. (2018). Graphically supported evaluation of mapping techniques used in presenting spatial accessibility. Cartography and Geographic Information Science, 46(4), 311–333. https://doi.org/10.1080/15230406.2018.1479311
   Web of Science ®Google Scholar
• Williams, L. G. (2007). The role of the user in the map communication process: Obtaining information from displays with discrete elements. Cartographica, 8(2), 29–34. https://doi.org/10.3138/A724-2K5V-2887-P200
   Google Scholar