Study about the appropriate number of participants in map user studies

ABSTRACT

The minimum and the adequate number of participants in experiments with maps can vary significantly according to the characteristics of the participants, the maps, and especially the test’s purpose. In this sense, the estimation of the adequate number of participants employed in carrying out tests involving map users bases the problem of this research. The study’s hypothesis presupposes that it is possible to establish the number of participants for each group of methods of experiments with similar characteristics that group the tests. To this end, to compare terms found in the Web of Science database with those informed in the title, abstract, introduction, and methodology of 200 scientific articles published in the area of cartography, whose subject is related to map users, the research performed an analytical review of the works. As a result, the analysis made it possible to select 85 publications, such as adequacy to the subject of study, according to the methods used. The results obtained from the research make it possible to define the number of participants according to the purpose of the applied test when evaluating maps.

RÉSUMÉ

Les nombres de participants minimum et approprié pour réaliser des expérimentations sur des cartes peuvent varier de façon significative en fonction des caractéristiques des participants, des cartes et surtout de l'objectif du test. C'est pourquoi l'estimation du nombre approprié de participants requis pour conduire un test impliquant des utilisateurs de cartes est le cœur de cette recherche. L'hypothèse de l'étude présuppose qu'il est possible de fixer le nombre de participants pour chaque type de méthodes expérimentales avec des caractéristiques similaires qui permettent de regrouper les tests. Pour cela nous avons effectué une analyse critique de travaux pour comparer les termes trouvés dans la base de données Web Of Science avec ceux trouvés dans les titres, résumés, introductions et méthodologies de 200 articles scientifiques publiés dans le domaine de la cartographie sur le sujet des utilisateurs de cartes. Comme résultat, l'analyse a permis de sélectionner 85 publications, en adéquation au sujet de l'étude, en fonction de la méthode utilisée. Les résultats obtenus à partir de cette recherche permettent de définir le nombre de participants en fonction de l'objectif du test appliqué lors de l'évaluation des cartes.

KEYWORDS:

• Usability in cartography
• user testing
• map users

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The first author acknowledges the Coordenação de Aperfeiçoamento de Pessoal de Nível Superior – CAPES by encouraging research and financial support, process 88887.601430/2021-00. The second author thanks the National Council for Scientific and Technological Development (CNPq) for the financial incentive, process 142253/2020-0. To CNPq, for the Research Productivity grand of the last author, process 310312/2017-5.

Notes on contributors

Vinicius Bergmann Martins

Vinicius Bergmann Martins Academic of the postgraduate program in Geodetic Sciences at the Federal University of Paraná (UFPR) – Curitiba/PR, enrolled as a doctoral student working in the area concentrated in Cartography and Geographic Information Systems (GIS). Master in Geodetic Sciences from UFPR (2019–2021). Bachelor's degree in Cartographic and Surveying Engineering from the Federal University of Pampa (UNIPAMPA) Campus - Itaqui/ RS (2014–2018).

Fabrício Rosa Amorim

Fabrício Rosa Amorim Graduated in Surveying and Cartographic Engineering (2015) from the Federal University of Uberlândia – Campus Monte Carmelo. Master in Cartographic Sciences from Universidade Estadual Paulista (FCT – UNESP), Presidente Prudente campus. Doctoral student in Geodetic Sciences at the Federal University of Paraná – UFPR. Developer of cartographic systems and researcher in Cognition (Visual and Spatial Perception) for navigation tasks in static and dynamic digital maps and in Augmented Reality Systems (ARS). Currently, he is an Assistant Professor at the Federal University of Piauí, assigned to the Department of Transport.

Marcio Augusto Reolon Schmidt

Marcio Augusto Reolon Schmidt Graduated in Cartographic Engineering, Master's and Doctorate in Geodetic Sciences from the Federal University of Paraná. He has professional experience in the field of Geosciences and Conservation, working in Geoprocessing for regional planning, Cartographic Visualization and Smart Methods in Remote Sensing. He works in artificial intelligence research lines through specialist systems for GIS and Cartography, Visualization of spatial data and integration of laserscanning and GIS technologies. He is a professor at the Faculty of Civil Engineering at the Federal University of Uberlândia.

Luciene Stamato Delazari

Luciene Stamato Delazari Full Professor at the Federal University of Paraná, with experience in the field of Cartography and GIS. Her research focuses on interactive, online, and mobile map design and visualization. She currently serves as the Vice Chair of the ICA Commission on User Experience and coordinates the Center for Applied Research in Geoinformation – CEPAG (www.cepag.ufpr.br). Member of the CNPq Geosciences Advisory Committee (2020–2023).