Usability of a navigation application for travel in Quebec City with wheeled mobility device and, further validation of the Evaluation of satisfaction with geospatial assistive technology

Abstract

Purpose

Knowledge of route accessibility is indispensable for “wheeled mobility device” users to travel safely and efficiently; however, current navigation technologies hardly provide adapted information for this population. Aims of the study were to collect data on the usability of a navigation application and to propose a version 1.0 of the Evaluation of satisfaction with geospatial assistive technology (ESGAT), by addressing the criterion, construct and cross-cultural validities.

Method

A filmed field trial and a methodological study were conducted in parallel. Thirty wheeled mobility device users were filmed planning and making a 10-minute known journey using the HERE WeGo app. The ESGAT, ÉSTGA (French version) and the Computer System Usability Questionnaire were administered. A video observation grid addressed the effectiveness and efficiency during the journey. Descriptive, correlation and multiple match analyses were performed.

Results

Fourteen men and 16 women averaging 45.9 years old tried out HERE WeGo; 14 were powered wheelchair users. Usability of the app was moderate (good effectiveness, moderate efficiency and quite satisfied). The criterion validity of the ÉSTGA was good (r = 0.598; p < 0.001). The construct validity was average considering the results for factor 1 (α = 0.789, acceptable), factor 2 (α = 0,586, low) and factor 3 (α = 0.409, unacceptable). The cross-cultural validity (French vs English) was moderate (r = 0.861; p < 0.001).

Conclusion

ESGAT and ÉSTGA 1.0 questionnaires are now available in English and French with a total mean score (11 items), an informatics subscore (mean of 5 items) and a geomatic subscore (mean of 6 items). Their validation should be pursued with new navigation applications.

IMPLICATIONS FOR REHABILITATION

• Clinicians should ask their clients using a wheeled mobility device to test navigation applications to ensure their safety and complete the Evaluation of satisfaction with geospatial assistive technology (ESGAT 1.0), also available in French.

• Clinicians should inquire about satisfaction for items addressing informatics (Ease of access, Learnability, Hands-free function, Ease of use, Transportability and Appearance) and items addressing geomatic (Content, Geographic information, Effectiveness, Efficiency, Real-time navigation assistance, Aspect of security).

• Rehabilitation clinicians should inquire about the efficiency of the navigation app, considering avoiding or announcing potential obstacles such as: travelling on the street for a long portion of the trip and not on the sidewalk; verbal indication too soon or too late; incorrect indication; damaged, and congested sidewalk.

Keywords:

• Mobile device
• geospatial assistive technology
• usability engineering
• wheelchair user
• scooter
• wheeled mobility
• mobility impairment
• urban accessibility
• user interface

Acknowledgements

A huge thanks to the Regroupement des personnes handicapées de la région 03 (ROP-03), Josiane Lettre from Cirris, Comité d’action des personnes vivant des situations de handicap (CAPVISH) and Adaptavie for the recruitment assistance. The authors are immensely grateful to Brad McFadyen, PhD and Krista Best, PhD both kinesiologists and researchers in mobility at the Cirris, for helping with the translations of items for the cross-cultural validation. The authors also thank Simon Richard, for recruiting, collecting, and analyzing data from the first eight participants in the study.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This project was funded under the Office des personnes handicapées du Québec and the Quebec Rehabilitation Research Network [Funding Reference Number: 30-04-2018]. François Routhier is Senior Research Scholar of the Quebec Health Research Funds (FRQ-S).