Mixed-method usability investigation of ARROWS: augmented reality for roadway work zone safety

Abstract

This article explores the usability and user experience challenges of ARROWS, a novel augmented reality (AR) and wearable technology (WT) safety system for roadway work zones, an area with limited existing usability research. We utilized a mixed-method approach with two complementary experiments in indoor and outdoor settings, using the Wizard of Oz methodology and a high-fidelity prototype. We focused on identifying usability challenges, factors contributing to user experience and the distinct needs of highway workers, documenting results using the system usability scale (SUS), the rating scale mental effort (RSME) and a trust score. Participants rated the usability of ARROWS above average in both settings, while making a reasonable level of mental effort. The findings also indicate a significant correlation between perceived trust and usability, highlighting the importance of trust in user experience.

Keywords:

• usability
• Wizard of Oz
• augmented reality
• user experience
• worker safety
• highway work zone

Acknowledgements

The authors would like to acknowledge Sheila Johnson and the Minnesota Department of Transportation (MnDOT) for their help with this study.

Disclosure statement

No potential conflict of interest was reported by the authors.

Additional information

Funding

This work was supported by National Science Foundation [Grant Number 1932524].