ABSTRACT
A multi-task paradigm involving dual tracking for hand and foot and a discrete choice response task with signals presented in different modalities (visual–visual versus auditory–visual) was used to study the effect of spatial compatibility for various display-control configurations on performance. Delay in multi-task processing was observed when more than one task demanded the same cognitive resources for processing. Compatibility between stimuli and responses for the discrete response task was found to significantly affect the amount of delay in overall multi-task performance. When two fingers of the left hand were used for responses in the spatial compatibility task, there was an absence of salient frame of reference in the horizontal right–left dimension. Compared with the visual–visual signal presentation, the auditory–visual signal presentation resulted in significantly higher hand-tracking errors, response times, and response errors, implying that mixed-modality stimulus presentation for a discrete response task has an adverse effect on multi-task time-sharing, probably due to response conflict and the effects of shifting between visual and auditory modalities across trials. We conclude by providing ergonomics design implications and recommendations for multi-task environments to facilitate human–machine system design and improve overall system performance.
Funding
The work described in this paper was fully supported by a grant from the City University of Hong Kong [grant number SRG 7004079].
Additional information
Funding
Notes on contributors
X.Q. Kang Stefanie
X. Q. Kang Stefanie obtained her Bachelor Degree in Industrial Design at Xi’an JiaoTong University in 2010. She was then recommended by Xi’an Jiao Tong University-City University of Hong Kong to study for a PhD degree since 2011. Now she focuses on the study of human–computer interaction.
Steve N.H. Tsang
Steve N. H. Tsang earned his PhD in Human Factors and Ergonomics at City University of Hong Kong. He earned his BEng in Manufacturing Systems Engineering from the same university.
Alan H.S. Chan
Alan H. S. Chan obtained his BSc, MPhil and PhD in human factors studies from Hong Kong University. He has a wide range of research interests in work design, human factors and ergonomics, and occupational safety and health.
S.L. Liu
S. L. Liu is a professor in the School of Management at Xi’an JiaoTong University (XJTU). He obtained his BSc, MPhil and PhD in Management Engineering from XJTU. He has hosted two Natural Science Foundation Projects, and won the National Science and Technology Progress Second Prize.