ABSTRACT
In this study, a dynamic user interface (UI) is proposed in visual P300 Brain-Computer Interface (BCI) based environmental control system. A head-mounted Augmented Reality (AR) glass is used as the interactive media, which is used to assists the BCI system to build the dynamic UI with the scene in subject’s field of view. In the dynamic UI, based on the objects detected by the AR glass, options are dynamically generated. The subject can assign tasks by selecting different options in the dynamic UI. Five subjects successfully completed the task of controlling household appliances and navigating wheelchairs to designated destinations. Compared to static UI, the proposed dynamic UI has a 17.4% improvement in time delay. On average, only 1.9% of the commands resulted in incorrect operations. The dynamic UI makes progress in reducing time delay and incorrect operations. The proposed system provides a brand-new interactive method in BCI based applications.
Additional information
Funding
Notes on contributors
Saisai Zhong
Saisai Zhong was born in Jiangsu, China, in 1994. He received the B.Sc. degree from Xi’an Jiaotong University in 2016. He received the M.Sc. degree from the National University of Defense Technology, Changsha, China, in 2018. His research interests include brain-computer interface and machine learning.
Yadong Liu
Yadong Liu was born in Gansu, China, in 1977. He received the B.Sc. and Ph.D. degrees from the National University of Defense Technology, Changsha, China, in 2000 and 2006, respectively. His research interests include image/signal processing, computer/biologicalvi-sion, system identification and control, and cognitive science.
Yang Yu
Yang Yu was born in Liaoning, China, in 1987. He received the B.Sc. degree from Tianjin University, in 2010, and the M.Sc. degree from the National University of Defense Technology, China, in 2012, where he is currently working towards the Ph.D degree. His research Interests include brain-computer interface,and neuroimage.
Jingsheng Tang
Jingsheng Tang was born in Changsha, China, in 1988. He received his B.Sc. degree from Changsha University of Science & Technology in 2011. He received his Ph.D from the National University of Defense Technology, China, in 2018. His research interests include brain–computer interface.
Zongtan Zhou
Zongtan Zhou was born in Henan, China, in 1969. He received the B.Sc., M.Sc. and Ph.D degrees from National University of Defense Technology, China, in 1990, 1994 and 1998, respectively. His research interests include brain-computer interface, cognitive neuroscience, image/signal processing, computer/biological vision and neural networks.
Dewen Hu
Dewen Hu was born in Hunan, in 1963. He received the B.Sc. and M.Sc. degrees from Xi’an Jiaotong University, in 1983 and 1986, respectively. He got his Ph. degree from the National University of Defense Technology in 1999. His research interests include cognitive science, brain-computer interface, and neural networks.