Applying Functional Animation to Pictorial Symbols for Supporting P300–Brain–Computer Interface Access to Augmentative and Alternative Communication Devices by Children

Abstract

Motion techniques, such as highlighting communication items via flip and/or zoom motion, may support BCI-AAC success and comfort for those using P300 brain–computer interface techniques for augmentative and alternative communication device access (BCI-AAC). However, the utilization of motion in P300-BCI-AAC for children is largely unexplored. Therefore, the aims of this investigation are to provide initial insights into the impacts of functional pictorial symbol animation on (a) event-related potentials underlying P300-BCI-AAC performance and (b) children’s user experience. Participants completed two conditions: (1) a static item condition, and (2) a functional animation condition. Following completion, participants completed Likert scale ratings of factors like visual appeal. Animation significantly increased parieto-occipital P200/P300 amplitudes and delayed parieto-occipital N200, P200/P300, and N400 latencies. Further, animation raised ratings of visual appeal to a level approaching significance. Static highlighting significantly increased N400 amplitudes. Findings provide early insights into neural activity underlying P300-BCI-AAC highlighting of pictorial symbols via animation in children and justify further evaluation.

Acknowledgements

The authors would like to thank Austin Spoor, Amirsalar Mansouri, Hannah Gaffney, Kylie Weckwerth, Marj McKinty, and Dr. Yingying Wang for their contributions to the project.

Disclosure statement

Dr. Pitt receives a salary from the University of Nebraska–Lincoln. The authors report no competing interests to declare.

Additional information

Funding

The project was supported by the Nebraska Tobacco Settlement Biomedical Research Development Fund and a Layman award from the University of Nebraska-Lincoln.

Notes on contributors

Kevin M. Pitt

Kevin M. Pitt is an assistant professor in Communication Sciences and Disorders, and PI of the AAC Translation (AACT) Laboratory. He is interested in translating the latest AAC access advancements such as brain-computer interfaces out of the laboratory setting by incorporating clinical procedures, stakeholder input, and principles governing display design.

Zachary J. Cole

Zachary Cole is a PhD student in the Psychology-Neuroscience and Behavior program at the University of Nebraska-Lincoln. Zach has a background in kinesiology, psychology and electroencephalography. He is interested in wearable technologies, and interactions between health, exercise, and executive function.

Joshua Zosky

Joshua Zosky is a PhD student in the Psychology-Neuroscience and Behavior program, and a research assistant in the AACT Laboratory. He is interested in developing novel technologies within the realm of clinical treatment, neuroimaging, and perception. Specifically, he would like to translate research findings and technology for low-cost real-world applications.