Examining sensory ability, feature matching and assessment-based adaptation for a brain–computer interface using the steady-state visually evoked potential

Abstract

Purpose: We investigated how overt visual attention and oculomotor control influence successful use of a visual feedback brain-computer interface (BCI) for accessing augmentative and alternative communication (AAC) devices in a heterogeneous population of individuals with profound neuromotor impairments. BCIs are often tested within a single patient population limiting generalization of results. This study focuses on examining individual sensory abilities with an eye toward possible interface adaptations to improve device performance.

Methods: Five individuals with a range of neuromotor disorders participated in four-choice BCI control task involving the steady state visually evoked potential. The BCI graphical interface was designed to simulate a commercial AAC device to examine whether an integrated device could be used successfully by individuals with neuromotor impairment.

Results: All participants were able to interact with the BCI and highest performance was found for participants able to employ an overt visual attention strategy. For participants with visual deficits to due to impaired oculomotor control, effective performance increased after accounting for mismatches between the graphical layout and participant visual capabilities.

Conclusion: As BCIs are translated from research environments to clinical applications, the assessment of BCI-related skills will help facilitate proper device selection and provide individuals who use BCI the greatest likelihood of immediate and long term communicative success. Overall, our results indicate that adaptations can be an effective strategy to reduce barriers and increase access to BCI technology. These efforts should be directed by comprehensive assessments for matching individuals to the most appropriate device to support their complex communication needs.

Implications for Rehabilitation

• Brain computer interfaces using the steady state visually evoked potential can be integrated with an augmentative and alternative communication device to provide access to language and literacy for individuals with neuromotor impairment.

• Comprehensive assessments are needed to fully understand the sensory, motor, and cognitive abilities of individuals who may use brain-computer interfaces for proper feature matching as selection of the most appropriate device including optimization device layouts and control paradigms.

• Oculomotor impairments negatively impact brain-computer interfaces that use the steady state visually evoked potential, but modifications to place interface stimuli and communication items in the intact visual field can improve successful outcomes.

Keywords:

• Brain-computer interface (BCI)
• steady-state visually evoked potential
• SSVEP
• AAC
• feature matching

Acknowledgements

We would like to thank all of the participants for their time and support of this research

Disclosure statement

The authors report no conflicts of interest.

Additional information

Funding

This work was supported in by the National Institutes of Health; National Institute on Deafness and Other Communication Disorders (NIDCD) [R03-DC011304]; and CELEST, a National Science Foundation Science of Learning Center; Division of Behavioral and Cognitive Sciences; under Grant NSF [SMA-0835976].