2,764
Views
8
CrossRef citations to date
0
Altmetric
Research on Products and Devices

Brain-Computer interfaces for communication: preferences of individuals with locked-in syndrome, caregivers and researchers

ORCID Icon, ORCID Icon, , ORCID Icon & ORCID Icon
Pages 963-973 | Received 16 Mar 2021, Accepted 19 Jul 2021, Published online: 12 Aug 2021

Abstract

Objectives

The development of Brain-Computer Interfaces to restore communication (cBCIs) in people with severe motor impairment ideally relies on a close collaboration between end-users and other stakeholders, such as caregivers and researchers. Awareness about potential differences in opinion between these groups is crucial for development of usable cBCIs and access technology (AT) in general. In this study, we compared the opinions of prospective cBCI users, their caregivers and cBCI researchers regarding: (1) what applications would users like to control with a cBCI; (2) what mental strategies would users prefer to use for cBCI control; and (3) at what stage of their clinical trajectory would users like to be informed about AT and cBCIs.

Methods

We collected data from 28 individuals with locked-in syndrome, 29 of their caregivers and 28 cBCI researchers. The questionnaire was supported with animation videos to explain different cBCI concepts, the utility of which was also assessed.

Results

Opinions of the three groups were aligned with respect to the most desired cBCI applications, but diverged regarding mental strategies and the timing of being informed about cBCIs. Animation videos were regarded as clear and useful tools to explain cBCIs and mental strategies to end-users and other stakeholders.

Conclusions

Disagreements were clear between stakeholders regarding which mental strategies users prefer to use and when they would like to be informed about cBCIs. To move forward in the development and clinical implementation of cBCIs, it will be necessary to align the research agendas with the needs of the end-users and caregivers.

    IMPLICATIONS FOR REHABILITATION

  • Brain-Computer Interfaces may offer people with severe motor impairment a brain-based and muscle-independent approach to control communication-technology. The successful development of communication BCIs (cBCIs) relies on a close collaboration between end-users and other stakeholders, such as caregivers and researchers.

  • Our work reveals that people with locked-in syndrome (end-users), their caregivers and researchers developing cBCIs agree that direct and private forms of communication are the most desired cBCI applications, but disagree regarding the preferred mental strategies for cBCI control and when to be informed about cBCIs.

  • Animation videos are an effective tool for providing information to individuals, independent of their level of health literacy, regarding the concept of cBCIs and mental strategies for control.

  • The misalignment in opinions of different groups of stakeholders about cBCIs strengthens the argument for a user-centered design approach in the development of cBCIs and access technology designed for daily life usage.

Introduction

Assistive technology (AT) has been developed to facilitate and/or enable communication in people with paralysis and communication impairments, serving those with some form of (residual) voluntary movement control [Citation1,Citation2]. For individuals with poor volitional control of their muscles or with no movement control (locked-in syndrome; LIS) such technology often falls short. In these cases, Brain-Computer Interfaces (BCIs) may present the only alternative to establish communication [Citation3], as BCIs are intended to be controlled without any residual muscle activity.

The effectiveness of cBCIs in the motor-impaired target population largely depends on the quality of the BCI system but also on its acceptance by the end-user [Citation4–10]. There is an increasing awareness about the importance of accommodating the wishes, needs and opinions of end-users in the design of BCIs [Citation4,Citation11]. However, the proper incorporation of such “User-Centred Design” requires other stakeholders, such as researchers and caregivers, to be aware of these factors. Earlier studies have focussed on the opinion of caregivers [Citation6,Citation12] and rehabilitation professionals [Citation13], in order to evaluate, inform and define design requirements of BCIs. However, a direct comparison between the user’s opinion and the opinion of their caregivers and cBCI researchers has not yet been conducted.

In a previous study we assessed the opinion of prospective cBCI users about which applications users would like to control with a cBCI, which mental strategies users would prefer to use for cBCI control, and when during the clinical trajectory users would like to be informed about cBCIs and AT in general [Citation14]. For that, we administered a questionnaire to 28 Dutch individuals with LIS (prospective users) that incorporated animation videos specifically designed to introduce and explain cBCIs. We showed that, despite differences in aetiology, individuals with LIS agree with respect to applications, mental strategies and timing of information [Citation14].

In the current report, we extend these results by including caregivers and researchers and compare their opinions on the three above-mentioned topics with those of the users. Furthermore, given that (most) cBCIs are still in the development stage and the concept of mental strategies for BCI control can be difficult to convey, we assessed the clarity and comprehension of the animation videos as a tool to introduce and explain cBCIs.

Material and methods

A questionnaire was administered to each of the three different target groups: prospective cBCI users; their caregivers; and a group of international cBCI researchers. The questionnaires were implemented on the Qualtrics Survey platform (www.qualtrics.com/). The study was assessed by the local ethics board of the Medical University Centre (UMC) Utrecht, who determined it to be exempt from the Dutch Medical Scientific Research Act. Following standard UMC Utrecht policy, all participants (or caregivers on behalf of the users) gave written informed consent to participate in the study at the beginning of the home visit (users) or by completing and submitting the online questionnaire (caregivers and researchers).

Participants

Prospective users

We included 28 Dutch individuals with LIS and administered the questionnaire in Dutch during a 3-hour home visit. The user population was divided into two groups depending on the aetiology underlying their motor impairment: neuromuscular disorder (NMD; e.g., amyotrophic lateral sclerosis; 13 participants) or sudden onset (SO; e.g., trauma or stroke; 15 participants). Detailed information about the home interview, data description, demographics and results regarding the user group can be found in [Citation14].

Caregivers

An online questionnaire (in Dutch) was sent to 41 primary caregivers (professional caretakers and family members) who provide daily care to one of the included prospective users. In total, 29 caregivers completed the questionnaire (71% inclusion rate). Eight users were associated with one caregiver each, 9 were matched with two caregivers and one was matched with three caregivers. The caregiver group was divided into two groups depending on the type of disorder of the user they provided care for: 15 NMD-related caregivers and 14 SO-related caregivers.

Researchers

An online questionnaire (in English) was sent to 70 international BCI researchers whose work was related to both cBCIs and individuals with communication impairment. Email addresses were obtained from BCI research groups, from publications on the topic of cBCI and by referral from other BCI researchers. Approached researchers were spread over 15 countries and 48 different institutions (maximum 4 researchers per institution). To avoid biased responses, the authors of this manuscript and their respective research teams were not included in the study. In total, 29 researchers (41% inclusion rate) completed and submitted the questionnaire.

Structure of the questionnaire

All three questionnaires consisted of five sections: (1) demographics, (2) introduction to cBCI, (3) cBCI applications, (4) mental strategies and (5) time of information. The users’ and caregivers’ questionnaires were written in Dutch, while the researchers’ questionnaire was written in English. Different sentence forms were used to indicate if respondents were asked to give their own opinion, or to convey their idea about what and end-user would prefer. In total, 9 animation videos (21–110 s in duration) were used for the introduction of the concept of cBCI and for explaining 8 different mental strategies for cBCI control. The animation videos were tailored for this study, narrated in Dutch or English and reviewed by one individual with LIS and the co-authors’ research teams. In order to assess the quality of the animation videos, we asked the BCI researchers for feedback in an additional section (see 2.2.6). In the questionnaire, the order in which the applications, mental strategies and respective ranking questions were presented was randomised and therefore differed between participants.

Section 1: demographics

Participants were asked to answer a list of multiple-choice/short-answer questions on their demographics. When applicable, more than one multiple-choice answer could be selected and a free-text field was available to accommodate other options.

Section 2: introduction

Communication BCIs were introduced by means of an animation video (), which explained the concept of a BCI in general and of cBCIs in particular. Of note, we described a conceptually ideal system that would be 100% accurate and 100% accepted by the users to ensure that participants would focus on evaluating the mental strategy rather than the efficacy of the cBCI.

Figure 1. Representative screenshots of the animation videos used in the questionnaire. Three illustrative screenshots of the videos used to explain the concept of BCIs, BCI-based communication and mental strategies that can be used to control the BCI. For simplicity and consistency across mental strategies, we used a spelling matrix as a control application (middle panel) and a button press (and subsequent letter selection) as a control output (upper panel).

Figure 1. Representative screenshots of the animation videos used in the questionnaire. Three illustrative screenshots of the videos used to explain the concept of BCIs, BCI-based communication and mental strategies that can be used to control the BCI. For simplicity and consistency across mental strategies, we used a spelling matrix as a control application (middle panel) and a button press (and subsequent letter selection) as a control output (upper panel).

Section 3: cBCI applications

We asked the opinion about 6 possible cBCI applications, including private conversation and writing (e.g., email, chat, diary), direct personal communication (e.g., voice synthesis, direct conversation), environmental control (e.g., home appliances, alarm), general computer use (e.g., playing games, internet surfing, social media), artistic expression (e.g., painting, producing music) and emotions and facial expressions (e.g., expressing feelings, emoji’s). As users were currently using AT with specific applications, we considered these applications as the optimal target for a cBCI. Hence, we asked users what applications their current AT device provided and how often they used these applications. Lastly, we asked users to rank all applications from most preferred to least preferred. Caregivers and researchers were asked to consider their knowledge about the user’s opinions and preferences and indicate (1) which applications they thought the users would find essential in a cBCI, (2) how often they thought these would be used by the user and (3) to rank the application from the most preferred by the user to the least preferred.

Section 4: mental strategies

We identified eight mental strategies that can be used for cBCI control: hand movement attempt, other body part movement attempt, attempted speech, counting backwards, visual imagery, visual P300, auditory P300 and steady-state visual evoked potentials (SSVEPs). Each mental strategy was presented using a specific animation video (). For simplicity and to avoid bias across mental strategies, the control application (spelling matrix with automatic scanning) and the control output (button press and subsequent letter selection) were the same for every mental strategy. After each mental strategy video, the respondent was asked to imagine using that particular mental strategy and rate it on a 5-point Likert scale on difficulty and enjoyability. The clarity of the mental strategies as illustrated by the videos was also rated using the same scale. In this section of the questionnaire we considered the caregivers as a “control group”, in that they were asked to rate each paradigm from their own perspective. As the opinion of the researchers about the paradigms were likely biased by their own research topics, we asked them instead to report what they thought the users would rate. In the end of the fourth section, we asked all participants to rank the top four mental strategies from their own (users and caregivers) or the users’ perspective (researchers).

Section 5: time of information

In this section we separated the results by type of aetiology (NMD and SO) and compared the opinions of the three groups. We asked the users, caregivers and researchers in which phase of their medical history they/the user would like to be informed about AT aids including cBCIs. Namely, “as soon as possible” after diagnosis/incident, “before rehabilitation” (possible period between incident/hospitalization and start of therapy), “during rehabilitation”, “after rehabilitation”, “when no residual movement/speech is available” or an open field for another timepoint. For simplicity and clarity, in the researchers’ questionnaire we repeated this question and asked the researchers to respond separately for the SO and the NMD situation. For both users and caregivers this separation was not necessary as they were asked to reflect on their own situation and their answers could be linked to only one group.

Section 6: BCI researchers’ feedback

Besides the assessment of the videos’ clarity in section 4 of the questionnaire, we asked the BCI researchers for their opinion about how well the videos in general introduce cBCIs to prospective users and other stakeholders, such as caregivers, family members and rehabilitation centres.

Data analysis

Descriptive statistics and open answers

Descriptive statistics were used to describe the results of the three questionnaires. Percentages were used for comparison between groups. These were computed relative to the total number of respondents per group (N = 28 for users; N = 29 for caregivers; and N = 29 for researchers) or to a subgroup of participants when applicable. Non-parametric Kruskal-Wallis and post-hoc Mann-Whitney tests were used to compare Likert scale responses between groups.

Ranking questions

As in our previous report [Citation14], we quantified the importance or preference of the participants for specific applications and mental strategies (ranking questions) using a centre-of-mass (COM) score. The COM scores vary between 0 and the total number of ranked options (4 or 6), such that the larger COM scores correspond to a higher preference. Meaningful differences in COM values across applications or mental strategies were identified using a Monte Carlo randomisation method to estimate the expected variance of the scores when ranking would be performed randomly (see [Citation14] for more details).

Results

Demographics

Of the 28 users (52% female), 68% lived at home and 32% in a nursing home; about half were locked-in as a result of NMD (46%) and the other half due to an SO event (54%) (). Of the 29 caregivers (median age 52 years old; range 20–85 years old; 79% female), 52% were family members, 52% cared for users with NMD and 48% for users with SO (). More than half of the caregivers and users were familiar with the BCI concept (62% and 86%, respectively). Of the 28 BCI researchers (median age 48 years old, range 27–73 years old; 69% male), most worked either in North-America (41%) or in Europe (48%) (). As expected, the majority worked with or close to individuals with LIS (83%). In addition, 93% of the researchers worked or had experience with cBCIs. The majority used EEG signals (96%) and worked with P300 (74%) and/or sensorimotor rhythms (48%) as mental strategies for cBCI control ().

Figure 2. Demographic description of the users, caregivers and researchers. Demographic information of the users (N = 28), caregivers (N = 29) and researchers (N = 29) included in this study was extracted from Section 1 of the questionnaire. (A) Information (in percentage) about the user’s gender (male, female), age group (50 years old, >50 years old), living situation (at home or at a nursing home), aetiology (neuromuscular disease, NMD; sudden onset, SO) and whether they were naïve to BCI. (B) Information (in percentage) about the caregiver’s gender (male, female), age group (50 years old, >50 years old), personal/professional relation to the user (family member, professional caregiver), type of LIS of individual the caregiver takes care of (neuromuscular disease, NMD; sudden onset, SO), and whether they were naïve to BCI. (C) Information (in percentage) about the researcher’s gender (male, female), age group (50 years old, >50 years old), continent of residence (Asia, Europe or North America), and whether they worked with individuals with locked-in syndrome (LIS) and communication Brain-Computer Interfaces (cBCIs). Bar plots indicate most used signal acquisition techniques by researchers in their line of work, as well as the most investigated mental strategies for controlling a BCI.

Figure 2. Demographic description of the users, caregivers and researchers. Demographic information of the users (N = 28), caregivers (N = 29) and researchers (N = 29) included in this study was extracted from Section 1 of the questionnaire. (A) Information (in percentage) about the user’s gender (male, female), age group (≤50 years old, >50 years old), living situation (at home or at a nursing home), aetiology (neuromuscular disease, NMD; sudden onset, SO) and whether they were naïve to BCI. (B) Information (in percentage) about the caregiver’s gender (male, female), age group (≤50 years old, >50 years old), personal/professional relation to the user (family member, professional caregiver), type of LIS of individual the caregiver takes care of (neuromuscular disease, NMD; sudden onset, SO), and whether they were naïve to BCI. (C) Information (in percentage) about the researcher’s gender (male, female), age group (≤50 years old, >50 years old), continent of residence (Asia, Europe or North America), and whether they worked with individuals with locked-in syndrome (LIS) and communication Brain-Computer Interfaces (cBCIs). Bar plots indicate most used signal acquisition techniques by researchers in their line of work, as well as the most investigated mental strategies for controlling a BCI.

cBCI applications

Users, caregivers and researchers showed similar preference rankings for all applications (; differences between groups smaller than the Monte Carlo variance 0.32), with the exception of “environmental control” (difference of 0.33 between users and researchers). “Direct personal communication”, “private conversation & writing” and “general computer use” were the top three ranked applications. Comparison of the percentage of users using a certain application to the percentage of caregivers and researchers indicating that application as essential to be provided by a cBCI showed that all applications (except “environmental control” and “artistic expression”) were selected less frequently by caregivers and researchers than by users (). When compared with how often the users used the applications, the caregivers’ estimation of frequency of use was more often in line with the one reported by the users than that of researchers; with the exception of the frequency of use of “emotions & facial expressions” and “artistic expression”, which was estimated to be higher by caregivers and researchers ().

Figure 3. Comparison between users’ current AT application and expected cBCI applications. (A) Ranking of preferred applications to be supported by a cBCI, using the centre-of-mass (COM) metric. Meaningful differences between groups were estimated using the Monte Carlo variance indicated on the top right corner (0.32). In addition, the size of the Monte Carlo variance is indicated on top of the one bar that showed a larger-than-Monte-Carlo-variance difference from users. Rating scales ranged from 1 (least preferred) to 6 (most preferred). (B) Percent of users that have a specific AT application currently available at home (dark green, highlighted with black line) compared with the importance of these applications as rated by the caregivers (green) and researchers (light green). (C) Median and median absolute deviation (error bars) of how often each application was (estimated to be) used. Of note, the frequency of usage of each application was computed from the number of participants that selected that specific application in B (grey bars; units in the right-side y-axis; copies of the information given in B).

Figure 3. Comparison between users’ current AT application and expected cBCI applications. (A) Ranking of preferred applications to be supported by a cBCI, using the centre-of-mass (COM) metric. Meaningful differences between groups were estimated using the Monte Carlo variance indicated on the top right corner (0.32). In addition, the size of the Monte Carlo variance is indicated on top of the one bar that showed a larger-than-Monte-Carlo-variance difference from users. Rating scales ranged from 1 (least preferred) to 6 (most preferred). (B) Percent of users that have a specific AT application currently available at home (dark green, highlighted with black line) compared with the importance of these applications as rated by the caregivers (green) and researchers (light green). (C) Median and median absolute deviation (error bars) of how often each application was (estimated to be) used. Of note, the frequency of usage of each application was computed from the number of participants that selected that specific application in B (grey bars; units in the right-side y-axis; copies of the information given in B).

Mental strategies

Results show that attempted speech was equally favoured by caregivers (here considered abled control group) and users. Caregivers () showed a meaningfully higher preference than users for visual strategies such as P300 and SSVEP and visual imagery (larger than Monte Carlo variance of 0.28), and considerably lower preference for body part action generation (attempted hand or body movement) than users. Similar differences were found between users and researchers () for the visually induced paradigms (P300 and SSVEP). In contrast to the caregivers, researchers considered attempted speech less favourable than the users, albeit still among the four most favoured strategies. The most chosen body parts across the groups were the feet (9 users and 10 researchers) and toes (7 users and 8 caregivers). Overall, users found all strategies very easy to execute (). Furthermore, caregivers and/or researchers rated attempted body movement, visual imagery and counting backwards as significantly more difficult than the users (Kruskal Wallis test for 3 groups and 8 strategies, p < 0.05 Bonferroni corrected for N = 8; Mann-Whitney test within strategy, p < 0.05; ). Differences between users and caregivers/researchers were found for the question about the level of enjoyability. For all but one strategy (attempted hand movement), there was a significant difference across groups (Kruskal Wallis test for 3 groups and 8 strategies, p < 0.05 Bonferroni corrected for N = 8; ). Within strategies tests (Mann-Whitney test within strategy, p < 0.05; ) showed that users found attempted body movement, visual imagery and counting backwards significantly more enjoyable than caregivers and researchers, and that users found attempted speech, visual P300, SSVEP and auditory P300 significantly more enjoyable than researchers.

Figure 4. Comparison between users’, caregivers’ and researchers’ opinion about mental strategies. (A) Centre-of-mass (COM) values computed for the top 4 mental strategies for users, caregivers and researchers. Note that caregivers rank their preference from their own perspective (as an abled control group), whereas researchers ranked from the perspective of the users. Monte Carlo variance is indicated on the top right corner of each panel and at each caregiver/research bar of which the difference with the user bar is larger or smaller than the Monte Carlo variance (0.28). Ranking scales ranged from 1 (least preferred) to 4 (most preferred). (B–C) Percent of participants that rated each strategy (in a 5-points Likert scale) according to how easy (B) and how enjoyable (C) it is. The charts position the % of replies vertically such that positive responses are stacked above the horizontal baseline (0%) and negative responses are stacked below the baseline. The ‘neutral’ is centred around 0%. Mental strategies highlighted in grey showed a statistically significant difference between groups (Kruskal Wallis test, p < 0.05, Bonferroni corrected for 8 repetitions). For the strategies with significant difference between groups, pair-wise Mann-Whitney tests were used to test which groups were statistically different between users and researchers or caregivers (* < 0.05).

Figure 4. Comparison between users’, caregivers’ and researchers’ opinion about mental strategies. (A) Centre-of-mass (COM) values computed for the top 4 mental strategies for users, caregivers and researchers. Note that caregivers rank their preference from their own perspective (as an abled control group), whereas researchers ranked from the perspective of the users. Monte Carlo variance is indicated on the top right corner of each panel and at each caregiver/research bar of which the difference with the user bar is larger or smaller than the Monte Carlo variance (0.28). Ranking scales ranged from 1 (least preferred) to 4 (most preferred). (B–C) Percent of participants that rated each strategy (in a 5-points Likert scale) according to how easy (B) and how enjoyable (C) it is. The charts position the % of replies vertically such that positive responses are stacked above the horizontal baseline (0%) and negative responses are stacked below the baseline. The ‘neutral’ is centred around 0%. Mental strategies highlighted in grey showed a statistically significant difference between groups (Kruskal Wallis test, p < 0.05, Bonferroni corrected for 8 repetitions). For the strategies with significant difference between groups, pair-wise Mann-Whitney tests were used to test which groups were statistically different between users and researchers or caregivers (* < 0.05).

Time of information

Caregivers and researchers agreed that information about ATs and cBCIs should be provided to users “as soon as possible” after the diagnose of LIS, irrespective of the aetiology (). However, users of the NMD group () indicated they would only like to be informed when they have lost the ability to speak or press a button.

Figure 5. Results of time of AT information ratings. Opinion of participants (in percentage) per group (users, caregivers and researchers) about the timing of information delivery on AT and cBCIs for people with LIS due to neuromuscular disorder (A: NMD) or sudden onset (B: SO).

Figure 5. Results of time of AT information ratings. Opinion of participants (in percentage) per group (users, caregivers and researchers) about the timing of information delivery on AT and cBCIs for people with LIS due to neuromuscular disorder (A: NMD) or sudden onset (B: SO).

Animation videos

Overall, users rated the animation videos explaining each strategy as very clear (). Both caregivers and researchers found the videos explaining attempted speech, attempted body and hand movement, visual imagery and counting backwards significantly less clear than the users (Kruskal Wallis test for 3 groups and 8 strategies, p < 0.05 Bonferroni corrected for N = 8; Mann-Whitney test within strategy, p < 0.05). Furthermore, researchers assessed the overall clarity of all 9 videos (). The majority of the researchers indicated that these provided a “clear” introduction and explanation of cBCIs and mental strategies for end-users (55%) and other stakeholders (52%). Most of the participants who replied with “maybe” to this question indicated that the videos were sometimes too simple and could contain more detailed information.

Figure 6. Animation videos feedback from users, caregivers and researchers. (A) The three respondent groups (users, caregiver and researchers) rated the animation videos introducing each mental strategy according to how clear it was, using a 5-points Likert scale. Videos on mental strategies highlighted in grey showed a statistically significant difference between groups (Kruskal Wallis test, p < 0.05, Bonferroni corrected for 8 repetitions). For the strategies with a significant difference between groups, pair-wise Mann-Whitney tests were used to test which groups (caregivers/researchers) were statistically different from the users (* < 0.05). (B) Percent of researchers that reported that the animation videos were a clear (or not) means to introduce cBCIs and mental strategies to user and other stakeholders (Yes = clear; No = not clear).

Figure 6. Animation videos feedback from users, caregivers and researchers. (A) The three respondent groups (users, caregiver and researchers) rated the animation videos introducing each mental strategy according to how clear it was, using a 5-points Likert scale. Videos on mental strategies highlighted in grey showed a statistically significant difference between groups (Kruskal Wallis test, p < 0.05, Bonferroni corrected for 8 repetitions). For the strategies with a significant difference between groups, pair-wise Mann-Whitney tests were used to test which groups (caregivers/researchers) were statistically different from the users (* < 0.05). (B) Percent of researchers that reported that the animation videos were a clear (or not) means to introduce cBCIs and mental strategies to user and other stakeholders (Yes = clear; No = not clear).

Discussion

In this study we compared the opinions of individuals with LIS with those of caregivers and of researchers working in the field of cBCI. Overall, caregivers and researchers ranked the importance of different cBCI applications similar to users, but disagreed with the users regarding preferred mental strategies and timing of being informed with respect to aetiology.

Preferred applications

The self-evident strong preference for direct and private communication by the users has been previously reported in [Citation4]. Here we show that priorities of cBCI applications are consistent between users, the ones who provide daily care and the ones who develop the technology, demonstrating that caregivers and researchers are able to estimate these priorities well. We found that “emotions and facial expressions” and “artistic expression” were the least preferred applications, and that the frequency of use of these applications was overestimated by the caregivers and researchers. This result contrasts that of previous studies that suggested that artistic expression is an important BCI tool for individuals with severe paralysis (e.g., Citation15–19). One could argue that such application is not provided by all current communication aids, whereas communication is a universally used concept. We also show that while the top applications were currently used by more than 90% of the users at home, a smaller number of caregivers and researchers selected these as essential to be provided by a cBCI. This discrepancy could be the result of a comparison between current (users) and future (caregivers, researchers) situations.

Preferred mental strategies

To our knowledge this is the first study to compare the preference of multiple mental strategies for BCI control between potential end-users, an able-bodied control group (caregivers) and researchers developing BCIs based on these strategies. We show that preferences of users for certain mental strategies are often not aligned with the opinion of caregivers and the expectations of researchers. In fact, caregivers and researchers were unable to estimate or predict the users’ opinion about attempted body and hand movement, visual imagery and evoked stimuli. Interestingly, discrepancies between individuals with LIS and other stakeholders have been reported before, regarding for example the quality-of-life rating of individuals with LIS. Whereas healthy individuals, medical professionals and caregivers sometimes assume that the quality of life of an individual with LIS is low and not worth living for [Citation20], the quality of life as rated by individuals with LIS is often reported to be comparable to that of healthy groups [Citation20–23]. With respect to the current study, it should be noted that the overestimation of the visual P300 strategy by the researchers could be explained by the fact that 74% of the researchers participating in this study investigate and develop visual P300 paradigms [Citation19,Citation24–29].

Time of information

Users, irrespective of their aetiology, expressed a preference to be informed about AT and BCIs when they reach the locked-in state [Citation14]. This moment is especially relevant for users diagnosed with NMD, where the locked-in state is typically reached in later stages of the disease progression. This choice contrasts with that of caregivers and researchers, who estimated that users with NMD would like to be informed as soon as possible after being diagnosed. The discrepancy between groups is in line with findings regarding timing of information related to prognostics and end-of-life communication for individuals with advanced late-stage illnesses, such as metastatic diseases and ALS [Citation30–32]. Factors such as the patients’ acceptance of their medical diagnosis, can play an important role in the readiness of the patient to receive information. Indeed, several studies with patients with metastatic diseases showed that patients rather not discuss end-of-life or palliative care at the time of diagnosis and that, as the illness progresses, caregivers seemed to want more information about clinical treatment options than patients [Citation30]. Similarly, it has been reported that individuals with ALS experience difficulties in coming to terms with the diagnosis and adjust to disease progression, and that clinicians and patients diverge with respect to how patients perceive and comprehend their condition [Citation32]. Discrepancies between patients and health professionals have been further systematically described in [Citation31], where the authors report that health professionals tend to overestimate the awareness of the patients regarding their prognosis and that patients should be given the option to defer the discussion of prognosis and end-of-life decisions to later time points in the clinical trajectory, although these results may depend on the country and culture. Yet, some participants also preferred to be informed as soon as possible. A similar dichotomous finding was recently also reported in a study with individuals with ALS [Citation33], illustrating that ideal timing of information is highly subject specific. Indeed, while researchers, caregivers and clinicians should be sensitive to the opinion of end-users, there are some arguments for not waiting too long with providing information. These arguments include sufficient time for learning how to use the technology (training time) and avoiding last-minute (urgent) decisions for one or another AT solution.

Animation videos

The videos used in this study to introduce and explain the concept of cBCI and mental strategies were positively rated by the three groups, and in particular by the users. Indeed, the added value of animations to explain complex health information has been reported before (e.g., Citation34), supporting the notion that animations are an effective tool for providing information to individuals, independent of their level of health literacy. Although some researchers indicated that the animations should provide more detailed information about the technology, we wanted to use the same questions and videos for all three groups, specifically accommodating users and caregivers who we reasoned may be confused by more complex or detailed videos.

Limitations and future directions

The researchers group comprised individuals from several research institutes in multiple countries, whereas the samples of users and caregivers were limited to the Dutch population. These differences in location may be associated with cultural differences that yield differences in opinion. Based on the current results, we believe a larger replication study with users and caregivers from multiple countries could provide insight in the effect of cultural factors. Furthermore, a previous study has suggested that the decision about AT implementation needs to be shared between the user and health care professional [Citation35]. However, the opinion (and acceptance) of health care providers regarding cBCIs is still largely unknown.

Conclusion

The opinion of prospective users regarding BCIs for communication was compared with the one of their respective caregivers and cBCI researchers. We showed that, even though users, caregivers and researchers agree on which communication outputs have the highest priority for cBCI, they disagree on which mental strategies are preferred for cBCI control and on the time point at which AT and cBCIs should be introduced to users with NMD. The misalignment in opinions of groups strengthens the argument for a user-centred design approach in the BCI field.

Supplemental material

Questionnaire_researchers_V1.pdf

Download PDF (2.3 MB)

Acknowledgements

The authors thank the participants for their time and motivation to answer the questionnaire, Merel Horsmeier for designing and producing the animation videos, Wesley Sewnundun for implementing the questionnaire in Qualtrics, and Ruben Sars for his help during the home-visits and in distributing the questionnaire to the caregivers.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability statement

The animation videos used in the questionnaires (Video 1–9; translated to English) are available at https://doi.org/10.5281/zenodo.3271440. The BCI researchers’ questionnaire (in English) is available in Supplementary Materials. The Users’ and Caregivers’ questionnaires (Dutch only) and data that support the findings can be made available upon reasonable request to the authors.

Additional information

Funding

This research was funded by the ERC-Advanced ‘iConnect’ project [grant ADV 320708] (NFR), Dutch Technology Foundation STW NeuroCIMT project [grant 14906] (NFR) and the National Institute On Deafness And Other Communication Disorders of the National Institutes of Health [U01DC016686] (NFR).

References

  • Tai K, Blain S, Chau T. A review of emerging access technologies for individuals with severe motor impairments. Assist Technol. 2008;20(4):204–221.
  • Bernat JL. Medical decision making by patients in the locked-in syndrome. Neuroethics. 2020;13(2):229–238.
  • Brunner C, Birbaumer N, Blankertz B, et al. BNCI horizon 2020: towards a roadmap for the BCI community. Brain-Comput Interfaces. 2015;2(1):1–10.
  • Huggins JE, Wren PA, Gruis KL. What would brain-computer interface users want? Opinions and priorities of potential users with amyotrophic lateral sclerosis. Amyotroph Lateral Scler. 2011;12(5):318–324.
  • Basha D, Dostrovsky JO, Lopez Rios AL, et al. Beta oscillatory neurons in the motor thalamus of movement disorder and pain patients. Exp Neurol. 2014;261:782–790.
  • Blain-Moraes S, Schaff R, Gruis KL, et al. Barriers to and mediators of brain-computer interface user acceptance: focus group findings. Ergonomics. 2012;55(5):516–525.
  • Schicktanz S, Amelung T, Rieger JW. Qualitative assessment of patients’ attitudes and expectations toward BCIs and implications for future technology development. Front Syst Neurosci. 2015;9.
  • Lahr J, Schwartz C, Heimbach B, et al. Invasive brain-machine interfaces: a survey of paralyzed patients’ attitudes, knowledge and methods of information retrieval. J Neural Eng. 2015;12(4):043001.
  • Blabe CH, Gilja V, Chestek CA, et al. Assessment of brain-machine interfaces from the perspective of people with paralysis. J Neural Eng. 2015;12(4):043002.
  • Huggins JE, Moinuddin AA, Chiodo AE, et al. What would Brain-Computer interface users want: opinions and priorities of potential users with spinal cord injury. Arch Phys Med Rehabil. 2015;96(3):S38–S45.e5.
  • Fager SK, Fried-Oken M, Jakobs T, et al. New and emerging access technologies for adults with complex communication needs and severe motor impairments: State of the science. Augment Altern Commun. 2019;35(1):13–13.
  • Andresen EM, Fried-Oken M, Peters B, et al. Initial constructs for patient-centered outcome measures to evaluate brain-computer interfaces. Disabil Rehabil Assist Technol. 2016;11(7):548–557.
  • Nijboer F, Bos DP-O, Blokland Y, et al. Design requirements and potential target users for brain-computer interfaces – recommendations from rehabilitation professionals. Brain-Comput Interfaces. 2014;1(1):50–61.
  • Branco MP, Pels EGM, Sars RH, et al. Brain-computer interfaces for communication: Preferences of individuals with locked-in syndrome. Neurorehabil Neural Repair. 2021;35(3):267–279. Published online February 3, 1545968321989331.
  • Münßinger JI, Halder S, Kleih SC, et al. Brain painting: first evaluation of a new brain-computer interface application with ALS-patients and healthy volunteers. Front Neurosci. 2010;4:182.
  • Zickler C, Halder S, Kleih SC, et al. Brain painting: Usability testing according to the user-centered design in end users with severe motor paralysis. Artif Intell Med. 2013;59(2):99–110.
  • Botrel L, Holz EM, Kübler A. Brain painting V2: evaluation of P300-based brain-computer interface for creative expression by an end-user following the user-centered design. Brain-Comput Interfaces. 2015;2(2–3):135–149.
  • Holz EM, Botrel L, Kübler A. Independent home use of brain painting improves quality of life of two artists in the locked-in state diagnosed with amyotrophic lateral sclerosis. Brain-Comput Interfaces. 2015;2(2–3):117–134.
  • Botrel L, Holz EM, Kübler A. Using brain painting at home for 5 years: stability of the P300 during prolonged BCI usage by two End-Users with ALS. In: International Conference on Augmented Cognition. Cham: Springer; 2017. p. 282–292.
  • Laureys S, Pellas F, Van Eeckhout P, et al. The locked-in syndrome: what is it like to be conscious but paralyzed and voiceless? Prog Brain Res. 2005;150:495–511. DOI:10.1016/S0079-6123(05)50034
  • Kübler A, Nijboer F, Mellinger J, et al. Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology. 2005;64(10):1775–1777.
  • Bruno M-A, Bernheim JL, Ledoux D, et al. A survey on self-assessed well-being in a cohort of chronic locked-in syndrome patients: happy majority, miserable minority. BMJ Open. 2011;1(1):e000039.
  • Rousseau M-C, Baumstarck K, Alessandrini M, et al. Quality of life in patients with locked-in syndrome: evolution over a 6-year period. Orphanet J Rare Dis. 2015;10:88.
  • Sellers EW, Donchin E. A P300-based brain-computer interface: initial tests by ALS patients. Clin Neurophysiol. 2006;117(3):538–548.
  • Kübler Furdea A, Halder S, Hammer EM, et al. A brain-computer interface controlled auditory event-related potential (p300) spelling system for locked-in patients. Ann N Y Acad Sci. 2009;1157(1):90–100.
  • Pires G, Nunes U, Castelo-Branco M. Statistical spatial filtering for a P300-based BCI: Tests in able-bodied, and patients with cerebral palsy and amyotrophic lateral sclerosis. J Neurosci Methods. 2011;195(2):270–281.
  • Brunner P, Ritaccio AL, Emrich JF, et al. Rapid communication with a “P300” matrix speller using electrocorticographic signals (ECoG). Front Neurosci. 2011;5:5.
  • Vansteensel MJ, Kristo G, Aarnoutse EJ, et al. The brain-computer interface researcher’s questionnaire: from research to application. Brain-Comput Interfaces. 2017;4(4):236–247.
  • Wolpaw JR, Bedlack RS, Reda DJ, et al. Independent home use of a brain-computer interface by people with amyotrophic lateral sclerosis. Neurology. 2018;91(3):e258–e267.
  • Parker SM, Clayton JM, Hancock K, et al. A systematic review of prognostic/end-of-life communication with adults in the advanced stages of a life-limiting illness: patient/caregiver preferences for the content, style, and timing of information. J Pain Symptom Manage. 2007;34(1):81–93.
  • Hancock K, Clayton JM, Parker SM, et al. Discrepant perceptions about end-of-Life communication: a systematic review. J Pain Symptom Manage. 2007;34(2):190–200.
  • Hogden A, Greenfield D, Nugus P, et al. Engaging in patient decision-making in multidisciplinary care for amyotrophic lateral sclerosis: the views of health professionals. Patient Prefer Adherence. 2012;6:691–701.
  • Versalovic E, Diamond M, Klein E. “Re-identifying yourself”: a qualitative study of veteran views on implantable BCI for mobility and communication in ALS. Disabil Rehabil Assist Technol. 2020;17:1–8.
  • Ahmed E, Alike Q, Keselman A. The process of creating online animated videos to overcome literacy barriers in health information outreach. J Consum Health Internet. 2015;19(3–4):184–199.
  • Johnston P, Currie LM, Drynan D, et al. Getting it “right”: how collaborative relationships between people with disabilities and professionals can lead to the acquisition of needed assistive technology. Disabil Rehabil Assist Technol. 2014;9(5):421–431.