114
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Implementation of the MiNDToolkit intervention for the management of behavioral symptoms in MND by healthcare professionals: a mixed-methods process evaluation

, & ORCID Icon
Received 17 Jan 2024, Accepted 16 Apr 2024, Published online: 15 May 2024

Abstract

Objective

MiNDToolkit is a novel psychoeducational intervention for carers to support management of behavioral symptoms in people living with motor neuron disease (PlwMND). Implementation of MiNDToolkit involves delivery of an online intervention to carers, which is reinforced by trained healthcare professionals (HCPs).

Methods

A mixed-methods process evaluation of the MiNDToolkit feasibility trial was conducted, focusing on reinforcement of the intervention by HCPs. Quantitative data, descriptively analyzed, were included from platform analytics, questionnaire, and 10 semi-structured interviews with HCPs. Interviews were transcribed verbatim; data were inductively analyzed using Reflective Thematic Analysis.

Results

The MiNDToolkit training and platform is a beneficial and acceptable resource for HCPs with potential to increase knowledge and confidence in identifying and managing behavioral symptoms in MND. Implementation barriers included HCPs’ perceptions that highlighting behavior changes would be burdensome to carers and assumptions that carers would take the initiative to ask for support from clinicians. Degree of intervention reinforcement varied, with most HCPs delegating intervention delivery solely to the online platform.

Conclusions

Implementation of the MiNDToolkit was viewed to be feasible and the platform thought to increase accessibility of support to carers. The flexible approach to delivery (online platform and optional HCP reinforcement) is acceptable as an intervention for supporting carers of PlwMND with behavioral symptoms. However, MiNDToolkit should not negate HCP involvement in providing medical and practical information to PlwMND and families. Future research should explore ways to incorporate support for carers in the management of PlwMND alongside standard care, alongside tools such as the MiNDToolkit.

This article is related to:
An online intervention for carers to manage behavioral symptoms in motor neuron disease (MiNDToolkit): a randomized parallel multi-center feasibility trial

Background

Evidence of cognitive and behavioral symptoms in MND has grown significantly in recent years (Citation1, Citation2). Symptoms include apathy, impulsivity, ridigity, executive and language dysfunction (Citation2). Detection of these symptoms has also improved, with many cognitive and/or behavioral screening tests now available (Citation3, Citation4). These assessments have been operationalized in the updated diagnostic criteria for ALSFTD) (Citation5), easing clinical detection and research studies.

Healthcare professionals (HCPs) can administer cognitive and behavioral assessments (Citation3). However, despite availability, services do not use the assessments regularly, or use them reactively, e.g. when severe symptoms are observed. Moreover, even when assessments for people living with MND (PlwMND) are done systematically, there are no guidelines on the management of cognitive and behavioral symptoms (Citation6). This is a concern that does not go unnoticed: at least 50% of PlwMND present with cognitive and behavioral symptoms, and these can affect survival rates (Citation7–9).

Recently, initiatives to address this evidence gap have started to surface. A peer-support group delivered online to small groups of carers was tested in Denmark (Citation10), with results demonstrating that carers engaged well with online interactions. More recently, the MiNDToolkit emerged as a new psychoeducational intervention for carers to support the management of behavioral symptoms, delivered by a bespoke online platform and reinforced by trained HCPs. The recently completed feasibility clinical trial (Citation11) showed the MiNDToolkit to be feasible and warranted further evaluation of its efficacy and effectiveness.

In this nested mixed-methods process evaluation, we set out to understand the experiences of HCPs in managing behavioral symptoms before MiNDToolkit, and their experiences using the platform, including training. Carers’ experiences of using MiNDToolkit are reported separately (Citation12). This study’s aims were to (i) assess implementation of the MiNDToolkit, (ii) understand contextual factors shaping intervention delivery, and (iii) investigate how to refine and optimize the intervention delivery ().

Figure 1. MiNDToolkit mixed methods process evaluation objectives.

Figure 1. MiNDToolkit mixed methods process evaluation objectives.

Methods

Design

A mixed-methods process evaluation including intervention platform analytics, questionnaires, and semi-structured interviews was conducted. The design, conduct and reporting of the study was informed by the UK-Medical Research Council guidance on process evaluation of complex interventions (Citation13).

Study setting

The MiNDToolkit study (ISRCTN 15746123) was a randomized controlled trial to determine feasibility of the MiNDToolkit for use by carers with optional support from HCPs. The study was conducted across 11 sites in England and Wales between July/2021-March/2023. Sites varied but all had advanced MND care set up.

The MiNDToolkit

MiNDToolkit is a complex intervention (Citation11) for the management of behavioral symptoms. In brief, carers access tailored online modules to manage symptoms reported on screening questionnaires also collected via the platform. Trained HCPs reinforce the learning and strategies during appointments. Training for HCPs includes a 2-hour online session, a 90-min group training session with role playing, and optional weekly supervisions throughout the trial.

Participants and recruitment

27 HCPs from participating sites were eligible to take part in this study. HCPs were purposively sampled to achieve maximum variation of site, professional role, engagement with the MiNDToolkit platform and reinforcement of the intervention.

Data collection

Ten individual semi-structured interviews were conducted. HCPs were asked about using the platform, reinforcing strategies with carers, perceived barriers/enablers to implementation, and proposed changes. To further explore engagement and experiences with training and implementation, interview data were triangulated with a questionnaire completed by HCPs before and after the training, and platform analytics - frequency of use and reinforcement notes.

Interviews were conducted virtually (TKC) on MS Teams, audio recorded, and professionally transcribed verbatim (Topic guide, Appendix-1).

Analysis

Quantitative data were descriptively analyzed. Interview data were inductively analyzed using Reflective Thematic Analysis (Citation14) to understand how training was experienced, how MiNDToolkit was implemented and how service structures shaped delivery; NVivo v.12 was used (QSR). More details on Appendix-2.

Results

Context

Services’ structure for managing behavioral symptoms in MND and ALSFTD

In England and Wales, services are commissioned locally through integrated care systems (ICSs), which are partnerships of organizations responsible for planning and delivering healthcare services. Characteristics of HCPs participating in the process evaluation, profession and sites are presented in ; these represented 10/27 HCPs involved in the trial (Citation11).

Table 1. Characteristics of HCPs interviewed for the process evaluation of the MiNDToolkit feasibility study.

Types of services offered to PlwMND experiencing behavioral symptoms prior to the MiNDToolkit varied greatly by sites. Although most teams were aware of the ECAS(3) assessment to support diagnosis of cognitive and behavioral symptoms, services administered it sporadically; a few offered it routinely. Moreover, due to lack of follow-on support, some HCPs expressed reluctance in offering the Edinburgh Cognitive and Behavioural ALS Screen - ECAS (, quote-A).

Table 2. MiNDToolkit process evaluation themes, subthemes and quotes.

Apart from use of medication, most services offered no support for the management of cognitive and behavioral symptoms. Few services offered advice from a psychologist; generally, HCPs viewed the management of cognitive and behavioral symptoms as a psychologist’s speciality. As such, sites without psychological expertise either had no follow-on support, or co-ordinated with other teams to provide support, e.g. Memory Clinics. The lack of standardized support for cognitive and behavioral symptoms was a key reason why HCPs signed up for the MiNDToolkit trial.

I’ve worked probably the best part of 12 years directly with people with MND […] it’s an area that I […] felt possibly less well equipped to help manage [HCP 09, Nurse].

Sites offered very limited support for carers. Additionally, the current service structure, which solely focuses on patients, was highlighted as a barrier to supporting carers, which resonated with experiences of carers (, quote-B) (Citation12).

HCPs’ approach to management of behavioral symptoms of MND and ALSFTD prior to the MiNDToolkit trial

Most services did not have an approach to managing behavioral symptoms prior to the MiNDToolkit study, except for sites A and F.

There wasn’t any support because we weren’t really recognising it […] and on top of that you haven’t really got a plan of how you help them [HCP 02, Occupational Therapist].

HCPs’ lack of confidence or expertise in identifying and managing behavioral symptoms prior to MiNDToolkit was highlighted as a source of anxiety, often leading to their own behavioral avoidance and potentially incorrect assumptions. For example, some HCPs felt raising the topic with carers too difficult, expressing their helplessness as they felt behavioral symptoms were “another thing” in the management of MND that they could not do anything about. Others felt that discussing behavioral symptoms would cause additional concerns and burden on families, which is an assumption not shared by most carers (Citation12). (, quote-C).

I don’t think we brought it up because it’s quite difficult to talk about… and you can justify that, well you know, there’s so much going on for the person with MND [HCP 02, Occupational Therapist].

Some HCPs presumed that behavioral symptoms were not a priority for carers. Additionally, despite HCPs acknowledging that some carers might be hesitant to speak up about behavioral symptoms, there was an assumption that carers faced with symptoms would be able to identify and name them on their own, and take the initiative to reach out to HCPs when needed.

Implementation

Acceptability and training experience

The training offered useful learning for all HCPs, regardless of their level of expertise and the platform was highlighted as a good educational resource (, quote-D). HCPs expressed the importance in recognizing and understanding behavioral symptoms and developing expertise to support and validate these experiences to PlwMND and their families. Indeed, validation of behavioral symptoms was a key pillar of the MiNDToolkit training.

Due to their perceived limited time, HCPs felt having a platform was crucial for providing specialist support, addressing important topics for carers. HCPs found it useful that modules were tailored to the PlwMND’s symptoms, providing a resource that explained most relevant symptoms for carers and offered simple and practical strategies. HCPs felt that having symptoms explained to be part of MND was most important for allowing families to reconcile challenging behaviors at a time when they would like to make the most of their time together.

A lot of relatives and carers struggle with apathy because they think, if you’ve got a short life span, let’s do this, let’s do that […] and when their loved one doesn’t want to, they can’t understand it […] So for them to understand that it’s part of the disease is really important. And I don’t think we were very good at [explaining] that before and the platform explains that behaviour is caused by this [HCP 06, Nurse].

The structure of the training, consisting of 1) platform bite-size modules, 2) online training session with the Chief Investigator (EM), 3) platform resources, and 4) drop-in supervision sessions, was acceptable to HCPs. Some HCPs completed online training outside of their office hours. HCPs highlighted the virtual face-to-face component as most important, allowing them to have discussions about how to approach different scenarios and offering opportunity to practise these. HCPs expressed need to dedicate more time for this session in future, preferably in smaller groups, to ensure adequate opportunity for in-depth discussions and questions (, quote-E). Additionally, despite HCPs finding the drop-in session useful, uptake was low (3/27, on average). Those joining drop-in sessions were very engaged with the study (, quote-F).

Another suggestion was to offer online videos of real-life consultations demonstrating good communication skills. This stemmed from one HCP feeling very anxious about role playing in front of colleagues.

Training outcomes: increased knowledge and confidence

Despite diverse levels of knowledge/experience in the management of behavioral symptoms, most HCPs felt the platform was an invaluable educational resource for practitioners. HCPs felt that the training had given them a thorough background understanding of behavioral symptoms in the ALSFTD spectrum and provided skills and knowledge to identify the symptoms. Additionally, HCPs felt that they had received clear examples of when to introduce and apply suggested practical strategies to manage these symptoms.

I did find it all really helpful […] for example, apathy and understanding how it might be seen to be depression and how you might distinguish which was going on [HCP 09, Nurse].

HCPs’ knowledge before and after the training was assessed with a quiz. HCPs’ knowledge (all 27 HCPs) pretest mean was 66.67% (95%CI: 60.39 to 72.94). The post-training quiz showed that HCPs’ mean score was 79.73% (95%CI: 73.11 to 84.36). Overall, 23/27 HCPs improved their quiz scores (increases 1–5 points). Only one HCP, not interviewed, already scored 100% at the pre-training phase. The change in knowledge scores confirmed HCPs’ reflections in interviews, with some expressing surprise at how much they did not know about behavioral symptoms and felt that the training provided them with a much-needed opportunity to address this gap.

I thought I knew quite a bit about it but it turns out I didn’t, I learnt a lot from doing the training [HCP 06, Nurse].

HCPs also shared how training had increased their confidence to have conversations with carers about behavioral symptoms. Additionally, they felt that the platform offered the right tools and resources to address the topic, including strategies during consultations (, quote-G).

Recruitment: identifying eligible carers and offering MiNDToolkit

Most HCPs had no previous research experience, with some taking on the role of Principal Investigator (PI) for the first time. HCPs’ role in recruitment was to offer the study to carers, following which screening for eligibility would be undertaken via the platform. This approach was viewed favorably as it increased HCP capacity to recruit carers without undertaking the clinical screening. It also enabled dissemination of information to all carers in their caseload (, quote-H).

And I think that element of we didn’t do the screening, you did it, enabled us to offer it to loads and loads of people [HCP 06, Nurse].

However, the initial approach to recruitment taken by most sites was to offer the MiNDToolkit only face-to-face. On reflection, HCPs felt this approach led to low recruitment rates early in the study. In later stages of recruitment, HCPs worked with the research team to adopt more proactive recruitment, offering MiNDToolkit via letters or phone calls – which contributed to the study reaching its recruitment target (, quote-I).

HCPs highlighted the importance of offering the intervention early to maximize benefits for carers. HCPs’ perceptions of key determinants of carers uptake and engagement with MiNDToolkit included: carers’ capacity amidst responsibilities, carers’ readiness to learn more about behavioral symptoms, language (non-English speakers) and digital literacy. Although these perceived determinants were applicable to some carers, HCPs who offered MiNDToolkit despite their perceptions were often surprised at the positive response from carers (, quote-J):

I offered it despite thinking, “Oh, computer, tech wise she’s older, is she going to get on with it?” But then actually she was emailing me back and forth about thing [HCP 08, Nurse].

Reinforcing strategies to carers during appointments

HCPs reinforcing strategies to carers varied across sites, with 5/27 HCPs providing reinforcement. Reinforcement, designed to be conducted as part of a consultation, involved HCPs and carers openly discussing management of behavioral symptoms and strategy implementation. Finding time to discuss the MiNDToolkit away from the PlwMND was a challenge, especially for HCPs working in secondary care settings and for carers who did not want to disclose to the PlwMND that they are receiving MiNDToolkit support.

I found it more difficult with the person with MND next to them, to go into any great depth…I’m largely clinic based, it has been quite difficult to reinforce the strategies so, I haven’t engaged in that bit as well as I would have hoped to [HCP 09, Nurse].

HCPs and carers working flexibly to discuss the content of the MiNDToolkit depended on capacity, environment (clinic vs home) and needs of the carers. As such, reinforcement interactions looked different for each carer-HCP dyad and included one-to-one discussions over the phone or at the doorstep following home visits. On reflection, most HCPs felt that the platform offered comprehensive support for carers, and that not all carers needed reinforcement. However, HCPs felt it still important to be aware of what carers know and check-in with them. Overall, HCPs who reinforced the MiNDToolkit felt that reinforcement was a motivation for carers and important for their engagement and does not take too much extra time (approx. 10min) during appointments (, quote-K).

Another key challenge highlighted by HCPs was the ambiguity in the guidance regarding reinforcement where some attempted to align reinforcement with usual appointments, which can be 3-monthly (where the feasibility trial period was approximately 3 months), whereas others kept regular contact with carers outside of these appointments. As such, HCPs expressed the need for greater clarity around frequency of reinforcement (e.g. monthly) and a structured meeting plan which might involve pre-arranging this with carers (, quote-L).

Platform engagement

Beyond training, the MiNDToolkit provides HCPs with resources and strategies for use during appointments. The platform is also designed to facilitate a Multidisciplinary Team (MDT) approach, providing a space to record notes and keep up-to-date with carers’ progress. As with reinforcement, use of the platform varied greatly (, quote-M).

Practically, a few HCPs experienced difficulties linking strategies to behavioral symptoms when preparing for the appointments and found the combination of strategies difficult to remember. A suggestion emerged to simplify strategies by using an acronym and/or using single words rather than word combinations. HCPs also felt that developing a paper resource of strategies which could serve as a reminder during visits.

Future implementation

Overall implementation of MiNDToolkit was viewed to be feasible and the platform was thought to increase accessibility. For inclusivity, HCPs recommended the continuation of the hybrid delivery approach (i.e. online with HCP reinforcement), delivering the intervention in other formats (e.g. books and Apps), and adding other language options (e.g. Urdu).

The implementation of MiNDToolkit into routine practice was viewed positively by all HCPs, most of whom highlighted that there is currently no other intervention of its kind. There was willingness from some HCPs to even pay for MiNDToolkit to be implemented in their service. The MDT approach to training and delivery of the intervention was also viewed favorably by HCPs as this would ensure that families are supported holistically without depending on one HCP only.

I don’t think there’s anything else like it in the MND… And now that [we] have done the MiNDToolkit, we are more aware when we have our meetings with patients and we had one yesterday with somebody who has got, very rigid thinking and lack of insight [HCP 02, occupational therapist]

In some sites, use of MiNDToolkit led to wider impact for service setup. For example, the MiNDToolkit triggered the creation of a management pathway involving early identification and timely support. Previous attempts to pathway creation had been unsuccessful because MND was viewed as primarily a physical condition. Following the training, HCPs felt more confident and skilled to initiate conversations with their colleagues to create a care pathway for PlwMND experiencing behavioral symptoms and their families.

We have standardised a template on SystmOne now with the ECAS templates - the MiNDToolkit prompted that. The other thing that’s come off the back of this, is we’ve never had a pathway with mental health services before, they will not see patients with MND because in their opinion it’s more of a […] physical condition. But we have actually met with the mental health doctors and pulled a pathway together [HCP 03, Occupational Therapist]

Discussion

The MiNDToolkit was recognized as a beneficial educational resource for HCPs and an acceptable intervention for supporting carers of PlwMND with behavioral symptoms. The virtual training and bespoke platform consisting of educational modules, structured interactive clinical reasoning and strategies, facilitated the increase of HCP knowledge and confidence in identifying behavioral symptoms in MND and providing appropriate advice. Against the contextual backdrop of limited HCP training and limited support for families of PlwMND, motivation to engage in training was consistently high throughout the study.

Our findings reveal that HCPs’ perceptions (e.g. mentioning behavioral symptoms would be burdensome to carers) and assumptions (e.g. carers can take initiative to ask for support from clinicians) about carers’ communication and support needs could pose as potential barriers to offering appropriate carers support. These assumptions and perceptions, which partly stemmed from HCPs’ lack of training and confidence in identifying behavioral symptoms and providing follow-on support, highlight the need for HCPs to receive specialist training. With recent evidence suggesting that PlwMND and carers rely on clinicians for medical and practical information (Citation15), it is vital that HCPs receive appropriate training and resources for the management of behavioral symptoms. In addition, it is important that discussions on communication preferences in response to changing needs and disease progression are held early in the therapeutic relationship to eliminate assumptions which might hinder the provision of support (Citation15).

Our findings suggest that although MiNDToolkit training has a definite role in increasing knowledge and providing necessary tools, there is still a need for HCPs to have regular use and application of the learning to gain experience and develop confidence. In the MiNDToolkit feasibility study, the lack of experience and confidence in identifying behavioral symptoms in PlwMND posed an initial barrier to recruitment. However, the platform’s inbuilt screening feature minimized the need for HCPs to make decisions around the eligibility based on experience. Moreover, the provision of specialist resources that explain symptoms most relevant for carers and provide simple and practical strategies for these symptoms was positively viewed by HCPs.

The MiNDToolkit, originally designed for delivery in person by HCPs, was subsequently re-designed for delivery via a bespoke platform and optional HCP reinforcement due to the COVID-19 pandemic. This new flexible approach to intervention delivery was positively regarded by HCPs for its potential to minimize time capacity challenges whilst still allowing for human interaction, when needed or preferred by carers (Citation16). However, our assessment of intervention fidelity, which for HCPs consisted of platform use and reinforcement, showed that most HCPs delegated the intervention delivery primarily to the platform, and did not take ownership of the reinforcement/intervention. Findings showed that intervention setting, i.e. clinic vs home setting, played a key role in determining whether appointments allowed for the provision of both PlwMND and carer-focused support. The care of PlwMND requires significant input from carers, most of whom are informal carers. With previous research highlighting the burden, psychological and emotional impact associated with informal care of people with MND (Citation17), there is a need to reconfigure how care is delivered to PlwMND and their families (Citation18). Although the MiNDToolkit can serve as a standalone intervention, carers involved in the feasibility study unanimously expressed the need for HCP involvement in their support (Citation12). Therefore, the need to further explore how best to incorporate support for carers in the management of PlwMND alongside interventions such as MiNDToolkit requires further exploration.

Finally, the feasibility of the MiNDToolkit study (Citation11) provides a foundation that facilitates progress to the full RCT. The enthusiasm for research displayed by HCPs, several of whom were PIs for the first time, has created the potential to efficiently link services in the UK, and facilitate the progress of applied research in MND.

Conclusion

The MiNDToolkit is a beneficial educational resource for HCPs involved in the management of behavioral symptoms in PlwMND. The flexible approach to delivery via online platform with optional reinforcement is acceptable as an intervention for carers of PlwMND displaying behavioral symptoms. The MiNDToolkit does not negate the need for HCP involvement in providing medical and practical support to PlwMND and families. As such, there is still a need to explore ways to incorporate support for carers in the management of PlwMND alongside standard care, with tools such as the MiNDToolkit.

Supplemental material

Supplemental Material

Download Zip (24.1 KB)

Acknowledgements

Our heartfelt thanks to all family carers who generously gave their time to help us with our trial. We could not have conducted the trial without the engagement and support from the 28 HCPs, Helen Copsey, Karen Young, Chantelle Blazey, Donna Clements, Caroline Barry, Claudia Olhero, Heather Hill, Jennifer Robinson, Luciene Morgan, Debora South, Katie Gibbon, Caroline Bidder, Katherine Shepherd, Omina Yasmin, Luke Feathers, Barbara Powell, Catherine McRae, Alison Fleming, Siwan Seaman, Esther Hobson, Emily Mayberry, Elizabeth Macdonald, Gemma O’Brien, Rachel Henry, Sarah Jones, Kathryn Barber, Bally Purewal, Sue Ashton, some of whom were interviewed for this process evaluation study. HCPs were based across 11 sites in England and Wales at the time of the study: Norfolk Care and Research Network; Sheffield MND Care Centre; South Wales MND Care Network – Cardiff and Vale University Health Board, Hywel Dda University Health Board, and Swansea Bay University Health Board; Hospice Care for Leicester, Leicestershire and Rutland – LOROS; Norfolk Community Health and Care NHS Trust; Sussex Community NHS Foundation Trust; Calderdale and Huddersfield NHS Trust; East Suffolk and North Essex NHS Foundation Trust and West Suffolk NHS Foundation Trust. We are also grateful for the expertise from the Norwich CTU, Alex Howard from AAH Software, and the continuous support from the MND Association. Special thanks to Naoko Kishita and Michael Hornberger, who advised on the development of the online platform, and Mei-See Mann, for testing it extensively. We are also indebted to Sue Heal, our Patient and Public Involvement and Engagement representative, who has been promoting, advising and supporting our research programme in MND for many years.

Data availability statement

The study data have not been made publicly available due their sensitive nature (interviews) but those interested in exploring collaborations should contact the corresponding author.

Disclosure statement

EM, EF and TKC were funded by the MND Association. This work was also funded by the NIHR Clinical Research Network East of England, the NIHR Applied Research Collaboration East of England, and MND Scotland. EM provided consultancy for LifeArc, and is a member of the MND Association Healthcare Research Panel and NIHR DLAF committee.

Additional information

Funding

This project was funded by the Motor Neurone Disease Association UK, with additional support from the National Institute for Health and Care Research (NIHR) Applied Research Collaboration East of England (NIHR ARC EoE), and the Clinical Research Network East of England. EM is supported by the National Institute for Health and Care Research (NIHR) Applied Research Collaboration East of England (NIHR ARC EoE) at Cambridgeshire and Peterborough NHS Foundation Trust. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

References

  • Crockford C, Newton J, Lonergan K, Chiwera T, Booth T, Chandran S, et al. ALS-specific cognitive and behavior changes associated with advancing disease stage in ALS. Neurology. 2018;91:e1370–e80.
  • Abrahams S. Neuropsychological impairment in amyotrophic lateral sclerosis-frontotemporal spectrum disorder. Nat Rev Neurol. 2023;19:655–67.
  • Niven E, Newton J, Foley J, Colville S, Swingler R, Chandran S, et al. Validation of the Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis Screen (ECAS): A cognitive tool for motor disorders. Amyotroph Lateral Scler Frontotemporal Degener. 2015;16:172–9.
  • Woolley SC, York MK, Moore DH, Strutt AM, Murphy J, Schulz PE, et al. Detecting frontotemporal dysfunction in ALS: utility of the ALS Cognitive Behavioral Screen (ALS-CBS). Amyotroph Lateral Scler. 2010;11:303–11.
  • Strong MJ, Abrahams S, Goldstein LH, Woolley S, McLaughlin P, Snowden J, et al. Amyotrophic lateral sclerosis – frontotemporal spectrum disorder (ALS-FTSD): revised diagnostic criteria. Amyotroph Lateral Scler Frontotemporal Degener. 2017;18:153–74.
  • NICE. Motor neurone disease: assessment and management – NG42. 2019
  • Hu WT, Shelnutt M, Wilson A, Yarab N, Kelly C, Grossman M, et al. Behavior matters–cognitive predictors of survival in amyotrophic lateral sclerosis. PLoS One. 2013;8:e57584.
  • Kansal K, Mareddy M, Sloane KL, Minc AA, Rabins PV, McGready JB, et al. Survival in frontotemporal dementia phenotypes: A meta-analysis. Dement Geriatr Cogn Disord. 2016;41:109–22.
  • Nguyen C, Caga J, Mahoney CJ, Kiernan MC, Huynh W. Behavioural changes predict poorer survival in amyotrophic lateral sclerosis. Brain Cogn. 2021;150:105710.
  • Olesen LK, la Cour K, Thorne S, With H, Handberg C. Perceived benefits from peer-support among family caregivers of people with amyotrophic lateral sclerosis and cognitive impairments in a palliative rehabilitation blended online learning programme. J Eval Clin Pract. 2023;29:602–13.
  • Mioshi EG, Flanagan E, Heal S, Copsey H, Gould R, Hammond M, et al. An online intervention for carers to manage behavioural symptoms in Motor Neuron Disease (MiNDToolkit): a randomised parallel multi-centre feasibility trial. (Under Review). 2024. doi: 10.1080/21678421.2024.2350658.
  • Mioshi E, Heal S, Katangwe-Chigamba T. ‘A lightbulb moment’: experiences of carers learning and managing behavioural symptoms in motor neurone disease forthcoming. 2024.
  • Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. Bmj. 2015;350:h1258–h1258.
  • Byrne D. A worked example of Braun and Clarke’s approach to reflexive thematic analysis. Qual Quant. 2022;56:1391–412.
  • Genuis SK, Luth W, Bubela T, Johnston WS. What do people affected by amyotrophic lateral sclerosis want from health communications? Evidence from the ALS talk project. Muscle Nerve. 2023;68:286–95.
  • Sin J, Henderson C, Spain D, Cornelius V, Chen T, Gillard S. eHealth interventions for family carers of people with long term illness: A promising approach? Clin Psychol Rev. 2018;60:109–25.
  • Conroy É, Kennedy P, Heverin M, Leroi I, Mayberry E, Beelen A, et al. Informal caregivers in amyotrophic lateral sclerosis: a multi-centre, exploratory study of burden and difficulties. Brain Sci 2021;11:1–16. doi: 10.3390/brainsci11081094.
  • O’Brien MR, Whitehead B, Jack BA, Mitchell JD. The need for support services for family carers of people with motor neurone disease (MND): views of current and former family caregivers a qualitative study. Disabil Rehabil. 2012;34:247–56.