527
Views
0
CrossRef citations to date
0
Altmetric
Review Article

What is the extent of reliability and validity evidence for screening tools for cognitive and behavioral change in people with ALS? A systematic review

ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Received 06 Dec 2023, Accepted 28 Jan 2024, Published online: 28 Feb 2024

Abstract

Objective: This systematic review provides an updated summary of the existing literature on the validity of screening tools for cognitive and behavioral impairment in people with Amyotrophic Lateral Sclerosis (pwALS), and also focuses on their reliability. Method: The following cognitive and behavioral screening tools were assessed in this review: the Edinburgh Cognitive and Behavioral ALS Screen (ECAS); the ALS Cognitive Behavioral Screen (ALS-CBS), the Mini Addenbrooke’s Cognitive Examination (Mini-ACE), the Beaumont Behavioral Interview (BBI); the MND Behavior Scale (MiND-B); and the ALS-FTD Questionnaire (ALS-FTD-Q). A search, using Medline, PsychINFO and Embase (21/09/2023), generated 37 results after exclusion criteria were applied. Evidence of internal consistency, item-total correlations, inter-rater reliability, clinical validity, convergent validity, and structural validity were extracted and assessed and risk of bias was evaluated. Results: The cognitive component of the ECAS was the tool with most evidence of reliability and validity for the assessment of cognitive impairment in ALS. It is well-suited to accommodate physical symptoms of ALS. For behavioral assessment, the BBI or ALS-FTD-Q had the most evidence of reliability and validity. The BBI is more thorough, but the ALS-FTD-Q is briefer. Conclusions: There is good but limited evidence for the reliability and validity of cognitive and behavioral screens. Further evidence of clinical and convergent validity would increase confidence in their clinical and research use.

1. Introduction

Around 50% of people with ALS (pwALS) show signs of cognitive or behavioral change, with 15% having ALS-frontotemporal dementia (ALS-FTD) (Citation1, Citation2). Diagnostic criteria for cognitive impairment (ALSci), behavioral impairment (ALSbi), simultaneous cognitive and behavioral impairment (ALScbi), and ALS-FTD are outlined by the ALS-frontotemporal spectrum disorder (ALS-FTSD) criteria (Citation3) and the consensus criteria for the diagnosis of behavioral variant FTD (bvFTD) (Citation4). Several screening tools have been developed to detect changes to cognition and behavior in pwALS.

Previous systematic reviews of the reliability and validity of cognitive and behavioral screening tools for ALS have been conducted (Citation5–7). A review of cognitive and behavioral screening tools (Citation5) concluded that the cognitive component of the Edinburgh Cognitive and Behavioral ALS Screen (ECASc) (Citation8) had strong clinical validity, though validity evidence of the behavioral component of the ECAS (ECASb) was limited. It was also concluded that the Beaumont Behavioral Interview (BBI) (Citation9) assessed the widest range of behavioral impairment so was most promising but validation evidence was limited.

Another systematic review (Citation7) concluded that the ECASc and cognitive component of the ALS Cognitive Behavior Scale (ALS-CBSc) (Citation10) had good clinical validity. Studies in this review (Citation7) demonstrated satisfactory clinical validity for the behavioral component of the ALS-CBS (ALS-CBSb), BBI, and MND Behavior Scale (MiND-B) (Citation11) but highlighted that the MiND-B assesses a smaller number of behavioral domains than the other screens and may not fully assess the Rascovsky et al. (Citation4) criteria for bvFTD.

Taule et al. (Citation6) conducted a systematic review of reliability and validity evidence for the ECASc, ALS-CBSc and other non-ALS-specific measures (Citation12–15). They reported that the ECAS and versions of the Addenbrooke’s Cognitive Examination (Citation12, Citation13) were evaluated most for the greatest number of psychometric properties.

Gosselt et al. (Citation7) and Simon & Goldstein (Citation5) did not review evidence for the reliability of the cognitive screens, and Taule et al. (Citation6) only evaluated reliability and validity for the ECAS and ALS-CBS. Taule et al. (Citation6) made no assessment of behavioral screens other than the ALS-CBS. None of these three reviews assessed the reliability or validity of the Mini Addenbrooke’s Cognitive Examination (Mini-ACE) (Citation16). While the Mini-ACE (Citation16) is not an ALS-specific measure, it has been suggested as a suitable method of screening for cognitive change in ALS (Citation17). Since Gosselt et al. (Citation7), Simon & Goldstein (Citation5), and Taule et al. (Citation6) published their systematic reviews, further studies of the reliability and validity of the screening measures have emerged.

The aim of this systematic review was, therefore, to assess the extent of both current reliability and validity evidence for different screening tools for cognitive and behavioral change in pwALS including the Mini-ACE. The ALS-specific cognitive screening tools (i.e. screening tools designed specifically to detect cognitive changes likely to be found in pwALS) assessed in this systematic review were the ECASc and the ALS-CBSc; of note, however, the ECASc also assesses cognitive functions that are less likely to be observed in pwALS, referred to as ALS-non-specific scores, although only total ECASc scores were considered here. The ALS-specific behavioral screening tools that were assessed in this systematic review were the ECASb, the ALS-CBSb, the BBI, the MiND-B, and the ALS-FTD Questionnaire (ALS-FTD-Q) (Citation18).

2. Methods

This systematic review was conducted according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (Citation19).

2.1. Eligibility

Articles in press, conference proceedings, abstracts, non-observational studies, papers not published in English, and other systematic reviews were excluded. Studies were excluded if they did not report reliability or validity statistics.

Participant samples could include pwALS or healthy controls. Reported statistics must have been based on screening tool total scores and not sub-section scores. Studies needed to have determined cutoff scores, evaluated cutoff scores based on their sensitivity and specificity, or evaluated a screen’s ability to differentiate between people with ALS and people with ALS with ALSci or ALSbi (e.g. using ROC curve analysis) to provide evidence of clinical validity.

Test-retest studies where test sessions were conducted more than two weeks apart or studies that did not report the test-retest interval were excluded (Citation20). Test-retest studies that were conducted over a longer period may be influenced by declining cognition and behavior.

Demonstrating a significant difference in scores between ALSci or ALSbi and ALS with no impairment was deemed insufficient evidence of clinical validity (Citation21, Citation22).

2.2. Search strategy

The Embase, PsychINFO, and Medline databases were searched on 04/05/2022; searches were updated on 21/09/2023. The search terms are listed in . The process of article selection is detailed in .

Figure 1. Prisma flow diagram.

Figure 1. Prisma flow diagram.

Table 1. Search terms for systematic review evaluating the reliability and validity of cognitive and behavioral screening tools.

2.3. Process of study selection

Titles and abstracts of records identified through electronic database searching were screened and duplicates were removed. Reference lists of included studies were hand searched for articles not found in the electronic literature search and 13 were identified. After exclusion criteria were applied, 37 articles remained (). Where it was not clear whether a paper met exclusion criteria, three researchers (LD, SV, LHG) decided whether papers should be included in the review.

2.4. Data synthesis and extraction

No changes were made to the data extraction form following a pilot of search terms, exclusion criteria and data extraction. Information was extracted from articles by one researcher (LD). One study author was contacted for statistical clarification. Studies were grouped by screening tool. See Supplementary Material for further details on data synthesis and extraction.

2.5. Risk of bias and study quality

No established quality evaluation tool was used in this systematic review; instead, characteristics that were important to the types of study assessed in this review were evaluated. This permitted the tailoring of the assessment of risk of bias and study quality to the currently evaluated studies. One researcher (LD) made risk of bias and study quality assessments with input from two other researchers (SV and LHG).

A risk of bias and study quality score was assigned to studies, with high scores indicating a low risk of bias (good quality) and low scores indicating a high risk of bias (poor quality). Bias and study quality scores were calculated as total points awarded for each bias assessment criterion over total points available (not all bias assessment criteria were applicable to each study) and are given as a percentage. See Supplementary Material and table legends for details.

3. Results

Demographic data extracted from the included studies is presented in and ALS data is presented in . Excluded studies are listed in Supplementary Material. Risk of bias and study quality ( and ) varied across studies.

Table 2. Demographic characteristics.

Table 3. ALS sample characteristics.

Table 4. Risk of bias and study quality assessment.

Table 5. Risk of bias and study quality assessment for inter-rater reliability assessments.

3.1. Reliability

Eighteen of the 37 studies assessed internal consistency (see ).

Table 6. Internal consistency.

There were nine studies showing acceptable internal consistency for the ECASc (Citation8, Citation23–30), while one did not demonstrate acceptable internal consistency (Citation31) (). This latter study (Citation31) had a lower study bias/quality score () than all other studies that reported acceptable internal consistency for the ECASc. The ECASc has been shown to have fair to good inter-rater reliability (Citation26, Citation32, Citation33). Studies that reported better inter-rater reliability for the ECASc had higher bias/quality scores (see ). There was no evidence of test-retest reliability for the ECASc within the parameters set in this systematic review; while Kacem et al. (Citation29) reported test-retest statistics, their methodology and reported results did not meet inclusion criteria. Item-total correlations were unavailable for the ECASc.

Inter-rater reliability, test-retest reliability, internal consistency, and item-total correlations of the ALS-CBSc were not reported in any of the studies, within the parameters set in this systematic review. Similarly, inter-rater reliability, test-retest reliability, item-total correlation, and internal consistency for the Mini-ACE were not reported in the included studies.

The internal consistency of the ECASb was questionable as it was only assessed by one study (Citation25) that found its internal consistency to be statistically unacceptable. While inter-rater reliability and test-retest reliability for the ALS-CBSb were not reported in any of the studies included here, one study suggested that the ALS-CBSb had acceptable internal consistency (Citation34).

The ALS-FTD-Q had acceptable internal consistency and 80% of items had acceptable item-total correlations (Citation18,Citation28) (). Inter-rater reliability and test-retest reliability of the ALS-FTD-Q were not reported in any of the included studies.

While inter-rater reliability, test-retest reliability, and item-total correlations of the BBI were not reported, three studies reported that the internal consistency of the BBI was acceptable (Citation9,Citation35,Citation36) ().

One study reported that 7/9 MiND-B items had acceptable item-total correlations (Citation37) and two studies reported acceptable internal consistency (Citation11, Citation37). The inter-rater reliability and test-retest reliability of the MiND-B were not reported in any of the studies.

3.2. Validity

Clinical and convergent validity of the different measures are summarized in . No validity data for the ALS-FTD-Q cutoff score has been reported.

Table 7. Test cutoff scores, sensitivity, specificity, area under the curve and convergent validity.

3.2.1. Clinical validity data for the ECASc

Generally, the sensitivity and specificity of ECASc cutoff scores varied from 0.5 to 1.0 (Citation26, Citation27, Citation38–40); see . Based on ROC curve analyses, the ECASc was good (Citation41) at discriminating between ALSci and cognitively normal individuals (Citation27, Citation38, Citation40) and between ALSci and Alzheimer’s dementia (Citation26).

Overall, there is substantial evidence that the ECASc has good clinical validity.

3.2.2. Clinical validity data for the ALS-CBSc

For the ALS-CBSc, nine studies reported validity statistics (Citation10,Citation25,Citation42–47) (). Three studies with good methodological quality examined the clinical validity of the ALS-CBSc (Citation10,Citation43,Citation47) (). There were some differences in the cutoff scores identified by the different studies but the reported sensitivity and specificity of those cutoff scores were very good to perfect.

3.2.3. Clinical validity data for the Mini-ACE

Validity data was given for the Mini-ACE by two studies (Citation17,Citation26) (). For differentiating Alzheimer’s dementia from pwALS, a cutoff slightly lower than the published cutoff score was identified, with excellent sensitivity and good specificity (Citation26). For identifying ALS plus (having cognitive and/or behavioral symptoms) from ALS cognitively normal, the published cutoff had fair sensitivity and excellent specificity (Citation17).

3.2.4. Clinical validity data for the ALS-CBSb

Six papers reported ALS-CBSb validity data (Citation10,Citation26,Citation34,Citation45,Citation47,Citation48) (). Two studies supported the clinical validity of the ALS-CBSb (Citation10, Citation47). They were in agreement over the cutoff score for determining ALS-FTD and reported similar cutoff scores for ALSbi, all with very good to excellent sensitivity and fair to very good specificity.

3.2.5. Clinical validity data for the BBI

The two studies that reported clinical validity and were high in methodological quality identified different cutoff scores with very good to excellent sensitivity and good to excellent specificity (Citation9, Citation35).

3.2.6. Clinical validity data for the MiND-B

The published cutoff scores for the MiND-B had very good to excellent sensitivity and medium to good specificity, according to two studies with high methodological quality (Citation11,Citation17) ().

3.2.7. Clinical validity data for the ALSFTD-Q

There were no available studies to support the clinical validity of the ALS-FTD-Q.

3.2.8. Convergent validity ()

Convergent validity was demonstrated between the ECASc and the ALS-CBSc (Citation25, Citation26, Citation42, Citation44), between the ECASc and Montreal Cognitive Assessment (MoCA) (Citation15, Citation23, Citation30, Citation32, Citation33, Citation49) between the ECASc and the Frontal Assessment Battery (FAB) (Citation14, Citation23, Citation29, Citation30, Citation33, Citation49), and between the ECASc and other cognitive tests (Citation30, Citation50, Citation51). Evidence of the convergent validity of the ECASc was, therefore, very strong.

As well as evidence of convergent validity between the ECASc and ALS-CBSc (Citation25, Citation26, Citation42, Citation44), there was also evidence of convergent validity between the ALS-CBSc and the Mini-ACE (Citation26). In addition, there was evidence of convergent validity between the ALS-CBSc and other cognitive tests (Citation45, Citation46).

There was evidence of convergent validity between the ECASb and ALS-CBSb (Citation25,Citation26,Citation34) () and between the ALS-CBSb and the other behavioral measures (Citation34, Citation45, Citation48).

As well as the evidence of convergent validity between the ALS-FTD-Q and the BBI (Citation52), convergent validity was demonstrated between the ALS-FTD-Q and the Frontal Systems Behavior Scale (FrSBe) (Citation18, Citation53), and between the ALS-FTD-Q and the Frontal Behavioral Inventory (FBI) (Citation18,Citation49,Citation54) (). There was evidence of convergent validity between the BBI and the FrSBe and between the BBI and the FAB but this evidence was not extensive (Citation9) (). There was evidence of divergent validity between the MiND-B and the ECASc, suggesting that the MiND-B measures behavioral change as an independent construct from cognitive change (Citation37).

3.2.9. Structural validity

One study (Citation34), using Principal Components Analysis (PCA), reported that the ALS-CBSb has a single component structure. For the BBI, another study (Citation35) reported that five items loaded weakly on the component of behavioral impairment when using PCA but reported a clear single factor structure. When PCA was conducted for the MiND-B to confirm unidimensionality, only 44% of raw variance was explained (target: 50%) (Citation11). Both studies were awarded high scores in the risk of bias and study quality assessment. The structural validity of the ECASc, ALS-CBSc, Mini-ACE, ECASb, and ALS-FTD-Q has not been assessed.

4. Discussion

The purpose of this systematic review was to assess the evidence of reliability and validity relating to screening tools for cognitive and behavioral change in pwALS. This systematic review assessed 37 studies. Most (20/37) studies focused on the ECASc.

4.1. Cognitive screens

For cognitive screening tools, the methodological quality of studies varied, with 17/26 studies achieving the maximum possible score (signifying low risk of bias and high study quality).

Twenty studies reported reliability and/or validity statistics for the ECASc ( and ).

Given the extensive evidence of the reliability (internal consistency and inter-rater reliability) and validity of the ECASc and given that it is ALS-specific and tailored to people with ALS who are unable to either speak or write a response, the ECASc appears to be a suitable assessment option for clinicians and researchers, based on this review.

Ten studies reported validity statistics for the ALS-CBSc (). Overall, there was good evidence for the validity of the ALS-CBSc, though evidence of its reliability was limited. The ALS-CBSc is an ALS-specific measure, but there are insufficient adjustment mechanisms in place for people with ALS who cannot write or cannot say their responses. Despite good evidence of validity, the ALS-CBSc is limited by its lack of accessibility for some pwALS.

Evidence of the validity of Mini-ACE, in terms of its use with pwALS, was limited and there was no data concerning the Mini-ACE’s reliability. The Mini-ACE is also not ALS-specific and makes no adjustments for writing/speech difficulties. Based on the evidence considered in this systematic review, the Mini-ACE was the weakest of the three cognitive screening tools for identifying cognitive impairment in pwALS.

4.2. Behavioral screens

The methodological quality of behavioral screen studies was generally high. Reliability and validity statistics were presented for the ECASb by only four studies (Citation23,Citation25,Citation26,Citation34) ( and ). The internal consistency of the ECASb was questionable as it was only assessed by one study (Citation25) that found its internal consistency to be statistically unacceptable. However, this may not necessarily be a weakness of the ECASb since there is no published evidence for its unidimensionality and no indication that identified behaviors contribute equally to a classification of ALSbi. Evidence of validity and reliability for the ECASb was, therefore, limited, thereby reducing evidence that can be used to justify its choice for the behavioral assessment of people with ALS.

There was good evidence for the validity of the ALS-CBSb but this was not extensive and there was limited evidence of ALS-CBSb reliability.

While evidence of the validity and reliability of the ALS-FTD-Q comes from a small number of studies, the quality of evidence was good and is, therefore, a good option for clinicians and researchers.

For the BBI, validity and reliability statistics were reported by four studies (Citation9,Citation35,Citation36,Citation52) ( and ). The BBI is ALS-specific and very thorough, though lengthy. The evidence reviewed in this study suggests that the BBI is a good option for researchers and clinicians who are not under assessment time constraints.

Three studies evaluated the reliability and validity of the MiND-B (Citation11,Citation17,Citation37) ( and ). Due to limited evidence of the reliability and validity of the MiND-B evaluated in this review, it is likely not the best option for clinicians and researchers, especially given that other measures are available.

Consistent with a previous review (Citation5), the current review suggested that the ECASc was the most appropriate screening tool for cognitive impairment in ALS with the strongest validation evidence. Another review (Citation7) also concluded that the ECASc, along with the ALS-CBSc, had evidence of good clinical validity. A third review (Citation6), however, highlighted that assessments of the psychometric properties of the ALS-CBSc are limited. The findings of this systematic review do not contradict this statement, but this is true of all of the assessed cognitive and behavioral screening tools, with the exception of the ECASc. It was previously highlighted (Citation5) that the evidence of behavioral screening tool validity was limited; this is still the case, although eight studies have since contributed to the evidence-base (Citation25, Citation26, Citation29, Citation30, Citation34, Citation35, Citation37, Citation42). The results of the current review concur with previous conclusions (Citation5) that the validity of the BBI and ALS-FTD-Q is similar but as the BBI is more comprehensive, it may be the better option. The advantage of the ALS-FTD-Q is that it is briefer and therefore quicker to complete than the BBI.

This systematic review assessed most ALS-specific screening tools for cognitive and behavioral impairment. This is the first systematic review of several ALS-specific cognitive and behavioral screening tools, beyond the ECASc and ALS-CBS, to evaluate both their reliability and validity. It was critical of the methods used to generate cutoff scores as part of the risk of bias and study quality assessment. However, this review did not evaluate the effect of age and education on scores on screening tools and how cutoff scores may vary depending on these factors.

This review excluded test-retest reliability studies where test sessions were more than two weeks apart (Citation20). In such cases the mean duration between test sessions was often around six months (Citation55). While this may reduce practice effects studies may instead be measuring sensitivity to progressive deterioration.

The current review assumed equivalence of the screening measures in different languages. Given that some cognitive items were altered to be culturally suitable, adapted cognitive screening tools may have functioned differently to the original.

All but one study (Citation26) included in this review used healthy control group data for ROC curve analysis in order to evaluate the sensitivity and specificity of screening tool cutoff scores. These multiple studies are, therefore, informative when trying to identify impairment in pwALS when compared to the normal population. The comparison of pwALS with another clinical group (e.g., Alzheimer’s disease; (Citation26)) addresses a different diagnostic question and data on sensitivity and specificity must be examined in that context rather than in the context of distinguishing pwALS from healthy controls.

The conclusion of this review is that the ECASc remains the most suitable tool for assessing cognitive impairment in ALS because of its suitability to the population and the extensive evidence of its reliability (internal consistency and inter-rater reliability) and validity. For behavioral assessment, the evidence examined here suggests that the BBI or ALS-FTD-Q are the most suitable for clinical and research use, with the BBI being the most thorough and ALS-FTD-Q being briefer. Therefore, this systematic review recommends that clinicians and researchers consider the use of the ECASc to measure cognitive change in pwALS. When assessing behavioral change in pwALS clinicians and researchers should weigh up the need for a more comprehensive as opposed to a briefer assessment and, if opting to choose other measures of ALSci and ALSbi, should appraise themselves of the psychometric properties of the measures, and of the clinical groups in which they have been validated, before adopting them for use.

Supplemental material

Supplemental Material

Download MS Word (63.7 KB)

Acknowledgments

This study was funded by the Motor Neurone Disease Association (Goldstein/Oct17/892-792). AA-C is an NIHR Senior Investigator (NIHR202421). AA-C is part-funded by an EU Joint Programme Neurodegenerative Disease Research (JPND) project. The project is supported through the following funding organizations under the egis of JPND – www.jpnd.eu (United Kingdom, Medical Research Council (MR/L501529/1; MR/R024804/1) and Economic and Social Research Council (ES/L008238/1)) and through the Motor Neurone Disease Association, My Name’5 Doddie Foundation, and Alan Davidson Foundation. This study represents independent research part-funded by the National Institute for Health and Care Research (NIHR) Biomedical Research Center at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care.

Declaration of interest

The funder had no role in designing the review. AA-C reports consultancies or advisory boards for Amylyx, Apellis, Biogen, Brainstorm, Cytokinetics, GenieUs, GSK, Lilly, Mitsubishi Tanabe Pharma, Novartis, OrionPharma, Quralis, Sano, Sanofi, and Wave Pharmaceuticals. AA-C reports the following patent: Use of CSF-Neurofilament determinations and CSF-Neurofilament thresholds of prognostic and stratification value with regards to response to therapy in neuromuscular and neurodegenerative diseases. The other authors have no conflicts of interest to declare.

References

  • Ringholz GM, Appel SH, Bradshaw M, Cooke NA, Mosnik DM, Schulz PE. Prevalence and patterns of cognitive impairment in sporadic ALS. Neurology 2005;65:586–90.
  • Abrahams S. Neuropsychological impairment in amyotrophic lateral sclerosis – frontotemporal spectrum disorder. Nat Rev Neurol. 2023;19:655–67.
  • Strong MJ, Abrahams S, Goldstein LH, Woolley S, Mclaughlin P, Snowden J, et al. Amyotrophic lateral sclerosis – frontotemporal spectrum disorder (ALS-FTSD): Revised diagnostic criteria. Amyotroph Lateral Scler Frontotemporal Degener. 2017;18:153–74.
  • Rascovsky K, Hodges JR, Knopman D, Mendez MF, Kramer JH, Neuhaus J, et al. Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain. 2011;134:2456–77. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3170532/pdf/awr179.pdf
  • Simon N, Goldstein LH. Screening for cognitive and behavioral change in amyotrophic lateral sclerosis/motor neuron disease: a systematic review of validated screening methods. Amyotroph Lateral Scler Frontotemporal Degener. 2018;20:1–11.
  • Taule T, Søvik M, Lein RK, Wehling E, Aßmus J, Rekand T. Psychometric properties of cognitive assessment in amyotrophic lateral sclerosis: a systematic review. Patient Relat Outcome Meas. 2020; 11:181–94.
  • Gosselt IK, Nijboer TCW, Van Es MA. An overview of screening instruments for cognition and behavior in patients with ALS: selecting the appropriate tool for clinical practice. Amyotroph Lateral Scler Frontotemporal Degener. 2020; 21:324–36.
  • Abrahams S, Newton J, Niven E, Foley J, Bak TH. Screening for cognition and behaviour changes in ALS. Amyotroph Lateral Scler Frontotemporal Degener. 2014;15:9–14.
  • Elamin M, Pinto-Grau M, Burke T, Bede P, Rooney J, O’Sullivan M, et al. Identifying behavioural changes in ALS: Validation of the Beaumont Behavioural Inventory (BBI). Amyotroph Lateral Scler Frontotemporal Degener. 2017;18:68–73.
  • Woolley SC, York MK, Moore DH, Strutt AM, Murphy J, Schulz PE, et al. Detecting frontotemporal dysfunction in ALS: Utility of the ALS Cognitive Behavioral Screen (ALS-CBSTM). Amyotroph Lateral Scler. 2010;11:303–11.
  • Mioshi E, Hsieh S, Caga J, Ramsey E, Chen K, Lillo P, et al. A novel tool to detect behavioural symptoms in ALS. Amyotroph Lateral Scler Frontotemporal Degener. 2014;15:298–304.
  • Hsieh S, Schubert S, Hoon C, Mioshi E, Hodges JR. Validation of the Addenbrooke’s cognitive examination III in frontotemporal dementia and Alzheimer’s disease. Dement Geriatr Cogn Disord. 2013;36:242–50.
  • Mioshi E, Dawson K, Mitchell J, Arnold R, Hodges JR. The Addenbrooke’s Cognitive Examination Revised (ACE-R): a brief cognitive test battery for dementia screening. Int J Geriatr Psychiatry. 2006;21:1078–85.
  • Dubois B, Slachevsky A, Litvan I, Pillon B. The FAB: A frontal assessment battery at bedside. Neurology 2000;55:1621–6.
  • Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53:695–9.
  • Hsieh S, McGrory S, Leslie F, Dawson K, Ahmed S, Butler CR, et al. The Mini-Addenbrooke’s Cognitive Examination: A new assessment tool for dementia. Dement Geriatr Cogn Disord. 2015;39:1–11.
  • Hsieh S, Caga J, Leslie FVC, Shibata M, Daveson N, Foxe D, et al. Cognitive and behavioral symptoms in ALSFTD: detection, differentiation, and progression. J Geriatr Psychiatry Neurol. 2016;29:3–10. Available at: https://doi.org/10.1177/0891988715598232
  • Raaphorst J, Beeldman E, Schmand B, Berkhout J, Linssen WHJP, Van Den Berg LH, et al. The ALS-FTD-Q: A new screening tool for behavioral disturbances in ALS. Neurology 2012;79:1377–83.
  • Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Med. 2009;6:e1000097. Available from: http://www.prisma-statement.
  • Streiner DL, Norman GR, Cairney J. Health measurement scales. A practical guide to their development and use. 4th ed. New York: Oxford University Press; 2014.
  • Bogduk N. On understanding the validity of diagnostic tests. Interventional Pain Medicine. 2022;1:100127.
  • Rossi TM. Study design synopsis: Clinical validation of diagnostic tests. Equine Vet J. 2020;53:410–3.
  • Poletti B, Solca F, Carelli L, Madotto F, Lafronza A, Faini A, et al. The validation of the Italian Edinburgh Cognitive and Behavioural ALS Screen (ECAS). Amyotroph Lateral Scler Frontotemporal Degener. 2016;17:489–98.
  • Ye S, Ji Y, Li C, He J, Liu X, Fan D. The Edinburgh Cognitive and Behavioural ALS Screen in a Chinese Amyotrophic Lateral Sclerosis Population. PLoS One. 2016;11:e0155496. Available at: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4873026/pdf/pone.0155496.pdf
  • Mora JS, Salas T, Fernández MC, Rodríguez-Castillo V, Marín S, Chaverri D, et al. Spanish adaptation of the edinburgh cognitive and behavioral amyotrophic lateral sclerosis screen (ECAS). Amyotroph Lateral Scler Frontotemporal Degener. 2018;19:74–9.
  • Kourtesis P, Christidi F, Margioti E, Demenega C, Rentzos M, Evdokimidis I, et al. The Edinburgh cognitive and behavioral amyotrophic lateral sclerosis screen (ECAS): sensitivity in differentiating between ALS and Alzheimer’s disease in a Greek population. Amyotroph Lateral Scler Frontotemporal Degener. 2019;21:78–85.
  • Mojtabavi H, Nafissi S, Mahmoodi-Bakhtiari B, Fathi D, Fatehi F. Persian adaptation of Edinburgh Cognitive and Behavioural Screen (ECAS). Amyotroph Lateral Scler Frontotemporal Degener. 2021;22:426–33.
  • Watanabe Y, Beeldman E, Raaphorst J, Izumi Y, Yoshino H, Masuda M, et al. Japanese version of the ALS-FTD-Questionnaire (ALS-FTD-Q-J). J Neurol Sci. 2016;367:51–5.
  • Kacem I, Abida Y, Ferchichi W, Mrabet S, Sghaier I, Gharbi A, et al. Arabic adaptation of the Edinburgh cognitive and behavioural Amyotrophic lateral sclerosis screen (ECAS-AR). Rev Neurol (Paris). 2022;178:817–25.
  • Lee J, Kim A, Choi SJ, Cho E, Seo J, Oh SI, et al. Development and validation of the Korean Version of the Edinburgh cognitive and behavioral amyotrophic lateral sclerosis Screen (ECAS-K). J Clin Neurol. 2023;19:454–9.
  • Fazio R, Soósová N, Bak T, Růžička E, Bezdicek O. A normative study of the Czech Edinburgh Cognitive and Behavioural ALS Screen (ECAS): a brief report. Clin Neuropsychol. 2021;35:S65–S72.
  • Albertyn CH, Hardy A, Bakker LA, Hlangani M, Van Der Walt K, Zeilinga B, et al. Adaptation and norming of the Edinburgh Cognitive and behavioural amyotrophic lateral sclerosis screen (ECAS) for three language groups in South Africa. Amyotroph Lateral Scler Frontotemporal Degener. 2022;23:532–41.
  • Lulé D, Burkhardt C, Abdulla S, Böhm S, Kollewe K, Uttner I, et al. The Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis Screen: A cross-sectional comparison of established screening tools in a German-Swiss population. Amyotroph Lateral Scler Frontotemporal Degener. 2015;16:16–23.
  • Aiello EN, Solca F, Greco LC, La Tona A, Torre S, Carelli L, et al. Standardization of the Italian ALS-CBSTM Caregiver Behavioral Questionnaire. Front Psychol. 2023;13:1107001.
  • Iazzolino B, Pain D, Laura P, Aiello EN, Gallucci M, Radici A, et al. Italian adaptation of the Beaumont Behavioral Inventory (BBI): psychometric properties and clinical usability. Amyotroph Lateral Scler Frontotemporal Degener. 2022;23:81–6.
  • Burke T, Pinto-Grau M, Lonergan K, Bede P, O’Sullivan M, Heverin M, et al. A Cross-sectional population-based investigation into behavioral change in amyotrophic lateral sclerosis: subphenotypes, staging, cognitive predictors, and survival. Ann Clin Transl Neurol. 2017;4:305–17.
  • Rahimzadeh Goradel R, Sattarpour R, Hooshyari Z, Taebi M, Ghavampour A, Jazani MR, et al. Examining the validity and reliability of the Persian version of the MiND-B questionnaire in ALS patients. Brain Behav 2023;13(9):e3167.
  • Aiello EN, Iazzolino B, Pain D, Peotta L, Palumbo F, Radici A, et al. The diagnostic value of the Italian version of the Edinburgh Cognitive and Behavioral ALS Screen (ECAS). Amyotroph Lateral Scler Frontotemporal Degener. 2022;23:527–31.
  • Beeldman E, Govaarts R, de Visser M, van Es MA, Pijnenburg YAL, Schmand BA, et al. Screening for cognition in amyotrophic lateral sclerosis: test characteristics of a new screen. J Neurol. 2021;268:2533–40.
  • Niven E, Newton J, Foley J, Colville S, Swingler R, Chandran S, et al. Validation of the Edinburgh Cognitive and Behavioural Amyotrophic Lateral Sclerosis Screen (ECAS): a cognitive tool for motor disorders. Amyotroph Lateral Scler Frontotemporal Degener. 2015;16:172–9.
  • Okeh UM, Okoro CN. Evaluating measures of indicators of diagnostic test performance: fundamental meanings and formulars. J Biom Biostat 2012;03:1–10.
  • Aiello EN, Solca F, Greco LC, Torre S, Carelli L, Morelli C, et al. Equating norms between the ALS Cognitive Behavioral Screen (ALS-CBSTM) and the Edinburgh Cognitive and Behavioural ALS Screen (ECAS) in non-demented ALS patients. J Neurol. 2023;270:4090–5.
  • Branco LMT, Zanao T, De Rezende TJ, Casseb RF, Balthazar MF, Woolley SC, et al. Transcultural validation of the ALS-CBS cognitive section for the Brazilian population. Amyotroph Lateral Scler Frontotemporal Degener. 2017;18:60–7.
  • Greco LC, Lizio A, Casiraghi J, Ada Sansone V, Tremolizzo L, Riva N, et al. A preliminary comparison between ECAS and ALS-CBS in classifying cognitive-behavioural phenotypes in a cohort of non-demented amyotrophic lateral sclerosis patients. J Neurol. 2021;269:1899–904.
  • Murphy J, Factor-Litvak P, Goetz R, Lomen-Hoerth C, Nagy PL, Hupf J, et al. Cognitive-behavioral screening reveals prevalent impairment in a large multicenter ALS Cohort. Neurology. 2016;86:813–20.
  • Tremolizzo L, Lizio A, Santangelo G, Diamanti S, Lunetta C, Gerardi F, et al. ALS Cognitive Behavioral Screen (ALS-CBS): normative values for the Italian population and clinical usability. Neurol Sci. 2020;41:835–41.
  • Turon-Sans J, Gascon-Bayarri J, Reñé R, Rico I, Gámez C, Paipa A, et al. Cognitive impairment in ALS patients and validation of the Spanish version of the ALS-CBS test. Amyotroph Lateral Scler Frontotemporal Degener. 2016;17:221–7.
  • Murphy J, Ahmed F, Lomen-Hoerth C. The UCSF screening exam effectively screens cognitive and behavioral impairment in patients with ALS. Amyotroph Lateral Scler Frontotemporal Degener. 2015;16:24–30.
  • Watanabe Y, Ogino M, Ichikawa H, Hanajima R, Nakashima K. The Edinburgh Cognitive and Behavioural ALS Screen (ECAS) for Japanese ALS and FTD patients. Amyotroph Lateral Scler Frontotemporal Degener. 2021;22:66–72.
  • De Icaza Valenzuela MM, Bak TH, Pal S, Abrahams S. The Edinburgh Cognitive and Behavioral ALS screen: relationship to age, education, IQ and the Addenbrooke’s Cognitive Examination-III. Amyotroph Lateral Scler Frontotemporal Degener. 2018;19:585–90.
  • Saxon JA, Thompson JC, Harris JM, Ealing J, Hamdalla H, Chaouch A, et al. The Edinburgh Cognitive and Behavioral ALS Screen (ECAS) in frontotemporal dementia. Amyotroph Lateral Scler Frontotemporal Degener. 2020;21:606–13.
  • Pinto-Grau M, Costello E, O'Connor S, Elamin M, Burke T, Heverin M, et al. Assessing behavioural changes in ALS: cross-validation of ALS-specific measures. J Neurol. 2017;264:1397–401. Available at: https://doi.org/10.1007/s00415-017-8536-6.pdf
  • Grace J, Malloy P. Frontal systems behavior scale: professional manual. Lutz, Florida: Psychological Assessment Resources Inc; 2001.
  • Kertesz A, Davidson W, Fox H. Frontal behavioral inventory: diagnostic criteria for frontal lobe dementia. Can J Neurol Sci. 1997;24:29–36.
  • Bock M, Duong YN, Kim A, Allen I, Murphy J, Lomen-Hoerth C. Progression and effect of cognitive-behavioral changes in patients with amyotrophic lateral sclerosis. Neurol Clin Pract. 2017;7:488–98.
  • Bakker LA, Schröder CD, Spreij LA, Verhaegen M, De Vocht J, Van Damme P, et al. Derivation of norms for the Dutch version of the Edinburgh cognitive and behavioral ALS screen. Amyotroph Lateral Scler Frontotemporal Degener. 2019;20:19–27.
  • Díaz JL, Mondragón H, Sancho J, Aguilar EJ, Servera E. Relationship between cognitive-behavioral impairment and clinical and functional parameters in ALS and reliability of the Edinburgh Cognitive and Behavioural ALS screen to assess ALS: preliminary findings. Cogn Behav Neurol. 2019;32:185–92.
  • Mathuranath PS, Nestor PJ, Berrios GE, Rakowicz W, Hodges JR. A brief cognitive test battery to differentiate Alzheimer’s disease and frontotemporal dementia. Neurology 2000;55:1613–20.
  • Kertesz A, Nadkarni N, Davidson W, Thomas A. The Frontal Behavioral Inventory in the differential diagnosis of frontotemporal dementia. J Int Neuropsychol Soc. 2000;6:460–8.
  • Weigl E. On the psychology of so-called processes of abstraction. J Abnorm Soc Psychol. 1941;36:3–33.
  • Kay J, Lesser R, Coltheart M. Psycholinguistic assessments of language processing in aphasia (PALPA). East Sussex: Lawrence Erlbaum Associates; 1992.