1,016
Views
2
CrossRef citations to date
0
Altmetric
Cognition

Italian reference values and brain correlates of verbal fluency index – vs standard verbal fluency test – to assess executive dysfunction in ALS

, , , , , , , , ORCID Icon, , , , ORCID Icon, , ORCID Icon & show all
Pages 457-465 | Received 31 Oct 2022, Accepted 09 Jan 2023, Published online: 18 Jan 2023

Abstract

Objectives: In amyotrophic lateral sclerosis (ALS), verbal fluency index (Vfi) is used to investigate fluency accounting for motor impairment. This study has three aims: (1) to provide Vfi reference values from a cohort of Italian healthy subjects; (2) to assess the ability of Vfi reference values (vs standard verbal fluency test [VFT]) in distinguishing ALS patients with and without executive dysfunction; and (3) to investigate the association between Vfi and brain structural features of ALS patients. Methods: We included 180 healthy subjects and 157 ALS patients who underwent neuropsychological assessment, including VFT and Vfi, and brain MRI. Healthy subjects were split into four subgroups according to sex and education. For each subgroup, we defined the 95th percentile of Vfi as the cutoff. In ALS, the distributions of “abnormal” cases based on Vfi and standard VFT cutoffs were compared using Fisher’s exact test. Using quantile regressions in patients, we assessed the association between Vfi and VFT scores, separately, with gray matter volumes and white matter (WM) tract integrity. Results: Applying Vfi and VFT cutoffs, 9 and 13% of ALS cases, respectively, had abnormal scores (p < 0.001). In ALS, while higher Vfi scores were associated with WM changes of callosal fibers linking supplementary motor area, lower VFT performances related to corticospinal tract alterations. Discussion: We provided Italian reference values for the spoken Vfi. Compared to VFT, Vfis are critical to disentangle motor and cognitive deficits in ALS. In patients, abnormal Vfis were associated with damage to WM tracts specifically involved in ideational information processing.

Introduction

Amyotrophic lateral sclerosis (ALS), the most common form of motor neuron disease, is a progressive and fatal neurodegenerative disorder characterized by the degeneration of both the upper and lower motor neurons (Citation1). In about 35–45% of ALS patients concomitant cognitive and/or behavioral deficits may occur, with 14% of these cases presenting with a comorbid behavioral variant frontotemporal dementia (bvFTD) (Citation1,Citation2). The most frequent cognitive changes are executive function and language deficits, while typical behavioral disturbances are apathy, loss of sympathy and empathy, stereotyped behaviors and dietary changes (Citation2,Citation3).

According to the revised consensus criteria (Citation4), a diagnosis of ALS with cognitive impairment depends on the presence of executive and/or language dysfunction. The executive dysfunction is defined by the sole presence of deficits in verbal letter fluency or in two non-overlapping executive tests. Verbal letter fluency is assessed with the verbal fluency test (VFT), in which subjects are required to produce as many words as possible beginning with a certain letter within a limited amount of time (usually 60 s per letter). In ALS, VFT pathological scores are considered a sensitive early marker of executive function difficulties (Citation5,Citation6). However, a major concern is that VFT can be affected by patient speech motor disabilities resulting from bulbar involvement (Citation7). In the original paper of Abrahams et al. (Citation7), authors observed a performance decrement in the ALS patient group on the spoken VFT without the inclusion of the speech motor control condition. Being VFT determinant for the cognitive classification of ALS patients, this test is valid only if controlled for motor and/or speech impairment, otherwise would lead to an over estimation and misclassification of patients’ cognitive deficits with implications in terms of prognosis, treatment, expectations about the adherence to treatment, prognosis and caregiver burden (Citation8). To overcome such a limitation, the verbal fluency index (Vfi = 60 s-seconds to read aloud words/correct words generated) was introduced, which allows the investigation of fluency accounting for motor impairment (Citation7). Vfi has been included in the Edinburgh Cognitive and Behavioral ALS Screen (ECAS) (Citation9).

In Italy, the need of Vfi reference values has been partially satisfied by the Italian ECAS, which provided a cutoff for the spoken letter fluency index of a single letter (Citation10). However, the Italian most common VFT is that of Novelli et al. (Citation11), which is still widely administered also to ALS patients. In this version of VFT, participants are required to produce as many words as possible beginning with the letters “F”, “P”, and “L” in three 1-min trials. Several findings suggested that the impact of executive abilities on fluency tests increases across the trials because patients need to remember earlier responses, suppress interference, and shift between proposed letters (Citation12,Citation13). Therefore, more trials should be more sensitive to executive dysfunctions than one trial alone, as in the case of ECAS. Italian normative values for Vfi of this commonly used version of VFT (Citation11) have not been provided yet.

With respect to this background, our study had three aims: (1) to provide Vfi reference values from a cohort of Italian healthy controls; (2) in a large cohort of ALS patients, to compare the ability of Vfi reference values vs. standard VFT cutoffs in distinguishing patients with and without executive dysfunction; and (3) to investigate the association between VFT and Vfi values, separately, with brain features of ALS patients. We hypothesized that a lower number of ALS patients would be classified as cognitively impaired based on the Vfi reference values with respect to using the standard VFT cutoffs. We further expected that the relationship between patients’ Vfi performances and their brain integrity would include regions specifically involved in lexical and ideational information processing.

Materials and methods

Subjects

From a large sample of 311 healthy controls, we retrospectively selected 180 subjects, aged 29–85 years, who had an available neuropsychological assessment which included both VFT and Vfi. Inclusion criteria were the following: normal neurological exam, Mini Mental State Examination (MMSE) score ≥27, and negative family history for neurodegenerative disorders. From a large sample of 235 patients with ALS, we retrospectively selected 157 cases, recruited in two expert centers in Milan (IRCCS Ospedale San Raffaele and IRCCS Istituto Auxologico Italiano), with a clinical diagnosis of probable or definite ALS (Citation14), and with an available neuropsychological assessment which included both VFT and Vfi. VFT and Vfi. Disease severity in patients was assessed using the ALS Functional Rating Scale-revised (ALSFRS-R) (Citation15). At study entry, all patients were receiving Riluzole and none had significant respiratory failure. A sub-sample of ALS patients (N = 95) also underwent a 3T MRI scan (see details below). Additional inclusion criteria for all participants were the following: native Italian-speaking, no significant medical illnesses or substance abuse that could interfere with cognitive functioning, no (other) major systemic, psychiatric, or neurological illnesses.

The study protocol was approved by local ethical standards committee on human experimentation and all participants provided written informed consent.

Cognitive and behavioral assessment

Neuropsychological assessments were performed by experienced neuropsychologists. Full details of the batteries administered to patients and controls are available on the supplementary material.

Among the executive functions, in patients and healthy controls, fluency was assessed with the spoken letter VFTs (Citation11) and the relative Vfis (Citation7). During the spoken letter VFT, each participant was asked to say aloud as many different words beginning with a given letter (P, F and L; excluding proper nouns and derived words) in a 60 s time period (Citation11). In order to obtain Vfi values, we applied the following procedure: for each letter of the VFT, the participant was asked to read aloud the produced words as fast as possible and the reading time (seconds) was recorded; a Vfi for each letter was calculated with the following formula: 60 s-seconds to read aloud words/correct words generated (Citation7); the three obtained Vfis (one for each letter) were finally averaged, thus obtaining one Vfi for each participant.

MRI acquisition

Using a 3.0 T scanner (Intera, Philips Medical Systems, Best, the Netherlands), the following brain MRI sequences were obtained from 95 ALS patients at the same center: T2-weighted spin echo; fluid-attenuated inversion recovery; 3D T1-weighted fast field echo (FFE); and pulsed-gradient SE echo planar. Full details on MRI acquisition are available on the supplementary material.

MRI analysis

MRI analysis has been previously described (Citation16). Full details on volumetry, diffusion map reconstruction and fiber tracking are available on the supplementary material.

Grey matter volumes

To obtain quantitative measures of regional gray matter (GM) volumes, GM maps of patients were parcellated into 90 Automated Anatomical Labeling (AAL) regions of interest.

White matter tractography

DT MRI analysis was performed using the FMRIB Diffusion Toolbox in FSL and the JIM6 software. Maps of mean diffusivity (MD), fractional anisotropy (FA), axial diffusivity (axD) and radial diffusivity (radD) were obtained. Seeds for tractography of the corticospinal tract (CST), corpus callosum (CC), cingulum, superior longitudinal (SLF), inferior longitudinal and uncinate fasciculi were defined, as previously described (Citation17,Citation18). In addition, using a “seed to target” approach, the CC was segmented into three portions to identify the callosal fibers linking the primary motor cortices, lateral premotor cortices and supplementary motor areas (CC-SMA) (Citation17). Fiber tracking was performed using a probabilistic tractography algorithm in FSL (probtrackx, Bedpostx) (Citation19).

Statistical analysis

Sociodemographic, cognitive, and behavioral data

Sociodemographic, cognitive, and behavioral features were compared between ALS and healthy controls using Mann–Whitney’s test and Fisher’s exact test for continuous and categorical variables, respectively. The statistical analyses were performed with using SPSS software (version 24.0; IBM Corp., Armonk, NY, USA). In order to verify the homogeneity of the ALS samples, these analyses were repeated between ALS patients who underwent (N = 95) or not (N = 62) the MRI scan.

Vfi reference values

In healthy controls, the relationship between age (≤60 vs >60 years), sex and education (≤13 vs >13 years) with Vfi scores was assessed using multiple quantile regression. As in the Italian version of ECAS (Citation10), which includes Vfi cutoffs for the letter S, we used 13 years of education for separating low and high educated participants. Vfi scores were found be significantly associated with education (p = 0.001), but not with sex (p = 0.051), and amply not with age which was removed by backward variable selection. Thus, for the definition of the reference cutoffs, healthy controls were split into four subgroups based on sex and education: N = 37 females, education >13; N = 76 females, education ≤13; N = 27 males, education >13; N = 40 males, education ≤13 (see Supplementary Table 1 for sociodemographic, cognitive and behavioral features of each of the four subgroups).

Table 1 Sociodemographic and clinical features of the sample.

In each healthy control subgroup, the distribution of the Vfi scores was examined. Since the distributions were not normal, we identified the cutoff differently from Abrahams et al. (Citation9). For each healthy control subgroup, we firstly estimated the 95th percentile of Vfi and its 95% confident interval (CI). In order to be highly conservative in the definition of normal scores (and thus reducing false positives cases), we defined the upper bound of the 95% CI as the cutoff to assess abnormal scores (Supplementary Figure 1).

As for the healthy control group, the ALS patient group was divided in four subgroups according to sex and education. Vfi reference cutoffs obtained in healthy controls were then applied to determine the possible presence of abnormal Vfi scores in patients. ALS Vfis were considered altered if they were greater than the reference cutoff. In the ALS cohort, the distribution of “abnormal” cases defined with the cutoffs of the Vfi and of the standard VFT (Citation11) was compared using Fisher’s exact test.

Finally, in order to verify the correlation between Vfi and other executive domain tests, in healthy controls we computed the Spearman’s correlation coefficient between VFT and Vfi scores, separately, with the performances at the Digit Span backward, Trail Making Test B-A, and Attentive Matrices.

The analyses were performed with R 3.5.0 (http://www.R-project.org/) and SPSS software (version 24.0; IBM Corp., Armonk, NY, USA). The quantreg R package was used for the estimation of the quantile regression and the quantileCI R package for the calculation of the 95% CI of the percentiles.

MRI analysis

In the group of ALS patients who also underwent MRI (N = 95), we assessed the association between VFT and Vfi values, separately, with GM volumes and WM tract integrity measures, by using quantile regression adjusted for age, sex and education (age and education considered as continuous variables). Bonferroni-correction for multiple comparisons was applied to the resulting p values considering GM and WM, separately. The quantreg package of R 3.5.0 (http://www.R-project.org/) was used for estimating the quantile regression.

Results

Sociodemographic, cognitive, and behavioral data

Sociodemographic and clinical features of healthy controls and ALS patients are presented in , while details on their neuropsychological features are shown in . ALS patients and healthy controls differed in age, sex and education (). The neuropsychological assessment revealed significant differences between groups in almost all the tests administered, including the VFT and the Vfi ().

Table 2 Neuropsychological assessment of the sample.

When classifying our ALS patient sample according to consensus criteria (Citation4), 13% presented with cognitive impairment, 10% had behavioral impairments, 6% presented both cognitive and behavioral difficulties, and 3% were ALS-FTD.

The comparison between ALS cases who underwent or not the MRI revealed that patients who performed the MRI (N = 95) were older. The two groups were similar for the remaining sociodemographic, clinical, and cognitive variables (Supplementary Table 2).

Vfi reference values

shows the resulting normative data of the Vfi for each healthy control subgroup. Applying Vfi cutoffs, 9% of ALS patients had an abnormal Vfi score. On the other hand, applying standard VFT cutoffs, 13% of patients with ALS showed a pathological performance. The distribution of the abnormal performances classified with the VFT (n = 20/157) and with the Vfi (n = 14/157) differed significantly (p < 0.001; see ).

Table 3 Reference data and cutoffs for the verbal fluency index (Vfi) in each subgroup of healthy controls.

Figure 1 Application of VFT and Vfi cutoffs. Graphs display the percentages of ALS patients with an impaired and normal performance applying VFT and Vfi cutoffs. p Value refers to Fisher’s exact test.

Figure 1 Application of VFT and Vfi cutoffs. Graphs display the percentages of ALS patients with an impaired and normal performance applying VFT and Vfi cutoffs. p Value refers to Fisher’s exact test.

The 8 cases classified as pathological by VFT (but not by Vfi) showed moderate disease severity (mean ALSFRS-R = 37.17; mean disease progression rate = 0.68). In the diagnostic classification according to Strong’s criteria (Citation4), 4/8 cases were classified as cognitively impaired by VFT only; the remaining four cases were classified in any case as ALS-FTD (N = 1), behaviorally impaired (N = 1), and cognitive impaired (N = 2) due to the presence of executive dysfunctions in other tests than fluency.

The 2 cases classified pathological by Vfi (but not by VFT) had bordeline performances based on standard VFT cutoffs (equivalent score = 1, between the 13.6th and the 5th percentile) and mild disease severity (mean ALSFRS-R = 44.00; mean disease progression rate = 0.25). According to the cognitive/behavioral classification (Citation4), these two cases were classified as ALS-FTD and cognitively and behaviorally impaired.

Relationship between VFT/Vfi and another executive test in healthy controls

In healthy controls, significant correlations were found between VFT and Vfi performances, separately, with executive functions scores, assessed with the Digit Span backward (VFT: rho = 0.237, p = 0.01; Vfi: rho= −0.199, p = 0.02), Trail Making Test B-A (VFT: rho= −0.282, p = 0.002; Vfi: rho = 0.297, p = 0.001), and Attentive Matrices (VFT: rho = 0.301, p = 0.001; Vfi: rho= −0.300, p = 0.001).

VFT and Vfi performances vs MRI features in ALS

In ALS, adjusted quantile regression between VFT and Vfi values, separately, with GM volumes and WM tract integrity measures showed that poor VFT scores were associated with WM alterations of the entire CC, CC-SMA, bilateral SLF, and right CST. Higher Vfi scores (reflecting a poor performance) were associated with WM alterations of the CC-SMA. Details of the DTI measures which were significantly associated with VFT scores and Vfis are reported in and . In ALS cases, no associations were found between any fluency score and GM volumes.

Figure 2 Significant relationships between patients’ verbal fluency test and verbal fluency index performances with their white matter tract integrity. Abbreviations: CC: corpus callosum; CC-SMA: callosal fibers linking the supplementary motor area; CST: corticospinal tract; L: left; R: right; SLF: superior longitudinal fasciculus.

Figure 2 Significant relationships between patients’ verbal fluency test and verbal fluency index performances with their white matter tract integrity. Abbreviations: CC: corpus callosum; CC-SMA: callosal fibers linking the supplementary motor area; CST: corticospinal tract; L: left; R: right; SLF: superior longitudinal fasciculus.

Table 4 Significant relationships between patients’ verbal fluency test and verbal fluency index performances and their white matter tract integrity.

Discussion

In the present study, we provided Italian Vfi reference values for the adjustment for ALS motor and/or speech impairment during fluency performances. Applying the standard and the identified Vfi reference cutoffs in a large cohort of ALS patients, we demonstrated a significant difference in the classification of patients with abnormal fluency. As hypothesized, using the normative Vfi cutoffs defined in this study, the percentage of patients who had abnormal fluency indices (and thus potentially classified as ALS with cognitive impairment) was significantly lower compared to standard VFT. The eight patients classified as pathological by VFT (but not by Vfi) showed moderate to severe disease severity (in terms of ALSFRS-R and progression rate), reflecting the possibility of a misclassification of patients’ executive dysfunction due to motor impairment. On the other hand, one can hypothesize that these cases classified “normal” by Vfi are false negatives. In fact, among these patients, one was classified as ALS-FTD according to Strong’s criteria (Citation4), one had behavioral impairment and two had executive impairments on tests other than verbal fluency. The Vfi cutoffs that we proposed allow to define or support the diagnosis for the fluency domain only, neither for other executive dysfunctions nor for behavioral impairment. Although we cannot totally exclude the presence of false negatives when using Vfi, we believe that those subjects (including the case of ALS-FTD) who were classified “normal” by our Vfi cutoffs did not have a clear fluency impairment.

Although the Italian version of ECAS is an accurate measure for screening the presence of fluency dysfunction in patients with ALS accounting for motor disability (Citation10), the Vfi values obtained using Novelli’s VFT (Citation11) can be useful for assessing cognitive decline in those patients who present with high level of physical fatigue and are unable to perform the entire ECAS battery, or in those centers with a limited number of neuropsychologists.

Furthermore, the Vfi values obtained using Novelli’s VFT, have the potential to increase the accuracy of ECAS in detecting a possible impairment. This is due to the robustness of the test presenting more than one trial (Citation11), which guarantees a reliable assessment of executive abilities, such as inhibition and switching, beyond the verbal (e.g. lexical/vocabulary knowledge) function (Citation12,Citation13). In this regard, we observed an association between Vfi values and higher order executive functions (as indexed by the digit span backward, Trail Making Test B-A, and Attentive Matrices performances) in healthy subjects.

In this study, we obtained Vfi reference values from a large and well-defined sample of healthy adults. In defining the cohort of controls, we took care to enroll participants with a normal score on MMSE (≥27) and negative family history for neurodegenerative disorders.

As in a previous study on normative data in a Dutch population (Citation20), we did not find age-related differences on Vfi performance. While the effect of age on semantic fluency has been consistently demonstrated (Citation21), the total number of produced words in letter fluency seems to be stable across the tested age-range (Citation22,Citation23). In fact, letter fluency performance on conventional tests increases until 39 years of age with only a mild decline after the age of 70 (Citation24). Most of the normal subjects in our cohort were between 40 and 70 years of age, which might explain the absence of an age effect in this sample. On the other hand, Vfi values were associated with years of education and sex, with higher performances in highly educated subjects and females, which is consistent with other studies on Vfi and standard VFT (Citation20,Citation25).

In patients with ALS, we observed that lower VFT scores were associated with a widespread pattern of WM tract alterations, including both motor (CST) and extra-motor (bilateral SLF, CC) pathways, reflecting the influence of ALS motor impairment on the spoken fluency performed in a standard modality. On the other hand, abnormal Vfis were associated with a focal damage to callosal fibers linking to SMA. SMA is significantly involved in speech production (Citation26), working memory, sequence processing and cognitive control (Citation27,Citation28). The link of this structure with fluency and executive performances has been corroborated by functional-MRI overt verbal fluency paradigms in healthy controls (Citation29–32) and by findings on patients affected by the “SMA syndrome” (Citation33,Citation34). These latter cases, who underwent a neurosurgical resection of the dorsal part of the superior frontal cortex (Citation35), showed a poor letter (more than category) fluency and decreased performances on dual tasks and cognitive control.

Interestingly, although it is known that letter fluency involves different GM areas, especially the left inferior frontal gyrus (Citation36,Citation37) and the subcortical brain regions (Citation38), we did not find association between fluency performances and GM volume integrity in our patient sample. Other GM metrics, such as cortical thickness, could be more informative on the associations with fluency in these patients.

Some caveats need to be considered when interpreting our findings. In this study we did not solve the potential inability of Vfi in detecting those cases with severe motor impairment and concomitant executive dysfunction. Furthermore, although we recruited a large population of healthy subjects, their distribution was not normal and, differently from Abrahams et al. (Citation9), we were compelled to identify the cutoffs based on percentile confidence intervals. Finally, due to the cross-sectional nature of the study, the evolving trajectory of the proposed Vfis (in parallel with the progression of motor impairment) as well as their ability to predict clinical worsening should be further investigated.

In conclusion, the present study provides Italian normative values of the spoken Vfi, which can be applied for detecting cognitive impairment in ALS accounting for patients’ motor impairment. Moreover, it demonstrates that, compared to standard VFT, Vfi is critical to disentangle motor and cognitive deficits in ALS. Finally, the correlation with MRI in ALS patients shows the association of abnormal Vfis with damage to WM tracts specifically involved in lexical and ideational information processing, such as callosal fibers linking to SMA.

Supplemental material

Supplemental Material

Download MS Word (18.2 KB)

Supplemental Material

Download MS Word (31 KB)

Supplemental Material

Download MS Word (51.3 KB)

Declaration of interest

V. Castelnovo, P.M.V. Rancoita, M. Leocadi, A. Lamanuzzi, E.G. Spinelli, S. Basaia, N. Riva, B. Poletti, F. Solca, S. Abrahams report no conflict of interest. E. Canu has received research supports from the Italian Ministry of Health. F. Verde is review editor for Frontiers in Aging Neuroscience. N. Ticozzi received compensation from consulting services from Amylyx Pharmaceuticals and Zambon Biotech SA and lecture fees from Italfarmaco. He received research funding from the Italian Ministry of Health and AriSLA. He is associate editor for Frontiers in Aging Neuroscience. V. Silani received compensation for consulting services and/or speaking activities from AveXis, Cytokinetics, Italfarmaco, and Zambon; and receives research supports from the Italian Ministry of Health (Grant RF-2013-02355764), Fondazione Regione per la Ricerca Biomedica Regione Lombardia (Project nr.2015-0023), and E-RARE JTC 2018 (Project Repetomics). M. Filippi is Editor-in-Chief of the Journal of Neurology; received compensation for consulting services and/or speaking activities from Alexion, Almirall, Bayer, Biogen, Celgene, Chiesi Italia SpA, Eli Lilly, Genzyme, Janssen, Merck, Neopharmed Gentili, Novartis, Novo Nordisk, Roche, Sanofi Genzyme, Takeda, and Teva Pharmaceutical Industries; and receives research support from Biogen, Merck, Novartis, Roche, Italian Ministry of Health, Fondazione Italiana Sclerosi Multipla, and ARiSLA (Fondazione Italiana di Ricerca per la SLA). F. Agosta is Section Editor of NeuroImage: Clinical; has received speaker honoraria from Biogen Idec, Roche and Zambon; and receives or has received research supports from the Italian Ministry of Health, AriSLA (Fondazione Italiana di Ricerca per la SLA), the European Research Council and the Foundation Research on Alzheimer Disease.

Data availability statement

The dataset used during the study will be made available by the corresponding author upon request to qualified researchers (i.e. affiliated with a university or research institution/hospital).

Additional information

Funding

This work was supported by the Italian Ministry of Health under Grants RF-2010-2313220, RF-2011-02351193, and GR-2013-02357415; the European Research Council under Grant StG-2016_714388_NeuroTRACK; and the Foundation Research on Alzheimer Disease.

References

  • Hardiman O, Al-Chalabi A, Chio A, Corr EM, Logroscino G, Robberecht W, et al. Amyotrophic lateral sclerosis. Nat Rev Dis Primers. 2017;3:17071.
  • Pender N, Pinto-Grau M, Hardiman O. Cognitive and behavioural impairment in amyotrophic lateral sclerosis. Curr Opin Neurol. 2020;33:649–54.
  • Taylor LJ, Brown RG, Tsermentseli S, Al-Chalabi A, Shaw CE, Ellis CM, et al. Is language impairment more common than executive dysfunction in amyotrophic lateral sclerosis? J Neurol Neurosurg Psychiatry. 2013;84:494–8.
  • Strong MJ, Abrahams S, Goldstein LH, Woolley S, McLaughlin P, Snowden J, et al. Amyotrophic lateral sclerosis - frontotemporal spectrum disorder (ALS-FTSD): revised diagnostic criteria. Amyotroph Lateral Scler Frontotemporal Degener. 2017;18:153–74.
  • Goldstein LH, Abrahams S. Changes in cognition and behaviour in amyotrophic lateral sclerosis: nature of impairment and implications for assessment. Lancet Neurol. 2013;12:368–80.
  • Phukan J, Pender NP, Hardiman O. Cognitive impairment in amyotrophic lateral sclerosis. Lancet Neurol. 2007;6:994–1003.
  • Abrahams S, Leigh PN, Harvey A, Vythelingum GN, Grise D, Goldstein LH. Verbal fluency and executive dysfunction in amyotrophic lateral sclerosis (ALS). Neuropsychologia. 2000;38:734–47.
  • Caga J, Hsieh S, Lillo P, Dudley K, Mioshi E. The impact of cognitive and behavioral symptoms on ALS patients and their caregivers. Front Neurol. 2019;10:192.
  • Abrahams S, Newton J, Niven E, Foley J, Bak TH. Screening for cognition and behaviour changes in ALS. Amyotroph Lateral Scler Frontotemporal Degener. 2014;15:9–14.
  • Poletti B, Solca F, Carelli L, Faini A, Madotto F, Lafronza A, et al. Cognitive-behavioral longitudinal assessment in ALS. The Italian Edinburgh cognitive and behavioral ALS screen (ECAS). Amyotroph Lateral Scler Frontotemporal Degener. 2018;19:387–95.
  • Novelli G, Papagno C, Capitani E, Laiacona M. Three clinical tests for the assessment of verbal long-term memory function: norms from 320 normal subjects. Arch Psicol Neurol Psichiatr. 1986;47:278–96.
  • Luo L, Luk G, Bialystok E. Effect of language proficiency and executive control on verbal fluency performance in bilinguals. Cognition. 2010;114:29–41.
  • Shao Z, Janse E, Visser K, Meyer AS. What do verbal fluency tasks measure? Predictors of verbal fluency performance in older adults. Front Psychol. 2014;5:772.
  • Brooks BR, Miller RG, Swash M, Munsat TL. El Escorial revisited: revised criteria for the diagnosis of amyotrophic lateral sclerosis. Amyotroph Lateral Scler Other Motor Neuron Disord. 2000;1:293–9.
  • Cedarbaum JM, Stambler N, Malta E, Fuller C, Hilt D, Thurmond B, et al. The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. BDNF ALS Study Group (Phase III). J Neurol Sci. 1999;169(1–2):13–21.
  • Agosta F, Spinelli EG, Riva N, Fontana A, Basaia S, Canu E, et al. Survival prediction models in motor neuron disease. Eur J Neurol. 2019;26:1143–52.
  • Agosta F, Galantucci S, Riva N, Chio A, Messina S, Iannaccone S, et al. Intrahemispheric and interhemispheric structural network abnormalities in PLS and ALS. Hum Brain Mapp. 2014;35:1710–22.
  • Agosta F, Galantucci S, Canu E, Cappa SF, Magnani G, Franceschi M, et al. Disruption of structural connectivity along the dorsal and ventral language pathways in patients with nonfluent and semantic variant primary progressive aphasia: a DT MRI study and a literature review. Brain Lang. 2013;127:157–66.
  • Behrens TE, Berg HJ, Jbabdi S, Rushworth MF, Woolrich MW. Probabilistic diffusion tractography with multiple fibre orientations: what can we gain? Neuroimage. 2007;34:144–55.
  • Beeldman E, Jaeger B, Raaphorst J, Seelen M, Veldink J, van den Berg L, et al. The verbal fluency index: Dutch normative data for cognitive testing in ALS. Amyotroph Lateral Scler Frontotemporal Degener. 2014;15:388–91.
  • Mathuranath PS, George A, Cherian PJ, Alexander A, Sarma SG, Sarma PS. Effects of age, education and gender on verbal fluency. J Clin Exp Neuropsychol. 2003;25:1057–64.
  • Crossley M, D'Arcy C, Rawson NS. Letter and category fluency in community-dwelling Canadian seniors: a comparison of normal participants to those with dementia of the Alzheimer or vascular type. J Clin Exp Neuropsychol. 1997;19:52–62.
  • Troyer AK, Moscovitch M, Winocur G. Clustering and switching as two components of verbal fluency: evidence from younger and older healthy adults. Neuropsychology. 1997;11:138–46.
  • Strauss ESE, Spreen O. Executive functions. A compendium of neuropsychological tests: administration, norms and commentary. 3rd ed. New York: Oxford University Press; 2006:499–526
  • Hirnstein M, Stuebs J, Moe A, Hausmann M. Sex/gender differences in verbal fluency and verbal-episodic memory: a meta-analysis. Perspect Psychol Sci. 2022. doi: 10.1177/17456916221082116
  • Hertrich I, Dietrich S, Ackermann H. The role of the supplementary motor area for speech and language processing. Neurosci Biobehav Rev. 2016;68:602–10.
  • Cona G, Semenza C. Supplementary motor area as key structure for domain-general sequence processing: a unified account. Neurosci Biobehav Rev. 2017;72:28–42.
  • Busan P. Developmental stuttering and the role of the supplementary motor cortex. J Fluency Disord. 2020;64:105763.
  • Abrahams S, Goldstein LH, Simmons A, Brammer MJ, Williams SC, Giampietro VP, et al. Functional magnetic resonance imaging of verbal fluency and confrontation naming using compressed image acquisition to permit overt responses. Hum Brain Mapp. 2003;20:29–40.
  • Alario FX, Chainay H, Lehericy S, Cohen L. The role of the supplementary motor area (SMA) in word production. Brain Res. 2006;1076:129–43.
  • Crosson B, Sadek JR, Maron L, Gokcay D, Mohr CM, Auerbach EJ, et al. Relative shift in activity from medial to lateral frontal cortex during internally versus externally guided word generation. J Cogn Neurosci. 2001;13:272–83.
  • Tremblay P, Gracco VL. Contribution of the pre-SMA to the production of words and non-speech oral motor gestures, as revealed by repetitive transcranial magnetic stimulation (rTMS). Brain Res. 2009;1268:112–24.
  • Canas A, Juncadella M, Lau R, Gabarros A, Hernandez M. Working memory deficits after lesions involving the supplementary motor area. Front Psychol. 2018;9:765.
  • Sjoberg RL, Stalnacke M, Andersson M, Eriksson J. The supplementary motor area syndrome and cognitive control. Neuropsychologia. 2019;129:141–5.
  • Bannur U, Rajshekhar V. Post operative supplementary motor area syndrome: clinical features and outcome. Br J Neurosurg. 2000;14:204–10.
  • Robinson G, Shallice T, Bozzali M, Cipolotti L. The differing roles of the frontal cortex in fluency tests. Brain. 2012;135:2202–14.
  • Cipolotti L, Molenberghs P, Dominguez J, Smith N, Smirni D, Xu T, et al. Fluency and rule breaking behaviour in the frontal cortex. Neuropsychologia. 2020;137:107308.
  • Ellfolk U, Joutsa J, Rinne JO, Parkkola R, Jokinen P, Karrasch M. Striatal volume is related to phonemic verbal fluency but not to semantic or alternating verbal fluency in early Parkinson’s disease. J Neural Transm. 2014;121:33–40.