1,914
Views
28
CrossRef citations to date
0
Altmetric
ORIGINAL ARTICLE

Syntactic processing as a marker for cognitive impairment in amyotrophic lateral sclerosis

, , , , &
Pages 69-76 | Received 23 Mar 2015, Accepted 01 Jun 2015, Published online: 24 Aug 2015

Abstract

Despite recent interest in cognitive changes in patients with amyotrophic lateral sclerosis (ALS), investigations of language function looking at the level of word, sentence and discourse processing are relatively scarce. Data were obtained from 26 patients with sporadic ALS and 26 healthy controls matched for age, education, gender, anxiety, depression and executive function performance. Standardized language tasks included confrontation naming, semantic access, and syntactic comprehension. Quantitative production analysis (QPA) was used to analyse connected speech samples of the Cookie Theft picture description task. Results showed that the ALS patients were impaired on standardized measures of grammatical comprehension and action/verb semantics. At the level of discourse, ALS patients were impaired on measures of syntactic complexity and fluency; however, the latter could be better explained by disease related factors. Discriminant analysis revealed that syntactic measures differentiated ALS patients from controls. In conclusion, patients with ALS exhibit deficits in receptive and expressive language on tasks of comprehension and connected speech production, respectively. Our findings suggest that syntactic processing deficits seem to be the predominant feature of language impairment in ALS and that these deficits can be detected by relatively simple language tests.

Introduction

There is currently great interest in characterizing the cognitive profiles of patients with amyotrophic lateral sclerosis (ALS) who do not meet criteria for frontotemporal lobar degeneration (FTLD) (Citation1). Considering that degeneration in ALS affects primarily posterior frontal regions, this line of research has mainly focused on the presence of executive functions (e.g. (Citation2–4)). Nevertheless, in recent years research has shown that cognitive deficits go beyond an executive dysfunction syndrome and reveal that language is also affected (Citation5–7). A variety of structured language tests have been used to detect linguistic impairment in ALS and the most common changes reported include confrontation naming, syntactic comprehension and verb processing (Citation8–11). Although there is some clinical utility in using standardized tests, this approach oversimplifies the complexity of the linguistic data as these tests do not evaluate functional language skills such as discourse.

Recent work has documented deficits in the ability of ALS patients to organize the local connectedness and maintenance of the theme during narrative discourse (Citation12). However, the specific nature of these deficits in ALS is not yet clear. This is critical because spontaneous connected speech is an essential part of everyday communication. Features of connected speech in ALS have only been investigated by one recent study that reported a deficit in grammatical expression (Citation13). The present study aimed to build on these recent findings (Citation13) and improve the characterization of connected speech production and other language functions in ALS. A secondary aim was to examine the potential of formal standardized language testing and spontaneous speech analysis in the identification of a specific linguistic marker for ALS.

Materials and methods

Participants

Twenty-six patients with sporadic ALS and 26 healthy controls participated in the study. ALS patients were mainly recruited from The King's Motor Neurone Disease (MND) Care and Research Centre, London, UK. Additional patients were recruited from Barts Health Motor Neurone Disease Centre in London and from the Motor Neurone Disease Association (MNDA) research register. Healthy control participants were recruited through a volunteer database and the local community.

Inclusion criteria for all participants were age < 75 years, English as a first language, right handedness, no history of cerebrovascular disease, hypertension, diabetes or head injury, not taking any psychoactive medication and IQ > 70. We included patients with probable or definite ALS (Citation14) within 24 months after diagnosis. Patients with bulbar symptoms (ALSFRS-R (Citation15) score on bulbar items 1–3, < 9), respiratory insufficiency (FVC < 70% predicted), and insufficiently intelligible speech were excluded. Additional patient exclusion criteria included a clinical diagnosis of Frontotemporal Dementia (FTD), Primary Progressive Aphasia (either progressive non-fluent aphasia (PNFA) or semantic dementia (SD)) – according to FTLD diagnostic criteria (Citation16). Control participants were matched as closely as possible to the ALS group for age, gender and education.

Measures

Patients’ functional abilities were assessed using the revised Amyotrophic Sclerosis Functional Rating Scale (ALSFRS-R) (Citation15). The Wechsler Abbreviated Scale of Intelligence (WASI) (Citation17) and Wechsler Test of Adult Reading (WTAR) (Citation18) were used to assess current and premorbid IQ, respectively. Symptoms of anxiety and depression were measured using the Hospital Anxiety and Depression Scale (HADS) (Citation19). The Family Form of the Frontal System Behaviour Scale (FrSBe) was used to assess behavioural changes (Citation20), characterized as scores on subscales of Apathy, Executive Dysfunction and Disinhibition.

The neuropsychological data for the present study included a broad battery of tests assessing executive function, visuoperceptual ability, memory and language. To determine differences in cognitive functioning outside the language domain between patients with ALS and healthy controls, composite scores were calculated for the Executive, Visuoperceptual and Memory domains (). This was undertaken with the aim of reducing the likelihood of making type 1 errors through multiple comparisons using each individual neuropsychological test score, following the methods described by Taylor et al. (Citation6).

Table I. Test indices included in cognitive composites.

Formal standardized language testing included measurements of confrontation naming, semantic access, and single word and syntactic comprehension. Confrontation naming was measured with the Graded Naming Test (Citation21). Semantic access of nouns/objects and verbs/action was measured by the Pyramids & Palm Trees (Citation22) and the Kissing & Dancing Tests (Citation22), respectively. Syntactic and single word comprehension was assessed with the Test of Reception of Grammar (Citation24), the modified Token Test (Citation25) and the British Picture Vocabulary Scale-II (Citation26).

The connected speech sample was taken from the Cookie Theft picture description component of the Boston Diagnostic Aphasia Examination (Citation33). Quantitative production analysis (QPA) (Citation34) was used to analyse the transcribed language samples following the approach used by Wilson et al. (Citation35). Transcripts were coded by two graduates trained in analysis of recorded discourse, blind to participants’ status. Coding showed high inter-rater reliability (correlations ranged from .85 to .93) with the exception of phonological distortions, paraphasias and semantic errors. The identification of distortions and semantic errors has been found to be the most problematic aspect of coding (Citation35). Distortions were defined as articulatory speech errors that did not involve frank phonemic substitutions. For patients with dysarthria, every word could potentially be classified as a distortion, so for these patients only words that were distorted above a patient's most accurate speech were coded as distortions. Semantic errors were recorded when participants produced sentences that were syntactically well-formed, but were either nonsensical or were semantically inappropriate for the context. The most common type of semantic errors involved substitutions of semantically related items. Discrepancies in coding were resolved following advice from a speech and language therapist.

The linguistic profile of connected speech production assessed measures under four main categories: 1) speech production (numbers of words, duration of narratives, speech rate, distortions and phonological paraphasias); 2) disruptions to fluency (false starts, filled pauses, repaired sequences and incomplete sentences); 3) lexical content (proportional frequencies of closed class words, pronouns and verbs); and 4) syntactic structure and complexity (mean length of utterances, proportional frequencies of words in sentences, number of embeddings, and semantic errors).

Ethics approval for the study was obtained from The Joint South London and Maudsley and The Institute of Psychiatry NHS Research Ethics Committee (07/H0807/85). Appropriate institutional approvals were obtained to permit recruitment from additional centres. Informed written consent was obtained from all participants, consistent with the Declaration of Helsinki.

Statistical analysis

The data were analysed using Statistical Package for the Social Sciences (SPSS) Version 21. Variables were checked for normality and homogeneity assumptions of parametric tests. Between-group comparisons were undertaken using t-tests or multivariate analysis of covariance (MANCOVA). Categorical data were analysed using χ2 tests. Pearson's correlations and discriminant function analyses were used to examine the relationships between language scores and clinical measures. All tests were two-tailed and statistical significance was set at p < 0.05.

Results

Background characteristics

Demographic and clinical characteristics of participants are summarized in . The mean ALSFRS-R score at the time of neuropsychological assessment was 40.38 (SD, 4.16). Eighty-five percent of patients had limb onset and 15% had bulbar-onset disease, with an average delay from symptom onset to diagnosis of approximately 10 months (M = 9.26, SD = 7.8). Seventy-six percent of ALS patients were taking riluzole at the time of assessment. There were no significant differences between the groups in terms of age, education, gender ratio, current IQ or estimated premorbid IQ, current FrSBe subscale scores as rated by informants, or HADS anxiety and depression scores. The groups also did not differ in terms of their executive function, memory or visuoperceptual performance as measured by composite score domains.

Table II. Demographic and clinical characteristics of participants and composite scores.

The specificity of interpretations drawn from this study may be restricted by the use of cognitive composite scores derived from varied assessment measures. Although this method avoids type 1 errors and allows a more global interpretation based on overall rates of impairment in executive and other domains, further details of scores on individual measures () provide additional information concerning the profiles of cognitive impairment. Individual measures of executive, memory and visuoperceptual functioning did not differ between ALS patients and controls, with the exception of TEA dual decrement (p = .049), the WCST categories achieved (p = .052) and CVLT short- delay recall (p = .058) which showed marginal differences. These data were not used further in this study. However, after individual inspection of the data, four patients with ALS exhibited impaired phonemic verbal fluency (VFi). These patients scored at least 2 SDs below the mean score of healthy controls on two tests of phonemic verbal fluency.

Table III. Means and standard deviations of individual measures of executive, memory and visuoperceptual functioning in ALS and controls.

Connected speech measures

The performance on measures of connected speech production of ALS patients and healthy controls was compared using multivariate analyses of covariance (MANCOVAs). Although the two groups did not differ in terms of premorbid IQ, WTAR-predicted IQ correlated with some language measures and was therefore entered as a covariate. MANCOVA revealed that the patients’ connected speech performance was significantly more impaired than that of healthy controls, λ = 0.402, F(17,30) = 2.631, p < 0.01. Post hoc (Bonferroni-corrected) analyses of the univariate contrasts showed that ALS patients produced a significantly lower mean number of words (p = .007), lower mean duration of narrative (p = .018), a higher mean number of distortions (p = .018), and more incomplete sentences (p = .009). Patients also produced a lower mean length of utterances (p = .004) and more semantic errors (p = .014).

To evaluate the contribution of a bulbar motor disorder, we identified mild dysarthria in three patients (ALSFRS-R (Citation15) score on speech item < 4). To minimize the possibility that language performance was influenced by dysarthria or verbal fluency, following the approach of earlier work (Citation13) we separately analysed performance in the subset of 23 patients who did not have dysarthria and the 22 patients who did not have an impaired VFi. The main effect remained significant in the subset of patients without dysarthria (λ = 0.229, F(17,26) = 1.665, p < 0.01) and in the subset of patients without impaired VFi (λ = 1.506, F(17, 30) = 2.658, p = .036). Univariate contrasts showed that non-dysarthric ALS patients produced more distortions (p = .038), more incomplete sentences (p = .040), lower mean length of utterances (p = .004), and more semantic errors (p = .029) than controls. ALS patients without impaired VFi also produced more distortions (p = .037), more incomplete sentences (p = .049), lower mean length of utterances (p = .004), and more semantic errors (p = .029). Measures of connected speech performance in ALS and controls are summarized in .

Table IV. Mean (SD) measures of connected speech production in all patients with ALS, patients with ALS without verbal-fluency impairment (VFi), non-dysarthric patients with ALS, and controls.

Formal standardized language testing

A MANCOVA (adjusted for premorbid IQ) showed that ALS patients’ performance on formal standardized language tests was more impaired than that of healthy controls overall (λ = 0.605, F(7,38) = 3.539, p < 0.01. Univariate contrasts showed that, compared to controls, ALS patients made more errors (p = .019), completed fewer blocks (p = .020) and scored lower overall (p = .022) on the TROG. They also performed worse on the modified Token Test (p <.001) and the KDT Test (p = .020). These results were also observed in the subset of patients without impairment on VFi (λ = 0.789, F(10,36) = 2.841, p < 0.001) and the non-dysarthric patients (λ = 0.475, F(10, 33) = 3.645, p = 0.002). Means and SDs of structured language tests in ALS and controls are summarized in .

Table V. Means (SD) of structured measures of language functioning in all patients with ALS, patients with ALS without verbal fluency impairment (VFi), non-dysarthric patients with ALS, and controls.

Relationship of language deficits with other measures

The relationship between deficits on the language measures with cognitive composites, apathy scores and other measures of motor functioning was investigated using a series of correlations in the patient group only. The group of all patients with ALS exhibited a correlation between duration of narrative and motor speech functioning as measured by ALSFRS-dysarthria score (r = .461, p = .018). This relationship did not survive when the dysarthric and the VFi-impaired patients were excluded. No other significant correlations were identified.

Discriminant analysis

A stepwise discriminant function analysis was performed to determine whether specific language measures could be used together to predict group membership (i.e. ALS or control). The measures that were included in the analysis were distortions, incomplete sentences, mean length of utterances, semantic errors, TROG standard score, the modified Token Test score and KDT score. Our results showed that mean length of utterance was entered first, followed by incomplete sentences and then the modified Token Test, with no other measures contributing significantly to discriminability. Ninety-six percent of healthy controls and 81.8% of all ALS patients were correctly classified (Wilks’ Lambda = .537, χ2 = 28.28, p < 0.001). These data suggest that the three language measures provide a sensitivity of 81.8% and a specificity of 96%. When patients with dysarthria and executive (i.e. VFi) impairment were removed, the same model classified 96% of healthy controls and 85% of ALS patients accurately (Wilk's lambda = .436, χ2 = 34.489, p < 0.001).

Discussion

The objective of this study was to clarify whether ALS patients without FTLD presented specific changes in connected speech production evident in a description of the Cookie Theft Picture, as well as other linguistic deficits as measured by a variety of other formal standardized language tests. The findings of the present study are consistent with literature indicating expressive and receptive language disturbances in ALS (Citation6,Citation8–13). We found that patients with ALS showed deficits in speech production fluency and in semantic and syntactic comprehension. Consistent with recent work (Citation13) we also showed that syntactic and action knowledge deficits are independent of motor speech impairments and that syntactic features can be informative in distinguishing between ALS and healthy control groups. In previous studies (Citation6,Citation9,Citation12,Citation13) ALS patients had significantly poorer executive performance than controls, while in ours they performed within the normal range. This difference across research samples might reflect the large variability within the ALS population, and/or our stringent exclusion criteria. Research on less cognitively impaired patients is crucial to isolate the relationship between ALS and language impairment. Thus, on the assumption that our sample was on average less cognitively impaired than previous samples, the current results suggest that syntactic and semantic processing can deteriorate in ALS independently and/or earlier than other cognitive functions.

On the connected speech measures, patients with ALS were impaired on dimensions that contribute to fluency; they produced a lower number of words, a shorter duration of narrative and made more distortions. These deficits did not survive when the dysarthric ALS patients were excluded and were probably the consequence of motor speech deficits. Lexical content was not impaired in any of the subgroups of patients; however, many patients produced utterances that were not complete sentences and showed a reduced length of utterances and more semantic errors. These selective deficits in the absence of executive function difficulties suggest a syntactic complexity impairment, consistent with findings recently reported in the literature (Citation13,Citation36). Interestingly, these linguistic dysfunctions parallel the connected speech features of patients with PNFA reported by Wilson et al. (Citation35).

Performance on structured standardized language tests confirmed that ALS patients showed impairment in syntactic comprehension and semantic/action knowledge, in agreement with previous studies (Citation3,Citation10,Citation35,Citation37), but were relatively unimpaired on tests of single word naming and comprehension of objects. Previous studies (Citation6,Citation9) reported confrontation naming deficits in ALS but these were mild in clinical terms. Our findings again confirm the proposition that ALS patients may have specific impairments of the syntactic and action knowledge systems and also suggest that most of these deficits are not related to executive dysfunction. The present findings relating to sentence production are in agreement with others (Citation13) but are set in the context of a more comprehensive assessment of language function, highlighting the sensitivity of these measures in detecting abnormalities. Difficulties in the mechanics of language are a common characteristic in FTD-ALS with bulbar onset as well as PNFA. Our findings are consistent with previous research that has highlighted both overlap and independence of FTD and aphasia (Citation6,Citation38) and extend the finding of syntactic impairment in ALS patients with limb onset.

It is well known that Broca's area is involved in the processing of sentence structure (Citation39,Citation40). Broca's area is adjacent to motor areas such as the lower precentral gyrus. Yoshizawa et al. (Citation36) found reduced activation in Broca's area in ALS patients with syntactic comprehension impairments. They proposed that in ALS, neurodegeneration first progresses from the medulla oblongata and pons to the prefrontal gyrus and Broca's area. When neurodegeneration is limited to Broca's area, syntactic comprehension impairments without executive dysfunction might occur. This pattern of degeneration could explain why executive and language dysfunction are strongly associated in ALS, and also why executive dysfunction cannot always account for the language impairment observed. Further imaging studies are needed to determine the mechanisms by which neurodegeneration progresses in ALS and how these affect non-motor systems.

The results of our discriminant analysis confirmed that three measures of syntax may differentiate between ALS and healthy controls. Two connected speech measures (i.e. mean length of utterance and incomplete sentences) were the strongest discriminating factors followed by spoken sentence comprehension. From a clinical point of view, progressively deteriorating bulbar symptoms make it difficult to evaluate language and especially speech functions in ALS. In the past, speech related problems in ALS may have been relatively overlooked in linguistic research because evaluation of these features in ALS patients is difficult. In the present study, features of syntactic processing accurately differentiated ALS patients from healthy controls without being masked by dysarthria. Our findings suggest that syntactic processing deficits may be evident at the early stages of the disease and that these deficits can be detected by relatively simple language tests.

Most importantly, the recent interest in the cognitive changes in non-demented ALS has led to the publication of consensus criteria for optimum assessment of cognitive profile (Citation41). These criteria recommend that non-demented patients with ALS be considered as cognitively impaired based solely on measures of executive functioning. Our findings are in agreement with Taylor et al. (Citation6) and suggest that language dysfunction is an important aspect of the cognitive profiles of non-demented ALS patients that cannot always be explained by executive dysfunction. Failure to revise the current consensus criteria could lead to underestimates of the prevalence rates of cognitive impairment and the development of less viable diagnostic, prognostic and monitoring markers.

The results of this study must be interpreted with caution due to the following limitations: 1) the small sample size; 2) the young average age of both groups; 3) the predominantly male sample; 4) the relatively mild motor impairment of the ALS patients; 5) the small number of bulbar-onset patients; and 6) the high intellectual ability of our participants. The pattern of language impairment reported in the present study relates only to relatively unimpaired sporadic ALS patients and therefore the current study cannot comment on the general nature of language impairment in the wider ALS population. Finally, even though a wide range of executive function tests was incorporated, we cannot exclude the possibility that language performance could have been influenced by executive sub-functions (e.g. organization and sequencing) that have not been assessed in the present study.

Despite these limitations, the study confirms that independent linguistic deficits in ALS patients are present and these may be specific rather than global. It appears that the syntactic system is disrupted, while lexical access is relatively spared. This study has also provided the most comprehensive description of connected speech production in ALS to date. We showed that a detailed quantification of connected speech is necessary to characterize the linguistic changes of verbal expression in patients with ALS. The present study also proposes that the linguistic features derived from a simple picture description task can be clinically informative. As we previously highlighted (Citation6), there is a need to reconsider the current consensus criteria (Citation41) for the identification of cognitive impairment in ALS, in order to include language impairments as well as executive dysfunction.

Acknowledgements

The study was supported by the Wellcome Trust (Grant reference 083477/Z/07/Z). Our group's work undertaken via The King's MND Care and Research Centre receives support from the Motor Neurone Disease Association (UK). We would also like to acknowledge Barts Health Motor Neurone Disease Centre, the Motor Neurone Disease Association (MNDA) and the Dementias and Neurodegenerative Diseases Research Network (DeNDRoN) for facilitating recruitment. We would also like to thank Rebecca Hogan, Hugh Leddy and Steliana Yanakieva for their help with the analysis of connected speech measures.

Declaration of interest: The authors declare no conflicts of interest.

S. Tsermentseli, P. N. Leigh and L. J. Taylor have no disclosures to make.

M. Catani is the recipient of the Wellcome Trust New Investigator Award (reference 103759/Z/14/Z). A. Radunovic is currently in receipt of funding from the Motor Neurone Disease Association. L. H. Goldstein receives salary support from the NIHR Dementia Biomedical Research Unit at the South London and Maudsley NHS Foundation Trust and King's College London. The views expressed are those of the author and not necessarily those of the NHS, the NIHR or the Department of Health. She is currently in receipt of other research funding from the NIHR and has received funding from the Motor Neurone Disease Association.

References

  • Neary D, Snowden JS, Mann DM, Northen B, Goulding PJ, Macdermott N. Frontal lobe dementia and motor neuron disease. J Neurol Neurosurg Psychiatry. 1990;53: 23–32.
  • Abrahams S, Goldstein LH, Al Chalabi A, Pickering A, Morris RG, Passingham RE, et al. Relation between cognitive dysfunction and pseudobulbar palsy in amyotrophic lateral sclerosis. J Neurol Neurosurg Psychiatry. 1997;62: 464–72.
  • Abrahams S, Leigh PN, Harvey A, Vythelinghum GN, Grise D, Goldstein LH. Verbal fluency and executive dysfunction in amyotrophic lateral sclerosis (ALS). Neuropsychologia. 2000;38:734–7.
  • Wicks P, Abrahams S, Papps B, Al Chalabi A, Shaw CE, Leigh PN, et al. SOD1 and cognitive dysfunction in familial amyotrophic lateral sclerosis. J Neurol. 2009;256:234–41.
  • Tsermentseli S, Leigh PN, Goldstein LH. The anatomy of cognitive impairment in amyotrophic lateral sclerosis: more than frontal lobe dysfunction. Cortex. 2012;48:166–82.
  • Taylor LJ, Brown RG, Tsermentseli S, Al Chalabi A, Shaw CE, Ellis CM, et al. Is language impairment more common than executive dysfunction in amyotrophic lateral sclerosis? J Neurol Neurosurg Psychiatry. 2013; 84:494–8.
  • Abrahams S. Executive dysfunction in ALS is not the whole story. J Neurol Neurosurg Psychiatry. 2013;84:474–5.
  • Cobble M. Language impairment in motor neuron disease. J Neurol Sci. 1998;160 (Suppl 1):S47–52.
  • Abrahams S, Goldstein LH, Simmons A, Brammer M, Williams SCR, Giampietro V, et al. Word retrieval in amyotrophic lateral sclerosis: a functional magnetic resonance imaging study. Brain. 2004;127:1507–17.
  • Grossman M, Anderson C, Khan A, Avants B, Elamn L, McCluskey L. Impaired action knowledge in amyotrophic lateral sclerosis. Neurology. 2008;71:1396–401.
  • Phukan J, Elamin M, Bede P, Jordan N, Gallagher L, Byrne S, et al. The syndrome of cognitive impairment in amyotrophic lateral sclerosis: a population based study. J Neurol Neurosurg Psychiatry. 2012;83:102–8.
  • Ash S, Menaged A, Olm C, McMillan CT, Boller A, Irwin DJ, et al.Narrative discourse deficits in amyotrophic lateral sclerosis. Neurology. 2014;83:520–8.
  • Ash S, Olm C, McMillan CT, Boller A, Irwin DJ, McCluskey L, et al. Deficits in sentence expression in amyotrophic lateral sclerosis. Amyotroph Lateral Scler Frontotemporal Degener. – posted online on December 8, 2014: doi:10.3109/21678421.2014.974617.
  • Brooks B, Miller R, Swash M, Munsat TL; World Federation of Neurology Research Group on Motor Neuron Diseases.El Escorial revisited: revised criteria for the diagnosis of amyotrophic lateral sclerosis. Amyotroph Lateral Scler. 2000; 1:293–9.
  • Cedarbaum JM, Stambler N, Malta E, Fuller C, Hilt D, Thurmond B, et al. The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. BDNF ALS Study Group (Phase III). J Neurol Sci. 1999;169:13–21.
  • Neary D, Snowden JS, Gustafson L, Passant U, Stuss D, Black S, et al. Frontotemporal lobar degeneration: a consensus on clinical diagnostic criteria. Neurol. 1998;51: 1546–54.
  • Wechsler D. Wechsler Abbreviated Scale of Intelligence. San Antonio, Texas: Psychological Corporation; 1999.
  • Holdnack J. Wechsler Test of Adult Reading. San Antonio, Texas: Psychological Corporation; 2001.
  • Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand.1983;67:361–70.
  • Grace J, Malloy P. Frontal Systems Behaviour Scale (FrSBe): Professional Manual. Lutz, FL; Psychological Assessment Resources, Inc., 2001.
  • McKenna P, Warrington EK. Testing for nominal dysphasia. J Neurol Neurosurg Psychiatry. 1980;43:781–8.
  • Howard D, Patterson K. Pyramids and Palm Trees. Bury St. Edmunds, UK: Thames Valley Test Company; 1992.
  • Bak T, Hodges J. Kissing and Dancing – a test to distinguish the lexical and conceptual to noun/verb and action/object dissociation. Preliminary results in patients with frontotemporal dementia. J Neurolinguistics. 2003;16:169–81.
  • Bishop DV. Test for the Reception of Grammar (TROG-2). London, UK: Harcourt Assessment; 2003.
  • Coughlan AK, Warrington E. Word comprehension and word retrieval in patients with localized cerebral lesions. Brain. 1978;101:163–85.
  • Dunn L, Whetton C. The British Picture Vocabulary Scale, 2nd edn. Windsor, UK: NFER-Nelson; 1997.
  • Burgess P, Shallice T. The Hayling and Brixton Tests. Bury St. Edmunds, UK: Thames Valley Company; 1997.
  • Robertson IH, Ward T, Ridgeway V, Nimmo-Smith I. Test of Everyday Attention. London: Harcourt; 1994.
  • Psychological Assessment Resources. Computerized Wisconsin Card Sort Task Version 4 (WCST). Psychological Assessment Resources; 2003.
  • Delis DC, Kramer JH, Kaplan E, Ober BA. California Verbal Learning Test, 2nd edn. San Antonio, TX: Psychological Corporation; 2000.
  • Warrington E, James M. The Visual Object and Space Perception Battery. London: Harcourt; 1991.
  • Benton A, Sivan A, Hamsher K, Spreen O. Judgement of Line Orientation. Lutz, FL: Psychological Assessment Resources; 1983.
  • Goodglass H, Kaplan E. The Boston Diagnostic Aphasia Examination. Philadelphia: Lea & Febiger; 1972.
  • Berndt RS. Quantitative production analysis: a training manual for the analysis of aphasic sentence production. Hove, UK: Psychology Press; 2000.
  • Wilson SM, Henry ML, Besbris M, Ogar JM, Dronkers NF, Jarrold W. Connected speech production in three variants of primary progressive aphasia. Brain. 2010;133:2069–88.
  • Yoshizawa K, Yasuda N, Fukuda M, Yukimoto Y, Ogino M, Hata W, et al. Syntactic comprehension in patients with amyotrophic lateral sclerosis. Behavioural Neurology. 2014; article ID 230578: doi 10.1155/2014/230578.
  • Papeo L, Cecchetto C, Mazzon G, Granello G, Cattaruzza T, Verriello L, et al. The processing of actions and action-words in amyotrophic lateral sclerosis patients. Cortex. 2014;64: 136–47.
  • Catani M, Piccirilli M, Geloso MC, Cherubini A, Finali G, Pelliccioli G, et al. Rapidly progressive aphasic dementia with motor neuron disease: a distinctive clinical entity. Dement Geriatr Cogn Disord. 2004;17:21–8.
  • Wartenburger, I, Heekeren HR, Burchert F, Heinemann S, de Bleser R, Villringer A. Neural correlates of syntactic transformations. Hum Brain Map. 2004;22:72–81.
  • Fiebach CJ, Schlesewsky M, Lohmann G, von Cramon DY, Friederici AD. Revisiting the role of Broca's area in sentence processing: syntactic integration versus syntactic working memory. Hum Brain Map. 2005;24:79–91.
  • Strong MJ, Grace GM, Freedman M, Lomen-Hoerth C, Woolley S, Goldstein LH, et al. Consensus criteria for the diagnosis of frontotemporal cognitive and behavioural syndromes in amyotrophic lateral sclerosis. Amyotroph Lateral Scler. 2009;10:131–46.