3,047
Views
2
CrossRef citations to date
0
Altmetric
Original Articles

Which approach to measure cognitive functioning should be preferred when exploring the association between cognitive functioning and participation after stroke?

, , ORCID Icon, ORCID Icon, ORCID Icon & ORCID Icon
Pages 1207-1223 | Received 10 Dec 2019, Accepted 04 May 2020, Published online: 04 Jun 2020

ABSTRACT

A variety of approaches are currently used to explore the relationship between cognitive functioning and participation after stroke. We aimed to gain insight into the preferred approach to measure cognitive functioning when exploring the association between cognitive functioning and participation in the long term after stroke. In this inception cohort study 128 individuals with stroke participated and were assessed at a single time point three to four years after the event. Participation was measured using the Restrictions subscale of the Utrecht Scale for Evaluation of Rehabilitation-Participation. Subjective cognitive complaints were assessed using the Cognition subscale of the Checklist for Cognitive and Emotional Consequences (CLCE-24-C). Objective cognitive performance was measured using the Montreal Cognitive Assessment (MoCA) and a neuropsychological test battery (NTB) testing multiple cognitive domains. Participation showed a strong correlation (r = 0.51) with the CLCE-24-C and moderate correlations with the domains of visuospatial perception (r = 0.37) and mental speed (r = 0.36). Backward linear regression analyses showed that participation restrictions were best explained by the combination of the CLCE-24-C and a test for visuospatial perception (R2 = 0.31). Our findings suggest the use of a combination of subjective cognitive complaints and objective cognitive performance to explore the relationship between cognitive functioning and participation after stroke.

View correction statement:
Correction

Introduction

Stroke is one of the main causes of disability in the world (Collaborators GBDCoD, Citation2017). Due to the aging population and increased survival, more and more individuals with stroke have to deal with long-term restrictions in social and community participation (Kuhrij et al., Citation2018). According to the International Classification of Functioning, Disability and Health (ICF), participation has been defined as “the person’s involvement in a life situation” and is regarded an important goal in stroke rehabilitation (World Health O, Citation2001). Depending on stroke characteristics, demographic factors and diagnostic criteria, the prevalence of cognitive deficits after stroke varies from 20–80% (Sun et al., Citation2014). Since cognitive functioning is an important determinant of participation in individuals with stroke, evaluation of cognitive functioning during follow-up assessments after stroke is essential to select potential rehabilitation interventions to improve participation (Barker-Collo et al., Citation2010; Ezekiel et al., Citation2018; Nijsse et al., Citation2017b). In the current stroke literature, various types of cognitive assessments are used to study the relationship between cognitive functioning and participation, measuring either objective or subjective cognitive functioning. It is largely unknown, however, which approach is preferable to study the association between cognitive functioning and restrictions in participation after stroke.

Objective cognitive performance can be assessed using cognitive screening instruments or standardized neuropsychological tests. Cognitive screening instruments, such as the Montreal Cognitive Assessment (MoCA), are often used in daily practice and can serve as a brief screening tool to detect global cognitive deficits (Nasreddine et al., Citation2005). MoCA scores have been associated with levels of activities after aneurysmal subarachnoid hemorrhage (Wong et al., Citation2014) and with return to work and participation in individuals aged under 70 years one year after stroke (de Graaf et al., Citation2018; van der Kemp et al., Citation2019). A neuropsychological test battery (NTB) is the “gold standard” to assess domain-specific cognitive deficits after stroke and can serve both diagnostic and prognostic purposes (Cumming et al., Citation2013). Verbal expression (Viscogliosi et al., Citation2011a), visuospatial perception (Beaudoin et al., Citation2013) and memory (Viscogliosi et al., Citation2011b) have been identified as cognitive domains negatively affecting participation after stroke. Additionally, attention and executive functioning were also found to predict levels of activities up to one year after stroke (Mole & Demeyere, Citation2018). The rationale behind the importance of these specific cognitive domains has not yet been fully elucidated (Cumming et al., Citation2014). A recent systematic review exploring the relationship between objective cognitive performance and long-term participation after stroke concluded that this relationship partially depends on the type of cognitive assessment undertaken (Mole & Demeyere, Citation2018). In general, NTBs have shown more consistent associations with participation after stroke than cognitive screening instruments (Mole & Demeyere, Citation2018). This may be explained by the limited sensitivity of the MoCA to assess essential cognitive domains, such as executive functioning (Chan et al., Citation2014).

However, the ecological validity of NTBs is weak (Ruff, Citation2003), and it is the subjective cognitive complaints in everyday life that matter most from the patients’ perspective (Pollock et al., Citation2014). Subjective cognitive complaints can be measured using a self-report questionnaire, are highly prevalent after stroke and tend to increase over time (van Rijsbergen et al., Citation2015). Subjective cognitive complaints are related to both objective cognitive performance and long-term restrictions in participation after stroke, but do not necessarily coexist with deficits in objective cognitive performance (van Rijsbergen et al., Citation2014; van Rijsbergen et al., Citation2017). Although approximately half of the individuals with stroke who experience subjective cognitive complaints show evidence of deficits in objective cognitive performance (Lamb et al., Citation2013), the relationship between subjective cognitive complaints and objective cognitive performance is inconsistent (van Rijsbergen et al., Citation2014). The accumulation of deficits in multiple cognitive domains has been suggested to contribute to subjective cognitive complaints after stroke (van Rijsbergen et al., Citation2017).

In conclusion, cognitive functioning after stroke can be measured using screening instruments or an NTB to measure objective cognitive performance, or a self-report instrument to measure subjective cognitive complaints. The relationship between cognitive functioning and participation is inconsistent due to the variety of approaches used to measure cognitive functioning in the current stroke literature (Quinn et al., Citation2018). Therefore, the aim of this study was to gain insight into the preferred approach to measure cognitive functioning when exploring the association between cognitive functioning and participation in the long term after stroke. Both objective cognitive performance (global cognitive screening and an NTB) and subjective cognitive complaints were used to measure cognitive functioning. As we were solely interested in the bivariate relationship between cognitive functioning and participation, we did not take the effect of other determinants of participation after stroke into account. Our hypothesis is that a combination of objective cognitive performance and subjective cognitive complaints will provide the highest association with participation and would therefore be preferable when studying the relationship between cognitive functioning and participation after stroke.

Method

Design

The present study is a follow-up assessment (three to four years post-stroke) of the multicenter prospective longitudinal Restore4Stroke cohort study, in which individuals with stroke were followed for two years, including five measurements (van Mierlo et al., Citation2014).

Participants

Participants were consecutively recruited from stroke units in six participating hospitals in the Netherlands between March 2011 and March 2013. For the present study, participants were asked to participate in an additional assessment at three to four years post stroke. Individuals with stroke were eligible for Restore4stroke if they (1) had a clinically confirmed diagnosis of ischemic or hemorrhagic stroke; (2) gave informed consent within seven days after symptom onset; and (3) were at least 18 years old. Participants were excluded from the study if they (1) had a serious other condition that could interfere with study outcomes; (2) had been dependent in basic activities of daily living before the stroke occurred (defined by a Barthel Index score of ≤17 (Collin et al., Citation1988)); (3) had insufficient command of Dutch to complete the questionnaires and neuropsychological tests, based on clinical judgment; or (4) had suffered cognitive decline prior to the stroke (defined by a score of ≥1 on the Heteroanamnesis List Cognition [ Meijer et al., Citation2006]). Participants who completed the Restriction subscale of the USER-Participation at three to four years after stroke were included in the analysis of the current study. Informed consent was obtained from all participants.

Procedure

Three to four years after stroke, a neuropsychological assessment, including a global cognitive screening, was conducted by a trained research assistant (graduated neuropsychologist), either in the nearest participating hospital or at the participants’ home (if participants were not able to travel). Participants were also asked to complete a self-report questionnaire including measures of participation and subjective cognitive complaints. These measurements were conducted between July 2015 and October 2016. The Restore4Stroke cohort study and the additional follow-up measurements reported here were approved by the Medical Ethics Committees of all participating hospitals.

Dependent variables

The Restrictions subscale of the Utrecht Scale for Evaluation of Rehabilitation-Participation (USER-Participation) was used to measure participation (van der Zee et al., Citation2013b). The Restrictions subscale (USER-P-R) consists of 11 items, concerning difficulties experienced with vocational, leisure and social activities due to the stroke. For each item four response categories are available (“not possible,” “with assistance,” “with difficulty,” and “without difficulty”). A “not applicable” option is available for all items in case an activity is not performed for other reasons or a restriction is not attributed to the stroke. The total score of the Restrictions subscale ranges from 0–100 and is based on items that are applicable. A higher score indicates a more favourable level of participation (fewer restrictions experienced). The USER-Participation has previously shown satisfactory validity and reliability (Post et al., Citation2012) and excellent responsiveness in individuals with stroke (van der Zee et al., Citation2011; van der Zee et al., Citation2013a).

Independent variables

Demographic factors

Information about gender, age, marital status and level of education was collected. Education levels were dichotomized into low (up to completed secondary vocational education) and high (completed higher secondary professional education or university) (Verhage, Citation1964).

Stroke-related factors

The hemisphere involved, the type of stroke (ischemic or hemorrhagic), history of stroke, length of stay in hospital and discharge destination were obtained from medical charts. The severity of stroke was assessed with the National Institutes of Health Stroke Scale four days after stroke (Brott et al., Citation1989). Activities of daily living were assessed by the stroke nurses with the Barthel Index four days after stroke (Collin et al., Citation1988).

Neuropsychological test battery

The Visual Object and Space Perception test (VOSP) (Warrington & James, Citation1991) assesses visuospatial perception abilities. The test consists of four subtests for object perception and four subtests for space perception, which can be used separately. The number of correct responses per subtest is scored, and if this number exceeds the minimal threshold, one point is given. The total score is calculated by adding up all points (which leads to a maximum score of 8).

The Boston Naming Test (BNT) (Kaplan, Citation1983) is a test of verbal expression. The short version was used, in which the participant is asked to name 29 items ranging in familiarity.

The Rivermead Behavioural Memory Test (RBMT) (Wilson et al., Citation1989) measures different aspects of memory. In one of the subscales the participant is read a story and asked to recall, both immediately (RBMT-I) and after a delay (RBMT-D), as many elements of the story as possible. The number of correctly recalled elements is scored.

The Symbol Digit Modalities Test (SDMT) (Smith, Citation1982) primarily assesses complex scanning and visual tracking. The test is mostly used to measure speed of information processing or mental speed. It consists of a sheet of paper with, at the top, a sequence of nine symbols and nine corresponding numbers (key). Within a 90-second time limit the participant is required, consulting the key as necessary, to insert the numbers associated with the symbols.

The Trail Making Test (TMT) (Reitan & Wolfson, Citation2004) is a test for visual attention, executive functioning and task switching/cognitive flexibility. This test requires speed of information processing, visual search strategies and visuo-motor behaviour. The test has various parts (part A and part B), in which the participant is asked to connect numbers, letters or a combination of numbers and letters in the correct order. The time needed to complete part A and B is scored.

MoCA

The MoCA is a brief cognitive screening tool, which has been validated for individuals with stroke (Nasreddine et al., Citation2005). Scores range from 0–30 and higher scores indicate better cognitive functioning. Participants with <12 years of education were assigned one additional point on their MoCA score (Nasreddine et al., Citation2005). Cognitive impairment can be defined as MoCA<26, as this cut-off yields the best balance between sensitivity and specificity in detecting cognitive impairment (Nasreddine et al., Citation2005).

Subjective cognitive complaints

The presence of subjective cognitive complaints was assessed using the Cognition subscale of the Checklist for Cognitive and Emotional Consequences (CLCE-24-C), which consists of 13 items (e.g., problems with “doing two things at once” or “remembering new information”) (Rasquin et al., Citation2006). The items involve multiple cognitive domains (including executive functioning, attention, memory, speed of processing and visuospatial perception) and are indicative of the cognitive complaints the patient experiences. The interviewer scores a “0” for the absence of complaints, a “1” for possible complaints and a “2” for the presence of complaints. Total scores range from 0-26 and higher scores indicate more cognitive complaints. The CLCE-24 is a feasible and valid instrument to use in individuals with stroke (van Heugten et al., Citation2007).

Statistical analysis

All analyses were conducted with SPSS statistics version 24 (IBM, Armonk, NY). Descriptive statistics were used to describe participant characteristics and dependent variables. Baseline characteristics of participants lost to attrition and study participants were compared using independent T-tests (continuous variables) and Chi-square tests (categorical variables).

Raw scores of the RBMT-I, RBMT-D, SDMT and TMT were converted to t-scores using age-specific (and, when available, education- and gender-specific) normative data. The TMT t-score is based on the raw scores of TMT part B, adjusted for the raw scores on TMT part A. Scores on the BNT were converted to percentiles using age- and education-specific normative data. Scores on the VOSP were adjusted for age (Warrington & James, Citation1991).

Bivariate associations of the NTB (BNT, RBMT-I, RBMT-D, SDMT, TMT and VOSP), MoCA and CLCE-24-C with the USER-P-R were tested using Spearman correlations. As proposed by Cohen, correlation coefficients of the order of 0.10 were interpreted as “weak,” those of 0.30 as “moderate” and those of 0.50 or higher as “strong” (Cohen, Citation1988). Bonferroni correction was used to account for multiple comparisons, and p < 0.001 was considered statistically significant.

Multiple linear regression analysis was used to explore the association between different combinations of cognitive measures and participation three to four years after stroke. The USER-P-R was entered as a dependent variable in all models. The models were built using a hierarchical approach. The NTB, currently regarded as a “gold standard” to assess cognitive functioning, was entered in model 1. As we were interested in the association between participation and a combination of objective cognitive performance (MoCA and NTB) and subjective cognitive complaints (CLCE-24-C), we entered the MoCA and CLCE-24-C in model 2 and the NTB and CLCE-24-C in model 3. In order to explore which combination of approaches is preferable when exploring the relationship between cognitive functioning and participation, backward selection was used to fit the best model of cognitive measures (out of the NTB, MoCA and CLCE-24-C) in model 4. Possible multicollinearity was checked (VIF < 4), which did not reveal any problems. A value of p < 0.05 was considered statistically significant.

Results

A total of 395 participants were included in the Restore4Stroke study within the first week after stroke onset, and 160 of them (40.5%) were tested three to four years after stroke. The Restrictions subscale of the USER-P was completed by 128 participants (80.0%) at three to four years after stroke, and they were included in the analysis. Of the 235 resigned participants, 33 had died, 120 refused further participation, 47 were lost to follow-up and 35 were lost to attrition because of an insufficient general physical condition.

Participant characteristics are presented in . The study participants were significantly younger at stroke onset and were less cognitively impaired than the participants lost to attrition. The participation and cognitive test scores at three to four years after stroke are presented in . The CLCE-24-C showed adequate internal consistency (Cronbach’s α = 0.79). The majority of participants (89.0%) reported subjective cognitive complaints for at least one item of the CLCE-24-C. According to the MoCA, almost half (45.3%) of participants were cognitively impaired at three to four years after stroke. Cognitive domains most often affected according to the NTB were immediate and delayed recall (49.1% and 25.2% respectively), higher visual perception (20.0%) and mental speed (15.3%).

Table 1. Participant characteristics (n = 395).

Table 2. Scores on participation and cognitive tests (MoCA, CLCE-24-C and NTB) at three to four years after stroke.

Bivariate analyses

CLCE-24-C scores were strongly correlated with participation scores three to four years after stroke (r = 0.51), as shown in . MoCA (r = 0.24) and NTB scores correlated weakly with participation, except for the SDMT (r = 0.36) and VOSP scores (r = 0.37) which showed a moderate correlation with participation. CLCE-24-C scores showed weak negative correlations with the MoCA and NTB. Weak (BNT, TMT and VOSP) or moderate (RBMT-I, RBMT-D and SDMT) positive correlations were observed between the MoCA and the NTB. Except for the very strong correlation between RBMT-I and RBMT-D (r = 0.83), inter-correlations between NTB test scores were weak to moderate. The CLCE-24-C (R2 = 0.19), VOSP (R2 = 0.18), SDMT (R2 = 0.15) and MoCA (R2 = 0.06) explained the largest amount of variance in participation scores three to four years after stroke.

Table 3. Bivariate analyses: correlations between the neuropsychological tests, MoCA, CLCE-24-C and participation (n = 128) at three to four years after stroke.

Multivariate linear regression

Results of the multivariate regression analyses are shown in . In model 1 (including NTB) higher scores on the SDMT and VOSP were associated with fewer restrictions in participation three to four years after stroke. In model 2 (including MoCA and CLCE-24-C), only having fewer cognitive complaints was associated with fewer restrictions in participation three to four years after stroke. In both model 3 (combining NTB and CLCE-24-C) and model 4 (using backward selection), fewer cognitive complaints and a higher score on the VOSP were associated with fewer restrictions in participation three to four years after stroke. Combining the CLCE-24-C and the VOSP in model 4 (R2 = 0.31) explained a larger amount of variance in participation scores three to four years after stroke than the NTB in model 1 (R2 = 0.20), combining the CLCE-24-C and the MoCA in model 2 (R2 = 0.20) or the CLCE-24-C and the NTB in model 3 (R2 = 0.29).

Table 4. Multivariate analysis: associations between different combinations of cognitive measures (CLCE-24-C, MoCA and NTB) and participation three to four years after stroke.

Discussion

The aim of this study was to gain insight into the preferred approach to measure cognitive functioning when exploring the association between cognitive functioning and participation in the long term after stroke. Although significant relationships were found between all cognitive measures and participation after stroke, the subjective CLCE-24-C score showed the strongest bivariate association with participation after stroke (19% explained variance). Among the NTB tests, the domains of visuospatial perception (VOSP) and mental speed (SDMT) were moderately associated with participation after stroke. Global cognitive screening (MoCA) showed a weak association with participation after stroke. The combination of the CLCE-24-C and VOSP explained the highest proportion (31%) of the variance in participation scores. Therefore, a combination of subjective and objective measures (preferably including the cognitive domains of visuospatial perception and mental speed) is to be recommended when exploring the association between cognitive functioning and participation after stroke.

Subjective cognitive complaints

The high prevalence of subjective cognitive complaints three to four years after stroke found in this study (89.0%) is in accordance with previous studies (van Rijsbergen et al., Citation2014). The strong association between subjective cognitive complaints and participation after stroke is a relatively new finding. One cross-sectional study concerned individuals who had been discharged home and were assessed at least 6 months post-stroke. It showed a weak association between subjective cognitive complaints and difficulties of community reintegration (r = −0.23) (Kimonides et al., Citation2018). In another study, subjective cognitive complaints were among the main predictors of participation restrictions in individuals six months after an aneurysmal subarachnoid hemorrhage (Huenges Wajer et al., Citation2017). A possible explanation could be the similarity between the CLCE-24-C and USER-P. Both instruments are self-reported questionnaires asking about complaints/restrictions experienced in everyday life, whereas NTB and MoCA may lack ecological validity and may less accurately reflect daily life functioning (Ruff, Citation2003).

Our study showed a weak correlation between subjective cognitive complaints and objective cognitive performance. Although some studies found associations between cognitive screening instruments (including the MoCA in one study (Nijsse et al., Citation2017a)) and subjective cognitive complaints (Narasimhalu et al., Citation2013; van Heugten et al., Citation2007; Xiong et al., Citation2011), other studies did not find a relationship between subjective cognitive complaints and NTB tests (Aben et al., Citation2011; Duits et al., Citation2008; Winkens et al., Citation2009). This inconsistency may be explained by the limited ecological validity of the NTB tests used in some studies (van Rijsbergen et al., Citation2017) and by the huge variation of NTB tests across studies. Also, it has been suggested that the accumulation of cognitive deficits in various cognitive domains contributes to subjective cognitive complaints after stroke, explaining the lack of correlation between individual NTB tests and subjective cognitive complaints (van Rijsbergen et al., Citation2017). However, the MoCA, a global cognitive screening instrument covering multiple domains, also weakly correlated with subjective cognitive complaints in our study (r = 0.27).

Objective cognitive performance

The cognitive domains of visuospatial perception (VOSP) and mental speed (SDMT) showed the strongest correlation with participation after stroke (r = 0.37 and 0.36 respectively), and were also associated to participation in the multivariate models (SDMT only in model 1, VOSP in all models). Previous studies identified the same cognitive domains as determinants of quality of life up to one year after stroke (Cumming et al., Citation2014). It has been suggested that visuospatial perception is a more fundamental aspect of cognitive functioning, upon which other cognitive domains depend, and that this is a prerequisite for daily life functioning (Cumming et al., Citation2014). Impairments in executive functioning and mental speed may affect the ability to plan, monitor and evaluate more complex daily tasks, having a negative impact on daily life functioning (Mole & Demeyere, Citation2018).

In the final multivariate model (model 4 using backward selection) the combination of the visuospatial perception (VOSP) domain and subjective cognitive complaints (CLCE-24-C) provided the strongest association with participation. Previous studies also found an association between visuospatial perception and participation up to 6–12 months after stroke (Beaudoin et al., Citation2013; Desrosiers et al., Citation2008; Viscogliosi et al., Citation2011b). According to a recent systematic review looking into the relationship between cognitive functioning and participation after stroke, cognitive screening instruments such as the MoCA show less consistent associations with participation than NTBs (Mole & Demeyere, Citation2018). Our results confirm the suggestion that specific cognitive domains are more strongly associated with participation than global cognitive functioning (Barker-Collo & Feigin, Citation2006), as the MoCA showed a weak correlation and no association with participation after stroke in the multivariate models.

Limitations

Due to the relatively long period that elapsed between the follow-up assessments, a considerable number of participants were lost to follow-up. It could be that only the most motivated participants were willing to participate in an additional assessment. This may have led to selection bias, as the study sample was significantly younger at stroke onset and was less cognitively impaired compared to the resigned participants. This could therefore negatively affect the generalizability of the results to older individuals with stroke and those with severe cognitive impairments. However, current epidemiological studies show that most people have relatively mild strokes. Furthermore, missing NTB data (especially the VOSP) considerably reduced the sample size (n = 75) in the multivariate models (models 1, 3 and 4). However, apart from cognitive functioning (participants with missing NTB data being more cognitively impaired based on the MoCA), no significant differences in any of the baseline characteristics were observed between the multivariate model sample (n = 75) and the participants at stroke onset (n = 395) or at 3–4 years after stroke (n = 128). Lastly, although we aimed to cover the most important cognitive domains after stroke, not all aspects of cognitive functioning are represented in the NTB (e.g., planning, visual memory and social cognition are lacking).

Conclusions

This study has shown the impact of subjective cognitive complaints on everyday life in the long term after stroke, as subjective cognitive complaints were strongly related to restrictions in participation three to four years after stroke. A combination of objective cognitive performance (preferably including the domains of visuospatial perception and mental speed) and subjective cognitive complaints showed the strongest association with participation, and is therefore to be recommended when exploring cognitive functioning as a determinant of participation after stroke. External validation in another stroke sample is needed to confirm whether these results also apply to older individuals with stroke and those with severe cognitive impairments due to the limited generalizability to these patient categories in our study population. Last but not least, since participation is an important goal in rehabilitation, it is important to consider subjective cognitive complaints in stroke aftercare.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This research project is funded by the Dutch organization for health research and care innovation (ZonMW) as part of the “TopZorg” project [grant number 842003005].

References

  • Aben, L., Ponds, R. W., Heijenbrok-Kal, M. H., Visser, M. M., Busschbach, J. J., & Ribbers, G. M. (2011). Memory complaints in chronic stroke patients are predicted by memory self-efficacy rather than memory capacity. Cerebrovascular Diseases, 31(6), 566–572. https://doi.org/10.1159/000324627
  • Barker-Collo, S., & Feigin, V. (2006). The impact of neuropsychological deficits on functional stroke outcomes. Neuropsychology Review, 16(2), 53–64. https://doi.org/10.1007/s11065-006-9007-5
  • Barker-Collo, S., Feigin, V. L., Parag, V., Lawes, C. M., & Senior, H. (2010). Auckland Stroke outcomes study. Part 2: Cognition and functional outcomes 5 years poststroke. Neurology, 75(18), 1608–1616. https://doi.org/10.1212/WNL.0b013e3181fb44c8
  • Beaudoin, A. J., Fournier, B., Julien-Caron, L., Moleski, L., Simard, J., Mercier, L., & Desrosiers, J. (2013). Visuoperceptual deficits and participation in older adults after stroke. Australian Occupational Therapy Journal, 60(4), 260–266. https://doi.org/10.1111/1440-1630.12046
  • Brott, T., Adams, Jr., H. P., Olinger, C. P., Marler, J. R., Barsan, W. G., Biller, J., Spilker, J., Holleran, R., Eberle, R., & Hertzberg, V. (1989). Measurements of acute cerebral infarction: A clinical examination scale. Stroke; A Journal of Cerebral Circulation, 20(7), 864–870. https://doi.org/10.1161/01.STR.20.7.864
  • Chan, E., Khan, S., Oliver, R., Gill, S. K., Werring, D. J., & Cipolotti, L. (2014). Underestimation of cognitive impairments by the Montreal cognitive Assessment (MoCA) in an acute stroke unit population. Journal of the Neurological Sciences, 343(1-2), 176–179. https://doi.org/10.1016/j.jns.2014.05.005
  • Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Taylor & Francis Inc.
  • Collaborators GBDCoD. (2017). Global, regional, and national age-sex specific mortality for 264 causes of death, 1980-2016: A systematic analysis for the global burden of disease study 2016. Lancet, 390(10100), 1151–1210. https://doi.org/10.1016/S0140-6736 doi: 10.1016/S0140-6736(17)32152-9
  • Collin, C., Wade, D. T., Davies, S., & Horne, V. (1988). The Barthel ADL index: A reliability study. International Disability Studies, 10(2), 61–63. https://doi.org/10.3109/09638288809164103
  • Cumming, T. B., Brodtmann, A., Darby, D., & Bernhardt, J. (2014). The importance of cognition to quality of life after stroke. Journal of Psychosomatic Research, 77(5), 374–379. https://doi.org/10.1016/j.jpsychores.2014.08.009
  • Cumming, T. B., Marshall, R. S., & Lazar, R. M. (2013). Stroke, cognitive deficits, and rehabilitation: Still an incomplete picture. International Journal of Stroke, 8(1), 38–45. https://doi.org/10.1111/j.1747-4949.2012.00972.x
  • de Graaf, J. A., van Mierlo, M. L., Post, M. W. M., Achterberg, W. P., Kappelle, L. J., & Visser-Meily, J. M. A. (2018). Long-term restrictions in participation in stroke survivors under and over 70 years of age. Disability and Rehabilitation, 40(6), 637–645. https://doi.org/10.1080/09638288.2016.1271466
  • Desrosiers, J., Demers, L., Robichaud, L., Vincent, C., Belleville, S., & Ska, B. (2008). Short-term changes in and predictors of participation of older adults after stroke following acute care or rehabilitation. Neurorehabilitation and Neural Repair, 22(3), 288–297. https://doi.org/10.1177/1545968307307116
  • Duits, A., Munnecom, T., van Heugten, C., & van Oostenbrugge, R. J. (2008). Cognitive complaints in the early phase after stroke are not indicative of cognitive impairment. Journal of Neurology, Neurosurgery &amp; Psychiatry, 79(2), 143–146. https://doi.org/10.1136/jnnp.2007.114595
  • Ezekiel, L., Collett, J., Dawes, H., Mayo, N. E., Pang, L., & Field, L. (2018). Factors associated with participation in life situations for adults with stroke: A systematic review. Archives of Physical Medicine and Rehabilitation, 100, 945–955. https://doi.org/10.1016/j.apmr.2018.06.017
  • Huenges Wajer I. M., Visser-Meily, J. M., Greebe, P., Post, M. W., Rinkel, G. J., & van Zandvoort, M. J. (2017). Restrictions and satisfaction with participation in patients who are ADL-independent after an aneurysmal subarachnoid hemorrhage. Topics in Stroke Rehabilitation, 24(2), 134–141. https://doi.org/10.1080/10749357.2016.1194557
  • Kaplan, E. (1983). The assessment of aphasia and related disorders. Lippincott Williams & Wilkins.
  • Kimonides, S., Cavuoto, M. G., De Silva, L., & Kinsella, G. J. (2018). The role of subjective cognitive complaints and depressive symptoms in social re-integration following stroke: A mediation explanation in a cross-sectional sample. Topics in Stroke Rehabilitation, 24, 1–7. https://doi.org/10.1080/10749357.2018.1489570
  • Kuhrij, L. S., Wouters, M. W. J. M., van den Berg-Vos, R. M., de Leeuw, F. E., & Nederkoorn, P. J. (2018). The Dutch acute stroke audit: Benchmarking acute stroke care in the Netherlands. European Stroke Journal, 3, 361–368. https://doi.org/10.1177/2396987318787695
  • Lamb, F., Anderson, J., Saling, M., & Dewey, H. (2013). Predictors of subjective cognitive complaint in postacute older adult stroke patients. Archives of Physical Medicine and Rehabilitation, 94(9), 1747–1752. https://doi.org/10.1016/j.apmr.2013.02.026
  • Meijer, R., van Limbeek, J., & de Haan, R. (2006). Development of the stroke-unit discharge guideline: Choice of assessment instruments for prediction in the subacute phase post-stroke. International Journal of Rehabilitation ResearchInternationale Zeitschrift fur RehabilitationsforschungRevue Internationale de Recherches de Readaptation, 29(1), 1–8. https://doi.org/10.1097/01.mrr.0000175269.59788.41
  • Mole, J. A., & Demeyere, N. (2018). The relationship between early post-stroke cognition and longer term activities and participation: A systematic review. Neuropsychological Rehabilitation, 30, 1–25. https://doi.org/10.1080/09602011.2018.1464934
  • Narasimhalu, K., Wiryasaputra, L., Sitoh, Y. Y., & Kandiah, N. (2013). Post-stroke subjective cognitive impairment is associated with acute lacunar infarcts in the basal ganglia. European Journal of Neurology, 20(3), 547–551. https://doi.org/10.1111/ene.12032
  • Nasreddine, Z. S., Phillips, N. A., Bedirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005). The Montreal cognitive assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695–699. https://doi.org/10.1111/j.1532-5415.2005.53221.x
  • Nijsse, B., van Heugten, C. M., van Mierlo, M. L., Post, M. W., de Kort, P. L., & Visser-Meily, J. M. (2017a). Psychological factors are associated with subjective cognitive complaints 2 months post-stroke. Neuropsychological Rehabilitation, 27(1), 99–115. https://doi.org/10.1080/09602011.2015.1065280
  • Nijsse, B., Visser-Meily, J. M., van Mierlo, M. L., Post, M. W., de Kort, P. L., & van Heugten, C. M. (2017b). Temporal evolution of poststroke cognitive impairment using the montreal cognitive assessment. Stroke, 48(1), 98–104. https://doi.org/10.1161/STROKEAHA.116.014168
  • Pollock, A., St George, B., Fenton, M., & Firkins, L. (2014). Top 10 research priorities relating to life after stroke–consensus from stroke survivors, caregivers, and health professionals. International Journal of Stroke, 9(3), 313–320. https://doi.org/10.1111/j.1747-4949.2012.00942.x
  • Post, M. W., van der Zee, C. H., Hennink, J., Schafrat, C. G., Visser-Meily, J. M., & van Berlekom, S. B. (2012). Validity of the Utrecht scale for evaluation of rehabilitation-participation. Disability and Rehabilitation, 34(6), 478–485. https://doi.org/10.3109/09638288.2011.608148
  • Quinn, T. J., Elliott, E., & Langhorne, P. (2018). Cognitive and mood assessment tools for use in stroke. Stroke, 49(2), 483–490. https://doi.org/10.1161/STROKEAHA.117.016994
  • Rasquin, S. M., van Heugten, C. M., Winkens, L., Beusmans, G., & Verhey, F. R. (2006). Checklist for the detection of cognitive and emotional consequences after stroke (CLCE-24). Tijdschrift Voor Gerontologie en Geriatrie, 37(3), 121–126. https://doi.org/10.1007/BF03074778
  • Reitan, R. M., & Wolfson, D. (2004). The trail making test as an initial screening procedure for neuropsychological impairment in older children. Archives of Clinical Neuropsychology, 19(2), 281–288. https://doi.org/10.1016/S0887-6177(03)00042-8
  • Ruff, R. M. (2003). A friendly critique of neuropsychology: Facing the challenges of our future. Archives of Clinical Neuropsychology, 18(8), 847–864. https://doi.org/10.1016/j.acn.2003.07.002
  • Smith, A. (1982). Symbol digit modalities test (SDMT) manual (revised). Western Psychological Services.
  • Sun, J. H., Tan, L., & Yu, J. T. (2014). Post-stroke cognitive impairment: Epidemiology, mechanisms and management. Annals of Translational Medicine, 2(8), 80. https://doi.org/10.3978/j.issn.2305-5839.2014.08.05.
  • van der Kemp, J., Kruithof, W. J., Nijboer, T. C. W., van Bennekom, C. A. M., van Heugten, C., & Visser-Meily, J. M. A. (2019). Return to work after mild-to-moderate stroke: Work satisfaction and predictive factors. Neuropsychological Rehabilitation, 29(4), 638–653. https://doi.org/10.1080/09602011.2017.1313746
  • van der Zee, C. H., Baars-Elsinga, A., Visser-Meily, J. M., & Post, M. W. (2013a). Responsiveness of two participation measures in an outpatient rehabilitation setting. Scandinavian Journal of Occupational Therapy, 20(3), 201–208. https://doi.org/10.3109/11038128.2012.754491
  • van der Zee, C. H., Kap, A., Rambaran Mishre, R., Schouten, E. J., & Post, M. W. (2011). Responsiveness of four participation measures to changes during and after outpatient rehabilitation. Journal of Rehabilitation Medicine, 43(11), 1003–1009. https://doi.org/10.2340/16501977-0879
  • van der Zee, C. H., Visser-Meily, J. M., Lindeman, E., Jaap Kappelle, L., & Post, M. W. (2013b). Participation in the chronic phase of stroke. Topics in Stroke Rehabilitation, 20(1), 52–61. https://doi.org/10.1310/tsr2001-52
  • van Heugten, C., Rasquin, S., Winkens, I., Beusmans, G., & Verhey, F. (2007). Checklist for cognitive and emotional consequences following stroke (CLCE-24): development, usability and quality of the self-report version. Clinical Neurology and Neurosurgery, 109(3), 257–262. https://doi.org/10.1016/j.clineuro.2006.10.002
  • van Mierlo, M. L., van Heugten, C. M., Post, M. W., Lindeman, E., de Kort, P. L., & Visser-Meily, J. M. (2014). A longitudinal cohort study on quality of life in stroke patients and their partners: Restore4Stroke cohort. International Journal of Stroke: Official Journal of the International Stroke Society, 9(1), 148–154. https://doi.org/10.1111/j.1747-4949.2012.00882.x
  • van Rijsbergen, M. W., Mark, R. E., de Kort, P. L., & Sitskoorn, M. M. (2014). Subjective cognitive complaints after stroke: A systematic review. Journal of Stroke and Cerebrovascular Diseases, 23(3), 408–420. https://doi.org/10.1016/j.jstrokecerebrovasdis.2013.05.003
  • van Rijsbergen, M. W., Mark, R. E., de Kort, P. L., & Sitskoorn, M. M. (2015). Prevalence and Profile of Poststroke subjective cognitive complaints. Journal of Stroke and Cerebrovascular Diseases, 24(8), 1823–1831. https://doi.org/10.1016/j.jstrokecerebrovasdis.2015.04.017
  • van Rijsbergen, M. W., Mark, R. E., Kop, W. J., de Kort, P. L., & Sitskoorn, M. M. (2017). The role of objective cognitive dysfunction in subjective cognitive complaints after stroke. European Journal of Neurology, 24(3), 475–482. https://doi.org/10.1111/ene.13227
  • Verhage, F. (1964). Intelligentie en leeftijd: Onderzoek bij Nederlanders van twaalf tot zevenenzeventig jaar [Intelligence and age: Research study in Dutch individuals aged twelve to seventy-seven]. Van Gorcum/Prakke & Prakke.
  • Viscogliosi, C., Belleville, S., Desrosiers, J., Caron, C. D., Ska, B., & Group, B. (2011a). Participation after a stroke: Changes over time as a function of cognitive deficits. Archives of Gerontology and Geriatrics, 52(3), 336–343. https://doi.org/10.1016/j.archger.2010.04.020
  • Viscogliosi, C., Desrosiers, J., Belleville, S., Caron, C. D., Ska, B., & Group, B. (2011b). Differences in participation according to specific cognitive deficits following a stroke. Applied Neuropsychology, 18(2), 117–126. https://doi.org/10.1080/09084282.2010.547779
  • Warrington, E. K., & James, M. (1991). The visual object and space perception battery. Thames Valley Test Company.
  • Wilson, B., Cockburn, J., Baddeley, A., & Hiorns, R. (1989). The development and validation of a test battery for detecting and monitoring everyday memory problems. Journal of Clinical and Experimental Neuropsychology, 11(6), 855–870. https://doi.org/10.1080/01688638908400940
  • Winkens, I., Van Heugten, C. M., Fasotti, L., & Wade, D. T. (2009). Reliability and validity of two new instruments for measuring aspects of mental slowness in the daily lives of stroke patients. Neuropsychological Rehabilitation, 19(1), 64–85. https://doi.org/10.1080/09602010801913650
  • Wong, G. K., Lam, S. W., Wong, A., Lai, M., Siu, D., Poon, W. S., & Mok, V. (2014). MoCA-assessed cognitive function and excellent outcome after aneurysmal subarachnoid hemorrhage at 1 year. European Journal of Neurology, 21(5), 725–730. https://doi.org/10.1111/ene.12363
  • World Health O. (2001). The international classification of functioning, disability and health - ICF.
  • Xiong, Y. Y., Wong, A., Mok, V. C., Tang, W. K., Lam, W. W., Kwok, T. C., Chu, W. C., Chan, A. Y., & Wong, L. K. (2011). Frequency and predictors of proxy-confirmed post-stroke cognitive complaints in lacunar stroke patients without major depression. International Journal of Geriatric Psychiatry, 26(11), 1144–1151.