Publication Cover
Child Neuropsychology
A Journal on Normal and Abnormal Development in Childhood and Adolescence
Volume 28, 2022 - Issue 3
3,866
Views
1
CrossRef citations to date
0
Altmetric
Review Article

Unity or diversity of executive functioning in children and adolescents with post-traumatic stress symptoms? A systematic review and meta-analysis

, ORCID Icon, ORCID Icon & ORCID Icon
Pages 374-393 | Received 05 Jan 2021, Accepted 08 Sep 2021, Published online: 23 Sep 2021

ABSTRACT

For some children, psychological reactions to a traumatic event develop into severe or persistent post-traumatic stress symptoms (PTSS) or the clinical condition of post-traumatic stress disorder (PTSD). Cognitive problems in children with PTSS have been reported, but it is not clear which specific functions are affected. Executive functions is a domain of particular interest, given its importance for academic performance and social and emotional functioning. A systematic literature search was performed, and 12 studies with 55 comparisons of executive functions in children with PTSS and healthy controls were eligible for meta-analysis. A subset of the studies also included a comparison group of children with traumatic experienced but without PTSS. Overall, across all tasks and measures, children with PTSS showed lower executive functioning than healthy controls (SMD = −0.57). The effect sizes between the subdomains complex tasks, verbal fluency, inhibition, shifting and working memory were not significantly different from each other, but was largest for verbal fluency (SMD = −1.45). Analyses comparing children with traumatic experiences with and without PTSS similarly showed overall lower executive functioning in the PTSS group (SMD = −0.34) and no significant differences in effect sizes between subdomains. The results have implications for assessment and clinical work with youth exposed to traumatic events. We should be aware of the poor executive functioning that may be an issue for some children with a history of trauma and subsequent development of PTSS, and the impact this could have on everyday functioning.

Most individuals will experience one or more potentially traumatic experience during childhood (Gilbert et al., Citation2009; McLaughlin et al., Citation2013). These types of experiences include the death of a loved one, witnessing or suffering serious accidents or injuries, natural disasters, and child maltreatment such as physical, emotional or sexual abuse. Traumatic experiences can have a profound impact on children’s development, and is on a group level associated with physical and mental health problems in both short and long-term perspectives (Appleyard et al., Citation2005; Felitti, Citation2002). One such consequence is an increased risk of developing post-traumatic stress symptoms (PTSS) such as intrusive reexperiencing, avoidance, negative effects and hyper arousal. It is estimated that about 16% of all traumatized children will develop posttraumatic stress disorder (PTSD) (Alisic et al., Citation2014) and an unknown, presumably larger, proportion may develop PTSS without completely fulfilling the criteria for a PTSD diagnosis. Traumatic experiences and PTSS have both been associated with reduced cognitive functioning relative to performance in healthy control (Malarbi et al., Citation2017; Scott et al., Citation2015), with potential consequences for everyday functioning (Biederman et al., Citation2004; Danzi & La Greca, Citation2017). One of the cognitive domains that appears to be most affected is executive functions (Kavanaugh et al., Citation2017; Op den Kelder et al., Citation2018).

Executive functions are high-level cognitive processes that control lower-level processes and enable goal-directed behavior (Friedman & Miyake, Citation2017). An influential model of executive functions is the unity and diversity model proposed by Miyake, Friedman and colleagues (Friedman & Miyake, Citation2017; Miyake et al., Citation2000). Based on confirmatory factor analysis of behavioral data from several relatively simple behavioral tasks, they identified a taxonomy distinguishing between specific executive functions, including inhibition, shifting and working memory. Inhibition is the ability to suppress distracting information or to stop responses. Shifting allows individuals to flexibly switch their attention between different tasks, operations, or mental sets. Working memory is the active ability to code, maintain and replace accurate mental representations of information changing over time. Other specific executive functions have also been described, including verbal fluency, which involved spontaneous information retrieval from memory and response generation, although results indicate that this function is also closely related to language functions (Whiteside et al., Citation2016). Notably, specific executive functions correlate, but are also separable, in other words they show both unity and diversity (Friedman & Miyake, Citation2017). Less pure behavioral tasks can be considered complex executive function tasks in that rely on broader sets of cognitive functions (Miyake et al., Citation2000). Executive functions are also closely tied to emotion regulation, as both can be considered “top-down” elements of self-regulation (Palacios-Barrios & Hanson, Citation2019).

Executive functions have complicated and particularly extended developmental courses, possibly making them vulnerable to traumatic experiences and psychopathology during childhood and adolescence. Alternatively, atypical development of executive functions may make some children particularly vulnerable. The development of executive functions during childhood involves qualitative changes in the structure or organization of functions, with increasing differentiation between different specific functions with increasing age (Akshoomoff et al., Citation2018; Hartung et al., Citation2020; Lee et al., Citation2013; Zhang et al., Citation2021). This both overlaps with and is followed by gradual quantitative improvements continuing throughout childhood and adolescence (Huizinga et al., Citation2006; Lehto et al., Citation2003; Tamnes et al., Citation2010). Performance on shifting tasks improves at least into mid-adolescence, while inhibition and working memory likely continue to improve into young adulthood (Huizinga et al., Citation2006; Prencipe et al., Citation2011; Theodoraki et al., Citation2020). This protracted development of executive functions parallels the lengthy structural development of prefrontal cortical regions (Baum et al., Citation2020; Fiske & Holmboe, Citation2019; Norbom et al., Citation2021; Tamnes et al., Citation2013) and white matter tracts that connect prefrontal regions with other parts of the brain (Geeraert et al., Citation2019; Goddings et al., Citation2021; Lebel & Beaulieu, Citation2011). In addition to being a core aspect of the development of complex cognitive functions, executive functions are predictive of academic performance at school beyond general cognitive abilities (Donati et al., Citation2019), and are also important for social behavior both in school and in other settings (McClelland & Cameron, Citation2012).The development of executive functions is also linked to the ability to successfully regulate emotions (Schweizer, Gotlib et al., Citation2020; Schweizer, Parker et al., Citation2020), which is an important vulnerability and resiliency factor for the development of trauma symptoms (Christ et al., Citation2019; Dvir et al., Citation2014; Heleniak et al., Citation2016). Impairments in executive functions in youth with PTSS may therefore have a range of tangible consequences.

The few studies to date that have scrutinized the question of whether cognitive functions, and specifically executive functions, are differentially impaired depending on the presence of PTSS or not in youth after trauma exposure have shown mixed results (Barrera et al., Citation2013; De Bellis et al., Citation2009; Saigh et al., Citation2006; Scrimin et al., Citation2006). On the one hand, studies find impaired learning, memory and cognitive flexibility in children with PTSD as compared to trauma-exposed children without symptoms of PTSD (Samuelson et al., Citation2010; Schoeman et al., Citation2009; Yasik et al., Citation2007). On the other hand, no differences have been reported between these groups of trauma-exposed children on general intellectual abilities, attention, working memory, inhibition and memory (Samuelson et al., Citation2010; Yang et al., Citation2014). When comparing trauma-exposed children with and without PTSD to healthy controls, one study documented poorer general and verbal intellectual abilities in the PTSD group exclusively (Saigh et al., Citation2006). When investigating this question meta-analytically, Malarbi et al. (Citation2017) found a slight impairment in executive functioning in the PTSD/PTSS groups as compared to groups of trauma-exposed children without PTSD and healthy controls.

The aim of this systematic review and meta-analysis was to explore the nature of executive functioning in children and adolescents with PTSS. Specifically, we aimed to address the following research questions: 1. Do children and adolescents with PTSS show global or specific deficits in executive functions compared to healthy controls?, and 2. Do youth with PTSS show greater impairments in executive functions compared to youth exposed to traumatic events without PTSS? To address these questions, we performed meta-analyses on group-level differences between children with PTSS and health controls and between children with PTSS and children with traumatic experiences but without PTSS in performance on tasks considered to measure executive functioning. We chose to focus on executive functioning given their extended developmental course and their importance for academic performance and social and emotional functioning. We analyzed executive functions both on a general level across all available tasks and measures and for specific subdomains, including verbal fluency, inhibition, shifting, and working memory, as well on performance on complex executive function tasks. Dividing the tasks and measures into different executive function subdomains may aid in specifying the executive function difficulties associated with PTSS. Based on previous work (Kavanaugh et al., Citation2017; Malarbi et al., Citation2017; Op den Kelder et al., Citation2018; Scott et al., Citation2015), we hypothesized that children with PTSD would show overall poorer executive function performance than both healthy control and children with traumatic experiences without PTSD, while we considered our analyses of executive function subdomains explorative.

Previous reviews (Kavanaugh et al., Citation2017; Pechtel & Pizzagalli, Citation2011; Perkins & Graham-Bermann, Citation2012) and meta-analyses (Johnson et al., Citation2021; Malarbi et al., Citation2017; Op den Kelder et al., Citation2018) have focussed on associations between early-life stress or trauma exposure and functioning in different cognitive domains in children and adolescents. Instead, we chose to focus on cognitive functioning in children and adolescents with PTSS, rather than on groups with reported experienced traumatic events. This is an important distinction as only a minority of traumatized children will develop persisting and severe symptoms after trauma (McLaughlin et al., Citation2013). One exception is a meta-analysis of cognitive functioning in adults with PTSD (Scott et al., Citation2015), but this study excluded individuals below 18 years. A systematic review and meta-analysis of executive functioning in youth with PTSS is thus needed. Knowledge about executive functioning in children and adolescents with PTSS is important as these functions may be effective targets for intervention after trauma (Schweizer et al., Citation2017). Identifying whether children and adolescents struggle with specific executive functions or with executive functions more globally may guide future research and clinical work on how to intervene most effectively.

Methods

Search strategy and study selection

The present systematic review and meta-analysis is based on the Preferred reporting items for systematic reviews and meta-analyses (PRISMA) 27-item checklist and flow diagram (Moher et al., Citation2009). The literature search was performed February, 2021 in Scopus and Ovid (covering PubMed, Embase and Psychinfo) with the search phrase (“ptsd” OR “ptss” OR “post-traumatic stress” OR “posttraumatic stress”) AND (“executive*” OR “cognitive control”) AND (“child*” OR “adolescen*” OR “youth*” OR “pediatr*”).To limit the number of non-relevant hits, specific executive function subdomain terms were not included in the search. All abstracts were read for screening, and the eligibility criteria were: 1) original studies in English 2) using behavioral tasks to measure executive functions 3) in children (<18 years) 4) with PTSD or PTSS as determined either by a psychiatrist/psychologist or by self- or parent-report and 5) with a control group without PTSD or PTSS. Studies using questionnaires to measure executive functions were excluded, as were studies focused on other patient groups or the effects of interventions. Relevant references were cross-checked for further relevant studies. All eligible studies were read in full by two of the authors (ON, CKT) and inclusion was made by consensus. We contacted authors of all articles that met the inclusion criteria, but which did not report group means and standard deviations for the executive function measures. The results of the screening and selection procedure is detailed below.

The following information was extracted from the included studies: authors, year of publication, journal, study location, mean age, trauma type, executive function tests used, number of participants per group, and means and standard deviations of executive function task scores per group. All relevant task scores were included, although it was not consistently reported whether these scores were age-normed scores or raw scores. The different executive function test were then, based on discussion and consensus among the authors, categorized into the following five subdomains: complex, verbal fluency, inhibition, shifting, and working memory.

Statistical analyses

The statistical analyses were performed in R4.0.2 and RStudio 1.3.959 (https://www.r-project.org/). The package meta,version 4.15-1 (Balduzzi et al., Citation2019) was used to perform meta-analyses with executive function subdomains defined as subgroups, to create forest plots and funnel plots, and for regression analyses. We used the package metafor,version 2.4-0 (Viechtbauer, Citation2010) for sensitivity analyses to investigate whether clustering/multilevel effects of including multiple results from the same study influenced the results. As we expected the studies to be heterogeneous, we used random effects models. All available executive function performance scores from the studies were included separately. Each study could thus potentially contribute with multiple outcomes measures. In addition to examining group differences in executive functioning across all included tasks and measures, subgroup-level analyses allowed us to examine and compare group differences within and between each of the five executive function subdomains; complex, verbal fluency, inhibition, shifting, and working memory. We performed two separate analyses; one where we compared children with PTSS to healthy controls, and one where we compared children with PTSS to children exposed to traumatic events but without PTSS. Linear regression analyses were performed to investigate whether mean age of participants or publishing year influenced the results.

The reported effect sizes are bias-corrected standardized mean differences (Hedges’ g) (SMD) between the two groups. Negative effect sizes will here indicate that the group of children with PTSS performed worse than the control group. To ease interpretation, error and reaction time-based difference scores were calculated in the opposite direction, again so that negative effects indicate lower performance in the group of children with PTSS. Chi-square test (Q), tau, and I2 were used to assess heterogeneity, both within each executive function subdomain and across all measures. Significance level 5% was chosen for all analyses.

Bias evaluation

Each study was subjectively evaluated to have low, unclear or high risk with respect to six possible biases (selection, performance, detection, attrition, reporting and other bias), based on Higgins et al. (Citation2011). The risk of bias was individually assessed by two of the authors (ON and CKT). In cases of discrepancies between the two authors, consensus was researched after discussion. Studies were included irrespective of their assessed quality. Funnel plots were created to assess publication bias and interpreted according to recommendations by Sterne et al. (Citation2011).

Results

Study selection

The database search identified 325 studies after removing duplicates and after adding 2 relevant studies identified though other sources. After screening, 293 of these were excluded, while 33 articles were assessed in detail for eligibility. From these 33 studies, 12 studies were included in the meta-analyses, 6 of which had two control groups; healthy controls and children exposed to traumatic events without PTSS. The results of the study screening and selection process is further described in . Details of the studies included in the meta-analysis are presented in .

Table 1. Studies included in the meta-analyses

Figure 1. Flow diagram for the screening and selection procedure for studies in this meta-analysis.

Figure 1. Flow diagram for the screening and selection procedure for studies in this meta-analysis.

In all the 12 studies included in the meta-analysis, except three (Kavanaugh et al., Citation2015; Mueller et al., Citation2015; Park et al., Citation2014), the presence of PTSS or PTSD was determined with clinical interviews or with a clinician-administered scale. The definition and assessment of executive functions varied in the included studies. Some tasks were used in many of the included studies, whereas other tasks were less frequently used. The most frequently measured subdomains were complex executive functions and inhibition. The most frequently used task within these two subdomains was the Wisconsin Card Sorting Task and the Stroop Color-Word Task, respectively.

Meta-analysis

Executive functions in PTSS vs healthy controls

We first compared executive functioning in children with PTSS to healthy controls. The forest plot for the results are presented in , and presents a summary of the findings. There was strong heterogeneity among the 55 outcomes included in the meta-analysis (chi-square (52) = 334.62, p < .001; tau = 0.67; I2 = 84% (95% CI = 80% to 88%).

Table 2. Overview of findings from meta-analyses

Figure 2. Forest plot from meta-analysis on executive functions in children with PTSS vs. healthy controls.

Figure 2. Forest plot from meta-analysis on executive functions in children with PTSS vs. healthy controls.

Similarly, none of the executive function subdomains was homogenous. When examined on a global level across all executive function tasks and measures, children with PTSS had significantly worse executive functioning compared to non-trauma exposed healthy controls (SMD = −0.57 (95% CI = −0.77, −0.37), p < .001). The effect sizes between the five executive function subdomains were not significantly different from each other (Q = 7.18 (4), p = .13). Verbal fluency had the largest effect size (SMD of −1.45), followed by working memory and complex executive function measures (SMD of −0.59 and −0.55 respectively). The smallest effect sizes were seen for inhibition and shifting (SMD of −0.33 and −0.48 respectively). These group differences were significant for all investigated subdomains.

Executive functions in PTSS versus traumatic events

Second, we compared executive functioning in children with PTSS to children exposed to traumatic events but without PTSS. Six of the included studies in this meta-analysis included a comparison group of youth that were exposed to traumatic events but who did not develop PTSS. Such a comparison is central in the understanding of whether it is the symptoms of psychopathology or the traumatic event in itself that is associated with lower executive functioning.

The results of this meta-analysis are presented in , and summarized in . There was high heterogeneity across the 24 included effect sizes (chi-square (23) = 74.63, p < .001; tau = 0.56; I2 = 69% (95% CI = 53% to 80%). However, the complex and fluency executive functions subdomains were the only two which showed significant heterogeneity. When compared to children with traumatic experiences, but without PTSS, children with PTSS had overall significantly worse executive functioning (SMD = −0.34 (95% CI = −0.60, −0.07, p = .01). There were no significant differences in effect sizes between the five executive function subdomains (Q = 5.46 (4), p = .24). Children and adolescents with PTSS did significantly worse than trauma-exposed children without PTSS in the two executive function subdomains of shifting and working memory (SMD = −0.76 and −0.41, respectively), but not on complex tasks, fluency or inhibition.

Figure 3. Forest plot from meta-analysis on executive functions in children with PTSS vs. children with traumatic experiences but without PTSS.

Figure 3. Forest plot from meta-analysis on executive functions in children with PTSS vs. children with traumatic experiences but without PTSS.

Covariates

Age (B = −0.10 (95% CI = −0.19, −0.09), p = .04), but not publication year (B = −0.04 (95% CI = −0.08, 0.00), p = .06), was significantly related to the overall difference in executive functioning between children with PTSS and healthy controls. In the analyses of children with PTSS and children exposed to traumatic events, neither age (B = −0.01 (95% CI = −0.15, 0.12), p = .85), nor publication year (B = 0.01 (95% CI = −0.09, 0.11), p = .89) were significantly related to the overall group difference.

Multilevel analyses

Sensitivity analyses that consider the inclusion of several measures from the same study are presented in . There are no major differences between the results from these multilevel analyses and the results from the main analyses presented above.

Bias evaluation

There were risks of bias in all but one of the included studies. Detailed results from the assessment of bias are shown in Table S1. Out of the 12 studies, five did not report whether the groups were similar or different in socioeconomic status and one reported that there was a difference, and these studies therefore had a risk of selection bias. For seven of the 12 studies, it is natural to assume that participants had knowledge of their clinical status and the focus of the study and that the performance bias therefore was high. One study reported that the test administrator was unblinded, while five other studies did not report whether the administrator was blinded or not to clinical status, and therefore had possible detection bias. None of the studies showed risk of attrition bias, and only two studies showed risk of reporting bias, as only results for composite scores were reported. We did not find other bias risks in any of the studies. The funnel plots did not indicate serious publication bias, but did support that there was great heterogeneity among the studies (Figures S1 and S2).

Discussion

The present systematic review and meta-analysis indicate that children with PTSS have overall poorer executive functioning compared to healthy controls. The effect sizes varied between small to large for the different executive function subdomains complex tasks, verbal fluency, inhibition, shifting and working memory, but were not significantly different from each other. Thus, the results did not provide evidence for diversity in executive function impairment in children with PTSS, at least across the subdomains included in the present analysis. Similarly, analyses comparing children with traumatic experiences with and without PTSS showed overall poorer executive functioning in the PTSS group, albeit no significant differences in the effects across the executive function subdomains. The findings from the present meta-analysis confirm the already documented association between childhood trauma and poorer executive functioning (e.g., (Augusti & Melinder, Citation2013; DePrince et al., Citation2009; Lewis et al., Citation2007), see (Malarbi et al., Citation2017; Op den Kelder et al., Citation2018) for meta-analyses). In addition, the present meta-analysis expands on previous knowledge by indicating that the differences in executive functioning depend on the development of PTSS after the trauma.

Being exposed to trauma and presenting with PTSS was associated with poorer executive functioning compared to non-traumatized healthy controls. Beyond this overall difference across all executive function tasks and measures, no significant difference in effect sizes was found between the various executive function subdomains. This finding may suggest that there is not one or only a few subdomains that are negatively affected by trauma and PTSS, but rather that impairments in several subdomains of executive function may be associated with trauma symptoms. It is possible that significant differences between the subdomains could have been found if more studies were available for inclusion in the meta-analysis. When testing each subdomain separately, we observed the largest effect size for verbal fluency, but the differences were significant for all investigated domain. Previous meta-analyses have found broad deficits in cognition (Malarbi et al., Citation2017; Masson et al., Citation2015) and executive functions (Op den Kelder et al., Citation2018) in trauma-exposed youth compared to non-traumatized individuals, and the present study expands on this finding by testing specific subdomains of executive functions in children with PTSS and finding overall poorer executive functioning compared to healthy controls. Moreover, we found a negative association between age of participants and the overall difference in executive functioning between children with PTSS and healthy controls, possibly indicating greater vulnerability at younger ages or that the effect reduces over time, but this result should be interpreted with caution given the small number and cross-sectional nature of available studies.

A second objective of the present meta-analysis was to investigate whether presenting with PTSS compared to the absence of PTSS after childhood trauma is associated with different scores on executive functioning tasks, and if so if this is a global difference or specific to certain executive function subdomains. Similar to the comparison between children with PTSS and healthy controls, albeit with a smaller effect size, we found that children with traumatic experiences and PTSS showed overall poorer executive functioning than children with traumatic experiences without PTSS. Also here, there were no significant differences in the effects across the executive function subdomains. When testing each subdomain separately, only the shifting and working memory domains showed significant differences between traumatized children with and without PTSS, possibly due to the relatively small number of studies and outcome comparisons available for some of the subdomains in these analyses.

The present meta-analysis confirmed previous findings on the association between trauma and executive functioning, as well as the additional toll with which PTSS adds to difficulties in traumatized children’s cognition. However, the question as to whether some executive function subdomains are more negatively affected than others was not confirmed. A possible explanation of the lack of differences among specific subdomains of executive functioning may be the heterogeneity in tests and measures used to map the various subdomains included in our analyses. Previous studies have indicated that executive function subdomains are differently associated with trauma-exposure and PTSS. For instance, in a study on maltreated children, spatial working memory was the one domain mostly impaired compared to the other domains (Augusti & Melinder, Citation2013). In another study, on traumatized adolescents, set shifting turned out as the function most strongly associated with PTSS, but only in boys (Melinder et al., Citation2015). As discussed further below, most studies on the associations between trauma, PTSS and executive functioning are based on relatively small and heterogeneous samples, rendering it difficult to draw firm conclusions. The present meta-analysis may therefore shed new light on previous findings pertaining to specific executive functions being more or less affected by trauma-related stress reactions.

Although we in this meta-analysis comprehensively assessed executive functioning and specific executive function subdomains in children with PTSS compared to healthy controls and traumatized children without PTSS, some caveats merit consideration. First, most of the available studies have included relatively small samples. Second, a variety of tasks and measures have been used to assess executive functions in children with PTSS. Although the tests used in the studies included in the present meta-analysis are generally well-established and psychometrically sound, they are not necessarily developed to test the exact subdomains in the empirically based model by Miyake, Friedman and colleagues (Friedman & Miyake, Citation2017; Miyake et al., Citation2000), which the present study is based on. Moreover, not all measures were described in detail in the original studies, further complicating the categorization into subdomains. As such, some variance in our subdomain results might be ascribed to that the tests and measures included do not easily map onto single subdomains in this model. Third, we did not investigate timing or chronicity effects of the traumatic events behind PTSS on executive functioning. Previous studies indicate that abuse taking place early in life or over a prolonged period has a more severe impact on cognitive functioning than abuse with later onset or abuse, which is not chronic (Cowell et al., Citation2015). Fourth, most of the studies included in the present meta-analysis included samples with children exposed to familial trauma, also known as child maltreatment. Only a minority of the studies included samples exposed to traumatic events outside the family and which does not involve interpersonal trauma. There is a scarcity of studies on the association between non-familial trauma, such as accidents and natural disasters, and executive functioning and later development of PTSS. The relative imbalance between study samples when it comes to type of trauma exposure precluded the use of trauma type as a co-variate in the present meta-analysis. Previous studies on the prevalence of PTSD after trauma suggest that non-familial trauma results in lower levels of PTSD (Alisic et al., Citation2014), and we speculate that non-familiar trauma may also be associated with relatively smaller or fewer difficulties with executive functioning.

Future research should aim to further our understanding of the roles of timing and duration of trauma and of specific types of trauma in cognitive and executive functioning in children (see e.g., McLaughlin et al., Citation2020; Nolin & Ethier, Citation2007). Moreover, the present meta-analysis did not include executive functioning tasks with emotional valence, and future studies should further disentangle whether different patterns of associations are revealed when emotional information is embedded in executive functioning tasks (“hot” executive functions; Zelazo & Carlson, Citation2012). Such tasks have been considered more ecologically valid, as emotion regulation functions may be central for the development of psychopathology after trauma (Aupperle et al., Citation2012; Briggs-Gowan et al., Citation2015; Sætren et al., Citation2021; Schweizer et al., Citation2019; Shackman et al., Citation2007). Future studies should also test how executive functioning in children with post-traumatic stress reactions relates to daily life and school functioning, as well as whether executive functioning moderates treatment outcomes.

Supplemental material

CNY-RA_21-03-File006.xlsx

Download MS Excel (11.8 KB)

CNY-RA_21-03-File005.xlsx

Download MS Excel (15.2 KB)

CNY-RA_21-03-File004.docx

Download MS Word (157.6 KB)

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplementary material

Supplemental data for this article can be accessed at https://doi.org/10.1080/09297049.2021.1979950.

Data availability statement

The data used in the meta-analyses is available in the Supplementary Materials and at the Open Science Framework, https://osf.io/9nujs/.

Additional information

Funding

C.K.T. was supported by the Research Council of Norway [#223273, #288083, #301767] and the South-Eastern Norway Regional Health Authority [#2019069, #2021070, #500189]. Martin Ostenfeldt Trøstheim at the Department of Psychology, University of Oslo gave invaluable statistical support.

References