7,479
Views
17
CrossRef citations to date
0
Altmetric
Research Article

Internalising and externalising in early adolescence predict later executive function, not the other way around: a cross-lagged panel analysis

ORCID Icon, ORCID Icon & ORCID Icon
Pages 986-998 | Received 29 Jan 2020, Accepted 13 Apr 2021, Published online: 26 Apr 2021

ABSTRACT

Developmental changes in the brain networks involved in emotion regulation are thought to contribute to vulnerability to mental health problems during adolescence. Executive control is often viewed as allowing top-down regulation of emotional responses. However, while associations between executive control and mental health are commonly observed in both clinical and non-clinical populations, the direction of these associations remains unclear. Low, or immature, cognitive control could limit emotion regulation. Reversely, high emotionality could impede cognitive functioning. The scarcity of longitudinal studies testing for bi-directional effects, particularly in adolescence, has made it difficult to draw conclusions. This study analysed data from 1,445 participants of a longitudinal cohort in a cross-lagged panel design to understand bi-directional longitudinal associations between executive function and emotional behaviours across adolescence. Executive function was assessed using experimental working memory and inhibitory control tasks, emotional behaviours through parental report of internalising and externalising behaviours. Cross-sectional associations were replicated. Controlling for cross-sectional associations, early executive functions were not found to predict later emotional behaviours. Instead, early emotional behaviours predicted later executive function, with the strongest link observed between early externalising and later working memory. These results suggest that emotional well-being may affect the maturation of executive function during adolescence.

Many mental health conditions have an age of onset during adolescence (Giedd et al., Citation2008; Rapee et al., Citation2019), coinciding with substantial changes occurring in brain areas governing cognitive control and emotional reactivity (Crone & Dahl, Citation2012). This has led to a hypothesis that relatively poorer cognitive control, combined with increasingly reactive subcortical regions, make emotion regulation difficult for adolescents, putting them at risk for developing mental health issues (Crone & Dahl, Citation2012). Studies in adults have shown associations between activity in the prefrontal cortex (PFC), down-regulation of amygdala activity, and better mental well-being (Frank et al., Citation2014). These studies provide a mechanistic understanding for findings that individual differences in cognitive control, or executive function (EF), have been associated with internalising and externalising behaviours. Internalising behaviours are directed inwards and include fearfulness, social withdrawal and anxiety, while externalising behaviours are directed outwards and include physical aggression, disobedience and substance abuse (American Psychiatric Association, Citation2013). Poor EF has therefore been proposed as a risk factor for developing psychopathologies (Snyder et al., Citation2015). However, there is also research showing that emotion can interfere with cognitive processing (Song et al., Citation2017). The direction of association between EF and internalising and externalising behaviours, in particular during adolescence, remains therefore unknown.

During adolescence there are structural (Gogtay et al., Citation2004; Mills et al., Citation2016; Zhou et al., Citation2015) and functional (Crone & Dahl, Citation2012) changes in the frontal-parietal executive networks, structural (Goddings et al., Citation2014) and functional (Hare et al., Citation2008) changes in subcortical areas processing emotional stimuli, as well as changes in patterns of connectivity between these networks during emotional regulation (Casey et al., Citation2019). These changes are thought to lead to increased emotional reactivity during adolescence (e.g. Hare et al., Citation2008), before the emergence of mature emotional regulation supported by top-down connectivity (i) within the prefrontal cortex and (ii) from the prefrontal cortex to the ventral striatum and amygdala (Casey et al., Citation2019). Furthermore, the “flexible” state of the PFC has been suggested as a risk factor for adolescent mental health problems (Crone & Dahl, Citation2012). Neuroimaging studies in adults have shown an association between better down-regulation of emotions, measured behaviourally, and a greater inverse functional connectivity between the amygdala and parts of the prefrontal cortex during emotion regulation (Frank et al., Citation2014; Lee et al., Citation2012). Adults with high levels of anxiety have been found to have decreased structural connectivity between prefrontal areas and limbic regions (Kim et al., Citation2011; Kim & Whalen, Citation2009). Since the prefrontal cortex is the key brain structure for performing executive functions (Funahashi & Andreau, Citation2013), it has been suggested that poor EF might contribute to poor emotional regulation via poor top-down regulation of subcortical regions (Frank et al., Citation2014; White et al., Citation2011; Zelazo & Cunningham, Citation2007). Furthermore, cross-sectional clinical and non-clinical studies have found deficits in almost all neuropsychological EF tasks across the spectrum of mental health disorders (Snyder et al., Citation2015).

Executive functions are a set of cognitive processes necessary for the voluntary control of behaviour and the successful achievement of goals (Diamond, Citation2013). Although there is no clear agreement as to what executive functions are, they are closely related to fluid intelligence and processing speed (Jurado & Rosselli, Citation2007). The current dominant adult EF framework (Friedman & Miyake, Citation2017; Miyake et al., Citation2000) has focused on three aspects of executive functioning: (i) working memory (WM), the ability to hold and manipulate information in mind; (ii) shifting, the ability to flexibly switch attention between different tasks, rules, or mental states; and (iii) inhibitory control (IC), the ability to suppress distracting information and unwanted responses. Although correlated when measured experimentally, these three aspects of EF are also separable (Karr et al., Citation2018; Lee et al., Citation2013; Miyake et al., Citation2000) and associate distinctly with other measures. For example the updating component of working memory associates more closely with obsessive-compulsive disorder than the other measures, inhibitory control more closely with behavioural disinhibition, and shifting with post-traumatic stress disorder (Snyder et al., Citation2015; Young et al., Citation2009). This has led to the proposal of both unity, represented by the “common EF” factor, and diversity, with evidence of unique variance in shifting and updating, and more mixed results of inhibition (Friedman & Miyake, Citation2017; Karr et al., Citation2018; Miyake & Friedman, Citation2012). Developmentally, while results are somewhat mixed, there is a general pattern of increasing specialisation from unity (all EF measures feeding into a common factor) to diversity (different measures tapping into different constructs) (Hartung et al., Citation2020; Karr et al., Citation2018). For example, a number of studies consistently find a unitary model of EF in early childhood (Wiebe et al., Citation2008, Citation2011), whereas by late childhood/early adolescence the picture is more variable. Some studies find evidence to support three separable but highly correlated traits in 8–13 year-olds (Lehto et al., Citation2003) and others find that in 5–13 year-olds a two-factor model of EF fits the data best and it is not until age 15 that a three-factor model emerges (Lee et al., Citation2013). Huizinga et al. (Citation2006) found shifting and WM latent factors in 7–21 year-olds, but no clear IC latent measure, instead the three IC measures loaded separately. Finally, Malagoli and Usai (Citation2018) found a two-factor model when looking at measures of WM and IC in adolescents aged 14–19 years (Malagoli & Usai, Citation2018).

Early childhood studies find a consistent relationship between poorer EF across a variety of measures and higher levels of externalising behaviours. For example, a meta-analysis of 126 studies including 14,786 participants ranging from preschool to mid-adulthood found a medium effect size for the associations between poorer IC (d = 0.56) and WM (d = 0.54) and externalising behaviour (Ogilvie et al., Citation2011). A study of 1,177 6 year-olds found a negative association between IC and measures of the attention and executive functioning domain of the NEPSY-II battery and externalising behaviours (Blanken et al., Citation2017). Cole and colleagues also found an association in pre-schoolers between a latent EF measure combining IC, WM, shifting, planning and attention tasks, and externalising problems (Cole et al., Citation1993). Brophy and colleagues, on the other hand, found longitudinal impairments in IC in “hard to manage” children (aged 4 and then 7 years old), but no associations with WM (Brophy et al., Citation2002). This relationship in younger children between poorer IC and impulsive, intense and aggressive behaviours (Carlson & Wang, Citation2007; Eisenberg et al., Citation2001; Eisenberg & Fabes, Citation1992; Nigg et al., Citation1999) and hyperactivity (Thorell et al., Citation2004) is fairly consistent. Beyond early childhood, a study with children and adolescents aged 7–18 years found a strong association between latent measures of externalising and WM (Cassidy, Citation2016). Séguin et at. (Citation1999) found that the association between aggression and working memory in adolescent boys (13–15 years) remained even after controlling for IQ and ADHD diagnosis (Séguin et al., Citation1999). In combination, these studies suggest there may be age-related changes to the associations between externalising and EF, where IC is important in early childhood externalising, and WM in later externalising behaviours.

Findings are less consistent regarding associations between EFs and internalising behaviours and disorders, which may be moderated by other factors. For example, pre-schoolers with high inhibitory control are less likely to express negative emotion (Eisenberg & Spinrad, Citation2004). However, these pre-schoolers also often have poorer cognitive flexibility, which may be behind their greater susceptibility to internalising disorders (Carlson & Wang, Citation2007; Fox, Citation1994; Nigg, Citation2000). Others have found an interaction in pre-schoolers between inhibitory control measured by the day-night inhibitory control task and behavioural inhibition in predicting anxiety (White et al., Citation2011). Some have argued high levels of IC are protective against developing externalising behaviours, but a risk factor for developing internalising behaviours (Thorell et al., Citation2004), with suggestions of a quadratic relationship between IC and behavioural problems (Carlson & Wang, Citation2007). However, clinical studies in adults tend to find a negative association between executive functioning and internalising disorders. Poor inhibitory control has been associated with depression as well as rumination in the general population (Hilt et al., Citation2014; Joormann et al., Citation2007; Whitmer & Banich, Citation2007). Depressed adult patients are generally slower and make more errors in inhibitory control tasks (Gohier et al., Citation2009). Anxiety-related disorders are also associated with visuospatial working memory deficits (Boldrini et al., Citation2005), while poorer WM has been associated with depression in child and adolescent girls (Matthews et al., Citation2008) and adults (Harvey et al., Citation2004). Overall, these results provide a mixed pattern of associations between internalising and EF across ages.

Although the dominant interpretation of the observed associations between cognitive control and emotional behaviours is that poorer EF lead to poorer well-being, there are a number limitations to this interpretation. Current studies are mostly cross-sectional, making it difficult to assess directionality; when longitudinal, the studies mostly fail to account for early correlations between measures or do not allow for emotional behaviours to be the predictive factor in the association (Eisenberg et al., Citation2009; Hughes & Ensor, Citation2011). Neuroimaging studies largely use EF tasks with emotional stimuli (Schweizer et al., Citation2013) and behavioural studies often use self-regulation tasks that are emotionally charged (e.g. Carlson & Wang, Citation2007), potentially overestimating the correlations between EF and emotion regulation (e.g. see Braunstein et al., Citation2017). Indeed there are suggestions that EFs recruited in emotional contexts (“hot” EF) operate under different mechanisms to those recruited in unemotional contexts (“cool” EF) (Zelazo & Carlson, Citation2012). Therefore, evidence is still lacking that “cool” EFs have a causal impact on long-term emotional disorders or problem behaviour.

Neuroimaging studies rarely measure EF directly and use PFC activation as a proxy measure instead; they also leave space for alternative interpretations of the data (for review: Ochsner & Gross, Citation2008). For example, emotional processing is known to interfere with cognitive processing (Ansari & Derakshan, Citation2010; Song et al., Citation2017), therefore it could be that a more reactive amygdala impedes PFC top-down control rather than poor top-down cognitive control on amygdala function resulting in high emotional reactivity. Indeed, Kopf and colleagues performed a neuroimaging study using the emotional N-back and found that WM and emotional processing compete for cognitive resources. Furthermore, in the context of negative valence, emotional content took precedence by limiting brain activation otherwise associated with WM performance (Kopf et al., Citation2013). Evidence from EF training studies aimed at improving emotional symptoms remain inconclusive (Course-Choi et al., Citation2017; Hotton et al., Citation2018; Sari et al., Citation2016), which also argues against a simple causal link between poor cognitive control and high emotional behaviours.

The alternatives are that, first, both of these models could be true, with different disorders disturbing cognitive control or emotional response networks differently (Goschke, Citation2014). Second, there could be a reciprocal relationship between EF and emotion. Early development researchers suggest a bi-directional relationship between EF and emotional well-being unfolds over development. For example, infant orienting away from distressing stimuli establishes early self-regulation and cognitive control, setting a positive foundation for working memory, which results in better emotion regulation and in turn frees up cognitive space for better cognitive development (Bell & Wolfe, Citation2004; Posner & Rothbart, Citation2000).

There remains significant work to do to better understand the direction of associations between cognitive control and emotional behaviours. Despite theories suggesting a particular vulnerability in adolescence due to changes in the neural circuity underpinning emotion regulation (Mills et al., Citation2014; Prencipe et al., Citation2011) little research has been done into how cognitive control, emotional regulation and emotional behaviours relate to each other and change over adolescence. The present study used a longitudinal adolescent dataset to investigate the direction of associations between IC and WM measures of EF and parent-report measures of internalising and externalising emotional behaviours. The focus was on the spectrum of internalising and externalising behaviours, rather than on extreme clinical ends of the distributions. While a few studies have used latent factors of multiple EF measures (e.g. Cassidy, Citation2016; Cole et al., Citation1993), much research in this field has used only one task per construct and non-latent scores (e.g. Brophy et al., Citation2002; Thorell et al., Citation2004). The dominant adult EF framework argues latent measures are necessary to remove task-specific noise from EF tasks (Friedman & Miyake, Citation2017; Miyake & Friedman, Citation2012; Snyder et al., Citation2015). We therefore created two models: one which included IC and WM mean scores, the other using confirmatory factor analysis to create latent scores. As reviewed above, EF can be modelled as a single latent factor or multiple factors. We therefore compared a model of EF with two separate factors representing WM and IC, and a unitary EF factor model, and used the better model in the subsequent latent cross-lagged panel analysis. The aim was not to make specific claims about the structure of EF as we lacked a shifting measure and multiple measures of each construct, instead we aimed to assess whether the directionality of longitudinal associations between EF and externalising and internalising remained consistent across models.

Measures of executive function were collected in the Avon Longitudinal Study of Parents And Children (ALSPAC) cohort during early adolescence (age ∼10 years) and mid- to late adolescence (age ∼15–17 years), therefore this was the time interval that was considered here. There is some evidence to show that mid-adolescence is a period of particular emotional turmoil (see Ahmed et al., Citation2015), which this study will not be able to capture. However, the advantages of these time points are that the early measures allow us to take a “baseline” prior to the main developmental changes of adolescence, and the later measures allow us to capture long-lasting effects that would be relevant for long-term mental health issues. Importantly, the EF measures used in the present study did not involve emotional stimuli, which means any observed associations between EF and emotional behaviours would not be driven by the involvement of emotion regulation in the EF tasks.

We constructed cross-lagged panel models to assess firstly whether there was an association between cognitive control and emotional behaviours during adolescence and whether these associations continued across development. Secondly, we assessed whether cognitive control or emotional behaviours were the drivers of change over time. We expected a reciprocal developmental explanation where better mental health allows for better cognitive development and vice versa. Therefore, we expected that working memory and inhibitory control and internalising and externalising would have bi-directional relationships over adolescence.

Method

Study cohort

The Avon Longitudinal Study of Parents And Children (http://www.bristol.ac.uk/alspac/) is an on-going population-based study investigating factors influencing development and health. Initial recruitment included 14,541 mothers with 13,988 children alive at age one. Another round of recruitment at around age 7 left the total sample size for data collected after this age at 15,247 (see Supplementary Note 1 and Boyd et al., Citation2013 for full details). The study website contains details of all the data that are available through a fully searchable data dictionary (http://www.bris.ac.uk/alspac/researchers/data-access/data-dictionary/). Inevitably not all participants attended all data collection waves or returned all questionnaires, and therefore the final sample for the current study includes 1,445 participants (622 males, 823 females) aged 10 years 3 months to 13 years 3 months in the early measures and 14 years 3 months to 19 years 6 months in the late measures, who provided data for all measures at both time-points (see Supplementary Note 1 and Supplementary Table 1 for a description of the full and final samples). Compared to the full cohort, the final sample had a significantly greater proportion of females, was overall of higher socio-economic status, IQ, working memory and early inhibitory control, and reported fewer internalising and externalising behaviours, but with very small effect sizes (Supplementary Table 1). A post-hoc power analysis for our main analyses using a multiple regression model with four predictors showed we had a power of 1 to detect a R2 of 0.02. Ethical approval for the study was obtained from the ALSPAC Ethics and Law Committee and the local research Ethics Committee.

Measures

Strengths and difficulties questionnaire

Internalising and externalising measures were collected using the Strengths and Difficulties Questionnaire (SDQ) (Goodman, Citation1997), completed by a parent when the participant was 11 and 17 years old. ALSPAC did not have child-report measure of the SDQ before 16 years old and therefore for consistency we used parent-report measures at both timepoints. The SDQ is a well-validated measure of childhood behavioural and mental health problems (Ford et al., Citation2007; Goodman et al., Citation2010), including the parent-report measure specifically (Becker et al., Citation2004a). There is reasonable consistency between parent-report and self-report measures across this age group (Goodman et al., Citation1998) and parent-report measures are a better predictor of clinical diagnosis in younger adolescents than self-report measures (Becker et al., Citation2004b). The internalising measure comprises the five questions from the emotional problems scale (e.g. “Often unhappy, downhearted”) and the five questions from the peer problems scale (e.g. “Rather solitary, tends to play alone”). The externalising measure comprises the five questions from the conduct problems scale (e.g. “Often has temper tantrums or hot tempers”) and the five questions from the hyperactivity scale (e.g. “Restless, overactive”). For each question, the respondent can choose the answers “Not true”, “Somewhat True” or “Certainly True”, which have a score of 0, 1 and 2 respectively (note reversed-scored items were recoded). Sum scores resulted in possible scores of 0–20 for each scale at each time point. The internalising-externalising scales of the SDQ have been found to be good predictors of mental health issues in the general population (Goodman et al., Citation2010).

Early executive function measures

Participants performed two EF tasks at age 10 years: the Counting Span task and the Stop Signal task. The Counting Span task (Case et al., Citation1982) is a WM task where at the end of each block of trials the participant is asked to recall in order the number of red dots presented on each trial of that block. A Counting Span score was calculated from the number of trials correctly recalled (max. 42) (). The Stop Signal task (Logan & Cowan, Citation1984) is an IC task where the participant must respond to X’s and O’s on the screen by pressing the corresponding button as quickly as possible (Go trials). In a first practice blocks participants complete Go trials. This establishes a mean baseline reaction time (RT). The second practice block introduces Stop trials. On Stop trials a beep played randomly 150 ms or 250 ms before the participant’s baseline RT indicates the participant should refrain from responding. The practice block included 16 Go trials and eight Stop trials. There were then two experimental blocks of 48 trials, 16 of which were Stop trials (33%). As the number of correct Stop trials in the 150 and 250 ms delay conditions were highly correlated, an average Stop Signal number of correct Stop trials across delays was calculated for each individual ().

Table 1. Descriptive statistics of individual measures in the complete case dataset (n = 1,445).

Late executive function measures

The Counting Span task was not repeated in later testing sessions within the ALPSAC study, however an N-back task was used at age 17 years. This is another standard WM test, although rather than assessing a WM span it requires updating items in WM. Participants were presented with numbers 0–9 for 500 ms and had 3000 ms to judge whether the current number was the same as the number shown either two or three trials before (2-back or 3-back). The practice block consisted of 12 trials with two targets, and there were single blocks of the 2-back and 3-back conditions each consisting of 48 trials with eight targets. The measure used from this task was the 2-back accuracy as it has also been used in other studies looking at the relationship between WM and psychopathology and is the most commonly used measure (Snyder et al., Citation2015). The Stop Signal task from age 10 was repeated at age 15 years. However, although the practice and test blocks at age 15 were the same as at age 10, delay times between stimulus and stop signal presentations were different for different groups of participants. For this reason, a residual score covarying for the differences in delay duration was calculated for the purpose of this study. Latent measures of early and late EF were created using the saved factor scores from a confirmatory factor analysis.

Although shifting is another key construct of executive function, there was no available measure of shifting during adolescence in the ALSPAC sample.

Statistical analysis

We used the Lavaan version 0.6–7 (Rosseel, Citation2012) structural equation modelling package in R (R Core Team, Citation2013) with Robust Maximum Likelihood estimator with Yuan-Bentler scaled statistic (MLR) to account for any violation of multivariate normality. Due to the fact that the measures within each time point were collected at slightly different ages (see ) and that there are sex differences on some measures (Donati et al., Citation2019) all EF and SDQ scores were regressed for age and sex at each time point. Confirmatory factor analyses (CFA) were performed on EF measures to create latent scores using complete case data (n = 1,445) (see Supplementary Figure 1) in order to assess whether a single EF model was a better fit than a model with separate WM and IC latent measures, although we note that a single task was available at each timepoint for each EF construct. Next, two cross-lagged panel structural equation models were used to investigate the longitudinal bi-directional associations between (i) the WM and IC executive function measures and the internalising and externalising sum scores and (ii) the latent executive function measure/s and internalising and externalising sum scores. A panel model postulates that there is a directional relationship between constructs using regression. Cross-sectional correlations between measures at the early time point were controlled for in order to understand effects specific to changes between the time points.

Results

Pearson’s correlations were calculated between the eight variables included in the cross-lagged model (see Supplementary Table 2). Early and late internalising and externalising behaviours were positively correlated [range: .22–.59]. Weaker correlations were observed between early and late working memory and inhibitory control [range: .08–.51]. Parent-reported problem behaviours and EF cognitive measures were negatively correlated [range: -.06–-.20], with lower correlations between internalising and EF measures than between externalising and EF measures.

The cross-lagged panel model 1 is shown in . In combination, predictors explained the following percentage of variance in the late measures: 6.9% for working memory, 6.1% for inhibitory control, 24.2% for internalising, and 35.3% for externalising.

Figure 1. Cross-lagged panel model of the associations between working memory and inhibitory control and parent-reported internalising and externalising behaviours in early and mid-to-late adolescence. Values represent standardised betas with standard errors in brackets. Line styles indicate significance: thick lines p ≤ 001, thin lines p ≤ .01, dashed lines p ≤ .05, grey lines p > .05. Green lines highlight significant cross-construct associations. Age at testing: Early = 10y3m–13y3m, Late = 14y3m–18y4m.

Figure 1. Cross-lagged panel model of the associations between working memory and inhibitory control and parent-reported internalising and externalising behaviours in early and mid-to-late adolescence. Values represent standardised betas with standard errors in brackets. Line styles indicate significance: thick lines p ≤ 001, thin lines p ≤ .01, dashed lines p ≤ .05, grey lines p > .05. Green lines highlight significant cross-construct associations. Age at testing: Early = 10y3m–13y3m, Late = 14y3m–18y4m.

When controlling for all associations in early adolescence, all four measures were significantly (p ≤ .01) correlated with each other in early adolescence (). In late adolescence, when previous associations were controlled for, only three associations remained significant (internalising – externalising, externalising – WM, and WM – IC, ).

Early internalising longitudinally predicted variance in late internalising and late working memory. Similarly, early externalising longitudinally predicted variance in late externalising and late working memory, and in addition predicted variance in late internalising. The strongest cross-construct association was between early externalising and late working memory. Early EF measures predicted variance in late adolescence EF measures but did not predict variance in internalising or externalising in late adolescence ().

Confirmatory factor models comparing one and two EF factors found the two factor model returned a significantly better model fit χ2(9) = 1985.727, p < .001; CFI = .997; RMSEA = .020 [.000, .039]; SRMR = .012, χ2diff = 173.61, dfdiff = 4, p < .001. Therefore, even though measures from only a single task was available for each EF construct, the model with two EF factors was used in the subsequent cross-lagged panel model. In the latent EF trait cross-lagged panel analysis (Supplementary Figure 1) significant relationships remained the same but were strengthened between internalising and working memory and within EF measures. The variance explained in the late measures by all predictors for model 2 was 33.1% for WM, 11.0% for IC, 24.2% for internalising and 35.3% for externalising.

Discussion

The present study demonstrated that executive functions and internalising and externalising behaviours showed significant cross-sectional correlations during early adolescence, replicating previous findings. However, when controlling for early associations, analyses showed that internalising and externalising in early adolescence predicted later executive functioning, while early executive function measures did not predict later internalising or externalising. Strengths of this study are the use a of large population-based longitudinal sample, the comparison of different models and the consideration of bi-directional associations between emotional behaviours and EF.

Internalising and externalising were significantly cross-sectionally correlated with both WM and IC in early adolescence, in line with previous findings in childhood (e.g. Carlson & Wang, Citation2007), adolescence (e.g. Ogilvie et al., Citation2011) and adulthood (e.g. Snyder et al., Citation2015). All the associations were found to be negative. This is contrary to the preschool children results that suggest that higher IC associates with higher internalising (White et al., Citation2011), indicating that by adolescence this pattern is not present or has changed. The negative associations were overall small. The first cross-lagged panel model showed that when controlling for early associations, the only cross-construct cross-sectional correlation that remained significant in late adolescence was between WM and externalising, suggesting an increase in association between the two constructs over the course of adolescence, or that WM and externalising are similarly influenced by individual differences in some other aspect of cognition or the environment over the course of adolescence. These results replicate previous findings of associations between externalising behaviours and working memory from pre-schoolers to adults (Ogilvie et al., Citation2011; Ziermans et al., Citation2012), and between inhibitory control and externalising in childhood (Carlson & Wang, Citation2007; Eisenberg & Fabes, Citation1992) but suggest that findings linking externalising behaviour and IC in adulthood (Li et al., Citation2006) may represent residual relationships established early in life or common variance shared with working memory.

The high level of cross-sectional and longitudinal correlations between internalising and externalising, as has been shown previously, suggests a strong relationship between the two constructs that continues to change over time. The model shows that even when controlling for their association in early adolescence, the associations between internalising and externalising in late adolescence remains large. Studies spanning from infancy to adolescence suggest that externalising difficulties peak early in childhood whereas internalising difficulties continue to increase steadily with age and these changes are attributed to cognitive development (Gilliom & Shaw, Citation2004). In the present sample we find that early externalising is associated with later internalising, suggesting a possible change in the expression of emotional problems.

While EF and emotional behaviours show small cross-sectional associations, EF was not found to predict later internalising or externalising behaviours. This indicates that, when controlling for childhood associations, executive functions are not directly influencing change in emotional behaviours during adolescence, contrary to what is predicted by Gilliom and Shaw (Citation2004) and to the widely held view that individual differences in EF influence changes in emotional behaviours over adolescence (Ahmed et al., Citation2015). It is possible that EF’s influence on the emergence of emotional behaviours may be limited to childhood. Hughes and Ensor (Citation2011) for example, find that change in EF between 4 and 6 years of age predicts internalising and externalising at 6 years. However, while many studies have modelled executive function over development (Huizinga et al., Citation2006; Lee et al., Citation2013; Malagoli & Usai, Citation2018), and some studies have looked at whether executive function can predict emotional behaviours over development (Hughes & Ensor, Citation2011), we are aware of only one other study that models bi-directional effects of emotional behaviour on executive function across development as was done in the present study. Brieant and colleagues collected WM, IC and shifting measures as well as internalising and externalising at four time-points across adolescence, beginning at 13–14 years of age. They allowed for bi-directional effects across adolescence and found the same results as we observed in the present study: while EF did not predict changes in internalising or externalising, both measures of emotional behaviours predicted changes in EF (Brieant et al., Citation2020). Furthermore, they covered the period of adolescence missed in the present study (13–17 years old), suggesting our results are unlikely to be due to missing a key period. Combined, the present study and the study by Brieant and colleagues (Brieant et al., Citation2020) provide evidence that problem behaviours in early to mid-adolescence predict the longitudinal development of executive functioning into late adolescence, rather than the other way around.

There is evidence showing that adaptive emotion regulation strategies correlate with better EF and emotional well-being, as well as increased PFC and reduced amygdala activation during emotion regulation tasks (Ochsner et al., Citation2012). As the present study found that both early internalising and externalising behaviours predicted later executive function, unsuccessful top-down control could therefore be a consequence rather than a cause of increased emotionality. This interpretation aligns with studies that document how emotional processing interferes with cognitive processing (Fuhrmann et al., Citation2019; Song et al., Citation2017). Studies of emotion regulation and emotion interference generally focus on state interactions between emotion and cognition, whereas we have used more trait-like measures. A possible integrative interpretation of the results of previous research and the present study is that top-down executive control is involved in regulating state emotion but does not alter trait emotionality in adolescence. Alternatively, there could be a bi-directional relationship, as posited by Bell and Wolfe (Citation2004), where abilities are dominant at different times in development. EF may be dominant in influencing the early development of temperament when EFs are developing at a fast rate. However, by adolescence, although EFs are still flexible, they are potentially more affected by fluctuating emotional states that are driven by increased reward-salience, sensation seeking and salience of social interactions (Blakemore & Robbins, Citation2012; Crone & Dahl, Citation2012; Steinberg et al., Citation2018).

Our comparison of models specifying one or two EF factors showed a two-factor model was a significantly better fit. It is possible that this reflects the hypothesised increased specialisation and differentiation of execution functions over development (Karr et al., Citation2018). The cross-lagged panel model using latent EF variables (Supplementary Figure 1) showed the same patterns of associations as the basic model, but with slightly stronger associations between the EF measures.

Limitations

Overall the associations observed across constructs were small (although not unexpected given the time gap and all the variables controlled for) and a number of limitations due to the use of an existing dataset should be considered.

A first set of limitations relates to the cognitive tasks. Different WM tasks were administered to ALSPAC participants in early and late adolescence. It is therefore possible that the correlations between WM and internalising and externalising in early adolescence may not be fully controlled for. The Stop Signal task measure used in ALSPAC only included two Stop Signal delays rather than the variable delays typically used to assess Stop Signal Reaction Times (Logan & Cowan, Citation1984) and unfortunately, no measure of cognitive flexibility was available. The latent model was restricted by the fact that each factor had only variables from one task, which reduces the traditional advantages of using latent variables to remove task-specific variance. Finally, only a small amount of variance in late WM and IC was explained by model 1 (6.9% and 6.1% respectively), which perhaps reflects the commonly reported low level of test re-test reliability of EF measures (Hedge et al., Citation2018). Although this was considerably larger in the latent EF model: 33.1% for WM and 11% for IC.

Another set of limitations relates to the age of the participants and the nature of the sample. The ages at which participants completed the EF tasks and their parents completed the SDQ were not exactly matched, which may have affected the results. Overall, the size of the longitudinal associations between EF and emotional behaviours were small, perhaps due to the use of a combination of experimental and questionnaires measures but also the fact that this was a sample with generally low behaviour problems and high EF. Although our subsample was taken from a population-based study, the subsample had significantly higher levels of cognitive ability and lower levels of internalising and externalising than the main cohort. It is not clear how this would have influenced the results, but it may explain the relatively smaller effect sizes found here rather than in clinical studies (Snyder et al., Citation2015). It is also possible that the current study misses out on interactions between EF and emotional behaviour changes occurring in mid-adolescence. Another set of measures taken in mid-adolescence would have allowed us to track the continuing evolution of this relationship more closely, however the study by Brieant et al. (Citation2020) suggests it might not have altered our findings. A further possibility is that the effect sizes are small in adolescence and continue to get smaller with age, as brain functions continue to differentiate and specialise and individual differences in cognitive processes become more differentiated.

Finally, we note that although the SDQ is widely used and has shown fairly good reliability in predicting internalising disorders (Becker et al., Citation2004a; Goodman et al., Citation2010), the internalising measure of the SDQ may be too focused on depression and the peer interaction items may reflect individual differences unrelated to internalising (e.g. “rather solitary” may reflect an autism spectrum disorder or the consequences of externalising behaviours); it is possible that elements not captured are more closely related to EF. Self-report rather than parent-report measures of mental health may have given us a different picture of the relationship than that what we would possibly gain from self-report. However, assessments of parent-report measures tend to find them accurate (Becker et al., Citation2004a; Goodman et al., Citation1998), although sometimes better at reporting on externalising rather than internalising behaviours (Becker et al., Citation2004b).

Conclusion

This study replicated the widely reported cross-sectional associations between EF and internalising and externalising behaviours. However, the longitudinal design demonstrated that when controlling for childhood associations, externalising, and to a lesser extent, internalising, in early adolescence is associated with later executive functioning, but not the other way around. These results suggest that while executive function training in early adolescence may not improve emotional well-being, interventions to improve well-being may have a positive influence on cognitive performance. Further studies could incorporate middle adolescence as well as charting growth trajectories.

Supplemental material

Supplementary_Material

Download MS Word (225.5 KB)

Acknowledgements

We are extremely grateful to all the families who took part in this study, the midwives for their help in recruiting the participants and the whole ALSPAC team, which includes interviewers, computer and laboratory technicians, clerical workers, research scientists, volunteers, managers, receptionist and nurses. The UK Medical Research Council and Wellcome (Grant ref:102215/2/13/2) and the University of Bristol provide core support for ALSPAC. A comprehensive list of grants funding is available on the ALSPAC website (http://www.bristol.ac.uk/alspac/external/documents/grant-acknowledgements.pdf); This research was specifically funded by Wellcome (Grant 08426812/Z/07/Z), Wellcome and MRC (Grant 076467/Z/05/Z). Dr. Donati’s research was funded by the Birkbeck Wellcome Trust Institutional Strategic Support Fund (ISSF).

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by Medical Research Council: [grant numbers 076467/Z/05/Z, 102215/2/13/2]; Wellcome Trust: [grant numbers 08426812/Z/07/Z, 102215/2/13/2].

References

  • Ahmed, S. P., Bittencourt-Hewitt, A., & Sebastian, C. L. (2015). Neurocognitive bases of emotion regulation development in adolescence. Developmental Cognitive Neuroscience, 15, 11–25. https://doi.org/10.1016/j.dcn.2015.07.006
  • American Psychiatric Association, American Psychiatric Association, & DSM-5 Task Force. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (5th ed.). American Psychiatric Publishing.
  • Ansari, T. L., & Derakshan, N. (2010). Anxiety impairs inhibitory control but not volitional action control. Cognition & Emotion, 24(2), 241–254. https://doi.org/10.1080/02699930903381531
  • Becker, A., Hagenberg, N., Roessner, V., Woerner, W., & Rothenberger, A. (2004b). Evaluation of the self-reported SDQ in a clinical setting: Do self-reports tell us more than ratings by adult informants? European Child & Adolescent Psychiatry, 13(S2), https://doi.org/10.1007/s00787-004-2004-4
  • Becker, A., Woerner, W., Hasselhorn, M., Banaschewski, T., & Rothenberger, A. (2004a). Validation of the parent and teacher SDQ in a clinical sample. European Child & Adolescent Psychiatry, 13(2), ii11–ii16. https://doi.org/10.1007/s00787-004-2003-5
  • Bell, M. A., & Wolfe, C. D. (2004). Emotion and cognition: An intricately bound developmental process. Child Development, 75(2), 366–370. https://doi.org/10.1111/j.1467-8624.2004.00679.x
  • Blakemore, S.-J., & Robbins, T. W. (2012). Decision-making in the adolescent brain. Nature Neuroscience, 15(9), 1184–1191. https://doi.org/10.1038/nn.3177
  • Blanken, L. M. E., White, T., Mous, S. E., Basten, M., Muetzel, R. L., Jaddoe, V. W. V., Wals, M., van der Ende, J., Verhulst, F. C., & Tiemeier, H. (2017). Cognitive functioning in children with internalising, externalising and dysregulation problems: A population-based study. European Child & Adolescent Psychiatry, 26(4), 445–456. https://doi.org/10.1007/s00787-016-0903-9
  • Boldrini, M., Pace, L. D., Placidi, G. P. A., Keilp, J., Ellis, S. P., Signori, S., Placidi, G. F., & Cappa, S. F. (2005). Selective cognitive deficits in obsessive-compulsive disorder compared to panic disorder with agoraphobia. Acta Psychiatrica Scandinavica, 111(2), 150–158. https://doi.org/10.1111/j.1600-0447.2004.00247.x
  • Boyd, A., Golding, J., Macleod, J., Lawlor, D. A., Fraser, A., Henderson, J., Molloy, L., Ness, A., Ring, S., & Davey Smith, G. (2013). Cohort profile: The ‘children of the 90s’–the index offspring of the Avon Longitudinal Study of Parents and Children. International Journal of Epidemiology, 42(1), 111–127. https://doi.org/10.1093/ije/dys064
  • Braunstein, L. M., Gross, J. J., & Ochsner, K. N. (2017). Explicit and implicit emotion regulation: A multi-level framework. Social Cognitive and Affective Neuroscience, 12(10), 1545–1557. https://doi.org/10.1093/scan/nsx096
  • Brieant, A., King-Casas, B., & Kim-Spoon, J. (2020). Transactional relations between developmental trajectories of executive functioning and internalizing and externalizing symptomatology in adolescence. Development and Psychopathology, 1–12. https://doi.org/10.1017/S0954579420001054
  • Brophy, M., Taylor, E., & Hughes, C. (2002). To go or not to go: Inhibitory control in ‘hard to manage’ children. Infant and Child Development, 11(2), 125–140. https://doi.org/10.1002/icd.301
  • Carlson, S. M., & Wang, T. S. (2007). Inhibitory control and emotion regulation in preschool children. Cognitive Development, 22(4), 489–510. https://doi.org/10.1016/j.cogdev.2007.08.002
  • Case, R., Kurland, D. M., & Goldberg, J. (1982). Operational efficiency and the growth of short-term memory span. Journal of Experimental Child Psychology, 33(3), 386–404. https://doi.org/10.1016/0022-0965(82)90054-6
  • Casey, B. J., Heller, A. S., Gee, D. G., & Cohen, A. O. (2019). Development of the emotional brain. Neuroscience Letters, 693, 29–34. https://doi.org/10.1016/j.neulet.2017.11.055
  • Cassidy, A. R. (2016). Executive function and psychosocial adjustment in healthy children and adolescents: A latent variable modelling investigation. Child Neuropsychology, 22(3), 292–317. https://doi.org/10.1080/09297049.2014.994484
  • Cole, P. M., Usher, B. A., & Cargo, A. P. (1993). Cognitive risk and its association with risk for disruptive behaviour disorder in preschoolers. Jounral of Clinical and Child Psychology, 22(2), 154–164. https://doi.org/10.1207/s15374424jccp2202_3
  • Course-Choi, J., Saville, H., & Derakshan, N. (2017). The effects of adaptive working memory training and mindfulness meditation training on processing efficiency and worry in high worriers. Behaviour Research and Therapy, 89, 1–13. https://doi.org/10.1016/j.brat.2016.11.002
  • Crone, E. A., & Dahl, R. E. (2012). Understanding adolescence as a period of social–affective engagement and goal flexibility. Nature Reviews Neuroscience, 13(9), 636–650. https://doi.org/10.1038/nrn3313
  • Diamond, A. (2013). Executive functions. Annual Review of Psychology, 64(1), 135–168. https://doi.org/10.1146/annurev-psych-113011-143750
  • Donati, G., Meaburn, E. L., & Dumontheil, I. (2019). The specificity of associations between cognition and attainment in English, maths and science during adolescence. Learning and Individual Differences, 69, 84–93. https://doi.org/10.1016/j.lindif.2018.11.012
  • Eisenberg, N., Cumberland, A., Spinrad, T. L., Fabes, R. A., Shepard, S. A., Reiser, M., Murphy, B. C., Losoya, S. H., & Guthrie, I. K. (2001). The relations of regulation and emotionality to children’s externalizing and internalizing problem behavior. Child Development, 72(4), 1112–1134. https://doi.org/10.1111/1467-8624.00337
  • Eisenberg, N., & Fabes, R. A. (1992). Emotion, regulation, and the development of social competence. In M. S. Clark (Ed.), Review of personality and social psychology, Vol. 14. Emotion and social behavior (pp. 119–150). Sage Publications, Inc.
  • Eisenberg, N., & Spinrad, T. L. (2004). Emotion-related regulation: Sharpening the definition. Child Development, 334–339. https://doi.org/10.1111/j.1467-8624.2004.00674.x
  • Eisenberg, N., Valiente, C., Spinrad, T. L., Cumberland, A., Liew, J., Reiser, M., Zhou, Q., & Losoya, S. H. (2009). Longitudinal relations of children’s effortful control, impulsivity, and negative emotionality to their externalizing, internalizing, and co-occurring behavior problems. Developmental Psychology, 45(4), 988–1008. https://doi.org/10.1037/a0016213
  • Ford, T., Collishaw, S., Meltzer, H., & Goodman, R. (2007). A prospective study of childhood psychopathology: Independent predictors of change over three years. Social Psychiatry and Psychiatric Epidemiology, 42(12), 953–961. https://doi.org/10.1007/s00127-007-0272-2
  • Fox, N. A. (1994). Dynamic cerebral processes underlying emotion regulation. Monographs of the Society for Research in Child Development, 59(2/3), 152–166. https://doi.org/10.2307/1166143
  • Frank, D. W., Dewitt, M., Hudgens-Haney, M., Schaeffer, D. J., Ball, B. H., Schwarz, N. F., Hussein, A. A., Smart, L. M., & Sabatinelli, D. (2014). Emotion regulation: Quantitative meta-analysis of functional activation and deactivation. Neuroscience & Biobehavioral Reviews, 45, 202–211. https://doi.org/10.1016/j.neubiorev.2014.06.010
  • Friedman, N. P., & Miyake, A. (2017). Unity and Diversity of Executive Functions: individual differences as a window on cognitive structure. Cortex; a Journal Devoted to the Study of the Nervous System and Behavior, 86, 186–204. https://doi.org/10.1016/j.cortex.2016.04.023
  • Fuhrmann, D., Casey, C. S., Speekenbrink, M., & Blakemore, S.-J. (2019). Social exclusion affects working memory performance in young adolescent girls. Developmental Cognitive Neuroscience, 40, 100718. https://doi.org/10.1016/j.dcn.2019.100718
  • Funahashi, S., & Andreau, J. M. (2013). Prefrontal cortex and neural mechanisms of executive function. Journal of Physiology-Paris, 107(6), 471–482. https://doi.org/10.1016/j.jphysparis.2013.05.001
  • Giedd, J. N., Keshavan, M., & Paus, T. (2008). Why do many psychiatric disorders emerge during adolescence? Nature Reviews. Neuroscience, 9(12), 947–957. https://doi.org/10.1038/nrn2513
  • Gilliom, M., & Shaw, D. S. (2004). Codevelopment of externalizing and internalizing problems in early childhood. Development and Psychopathology, 16(02), https://doi.org/10.1017/S0954579404044530
  • Goddings, A.-L., Mills, K. L., Clasen, L. S., Giedd, J. N., Viner, R. M., & Blakemore, S.-J. (2014). The influence of puberty on subcortical brain development. NeuroImage, 88, 242–251. https://doi.org/10.1016/j.neuroimage.2013.09.073
  • Gogtay, N., Giedd, J. N., Lusk, L., Hayashi, K. M., Greenstein, D., Vaituzis, A. C., Nugent, T. F., Herman, D. H., Clasen, L. S., Toga, A. W., Rapoport, J. L., & Thompson, P. M. (2004). Dynamic mapping of human cortical development during childhood through early adulthood. Proceedings of the National Academy of Sciences of the United States of America, 101(21), 8174–8179. https://doi.org/10.1073/pnas.0402680101
  • Gohier, B., Ferracci, L., Surguladze, S. A., Lawrence, E., El Hage, W., Kefi, M. Z., Allain, P., Garre, J.-B., & Le Gall, D. (2009). Cognitive inhibition and working memory in unipolar depression. Journal of Affective Disorders, 116(1), 100–105. https://doi.org/10.1016/j.jad.2008.10.028
  • Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38(5), 581–586. https://doi.org/10.1111/j.1469-7610.1997.tb01545.x
  • Goodman, A., Lamping, D. L., & Ploubidis, G. B. (2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the strengths and difficulties questionnaire (SDQ): data from British parents, teachers and children. Journal of Abnormal Child Psychology, 38(8), 1179–1191. https://doi.org/10.1007/s10802-010-9434-x
  • Goodman, R., Meltzer, H., & Bailey, V. (1998). The strengths and difficulties questionnaire: A pilot study on the validity of the self-report version. Adolescent Psychiatry, 7(3), 6. https://doi.org/10.1007/s007870050057
  • Goschke, T. (2014). Dysfunctions of decision-making and cognitive control as transdiagnostic mechanisms of mental disorders: Advances, gaps, and needs in current research: Dysfunctions of decision-making and cognitive control. International Journal of Methods in Psychiatric Research, 23(S1), 41–57. https://doi.org/10.1002/mpr.1410
  • Hare, T. A., Tottenham, N., Galvan, A., Voss, H. U., Glover, G. H., & Casey, B. J. (2008). Biological substrates of emotional reactivity and regulation in adolescence during an emotional go-nogo task. Biological Psychiatry, 63(10), 927–934. https://doi.org/10.1016/j.biopsych.2008.03.015015
  • Hartung, J., Engelhardt, L. E., Thibodeaux, M. L., Harden, K. P., & Tucker-Drob, E. M. (2020). Developmental transformations in the structure of executive functions. Journal of Experimental Child Psychology, 189, 104681. https://doi.org/10.1016/j.jecp.2019.104681
  • Harvey, P. O., Le Bastard, G., Pochon, J. B., Levy, R., Allilaire, J. F., Dubois, B., & Fossati, P. (2004). Executive functions and updating of the contents of working memory in unipolar depression. Journal of Psychiatric Research, 38(6), 567–576. https://doi.org/10.1016/j.jpsychires.2004.03.003
  • Hedge, C., Powell, G., & Sumner, P. (2018). The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behavior Research Methods, 50(3), 1166–1186. https://doi.org/10.3758/s13428-017-0935-1
  • Hilt, L. M., Leitzke, B. T., & Pollak, S. D. (2014). Cognitive control and rumination in youth: The importance of emotion. Journal of Experimental Psychopathology, 5(3), 302–313. https://doi.org/10.5127/jep.038113
  • Hotton, M., Derakshan, N., & Fox, E. (2018). A randomised controlled trial investigating the benefits of adaptive working memory training for working memory capacity and attentional control in high worriers. Behaviour Research and Therapy, 100, 67–77. https://doi.org/10.1016/j.brat.2017.10.011
  • Hughes, C., & Ensor, R. (2011). Individual differences in growth in executive function across the transition to school predict externalizing and internalizing behaviors and self-perceived academic success at 6 years of age. Journal of Experimental Child Psychology, 108(3), 663–676. https://doi.org/10.1016/j.jecp.2010.06.005
  • Huizinga, M., Dolan, C. V., & van der Molen, M. W. (2006). Age-related change in executive function: Developmental trends and a latent variable analysis. Neuropsychologia, 44(11), 2017–2036. https://doi.org/10.1016/j.neuropsychologia.2006.01.010
  • Joormann, J., Yoon, K. L., & Zetsche, U. (2007). Cognitive inhibition in depression. Applied and Preventive Psychology, 12(3), 128–139. https://doi.org/10.1016/j.appsy.2007.09.002
  • Jurado, M. B., & Rosselli, M. (2007). The elusive nature of executive functions: A review of our current understanding. Neuropsychology Review, 17(3), 213–233. https://doi.org/10.1007/s11065-007-9040-z
  • Karr, J. E., Areshenkoff, C. N., Rast, P., Hofer, S. M., Iverson, G. L., & Garcia-Barrera, M. A. (2018). The unity and diversity of executive functions: A systematic review and re-analysis of latent variable studies. Psychological Bulletin, 144(11), 1147–1185. https://doi.org/10.1037/bul0000160
  • Kim, M. J., Loucks, R. A., Palmer, A. L., Brown, A. C., Solomon, K. M., Marchante, A. N., & Whalen, P. J. (2011). The structural and functional connectivity of the amygdala: From normal emotion to pathological anxiety. Behavioural Brain Research, 223(2), 403–410. https://doi.org/10.1016/j.bbr.2011.04.025
  • Kim, M. J., & Whalen, P. J. (2009). The structural integrity of an amygdala-prefrontal pathway predicts trait anxiety. Journal of Neuroscience, 29(37), 11614–11618. https://doi.org/10.1523/JNEUROSCI.2335-09.2009
  • Kopf, J., Dresler, T., Reicherts, P., Herrmann, M., & Reif, A. (2013). The effect of emotional content on brain activation and the late positive potential in a word n-back task. PLOS ONE, 8(9), 9. https://doi.org/10.1371/journal.pone.0075598
  • Lee, K., Bull, R., & Ho, R. M. H. (2013). Developmental changes in executive functioning. Child Development, 84(6), 1933–1953. https://doi.org/10.1111/cdev.12096
  • Lee, H., Heller, A. S., van Reekum, C. M., Nelson, B., & Davidson, R. J. (2012). Amygdala–prefrontal coupling underlies individual differences in emotion regulation. NeuroImage, 62(3), 1575–1581. https://doi.org/10.1016/j.neuroimage.2012.05.044
  • Lehto, J. E., Juujärvi, P., Kooistra, L., & Pulkkinen, L. (2003). Dimensions of executive functioning: Evidence from children. British Journal of Developmental Psychology, 21(1), 59–80. https://doi.org/10.1348/026151003321164627
  • Li, C. R., Milivojevic, V., Kemp, K., Hong, K., & Sinha, R. (2006). Performance monitoring and stop signal inhibition in abstinent patients with cocaine dependence. Drug and Alcohol Dependence, 85(3), 205–212. https://doi.org/10.1016/j.drugalcdep.2006.04.008
  • Logan, G. D., & Cowan, W. B. (1984). On the ability to inhibit thought and action: A theory of an act of control. Psychological Review, 91(3), 295. https://doi.org/10.1037/0033-295X.91.3.295
  • Malagoli, C., & Usai, M. C. (2018). The effects of gender and age on inhibition and working memory organization in 14- to 19-year-old adolescents and young adults. Cognitive Development, 45, 10–23. https://doi.org/10.1016/j.cogdev.2017.10.005
  • Matthews, K., Coghill, D., & Rhodes, S. (2008). Neuropsychological functioning in depressed adolescent girls. Journal of Affective Disorders, 111(1), 113–118. https://doi.org/10.1016/j.jad.2008.02.003
  • Mills, K. L., Goddings, A.-L., Clasen, L. S., Giedd, J. N., & Blakemore, S.-J. (2014). The developmental mismatch in structural brain maturation during adolescence. Developmental Neuroscience, 36(3–4), 147–160. https://doi.org/10.1159/000362328
  • Mills, K. L., Goddings, A.-L., Herting, M. M., Meuwese, R., Blakemore, S.-J., Crone, E. A., Dahl, R. E., Güroğlu, B., Raznahan, A., Sowell, E. R., & Tamnes, C. K. (2016). Structural brain development between childhood and adulthood: Convergence across four longitudinal samples. NeuroImage, 141, 273–281. https://doi.org/10.1016/j.neuroimage.2016.07.044
  • Miyake, A., & Friedman, N. P. (2012). The nature and organization of individual differences in executive functions: Four general conclusions. Current Directions in Psychological Science, 21(1), 8–14. https://doi.org/10.1177/0963721411429458
  • Miyake, A., Friedman, N. P., Emerson, M. J., Witzki, A. H., Howerter, A., & Wager, T. D. (2000). The unity and Diversity of executive functions and their contributions to complex “frontal lobe” tasks: A latent variable analysis. Cognitive Psychology, 41(1), 49–100. https://doi.org/10.1006/cogp.1999.0734
  • Nigg, J. T. (2000). On inhibition/disinhibition in developmental psychopathology: Views from cognitive and personality psychology and a working inhibition taxonomy. Psychological Bulletin, 126(2), 220–246. https://doi.org/10.1037/0033-2909.126.2.220
  • Nigg, J. T., Quamma, J. P., Greenberg, M. T., & Kusche, C. A. (1999). A two-year longitudinal study of neuropsychological and cognitive performance in relation to behavioral problems and competencies in elementary school children. Journal of Abnormal Child Psychology; New York, 27(1), 51–63. https://doi.org/10.1023/A:1022614407893
  • Ochsner, K. N., & Gross, J. J. (2008). Cognitive emotion regulation. Insights from social cognitive and affective neuroscience. Current Directions in Psychological Science, 17(2), 153–158. https://doi.org/10.1111/j.1467-8721.2008.00566.x
  • Ochsner, K. N., Silvers, J. A., & Buhle, J. T. (2012). Functional imaging studies of emotion regulation: A synthetic review and evolving model of the cognitive control of emotion. Annals of the New York Academy of Sciences, 1251(1), E1–24. https://doi.org/10.1111/j.1749-6632.2012.06751.x
  • Ogilvie, J. M., Stewart, A. L., Chan, R. C. K., & Shum, D. H. K. (2011). Neuropsychological measures of executive function and antisocial behavior: A meta-analysis*. Criminology; An interdisciplinary Journal, 49(4), 1063–1107. https://doi.org/10.1111/j.1745-9125.2011.00252.x
  • Posner, M. I., & Rothbart, M. (2000). Developing mechanisms of self-regulation. Development and Psychopathology, 12(3), 427–441. https://doi.org/10.1017/S0954579400003096
  • Prencipe, A., Kesek, A., Cohen, J., Lamm, C., Lewis, M. D., & Zelazo, P. D. (2011). Development of hot and cool executive function during the transition to adolescence. Journal of Experimental Child Psychology, 108(3), 621–637. https://doi.org/10.1016/j.jecp.2010.09.008
  • Rapee, R. M., Oar, E. L., Johnco, C. J., Forbes, M. K., Fardouly, J., Magson, N. R., & Richardson, C. E. (2019). Adolescent development and risk for the onset of social-emotional disorders: A review and conceptual model. Behaviour Research and Therapy, 103501. https://doi.org/10.1016/j.brat.2019.103501
  • R Core Team. (2013). R: A language and environment for statistical computing. R Foundation for Statistical Computing.
  • Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 2(48), 1–36. https://doi.org/10.18637/jss.v048.i02
  • Sari, B. A., Koster, E. H. W., Pourtois, G., & Derakshan, N. (2016). Training working memory to improve attentional control in anxiety: A proof-of-principle study using behavioral and electrophysiological measures. Biological Psychology, 121, 203–212. https://doi.org/10.1016/j.biopsycho.2015.09.008
  • Schweizer, S., Grahn, J., Hampshire, A., Mobbs, D., & Dalgleish, T. (2013). Training the emotional brain: Improving affective control through emotional working memory training. Journal of Neuroscience, 33(12), 5301–5311. https://doi.org/10.1523/JNEUROSCI.2593-12.2013
  • Séguin, J. R., Boulerice, B., Harden, P. W., Tremblay, R. E., & Pihl, R. O. (1999). Executive functions and physical aggression after controlling for attention deficit hyperactivity disorder, general memory, and IQ. The Journal of Child Psychology and Psychiatry and Allied Disciplines, 40(8), 1197–1208. https://doi.org/10.1111/1469-7610.00536
  • Snyder, H. R., Miyake, A., & Hankin, B. L. (2015). Advancing understanding of executive function impairments and psychopathology: Bridging the gap between clinical and cognitive approaches. Frontiers in Psychology, 6. https://doi.org/10.3389/fpsyg.2015.00328
  • Song, S., Zilverstand, A., Song, H., d’Oleire Uquillas, F., Wang, Y., Xie, C., Cheng, L., & Zou, Z. (2017). The influence of emotional interference on cognitive control: A meta-analysis of neuroimaging studies using the emotional Stroop task. Scientific Reports, 7(1), 2088. https://doi.org/10.1038/s41598-017-02266-2
  • Steinberg, L., Icenogle, G., Shulman, E. P., Breiner, K., Chein, J., Bacchini, D., Chang, L., Chaudhary, N., Giunta, L. D., Dodge, K. A., Fanti, K. A., Lansford, J. E., Malone, P. S., Oburu, P., Pastorelli, C., Skinner, A. T., Sorbring, E., Tapanya, S., Tirado, L. M. U., … Takash, H. M. S. (2018). Around the world, adolescence is a time of heightened sensation seeking and immature self-regulation. Developmental Science, 21(2), e12532. https://doi.org/10.1111/desc.12532
  • Thorell, L. B., Bohlin, G., & Rydell, A. (2004). Two types of inhibitory control: Predictive relations to social functioning. International Journal of Behavioral Development, 193–203. https://doi.org/10.1080/01650250344000389
  • White, L. K., McDermott, J. M., Degnan, K. A., Henderson, H. A., & Fox, N. A. (2011). Behavioral inhibition and anxiety: The moderating roles of inhibitory control and attention shifting. Journal of Abnormal Child Psychology, 39(5), 735–747. https://doi.org/10.1007/s10802-011-9490-x
  • Whitmer, A. J., & Banich, M. T. (2007). Inhibition versus switching deficits in different forms of rumination. Psychological Science, 18(6), 546–553. https://doi.org/10.1111/j.1467-9280.2007.01936.x
  • Wiebe, S. A., Espy, K. A., & Charak, D. (2008). Using confirmatory factor analysis to understand executive control in preschool children: I. Latent structure. Developmental Psychology, 44(2), 575. https://doi.org/10.1037/0012-1649.44.2.575
  • Wiebe, S. A., Sheffield, T., Nelson, J. M., Clark, C. A. C., Chevalier, N., & Espy, K. A. (2011). The structure of executive function in 3-year-old children. Journal of Experimental Child Psychology, 108(3), 436–452. https://doi.org/10.1016/j.jecp.2010.08.008
  • Young, S. E., Friedman, N. P., Miyake, A., Willcutt, E. G., Corley, R. P., Haberstick, B. C., & Hewitt, J. K. (2009). Behavioral disinhibition: Liability for externalizing spectrum disorders and its genetic and environmental relation to response inhibition across adolescence. Journal of Abnormal Psychology, 118(1), 117–130. https://doi.org/10.1037/a0014657
  • Zelazo, P. D., & Carlson, S. M. (2012). Hot and cool executive function in childhood and adolescence: Development and plasticity. Child Development Perspectives, 6(4), 354–360. https://doi.org/10.1111/j.1750-8606.2012.00246.x
  • Zelazo, P. D., & Cunningham, W. (2007). Executive function: Mechanisms underlying emotion regulation. In J. J. Gross (Ed.), Handbook of emotion regulation (pp. 135–158). Guilford.
  • Zhou, D., Lebel, C., Treit, S., Evans, A., & Beaulieu, C. (2015). Accelerated longitudinal cortical thinning in adolescence. NeuroImage, 104, 138–145. https://doi.org/10.1016/j.neuroimage.2014.10.005
  • Ziermans, T., Dumontheil, I., Roggeman, C., Peyrard-Janvid, M., Matsson, H., Kere, J., & Klingberg, T. (2012). Working memory brain activity and capacity link MAOA polymorphism to aggressive behavior during development. Translational Psychiatry, 2(2), e85. https://doi.org/10.1038/tp.2012.7