Publication Cover
Child Neuropsychology
A Journal on Normal and Abnormal Development in Childhood and Adolescence
Volume 29, 2023 - Issue 2
4,638
Views
0
CrossRef citations to date
0
Altmetric
Research Article

The significance of nonverbal performance in children with developmental language disorder

, &
Pages 213-234 | Received 22 Sep 2021, Accepted 10 May 2022, Published online: 20 May 2022

ABSTRACT

Nonverbal deficits are frequently reported in children with developmental language disorder (DLD). In the new diagnostic criteria of DLD, the previous requirement of normal nonverbal performance has been removed and children with below average and even weak nonverbal skills now fit under the DLD definition. However, the significance of the nonverbal cognitive level, and the connection between nonverbal and verbal skills in these children diagnosed according to the new DLD classification is unclear. In the present study, the significance of nonverbal cognitive level on verbal performance was investigated among preschool-aged children with remarkable deficits in language development. Verbal skills were compared between average, below average, and weak nonverbal cognitive level groups. The connection between nonverbal and verbal skills was evaluated with Pearson correlations, and the covariance structure of the subtests used was modeled with Structural Modelling. The connection between nonverbal cognitive level and verbal skills was clear; weaker nonverbal cognitive levels were associated with lower verbal skills. While receptive language skills and verbal short-term-memory (STM) were the most profound weaknesses, relative strengths emerged for each nonverbal cognitive level group in fluid intelligence, especially in nonverbal reasoning tasks without time limits. In addition, fluid intelligence was strongly linked to verbal understanding and reasoning. These results suggest that the relative strength in nonverbal fluid intelligence with specific weaknesses in receptive language, verbal understanding, and verbal STM could be used as basic factors differentiating children with DLD from those with intellectual disability.

Introduction

Changes in the diagnostic criteria of Developmental Language Disorder (DLD)

The definition and diagnostic criteria of DLD, previously known as Specific Language Impairment (SLI), have been changed in the new diagnostic classifications. The focus of the DSM-5 (Diagnostic and Statistical Manual of Mental Disorders, DSM-5, American Psychiatric Association, Citation2013) and the ICD-11 (International Statistical Classification of Diseases and Related Health Problems, ICD-11, World Health Organization [WHO], Citation2018) DLD definitions is on the verbal criteria, namely language acquisition and the use of language across modalities. The previous requirement of normal nonverbal level is no longer considered relevant for the DLD diagnosis due to concerns of excluding those with developmental language problems combined with other neurocognitive deficits from speech and language therapy (Bishop, Citation2014; Messer & Dockrell, Citation2006; Norbury et al., Citation2016). The multinational and multidisciplinary Delphi Consensus Study panel CATALISE (Bishop et al., Citation2016) recommended DLD to be identified regardless of the level of nonverbal ability. The additional neurocognitive difficulties (e.g., attentional, social, or behavioral problems) should be documented and considered when planning intervention strategies (Bishop et al., Citation2016). However, when associated with a known biomedical condition, such as neurological disease, intellectual disability, or hearing loss, the diagnosis should be DLD associated with the co-occurring condition (Bishop et al., Citation2016).

Nonverbal performance in children with DLD

Another reason why normal nonverbal skills are not considered critical in the new DLD definitions is that children with DLD have on average significantly lower Performance Intelligence Quotient (PIQ) values than children with typical development (TD; see the meta-analysis of Gallinat & Spaulding, Citation2014). Nonverbal skills also appear to depend on the subtype of DLD (Reham & Hassnaa, Citation2020; Saar et al., Citation2018) and to occasionally progress to a significant decline in school-aged children originally diagnosed with DLD (Botting, Citation2005; Stothard et al., Citation1998). In our previous study (Saar et al., Citation2018), nonverbal cognitive performance of children aged 4 to 6 years diagnosed with DLD was significantly lower than the normal age level. In addition, children with more widespread and severe language comprehension difficulties had significantly lower nonverbal cognitive skills than those with mainly expressive language difficulties.

The deficits and possible decline of nonverbal performance in children with DLD have been explained by a complex and dynamic relationship of verbal and nonverbal development (Botting, Citation2005). On the other hand, Ullman and Pierpont (Citation2005) proposed that disturbed development of brain structures and neural networks can cause disorders in both linguistic and non-linguistic functions. Similarly, Karmiloff-Smith (Citation2007) suggested an early local disorder to cause atypical development in several parts of the brain and to interfere with specialization and localization of brain functions.

Though nonverbal impairments are evident in children with DLD, they may be inconsistent (DeThorne & Watkins, Citation2006) and do not concern all children. Conti-Ramsden et al. (Citation2012) reported one third of children with DLD to have a deceleration of nonverbal development over time. Visuospatial memory deficits also concern a minority of children diagnosed with DLD (Archibald & Gathercole, Citation2006; Vugs et al., Citation2013).

In a retrospective study of children diagnosed with varying developmental delays at age 3 to 7 years, Liao et al. (Citation2014) grouped the participants according to language skills (DLD, below average language development, and normal language development). The PIQ was significantly lower in the two groups with below normal language development than in the group with normal language development. However, in all three groups, nonverbal performance was significantly better than verbal performance.

The nature of the relationship between verbal and nonverbal cognitive skills is not clear in children with DLD or with more widespread cognitive deficits, such as mixed specific developmental disorder (ICD-10 definition for children with a mixture of specific developmental disorders of speech and language, motor function, and scholastic skills, but in which none predominates sufficiently to constitute the main diagnosis) or borderline intellectual functioning (BIF, ICD-10 definition for children with full IQ level between 71–84, (WHO, Citation2018). In the new diagnostic criteria, these diagnostic groups fit under the DLD definition. However, measures and analyses of verbal and nonverbal functions in children with DLD and more widespread neurocognitive developmental disorders are commonly based on assessments that focus on specific and often narrow aspects of cognitive functions, and the tests used may have different psychometric properties (DeThorne & Schaefer, Citation2004; Gallinat & Spaulding, Citation2014; Miller & Gilbert, Citation2008). Typically, while only PIQ is used to define the level of nonverbal performance, the subtest profiles are mostly not described.

Pulina et al. (Citation2019) compared cognitive performance of children with BIF to children with TD. They found all WISC-IV indices of children with BIF to be significantly lower than those in children with TD. However, the index profile of children with BIF was uneven with specific weakness in Working Memory (WM) and highest scores in visuo-perceptual performance, regardless of any additional neurodevelopmental disorders such as ADHD or specific learning disorders. In addition to WM deficits shown in several previous studies (Alloway, Citation2010; Fernell & Gillberg, Citation2020; Gillam et al., Citation2021; Pulina et al., Citation2019; Santegoeds et al., Citation2021; Träff & Östergren, Citation2021) problems with executive functions (Alloway, Citation2010; Erostarbe-Pérez et al., Citation2022, Fernell & Gillberg, Citation2020; Träff & Östergren, Citation2021), processing speed (Santegoeds et al., Citation2021; Träff & Östergren, Citation2021), and adaptive skills (Greenspan, Citation2017; Pulina et al., Citation2019) are evident in children with BIF. In the longitudinal study of Träff and Östergren (Citation2021), children with BIF received lower scores than children with TD in all cognitive and academic tasks but exhibited similar developmental growth and trends as children with TD, supporting a developmental delay model opposed to an atypical developmental model.

While cognitive skills can be expressed both verbally and nonverbally, robust correlations between verbal and nonverbal scores in children with DLD have been shown in some studies (Durant et al., Citation2019; Liao et al., Citation2014; Plym et al., Citation2021; Saar et al., Citation2018). To our knowledge, this has not been observed in children with mixed specific developmental disorders or BIF.

Aim of the study

While there is considerable evidence showing weaker nonverbal skills in children with DLD than in children with TD (e.g., Gallinat & Spaulding, Citation2014; Liao et al., Citation2014; McGregor et al., Citation2013; Stothard et al., Citation1998), nonverbal deficits do not concern all children with DLD (Archibald & Gathercole, Citation2006; Botting, Citation2005; Conti-Ramsden et al. (Citation2012) and the DLD group is not homogeneous (Reham & Hassnaa, Citation2020; Saar et al., Citation2018). In addition, research on the cognitive performance of children with DLD has mainly been performed from narrow perspectives, and with composite scores (Gallinat & Spaulding, Citation2014). In the new diagnostic criteria of DLD, the previously used PIQ limit is no longer required and thus children previously diagnosed with more widespread cognitive deficits (such as mixed specific developmental problems or BIF) now fit in the DLD diagnostic category and were included in this study. To our knowledge, there are only a few studies where cognitive subtest profiles of these diagnostic groups have been evaluated (Durant et al., Citation2019; Peltopuro et al., Citation2014; Saar et al., Citation2018) and none where cognitive index or subtest profiles of these diagnostic groups have been directly compared.

The aim of the present study was to evaluate the significance of nonverbal performance level on cognitive subtest profiles and to examine the connections between nonverbal and verbal skills in children with DLD, now also including children with more widespread cognitive deficits. Based on previous findings in children with DLD (Gallinat & Spaulding, Citation2014; Liao et al., Citation2014; Saar et al., Citation2018), we assumed that children with more severe problems in nonverbal performance and reasoning skills would also exhibit more severe problems in verbal performance and reasoning. To study this, we first divided the participants into PIQ-level groups and evaluated the cognitive subtest profile differences between these groups. Secondly, we presumed a robust correlation between verbal and nonverbal performance in children with DLD. To further study the connection of verbal and nonverbal functions in children with DLD, a two-factor structure of the test variables was examined using Structural Methodology (SEM; Kline, Citation2015; Schumaker & Lomax, Citation2016).

Data and methods

Test materials and participants

The neuropsychological test materials used in this study were collected from the archived neuropsychological test records of 155 monolingual Finnish-speaking children (117 boys and 38 girls aged 4.0 to 6.9 years; 68 children were aged 4 years, 46 were aged 5 years old, and 20 were aged 6 years). Mean age was 5.3 years.

The participants of the present study had been admitted, assessed, and diagnosed with DLD or with mixed specific developmental disorders by a multidisciplinary team at Helsinki University Hospital Phoniatric Outpatient Clinic in 2010–2013 following the Finnish Current Care Guidelines based on the ICD-10 classification (World Health Organization [WHO], Citation2018). The exclusive PIQ limit of 70 is suggested for DLD diagnosis in the ICD-10. In the Finnish Current Care Guidelines, a diagnosis “mixed specific developmental disorder” is recommended for children who have DLD associated with PIQ values 70–84. In the present study, we included all children diagnosed with language problems (i.e., standard scores 1.5 SD below the age mean). However, the individual verbal subtest scores of these children varied considerably. Most of our participants had PIQ values ≥85 and received DLD diagnosis. Those with PIQ values <85 and some with PIQ values <70 but with significantly uneven nonverbal subtest profiles were diagnosed with mixed specific developmental disorders ().

Table 1. Diagnoses and number of participants in each PIQ group.

A phoniatric examination and assessments by a neuropsychologist and a speech-and-language therapist were performed over several appointments on different days. The tests used were chosen by these professional clinicians and were based on the age and symptoms of each child. Results of the logopedic and phoniatric evaluations that were part of the diagnostic process are not included here. Only the archived WPPSI-III (Wechsler Intelligence Scale for Children – Third edition; Finnish version, Wechsler, Citation2009) and NEPSY-II (Children’s Neuropsychological Research, Korkman et al., Citation2008) test records from the neuropsychological evaluation were used in the present study. Although the present study did not include data from an age-matched TD group, using subtest standard scores based on the normative data of the Finnish WPPSI-III and NEPSY-II tests allowed some comparison between children with DLD and TD. The data were partly used in our previous study (Saar et al., Citation2018). However, the present sample, research design, and analyses have not been published before.

The present data contains values of 155 subjects, in 16 test variables for all WPPSI-III subtests, and the NEPSY-II subtests Comprehension of Instructions and Sentence Repetition. We chose to use standard scores of the subtests instead of the raw scores due to the lack of children with TD in the present study and to be able to compare the scores of the children with DLD to the normative scores in the Finnish version of the WPPSI-III test. The material included missing values (21.1%) as the subtests administered to each participant were chosen purely for clinical purposes. Missingness cumulated in three WISC-III subtests (Comprehension, Similarities, and Symbol Search). Three subjects had more than 50% of their scores missing. The median missingness was 25%. Since Little’s test (Little & Rubin, Citation2002; Little, Citation1988) did not discard the hypothesis of CMAR (Completely Missing At Random; χ2 = 925.27, df = 886, p = 0.175), all 16 variables and 155 subjects were retained in the analyses. Missingness was addressed with Multiple Imputation (MI) using Bayesian technique (Asparouhov & Muthén, Citation2020; Rubin, Citation1987; Schafer, Citation1997). The imputed data were used in all analyses.

PIQ level groups

To evaluate the impact of nonverbal performance level on verbal skills, we first divided the participants into the following three groups based on their PIQ values that were calculated following WPPSI-III instructions using nonverbal subtests Block Design (estimates the ability to analyze and synthesize visual stimuli with two-colored blocks), Matrix Reasoning (estimates analogical and serial reasoning), and Picture Concepts (estimates abstract categorical reasoning): Group 1 (PIQ >84), Group 2 (PIQ 70–84) corresponding to the Finnish Current Care Guidelines PIQ limits separating DLD from mixed specific developmental disorders, and Group 3 (PIQ <70) corresponding to the ICD-10 PIQ limit separating DLD from more widespread developmental delays.

Group sizes of DLD children with average (Group 1) compared to below average (Group 2) and weak (Group 3) nonverbal performance were not balanced (see ), which in statistical analyses across all DLD groups caused a bias toward the average nonverbal performance Group.

Statistical methods

Within each PIQ group, mean values for all WPPSI-III verbal subtests were calculated. These were Information (estimates general knowledge and memory), Vocabulary (estimates word knowledge, concept formation and verbal fluency), Word Reasoning (estimates verbal abstract reasoning and concept formation), Comprehension (estimates social knowledge and verbal reasoning), Similarities (estimates logical thinking and verbal reasoning), and for General Language Index (GLI) subtests Receptive Vocabulary (estimates the ability to find correct responses to spoken words) and Picture Naming (estimates expressive language and word finding skills). The mean values were also calculated for the two NEPSY-II verbal subtests Comprehension of Instructions (estimates the ability to receive, process and give a correct response to verbal instructions) and Sentence Repetition (estimates verbal STM). In addition to the subtests included in the PIQ index, mean values were calculated for nonverbal subtests Picture Completion (estimates perceptual reasoning), Object Assembly (estimates visual-perceptual organization and part-whole relationship), and for the two Processing Speed index subtests Coding (measures speed and accuracy on paper and pencil task) and Symbol Search (estimates perception, recognition, and speed). The significance of the differences between the three PIQ groups were estimated for each verbal and nonverbal subtest using One-way ANOVA. η2 was used as a scale-free measure of the effect size in these analyses.

Further, to evaluate connections between nonverbal and verbal functions, we calculated a Pearson correlation between PIQ and VIQ indices. VIQ was determined following WPPSI-III instructions using verbal subtests Information, Vocabulary, and Word Reasoning. In addition, Pearson correlations between verbal subtests and PIQ and between nonverbal subtests and VIQ were estimated.

Finally, to analyze the similarity of covariances in the different PIQ-levels, to evaluate the measurement invariance (MI), and to summarize and elaborate the correlational results in a two-factor two-group model, we approached the test covariance matrix (16 x 16) using (SEM) techniques in the form of Multi-Group Confirmatory Factor Analysis (Kline, Citation2015; Schumaker & Lomax, Citation2016). The main advantages of using SEM techniques over traditional, exploratory multivariate techniques are explicit modeling of measurement errors; estimation of latent (unobserved) variables via observed variables; and comprehensive model testing where a structure can be imposed and assessed as to fit of the data (Smelser & Baltes, Citation2001). We assumed the 16 subtests to form two measurement models (i.e., latent P [nonverbal performance] and V [verbal] factors), which were free to correlate.

These two measurement models were subjected to SEM congeneric factor analysis to examine the unidimensionality hypothesis. Then the latent P and V factors were analyzed separately and together under progressively demanding constraints (factor loadings, intercepts, error correlations). The nested SEM models (configural, metric, and scale MI) were performed applying multiple imputed (10 times) two-group procedures. This is a standard procedure in modern evaluation of psychological measurements (Millsap, Citation2011; Van de Schoot et al., Citation2012, Xu & Traceya, Citation2017). In this analysis, PIQ groups 2 and 3 were merged to PIQ2 + 3 group due to statistical reasons (see ).

All SEM analyses were performed using Mplus 8 program with multiply imputed matrices. The parameters of the model were estimated using maximum likelihood (ML) estimation (Muthen & Muthen, Citation1998–2017).

Results

Effects of the PIQ level on cognitive performance in children with DLD

While the PIQ groups were based on the level of their nonverbal skills, all verbal and Processing Speed subtest values were systematically highest for PIQ group 1 and lowest for PIQ group 3 (see and ). However, the cognitive subtest profiles of the PIQ–level groups had parallel strengths and weaknesses. also shows the cognitive subtest profile of the combined DLD group, which closely matches those of PIQ groups 1 and 2. Similar weaknesses in the subtest profiles in all PIQ–level groups and the combined DLD group were seen in subtests Word Reasoning, Comprehension, and Sentence Repetition, with relative strengths in nonverbal subtests Matrix Reasoning and Picture Concepts and in Processing Speed subtest.

Figure 1. Disclosure provided: Verbal and nonverbal subtest profiles in PIQ groups 1 (PIQ>84), 2 (PIQ=70–84), and 3 (PIQ<70). Verbal subtests: IN=Information, VC=Vocabulary, WR=Word Reasoning, CO=Comprehension, SI=Similarities, CI=Comprehension of Instructions, and SR=Sentence Repetition. Nonverbal subtest: BD=Block Design, MR=Matrix Reasoning, PCn=Picture Concepts, PCm=Picture Completion, OA=Object Assembly, CD=Coding, and SS=Symbol Search.

Figure 1. Disclosure provided: Verbal and nonverbal subtest profiles in PIQ groups 1 (PIQ>84), 2 (PIQ=70–84), and 3 (PIQ<70). Verbal subtests: IN=Information, VC=Vocabulary, WR=Word Reasoning, CO=Comprehension, SI=Similarities, CI=Comprehension of Instructions, and SR=Sentence Repetition. Nonverbal subtest: BD=Block Design, MR=Matrix Reasoning, PCn=Picture Concepts, PCm=Picture Completion, OA=Object Assembly, CD=Coding, and SS=Symbol Search.

Table 2. Verbal subtest mean values in the three PIQ level groups and the total DLD group.

Table 3. Nonverbal subtest mean values in the three PIQ level groups and the total DLD group.

For the verbal subtests, the effect of PIQ level was large on Similarities (F(2,154) = 13.62, p < .001 ; η2 = .150) and Receptive Vocabulary (F(2,154) = 13.56, p < .001 ; η2 = .151); medium on Information (F(2,154) = 9.29, p < .001 ; η2 = .109), Vocabulary (F(2,154) = 8.75, p < .001 ; η2 = .103), Word Reasoning (F(2,154) = 6.470, p = .003 ; η2 = .078), and Comprehension of Instructions (F(2,154) = 7.23, p < .001 ; η2 = .087); and small on Comprehension (F(2,154) = 4.70, p = .030 ; η2 = .058), Picture Naming (F(2,154) = 1.87, p = .174 ; η2 = .024), and Sentence Repetition (F(2,154) = 4.63, p = .026 ; η2 = .057). Bonferroni post hoc tests revealed that all verbal subtests except Picture Naming differed significantly between PIQ groups 1 and 3. However, significant differences between PIQ groups 1 and 2 were only found in subtests Comprehension of Instructions and Receptive Vocabulary. In addition, significant differences between PIQ groups 2 and 3 occurred in subtests Information, Vocabulary, Similarities, and Receptive Vocabulary.

The effect of PIQ level was naturally significant and large on the following three PIQ index subtests: Block Design (F(2,154) = 75.98, p < .001 ; η2 = .500), Matrix Reasoning (F(2, 154) = 50.08, p < .001 ; η2 = .397), and Picture Concepts (F(2,154) = 48.48, p < .001 ; η2 = 0.389). However, a significant and large effect was also seen on Picture Completion (F(2,85) = 12.67, p < .001 ; η2 = .142), Object Assembly (F(2,154) = 18.15, p < .001 ; η2 = .142), and the two Processing Speed subtests Coding (F(2,154) = 17.83, p < .001 ; η2 = .190) and Symbol Search (F(2, 154) = 15.55, p = .004 ; η2 = .163). Bonferroni post hoc tests revealed that while the differences between PIQ groups 1 and 3 were significant in all nonverbal subtests, the difference between PIQ groups 1 and 2 was not significant in subtests Object Assembly and Symbol Search. The difference between PIQ groups 2 and 3 was not significant in Picture Completion and the two Processing Speed subtests.

Correlations between verbal and nonverbal indices and subtests

The correlation between PIQ and VIQ indices in the combined DLD group (see ) was significant and moderate (r = .368, p < .001 , n = 155). Verbal subtests tended to have positively skewed distributions while nonverbal subtests had fairly symmetric distributions. However, the scatterplot matrix with linear and nonlinear Locally Weighted Scatterplot Smoothing (lowess) lines showed that acceptable linearity was maintained in the correlations.

Figure 2. Scatter plot between VIQ and PIQ in three PIQ level groups.

Figure 2. Scatter plot between VIQ and PIQ in three PIQ level groups.

All the following verbal subtests had significant correlations to PIQ: Receptive Vocabulary (r = .416, p < .001), Comprehension of Instructions (r = .386, p < .001), Similarities (r = .378, p < .001), Information (r = 0.341, p < .001), Word Reasoning (r = .338, p < .001), Vocabulary (r = .297, p < .001), Sentence Repetition (r = .253, p = .003), Comprehension (r = .229, p = .030), and Picture Naming (r = .208, p = 0.012). In addition, the correlation between VIQ and the following other nonverbal subtests except Block Design (r = .126, p = .121) was significant: Symbol Search (r = .437, p = .005), Picture Concepts (r = .413, p < .001), Coding (r = 0.357, p < .001), Picture Completion (r = .333, p < .001), Object Assembly (r = .270, p = .016), and Matrix Reasoning (r = .275, p < .001).

Structural equation modelling

Results of the initial SEM analyses showed that covariance matrices of the V (9 x 9) and P (7 x 7) variables were equal across PIQ1 and PIQ2 + 3 groups. The total sample covariance matrices (16 x 16) across these groups could not be compared due to an excessively large df/N -ratio (see , rows 1–3). rows 4–9 contain one-factor (i.e., V and P factors separately) models of the combined DLD sample and PIQ1 and PIQ2 + 3 groups, which all showed good fit to the data.

Table 4. SEM analysis. Chi-square, df, p, RMSEA (Root Mean Square Error of Approximation), CFI (Comparative Fix Index), and TLI (Tucker-Lewis Index)..

The nested models of the measurement invariance (i.e., V and P factors together) are presented in , (rows 10–17). The fit values showed that the model of configural invariance (factor loadings equal) was good and acceptable. Metric invariance model (factor loadings and intercepts equal) was also good, showing strong factorial invariance. The subtest factor loadings were similar in PIQ1 and PIQ2 + 3 groups. The next step of strong measurement (scalar) invariance showed an ill-fit (row 12). Factor means were unequal (row 13) and the first three P factor variables (BD, PCn, and MR) accounted for the significant χ2. When their intercepts were relaxed, the model showed a fair fit (row 14). Releasing both factor means and the first three P factor variable intercepts changed the model to be acceptable (row 15). The next model releasing factor means, the first three P factor variable intercepts, and factor variances across PIQ1 and PIQ2 + 3 groups showed a similar good fit (row 16). We can thus claim that the measurements have a metric and partially scalar (weak) invariance.

The behavior of factor loadings remained fairly stable in the nested models. Since the covariances were equal, the metric invariance was good, and the scalar invariance partial, we chose a final model () where the combined DLD group was used without dividing it according to the PIQ level, although the fit of this model was not very good (, row 18). Other factors supporting this decision were the small number of cases when using divided groups and the amount of missing values, which made some of the models unstable. This model had no cross-loadings, intercepts were not constrained, error correlations were set to zero, and residual and factor correlations were freely estimated. The correlation between the latent V and P composite factors was large (r = .573, p < .001).

Figure 3. Factor loadings in SEM modeling.

Figure 3. Factor loadings in SEM modeling.

We used the following three options in the model trimming (, rows 21–23): releasing 6 of 120 error correlations, allowing some variable cross loadings, and dropping ill-fitting variables Comprehension and Sentence Repetition from the latent V factor, and Block Design, Symbol Search, and Picture Concepts from the P factor. This improved the fit to very good. However, to avoid over-fitting, the total 16-variable model without these trimmings was chosen as the final model.

In summary, the SEM process led to the following findings: measurement invariance was metric and partially scalar (i.e., the variables measure the same features in PIQ1 and PIQ2 + 3 groups); factor loadings were equal across these two groups; factor means were significantly higher in PIQ1 than PIQ2 + 3 group, but the means of V factor were smaller than the means of P factor in both groups; item intercepts were higher in PIQ1 than PIQ2 + 3 group; factor correlations were high and did not differ between the two groups; and factor variances were similar across these groups. Thus, the SEM results confirm the view obtained with the more traditional linear least-square methods.

Discussion

Several earlier studies have shown that children with DLD tend to have weaker nonverbal performance skills than their peers with normal development (e.g., Gallinat & Spaulding, Citation2014; Liao et al., Citation2014; McGregor et al., Citation2013; Stothard et al., Citation1998). While the level of overall nonverbal performance is no longer considered critical for DLD diagnosis in the new diagnostic classifications (DSM-5 and ICD-11), the exact nature and significance of the connection between verbal and nonverbal processing in children with DLD diagnosed following the new diagnostic criteria is not clear.

The aim of the present study was to evaluate the significance of nonverbal performance level on cognitive subtest profiles and the connections between nonverbal and verbal skills in children previously diagnosed with DLD and in those diagnosed with mixed specific developmental disorders following the ICD-10 criteria. Following the new diagnostic criteria, both these groups of children would be diagnosed with DLD. To our knowledge, the relations between verbal and nonverbal cognitive performance have not been previously examined in this newly defined DLD group.

Cognitive subtest profiles in children with DLD

Overall, our results indicate a strong connection between nonverbal and verbal cognitive skills in children diagnosed with DLD; the weaker the nonverbal cognitive level, the lower the verbal skills. Although verbal subtest profiles in all our PIQ groups fell below the normative age range (i.e., below −1 SD), the differences in verbal performance were greatest between children with average (PIQ group 1) and poor (PIQ group 3) nonverbal cognitive skills. Our results are partly consistent with those reported by Norbury et al. (Citation2016), showing only minimal differences in the severity of language problems between children with average (−1 SD or better, corresponding to our PIQ group 1) and low average (between −1 SD and −2 SD, corresponding to our PIQ group 2) nonverbal cognitive skills. However, in our study, significant differences in verbal performance between PIQ groups 1 and 2 were evident in subtests related to receptive language, whereas in the Norbury et al. (Citation2016) study, those with low average nonverbal cognitive skills had significantly more severe expressive language deficits. Moreover, PIQ group 3 with poor nonverbal cognitive skills had significantly more severe problems in verbal reasoning and receptive vocabulary than PIQ groups 1 and 2, but not in the expressive language test Picture Naming. The differences between the results in this study and Norbury et al. (Citation2016) are most probably related to selection of participants, selection of nonverbal and verbal tests, and the composite scores used in each study.

Similar to the Conti-Ramsden et al. (Citation2012) study, one third of children in the present study had low-average or poor nonverbal skills. These children resemble those with BIF, who typically score 1 to 2 standard deviations below the normal age mean in overall intelligence and adaptive functioning (Greenspan, Citation2017; Pulina et al., Citation2019). In the study by Pulina et al. (Citation2019), school-aged children with BIF had an uneven intellectual profile with significant weakness in the WM index and relative strength in the Perceptual Reasoning index. Children diagnosed with DLD typically also have relative strengths in perceptual reasoning (e.g., Hick et al., Citation2005; Saar et al., Citation2018) and in addition to speech and language deficits, have weaknesses in WM and verbal STM (e.g., Alloway et al. 2010; Archibald & Gathercole, Citation2006; Saar et al., Citation2018). In accordance with these findings, the most profound weaknesses in each PIQ-level group and the combined DLD group appeared in Word Reasoning, Comprehension, and Sentence Repetition, which are subtests related to verbal reasoning and STM. Relative strengths were evident in Matrix Reasoning and Picture Concepts, which require serial and categorical reasoning, respectively, and in Processing Speed subtests.

The combined DLD group consisted of children with average (PIQ group 1), low-average (PIQ group 2) and poor (PIQ group 3) nonverbal performance level. The subtest profile of the combined DLD group closely resembled that of PIQ group 1, reflecting the fact that most participants belonged to this PIQ-level group. However, the overall level of the combined DLD group subtest profile would probably be lower if the number of children in PIQ groups 2 and 3 were balanced with the number of children in PIQ group 1. The overall cognitive level, typically indexed with full scale IQ (FSIQ), was not evaluated in this study. Generally, FSIQ <70 is diagnostically related to intellectual disability (ID) but the use of FSIC, especially in clinical groups, has been questioned (e.g., Fiorello et al., Citation2007; Greenspan, Citation2017). In clinical groups, evaluation of the relative cognitive strengths and weaknesses is considered central for differential diagnosis and planning of interventions (Jankowska et al., Citation2021; Pulina et al., Citation2019). In the previous DLD diagnostic criteria, the discrepancy between VIQ and PIQ indices was considered crucial. In the new criteria, PIQ <70 is used to separate those with DLD from those with ID. However, diagnostically, differences and connections between more specific cognitive domains, such as processing speed, executive functions, and adaptive skills (Garret & Gilmore, Citation2009; Santegoeds et al., Citation2021) may be more useful than composite IQ scores. Our results suggest that in addition to clear deficits in verbal reasoning and STM, relative nonverbal strengths in processing speed and in subtests Matrix Reasoning and Picture Concepts could be used to separate children with DLD from those with ID. However, comparing our results to other studies is difficult because different tests and subtests were used, and subtest profiles have rarely been studied in children with or without DLD.

Connections between nonverbal and verbal cognitive skills in children with DLD

A strong connection between nonverbal cognitive level and verbal skills was also evident in the correlations and were further confirmed and elaborated with SEM modeling. These findings suggest a significant general connection between verbal and nonverbal cognitive processing in children with DLD.

The VIQ-PIQ correlation of the combined DLD group (r = .368) in the present study closely corresponds to the PIQ-VIQ correlation (r = .373) in the normative data of the Finnish WPPSI-III test (Wechsler, Citation2009), suggesting a similar relationship between nonverbal and verbal reasoning in preschool-aged children with and without DLD. A significant correlation has also been shown in children aged 5–6 years with DLD between PIQ and a composite language score consisting of pronunciation, fluency, articulation, receptive language, and expressive language (Liao et al., Citation2014). In addition, PIQ is significantly related to semantics and morphosyntax in children with DLD (DeThorne & Watkins, Citation2006). Together, these results suggest that in children with DLD, both verbal reasoning and basic language skills are connected to nonverbal reasoning abilities.

The connections of overall nonverbal cognitive performance to different verbal subtests and overall verbal performance to different nonverbal subtests varied in strength but were mainly stronger than those in the Finnish WPPSI-III normative data (Wechsler, Citation2009). This difference reflects the heterogeneity of our sample that produces larger variance, and consequently higher covariance and correlation values. The PIQ connection in the present study was strongest to subtests Similarities and Receptive Vocabulary (emphasizing verbal understanding) and weakest to subtests Picture Naming, Sentence Repetition, Comprehension (emphasising expressive language), and verbal STM, which are typical weaknesses in children with DLD (Archibald & Gathercole, Citation2006; Baird et al., Citation2010; Kenney et al., Citation2006; Messer & Dockrell, Citation2006) and consequently do not vary with nonverbal abilities as strongly as verbal comprehension and reasoning skills. On the other hand, all nonverbal subtests other than Block Design had significant correlations with VIQ, indicating a clear verbal impact on nonverbal reasoning in children with DLD. In our previous study (Saar et al., Citation2018), Block Design was the only nonverbal subtest that did not differentiate subjects with expressive or mixed receptive-expressive DLD but varied independently. Together, these results suggest that in children with DLD, Block Design is the only WPPSI-III subtest that evaluates nonverbal skills independently of the verbal cognitive level. In addition, consistent with our results showing a clear connection between processing speed and verbal reasoning, Miller et al. (Citation2001) found slow processing speed particularly in children with more severe language problems.

The two-factor structure of cognitive functions in children with DLD

A two-factor structure of cognitive functions representing verbal and nonverbal skills has been frequently suggested for typically developing preschool-aged children (e.g., Brito et al., Citation2011; Peyre et al., Citation2016; Tideman & Gustafsson, Citation2004). In other studies, the structure of cognitive functions in children with TD has been found to be more complex (e.g., Plym et al., Citation2021; Tusing & Ford, Citation2004) with differing numbers of factors suggested. Tusing and Ford (Citation2004) suggested a five-factor structure of cognitive functions in children with TD aged 4–5 years, including crystallized intelligence, auditory processing, STM, LTM, and one factor related to nonverbal ability. These results differ from those in Plym et al. (Citation2021), where the best-fitting structure for preschool-aged children with TD included factors reflecting verbal abilities, processing speed/short-term memory, visuomotor functions, and visuoconstructive abilities/nonverbal reasoning. The differences between these results are most probably related to the combination of tests used in each study that may have evaluated partly different cognitive functions.

In some studies, the structure of cognitive functions in preschool-aged children (Ottem, Citation2003) and school-aged children (Gillam et al., Citation2021) with and without DLD was similar, although again with different factor solutions from study to study. However, the structure of cognitive functions may also differ between preschool-aged children with and without DLD (Plym et al., Citation2021), showing more homogeneous verbal performance in TD children, and more interconnected nonverbal skills in children with DLD, indicating possible differences in the maturation rate of these cognitive skills between these groups of children.

In the present study, we chose the commonly used two-factor model with latent V (verbal) and P (nonverbal performance) composite factors to evaluate the connections between verbal and nonverbal performance in preschool-aged children with DLD with average versus below average nonverbal performance. Our results showed that in children with DLD, the latent V and P factor variables measured the same features in those with average (PIQ1 group) and below average (PIQ2 + 3 group) nonverbal abilities, and that the fit of the two-factor model in both groups was good. Thus, the structure of cognitive functions, evaluated with all WPPSI-III subtests and NEPSY-II subtests Comprehension of Instructions and Sentence Repetition, can adequately be modeled with a two-factor solution in children previously diagnosed with DLD and in those with mixed specific developmental disorders.

The final two-factor model selected for the combined DLD group exhibited the most generalizable solution with an acceptable fit without the danger of overfitting. In this group, all subtests representing verbal reasoning (Information, Comprehension, Word Reasoning, Vocabulary and Similarities) had high loadings on the latent V factor which closely resembles the verbal factor identified in the factor analysis of the Finnish WPPSI-III normative data (Wechsler, Citation2009). Also, in line with the Finnish WPPSI-III normative data, the latent P factor was most strongly defined by processing speed with additional impact from serial reasoning indexed by Matrix Reasoning and attention to visual details central in Picture Completion. These latent factors resemble fluid and crystallized intelligence, first described in Cattell’s Gf-Gc model of intelligence (Cattel, Citation1943) and later expanded (Cattel & Horn, Citation1978) to include broad abilities of visual processing, short-term apprehension and retrieval, long-term storage and retrieval, and speed of processing. More recently, other broad abilities have been added to the model. However, in a meta-analysis examining the structure of broad abilities, Bryan and Mayer (Citation2020) reported a reasonable fit for a two-factor solution with factors resembling fluid and crystallised intelligence. In the present study, the correlation between the latent V and P factors was large, indicating a strong connection between fluid and crystallised intelligence in children with DLD.

Fluid intelligence in children with DLD

The connection between fluid intelligence and verbal abilities was already presented in Cattel’s investment theory (Baghaei & Tabatabaee, Citation2015; Cattel & Horn, Citation1978; Cattel, Citation1943; Kvist & Gustafsson, Citation2007; Thorsen et al., Citation2014), where fluid intelligence is assumed to represent general intelligence and to have a continuous influence on crystallized intelligence (i.e., on the ability to use experience, knowledge, and verbal skills in reasoning). Fluid intelligence is most typically evaluated with tests resembling WPPSI-III subtest Matrix Reasoning (e.g., Ferrer et al., Citation2009; Ren et al., Citation2014). In WPPSI-IV (Wechsler, Citation2012), the new Fluid Reasoning index is composed of Matrix Reasoning and Picture Concepts, subtests significantly connected to verbal reasoning in children with DLD in the present study. These findings are in line with a notion that measures of nonverbal skills might not be totally discrete from or in contrast to verbal skills (Durant et al., Citation2019). In future studies applying WPPSI-IV, it would be interesting to compare the connection between verbal/crystallised and nonverbal/fluid reasoning in children with and without DLD.

Processing speed in general is considered a central component in all cognitive processing (e.g., Kail, Citation1994; Leonard et al., Citation2007), and together with Picture Concepts and Matrix Reasoning, represents nonverbal fluid intelligence in the WPPSI-III test (Wechsler, Citation2009), the newest Finnish version of the WPPSI test presently available. The strong connection between processing speed and DLD suggested in numerous earlier studies (e.g., Leonard et al., Citation2007; Miller et al., Citation2001, Park, Mainela-Arnold et al., Citation2015; Windsor et al., Citation2008) was also clear in the present study. The contribution of processing speed and WM to fluid intelligence has been emphasized (Dehn, Citation2017; Engle et al., Citation1999; Gillam et al., Citation2021; Leonard et al., Citation2007; Montgomery et al., Citation2018, Citation2021), and these basic cognitive processes are suggested to develop in concert with fluid intelligence (Fry & Hale, Citation2000). WM capacity is also central to verbal processing (Lum & Bleses, Citation2012; Montgomery et al., Citation2018), and the relationship between WM capacity and language skills has been shown to be stronger in TD children than in children with DLD (Gillam et al., Citation2021). However, it is not clear whether this difference is inherent in children with DLD or results from difficulties with both memory and language.

Interestingly, Chuderski (Citation2013) found that the relation of WM and fluid intelligence depends on the time allowed for nonverbal tasks, and that the performance of participants with low cognitive capacity approached those with higher capacity when no time limits were applied. In our study, children with DLD had on average weakest nonverbal reasoning scores in subtests with time limits (Block Design, Object Assembly and Picture Completion), suggesting a general slowness in nonverbal reasoning capacity. In addition, both nonverbal reasoning and processing speed were weakest in children with the most severe language problems. Consistent with our results, slow processing speed was observed particularly in children with more severe language problems (Miller et al., Citation2001), and it has been suggested that nonverbal tests should be presented and evaluated without time limits when diagnosing children with DLD (Park, Miller et al., Citation2015).

Conclusions

The present results suggest that nonverbal fluid intelligence is strongly linked to verbal understanding and reasoning in children with DLD; the weaker the nonverbal fluid intelligence, the more severe the DLD. On the other hand, following the new DLD diagnostic criteria and including children with below average and weak nonverbal skills, fluid intelligence and processing speed also emerged as relative cognitive strengths in the subtest profiles of these children, regardless of the nonverbal cognitive level. These results suggest that in addition to specific weaknesses in receptive and expressive language, verbal reasoning, STM and WM, relative nonverbal strengths in fluid reasoning and processing speed could be used as diagnostic markers when identifying children with DLD.

Consistent with Park, Miller et al. (Citation2015), we further suggest that nonverbal tests should be presented and evaluated without time limits, especially when the focus is to separate those with DLD from those with ID, as children with ID might not benefit from the extra time allowed for completing the tasks the same way as children with DLD. However, future studies are needed to evaluate the diagnostic significance of this suggestion. Following CATALISE (Bishop et al., Citation2017) recommendations, adaptive skills should also be evaluated to define the functional impact of verbal and nonverbal deficits and possible differences in children with DLD and ID.

Acknowledgements

This study was approved by the Ethics Committee of the Hospital District of Helsinki and Uusimaa. The authors alone are responsible for the content and writing of this manuscript. The authors are grateful to Dr Johanna Rosenqvist for her valuable comments on the manuscript.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The author(s) reported there is no funding associated with the work featured in this article.

References

  • Alloway, T. P. (2010). Working memory and executive function profiles of individuals with borderline intellectual functioning. Journal of Intellectual Disability Research, 54(5), 448–456. https://doi.org/10.1111/j.1365-2788.2010.01281.x
  • American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders (5th ed.). American Psychiatric Association.
  • Archibald, L., & Gathercole, S. (2006). Short-Term and working memory in specific language impairment. International Journal of Language & Communication Disorders, 41(6), 675–693. https://doi.org/10.1080/13682820500442602
  • Asparouhov, T., & Muthén, B. (2020). Bayesian estimation of single and multilevel models with latent variable interactions. A Multidisciplinary Journal, 28(2), 314–328. https://doi.org/10.1080/10705511.2020.1761808
  • Baghaei, P., & Tabatabaee, M. (2015). The C-test. An integrative measure of crystallized intelligence. Journal of Intelligence, 3(2), 46–58. https://doi.org/10.3390/jintelligence3020046
  • Baird, G., Dworzynski, K., Slonims, V., & Simonoff, E. (2010). Memory impairment in children with language impairment. Developmental Medicine & Child Neurology, 52(6), 535–540. https://doi.org/10.1111/j.1469-8749.2009.03494.x
  • Bishop, D. V. M. (2014). Ten Questions about terminology for children with unexplained language problems. International Journal of Language & Communication Disorder, 49(4), 381–415. https://doi.org/10.1111/1460-6984.12101
  • Bishop, D. V. M., Snowling, M. J., Thompson, P. A., Greenhalgh, T., & Consortium, C.A.T.A.L.I.S.E. (2016). CATALISE: A multinational and multidisciplinary Delphi consensus study. Identifying language impairments in children. PLOS One, 11(7), e0158753. https://doi.org/10.1371/journal.pone.0158753
  • Bishop, D. V. M., Snowling, M. J., Thompson, P. A., Greenhalgh, T., & CATALISE consortium. (2017). Phase 2 of CATALISE: A multinational and multidisciplinary Delphi consensus study of problems with language development: Terminology. The Journal of Child Psychology and Psychiatry, 58(10), 1068–1080. https://doi.org/10.1111/jcpp.12721
  • Botting, N. (2005). Non-Verbal cognitive development and language impairment. Journal of Child Psychology, 46(3), 317–326. https://doi.org/10.1111/j.1469-7610.2004.00355.x
  • Brito, L., Almeida, L. S., Ferreira, A. I., & Guisande, M. A. (2011). Contribución de los procesos y contenidos a la diferenciación cognitiva en la infancia: Un estudio con escolares Portugueses [Contribution of processes and contents on cognitive differentiation in childhood: A study with Portuguese children]. Infancia Y Aprendizaje, 34(3), 323–336. https://doi.org/10.1174/021037011797238540
  • Bryan, V. M., & Mayer, J. D. (2020). A meta-analysis of the correlations among broad intelligences: Understanding their relations. Intelligence, 81(C), 101469. https://doi.org/10.1016/j.intell.2020.101469
  • Cattel, R. B. (1943). Some theoretical issues in adult intelligence testing. Psychological Bulletin, 40(3), 153–193. https://doi.org/10.1037/h0059973
  • Cattel, R., & Horn, J. (1978). A check on the theory of fluid and crystallized intelligence with description of new subtest designs. Journal of Educational Measurement, 15(3), 139–164. https://doi.org/10.1111/j.1745-3984.1978.tb00065.x
  • Chuderski, A. (2013). When are fluid intelligence and working memory isomorphic and when are they not? Intelligence, 41(4), 244–262. https://doi.org/10.1016/j.intell.2013.04.003
  • Conti-Ramsden, G., St Clair, M. C., Pickles, A., & Durkin, K. (2012). Developmental trajectories of verbal and nonverbal skills in individuals with a history of specific language impairment: From childhood to adolescence. Journal of Speech, Language, and Hearing Research, 55(6), 1716–1735. https://doi.org/10.1044/1092-4388(2012/10-0182)
  • Dehn, M. (2017). How working memory enables fluid reasoning. Applied Neuropsychology, 6(3), 245–247. https://doi.org/10.1080/21622965.2017.1317490
  • DeThorne, L. S., & Schaefer, B. A. (2004). A guide to child nonverbal IQ measures. American Journal of Speech-Language Pathology, 13(4), 275–290. https://doi.org/10.1044/1058-0360(2004/029)
  • DeThorne, L. S., & Watkins, R. V. (2006). Language abilities and nonverbal IQ in children with language impairment: Inconsistency across measures. Clinical Linguistics & Phonetics, 20(9), 641–658. https://doi.org/10.1080/02699200500074313
  • Durant, K., Peña, E., Peña, A., Bedore, L. M., & Muñoz, M. R. (2019). Not all nonverbal tasks are equally nonverbal: Comparing two tasks in bilingual kindergartners with and without developmental language disorder. Journal of Speech, Language, and Hearing Research, 62(9), 3462–3469. https://doi.org/10.1044/2019_JSLHR-L-18-0331
  • Engle, R. W., Tuholski, S. W., Laughlin, J. E., & Conway, A. R. A. (1999). Working memory, short-term memory, and general fluid intelligence: A latent-variable approach. Journal of Experimental Psychology: General, 128(3), 309–331. https://doi.org/10.1037/0096-3445.128.3.309
  • Erostarbe-Pérez, M., Reparaz-Abaitua, C., Martínez-Pérez, L., & Magallón-Recalde, S. (2022). Executive functions and their relationship with intellectual capacity and age in schoolchildren with intellectual disability. Journal of Intellectual Disability Research, 66(1–2), 50–67. https://doi.org/10.1111/jir.12885
  • Fernell, E., & Gillberg, C. (2020) Borderline intellectual functioning. In A. Gallagher; C. Bulteau; D. Cohen, and J. L. Michaud (Eds.), Handbook of clinical neurology (Vol. 174, pp. 77–81, 3rd series). Disorders and Disabilities. https://doi.org/10.1016/B978-0-444-64148-9.00006-5
  • Ferrer, E., O’Hare, E., & Bunge, S. (2009). Fluid reasoning and the developing brain. Frontiers in Neuroscience, 3(1), 46–51. https://doi.org/10.3389/neuro.01.003.2009
  • Fiorello, C. A., Hale, J. B., Holdnack, J. A., Kavanagh, J. A., Terrell, J., & Long, L. (2007). Interpreting intelligence test results for children with disabilities: Is global intelligence relevant? Applied Neuropsychology, 14(1), 2–12. https://doi.org/10.1080/09084280701280338
  • Fry, A. F., & Hale, S. (2000). Relationships among processing speed, working memory, and fluid intelligence in children. Biological Psychology, 54(1–3), 1–34. https://doi.org/10.1016/s0301-0511(00)00051-x
  • Gallinat, E., & Spaulding, T. J. (2014). Differences in the performance of children with specific language impairment and their typically developing peers on nonverbal cognitive tests: A meta-analysis. Journal of Speech, Language, and Hearing Research, 57(4), 1363–1382. https://doi.org/10.1044/2014_JSLHR-L-12-0363
  • Garret, M., & Gilmore, L. (2009). To WPPSI or to binet, that is the question: A comparison of the WPPSI-III and SB5 with typically developing pre-schoolers. Australian Journal of Guidance & Counselling, 19(2), 104–115. https://doi.org/10.1375/ajgd.19.2.104
  • Gillam, R. B., Serang, S., Montgomery, J. W., & Evans, J. L. (2021). Cognitive processes related to memory capacity explain nearly all of the variance in language test performance in school-age children with and without developmental language disorder. Frontiers in Psychology, 12, 724356. https://doi.org/10.3389/fpsyg.2021.724356
  • Greenspan, S. (2017). Borderline intellectual functioning: An update. Current Opinion in Psychiatry, 30(2), 113–122. https://doi.org/10.1097/YCO.0000000000000317
  • Hick, R., Botting, N., & Conti-Ramsden, G. (2005). Cognitive abilities in children with specific language impairment: Considerations of visuo-spatial skills. International Journal of Language & Communication Disorder, 40(2), 137–149. https://doi.org/10.1080/13682820400011507
  • Jankowska, A. M., Lockiewicz, M., & Lada-Masko, A. B. (2021). Heterogeneity of cognitive profiles in students with borderline intellectual functioning. Psychiatria Polska, 55(4), 869–885. https://doi.org/10.12740/PP/123165
  • Kail, R. (1994). A method for studying the generalized slowing hypothesis in children with specific language impairment. Journal of Speech & Hearing Research, 37(2), 418–421. https://doi.org/10.1044/jshr.3702.418
  • Karmiloff-Smith, A. (2007). Atypical epigenesis. Developmental Science, 10(1), 84–88. https://doi.org/10.1111/j.1467-7687.2007.00568.x
  • Kenney, M. K., Barac-Cikoja, D., Finnegan, K., Jeffries, N., & Ludlow, C. L. (2006). Speech perception and short term memory deficits in persistent developmental speech disorder. Brain & Language, 96(2), 178–190. https://doi.org/10.1016/j.bandl.2005.04.002
  • Kline, R. B. (2015). Principles and practice of structural equation modeling (4th ed.). Guildford Press.
  • Korkman, M., Kirk, U., & Kemp, S. (2008). Nepsy II - Lasten neuropsykologinen tutkimus [NEPSY-II: Children’s Neuropsychological Research]. Hoegrefe Psykologien Kustannus Oy.
  • Kvist, A. V., & Gustafsson, J.-E. (2007). The relation between fluid intelligence and the general factor as a function of cultural background: A test of Cattell’s investment theory. Intelligence, 36(5), 422–436. https://doi.org/10.1016/j.intell.2007.08.004
  • Leonard, L. B., Weismer, S. E., Miller, C.A., Francis, D. J., Tomblin, J. B., & Kail, R. V. (2007). Speed of processing, working memory, and language impairment in children. Journal of Speech Language and Hearing Research, 50(2), 408–428. https://doi.org/10.1044/1092-4388(2007/029)
  • Liao, S.-F., Liu, J.-C., Hsu, C.-L., Chang, M.-Y., Chang, T.-M., & Cheng, H. (2014). Cognitive development in children with language impairment, and correlation between language and intelligence development in kindergarten children with developmental delay. Journal of Child Neurology, 30(1), 42–47. https://doi.org/10.1177/0883073814535486
  • Little, R. J. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83(404), 1198–1202. https://doi.org/10.1080/01621459.1988.10478722
  • Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed.). John Wiley & Sons.
  • Lum, J. A. G., & Bleses, D. (2012). Declarative and procedural memory in Danish speaking children with specific language impairment. Journal of Communication Disorders, 45(1), 46–58. https://doi.org/10.1016/j.jcomdis.2011.09.001
  • McGregor, K., Oleson, J., Bahnsen, A., & Duff, D. (2013). Children with developmental language impairment have vocabulary deficits characterized by limited breadth and depth. International Journal of Language & Communication Disorder, 48(3), 307–319. https://doi.org/10.1111/1460-6984.12008
  • Messer, D., & Dockrell, J. (2006). Children’s naming and word-finding difficulties: Descriptions and explanations. Journal of Speech Language and Hearing Research, 49(2), 309–324. https://doi.org/10.1044/1092-4388(2006/025)
  • Miller, C. A., Kail, R., Leonard, L. B., & Tomblin, J. B. (2001). Speed of processing in children with specific language disorder. Journal of Speech, Language, and Hearing Research, 44(2), 416–433. https://doi.org/10.1044/1092-4388(2001/034)
  • Miller, C. A., & Gilbert, E. (2008). Comparison of performance on two nonverbal intelligence tests by adolescents with and without language impairment. Journal of Communication Disorders, 41(4), 358–371. https://doi.org/10.1016/j.jcomdis.2008.02.003
  • Millsap, R. E. (2011). Statistical approaches to measurement invariance. Routledge.
  • Montgomery, J. W., Evans, J. L., Jameson, D. F., Schwartz, S., & Gillam, R. B. (2018). Structural relationship between cognitive processing and syntactic sentence comprehension in children with and without developmental language disorder. Journal of Speech, Language, and Hearing Research, 61(12), 2950–2976. https://doi.org/10.1044/2018_JSLHR-L-17-0421
  • Montgomery, J. W., Gillam, R. B., & Evans, J. L. (2021). A new memory perspective on the sentence comprehension deficits of school-age children with developmental language disorder: Implications for theory, assessment, and intervention. Language, Speech, and Hearing Services in Schools, 52(2), 449–466. https://doi.org/10.1044/2021_LSHSS-20-00128
  • Muthen, L. K., & Muthen, B. O. (1998–2017). Mplus user’s guide (8th ed.). Muthen & Muthen.
  • Norbury, C. F., Gooch, D., Wray, C., Baird, G., Charman, T., Simonoff, E., Vamvakas, G., & Pickles, A. (2016). The impact of nonverbal ability on prevalence and clinical presentation of language disorder: Evidence from a population study. Journal of Child Psychology and Psychiatry, 57(11), 1247–1257. https://doi.org/10.1111/jcpp.12573
  • Ottem, E. (2003). Confirmatory factor analysis of the WPPSI for language-impaired children. Scandinavian Journal of Psychology, 44(5), 433–439. https://doi.org/10.1046/j.1467-9450.2003.00364.x
  • Park, J., Mainela-Arnold, E., & Miller, C. A. (2015). Information processing speed as a predictor of IQ in children with and without specific language impairment in grades 3 and 8. Journal of Communication Disorders, 53(1), 57–69. https://doi.org/10.1016/j.jcomdis.2014.11.002
  • Park, J., Miller, C. A., & Mainela-Arnold, E. (2015). Processing speed measures as clinical markers for children with language impairment. Journal of Speech, Language, and Hearing Research, 58(3), 954–960. https://doi.org/10.1044/2015_JSLHR-L-
  • Peltopuro, M., Ahonen, T., Kaartinen, J., Seppälä, H., & Närhi, V. (2014). Borderline intellectual functioning: A systematic literature review. Intellectual and Developmental Disabilities, 52(6), 419–443. https://doi.org/10.1352/1934-9556-52.6.419
  • Peyre, H., Bernard, J. Y., Hoertel, N., Forhan, A., Charles, M.-A., De Agostini, M., Heude, B., Ramus, F., & Mother-Child Cohort Study Group, E.D.E.N. (2016). Differential effects of factors influencing cognitive development at the age of 5-to-6 years. Cognitive Development, 40, 152–162. https://doi.org/10.1016/j.cogdev.2016.10.001
  • Plym, J., Lahti-Nuuttila, P., Smolander, S., Arkkila, E., & Laasonen, M. (2021). Structure of cognitive functions in monolingual preschool children with typical development and children with developmental language disorder. Journal of Speech, Language, and Hearing Research, 64(8), 3140–3158. https://doi.org/10.1044/2021_JSLHR-20-00546
  • Pulina, F., Lanfranchi, S., Henry, L., & Vianello, R. (2019). Intellectual profile in school-aged children with borderline intellectual functioning. Research in Developmental Disabilities, 95, 103498. https://doi.org/10.1016/j.ridd.2019.103498
  • Reham, A. F., & Hassnaa, O. M. (2020). Panorama of the non-verbal cognitive abilities among children with SLI. Egyptian Journal of Ear Nose Throat and Allied Sciences, 21(3), 165-–175. https://doi.org/10.21608/ejentas.2020.27485.1194
  • Ren, X., Wang, T., Altmeyer, M., & Schweizer, K. (2014). A learning-based account of fluid intelligence from the perspective of the position effect. Learning and Individual Differences, 31, 30–35. https://doi.org/10.1016/j.lindif.2014.01.002
  • Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. John Wiley & Sons Inc.
  • Saar, V., Levänen, S., & Komulainen, E. (2018). Cognitive profiles of Finnish preschool children with expressive and receptive language impairment. Journal of Speech, Language, and Hearing Research, 61(2), 386–397. https://doi.org/10.1044/2017_JSLHR-L-16-036
  • Santegoeds, E., van der Schoot, E., Roording-Ragetlie, S., Klip, H., & Rommelse, N. (2021). Neurocognitive functioning of children with mild to borderline intellectual disabilities and psychiatric disorders: Profile characteristics and predictors of behavioural problems. Journal of Intellectual Disability Research, 66(1–2), 162–177. https://doi.org/10.1111/jir.12874
  • Schafer, J. L. (1997). Analysis of incomplete multivariate data. Chapman & Hall/CRC.
  • Schumaker, R. E., & Lomax, R. G. (2016). A beginner’s guide to structural equation modeling (4th ed.). Routledge.
  • Smelser N. J., & Baltes, P. B. (Eds.). (2001). International encyclopedia of the social & behavioral sciences (Vol. 11). Elsevier.
  • Stothard, S. E., Snowling, M. J., Bishop, D. V. M., Chipchase, B. B., & Kaplan, C. (1998). Language-Impaired preschoolers: A follow-up into adolescence. Journal of Speech, Language, and Hearing Research, 41(2), 407–418. https://doi.org/10.1044/jslhr.4102.407
  • Thorsen, C., Gustafsson, J.-E., & Cliffordson, C. (2014). The influence of fluid and crystallized intelligence on the development of knowledge and skills. The British Journal of Educational Psychology, 84(4), 556–570. https://doi.org/10.1111/bjep.12041
  • Tideman, E., & Gustafsson, J.-E. (2004). Age-related differentiation of cognitive abilities in ages 3–7. Personality and Individual Differences, 36(8), 1965–1974. https://doi.org/10.1016/j.paid.2003.09.004
  • Träff, U., & Östergren, R. (2021). Development of cognitive functions and academic skills in 9- to 10-year-old children with borderline intellectual functioning. Developmental Neuropsychology, 46(1), 54–69. https://doi.org/10.1080/87565641.2020.1858421
  • Tusing, M. E., & Ford, L. (2004). Examining preschool cognitive abilities using a CHC framework. International Journal of Testing, 4(2), 91–114. https://doi.org/10.1207/s15327574ijt0402_1
  • Ullman, R., & Pierpont, E. (2005). Specific language impairment is not specific to language: The procedural deficit hypothesis. Cortex, 41(3), 399–433. https://doi.org/10.1016/s0010-9452(08)70276-4
  • Van de Schoot, R., Lugtig, P., & Hox, J. (2012). A checklist for testing measurement invariance. The European Journal of Developmental Psychology, 9(4), 486–492. https://doi.org/10.1080/17405629.2012.686740
  • Vugs, B., Cuperus, J., Hendriks, M., & Verhoeven, L. (2013). Visuospatial working memory in specific language impairment: A meta-analysis. Research in Developmental Disabilities, 34(9), 2586–2597. https://doi.org/10.1016/j.ridd.2013.05.014
  • Wechsler, D. (2009). WPPSI III - Wechsler Preschool and Primary Scale of Intelligence (3rd ed.). Finnish version. Psykologien Kustannus Oy.
  • Wechsler, D. (2012). WPPSI-IV - Wechsler Preschool and Primary Scale of Intelligence (4th ed.). Pearson.
  • Windsor, J., Kohnert, K., Loxtercamp, A., & Kan, P. F. (2008). Performance on nonlinguistic visual tasks by children with language impairment. Applied Psycholinguistics, 29(02), 237–268. https://doi.org/10.1017/S0142716407080113
  • World Health Organization. (2018) . ICD-11. International classification of diseases, 11th Revision. The global standard for diagnostic health information, WHO.
  • Xu, H., & Traceya, T. J. G. (2017). Use of multi-group confirmatory factor analysis in examining measurement invariance in counselling Psychology Research. The European Journal of Counselling Psychology, 6(1), 75–82. https://doi.org/10.5964/ejcop.v6i1.120