1,846
Views
0
CrossRef citations to date
0
Altmetric
Research Article

IQ, non-cognitive and social-emotional parameters influencing education in speech- and language-impaired children

ORCID Icon, & | (Reviewing Editor)
Article: 1357912 | Received 22 Oct 2016, Accepted 17 Jul 2017, Published online: 31 Jul 2017

Abstract

Speech-/language-impaired (SL)-children face problems in school and later life. The significance of “non-cognitive, social-emotional skills” (NCSES) in these children is often underestimated.

Aim: Present study of affected SL-children was assessed to analyse the influence of NCSES for long-term school education.

Methods: Nineteen severely SL-impaired children (7 girls, 12 boys) from a specialised kindergarten were followed; follow-up period: Up to 12 years; the different skills or parameters were known.

Results: Fourteen children visited successfully a regular secondary school (RS), five children a “school focussing on learning problems” (SFL). SL-differences between the children attending RS and SFL were small; differences in “IQ” and “self-confidence” were significant, smaller differences were observed concerning “skills at crafts/construction” and “auditory-visual perception”.

Summary: Although the study group is small, results give evidence that beside SL- and “cognitive” skills “non-cognitive, social-emotional skills” are of major importance for long-term school education of SL-impaired children. These soft skills seem to be particularly important for “special need children” with SL-impairment.

Public Interest Statement

Worldwide speech-/language-(SL) impaired children face major problems in school career and later life. It is hypothesised that these issues are in part at least also an effect from focussing predominately on cognitive abilities and SL-competences in school education. In the present study, the development of school education was followed in a small group of 19 SL-impaired children by assessing non-cognitive, social-emotional skills. Fourteen children visited successful a regular secondary school, five children were transferred to a “school focussing on learning problems”. Findings regarding non-cognitive, social-emotional parameters give evidence that for educational achievement beneath IQ soft skill, such as self-esteem and creativity are very important. There are also indications that the impact of soft skills might be more important than SL-abilities. According to the authors’ opinion the promotion of so-called soft skills should be strengthened in educational work, especially in disadvantaged children.

Worldwide, speech-/language-(SL) impaired children are disadvantaged well into adulthood, but the exact causes of this discrimination remain the subject of much controversy. Multiple cognitive and speech parameters, as well as non-cognitive and social parameters seem to affect long-term prognosis in severely speech- and language-impaired children. The goal of this study is a comprehensive longitudinal assessment to understand the impact of (generally underestimated) soft skills on the development of children.

1. Introduction

Primary and secondary education allows children to develop skills and knowledge that are essential for social and economic success in later life (Glogowska, Roulstone, Peters, & Enderby, Citation2006; Heckman, Citation2011). Most developed countries have an education system that is focused predominantly on developing cognitive abilities in children. These abilities can be measured using intelligence quotient measurements and other formalised assessment processes. Cunhan, Heckman, Lochner, & Masterov (Citation2007) demonstrated that psycho-social or “soft” skills, such as self-esteem, motivation and ability to work in a team are often undervalued in the education system, resulting in a lack of these essential skills in later life (Barron, Citation2003; Beitchman et al., Citation2008; Borghans, Meijers, & Ter Weel, Citation2008). Other studies demonstrated, that early childhood education can achieve a substantial level of skill development compared to the required effort to teach these skills to adolescents or adults (Borghans et al., Citation2008; Cunhan et al., Citation2007; Durkin, Simkin, Knox, & Conti-Ramsden, Citation2009; Heckman, Citation2011; Miniscalco, Hagberg, Kadesjö, Westerlund, & Gillberg, Citation2007).

Children with speech-/language impairment are disadvantaged from early childhood onwards, and lasting effects are often present into adulthood (Clark et al., Citation2007; McLeod & McKinnon, Citation2007; Wadman, Botting, Durkin, & Conti-Ramsden, Citation2011). In lower Saxony, Germany, children with severe speech- and language impairment are able to attend “speech therapy kindergartens” (STK) during their pre-school years. This system has been in place since the 1980s (Flöther, Schlüter, & Bruns, Citation2011).

Affected children tend to have a variety of speech and language deficits. Assessment by speech therapists and medical doctors is a prerequisite for attendance at an STK. This assessment confirms that the child’s speech-/language impairment qualifies him/her for additional therapy, and excludes other, possibly treatable, medical issues.

Children aged 4–6 years attend an STKs, and therapy is designed based on the assumption that any speech-/language impairment is curable. One childcare worker is responsible for up to four children leading to a good personal relationship between the children and the childcare worker. The childrens’ education is additionally supported by speech therapists, occupational- and physiotherapists and psychologists.

The author’s own findings demonstrate that, approximately 75% of children with significant language impairment attending an STK were later able to attend a regular secondary school. Approximately 25% of children require on-going support in specialised secondary schools with further learning support (Ullrich, Ullrich, & Marten, Citation2009, 2014).

Cognitive and speech-/language skills are important for on-going success in education, as are psycho-social skills and social support structures for children, particularly for those with a speech impairment. However, the impact of social-emotional and non-cognitive skills on a positive child development are frequently underestimated. In the present study, the authors aimed to conduct a comprehensive assessment of cognitive, language and non-cognitive skills, as well as social and epidemiological parameters, which may affect the speech-/language-impaired child`s sustainable learning abilities. So the study is focussing on the impact of social-emotional and non-cognitive skills and the educational outcome of speech-/language disturbed children. Once the importance of individual parameters for long-term educational success has been evaluated, education programs and therapy for children with SL impairment can be optimised accordingly.

2. Methods

The study was designed as a prospective, longitudinal study, with some retrospective data collection for completeness. The study population included 19 children (7 girls, 12 boys), aged 10–18 years, with a median age of 13 years. All children had attended the same study STK near Hannover, Germany between 2000 and 2007 for a median duration of 16 months (range 11–35 months).

As described above, SL education in the STK follows a multidisciplinary approach involving childcare staff, speech therapists and physiotherapists as well as psychologists. The concept is based on the assumption, that almost every affected child is treatable to such an extent that it can be educated at a regular primary and secondary school. Prerequisites for enrolment in the STK include disturbed speech-/language development, unsuccessful intensive outpatient therapy and exclusion of any major medical illness.

Upon admission to the STK children were approximately 4 years old and verbal communication skills were severely limited or non-existent. After therapy had been completed all children were 6–7 years old and continued their primary school education at a regular elementary school. Questionnaires assessed further education following discharge from the STK. Informed consent for data collection and publication of results was obtained from participants and their parent or legal guardian. The study adheres to the Declaration of Helsinki.

The various language, cognitive and non-cognitive skills as well as psycho-social skills and social-epidemiological parameters assessed are listed in Table . Table describes the various skills as well as their different sources of assessment and test procedures conducted in greater detail.

Table 1. Psycho-social parameters, language and other skills assessed in the study cohort

Table 2. Skills examined, sources and test procedures

The evaluation is based on a variety of assessments performed at dismissal from the STK, case-note entries from the STK and questionnaires conducted in 2007 and 2011. Some skills are influenced by a variety of factors and are used as surrogate parameters. Self-esteem, for example, is thought to be a surrogate parameter, which includes abilities such as conscientiousness, openness to experience, extroversion, agreeableness and emotional stability.

For statistical analysis, some qualitative markers had to be converted to quantitative ones. Various abilities of the study population were grouped into categories of “below average”, “average” and “above average”, thus allowing for statistical comparisons. The ratings for the various skills were based on case-notes on the children, which include staff reports, psychological examinations and various test procedures. If the parameters were not well-defined, such as “self-esteem” the ranking was based on the summary of various information and an evaluation performed by three independent educational members of the staff. Speech- and language skills have been combined because in most children impaired language development was the main problem. The parameters, the specific evaluation of these parameters and their rankings are illustrated in Table .

Table 3. Skills/parameters examined and assessment criteria

Statistical analysis was computed using Microsoft Excel software and outcomes included frequency, relative frequency, mode, median and range.

3. Results

All children included in this study attended a regular primary school after discharge from the STK. Five children (2 girls, 3 boys) had to transfer to a “school for children with special needs” (SFL) after several years. The remaining study population (14 children: 5 girls, 9 boys) was attending a regular secondary or grammar school (RS) at time of assessment. On admission to the STK none of the children were able to communicate verbally. However, at commencement of regular primary school the speech-/language competencies for “understanding behaviour”, “vocabulary” and “grammar” were significantly worse (p ≤ 0,05) in children later attending a school for special needs (SFL) compared to those attending a regular school (RS). Figure illustrates the findings concerning the children’s language abilities upon admission to primary school. The data show the number of children with below average (BA), average (A) and above average (AA) skills of various language/speech parameters when attending either SFL or RS during their later educational development. Findings illustrate that, especially children lacking understanding behaviour, vocabulary skills and grammar ability have a high chance to attend the SFL after primary school education.

Figure 1. Frequency distribution of speech-/language skills according to the assessment criteria “Average”(A), “Below Average”(BA) and “Above Average” (AA) in children later attending “regular schools” (RS) (n = 14) or “school for special needs”(SFL) (n = 5). Mode is shown in the figures; the criteria “oral function” and “articulation” in SFL-children is based on the assessment of four children

Figure 1. Frequency distribution of speech-/language skills according to the assessment criteria “Average”(A), “Below Average”(BA) and “Above Average” (AA) in children later attending “regular schools” (RS) (n = 14) or “school for special needs”(SFL) (n = 5). Mode is shown in the figures; the criteria “oral function” and “articulation” in SFL-children is based on the assessment of four children

Figure analyses the impact of various cognitive and non-cognitive skills, as well as social-epidemiological parameters, such as number of siblings, socio-economic circumstances, measured non-verbal intelligence quotient (IQ). Similar to Figure the relative fractions of the children with “average” or “above/below average” parameters are shown. Findings presented in Figure suggest that “number of siblings”, “IQ”, “self-esteem”, “auditory-visual perception” and “creativity” are significantly different (p ≤ 0.05) in the two groups. The results indicate the impact of these skills on long-term school education in language/speech impaired children. According to these findings the surrogate parameter “language-/speech skills” seems to be of minor importance for long-term education.

Figure 2. Frequency distribution of different psycho-social skills and social data according to the assessment criteria “Average”(A), “Below Average”(BA) and “Above Average” (AA) in children later attending “regular schools” (RS) (n = 14) or “school for special needs”(SFL) (n = 5). Mode is shown in the figures

Figure 2. Frequency distribution of different psycho-social skills and social data according to the assessment criteria “Average”(A), “Below Average”(BA) and “Above Average” (AA) in children later attending “regular schools” (RS) (n = 14) or “school for special needs”(SFL) (n = 5). Mode is shown in the figures

While, those children attending an SFL have at least two or more “below average” ratings with respect to “ideas during play”, “IQ” and “self-esteem”, the subgroup of children attending an RS were deemed to have average and above average skills in these areas.

4. Discussion

Cognitive and speech-/language abilities in combination with epidemiological factors are usually considered essential for successful school education (Beitchman et al., Citation2008; Clark et al., Citation2007; Nelson, Nygren, Walker, & Panoscha, Citation2006; van Agt, van der Stege, de Ridder-Sluiter, Verhoeven, & de Koning, Citation2007). Therefore, the education system often places less emphasis on psycho-social and emotional skills, including in children with speech-/language impairment or delay. The present observational study was conducted to test the authors` hypothesis that the impact of psycho-social and emotional skills in those children is underestimated.

Several studies demonstrated that children with speech-/language impairment, who do not receive specific support, continue to experience a variety of problems concerning language, social skills, psychological problems and education well into adulthood (Cohen, Barwick, Horodezky, Vallance, & Im, Citation1998; Conti-Ramsden, Durkin, Simkin, & Knox, Citation2009; Heckman, Citation2011; Needlman, Citation1996).

The current study assesses children with significant speech-/language impairment, as no child in the cohort was able to communicate verbally at age 4–4.5 years. After conclusion of early childhood education in kindergartens with integrated speech-/language therapy, i.e. STK, they were able to attend a regular primary school. Children suffering from language/speech impairment during kindergarten years seem to be able to develop sufficient abilities (i.e. physical production of language, phonology) in order to attend a regular school. However, language competencies, which are important for identity formation, describing emotions and ideas seem to be underdeveloped, especially in those children later turning to the SFL. Impaired self-esteem and creativity appear to be (at least partially) harmful consequences of persisting language disorders (Jackson, Cavenagh, & Clibbens, Citation2014; McCrosky, Richmond, Daly, & Falcione, Citation1977). In the present study, epidemiological and social factors, such as the number of siblings or the parents’ income, are of lower importance for the further education path. The aforementioned low influence of social parameters, i.e. number of siblings and family income, on the children’s further education contrasts (partially) the findings of other studies by Needlman (Citation1996), Nelson et al. (Citation2006) or Ryan, Claessens, and Markowitz, (Citation2015).

In the present study, the critical factors for successful long-term education include a combination of interdependent skills, such as language, cognitive, emotional, psycho-social skills. In particular, IQ and the soft skills “self-esteem” and “perception of one’s environment”, as well as “creativity during play” were thought to be important.

A previous study has demonstrated, that intelligence is an important factor for successful schooling (Ullrich et al., Citation2009, 2014) in SL-impaired children. Findings of the present study indicate that average and higher IQ may be helpful to compensate for deficits in language competency as well as auditory perception. Contrary to popular opinion, IQ can be modified partially by social-emotional influences and therefore, it is amendable by education (Borghans et al., Citation2008; Cunhan et al., Citation2007).

Psycho-social aspects and skills, such as self-esteem are thought to represent surrogate parameters for children’s individual characteristics, and they may affect other abilities. The importance of social and emotional skills for daily life and integration into society and the workforce is generally underestimated and should be emphasised by educators (Barron, Citation2003; Borghans et al., Citation2008; Coleman, Citation1998; Cunhan et al., Citation2007; Heckman, Citation2011). The importance of those non-cognitive skills for school success and/or problem-solving abilities have been assessed by Barron (Citation2003) and Coleman (Coleman, Citation1998) in more detail.

The skills “auditory-visual perception” and “creativity during playtime” demonstrate a combination of cognitive and non-cognitive skills, thus functioning as surrogate parameters. For example, children’s interest in their surroundings and their ability to deal with frustration, as well as their motivation to develop new games and skills demonstrate non-cognitive skills. In comparison, abstract thinking during play or recognition and matching of pictures and sounds represents cognitive skills. Various studies demonstrate, that during child development in children with an average IQ disturbed auditory-visual perception becomes negligible in the majority of cases (Keilmann & Wintermeyer, Citation2008; Norrix, Plante, Vance, & Boliek, Citation2007; von Suchodoletz, Alberti, & Berwanger, Citation2004).

The results of the current study suggest, that children attending specialised kindergartens with speech-/language therapy, i.e. STK, have not only to develop their speech-/language abilities, but also improve both, their psycho-social and cognitive skills considerably. This improvement is thought to be a relevant part of education, so that these children can attend a regular primary school without problems later (Cunhan et al., Citation2007; Paterson, Heim, Friedman, Choudhury, & Benasich, Citation2006).

The findings of this study support the hypothesis, that soft skills, such as “self esteem”, “creativity” and “auditory-visual perception” are important factors in early education of speech-/language impaired children. Training these skills helps children to attend regular primary schools, despite problems in other areas, such as SL-competencies.

5. Conclusion

Early childhood education with integrated speech-/language therapy can improve children’s language skills, as well as their psycho-social and emotional capabilities. The present study illustrates the importance of multidisciplinary early childhood education, both, with integrated speech-/language therapy and pedagogic support of psycho-social and emotional skills. According to the authors’ opinion the significance of psycho-social and emotional skills is frequently underestimated. However, this study indicates, that the combination of these various means are essential for successful education and integration into society in later life.

Funding

The authors received no direct funding for this research.

Additional information

Notes on contributors

Dieter Ullrich

The authors are an interdisciplinary group (paediatrician, ENT, specialised educator) involved in practice and theory in the education of language- and/or speech-impaired pre-school children. In lower Saxony/Germany, those children with severe speech- and/or language impairment are able to attend a “speech-language therapy kindergarten”. The authors are not only interested in the development of the children during “kindergarten education” but also in long-term school education and the various skills/qualifications crucial for success or failure later. Theoretical knowledge and actual scientific findings have proved to be helpful in the improvement of practical work.

References

  • Barron, B. (2003). When smart groups fail. Journal of the Learning Sciences , 12 , 307–359.10.1207/S15327809JLS1203_1
  • Beitchman, J. H. , Jiang, H. , Koyama, E. , Johnson, C. J. , Escobar, M. , Atkinson, L. , … Vida, R. (2008). Models and determinants of vocabulary growth from kindergarten to adulthood. Journal of Child Psychology and Psychiatry , 49 , 626–634. doi:10.1111/j.1469-7610.2008.01878.x
  • Borghans, L. E. X. , Meijers, H. , & Ter Weel, B. A. S. (2008). The role of noncognitive skills in explaining cognitive test score. Economic Inquiry , 46 , 2–12.10.1111/ecin.2008.46.issue-1
  • Cattell, R. , Weiss, R. , & Osterland, J. (1997). CFT1. Grundintelligenztest Skala 1 (5th ed.). Göttingen: Hogrefe.
  • Clark, A. , O’Hare, A. , Watson, J. , Cohen, W. , Cowie, H. , Elton, R. , & Seckl, J. (2007). Severe receptive language disorder in childhood–familial aspects and long-term outcomes: Results from a Scottish study. Archives of Disease in Childhood , 92 , 614–619. doi:10.1136/adc.2006.101758
  • Cohen, N. J. , Barwick, M. A. , Horodezky, N. B. , Vallance, D. D. , & Im, N. (1998). Language, achievement, and cognitive processing in psychiatrically disturbed children with previously identified and unsuspected language impairments. Journal of Child Psychology and Psychiatry , 39 , 865–877.10.1111/jcpp.1998.39.issue-6
  • Coleman, E. (1998). Using explanatory knowledge during collaborative problem solving in science. Journal of the Learning Sciences , 7 , 387–427.10.1080/10508406.1998.9672059
  • Conti-Ramsden, G. , Durkin, K. , Simkin, Z. , & Knox, E. (2009). Specific language impairment and school outcomes. I: Identifying and explaining variability at the end of compulsory education. International Journal of Language & Communication Disorders , 44 , 15–35.10.1080/13682820801921601
  • Cunhan, F. , Heckman, J. , Lochner, J. , & Masterov, D. (2007). Interpreting the evidence on life cycle skill formation. In E. A. Hanushek , & F. Welch (Eds.), Handbook of the economics of education (pp. 687–812). Amsterdam: North Holland.
  • Durkin, K. , Simkin, Z. , Knox, E. , & Conti-Ramsden, G. (2009). Specific language impairment and school outcomes. II: Educational context, student satisfaction, and post-compulsory progress. International Journal of Language & Communication Disorders , 44 , 36–55. doi:10.1080/13682820801921510
  • Flöther, M. , Schlüter, E. , & Bruns, T. (2011). Multidisciplinary assessment and treatment of children with hearing and language disorders – Results of the effectiveness of a concept from Lower Saxony, Germany. Interdisziplinär , 19 , 282–292.
  • Fox, A. (2011). TROG-D – Test zur Überprüfung des Grammatikverständnisses (5th ed.). Idstein: Schulz-Kirchner-Verlag.
  • Glogowska, M. , Roulstone, S. , Peters, T. J. , & Enderby, P. (2006). Early speech- and language-impaired children: Linguistic, literacy, and social outcomes. Developmental Medicine & Child Neurology , 48 , 489–494. doi:10.1017/s0012162206001046
  • Grimme, H. , & Schöler, H. (1991). HSET – Heidelberger Sprachentwicklungstest . Göttingen: Hogrefe.
  • Hammill, D. , Pearson, N. , & Voress, J. (2007). Developmental Test of Visual Perception 2nd edit (DTVP-2) . Göttingen, Bern: Hogrefe.
  • Heckman, J. (2011). Integrating personality psychology into economics. NBER working paper series . Retrieved from https://www.nber.org/papers/w17378
  • Hild, U. (2002). Bilderbuch zur Aussprachediagnostik bei Kindern . Kassel: Orca GbR.
  • Grimm, H. , Aktas, M. , & Frevert, S. (2001). SETK – 3–5, Sprachentwicklungstest für 3–5jährige Kinder . Göttingen: Hogrefe.
  • Jackson, C. , Cavenagh, P. , & Clibbens, J. (2014). Communication and self-esteem in adults with Down-syndrome. International Journal of Language & Communication Disorders , 49 , 275–287.10.1111/jlcd.2014.49.issue-3
  • Keilmann, A. , & Wintermeyer, M. (2008). Is a specialised training of phonological awareness indicated in every preschool child? Folia Phoniatrica et Logopaedica , 60 , 73–79. doi:10.1159/000114648
  • Kiese-Himmel, C. (2005). AWST-R – Aktiver Wortschatztest für 3–5jährige Kinder . Göttingen: Hogrefe.
  • McCrosky, J. C. , Richmond, V. P. , Daly, J. A. , & Falcione, R. L. (1977). Studies of the relationship between communication apprehension and self-esteem. Human Communication Research , 3 , 269–277.10.1111/hcre.1977.3.issue-3
  • McLeod, S. , & McKinnon, D. H. (2007). Prevalence of communication disorders compared with other learning needs in 14,500 primary and secondary school students. International Journal of Language & Communication Disorders , 42 , 37–59. doi:10.1080/13682820601173262
  • Miniscalco, C. , Hagberg, B. , Kadesjö, B. , Westerlund, M. , & Gillberg, C. (2007). Narrative skills, cognitive profiles and neuropsychiatric disorders in 7-8-year-old children with late developing language. International Journal of Language & Communication Disorders , 42 , 665–681. doi:10.1080/13682820601084428
  • Needlman, R. (1996). Growth and development. In R. Behrman , R. Kliegman & A. Arvin (Eds.), Nelson textbook of pediatrics (15th ed., pp. 44). Philadelphia, PA: WB Saunders.
  • Nelson, H. D. , Nygren, P. , Walker, M. , & Panoscha, R. (2006). Screening for speech and language delay in preschool children: Systematic evidence review for the US preventive services task force. Pediatrics , 117 , e298–e319. doi:10.1542/peds.2005-1467
  • Norrix, L. W. , Plante, E. , Vance, R. , & Boliek, C. A. (2007). Auditory-visual integration for speech by children with and without specific language impairment. Journal of Speech Language and Hearing Research , 50 , 1639–1651. doi:10.1044/1092-4388(2007/111)
  • Paterson, S. J. , Heim, S. , Friedman, J. T. , Choudhury, N. , & Benasich, A. A. (2006). Development of structure and function in the infant brain: Implications for cognition, language and social behaviour. Neuroscience & Biobehavioral Reviews , 30 , 1087–1105. doi:10.1016/j.neubiorev.2006.05.001
  • Ricken, G. , Fritz, A. , Schuck, K. , & Preuss, U. (Eds.). (2007). HAWIVA III – Hannover-Wechsler-Intelligenztest für das Vorschulalter III . Göttingen: Huber-Verlag/Hogrefe.
  • Ryan, R. M. , Claessens, A. , & Markowitz, A. (2015). Associations between family structure change and child behaviour problems: The moderating effect of family income. Child Development , 86 , 112–127.10.1111/cdev.2015.86.issue-1
  • Snijders-Oomen (1997). Non-verbal Intelligence Test SON-R 2 ½ – 7 . ( P. Tellegen , M. Winkel , B. Wijnberg-Williams , & J. Laros , Eds.). Lisse: Swets & Zeitlinger B.V.
  • von Suchodoletz, W. , Alberti, A. , & Berwanger, D. (2004). Are specific developmental language disorders caused by deficits in auditory perception? Klinische Pädiatrie , 216 , 49–56. doi:10.1055/s-2004-823147
  • Ullrich, D. , Ullrich, K. , & Marten, M. (2009). Long-term school-development of children with impaired language skills: 15-Years follow up after dismissal from child care centres with speech therapy. Laryngorhinootologie , 88 , 647–652. doi:10.1055/s-0029-1220945#
  • Ullrich, D. , Ullrich, K. , & Marten, M. (2014). A longitudinal assessment of early childhood education with integrated speech therapy for children with significant language impairment in Germany. International Journal of Language & Communication Disorders , 49 , 558–566. doi:10.1111/1460-6984.12092
  • van Agt, H. M. , van der Stege, H. A. , de Ridder-Sluiter, H. , Verhoeven, L. T. , & de Koning, H. J. (2007). A cluster-randomized trial of screening for language delay in toddlers: Effects on school performance and language development at age 8. Pediatrics , 120 , 1317–1325. doi:10.1542/peds.2006-3145
  • Wadman, R. , Botting, N. , Durkin, K. , & Conti-Ramsden, G. (2011). Changes in emotional health symptoms in adolescents with specific language impairment. International Journal of Language & Communication Disorders , 46 , 641–656. doi:10.1111/j.1460-6984.2011.00033.x
  • Ziler, H. , Brosat, H. , & Tötemeyer, N. (2007). Der Mann-Zeichen-Test . Göttingen: Hogrefe.
  • Zimmer, R. , & Volkamer, M. (1987). MOT 4–6; Motoriktest für vier- bis sechsjährige Kinder (2nd ed.). Beltz, Landsberg: Verlag Weinheim.