1,852
Views
4
CrossRef citations to date
0
Altmetric
Original Articles

Validation and Standardization of the Dutch Trauma Symptom Checklist for Young Children in a Normative and Clinical Sample

, ORCID Icon &
Pages 1-14 | Received 06 Jan 2016, Accepted 20 Feb 2017, Published online: 24 Apr 2017

ABSTRACT

The study aimed to describe the psychometric properties of the Dutch version of the Trauma Symptom Checklist for Young Children (TSCYC) in normative and clinical populations in the Netherlands. Caregivers’ ratings on the TSCYC were obtained for 1,802 children from the normal population, and for 515 children from a clinical population of traumatized children. In the clinical sample, additional measures were taken. The internal consistency and test-retest reliability of TSCYC scales were adequate. Confirmatory factor analysis showed acceptable fit on the putative scale structure. Regarding criterion validity, the clinical sample scored significantly higher on all clinical scales when compared to the normal population sample. Within the clinical sample, significant associations were found between TSCYC scales and convergent scales of other instruments. The Posttraumatic Stress-Total subscale demonstrated excellent discriminative ability between traumatized children and children from the normal population. The Dutch version of the TSCYC proved a valid and reliable instrument to measure trauma symptoms in young children through caregiver report, similar to the original American version. Further comparisons with diagnostic interviews are warranted.

Throughout their childhood, children may be exposed to different traumatic events including but not limited to child maltreatment, witnessing domestic violence, violence by peers, community and school violence, severe diseases, traffic accidents, and natural catastrophes. Children’s exposure to such threatening life events, and even less overwhelming experiences as divorce or (mental) illness of a family member, is associated with a wide range of possible mental health outcomes (Osofsky, Citation1995). These outcomes include low self-esteem and other self-cognitions (Evans, Davies, & DiLillo, Citation2008), anxiety and depression (Springer, Sheridan, Kuo, & Carnes, Citation2007), post-traumatic stress and dissociation (Stuber, Shemesh, & Saxe, Citation2003), problematic behavior or conduct disorders (Chan & Yeung, Citation2009), (psycho)somatic problems (Lamers-Winkelman, De Schipper, & Oosterman, Citation2012; Springer et al., Citation2007), suicidal and self-mutilating behavior (Cicchetti, Rogosch, Sturge-Apple, & Toth, Citation2010), anger and aggression (Litrownik, Newton, Hunter, English, & Everson, Citation2003), and, especially in the case of sexual abuse, age inappropriate sexual behavior and coercive sexual behavior (Kellogg, Citation2010). Due to the large number of children victimized by any form of violence and the many negative psychological consequences, early identification of trauma-related problems in children is needed.

Before the Trauma Symptom Checklist for Young Children (TSCYC) was introduced by Briere et al. in Citation2001, there were no standardized broad spectrum trauma questionnaires available for young children, beside a nonspecific symptom questionnaire for children, the Child Behavior Checklist (CBCL; Achenbach, Citation1991), and the Child Sexual Behavior Inventory (CSBI; Friedrich, Citation1997) to assess symptoms related to sexual abuse of children. The TSCYC is a caregiver report for young children, aged 3–12 years. This instrument showed adequate psychometric properties in clinical populations (Pollio, Glover-Orr, & Wherry, Citation2008) and in the normal population (Radford, Corral, Bradley, & Fisher, Citation2013). So far, there have been few studies in which the TSCYC was translated into different languages, and psychometric properties were tested. Recent studies into a Swedish version of the TSCYC (Nilsson, Gustafsson, & Svedin, Citation2012) and a Korean version (Bae, Jeong, Lee, & Chung, Citation2015) showed promising results. In both studies the scale structure was confirmed, the internal consistency of the total scale was high (between .92 and .96), and the internal consistencies of the subscales were adequate. Furthermore, the ability to discriminate between traumatized children and children from the normal population, was evident in both studies.

The TSCYC was first translated into Dutch by Lamers-Winkelman in Citation2007, for use in the Haarlem Trauma Center for Children in the Netherlands. The 90 items were translated into Dutch and back translated by an American native speaker (experienced trauma specialist) who resided in the Netherlands for 20 years. Based on the differences between the back translation and the original version, and to improve comprehensibility, small adjustments to some of the items were made. The final version was sent for acceptance to the publisher of the original scale. This version was tested in this study. The aim of this study was to investigate the psychometric properties concerning gender and age and sex group differences, internal consistency, test-retest reliability, construct validity, criterion validity, convergent and divergent validity, and predictive validity, of the Dutch version of the TSCYC in a normative and clinical population in the Netherlands.

Method

Participants

The Dutch version of the TSCYC was tested in a standardization sample originating from the PanelClix panel. This internet panel consists of 150,000 members who participate in various surveys for a small fee (PanelClix online market research, Citation2016). To test for differences between the original age group and gender combinations in the American validation sample (Briere, Citation2005), a sample of caregivers of 300 boys and 300 girls in each of three age groups: 3–4, 5–9, and 10–12 years, was generated within PanelClix, sampling to a total of 1,802 children. The PanelClix algorithm selected potential respondents based on equal numbers of children (boys and girls) in the age groups. Other factors PanelClix used to generate a representative sample were geographic region (i.e., Conurbation of Western Netherlands, other Western, Northern, Eastern, and Southern Netherlands), parental education level, and ethnicity. This stratification by demographic variables addresses self-selection bias from respondents from different demographic subgroups.

Selected participants in the panel were invited by email to participate in the panel wave. First, respondents filled in the selection questions to establish that they belonged to the target group (families with children between 3–12 years old), before they were automatically assigned to the online questionnaire. Next, respondents were invited for this study with a focused invitation providing full informed consent. Participation was voluntary. Based on the answers, the respondents were assigned to six groups defined by gender and age category. Respondents who did not meet the criteria or who were no longer needed, were led to the end of the questionnaire after the initial screening questions.

reports demographic data of the standardization sample in comparison with the general population. Of the 1,802 children, 50% were male. Within each age group, each year was evenly distributed. The average age of the caregivers was 38.3 years (range 18 to 67) and 43% of the caregivers were male.

Table 1. Demographical Characteristics of the Standardization Sample and Population.

Clinical group

Following Briere et al. (Citation2001), a clinical sample was assessed alongside the standardization sample. The clinical sample was composed of traumatized children referred to several childhood trauma centers in the Netherlands. The TSCYC was completed by the caregivers during the standard intake for treatment programs for traumatized children. Beside the TSCYC, the caregivers also completed the CBCL, the CSBI, the Children’s Depression Inventory (CDI; Kovacs, Citation1992), and the Child Dissociation Checklist (CDC; Putnam, Helmers, & Trickett, Citation1993). A total of 515 caregivers completed the TSCYC and provided the data anonymously for validation. The sample consisted of children of whom 50% were sexually abused, and 48% were victimized by witnessing domestic violence in the family. For 2% of the children, the form of child abuse was unknown. The mean age of the children was 7.9 years (SD = 2.4 years) and 50% were boys. Over 61% of the caregivers was of Dutch origin, 24% had another ethnic background, and of 15% of the caregivers, the ethnic origin was unknown.

Test-retest group

The test-retest group was composed of 100 randomly selected respondents from the standardization sample who agreed to complete the TSCYC a second time for the same children after 3 weeks (52 girls and 48 boys, mean age = 7.2 years, SD = 3.2).

Instruments

The TSCYC, developed by Briere et al. (Citation2001), is a caregiver report assessment of trauma symptoms in children ages 3–12 years. The manual was published in 2005. The TSCYC consists of 90 items in the form of symptoms related to traumatic events, which parents rate on a scale from 0 (not at all) to 4 (very often) on how often it occurred in the last month. The TSCYC consists of nine clinical scales: Anxiety, Depression, Anger/Aggression, Posttraumatic Stress-Intrusion, Posttraumatic Stress-Avoidance, Posttraumatic Stress-Arousal, Posttraumatic Stress-Total, Sexual Concerns and Dissociation, and two validity scales, for underreport (Response Level) and for Atypical Response. In the original validation study, Briere (Citation2005) found good internal reliability levels for all clinical scales in both the normative and clinical sample, ranging from α = .78 for the Anxiety scale in the normative sample to α = .93 for the Posttraumatic Stress-Total scale in the clinical sample.

The CDI (Kovacs, Citation1992) is one of the best studied, and most widely used scales for childhood depression (Myers & Winters, Citation2002). It is a self-report measure to assess depression in children (7–17 years of age), which consists of 27 items, rated on a 3-point scale (0 = not true, 1 = somewhat true, 2 = very true), reflecting the degree of symptoms over the past 2 weeks. Both a total score (from 0 to 54) and a score on five sub-scales (Negative Mood, Interpersonal Problems, Ineffectiveness, Anhedonia, and Negative Self-Esteem) are computed. Cronbach’s alpha of the total score was .88 (Kovacs, Citation1992). In the current study, only the total score was used.

The CSBI (Friedrich, Citation1997) for caregivers of children ages 2–12 years contains 38 items across the following content domains: Boundary Issues, Gender Role Behavior, Sexual Interest, Sexual Knowledge, Exhibitionism, Self-Stimulation, Sexual Intrusiveness, Voyeuristic Behavior, and Sexual Anxiety. The frequency of the behavior, as observed by the caregiver during the past 6 months, is rated on a 4-point scale ranging from 0 (never) to 3 (at least once a week). The internal consistency of the total score has been found high in both clinical and normative samples, respectively, α = .93 and α = .82 (Friedrich, Citation1997).

The CDC (Putnam et al., Citation1993) for caregivers of children ages 5–15 years contains 20 items, rated on a 3-point scale from 0 (not true) to 2 (very true), to describe the child’s behavior on a given item over the past 12 months. A total score is computed, which showed excellent reliability (α = .96) in the validation study (Putnam et al., Citation1993). A total score of 12 or higher gives a good indication of the presence of dissociative psychopathology (Putnam et al., Citation1993). The Dutch translation of the CDC was used in the present study (Hartvelt & Janssen, Citation1992).

The CBCL (Achenbach, Citation1991) is a caregiver report about competencies and behavioral problems of children from 4–18 years old. The list contains 120 items; response options range from 0 (not true) to 2 (very true or common) in the past 6 months. The list includes eight syndrome scales of which the following two were used in the present study: Anxious/Depressed (α = .76), and Aggressive Behavior (α = .76), and scales for Internalizing behavior, composed of three problem scales (α = .87) and Externalizing behavior, composed of two problem scales (α = .87), and a Total problems scale, composed of all eight problem scales (α = .94). The score on the list reveals a profile that indicates whether the child scores above the clinical cutoff or within normal range (Achenbach, Citation1991). There is considerable evidence for the reliability and validity of the CBCL (Achenbach, Citation1991) and for the Dutch translation (Verhulst, Van Der Ende, & Koot, Citation1996) used in the current study.

Statistical analysis

Differences in TSCYC scores between gender and age groups and the reproduction of the original gender and age groups (Briere, Citation2005) were tested using multivariate analysis of variance (MANOVA). Internal consistency was estimated with Cronbach’s α. Test-retest reliability was examined using the intraclass correlation coefficient (ICC). Construct validity was assessed by zero-order correlation (Pearson’s r) between TSCYC scales and by confirmatory factor analysis (CFA) for which maximum likelihood as estimation method was used (AMOS 22.0). Criterion validity was estimated by comparing differences in TSCYC scores between reference and clinical groups, using MANOVA. For this analysis, the clinical group was matched with a control group from the standardization sample. The control group consisted of 515 children with the same proportion by gender and age as in the clinical sample (257 girls and 258 boys, mean age = 7.9 years, SD = 2.4 years). Convergent and divergent validity was analyzed by zero-order correlation between TSCYC scales and corresponding scales in different instruments (CSBI, CDI, CBCL, and CDC) in the clinical sample. Predictive validity was based on receiver operating characteristics (ROC) curves for the distinction between samples on TSCYC scores.

Results

Gender and age group differences in the standardization sample

In MANOVA of gender by age group (2 * 10), multivariate main effects were found for sex, F(10, 1,773) = 4.11, p < .001, partial η2 = .023, and age, F(90, 12,035.33) = 3.63, p < .001, partial η2 = .020. In the original validation study by Briere (Citation2005), the largest differences occurred at a division of age into three categories: 3–4, 5–9, and 10–12 years, one-way MANOVA, F(20, 1,476) = 5.12, p < .001, partial η2 = .065. The same results were obtained in the current study with the same three age groups: one-way MANOVA, F(20, 3,580) = 12.11, p < .001, partial η2 = .063. The interaction effect between gender and the three age groups was small but significant: MANOVA, F(20, 3,574) = 1.60, p = .044, partial η2 = 0.009.

Scale structure in standardization sample and clinical group

The CFAs showed acceptable results with respect to the scale structure used in the original TSCYC, with eight clinical subscales and two validity subscales. Although the value of the relative chi-square (chi-square fit index divided by degrees of freedom) in the standardization sample was too high for an acceptable fit (6.17) and the value was statistically significant; the value of the relative chi-square in the clinical sample was at 2.24, more acceptable. Both the RMSEA and SRMR showed acceptable values in both samples (standardization sample: RMSEA = .054, SRMR = .063; clinical sample: RMSEA = .051, SRMR = .069). The difference in relative chi-square value might be caused by the difference in population size. Therefore, the same analysis was performed in subsamples of only respondents with (sub-) clinical scores on the TSCYC (standardization sample: n = 354; clinical sample: n = 431). The relative chi-square was almost equal in both groups (standardization sample: 2.05; clinical sample: 2.15) and showed an acceptable fit, as did the other values (standardization sample: RMSEA = .055, SRMR = .083; clinical sample: RMSEA = .052, SRMR = .071).

Reliability

Internal consistency

The internal consistency of the TSCYC was calculated in the standardization and clinical sample using Cronbach’s alpha. The results (see ) demonstrated adequate internal consistency of the TSCYC scales in both samples, except for the Atypical Response scale.

Table 2. Internal Consistency of TSCYC Scales in Both Samples.

Validity scales

The internal consistency of the Response Level scale was relatively high, with alphas of .80 and .85 for the standardization and for the clinical sample. However, the internal consistency of the Atypical Response scale was more variable across samples with an alpha of .93 for the standardization sample and an alpha of .37 for the clinical sample.

Clinical scales

In the standardization sample, the TSCYC clinical scales had alphas ranging from .78 for the Anxiety scale to .92 for the Posttraumatic Stress-Total scale (average of .85 for all clinical scales). In the clinical sample, the alphas for the clinical scales ranged from .79 (Posttraumatic Stress-Avoidance and Posttraumatic Stress-Arousal scale) to .91 for the Dissociation scale (average of .84 for all clinical scales).

Test-retest reliability

The ICC of the clinical scales (see ) varied between .82 (Sexual Concerns scale) and .93 (Posttraumatic Stress-Total scale), and .82 for the Response Level scale and lowest with .71 for the Atypical Response scale.

Table 3. Test-Retest Reliability Coefficient (r) TSCYC Scales for the Standardization Sample.

Validity

The validity of the TSCYC was evaluated by the inter-correlation between scales, the divergent and concurrent correlation with other instruments, and the diagnostic utility of the TSCYC to discriminate between the clinical and normal population.

Correlation among subscales

The inter-correlation between the TSCYC subscales (see ) varied between .47 (between the Sexual Concerns scale and the Posttraumatic Stress-Arousal scale) and .91 (between the Posttraumatic Stress-Total scale and the Posttraumatic Stress-Avoidance scale). As in the U.S. and Swedish standardization samples, the validity scale Response Level correlated negatively with all other scales, ranging from −.21 with the Atypical Response scale to −.55 with the Anger/Aggression scale. The Atypical Response scale is most closely associated with the Sexual Concerns scale (.89), and the least with the Response Level scale, as mentioned above.

Table 4. Correlation Between TSCYC Scales in the Standardization Sample.

To gauge the criterion validity of the TSCYC, shows the differences between the clinical sample and the control group on the TSCYC clinical scales and the results of the multivariate analysis of variance (MANOVA); multivariate main effects were found for group, control or clinical, F(8, 945) = 90.17, p < .001, partial η2 = .43. All scales showed significant differences between the clinical sample and the control group, with a moderate to large effect size (η2 ranges from .09 to .41).

Table 5. Analysis of Variance of Clinical TSCYC Scores in the Clinical Sample and the Control Group.

The sensitivity and specificity of the Posttraumatic Stress-Total subscale score was determined based on a receiver operating characteristics (ROC) analysis, in which the percentage of true-positives (sensitivity) was plotted against the false-positive rate (1—specificity) in . The ROC curve is a measure of the ability to discriminate on the basis of the Posttraumatic Stress-Total score between children with a traumatic experience (the clinical sample) and a sample from the population sample (the control group). The area under the ROC curve amounted to .90, with a 95% confidence interval of .88 to .92.

Figure 1. ROC Curve of the posttraumatic stress-total score in the clinical sample and the control group.

Figure 1. ROC Curve of the posttraumatic stress-total score in the clinical sample and the control group.

Construct validity

reports significant convergent associations between the TSCYC and the CBCL, with the highest correlation between the CBCL Aggressive Behavior scale and the TSCYC Anger/Aggression scale (.81), and CBCL Externalizing scale and the TSCYC Anger/Aggression scale (.73). The CBCL Anxious/Depressed scale correlated highest with the TSCYC Depression scale and the Posttraumatic Stress-Total scale (.70 and .62, respectively). The CBCL Internalizing scale showed the highest correlation with the TSCYC Depression (.65) and Posttraumatic Stress-Total scale (.64). The CBCL Total Problems scale correlated highest with three TSCYC scales, Posttraumatic Stress-Arousal, Posttraumatic Stress-Total and Depression (.67, .65 and .62, respectively).

Table 6. Correlation Between TSCYC Subscales, CBCL Subscales, CSBI, CDI, and CDC.

The CSBI (total) and the CDC scale were moderately associated with the equivalent TSCYC Sexual Concerns and Dissociation scale (.59 and .54, respectively). The CDI, however, was weakly associated with the TSCYC Depression scale. The clinical TSCYC scales were generally modestly associated (around .30) with scales that operationalized divergent symptom domains, which also demonstrated divergent validity.

Discussion

The findings of this study support the reliability and validity of the Dutch version of the Trauma Symptom Checklist for Young Children. The scale structure based on the U.S. original validation study showed an acceptable fit, with good discriminative and convergent validity, the clinical scales showed adequate to excellent internal reliability and good to excellent temporal stability, and the criterion validity of the Posttraumatic Stress-Total scale was excellent. The age and gender differences were congruent with those observed in the original version. In contrast with the original standardization study (Briere, Citation2005) and the Swedish standardization study (Nilsson et al., Citation2012), the proportion of men in the Dutch standardization sample was much higher (43%), although gender of the caregiver was not significantly associated with the study variables.

The test-retest reliability showed good to excellent temporal stability of the TSCYC clinical scales and the internal consistencies of all the scales were adequate, except the Atypical Response scale in the standardization sample, where a high alpha was found when a low alpha was expected. This phenomenon was also described in the original TSCYC Manual (Briere, Citation2005). In general, atypical response scales represent a tendency to respond to items which are rarely scored. Consequently, the internal consistency of such rare responses is usually low due to the limited variation in the scores. In the standardization sample a much higher standard deviation was found in the Atypical Response scores (SD = 2.1) in comparison with the clinical sample (SD = 1.0). The larger variance in the Atypical Response scores had the effect of increasing the overall variability and, as such, contributed to a higher alpha of the Atypical Response scale in the standardization sample.

The confirmatory factor analysis replicated the original ten-factor structure with acceptable Goodness of Fit values in both the standardization and the clinical sample. Based on the correlation among CBCL subscales, CSBI, CDI, and CDC with equivalent TSCYC subscales, the TSCYC showed good discriminative and convergent validity, although not all subscales correlated exactly as expected. The Depression subscale correlated highly with the CBCL Internalizing and CBCL Anxious/Depressed subscale, but lowly with the CDI. This might indicate an issue with content validity of the Depression subscale.

The comparison between the subscale scores of the standardization sample and the scores of the clinical sample showed that the clinical sample scored significantly higher on all clinical subscales, which indicates adequate criterion validity and confirmed that sexually abused children and children exposed to domestic violence were measurably more traumatized than children from the normal population. The ROC analysis of Posttraumatic Stress-Total subscale scores indicated that the Posttraumatic Stress-Total scale has an excellent ability to discriminate between children who have experienced a traumatic experience and children from the normal population. An important limitation in this study concerns the fact that the participants in the standardization sample were not questioned about possible traumatic events their children had experienced. Such a line of questioning would allow to find associations between exposure to traumatic events and TSCYC scores in the normative sample, and so contribute to criterion validity.

In his original study, Briere proposed to use T-scores, with a mean of 50 and a standard deviation of 10, for all scales based on the differences between age and gender groups and the distribution of raw scores (Briere, Citation2005). As the meaning of the values of T-scores are the same in most tests, the use of T-scores makes the meaning of the values more comprehensible. The same differences between the same age and gender groups were found in the Dutch study compared to Briere’s original study (Citation2005), which would suggest the same procedure to calculate T-scores for the Dutch population.

Briere (Citation2005) calculated standardized cutoff points for “possible concerns” and for “clinical significance.” An instrument like the TSCYC that monitors the impact of trauma on children can only be regarded as valid if it can discriminate between children who experienced traumatic events and children who have not, so the TSCYC could be used for a tentative posttraumatic stress disorder diagnosis. Future research should evaluate this function in the Dutch version in a comparison between TSCYC scores and a diagnostic interview like the Clinician-Administered PTSD Scale, Child and Adolescent version (CAPS-CA; Nader et al., Citation2004) or the Anxiety Disorder Interview Schedule (ADIS; Silverman & Albano, Citation1996). In all, the Dutch TSCYC has shown to have the characteristics required for assessing trauma symptoms in children for research, as well as screening purposes.

Funding

This article is based on research supported by a grant from the Rotterdam-Rijnmond Public Health Service in The Netherlands (PGZ/AN/mvh/2009/83/1791, Principal Investigator: Bas Tierolf).

Additional information

Funding

This article is based on research supported by a grant from the Rotterdam-Rijnmond Public Health Service in The Netherlands (PGZ/AN/mvh/2009/83/1791, Principal Investigator: Bas Tierolf).

References

  • Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-18 and 1991 profile. Burlington, VT: University of Vermont, Department of Vermont, Department of Psychiatry.
  • Bae, J. D., Jeong, J. H., Lee, J. J., & Chung, U. S. (2015). The study of reliability and validity of the Korean version of the Trauma Symptom Checklist for Young Children. Journal of Korean Medical Science, 30(9), 1340–1346. doi:10.3346/jkms.2015.30.9.1340
  • Briere, J. (2005). Trauma symptom checklist for young children. Professional manual. Odessa, FL: Psychological Assessment Resources.
  • Briere, J., Johnson, K., Bissada, A., Damon, L., Crouch, J., Gil, E., … Ernst, V. (2001). The Trauma Symptom Checklist for Young Children (TSCYC): Reliability and association with abuse exposure in a multi-site study. Child Abuse & Neglect, 25(8), 1001–1014. doi:10.1016/S0145-2134(01)00253-8
  • Chan, Y. C., & Yeung, J. W. K. (2009). Children living with violence within the family and its sequel: A meta-analysis from 1995–2006. Aggression and Violent Behavior, 14, 313–322. doi:10.1016/j.avb.2009.04.001
  • Cicchetti, C., Rogosch, F. A., Sturge-Apple, M., & Toth, L. (2010). Interaction of child maltreatment and 5-HTT polymorphisms: Suicidal ideation among children from low-SES backgrounds. Journal of Pediatric Psychology, 35, 536–546. doi:10.1093/jpepsy/jsp078
  • Evans, S. E., Davies, C., & DiLillo, D. (2008). Exposure to domestic violence: A meta-analysis of child and adolescent outcomes. Aggression and Violent Behavior, 13(2), 131–140. doi:10.1016/j.avb.2008.02.005
  • Friedrich, W. N. (1997). The child sexual behavior inventory professional manual. Odessa, FL: Psychological Assessment Resources.
  • Hartvelt, G., & Janssen, M. (1992). Nederlandse vertaling van de Child Dissociative Checklist (CDC). Amsterdam, the Netherlands: Vrije Universiteit.
  • Kellogg, N. D. (2010). Sexual behaviors in children: Evaluation and management. American Family Physician, 82(10), 1233–1238.
  • Kovacs, M. (1992). Children’s depression inventory. North Tonawanda, NY: Multi-Health Systems.
  • Lamers-Winkelman, F., De Schipper, J. C., & Oosterman, M. (2012). Children’s physical health complaints after exposure to intimate partner violence. British Journal of Health Psychology, 17(4), 771–784. doi:10.1111/j.2044-8287.2012.02072.x
  • Litrownik, A. J., Newton, R., Hunter, W. M., English, D., & Everson, M. D. (2003). Exposure to family violence in young at-risk children: A longitudinal look at the effects of victimization and witnessed physical and psychological aggression. Journal of Family Violence, 18(1), 59–73. doi:10.1023/A:1021405515323
  • MOA. (2013). Gold Standard. MOA. Retrieved from http://www.moaweb.nl/services/services/gouden-standaard.html
  • Myers, K., & Winters, N. C. (2002). Ten-year review of rating scales. II: Scales for internalizing disorders. Journal of the American Academy of Child & Adolescent Psychiatry, 41(6), 634–659. doi:10.1097/00004583-200206000-00004
  • Nader, K. O., Newman, E., Weathers, F. W., Kaloupek, D. G., Kriegler, J. A., & Blake, D. D. (2004). Clinician administered PTSD scale for children and adolescents (CAPS-C). Los Angeles, CA: Western Psychological Press.
  • Nilsson, D., Gustafsson, P. E., & Svedin, C. G. (2012). The psychometric properties of the Trauma Symptom Checklist for Young Children in a sample of Swedish children. European Journal of Psychotraumatology, 3, 18505. doi:10.3402/ejpt.v3i0.18505
  • Osofsky, J. D. (1995). The effect of exposure to violence on young children. American Psychologist, 50(9), 782–788. doi:10.1037/0003-066X.50.9.782
  • PanelClix online market research. (2016). Panel Book 2016. PanelClix. Retrieved from http://www.panelclix.nl/expertise/images/panelbook.pdf
  • Pollio, E. S., Glover-Orr, L. E., & Wherry, J. N. (2008). Assessing posttraumatic stress disorder using the Trauma Symptom Checklist for Young Children. Journal of Child Sexual Abuse, 17(1), 89–100. doi:10.1080/10538710701884557
  • Putnam, F. W., Helmers, K., & Trickett, P. K. (1993). Development, reliability, and validity of a child dissociation scale. Child Abuse & Neglect, 17(6), 731–741. doi:10.1016/S0145-2134(08)80004-X
  • Radford, L., Corral, S., Bradley, C., & Fisher, H. L. (2013). The prevalence and impact of child maltreatment and other types of victimization in the UK: Findings from a population survey of caregivers, children and young people and young adults. Child Abuse & Neglect, 37(3), 801–813. doi:10.1016/j.chiabu.2013.02.004
  • Silverman, W. K., & Albano, A. M. (1996). The anxiety disorders interview schedule for children for DSM-IV: Child and parent versions. San Antonia, TX: Psych Corp.
  • Springer, K. W., Sheridan, J., Kuo, D., & Carnes, M. (2007). Long-term physical and mental health consequences of childhood physical abuse: Results from a large population-based sample of men and women. Child Abuse & Neglect, 31(5), 517–530. doi:10.1016/j.chiabu.2007.01.003
  • Stuber, M. L., Shemesh, E., & Saxe, G. N. (2003). Posttraumatic stress responses in children with life-threatening illnesses. Child and Adolescent Psychiatric Clinics of North America, 12(2), 195–209. doi:10.1016/S1056-4993(02)00100-1
  • Verhulst, F. C., Van Der Ende, J., & Koot, H. M. (1996). Handleiding voor de CBCL/4-18. Rotterdam, the Netherlands: Sophia Kinderziekenhuis, Erasmus MC.