2,172
Views
0
CrossRef citations to date
0
Altmetric
Articles

Migration background and the measurement of home-based parental involvement in education: a psychometric evaluation of two self-report questionnaires

ORCID Icon, ORCID Icon, ORCID Icon, & ORCID Icon
Pages 39-59 | Received 22 May 2020, Accepted 19 Feb 2021, Published online: 31 Mar 2021

ABSTRACT

Home-based parental involvement in early education is linked to beneficial outcomes in children’s development and may redress unequal educational outcomes associated with family background. The type of educational activities at home and the way parents provide their support may differ across parents with and without a migration background. It is unclear whether home-based parental involvement is measured as the same construct across different origin groups. In this study, the psychometric properties of two parent-report questionnaires on home-based parental involvement were evaluated in 131 Dutch mothers of kindergarten-aged children, of whom 47% had a migration background. The dimensional structure of both questionnaires was tested with Principal Component Analysis. Multi-group confirmatory factor analyses were conducted to test for measurement invariance of the ‘Parenting Questionnaire’ across migration background. Results supported the multidimensional nature of home-based parental involvement, as formal and informal activities formed distinct components in the involvement of this diverse parent sample. In addition, measurement invariance was largely confirmed, indicating that parent’s involvement style can be validly measured across parents with and without a migration background in the Dutch context. Incorporating both formal and informal activities with involvement styles is recommended when measuring home-based parental involvement in different origin groups.

Introduction

Home-based parental involvement in children’s early education has been found associated with beneficial social, emotional, and cognitive outcomes in children’s development (Bakker et al. Citation2013; Carter Citation2002; Desforges and Abouchaar Citation2003). While the mechanisms underlying this link are not yet fully understood, previous studies have considered the potential of home-based parental involvement to redress unequal educational outcomes associated with children’s family backgrounds, such as immigration history (Cheadle Citation2008; St. Clair, Jackson, and Zweiback Citation2012). Studies on differences in home-based parental involvement and the association with child outcomes across parents with and without a migration background require instruments that assess the construct in an inclusive and equivalent manner across different origin groups. This study examined what home-based parental involvement in the Dutch kindergarten context may mean for parents with and without a migration background and how this meaning translates into the content and structure of two known questionnaires, covering multiple dimensions of home-based parental involvement.

The construct of home-based parental involvement

According to Bronfenbrenner (Citation1977) and Vygotsky (Vygotsky, Rieber, and Hall Citation1998), the home environment of children is an important context for learning. Transactional models of development (Sameroff Citation1975) underlie the hypothesis that learning in home and school context do not proceed independently, but rather form a developmental cascade. Children who have, for example, experienced sensitive parenting are more likely to develop social and cognitive skills that in turn enhance the effect of formal schooling on their cognitive development (Guralnick Citation2017). Further, frequent exposure to high-quality shared book reading with a parent is associated with higher scores on reading and mathematics assessments (Barnes and Puccioni Citation2017). As such, parents can be viewed as children’s incipient teachers when involved in the child’s learning process, a role which continues to be of importance when children make the transition to school (Spruijt et al. Citation2018).

Home-based parental involvement in child learning has been defined as learning-related interactions that take place between children and parents outside of the school context (Hoover-Dempsey and Sandler Citation2005). Home-based parental involvement can include a wide variety of activities, both formal and informal. Formal activities can be defined as activities accompanied by direct instruction in specific skills and, when relevant, with a focus on printed letters and text, although definitions may slightly differ (compare LeFevre et al. Citation2009 with Sénéchal and LeFevre Citation2002). Informal activities can be defined as activities with an indirect educational component, like telling stories, singing, and cooking. Previous research has found a link between both formal and informal activities and children’s cognitive development (LeFevre et al. Citation2009; Sénéchal and LeFevre Citation2002; Skwarchuk, Sowinski, and LeFevre Citation2014). In addition to the formal and informal dimension, home-based parental involvement also differs in the climate parents create during their interactions with children, their home-based parental involvement style, or, in a broader context, parenting style (Jeynes Citation2007; Spera Citation2005). For example, autonomy support and management/discipline styles have been found positively associated with children’s learning and learning-related skills (Hindman and Morrison Citation2012; Matte-Gagné and Bernier Citation2011; Pomerantz, Moorman, and Litwack Citation2007). Different combinations of home-based parental involvement activities and styles, however, appear beneficial across ethnic groups (Day and Dotterer Citation2018; Lee and Bowen Citation2006). Studying these differences and differential effects of home-based parental involvement in families with and without a migration background is important as populations continue to become more diverse.

Migration, home-based parental involvement, and the Dutch context

Similar to other immigration countries, a sizeable proportion (24%) of the Dutch population has a migration background, meaning that either they or one or both of their parents were born outside the Netherlands (CBS Citation2020). Additionally, there is a ‘third generation’ that descends from one or more grandparents who were born abroad. While often not defined as a migrant generation, the migration background of their parents and grandparents may still have indirect effects through cultural heritage, social and cultural capital, societal stigma, and discrimination in schooling, housing, and labour market (de Vries Citation2016; Ypenburg Citation2009; Thijssen et al. Citation2019; Zorlu and van Gent Citation2020). In the Netherlands, the largest minority groups are from Turkey and Morocco, who initially were brought in for doing low-skilled work, and from Suriname and Indonesia, due to special relations stemming from the Dutch colonial history. The home-cultures of all four groups have been characterized as more collectivistic than the host culture (Hofstede Citation2002). Additionally, individuals with a migration background on average are lower educated, earn less than individuals from the Dutch majority and are more likely to be dependent on social benefits (CBS Citation2020; Den Ridder et al. Citation2020; Zorlu and van Gent Citation2020).

Due to these cultural and social-economic differences children with a migration background on average possess less cultural capital than children without a migration background (Lareau Citation2002; Lee and Bowen Citation2006). Migration background children may have to bridge differences in rules, expectations, speech patterns/dialect, views on appropriate behaviour or learning goals which can negatively impact their educational outcomes (Fleer and Hedegaard Citation2010; Hill and Torres Citation2010; Lareau Citation2002). In kindergarten, Dutch children with a migration background are out-performed by their non-migration background peers on cognitive and non-cognitive skills (i.e. a primary effect of migration background) (Zumbuehl and Dillingh Citation2020). Subsequently, even when controlling for parental education, children with a migration background were more likely to discontinue their educational career at an earlier stage than children without a migration background (i.e. a secondary effect of migration background) (de Winter-Koçak and Badou Citation2020). Home-based parental involvement might reduce unequal educational outcomes associated with immigration history as it can contribute to children’s cognitive development and may bolster academic persistence (Bakker et al. Citation2013; Cheadle Citation2008; Lareau Citation2001; Mena Citation2011; St. Clair, Jackson, and Zweiback Citation2012). As such, when migration background parents show high levels of home-based parental involvement this might compensate for the disadvantage of possessing less cultural capital (Lee and Bowen Citation2006).

Migration background and home-based parental involvement activities

Studies into home-based parental involvement and its effects mainly focused on formal activities, such as reading and helping with homework (Boonk et al. Citation2018). Studies on differences in home-based parental involvement between migration background and non-migration background groups have reported less formal involvement shown by parents with a migration background, such as in Germany (e.g. Klein, Biedinger, and Becker Citation2014; Niklas and Schneider Citation2013) and the US (e.g. Raikes et al. Citation2006). Also in the Netherlands, comparative studies have mainly focused on formal involvement. For example, parents with a migration background have been found to read less to their children than parents with a non-migration background (Kaufmann Citation2000; Leseman and van Tuijl Citation2013). Additionally, parents with a migration background have been found to provide less help with homework assignments compared to non-migration background parents (Rønning Citation2011). These differences, however, may be more a reflection of comparative studies’ focus on formal activities than of actual differences in the amount of involvement activities parents undertake (Leseman and van Tuijl Citation2013).

In Western host cultures (such as the Netherlands) parents value the early acquisition of literacy and numeracy skills in their children which activates formal involvement activities like reading and practicing numbers (Herweijer and Vogels Citation2013; Lareau Citation2002). In contrast, compared to non-migration background parents, parents with a migration background more often value transmitting their moral and religious values, and practices (i.e. non-dominant cultural capital), which does not necessarily require involvement in formal institutional teaching, but may activate informal involvement activities such as sharing oral stories or including children in everyday adult activities (Delgado-Gaitan Citation1992; Gallimore and Goldenberg Citation2001; Kaufmann Citation2000; Pels and De Haan Citation2007; Smit, Driessen, and Doesburg Citation2005). Parents with a migration background might therefore be more familiar with informal involvement activities in interaction with their children. As previously stated, such informal activities have also been found to support children’s cognitive development (e.g. LeFevre et al. Citation2009). Additionally, the transmission of non-dominant/ethnic cultural capital (such as religious norms and values) may contribute to the educational careers of children with a migration background (Shah, Dwyer, and Modood Citation2010).

Studies investigating how home-based parental involvement can reduce primary and secondary effects of migration background, therefore, need to capture the construct in an inclusive manner across different origin groups. To enable such studies, instruments should contain items that are relevant to all intended respondent groups (i.e. both formal and informal activities) and psychometric properties of these instruments should be investigated in a representative sample (Rattray and Jones Citation2007).

Migration background and home-based parental involvement style

Differences have also been found in home-based parental involvement styles across parents with and without a migration background. Parents with a Turkish and Moroccan background have been found less supportive of the child’s autonomy than native Dutch parents, which can co-occur with a less responsive instructional climate, more intrusiveness and more authoritarian forms of control (Huiberts et al. Citation2006; Pels, Distelbrink, and Postma Citation2009; Yaman et al. Citation2010). More examples can be found in international parenting research. For example, White American parents were rated by their children as more emotionally supportive than Asian American parents, who were seen as more demanding (Suizzo and Soon Citation2006). Differential impact of parental involvement style on child outcomes has also been found within and across countries (Pinquart and Kauser Citation2018). For example, in the US a parental involvement style characterized by strictness and control around schoolwork was associated with higher levels of educational attainment for African American children, but with lower grade point average and lower educational attainment for White children (Day and Dotterer Citation2018).

It is still unknown whether differences in involvement styles reflect true differences on the latent construct of home-based parental involvement style or subjective differences caused by interpretations of participants. In this context, it would be helpful to test whether the construct is measured the same across origin groups. Cultural conventions influence meaning ascribed to words and behaviour as well as perceptions of social desirability which can lead to differences in response styles across groups (Van de Vijver Citation2015). Additionally, items can also be interpreted differently due to limited language abilities. This could render the instruments used in comparative studies non-invariant and thus produce results that are unreliable (Putnick and Bornstein Citation2016). One way to examine this is to test whether an instrument’s factor structure is equivalent in different groups (Cheung and Rensvold Citation1998).

The present study

The current study evaluated the psychometric properties of two self-report questionnaires on parental home-based involvement administered in an ethnically diverse group of parents of preschool-aged children. Our research aims were twofold.

Firstly, we evaluated a home-based parental involvement questionnaire that measures the frequency of home-based parental involvement activities undertaken in families. As described in the Materials and Methods section, this questionnaire was expanded to include both formal and informal activities, with the aim of making the questionnaire more inclusive and relevant for both parents with and without a migration background in the Dutch kindergarten context. In our first set of analyses, we tested this assumption by exploring the internal factor structure of the adapted questionnaire in a combined group of parents with and without a migration background.

Secondly, the Parenting Questionnaire which assesses home-based parental involvement style was evaluated. Since this questionnaire was not adapted, and the internal structure was established in other studies (Hindman and Morrison Citation2012), we performed confirmatory factor analyses to test the previously found internal structure. Additionally, we tested this questionnaire for measurement invariance across parents with and without a migration background. To our knowledge, this study is the first to explicitly test the measurement invariance (MI) of a home-based parental involvement style questionnaire across parents with and without a migration background.

Materials and methods

Participants

The sample consisted of 131 mothers with a mean age of 36 (SD = 5.75) years. About half of the mothers reported a Dutch background (70 mothers, 53%), four (3%) reported a Turkish background, 13 (10%) Moroccan, 23 (18%) Suriname, and two (2%) reported a Dutch Antillean background. Furthermore, 19 (15%) chose the ‘other’ category. In the MI analyses, the 70 mothers who reported a Dutch background were compared to the 61 mothers that reported a non-Dutch background, who were considered as having a migration background. Most women (n = 102, 78%; 70 Dutch and 32 migration background) reported Dutch as their home language. Four (3%) women generally spoke Arabic, four (3%) another language, and 20 (15%) reported speaking a combination of Dutch and another language at home. One woman indicated she spoke another language than Dutch at home, but did not specify which language. A lower educational level was reported by 47% (highest completed degree either primary education, high school education, or the lower levels of tertiary education). This is less than 69% of the Dutch population of adults 15 years or older who are lower educated (CBS Citation2020). Of the Dutch parents, 19 mothers (27%) were lower educated and 51 (73%) were higher educated. In the group of mothers with a migration background, 42 mothers (69%) were lower educated and 19 (31%) were higher educated.

Procedure

Parents participated in a five-wave study on educational partnerships. School leaders of seven schools in the North-Western part of the Netherlands had agreed that parents and teachers from their school could be approached for the study. On average these schools hosted 243 pupils, ranging from 75 to 414 pupils. The seven schools varied in size, denomination (religious or not), ethnicity and social–economic status of their student population.

After gaining approval from the ethical committee of the Faculty of Behavioural and Movement Sciences from the Vrije Universiteit Amsterdam (VCWE-2015-140), recruitment started. Researchers, together with school leaders, organized a meeting at each school during which parents were informed about the study. Both parents were invited to participate. After participants provided their written consent they received the questionnaires via email, or if requested, in paper-and-pencil form. Participants who did not return their questionnaires within two weeks received a reminder via email. When parents did not respond to a first reminder, they received a second email after another two weeks. After two reminders by the researcher, teachers provided one last reminder via email or face-to-face. In schools with low return rates parents were given the opportunity to fill in the questionnaire on paper. One school followed a different approach. The school leader requested that parents would be invited to fill in the questionnaires on paper in the waiting area when they came to school for their regular parent-teacher meetings. Questionnaires were used to collect demographic data and assess home-based parental involvement activities and styles. All questionnaires were in Dutch. When needed, parents who had insufficient command of the Dutch language were assisted by an interpreter. One parent was provided with a translated version of the questionnaire. Data from the first measurement wave were used in the current study

Measures

Home-based parental involvement activities

A previously used questionnaire with satisfactory internal consistency is the Parental Involvement Questionnaire (Walker et al. Citation2005). This instrument allows for the involvement of all members of the nuclear family to be reported which makes the instrument more culturally inclusive and less sensitive for background variables such as parents’ working hours. The original scale consisted of 10 items divided over two sub-scales: Home-based Involvement and School-based Involvement, with 5 items each. For this study, the questionnaire was translated to Dutch by a native English speaker. To check the quality of the translation another researcher translated the items back to English. Any inconsistencies were discussed until a satisfactory translation was reached. Four items from the School-based Involvement sub-scale were not included as our focus was on involvement in the family environment. Concerning the Home-based Involvement subscale, the item ‘Someone in this family helps this child study for tests’ was also omitted as it was considered unsuitable for the kindergarten context. Two other items were slightly adapted to be more applicable for this context. ‘Someone in this family supervises this child’s homework’ was adapted to ‘Someone in this family supervises this child’s work for school’. ‘Someone in this family practices spelling, math, or other skills with this child’ was adapted to ‘Someone in this family practices words, numbers, or concepts with this child’. The resulting five items represent formal activities that parents can undertake to support their children’s development (see ).

Table 1. Items and their Endorsement Frequencies Quantitative Home-based Involvement Questionnaire.

Subsequently, we added six items addressing informal daily activities to make the instrument more inclusive. Item development was done by a group of six experts in the field of parenting, parental involvement, and parenting practices of parents with a migration background. A sample item is ‘Someone in this family tells stories to this child’. Like the original items from the Home-based involvement scale, these items were administered on a 6-point scale (1 = never 2 = less than once a month, 3 = once a month, 4 = once a week, 5 = multiple times a week, and 6 = every day). The questionnaire was renamed Quantitative Home-based Involvement Questionnaire. An overview of the items and their endorsement frequencies is given in .

Home-based parental involvement style

Home-based parental involvement style was assessed with the Parenting Questionnaire (Hindman and Morrison Citation2012). This instrument includes 17 items, divided over three subscales: Home Learning Environment (HLE), Autonomy Support / Expectations (AUT), and Management / Discipline (MD). The original English version consisted of 14 qualitative and three quantitative items. For this study, the three quantitative items were omitted, because similar items were part of the Quantitative Home-based Involvement Questionnaire. Furthermore, the item ‘I encourage my child to do math-related activities’ was adapted to suit the kindergarten context and reworded as ‘I encourage my child to do calculus’ because the Dutch word for mathematics is not used until high school. A sample item is ‘I encourage my child to write’. Items were administered on a 5-point scale (1 = not at all like me to 5 = very much like me). For the items of the subscales HLE and MD the categories ‘not at all like me’ and ‘not like me’ were rarely endorsed in this sample, and therefore collapsed into one, hence analysing four instead of five categories for these subscales. The spread of endorsement frequencies was different for items of the subscale AUT. For these items, we combined the categories ‘not at all like me’, ‘not like me’, and ‘somewhat like me’. ‘Like me’ and ‘very much like me’ remained separate categories. As a result, for the AUT subscale, three instead of five categories were used in the analyses. An overview of the items and their original endorsement frequencies is given in .

Strategy of analysis

First, correlations among the items of each questionnaire were computed and assessed (Cohen Citation1988) and the internal consistency was assessed by computing Cronbach’s alpha. Cronbach’s alpha reflects the internal consistency of the items and is an indication of the reliability of the questionnaire. A higher Cronbach’s alpha means a more reliable questionnaire. Criteria for internal consistency are taken from Ponterotto and Ruckdeschel (Citation2007). Second, to explore the factor structure of the Quantitative Home-based Involvement Questionnaire we performed a Principal Component Analysis (PCA) in IBM SPSS Statistics version 24. We chose the exploratory PCA approach because the factor structure of the Quantitative Home-based Involvement Questionnaire, consisting of both existing and newly developed items, is unknown (Fokkema and Greiff Citation2017; Ziegler Citation2014). A rotated oblimin PCA, allowing for correlated components, was run. Components were selected on the basis of an eigenvalue larger than 1.00 and the scree plot was inspected (Cattell Citation1966; Kaiser Citation1958). Subsequently, the interpretability of components was assessed by examining the factor loadings, which represent the strength of the relationship of the item with that component. The rotated components should contain items with factor loadings larger than .35 that do not load highly on another dimension (i.e. the item clearly is most important for one particular component) and items loading on a component should share the same conceptual meanings.

With regard to the Parenting Questionnaire, the proposed three-factor structure (Hindman and Morrison Citation2012) was tested using confirmatory factor analysis in Mplus Version 7.31 (Muthén and Muthén Citation2015). Multi-group confirmatory factor analysis (MCFA) for categorical data with weighted least squares mean and variance adjusted (WLSMV) as an estimator was performed to test different levels of MI with respect to migration background (Gooden and Li Citation2016; Milfont and Fischer Citation2010; Vandenberg and Lance Citation2000). In the first step, we tested for configural invariance, meaning that the three-factor structure holds across both groups. This is the least constrained model of invariance where the fitted factor model is the same, but the parameter estimates (i.e. item thresholds, residual item variances, and factor loadings) may differ across groups. Item threshold reflects the ‘difficulty’ of the item: the higher the threshold, the lower the probability of answering one of the higher categories of the item. Factor loadings represent the strength of the relationship of the item with that factor. The higher the factor loadings, the stronger the item is related to the factor, hence, the better it is as an indicator of the construct the questionnaire intends to measure. Residual item variances reflect the amount of item-specific variance that is unrelated to the latent construct (and includes measurement error in the item). In the second step, we tested for metric invariance. In this model, in addition to assuming the same factor structure in both groups of parents, the factor loadings are constrained to be equal across groups. If this model fits well, metric invariance holds. This implies that the strength of the association between the factors and the items is the same across groups. In the third step, we tested for scalar invariance by further constraining the model by setting the item thresholds to be equivalent in the two groups. If support for scalar invariance is found, this means that the endorsement of a specific item on the questionnaire by parents reflects the same underlying latent response that is irrespective of group membership. Hence, factor means can be meaningfully compared across groups. In the last step, strict factorial invariance was tested by additionally constraining the residual item variances to be equal across groups. If strict factorial invariance holds, this means one can assume that differences in item scores between the groups reflect true differences in the construct.

The fit of each model was evaluated by the adjusted chi-square test, Root Mean Square Error of Approximation (RMSEA), Comparative Fit Index (CFI) and Tucker-Lewis Index (TLI) adhering to guidelines for models with categorical data (Van de Schoot, Lugtig, and Hox Citation2012; Yu Citation2002). In addition, model fit was compared between subsequent models, that is, each more constrained model was compared to the model tested in the previous step (Milfont and Fischer Citation2010; Putnick and Bornstein Citation2016). If the model fit of the more constrained model (e.g. the metric invariance model, with factor loadings constrained to be equal across groups) was not significantly worse than the fit of the less constrained model (e.g. the configural invariance model), support for the more stringent level of MI is found. The difference in model fit was evaluated with the adjusted chi-square difference test and the change in RMSEA and CFI (Chen Citation2007).

Results

Item frequencies and correlations of the quantitative home-based involvement questionnaire

Prior to exploring the factor structure of the Quantitative Home-based Involvement Questionnaire, we inspected the item endorsement frequencies () and the inter-item correlations (). A preliminary examination of the bivariate correlations amongst the items of the Quantitative Home-based Involvement Questionnaire revealed that 26 out of 55 inter-item correlations were statistically significant, ranging from .18 to .51. Of the significant correlations, one was of large effect size, nine were medium, and 16 were weak. All items, except the first, correlated significantly with at least one other item. The Cronbach’s alpha for the complete Quantitative Home-based Involvement Questionnaire was .64 (unsatisfactory).

Table 2. Inter-Item correlations Quantitative Home-based Involvement Questionnaire.

Exploring the factor structure of the quantitative home-based involvement questionnaire

The PCA for the Quantitative Home-based Involvement Questionnaire revealed that the 11 items could be reduced to four components (with eigenvalues larger than 1: 2.69, 1.75, 1.24, and 1.03, together explaining 61% of the variance). Individually the four components explained 24%, 16%, 11%, and 9% of the variance, respectively. The scree plot did not show a clear point where the slope of the curve clearly levelled off. We therefore first explored the rotated solution of the four-factor solution, see .

Table 3. Standardized Component Loadings of the rotated 4-factor solution Quantitative Home-based Involvement Questionnaire.

The pattern matrix revealed two components that should clearly be retained according to the interpretability criteria. Component 1 contained three items, reflecting informal activities. Component 4 included three items reflecting language/literacy activities. Component 2 contained only two items with the highest loading on that component, reflecting formal, school-related activities. Component 3 contained three items with distinctly different conceptual meanings. The item ‘Helping out at the child’s school’ also loaded positively and above .3 on Component 2 to which it also showed a better conceptual fit. As such, we decided to force a three-factor solution. When a three-factor solution was forced, the pattern matrix gave two components that should clearly be retained according to the interpretability criteria, see . Component 1 contained five items reflecting informal involvement activities. Component 2 included four items reflecting formal, school-related involvement activities. The language/literacy items were redistributed across these two components in predictable ways. Component 3 contained two items that did not share the same conceptual meaning. The item ‘Going to the library’ also loaded positively and above .3 on Component 2 to which it also showed a better conceptual fit. This suggested a two-factor solution might be more clear and parsimonious than the four- and three-factor solutions.

Table 4. Standardized Component Loadings of the rotated 3-factor solution Quantitative Home-based Involvement Questionnaire.

The two-factor solution produced components with eigenvalues of 2.69 and 1.75 (explaining 40% of the variance), see . This solution produced only one cross-loading above .30 and no negative loadings. Item 1 (Talks with this child about the school day) had a factor loading below .30 on either component and was dropped. Component 1 encompassed five items that refer to informal activities and could be labelled ‘Learning through play’. Component 2 consisted of the other five items and could be labelled ‘Support of Learning’. There was a small correlation between the two components (r = .08). These results suggest a two-factor solution with separate scales for ‘Learning through play’-items and ‘Support of Learning’-items fitted the data best. Internal consistency for the two subscales was α = .70 (moderate) and α = .56 (unsatisfactory), respectively.

Table 5. Standardized Component Loadings of the rotated 2-factor solution Quantitative Home-based Involvement Questionnaire.

Item frequencies and correlations of the parenting questionnaire

Prior to testing the factor structure of the Parenting Questionnaire, we inspected the item endorsement frequencies in both groups (with and without a migration background). An overview of the items and their original endorsement frequencies is given in .

Table 6. Items and their Endorsement Frequencies Parenting Questionnaire of Parents with and without a Migration Background.

A preliminary examination of the polychoric inter-item correlations with collapsed answer categories, calculated using the WLMSV estimator in Mplus, revealed similar numbers of correlations above .1 (or -.1 for negative correlations) in parents with and without a migration background (70 and 76 out of 91, respectively), for an overview see . In the group of parents without a migration background 22 correlations were of large effect size 23 were medium, and 25 were weak. In the group of parents with a migration background 20 were of large effect size 29 were medium, and 27 were weak. Items of the subscale Home Learning Environment (HLE) correlated strongly amongst each other in both groups of parents. Items of the subscale Autonomy Support (AUT) generally correlated strongly amongst each other in both groups of parents, as well. Correlations amongst the items of the Management/Discipline (MD) scale varied in both groups, see . We found weak to large correlations between items belonging to the subscale AUT with items belonging to the subscale MD and HLE and weak to medium correlations between items belonging to the subscales MD and HLE. Finally, Cronbach’s alphas for the three subscales were excellent for HLE and AUT (.83 and .86, respectively) and unsatisfactory for MD (.48). However, if item 14 was omitted from the MD subscale the Cronbach’s alpha was good (.75), see below.

Table 7. Inter-Item correlations Parenting Questionnaire of Parents with and without a Migration Background.

Testing the factor structure of the parenting questionnaire

To check whether the original factor structure of the Parenting Questionnaire held in our sample we fitted the three-factor model to the total sample prior to investigating MI. In this model, we assumed the 14 items formed three original subscales, with each subscale representing one dimension of home-based parental involvement style. The resulting model fitted the data well (χ²=88.19, df = 74, p = .12; RMSEA = .04; CFI = .99; TLI = .99). The correlation between HLE with AUT was .38 (p < .001); the correlation between HLE and MD was .13 (p = .22); and the correlation between AUT and MD was .49 (p < .001). Further, all factor loadings were significant (p < .001) except for the factor loading of item 14 from the MD subscale (‘When a lot of time passes after my child misbehaves, I just let it go’, est(SE)= −0.05 (0.11), p = .64). This corresponded with participants’ experiences that they did not understand the item. Therefore, item 14 was removed from further analyses.

Next, we tested whether the three-factor structure holds similarly in the two subgroups of parents with and without a migration background by applying the four steps of MI testing. The three-factor model, with different parameter estimates allowed in the two groups, initially did not converge. When inspecting the correlation structure and potential overlap of the content of the items, it became clear that item 2 ‘encourage to do calculus’ did not add unique information to the HLE construct, as item 1 also stresses ‘encouraging the child’ and item 3 also concerns calculus ‘providing calculus workbooks’. Therefore, we decided to drop item 2 from further analyses. Further, item 7 ‘encourage to talk’ showed high correlations with items 6 ‘encourage exploration’ and 8 ‘considerate of other’ in both groups, particularly in the non-migration background group. However, comparing the content of the items, we decided that item 7 may contribute new information, as none of the other items concern the child talking about his/her feelings. We, therefore, chose to constrain the factor loadings of items 6, 7, and 8 to each other in the first step of the measurement invariance testing (the configural invariance model). After these changes, the model converged well. Results from fitting the three-factor model to the data, including the subsequent different stages of MI tested across the two subgroups, are given in . Estimates of the unconstrained thresholds, factor loadings and residual variances from the configural invariance model are given in . The fit of this model was mediocre to good (χ² = 145.69, df = 104, p = .004; RMSEA = .08; CFI = .98; TLI = .97). We, therefore, accepted the configural invariance model and concluded that the three-factor structure holds across parents with and without a migration background. Parameter estimates in this model were generally similar in both groups, but with some differences. For the HLE factor, item 4 ‘play number games’ appeared a stronger indicator of HLE in the migration background group than in the non-migration background group of parents. Somewhat larger differences in factor loadings and residual variances between groups occurred for items 6, 7, and 8, belonging to the AUT factor, appearing to be stronger indicators with less residual variance in the non-migration background group than in the migration group. With regard to items from the MD factor, factor loadings also were somewhat higher for the non-migration background group, and residual variances somewhat lower.

Table 8. Measurement Invariance Results for the Parenting Questionnaire in Parents with and without a Migration Background.

Table 9. Parameter estimates From the Two-Group Confirmatory Three-Factor Model fitted to data on the Parenting Questionnaire in Parents with and without a Migration Background.

The next step showed that the fit of the metric invariance model was not worse when factor loadings were constrained (Δχ² = 15.12, Δdf = 9, p = .09; ΔRMSEA = 0 and ΔCFI = .001). Metric invariance is held across parents with a migration background and parents without a migration background. To test for scalar invariance, the thresholds were constrained. In this step, the fit did worsen significantly (Δχ² = 46.98, Δdf = 27, p = .01; ΔRMSEA = .001 and ΔCFI = .006). The Parenting Questionnaire did not reach scalar invariance with respect to parents with a migration background and parents without a migration background. However, when the thresholds of item 13 ‘threaten to discipline’ were not held equal across groups, the scalar factorial invariance model described the data reasonably well (χ² = 185.602, df = 137, p = .003; RMSEA = .074; CFI = .98; TLI = .98). Additionally, the fit was not significantly worse than the metric invariance model (Δχ² = 31.25, Δdf = 24 p = .15; ΔRMSEA = .004; ΔCFI = .002). On a scalar invariance level, the thresholds can be considered equal across these two subgroups, except for item 13 ‘threaten to discipline’. This means a higher score on an item is due to a higher score on the latent construct in both groups, and not due to any measurement differences between the two groups. This allows for the careful comparison of differences in mean factor scores between the two groups. With the release of the thresholds of item 13 strict invariance was also reached, meaning differences in residual variances in the two subgroups were not insuperable, see .

Table 10. Model Fit for All Levels of Measurement Invariance Tested Across Migration Background the thresholds of item 13 not held equal across groups.

Discussion

Home-based parental involvement may help to close the achievement gap between children with and without a migration background (Bakker et al. Citation2013; de Winter-Koçak and Badou Citation2020; Zumbuehl and Dillingh Citation2020). Current findings contribute to articulating and operationalizing both home-based parental involvement activities and home-based parental involvement style for parents with and without a migration background in the Dutch kindergarten context enabling comparative studies. First, home-based parental involvement activities vary and should be described along at least two distinct dimensions. Our first dimension ‘Learning through play’ reflects an informal type of involvement, including ‘Playing with the child’, ‘Reading to the child’, and ‘Telling stories to the child’. Our second dimension ‘Support of learning’ reflects a formal type of involvement, including ‘Supervising the child’s work for school’ and ‘Practicing words, number, or concepts with the child’. Because parents with a migration background might rely more on informal activities in supporting their child’s learning, adding an ‘Informal subscale’ to the Quantitative Home-based Involvement Questionnaire can help to make involvement practices and cultural capital provided by parents with a migration background visible which would otherwise have remained hidden (McWayne Citation2015; McWayne, Foster, and Melzi Citation2018; Pels and De Haan Citation2007). The subscale ‘support of learning’, which showed unsatisfactory reliability, might benefit from further modification, followed by re-exploration of the overall factor structure (Ponterotto and Ruckdeschel Citation2007). Subsequently, the proposed factor structure and investigation of measurement invariance across parents with and without migration background and SES levels for this questionnaire should be conducted in an independent sample drawn from the same population of Dutch parents (Fokkema and Greiff Citation2017).

The second main finding is that the Parenting Questionnaire replicates the three-factor structure identified by Hindman and Morrison (Citation2012). The Parenting Questionnaire assesses home-based parental involvement style by differentiating three facets of parenting that can contribute to child development: home learning environment, support for autonomy and expectations for appropriate behaviours, and management and discipline. Furthermore, results indicate this questionnaire to be largely measurement invariant across parents with and without a migration background, except for one item of the scale. This implies that scores obtained with this questionnaire can be confidently used to compare these two groups, as any group differences in scores can be taken to reflect true differences in parents’ home-based involvement styles, rather than differences in measurement across groups caused by cultural conventions, differential social desirability across groups, or a lower language ability (Putnick and Bornstein Citation2016; Van de Vijver Citation2015).

However, it should be noted that only when adjustments were made to the questionnaire (such as omitting two items and releasing the thresholds of item 13 ‘threaten to discipline’) we were able to reach sufficient levels of MI to compare groups. This calls for more research on MI of this instrument, preferably in larger samples that enable further distinction according to ethnic background and immigration history.

Limitations and considerations for future research

Limitations of this research should also be noted. First, our sample was very diverse, but not sufficiently large to further explore or test the factor structure of the two home-based parental involvement questionnaires in more than two subgroups based on the migration background of the parents. Compared to the native Dutch group, relatively larger within-group differences might exist in the group of parents with a migration background as it consists of different origin groups. Earlier studies found group differences in home-based parental involvement activities shown between immigrants from different subgroups (Kim et al. Citation2018). Garcia Coll and colleagues (Citation2002), for example, described differences in parental involvement of parents from three migrant groups in the US (Portuguese, Dominican, and Cambodian) and suggested these might be explained by differing forms of group migration (voluntary labour migrants or refugees), the educational system’s differential responses to the groups, and group differences in cultural values.

A related limitation is that we were unable to additionally test for MI across SES. Our migration and non-migration background subsamples differed significantly on SES. This means that the instrument can be used in samples with diverse migration backgrounds, as SES is known to correlate with migration background and can thus be a population characteristic. Measurement invariance across SES groups awaits further research, however. Differential effects of SES on academic outcomes have been reported for parents with and without a migration background. Loboda, Vogelbacher, and Gawlitzek (Citation2017) found for example, that in German parents without a migration background, SES has a stronger association with language proficiency than parenting style. Among parents with a migration background, SES showed no direct association with language proficiency while parenting style did show a direct association. As such, future studies are needed to test the instrument for MI across SES. If no measurement invariance is found across SES, an imbalance in SES across migration background and non-migration background subsamples might conflate or distort potential differences in home-based parental involvement.

With regard to the PCA of the Quantitative Home-Based Involvement Questionnaire, the Cronbach’s alpha of the ‘Support of learning’-subscale was unsatisfactory. This is reflected in the inter-item correlations as well, which suggest that if parents reported doing certain activities with a high frequency, other activities in the same scale were not reported as high frequent. Items in the ‘Support of learning’-subscale represent a wide variety of activities; from supervising school work to going to the library. To increase the reliability estimate it might be useful for future studies to add items and re-explore the instrument’s factor structure (Ponterotto and Ruckdeschel Citation2007). Additionally, the PCA initially suggested a four-factor solution. One of the four components consisted of language/literacy items. Although cross-loadings were found as well, this may indicate that these particular items form the basis of a separate scale focusing on language and literacy. As such, increasing the number of items might allow for different dimensions of home-based parental involvement to be detected. These clusters may differ across age groups as well. For example, reading acquisition becomes less important as children get older, whereas for older children, help with school-/homework might grow in importance. Future studies could, therefore, explore the factor structure across age groups.

Concerning the Parenting Questionnaire, we were able to reach sufficient levels of measurement invariance to compare groups, however not without making small adjustments. The nature of home-based parental involvement changes with children’s age (Bakker et al. Citation2013). As the current study focused on support of learning in children of kindergarten age (4–5 years-old), differences between the specific behaviours represented by the items 1–3 might not be meaningful at this age. A comparable age group was used for the development of this version of the questionnaire by Hindman and Morrison (Citation2012). However, as no inter-item correlations are given in their report it is unknown whether similar problems occurred in their study. Future research could include a sample more diverse in age to investigate whether differences between the specific behaviours represented by the items then increase, hence decreasing inter-item correlations. Another possibility would be to investigate whether item 2 can be combined with item 1 to form the item ‘I encourage my child to learn/study’.

Additionally, we needed to collapse response categories to perform the MI analyses as too many empty cells or cells with fewer than five observations occurred in the crosstabs when we divided the sample over two groups. We collapsed as few categories as possible to maximize information on the variation in item scores. Low variance in the item scores may indicate that the number of answer categories should be increased. Further research in a larger and more heterogeneous sample may help to increase variation in item scores and allow for better judgement of the suitability of the answer categories.

Implications for educational practice

Findings support the idea that home-based parental involvement activities may be assessed in a more inclusive way across different origin groups than has been done in studies to date. Furthermore, our study provides researchers with an instrument to measure home-based parental involvement style equivalently across parent populations with and without a migration background. Even though the instruments described in this study can benefit the assessment of home-based parental involvement, researchers and educational practitioners should be aware that the instruments operationalize a limited set of home-based parental involvement activities. Additionally, self-report instruments only present the parent’s perspective. Self-reported involvement, for example, may or may not be contingent to the child’s cues and emotional and instructional needs (Pino-Pasternak and Whitebread Citation2010). We, therefore, encourage teachers and other practitioners in the field of early education to enter into a reflective dialogue with parents that have dissimilar backgrounds to mutually explore their home-based involvement and the dominant and non-dominant cultural capital these parents can transmit to their children in the family context to support children’s development. This may allow teachers to strengthen parents’ home-based involvement as well as provide teachers with insights into cultural variations in involvement practices and their potential (Iliás et al. Citation2016; Kristen et al. Citation2011). This is especially important when children have their first real encounter with the host nation’s culture upon entering kindergarten. Such interactions may allow teachers and parents to connect these children’s school and family worlds whilst employing available funds of knowledge, sensitive to the cultural capital of parents with different backgrounds, and acknowledging the value of different parental involvement practices (Leopold and Shavit Citation2013; McWayne Citation2015; Pak and Vandekerckhove Citation2016).

Data availability

The data that support the findings of this study are available from the author, A.M. Willemen, upon reasonable request.

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work was supported by The Netherlands Initiative for Educational Research [grant number: 405-14-572] and the Amsterdam municipality [grant number: 10000780]. The sponsors had no role in the study design; in the collection, analysis and interpretation of data, in the writing of the report, and in the decision to submit the article for publication.

References