Time-specific Errors in Growth Curve Modeling: Type-1 Error Inflation and a Possible Solution with Mixed-Effects Models

References

• Ancona, D. G., Okhuysen, G. A., & Perlow, L. A. (2001). Taking time to integrate temporal research. Academy of Management Review, 26(4), 512–529.
   Web of Science ®Google Scholar
• Alessandri, G., Caprara, G. V., & Tisak, J. (2012). A unified latent curve, latent state-trait analysis of the developmental trajectories and correlates of positive orientation. Multivariate Behavioral Research, 47(3), 341–368. doi: 10.1080/00273171.2012.673954
   PubMed Web of Science ®Google Scholar
• Baayen, R. H., Davidson, D. J., & Bates, D. M. (2008). Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 59(4), 390–412. doi: 10.1016/j.jml.2007.12.005
   Web of Science ®Google Scholar
• Bates, D., Maechler, M., & Bolker, B. (2011). Lme4: Linear mixed-effects models using s4 classes (Version R package version 0.999375-39). Retrieved from http://CRAN.R-project.org/packagelme4
   Google Scholar
• Biesanz, J. C., Deeb-Sossa, N., Papadakis, A. A., Bollen, K. A., & Curran, P. J. (2004). The role of coding time in estimating and interpreting growth curve models. Psychological Methods, 9(1), 30–52. doi: 10.1037/1082-989x.9.1.30
   PubMed Web of Science ®Google Scholar
• Bodenhausen, G. V. (1990). Stereotypes as judgmental heuristics: Evidence of circadian variations in discrimination. Psychological Science, 1(5), 319–322. doi: 10.1111/j.1467-9280.1990.tb00226.x
   Web of Science ®Google Scholar
• Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54(1), 579–616. doi: 10.1146/annurev.psych.54.101601.145030
   PubMed Web of Science ®Google Scholar
• Bollen, K. A., & Curran, P. J. (2004). Autoregressive latent trajectory (ALT) models: A synthesis of two traditions. Sociological Methods & Research, 32(3), 336–383. doi: 10.1177/0049124103260222
   Web of Science ®Google Scholar
• Bollen, K. A., & Curran, P. J. (2006). Latent curve models: A structural equation perspective. Hoboken, NJ: John Wiley & Sons.
   Google Scholar
• Braun, M. T., Kuljanin, G., & DeShon, R. P. (2013). Spurious results in the analysis of longitudinal data in organizational research. Organizational Research Methods, 16(2), 302–330.
   Web of Science ®Google Scholar
• Clark, H. H. (1973). The language-as-fixed-effect fallacy: A critique of language statistics in psychological research. Journal of Verbal Learning & Verbal Behavior, 12(4), 335–359. doi:10.1016/S0022-5371(73)80014-3
   Google Scholar
• Collins, L. M., & Sayer, A. G. (2001). New methods for the analysis of change. Washington, D.C.: American Psychological Association.
   Google Scholar
• Cudeck, R., & Harring, J. R. (2007). Analysis of nonlinear patterns of change with random coefficient models. Annual Review of Psychology, 58(1), 615–637.
   PubMedGoogle Scholar
• Curran, P. J., & Bollen, K. A. (2001). The best of both worlds: Combining autoregressive and latent curve models. In Collins, L. M. & Sayer, A. G. (Eds.), New methods for the analysis of change (pp.105–136). Washington, DC: American Psychological Association.
   Google Scholar
• de Ayala, R. J. (2009). The theory and practice of item response theory. New York: The Guilford Press.
   Google Scholar
• Duncan, T. E., Duncan, S. C., & Strycker, L. A. (2006). An introduction to latent variable growth curve modeling: Concepts, issues, and applications (2nd ed.). Mahwah, NJ: Lawrence Erlbaum Associates Publishers.
   Google Scholar
• Durbin, J., & Watson, G. S. (1950). Testing for serial correlation in least squares regression, I. Biometrika, 37(3–4), 409–428. doi: 10.1093/biomet/37.3-4.409.JSTOR2332391
   PubMed Web of Science ®Google Scholar
• Durbin, J., & Watson, G. S. (1951). Testing for serial correlation in least squares regression, II. Biometrika, 38(1–2), 159–179. doi: 10.1093/biomet/38.1-2.159.JSTOR2332325
   PubMed Web of Science ®Google Scholar
• Eccles, J. S., & Wigfield, A. (1995). In the mind of the achiever: The structure of adolescents' achievement task values and expectancy related beliefs. Personality and Social Psychology Bulletin, 21, 215–225. doi: 10.1177/0146167295213003
   Google Scholar
• Freeman, E., Heathcote, A., Chalmers, K., & Hockley, W. (2010). Item effects in recognition memory for words. Journal of Memory and Language, 62(1), 1–18. doi: 10.1016/j.jml.2009.09.004
   Web of Science ®Google Scholar
• Fredricks, J. A., & Eccles, J. S. (2002). Children’s competence and value beliefs from childhood through adolescence: Growth trajectories in two male-sex-typed domains. Developmental Psychology, 38(4), 519–533. doi: 10.1037/0012-1649.38.4.519
   PubMed Web of Science ®Google Scholar
• Frenzel, A. C., Goetz, T., Pekrun, R., & Watt, H. M. G. (2010). Development of mathematics interest in adolescence: Influences of gender, family, and school context. Journal of Research on Adolescence, 20, 507–537.
   Google Scholar
• Giraitis, L., Kapetanios, G., & Yates, T. (2014). Inference on stochastic time-varying coefficient models. Journal of Econometrics, 179(1), 46–65. doi: 10.1016/j.jeconom.2013.10.009
   Web of Science ®Google Scholar
• Grimm, K. J., Ram, N., & Hamagami, F. (2011). Nonlinear growth curves in developmental research. Child Development, 82(5), 1357–1371. doi: 10.1111/j.1467-8624.2011.01630.x.
   PubMed Web of Science ®Google Scholar
• Grimm, K. J., Steele, J. S., Ram, N., & Nesselroade, J. R. (2013). Exploratory latent growth models in the structural equation modeling framework. Structural Equation Modeling, 20(4), 568–591. doi:10.1080/10705511.2013.824775
   Web of Science ®Google Scholar
• Hamaker, E. L., Ceulemans, E., Grasman, R. P. P. P., & Tuerlinckx, F. (2015). Modeling affect dynamics: State-of-the-art and future challenges. Emotion Review, 7(4), 316–322. doi: 10.1177/1754073915590619
   Web of Science ®Google Scholar
• Hamaker, E. L., Kuiper, R. M., & Grasman, R. P. P. P. (2015). A critique of the cross-lagged panel model. Psychological Methods, 20(1), 102–116. doi:10.1037/a0038889
   PubMed Web of Science ®Google Scholar
• Hedges, L. V., & Hedberg, E. (2007). Intraclass correlation values for planning group randomized trials in education. Educational Evaluation and Policy Analysis, 29(1), 60–87.
   Web of Science ®Google Scholar
• Hertzog, C., & Nesselroade, J. R. (2003). Assessing psychological change in adulthood: An overview of methodological issues. Psychology and Aging, 18(4), 639–657. doi: 10.1037/0882-7974.18.4.639
   PubMed Web of Science ®Google Scholar
• Judd, C. M., Westfall, J., & Kenny, D. A. (2012). Treating stimuli as a random factor in social psychology: A new and comprehensive solution to a pervasive but largely ignored problem. Journal of Personality and Social Psychology, 103(1), 54–69. doi: 10.1037/a0028347
   PubMed Web of Science ®Google Scholar
• Judd, C. M., Westfall, J., & Kenny, D. A. (2017). Experiments with more than one random factor: Designs, analytic models, and statistical power. Annual Review of Psychology, 68(1), 601–625.
   PubMed Web of Science ®Google Scholar
• Kenny, D. A., & Zautra, A. (2001). Trait-state models for longitudinal data. In L. M. Collins & A. G. Sayer (eds.), New methods for the analysis of change (pp. 243–263). Washington, DC: American Psychological Association.
   Google Scholar
• Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53(3), 983–997. doi: 10.2307/2533558
   PubMed Web of Science ®Google Scholar
• Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2015). lmerTest: Tests for random and fixed effects for linear mixed effect models (lmer objects of lme4 package). R package version 2.0-25. http://www.cran.r-project.org/package=lmerTest
   Google Scholar
• Kuznetsova, A., Brockhoff, P. B., & Christensen, R. H. B. (2017). lmerTest Package: Tests in linear mixed effects models. Journal of Statistical Software, 82(13), 1–26. doi: 10.18637/jss.v082.i13.
   Web of Science ®Google Scholar
• Laird, N. M., & Ware, H. (1982). Random-effects models for longitudinal data. Biometrics, 38(4), 963–974.
   PubMed Web of Science ®Google Scholar
• Lord, F.M., & Novick, M.R. (1968). Statistical theories of mental test scores. Menlo Park, CA: Addison-Wesley.
   Google Scholar
• Marsh, H. W., Pekrun, R., Parker, P. D., Murayama, K., Guo, J., Dicke, T., & Lichtenfeld, S. (2017). Long-term positive effects of repeating a year in school: Six-year longitudinal study of self-beliefs, anxiety, social relations, school grades, and test scores. Journal of Educational Psychology, 109(3), 425–438. doi: 10.1176/appi.ajp.2016.16020224
   Web of Science ®Google Scholar
• May, C. P. (1999). Synchrony effects in cognition: The costs and a benefit. Psychonomic Bulletin & Review, 6(1), 142–147. doi: 10.3758/BF03210822
   PubMed Web of Science ®Google Scholar
• McArdle, J. J. (1988). Dynamic but structural equation modeling of repeated measures data. In J. R. Nesselroade & R. B. Cattell (Eds.), The handbook of multivariate experimental psychology (pp. 561–614). New York, NY: Plenum Press.
   Google Scholar
• McArdle, J. J. (2009). Latent variable modeling of differences and changes with longitudinal data. Annual Review of Psychology, 60(1), 577–605. doi: 10.1146/annurev.psych.60.110707.163612.
   PubMed Web of Science ®Google Scholar
• McArdle, J. J., Anderson, E., Birren, J. E., & Schaie, K. W. (1990). Latent variable growth models for research on aging: Handbook of the psychology of aging (3rd ed.). (pp. 21–44). San Diego, CA: Academic Press.
   Google Scholar
• McArdle, J. J., & Hamagami, F. (2001). Latent difference score structural models for linear dynamic analyses with incomplete longitudinal data. In L. M. Collins & A. G. Sayer (eds.), New methods for the analysis of change (pp. 139–175). Washington, DC: American Psychological Association.
   Google Scholar
• McArdle, J. J., & Nesselroade, J. R. (1994). Using multivariate data to structure developmental change. In S. H. Cohen & H. W. Reese (Eds.), Life-span developmental psychology: Methodological contributions. (pp. 223–267). New Jersey: Lawrence Erlbaum Associates.
   Google Scholar
• McArdle, J. J., & Nesselroade, J. R. (2014). Longitudinal data analysis using structural equation models. Washington, DC: American Psychological Association.
   Google Scholar
• Mehta, P. D., & Neale, M. C. (2005). People are variables too: Multilevel structural equation modeling. Psychological Methods, 10(3), 259–284. doi: 10.1037/1082-989X.10.3.259
   PubMed Web of Science ®Google Scholar
• Meredith, W., & Horn, J. (2001). The role of factorial invariance in modeling growth and change. In L. M. Collins & A. G. Sayer (eds.), New methods for the analysis of change (pp. 203–240). Washington, DC: American Psychological Association.
   Google Scholar
• Meredith, W., & Tisak. J. (1984). Statistical considerations in Tuckerizing curves with emphasis on growth curves and cohort sequential analysis. Santa Barbara, CA: Paper presented at the annual meeting of the Psychometric Society.
   Google Scholar
• Meredith, W., & Tisak, J. (1990). Latent curve analysis. Psychometrika, 55(1), 107–122. doi: 10.1007/BF02294746
   Web of Science ®Google Scholar
• Meyers, J. L., & Beretvas, S. N. (2006). The impact of inappropriate modeling of cross-classified data structures. Multivariate Behavioral Research, 41(4), 473–497. doi: 10.1207/s15327906mbr4104_3
   PubMed Web of Science ®Google Scholar
• Murayama, K., Sakaki, M., Yan, V. X., & Smith, G. M. (2014). Type 1 error inflation in the traditional by-participant analysis to metamemory accuracy: A generalized mixed-effects model perspective. Journal of Experimental Psychology. Learning, Memory, and Cognition, 40(5), 1287–1306. doi:10.1037/a0036914
   PubMed Web of Science ®Google Scholar
• Murray, D. M., & Blistein, J. L. (2003). Methods to reduce the impact of intraclass correlation in group-randomized trials. Evaluation Review, 27(1), 79–103.
   PubMed Web of Science ®Google Scholar
• Potthoff, R. R., & Roy, S. N. (1964). A generalized multivariate analysis of variance model useful especially for growth curve problems. Biometrika, 51(3–4), 313–326. doi: 10.1093/biomet/51.3-4.313
   Web of Science ®Google Scholar
• Preacher, K. J., & Hancock, G. R. (2015). Meaningful aspects of change as novel random coefficients: A general method for reparameterizing longitudinal models. Psychological Methods, 20(1), 84–101. doi: 10.1037/met0000028
   PubMed Web of Science ®Google Scholar
• Primiceri, G. E. (2005). Time varying structural vector autoregressions and monetary policy. The Review of Economic Studies, 72(3), 821–852. doi: 10.1111/j.1467-937X.2005.00353.x
   Web of Science ®Google Scholar
• Ram, N., & Grimm, K. J. (2015). Growth curve modeling and longitudinal factor analysis. In W. F. Overton & P. C. M. Molenaar (Eds.), Handbook of child psychology and developmental science: Theory & method (pp. 758–788). Hoboken, NJ: Wiley.
   Google Scholar
• Rao, C. R. (1965). The theory of least squares when the parameters are stochastic and its application to the analysis of growth curves. Biometrika, 52(3), 447–458.
   PubMed Web of Science ®Google Scholar
• Rasbash, J., & Browne, W. J. (2001). Modeling non-hierarchical structures. In A. H. Leyland & H. Goldstein (Eds.), Multilevel modeling of health statistics (pp. 93–105). Chichester, UK: John Wiley and Sons.
   Google Scholar
• Raudenbush, S. W., & Bryk, A. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.). Newbury Park, CA: Sage.
   Google Scholar
• Rentz, J. O., & Reynolds, F. D. (1981). Separating age, cohort and period effects in consumer behavior. Advances in Consumer Research, 8, 596–601.
   Google Scholar
• Satterthwaite, F. E. (1941). Synthesis of variance. Psychometrika, 6(5), 309–316.
   Google Scholar
• Schwarz, N., & Clore, G. L. (1983). Mood, misattribution, and judgements of well-being: Informative and directive functions of affective states. Journal of Personality and Social Psychology, 45(3), 513–523. doi:10.1037/0022-3514.45.3.513
   Web of Science ®Google Scholar
• Schwarz, N. & Sudman, S. (Eds.) (1996). Answering questions: Methodology for determining cognitive and communicative processes in survey research. San Francisco, CA: Jossey-Bass Publications.
   Google Scholar
• Schaalje, G. B., McBride, J. B., & Fellingham, G. W. (2002). Adequacy of approximations to distributions of test statistics in complex mixed linear models using SAS Proc MIXED. Journal of Agricultural, Biological, and Environmental Statistics, 7(4), 512–524. doi: 10.1198/108571102726
   Web of Science ®Google Scholar
• Shanken, J. (1990). Intertemporal asset pricing: An empirical investigation. Journal of Econometrics, 45(1–2), 99–120. doi: 10.1016/0304-4076(90)90095-B
   Web of Science ®Google Scholar
• Shiyko, M. P., Lanza, S. T., Tan, X., Li, R., & Shiffman, S. (2012). Using the time-varying effect model (TVEM) to examine dynamic associations between negative affect and self confidence on smoking urges: Differences between successful quitters and relapsers. Prevention Science, 13(3), 288–299. doi: 10.1007/s11121-011-0264-z
   PubMed Web of Science ®Google Scholar
• Singer, J. D. (1998). Using sas proc mixed to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 23(4), 323–355. doi: 10.3102/10769986023004323
   Web of Science ®Google Scholar
• Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. Oxford, UK: Oxford University Press.
   Google Scholar
• Skrondal, A., & Rabe-Hesketh, S. (2004). Generalized latent variable modeling. Multilevel, longitudinal, and structural equation models. Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Tanaka, A., & Murayama, K. (2014). Within-person analyses of situational interest and boredom: Interactions between task-specific perceptions and achievement goals. Journal of Educational Psychology, 106(4), 1122–1134.
   Web of Science ®Google Scholar
• Usami, S. (2014). Generalized sample size determination formulas for experimental research with hierarchical data. Behavior Research Methods, 46(2), 346–356. doi: 10.3758/s13428-013-0387-1
   PubMed Web of Science ®Google Scholar
• Walls, T. A. & Schafer, J. L. (Eds.) (2006). Models for intensive longitudinal data. New York, NY: Oxford University Press.
   Google Scholar
• Westfall, J., Kenny, D. A., & Judd, C. M. (2014). Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. Journal of Experimental Psychology: General, 143, 2020–2045.
   Google Scholar
• Wigfield, A., & Eccles, J. S. (2000). Expectancy-value theory of motivation. Contemporary Educational Psychology, 25, 68–81. doi: 10.1006/ceps.1999.1015
   Google Scholar
• Wu, W., West, S. G., & Taylor, A. B. (2009). Evaluating model fit for growth curve models: Integration of fit indices from SEM and MLM frameworks. Psychological Methods, 14, 183–201.
   PubMed Web of Science ®Google Scholar