Analyzing Longitudinal Multirater Data with Changing and Stable Raters

References

• Bentler, P. M., & Chou, C. P. (1987). Practical issues in structural modeling. Sociological Methods & Research, 16, 78–117. doi:10.1177/0049124187016001004
   Web of Science ®Google Scholar
• Bleidorn, W., Kandler, C., & Caspi, A. (2014). The behavioural genetics of personality development in adulthood-classic, contemporary, and future trends. European Journal of Personality, 28, 244–255. doi:10.1002/per.1957
   Web of Science ®Google Scholar
• Bohn, J., Holtmann, J., Luhmann, M., Koch, T., & Eid, M. (2018). Attachment to parents and well-being in emerging adulthood: A study using self- and parent ratings. Cologne/Germany. Manuscript submitted for publication.
   Google Scholar
• Brüderl, J., Schmiedeberg, C., Castiglioni, L., Becker, O. A., Buhr, P., Fuß, D., … Schumann, N. (2018). The German Family Panel (pairfam). Cologne: GESIS Data Archive. doi:10.4232/pairfam.5678.9.0.0
   Google Scholar
• Courvoisier, D. S., Nussbeck, F. W., Eid, M., Geiser, C., & Cole, D. A. (2008). Analyzing the convergent and discriminant validity of states and traits: Development and applications of multimethod latent state-trait models. Psychological Assessment, 20, 270–280. doi:10.1037/a0012812
   PubMed Web of Science ®Google Scholar
• Crayen, C., Geiser, C., Scheithauer, H., & Eid, M. (2011). Evaluating interventions with multimethod data: A structural equation modeling approach. Structural Equation Modeling, 18, 497–524. doi:10.1080/10705511.2011.607068
   Web of Science ®Google Scholar
• Eid, M. (1996). Longitudinal confirmatory factor analysis for polytomous item responses: Model definition and model selection on the basis of stochastic measurement theory. Methods of Psychological Research—Online, 1, 65–85. Retrieved from https://www.dgps.de/fachgruppen/methoden/mpr-online/issue1/art4/article.html
   Google Scholar
• Eid, M. (2000). A multitrait-multimethod model with minimal assumptions. Psychometrika, 65, 241–261. doi:10.1007/BF02294377
   Web of Science ®Google Scholar
• Eid, M., Geiser, C., & Koch, T. (2016). Measuring method effects: From traditional to design-oriented approaches. Current Directions in Psychological Science, 25, 275–280. doi:10.1177/0963721416649624
   Web of Science ®Google Scholar
• Eid, M., Lischetzke, T., Nussbeck, F. W., & Trierweiler, L. I. (2003). Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple-indicator CT-C(M-1) model. Psychological Methods, 8, 38–60. doi:10.1037/1082-989X.8.1.38
   PubMed Web of Science ®Google Scholar
• Eid, M., Nussbeck, F. W., Geiser, C., Cole, D. A., Gollwitzer, M., & Lischetzke, T. (2008). Structural equation modeling of multitrait-multimethod data: Different models for different types of methods. Psychological Methods, 13, 230. doi:10.1037/a0013219
   PubMed Web of Science ®Google Scholar
• Enders, C. K. (2011). Missing not at random models for latent growth curve analyses. Psychological Methods, 16, 1–16. doi:10.1037/a0022640
   PubMed Web of Science ®Google Scholar
• Fagan, J., & Fantuzzo, J. W. (1999). Multirater congruence on the social skills rating system: Mother, father, and teacher assessments of urban Head Start children’s social competencies. Early Childhood Research Quarterly, 14, 229–242. doi:10.1016/s0885-2006(99)00010-1
   Web of Science ®Google Scholar
• Funder, D. C., & West, S. G., (Eds.) (1993). Viewpoints on personality: Consensus, self-other agreement and accuracy in judgments of personality. Journal of Personality, 61, 457–476. doi:10.1111/j.1467-6494.1993.tb00778.x
   PubMed Web of Science ®Google Scholar
• Geiser, C., Eid, M., & Nussbeck, F. W. (2008). On the meaning of the latent variables in the CT-C(M-1) model: A comment on Maydeu-Olivares and Coffman (2006). Psychological Methods, 13, 49–57. doi:10.1037/1082-989x.13.1.49
   PubMed Web of Science ®Google Scholar
• Geiser, C., Eid, M., Nussbeck, F. W., Courvoisier, D. S., & Cole, D. A. (2010). Multitrait-multimethod change modelling. AStA Advances in Statistical Analysis, 94, 185–201. doi:10.1007/s10182-010-0127-0
   Web of Science ®Google Scholar
• Geiser, C., Eid, M., West, S. G., Lischetzke, T., & Nussbeck, F. W. (2012). A comparison of method effects in two confirmatory factor models for structurally different methods. Structural Equation Modeling, 19, 409–436. doi:10.1080/10705511.2012.687658
   Web of Science ®Google Scholar
• Geiser, C., Koch, T., & Eid, M. (2014). Data-generating mechanisms versus constructively defined latent variables in multitrait–Multimethod analysis: A comment on Castro-Schilo, Widaman, and Grimm (2013). Structural Equation Modeling, 21, 509–523. doi:10.1080/10705511.2014.919816
   PubMed Web of Science ®Google Scholar
• Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. doi:10.1111/j.1469-7610.1997.tb01545.x
   PubMed Web of Science ®Google Scholar
• Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576. doi:10.1146/annurev.psych.58.110405.085530
   PubMed Web of Science ®Google Scholar
• Hays, W. L. (1994). Statistics (5th ed.). Fort Worth, TX: Harcourt Brace College Publishers.
   Google Scholar
• Heck, R. H., Thomas, S. L., & Tabata, L. N. (2013). Multilevel & longitudinal modeling with IBM SPSS. New York, NY: Routledge. doi:10.4324/9780203701249
   Google Scholar
• Hernán, M. A., & Robins, J. M. (in press). Causal inference. Boca Raton, FL: Chapman & Hall/CRC.
   Google Scholar
• Holtmann, J., Koch, T., Bohn, J., & Eid, M. (2017). Bayesian analysis of longitudinal multitrait-multimethod data with ordinal response variables. British Journal of Mathematical and Statistical Psychology, 70, 42–80. doi:10.1111/bmsp.12081
   PubMed Web of Science ®Google Scholar
• Holtmann, J., Koch, T., Lochner, K., & Eid, M. (2016). A comparison of ML, WLSMV and Bayesian methods for multilevel structural equation models in small samples - a simulation study. Multivariate Behavioral Research, 51, 661–680. doi:10.1080/00273171.2016.1208074
   PubMed Web of Science ®Google Scholar
• Horn, A. B., Milek, A., Brauner, A., & Maercker, A. (2017). Less positive sharing in the couple mediates the link between depression and relationship quality: A dyadic longitudinal study. Journal of Social and Clinical Psychology, 36, 535–553. doi:10.1521/jscp.2017.36.7.535
   Web of Science ®Google Scholar
• Horvitz, D. G., & Thompson, D. J. (1952). A generalization of sampling without replacement from a finite universe. Journal of the American Statistical Association, 47, 663–685. doi:10.1080/01621459.1952.10483446
   Web of Science ®Google Scholar
• Huinink, J., Brüderl, J., Nauck, B., Walper, S., Castiglioni, L., & Feldhaus, M. (2011). Panel analysis of intimate relationships and family dynamics (pairfam): Conceptual framework and design. Zeitschrift Für Familienforschung, 23, 77–101. Retrieved from www.zeitschrift-fuer-familienforschung.de/de/home
   Web of Science ®Google Scholar
• Imbens, G. W., & Rubin, D. B. (2015). Causal inference for statistics, social, and biomedical sciences: An introduction. New York, NY: Cambridge University Press.
   Google Scholar
• Kaplan, D. A. (1989). Study of the sampling variability of the z-values of parameter estimates from misspecified structural equation models. Multivariate Behavioral Research, 24, 41–57. doi:10.1207/s15327906mbr2401_3
   PubMed Web of Science ®Google Scholar
• Koch, T., Eid, M., & Lochner, K. (2018). Multitrait-multimethod-analysis: The psychometric foundation of CFA-MTMM models. In P. Irwing, T. Booth, & D. Hughes (Eds.), The Wiley handbook of psychometric testing: A multidisciplinary reference on survey, scale and test development (pp. 781–846). Hoboken, NJ: John Wiley & Sons Ltd. doi:10.1002/9781118489772.ch25
   Google Scholar
• Koch, T., Schultze, M., Eid, M., & Geiser, C. (2014). A longitudinal multilevel CFA-MTMM model for interchangeable and structurally different methods. Frontiers in Psychology, 5. doi:10.3389/fpsyg.2014.00311
   Web of Science ®Google Scholar
• Koch, T., Schultze, M., Holtmann, J., Geiser, C., & Eid, M. (2017). A multimethod latent state-trait model for structurally different and interchangeable methods. Psychometrika, 82, 17–47. doi:10.1007/s11336-016-9541-x
   PubMed Web of Science ®Google Scholar
• Lawes, M., Schultze, M., & Eid, M. (2018). Making the most of your research budget: Efficiency of a three-method measurement design with planned missing data. Assessment. doi:10.1177/1073191118798050
   PubMed Web of Science ®Google Scholar
• Lee, S.-Y., & Song, X.-Y. (2004). Evaluation of the Bayesian and maximum likelihood approaches in analyzing structural equation models with small sample sizes. Multivariate Behavioral Research, 39, 653–686. doi:10.1207/s15327906mbr3904_4
   PubMed Web of Science ®Google Scholar
• Little, T. D., Schnabel, K. U., & Baumert, J. (2000). Modeling longitudinal and multilevel data. Mahwah, NJ: Lawrence Erlbaum Associates. doi:10.4324/9781410601940
   Google Scholar
• Mahlke, J., Schultze, M., Koch, T., Eid, M., Eckert, R., & Brodbeck, F. C. (2015). A multilevel CFA–MTMM approach for multisource feedback instruments: Presentation and application of a new statistical model. Structural Equation Modeling, 23, 91–110. doi:10.1080/2F10705511.2014.990153
   Web of Science ®Google Scholar
• Mazza, G. L., Enders, C. K., & Ruehlman, L. S. (2015). Addressing item-level missing data: A comparison of proration and full information maximum likelihood estimation. Multivariate Behavioral Research, 50, 504–519. doi:10.1080/00273171.2015.1068157
   PubMed Web of Science ®Google Scholar
• McAbee, S. T., & Connelly, B. S. (2016). A multi-rater framework for studying personality: The trait-reputation-identity model. Psychological Review, 123, 569–591. doi:10.1037/rev0000035
   PubMed Web of Science ®Google Scholar
• Meredith, W., & Horn, J. (2001). The role of factorial invariance in modeling growth and change. In L. M. Collins & A. G. Sayer (Eds.), New methods for the analysis of change (pp. 203–240). Washington, D.C.: American Psychological Association.
   Google Scholar
• Millsap, R. E. (2011). Statistical approaches to measurement invariance. New York, NY: Routledge. doi:10.4324/9780203821961
   Google Scholar
• Muthén, L. K., & Muthén, B. O. (1998-2015). Mplus user’s guide (7th ed.). Los Angeles, CA: Muthén & Muthén.
   Google Scholar
• Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41. doi:10.2307/2335942
   Web of Science ®Google Scholar
• Rubin, D. B. (1974). Estimating causal effects of treatments in randomized and nonrandomized studies. Journal of Educational Psychology, 66, 688–70. doi:10.1037/h0037350
   Web of Science ®Google Scholar
• Rubin, D. B. (2005). Causal inference using potential outcomes: Design, modeling, decisions. Journal of the American Statistical Association, 100, 322–331. doi:10.1198/016214504000001880
   Web of Science ®Google Scholar
• Singer, J. D., & Willett, J. B. (2003). Applied longitudinal data analysis: Modeling change and event occurrence. Oxford, UK: Oxford University press. doi:10.1093/acprof:oso/9780195152968.001.0001
   Google Scholar
• Steyer, R. (1989). Models of classical psychometric test theory as stochastic measurement models: Representation, uniqueness, meaningfulness, identifiability, and testability. Methodika, 3, 25–60.
   Google Scholar
• Trull, T. J., & Ebner-Priemer, U. (2013). Ambulatory Assessment. Annual Review of Clinical Psychology, 9, 151–176. doi:10.1146/annurev-clinpsy-050212-185510
   PubMed Web of Science ®Google Scholar
• Van Horn, M. L., Atkins-Burnett, S., Karlin, E., Ramey, S. L., & Snyder, S. (2007). Parent ratings of children’s social skills: Longitudinal psychometric analyses of the social skills rating system. School Psychology Quarterly, 22, 162. doi:10.1037/1045-3830.22.2.162
   Web of Science ®Google Scholar
• Von Salisch, M., Denham, S. A., & Koch, T. (2016). Emotion knowledge and attention problems in young children. A crossed-lagged panel study of the direction of effects. Journal of Abnormal Child Psychology, 45, 45–56. doi:10.1007/s10802-016-0157-5
   Web of Science ®Google Scholar
• West, S. G., Cham, H., Thoemmes, F., Renneberg, B., Schulze, J., & Weiler, M. (2014). Propensity scores as a basis for equating groups: Basic principles and application in clinical treatment outcome research. Journal of Consulting and Clinical Psychology, 82, 906–919. doi:10.1037/a0036387
   PubMed Web of Science ®Google Scholar
• Widaman, K. F., & Reise, S. P. (1997). Exploring the measurement invariance of psychological instruments: Applications in the substance use domain. In K. J. In, B. M. Windle, & S. G. West (Eds.), The science of prevention: Methodological advances from alcohol and substance abuse research (pp. 281–324). Washington, DC: American Psychological Association. doi:10.1037/10222-009
   Google Scholar
• Woerner, W., Becker, A., Friedrich, C., Klasen, H., Goodman, R., & Rothenberger, A. (2002). Normierung und evaluation der deutschen elternversion des strengths and Difficulties Questionnaire (SDQ): Ergebnisse einer repräsentativen felderhebung [Standardisation and evaluation of the German parent version of the Strengths and Difficulties Questionnaire (SDQ): Results of a representative field survey]. Zeitschrift Für Kinder-Und Jugendpsychiatrie Und Psychotherapie, 30, 105–112. doi:10.1024/1422-4917.30.2.105
   PubMed Web of Science ®Google Scholar
• Wu, W., Jia, F., Rhemtulla, M., & Little, T. D. (2015). Search for efficient complete and planned missing data designs for analysis of change. Behavior Research Methods, 48, 1047–1061. doi:10.3758/s13428-015-0629-5
   Web of Science ®Google Scholar
• Yang, M., & Maxwell, S. E. (2014). Treatment effects in randomized longitudinal trials with different types of nonignorable dropout. Psychological Methods, 19, 188–210. doi:10.1037/a0033804
   PubMed Web of Science ®Google Scholar