402
Views
1
CrossRef citations to date
0
Altmetric
Research Article

On the Common but Problematic Specification of Conflated Random Slopes in Multilevel Models

&

References

  • Algina, J., & Swaminathan, H. (2011). Centering in two-level nested designs. In J. Hox & J. K. Roberts (Eds.), Handbook of advanced multilevel analysis (pp. 285–312). Taylor and Francis. https://doi.org/10.4324/9780203848852.ch15
  • Antonakis, J., Bastardoz, N., & Rönkkö, M. (2019). On ignoring the random effects assumption in multilevel models: Review, critique, and recommendations. Organizational Research Methods, 24(2), 443–483. https://doi.org/10.1177/1094428119877457
  • Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007). Untangling the alliance-outcome correlation: Exploring the relative importance of therapist and patient variability in the alliance. Journal of Consulting and Clinical Psychology, 75(6), 842–852. https://doi.org/10.1037/0022006X.75.6.842
  • Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J. (2013). Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68(3), 255–278. [Database] https://doi.org/10.1016/j.jml.2012.11.001
  • Bliese, P. D., & Britt, T. W. (2001). Social support, group consensus and stressor–strain relationships: Social context matters. Journal of Organizational Behavior, 22(4), 425–436. https://doi.org/10.1002/job.95
  • Brauer, M., & Curtin, J. J. (2018). Linear mixed-effects models and the analysis of nonindependent data: A unified framework to analyze categorical and continuous independent variables that vary within-subjects and/or within-items. Psychological Methods, 23(3), 389–411.
  • Boateng, F. D. (2016). Neighborhood-level effects on trust in the police: A multilevel analysis. International Criminal Justice Review, 26(3), 217–236. https://doi.org/10.1177/1057567716630792
  • Brincks, A. M., Enders, C. K., Llabre, M. M., Bulotsky-Shearer, R. J., Prado, G., & Feaster, D. J. (2017). Centering predictor variables in three-level contextual models. Multivariate Behavioral Research, 52(2), 149–163. https://doi.org/10.1080/00273171.2016.1256753
  • Burstein, L. (1980). The analysis of multilevel data in educational research and evaluation. Review of Research in Education, 8, 158–233. https://doi.org/10.3102/0091732X008001158
  • Cronbach, L. J. (1976). Research on classrooms and schools: Formulation of questions, design, and analysis. Stanford Evaluation Consortium, School of Education.
  • Curran, P. J., & Bauer, D. J. (2011). The disaggregation of within-person and between-person effects in longitudinal models of change. Annual Review of Psychology, 62, 583–619. https://doi.org/10.1146/annurev.psych.093008.100356
  • Curran, P. J., Lee, T., Howard, A. L., Lane, S., & MacCallum, R. A. (2012). Disaggregating within-person and between-person effects in multilevel and structural equation growth models. In J. R. Harring & G. R. Hancock (Eds.), Advances in longitudinal methods in the social and behavioral sciences (pp. 217–253). Information Age.
  • Deemer, E. D., Marks, L. R., & Miller, K. A. (2017). Peer science self-efficacy: A proximal contextual support for college students’ science career intentions. Journal of Career Assessment, 25(3), 537–551. https://doi.org/10.1177/1069072716651620
  • Diez-Roux, A. V., Link, B. G., & Northridge, M. E. (2000). A multilevel analysis of income inequality and cardiovascular disease risk factors. Social Science & Medicine, 50(5), 673–687. https://doi.org/10.1016/S0277-9536(99)00320-2
  • Enders, C. K. (2013). Centering predictors and contextual effects. In M. A. Scott, J. S. Simonof, & B. P. Marx (Eds.), The SAGE handbook of multilevel modeling (pp. 89–107). Sage. https://doi.org/10.4135/9781446247600.n6
  • Enders, C. K., & Tofighi, D. (2007). Centering predictor variables in cross-sectional multilevel models: A new look at an old issue. Psychological Methods, 12(2), 121–138. https://doi.org/10.1037/1082-989X.12.2.121
  • Espelage, D. L., Holt, M. K., & Henkel, R. R. (2003). Examination of peer–group contextual effects on aggression during early adolescence. Child Development, 74(1), 205–220. https://doi.org/10.1111/1467-8624.00531
  • Fischer, A. H., Rodriguez Mosquera, P. M., van Vianen, A. E. M., & Manstead, A. S. R. (2004). Gender and culture differences in emotion. Emotion (Washington, D.C.), 4(1), 87–94. https://doi.org/10.1037/1528-3542.4.1.87
  • Gelman, A., & Hill, J. (2007). Data analysis using regression and multilevel/hierarchical models. Cambridge University Press.
  • Goldstein, H. (2003). Multilevel statistical models (3rd ed.). Arnold.
  • Goldstein, H. (2011). Multilevel statistical models (4th ed.). Wiley.
  • Hamaker, E. L., & Grasman, R. P. (2014). To center or not to center? Investigating inertia with a multilevel autoregressive model. Frontiers in Psychology, 5, 1492. https://doi.org/10.3389/fpsyg.2014.01492
  • Hamaker, E. L., & Muthén, B. (2019). The fixed versus random effects debate and how it relates to centering in multilevel modeling. Psychological Methods, 25(3), 365–379. https://doi.org/10.1037/met0000239
  • Hatcher, R. L., & Barends, A. W. (2006). How a return to theory could help alliance research. Psychotherapy: Theory, Research, Practice, Training, 43(3), 292–299. https://doi.org/10.1037/00333204.43.3.292
  • Hedeker, D., & Gibbons, R. (2006). Longitudinal data analysis. Wiley. https://doi.org/10.1002/0470036486
  • Hedeker, D., Mermelstein, R. J., & Demirtas, H. (2012). Modeling between-subject and within-subject variances in ecological momentary assessment data using mixed-effects location scale models. Statistics in Medicine, 31(27), 3328–3336. https://doi.org/10.1002/sim.5338
  • Henry, K. L., & Slater, M. D. (2007). The contextual effect of school attachment on young adolescents’ alcohol use. Journal of School Health, 77(2), 67–74. https://doi.org/10.1111/j.17461561.2007.00169.x
  • Hoffman, L. (2015). Longitudinal analysis: Modeling within-person fluctuation and change. Routledge. https://doi.org/10.4324/9781315744094
  • Hoffman, L., & Stawski, R. S. (2009). Persons as contexts: Evaluating between-person and within-person effects in longitudinal analysis. Research in Human Development, 6(2-3), 97–120. https://doi.org/10.1080/15427600902911189
  • Hofmann, D. A., & Gavin, M. B. (1998). Centering decisions in hierarchical linear models: Implications for research in organizations. Journal of Management, 24(5), 623–641. https://doi.org/10.1177/014920639802400504
  • Hox, J. J. (2010). Multilevel analysis. Techniques and applications (2nd ed.) Routledge.
  • Kelley, J., Evans, M. D. R., Lowman, J., & Lykes, V. (2017). Group-mean-centering independent variables in multi-level models is dangerous. Quality & Quantity, 51(1), 261–283. https://doi.org/10.1007/s11135-015-0304-z
  • Kidwell, R. E., Jr, Mossholder, K. W., & Bennett, N. (1997). Cohesiveness and organizational citizenship behavior: A multilevel analysis using work groups and individuals. Journal of Management, 23(6), 775–793. https://doi.org/10.1177/014920639702300605
  • Korendijk, E., Maas, C., Moerbeek, M., & van der, H. (2008). The influence of misspecification of the heteroscedasticity on multilevel regression parameter and standard error estimates. Methodology, 4(2), 67–72. https://doi.org/10.1027/1614-2241.4.2.67
  • Kreft, I. G., & de Leeuw, J. (1998). Introducing multilevel modeling. Sage. https://doi.org/10.4135/9781849209366
  • Kreft, I. G. G., de Leeuw, J., & Aiken, L. S. (1995). The effects of different forms of centering in hierarchical linear models. Multivariate Behavioral Research, 30(1), 1–21. https://doi.org/10.1207/s15327906mbr3001_1
  • Lee, C. C, (2009). Hierarchical linear modeling to explore the influence of satisfaction with public facilities on housing prices. International Real Estate Review, 12(3), 252–272. https://doi.org/10.2307/2112866
  • Lee, V. E., & Bryk, A. S. (1989). A multilevel model of the social distribution of high school achievement. Sociology of Education, 62(3), 172–192. https://doi.org/10.2307/2112866
  • Longford, N. (1989). To center or not to center. Multilevel Modelling Newsletter, 1, 7.
  • Mallinckrodt, B. (2000). Attachment, social competencies, social support, and interpersonal process in psychotherapy. Psychotherapy Research, 10(3), 239–266. https://doi.org/10.1093/ptr/10.3.239
  • Merlo, J., Chaix, B., Yang, M., Lynch, J., & Råstam, L. (2005). A brief conceptual tutorial on multilevel analysis in social epidemiology: interpreting neighbourhood differences and the effect of neighbourhood characteristics on individual health. Journal of Epidemiology and Community Health, 59(12), 1022–1028. https://doi.org/10.1136/jech.2004.028035
  • Morrell, C. H. (1998). Likelihood ratio testing of variance components in the linear mixed-effects model using restricted maximum likelihood. Biometrics, 54(4), 1560–1568. https://doi.org/10.2307/2533680
  • Paccagnella, O. (2006). Centering or not centering in multilevel models? The role of the group mean and the assessment of group effects. Evaluation Review, 30(1), 66–85. https://doi.org/10.1177/0193841X05275649
  • Plewis, I. (1989). Comment on "centering" predictors. Multilevel Modelling Newsletter, 1, 6–& 11.
  • Poteat, V. P., Espelage, D. L., & Green, H. D. Jr, (2007). The socialization of dominance: Peer group contextual effects on homophobic and dominance attitudes. Journal of Personality and Social Psychology, 92(6), 1040–1050. https://doi.org/10.1037/0022-3514.92.6.1040
  • Preacher, K. J. (2011). Multilevel SEM strategies for evaluating mediation in three-level data. Multivariate behavioral Research, 46(4), 691–731. https://doi.org/10.1080/00273171.2011.589280
  • Raudenbush, S. W. (1989). “Centering” predictors in multilevel analysis: Choices and consequences. Multilevel Modelling Newsletter, 1, 10–12.
  • Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods (2nd ed.) Sage.
  • Rights, J. D. (2022). Aberrant distortion of variance components in multilevel models under conflation of level-specific effects. Psychological Methods. https://doi.org/10.1037/met0000514
  • Rights, J. D., Preacher, K. J., & Cole, D. A. (2020). The danger of conflating level-specific effects of control variables when primary interest lies in level-2 effects. British Journal of Mathematical and Statistical Psychology, 73(S1), 194–211. https://doi.org/10.1111/bmsp.12194
  • Rights, J. D., & Sterba, S. K. (2016). The relationship between multilevel models and nonparametric multilevel mixture models: Discrete approximation of intraclass correlation, random coefficient distributions, and residual heteroscedasticity. The British Journal of Mathematical and Statistical Psychology, 69(3), 316–343. https://doi.org/10.1111/bmsp.12073
  • Rights, J. D., & Sterba, S. K. (2019). Quantifying explained variance in multilevel models: An integrative framework for defining R-squared measures. Psychological Methods, 24(3), 309–338. https://doi.org/10.1037/met0000184
  • Rights, J. D., & Sterba, S. K. (2020). New recommendations on the use of R-squared differences in multilevel model comparisons. Multivariate Behavioral Research, 55(4), 568–599. https://doi.org/10.1080/00273171.2019.1660605
  • Rights, J. D., & Sterba, S. K. (2021). Effect size measures for longitudinal growth analyses: Extending a framework of multilevel model R-squareds to accommodate heteroscedasticity, autocorrelation, nonlinearity, and alternative centering strategies. New Directions for Child and Adolescent Development, 2021(175), 65–110. https://doi.org/10.1002/cad.20387
  • Robinson, W. S. (1950). Ecological correlations and the behavior of individuals. American Sociological Review, 15(3), 351–357. https://doi.org/10.2307/2087176
  • Schempf, A. H., & Kaufman, J. S. (2012). Accounting for context in studies of health inequalities: a review and comparison of analytic approaches. Annals of Epidemiology, 22(10), 683–690. https://doi.org/10.1016/j.annepidem.2012.06.105
  • Scott, A. J., & Holt, D. (1982). The effect of two-stage sampling on ordinary least squares methods. Journal of the American Statistical Association, 77(380), 848–854. https://doi.org/10.1080/01621459.1982.10477897
  • Snijders, T. A. B., & Berkhof, J. (2008). Diagnostic checks for multilevel models. In J. de Leeuw & E. Meijer (Eds.), Handbook of multilevel analysis (pp. 141–176). Springer. https://doi.org/10.1007/978-0-387-73186-5_3
  • Snijders, T. A. B., & Bosker, R. J. (1999). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Sage.
  • Snijders, T. A. B., & Bosker, R. J. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling (2nd ed.). Sage.
  • Stram, D. O., & Lee, J. W. (1994). Variance components testing in the longitudinal mixed effects model. Biometrics, 50(4), 1171–1177. https://doi.org/10.2307/2533455
  • Stram, D. O., & Lee, J. W. (1995). Corrections: Variance components testing in the longitudinal mixed effects model. Biometrics, 51, 1196. https://doi.org/10.2307/2533038
  • Titus, M. A. (2004). An examination of the influence of institutional context on student persistence at 4-year colleges and universities: A multilevel approach. Research in Higher Education, 45(7), 673–699. https://doi.org/10.1023/B:RIHE.0000044227.17161.fa
  • Wang, L. P., & Maxwell, S. E. (2015). On disaggregating between-person and within-person effects with longitudinal data using multilevel models. Psychological Methods, 20(1), 63–83. https://doi.org/10.1037/met0000030
  • West, B. T., Welch, K. B., & Galecki, A. T. (2014). Linear mixed models: A practical guide using statistical software. CRC Press. https://doi.org/10.1201/b17198
  • Wu, Y. W. B., & Wooldridge, P. J. (2005). The impact of centering first‐level predictors on individual and contextual effects in multilevel data analysis. Nursing research, 54(3), 212–216. https://doi.org/10.1097/00006199-200505000-00009

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.