Effect Partitioning in Cross-Sectionally Clustered Data Without Multilevel Models

References

• Allison, P. D. (2012, April 23). Handling missing data by maximum likelihood (Keynote presentation at the SAS Global Forum, Orlando, Florida). Retrieved from http://www.statisticalhorizons.com/wp-content/uploads/MissingDataByML.pdf.
   Google Scholar
• Aloisio, K. M., Micali, N., Swanson, S. A., Field, A., & Horton, N. J. (2014). Analysis of partially observed clustered data using generalized estimating equations and multiple imputation. The Stata Journal: Promoting Communications on Statistics and Stata, 14(4), 863–883. doi:10.1177/1536867X1401400410
   Google Scholar
• Ballinger, G. A. (2004). Using generalized estimating equations for longitudinal data analysis. Organizational Research Methods, 7(2), 127–150. doi:10.1177/1094428104263672
   Web of Science ®Google Scholar
• Bauer, D. J. (2003). Estimating multilevel linear models as structural equation models. Journal of Educational and Behavioral Statistics, 28(2), 135–167. doi:10.3102/10769986028002135
   Web of Science ®Google Scholar
• Begg, M. D., & Parides, M. K. (2003). Separation of individual‐level and cluster‐level covariate effects in regression analysis of correlated data. Statistics in Medicine, 22(16), 2591–2602. doi:10.1002/sim.1524
   PubMed Web of Science ®Google Scholar
• Bell, A., & Jones, K. (2015). Explaining fixed effects: Random effects modeling of time-series cross-sectional and panel data. Political Science Research and Methods, 3(01), 133–153. doi:10.1017/psrm.2014.7
   Google Scholar
• Benedetti, A., Platt, R., & Atherton, J. (2014). Generalized linear mixed models for binary data: are matching results from penalized quasi-likelihood and numerical integration less biased? PloS One, 9 http://dx.doi.org/10.1371/journal.pone.0084601.
   Web of Science ®Google Scholar
• Berkhof, J., & Kampen, J. K. (2004). Asymptotic effect of misspecification in the random part of the multilevel model. Journal of Educational and Behavioral Statistics, 29(2), 201–218. doi:10.3102/10769986029002201
   Web of Science ®Google Scholar
• Birhanu, T., Molenberghs, G., Sotto, C., & Kenward, M. G. (2011). Doubly robust and multiple-imputation-based generalized estimating equations. Journal of Biopharmaceutical Statistics, 21(2), 202–225. doi:10.1080/10543406.2011.550096
   PubMed Web of Science ®Google Scholar
• Boyd, L., & Iverson, G. (1979). Contextual analysis: Concepts and statistical techniques. Belmont, CA: Wadsworth
   Google Scholar
• Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31(2), 144–152. doi:10.1111/j.2044-8317.1978.tb00581.x
   Web of Science ®Google Scholar
• Breslow, N. E., & Lin, X. (1995). Bias correction in generalised linear mixed models with a single component of dispersion. Biometrika, 82(1), 81–91. doi:10.1093/biomet/82.1.81
   Web of Science ®Google Scholar
• Capanu, M., Gönen, M., & Begg, C. B. (2013). An assessment of estimation methods for generalized linear mixed models with binary outcomes. Statistics in Medicine, 32(26), 4550–4566. doi:10.1002/sim.5866
   PubMed Web of Science ®Google Scholar
• Carpenter, J. R., Kenward, M. G., & Vansteelandt, S. (2006). A comparison of multiple imputation and doubly robust estimation for analyses with missing data. Journal of the Royal Statistical Society: Series A (Statistics in Society), 169(3), 571–584. doi:10.1111/j.1467-985X.2006.00407.x
   Web of Science ®Google Scholar
• Carter, A. V., Schnepel, K. T., & Steigerwald, D. G. (2017). Asymptotic behavior of at-test robust to cluster heterogeneity. Review of Economics and Statistics, 99(4), 698–709. doi:10.1162/REST_a_00639
   Web of Science ®Google Scholar
• Cronbach, L. J., & Webb, N. (1975). Between-class and within-class effects of repeated aptitude treatment interaction: Re-analysis of a study by G. L. Anderson. Journal of Educational Psychology, 67(6), 717–724.
   Web of Science ®Google Scholar
• Croon, M. A., & van Veldhoven, M. J. (2007). Predicting group-level outcome variables from variables measured at the individual level: A latent variable multilevel model. Psychological Methods, 12(1), 45–57. doi:10.1037/1082-989X.12.1.45
   PubMed Web of Science ®Google Scholar
• Curran, P. J., & Bauer, D. J. (2011). The disaggregation of within-person and between-person effects in longitudinal models of change. Annual Review of Psychology, 62(1), 583–619. doi:10.1146/annurev.psych.093008.100356
   PubMed Web of Science ®Google Scholar
• da Silva, J. L. P., Colosimo, E. A., & Demarqui, F. N. (2015). Doubly robust-based generalized estimating equations for the analysis of longitudinal ordinal missing data. arXiv preprint arXiv:1506.04451.
   Google Scholar
• Ebbes, P., Wedel, M., Böckenholt, U., & Steerneman, T. (2005). Solving and testing for regressor-error (in) dependence when no instrumental variables are available: With new evidence for the effect of education on income. Quantitative Marketing and Economics, 3(4), 365–392. doi:10.1007/s11129-005-1177-6
   Web of Science ®Google Scholar
• Enders, C. K., Keller, B. T., & Levy, R. (2018). A fully conditional specification approach to multilevel imputation of categorical and continuous variables. Psychological Methods, 23(2), 298–317. doi:10.1037/met0000148
   PubMed Web of Science ®Google Scholar
• Fay, M. P., & Graubard, B. I. (2001). Small‐sample adjustments for Wald‐type tests using sandwich estimators. Biometrics, 57(4), 1198–1206. doi:10.1111/j.0006-341X.2001.01198.x
   PubMed Web of Science ®Google Scholar
• Feaster, D., Brincks, A., Robbins, M., & Szapocznik, J. (2011). Multilevel models to identify contextual effects on individual group member outcomes: a family example. Family Process, 50(2), 167–183. doi:10.1111/j.1545-5300.2011.01353.x
   PubMed Web of Science ®Google Scholar
• Firebaugh, G. (1978). A rule for inferring individual-level relationships from aggregate data. American Sociological Review, 43(4), 557–572. doi:10.2307/2094779
   Web of Science ®Google Scholar
• Fitzmaurice, G. M., Laird, N. M., & Rotnitzky, A. G. (1993). Regression models for discrete longitudinal responses. Statistical Science, 8(3), 284–299. doi:10.1214/ss/1177010899
   Web of Science ®Google Scholar
• Fitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2012). Applied longitudinal analysis. Hoboken, NJ: Wiley.
   Google Scholar
• Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491. doi:10.1037/1082-989X.9.4.466
   PubMed Web of Science ®Google Scholar
• Ford, W. P., & Westgate, P. M. (2017). Improved standard error estimator for maintaining the validity of inference in cluster randomized trials with a small number of clusters. Biometrical Journal, 59(3), 478–495. doi:10.1002/bimj.201600182
   PubMed Web of Science ®Google Scholar
• Gardiner, J. C., Luo, Z., & Roman, L. A. (2009). Fixed effects, random effects and GEE: what are the differences? Statistics in Medicine, 28(2), 221–239. doi:10.1002/sim.3478
   PubMed Web of Science ®Google Scholar
• Grilli, L., & Rampichini, C. (2015). Specification of random effects in multilevel models: A review. Quality & Quantity, 49, 967–976. doi:10.1007/s11135-014-0060-5
   Web of Science ®Google Scholar
• Gosho, M., Sato, Y., & Takeuchi, H. (2014). Robust covariance estimator for small-sample adjustment in the generalized estimating equations: A simulation study. Science Journal of Applied Mathematics and Statistics, 2(1), 20–25. doi:10.11648/j.sjams.20140201.13
   Google Scholar
• Grund, S., Lüdtke, O., & Robitzsch, A. (2016). Multiple imputation of missing covariate values in multilevel models with random slopes: A cautionary note. Behavior Research Methods, 48(2), 640–649. doi:10.3758/s13428-015-0590-3
   PubMed Web of Science ®Google Scholar
• Hamaker, E. L., & Grasman, R. P. (2015). To center or not to center? Investigating inertia with a multilevel autoregressive model. Frontiers in Psychology, 5, 1492. http://dx.doi.org/10.3389/fpsyg.2014.01492
   PubMed Web of Science ®Google Scholar
• Heagerty, P. J., & Kurland, B. F. (2001). Misspecified maximum likelihood estimates and generalised linear mixed models. Biometrika, 88(4), 973–985. doi:10.1093/biomet/88.4.973
   Web of Science ®Google Scholar
• Heisig, J. P., & Schaeffer, M. (2018). Why you should always include a random slope for the lower-level variable involved in a cross-level interaction, pre-print, https://doi.org/10.31235/osf.io/bwqtd.
   Google Scholar
• Hoogland, J. J., & Boomsma, A. (1998). Robustness studies in covariance structure modeling: An overview and a meta-analysis. Sociological Methods & Research, 26, 329–367. doi:10.1177/0049124198026003003
   Web of Science ®Google Scholar
• Hossain, A., Diaz-Ordaz, K., & Bartlett, J. W. (2017a). Missing continuous outcomes under covariate dependent missingness in cluster randomised trials. Statistical Methods in Medical Research, 26(3), 1543–1562. doi:10.1177/0962280216648357
   PubMed Web of Science ®Google Scholar
• Hossain, A., DiazOrdaz, K., & Bartlett, J. W. (2017b). Missing binary outcomes under covariate‐dependent missingness in cluster randomised trials. Statistics in Medicine, 36(19), 3092–3109. doi:10.1002/sim.7334
   PubMed Web of Science ®Google Scholar
• Hox, J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). Mahwah, NJ: Erlbaum.
   Google Scholar
• Hox, J. J., & Maas, C. J. (2001). The accuracy of multilevel structural equation modeling with pseudobalanced groups and small samples. Structural Equation Modeling, 8(2), 157–174. doi:10.1207/S15328007SEM0802_1
   Web of Science ®Google Scholar
• Huang, F. L. (2016). Alternatives to multilevel modeling for the analysis of clustered data. The Journal of Experimental Education, 84(1), 175–196. doi:10.1080/00220973.2014.952397
   Web of Science ®Google Scholar
• Huang, S., Fiero, M. H., & Bell, M. L. (2016). Generalized estimating equations in cluster randomized trials with a small number of clusters: Review of practice and simulation study. Clinical Trials: Journal of the Society for Clinical Trials, 13(4), 445–449. doi:10.1177/1740774516643498
   Google Scholar
• Ibrahim, J. G. (1990). Incomplete data in generalized linear models. Journal of the American Statistical Association, 85(411), 765–769. doi:10.1080/01621459.1990.10474938
   Web of Science ®Google Scholar
• Imbens, G. W., & Kolesar, M. (2016). Robust standard errors in small samples: Some practical advice. Review of Economics and Statistics, 98(4), 701–712. doi:10.1162/REST_a_00552
   Web of Science ®Google Scholar
• Iverson, G. R. (1991). Contextual analysis. Newbury Park, CA: Sage
   Google Scholar
• Jacqmin-Gadda, H., Sibillot, S., Proust, C., Molina, J. M., & Thiébaut, R. (2007). Robustness of the linear mixed model to misspecified error distribution. Computational Statistics & Data Analysis, 51, 5142–5154. doi:10.1016/j.csda.2006.05.021
   Web of Science ®Google Scholar
• Kauermann, G., & Carroll, R. J. (2001). A note on the efficiency of sandwich covariance matrix estimation. Journal of the American Statistical Association, 96(456), 1387–1396. doi:10.1198/016214501753382309
   Web of Science ®Google Scholar
• Kim, Y., Choi, Y. K., & Emery, S. (2013). Logistic regression with multiple random effects: a simulation study of estimation methods and statistical packages. The American Statistician, 67(3), 171–182. doi:10.1080/00031305.2013.817357
   Web of Science ®Google Scholar
• LaHuis, D. M., & Ferguson, M. W. (2009). The accuracy of significance tests for slope variance components in multilevel random coefficient models. Organizational Research Methods, 12(3), 418–435. doi:10.1177/1094428107308984
   Web of Science ®Google Scholar
• Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38(4), 963–974. doi:10.2307/2529876
   PubMed Web of Science ®Google Scholar
• Leyrat, C., Morgan, K. E., Leurent, B., & Kahan, B. C. (2018). Cluster randomized trials with a small number of clusters: which analyses should be used? International Journal of Epidemiology, 47(1), 321–331. doi:10.1093/ije/dyx169
   PubMed Web of Science ®Google Scholar
• Li, P., & Redden, D. T. (2015). Small sample performance of bias‐corrected sandwich estimators for cluster‐randomized trials with binary outcomes. Statistics in Medicine, 34(2), 281–296. doi:10.1002/sim.6344
   PubMed Web of Science ®Google Scholar
• Liang, K. Y., & Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73(1), 13–22. doi:10.1093/biomet/73.1.13
   Web of Science ®Google Scholar
• Little, R. J. (1995). Modeling the drop-out mechanism in repeated-measures studies. Journal of the American Statistical Association, 90(431), 1112–1121. doi:10.1080/01621459.1995.10476615
   Web of Science ®Google Scholar
• Litière, S., Alonso, A., & Molenberghs, G. (2007). Type I and type II error under random‐effects misspecification in generalized linear mixed models. Biometrics, 63(4), 1038–1044. doi:10.1111/j.1541-0420.2007.00782.x
   PubMed Web of Science ®Google Scholar
• Lüdtke, O., Marsh, H. W., Robitzsch, A., Trautwein, U., Asparouhov, T., & Muthén, B. (2008). The multilevel latent covariate model: a new, more reliable approach to group-level effects in contextual studies. Psychological Methods, 13(3), 203–229. doi:10.1037/a0012869
   PubMed Web of Science ®Google Scholar
• Maas, C. J., & Hox, J. J. (2004a). The influence of violations of assumptions on multilevel parameter estimates and their standard errors. Computational Statistics & Data Analysis, 46, 427–440. doi:10.1016/j.csda.2003.08.006
   Web of Science ®Google Scholar
• Maas, C. J., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58(2), 127–137. doi:10.1046/j.0039-0402.2003.00252.x
   Web of Science ®Google Scholar
• MacKinnon, J. G., & White, H. (1985). Some heteroskedasticity-consistent covariance matrix estimators with improved finite sample properties. Journal of Econometrics, 29(3), 305–325. doi:10.1016/0304-4076(85)90158-7
   Web of Science ®Google Scholar
• Mancl, L. A., & DeRouen, T. A. (2001). A covariance estimator for GEE with improved small‐sample properties. Biometrics, 57(1), 126–134. doi:10.1111/j.0006-341X.2001.00126.x
   PubMed Web of Science ®Google Scholar
• Marsh, H. W., Lüdtke, O., Robitzsch, A., Trautwein, U., Asparouhov, T., Muthén, B., & Nagengast, B. (2009). Doubly-latent models of school contextual effects: Integrating multilevel and structural equation approaches to control measurement and sampling error. Multivariate Behavioral Research, 44(6), 764–802. doi:10.1080/00273170903333665
   PubMed Web of Science ®Google Scholar
• McCulloch, C. E., & Neuhaus, J. M. (2011). Prediction of random effects in linear and generalized linear models under model misspecification. Biometrics, 67(1), 270–279. doi:10.1111/j.1541-0420.2010.01435.x
   PubMed Web of Science ®Google Scholar
• McNeish, D. (2016). Estimation methods for mixed logistic models with few clusters. Multivariate Behavioral Research, 51, 790–804. doi:10.1080/00273171.2016.1236237
   PubMed Web of Science ®Google Scholar
• McNeish, D. (2017a). Multilevel mediation with small samples: A cautionary note on the multilevel structural equation modeling framework. Structural Equation Modeling, 24(4), 609–625. doi:10.1080/10705511.2017.1280797
   Web of Science ®Google Scholar
• McNeish, D. (2017b). Challenging conventional wisdom for multivariate statistical models with small samples. Review of Educational Research, 87(6), 1117–1151. doi:10.3102/0034654317727727
   Web of Science ®Google Scholar
• McNeish, D. (2017c). Small sample methods for multilevel modeling: A colloquial elucidation of REML and the Kenward-Roger correction. Multivariate Behavioral Research, 52(5), 661–670. doi:10.1080/00273171.2017.1344538
   PubMed Web of Science ®Google Scholar
• McNeish, D., & Harring, J. R. (2017). Clustered data with small sample sizes: Comparing the performance of model-based and design-based approaches. Communications in Statistics-Simulation and Computation, 46(2), 855–869. doi:10.1080/03610918.2014.983648
   Web of Science ®Google Scholar
• McNeish, D., & Kelley, K. (2019). Fixed effects models versus mixed effects models for clustered data: Reviewing the approaches, disentangling the differences, and making recommendations. Psychological Methods, 24, 20–35. doi:10.1037/met0000182
   PubMed Web of Science ®Google Scholar
• McNeish, D., & Stapleton, L. M. (2016). Modeling clustered data with very few clusters. Multivariate Behavioral Research, 51(4), 495–518. doi:10.1080/00273171.2016.1167008
   PubMed Web of Science ®Google Scholar
• McNeish, D., Stapleton, L. M., & Silverman, R. D. (2017). On the unnecessary ubiquity of hierarchical linear modeling. Psychological Methods, 22(1), 114–140. doi:10.1037/met0000078
   PubMed Web of Science ®Google Scholar
• Merlo, J., Chaix, B., Yang, M., Lynch, J., & Råstam, L. (2005). A brief conceptual tutorial of multilevel analysis in social epidemiology: linking the statistical concept of clustering to the idea of contextual phenomenon. Journal of Epidemiology & Community Health, 59, 443–449. doi:10.1136/jech.2004.023473
   PubMed Web of Science ®Google Scholar
• Morel, J. G., Bokossa, M. C., & Neerchal, N. K. (2003). Small sample correction for the variance of GEE estimators. Biometrical Journal, 45(4), 395–409. doi:10.1002/bimj.200390021
   Web of Science ®Google Scholar
• Pan, W. (2001). On the robust variance estimator in generalised estimating equations. Biometrika, 88(3), 901–906. doi:10.1093/biomet/88.3.901
   Web of Science ®Google Scholar
• Paul, S., & Zhang, X. (2014). Small sample GEE estimation of regression parameters for longitudinal data. Statistics in Medicine, 33(22), 3869–3881. doi:10.1002/sim.6198
   PubMed Web of Science ®Google Scholar
• Pinheiro, J. C., & Chao, E. C. (2006). Efficient Laplacian and adaptive Gaussian quadrature algorithms for multilevel generalized linear mixed models. Journal of Computational and Graphical Statistics, 15(1), 58–81. doi:10.1198/106186006X96962
   Web of Science ®Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Thousand Oaks, CA: Sage.
   Google Scholar
• Robins, J. M., Rotnitzky, A., & Zhao, L. P. (1994). Estimation of regression coefficients when some regressors are not always observed. Journal of the American Statistical Association, 89(427), 846–866. doi:10.1080/01621459.1994.10476818
   Web of Science ®Google Scholar
• Roux, A. D. (2002). A glossary for multilevel analysis. Journal of Epidemiology & Community Health, 56, 588–594.
   PubMed Web of Science ®Google Scholar
• Royall, R. M. (1986). Model robust confidence intervals using maximum likelihood estimators. International Statistical Review, 54(2), 221–226. doi:10.2307/1403146
   Web of Science ®Google Scholar
• Scherbaum, C. A., & Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organizational Research Methods, 12(2), 347–367. doi:10.1177/1094428107308906
   Web of Science ®Google Scholar
• Snijders, T. A. B., & Berkhof, J. (2008). Diagnostic checks for multilevel models. In J. de Leeuq & E. Meijer (Eds.), Handbook of multilevel analysis (pp. 141–175). New York, NY: Springer.
   Google Scholar
• Snijders, T. A. B., & Bosker, R. J. (2011). Multilevel Analysis: An Introduction to Basic and Advanced Multilevel Modeling (2nd ed.). London, UK: Sage.
   Google Scholar
• Stram, D. O., & Lee, J. W. (1994). Variance components testing in the longitudinal mixed effects model. Biometrics, 50(4), 1171–1177. doi:10.2307/2533455
   PubMed Web of Science ®Google Scholar
• Sterba, S. K. (2009). Alternative model-based and design-based frameworks for inference from samples to populations: From polarization to integration. Multivariate Behavioral Research, 44(6), 711–740. doi:10.1080/00273170903333574
   PubMed Web of Science ®Google Scholar
• Twisk, J. W. (2004). Longitudinal data analysis. A comparison between generalized estimating equations and random coefficient analysis. European Journal of Epidemiology, 19(8), 769–776. doi:10.1023/B:EJEP.0000036572.00663.f2
   PubMed Web of Science ®Google Scholar
• U.S. Department of Education, National Center for Education Statistics (1982). High School and Beyond longitudinal study: First follow up, 1982. Washington, DC: Author
   Google Scholar
• Wang, M. (2015). Geesmv: Modified variance estimators for generalized estimating equations, R package. https://CRAN.R-project.org/package=geesmv.
   Google Scholar
• Wang, M., & Long, Q. (2011). Modified robust variance estimator for generalized estimating equations with improved small‐sample performance. Statistics in Medicine, 30(11), 1278–1291. doi:10.1002/sim.4150
   PubMed Web of Science ®Google Scholar
• Wedderburn, R. W. (1974). Quasi-likelihood functions, generalized linear models, and the Gauss—Newton method. Biometrika, 61, 439–447. doi:10.2307/2334725
   Web of Science ®Google Scholar
• Westgate, P. M. (2016). A covariance correction that accounts for correlation estimation to improve finite-sample inference with generalized estimating equations: a study on its applicability with structured correlation matrices. Journal of Statistical Computation and Simulation, 86(10), 1891–1900. doi:10.1080/00949655.2015.1089873
   PubMed Web of Science ®Google Scholar
• White, H. (1982). Maximum likelihood estimation of misspecified models. Econometrica, 50(1), 1–25. doi:10.2307/1912526
   Web of Science ®Google Scholar
• Zeger, S. L., & Liang, K. Y. (1986). Longitudinal data analysis for discrete and continuous outcomes. Biometrics, 42(1), 121–130. doi:10.2307/2531248
   PubMed Web of Science ®Google Scholar
• Zeger, S. L., Liang, K. Y., & Albert, P. S. (1988). Models for longitudinal data: a generalized estimating equation approach. Biometrics, 44(4), 1049–1060. doi:10.2307/2531734
   PubMed Web of Science ®Google Scholar