Poisson Multilevel Models with Small Samples

References

• Austin, P. C. (2010). Estimating multilevel logistic regression models when the number of clusters is low: A comparison of different statistical software procedures. The International Journal of Biostatistics, 6. doi: 10.2202/1557-4679.1195
   Google Scholar
• Bell, B. A., Morgan, G. B., Schoeneberger, J. A., Kromrey, J. D., & Ferron, J. M. (2014). How low can you go? An investigation of the influence of sample size and model complexity on point and interval estimates in two-level linear models. Methodology, 10(1), 1–11. doi: 10.1027/1614-2241/a000062
   Web of Science ®Google Scholar
• Bellamy, S. L., Li, Y., Lin, X., & Ryan, L. M. (2005). Quantifying PQL bias in estimating cluster-level covariate effects in generalized linear mixed models for group-randomized trials. Statistica Sinica, 15, 1015–1032.
   Web of Science ®Google Scholar
• Bellio, R., & Brazzale, A. R. (2011). Restricted likelihood inference for generalized linear mixed models. Statistics and Computing, 21(2), 173–183. doi: 10.1007/s11222-009-9157-4
   Web of Science ®Google Scholar
• Benedetti, A., Platt, R., & Atherton, J. (2014). Generalized linear mixed models for binary data: Are matching results from penalized quasi-likelihood and numerical integration less biased? PloS One, 9(1), e84601. doi: 10.1371/journal.pone.0084601
   PubMed Web of Science ®Google Scholar
• Börsch-Supan, A. (2018). Survey of Health, Ageing and Retirement in Europe (SHARE) Wave 1. Release version: 6.1.0. SHARE-ERIC. Data set. doi: 10.6103/SHARE.w1.611
   Google Scholar
• Börsch-Supan, A., Brandt, M., Hunkler, C., Kneip, T., Korbmacher, J., Malter, F., … Zuber, B. (2013). Data resource profile: The survey of health, ageing and retirement in Europe (SHARE). International Journal of Epidemiology, doi: 10.1093/ije/dyt088
   PubMed Web of Science ®Google Scholar
• Bradley, J. V. (1978). Robustness? British Journal of Mathematical and Statistical Psychology, 31(2), 144–152. doi: 10.1111/j.2044-8317.1978.tb00581.x
   Web of Science ®Google Scholar
• Breslow, N. E., & Clayton, D. G. (1993). Approximate inference in generalized linear mixed models. Journal of the American Statistical Association, 88, 9–25. doi: 10.2307/2290687
   Web of Science ®Google Scholar
• Browne, W. J., & Draper, D. (2006). A comparison of Bayesian and likelihood-based methods for fitting multilevel models. Bayesian Analysis, 1(3), 473–514. doi: 10.1214/06-BA117
   Web of Science ®Google Scholar
• Callens, M., & Croux, C. (2005). Performance of likelihood-based estimation methods for multilevel binary regression models. Journal of Statistical Computation and Simulation, 75(12), 1003–1017. doi: 10.1080/00949650412331321070
   Web of Science ®Google Scholar
• Capanu, M., Gönen, M., & Begg, C. B. (2013). An assessment of estimation methods for generalized linear mixed models with binary outcomes. Statistics in Medicine, 32(26), 4550–4566. doi: 10.1002/sim.5866
   PubMed Web of Science ®Google Scholar
• Clarke, P. (2008). When can group level clustering be ignored? Multilevel models versus single-level models with sparse data. Journal of Epidemiology & Community Health, 6, 752–758. doi: 10.1136/jech.2007.060798
   Web of Science ®Google Scholar
• Clarke, P., & Wheaton, B. (2007). Addressing data sparseness in contextual population research: Using cluster analysis to create synthetic neighborhoods. Sociological Methods & Research, 35, 311–351. doi: 10.1177/0049124106292362
   Web of Science ®Google Scholar
• Clarkson, D. B., & Zhan, Y. (2002). Using spherical–radial quadrature to fit generalized linear mixed effects models. Journal of Computational and Graphical Statistics, 11(3), 639–659. doi: 10.1198/106186002439
   Web of Science ®Google Scholar
• Coxe, S., West, S. G., & Aiken, L. S. (2009). The analysis of count data: A gentle introduction to Poisson regression and its alternatives. Journal of Personality Assessment, 91(2), 121–136. doi: 10.1080/00223890802634175
   PubMed Web of Science ®Google Scholar
• Dean, C. B., Ugarte, M. D., & Militino, A. F. (2004). Penalized quasi-likelihood with spatially correlated data. Computational Statistics & Data Analysis, 45, 235–248. doi: 10.1016/S0167-9473(02)00324-9
   Web of Science ®Google Scholar
• Depaoli, S. (2014). The impact of inaccurate “informative” priors for growth parameters in Bayesian growth mixture modeling. Structural Equation Modeling, 21(2), 239–252. doi: 10.1080/10705511.2014.882686
   Web of Science ®Google Scholar
• Diaz, R. E. (2007). Comparison of PQL and Laplace 6 estimates of hierarchical linear models when comparing groups of small incident rates in cluster randomised trials. Computational Statistics & Data Analysis, 51, 2871–2888. doi: 10.1016/j.csda.2006.10.005
   Web of Science ®Google Scholar
• Ferron, J. M., Bell, B. A., Hess, M. R., Rendina-Gobioff, G., & Hibbard, S. T. (2009). Making treatment effect inferences from multiple-baseline data: The utility of multilevel modeling approaches. Behavior Research Methods, 41(2), 372–384. doi: 10.3758/BRM.41.2.372
   PubMed Web of Science ®Google Scholar
• Fitzmaurice, G. M., Laird, N. M., & Ware, J. H. (2004). Applied longitudinal analysis. Hoboken, NJ: Wiley.
   Google Scholar
• Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491. doi: 10.1037/1082-989X.9.4.466
   PubMed Web of Science ®Google Scholar
• Gelman, A., & Hill, J. (2006). Data analysis using regression and multilevel/hierarchical models. Cambridge: Cambridge University Press.
   Google Scholar
• Goldstein, H., & Rasbash, J. (1996). Improved approximations for multilevel models with binary responses. Journal of the Royal Statistical Society Series A, 159(3), 505–513. doi: 10.2307/2983328
   Web of Science ®Google Scholar
• Hox, J. J., van de Schoot, R., & Matthijsse, S. (2012). How few countries will do? Comparative survey analysis from a Bayesian perspective. Survey Research Methods, 6, 87–93. doi: 10.18148/srm/2012.v6i2.5033
   Web of Science ®Google Scholar
• Joe, H. (2008). Accuracy of Laplace approximation for discrete response mixed models. Computational Statistics & Data Analysis, 52, 5066–5074. doi: 10.1016/j.csda.2008.05.002
   Web of Science ®Google Scholar
• Kenward, M. G., & Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53(3), 983–997. doi: 10.2307/2533558
   PubMed Web of Science ®Google Scholar
• Kenward, M. G., & Roger, J. H. (2009). An improved approximation to the precision of fixed effects from restricted maximum likelihood. Computational Statistics & Data Analysis, 53, 2583–2595. doi: 10.1016/j.csda.2008.12.013
   Web of Science ®Google Scholar
• Kim, Y., Choi, Y. K., & Emery, S. (2013). Logistic regression with multiple random effects: A simulation study of estimation methods and statistical packages. The American Statistician, 67(3), 171–182. doi: 10.1080/00031305.2013.817357
   Web of Science ®Google Scholar
• Kreft, I. (1996). Are multilevel techniques necessary? An overview including simulation studies. Unpublished manuscript, California State University, Los Angeles.
   Google Scholar
• Laird, N. M., & Ware, J. H. (1982). Random-effects models for longitudinal data. Biometrics, 38(4), 963–974. doi: 10.2307/2529876
   PubMed Web of Science ®Google Scholar
• Lee, Y., & Nelder, J. A. (1999). The robustness of the quasilikelihood estimator. Canadian Journal of Statistics, 27(2), 321–327. doi: 10.2307/3315642
   Web of Science ®Google Scholar
• Lesaffre, E., & Spiessens, B. (2001). On the effect of the number of quadrature points in a logistic random effects model: An example. Journal of the Royal Statistical Society: Series C, 50(3), 325–335. doi: 10.1111/1467-9876.00237
   Web of Science ®Google Scholar
• Litière, S., Alonso, A., & Molenberghs, G. (2007). Type I and Type II error under random-effects misspecification in generalized linear mixed models. Biometrics, 63(4), 1038–1044. doi: 10.1111/j.1541-0420.2007.00782.x
   PubMed Web of Science ®Google Scholar
• Maas, C., & Hox, J. J. (2004). Robustness issues in multilevel regression analysis. Statistica Neerlandica, 58(2), 127–137. doi: 10.1046/j.0039-0402.2003.00252.x
   Web of Science ®Google Scholar
• Maas, C., & Hox, J. J. (2005). Sufficient sample sizes for multilevel modeling. Methodology, 1(3), 86–92. doi: 10.1027/1614-2241.1.3.86
   Google Scholar
• McNeish, D. (2014). Modeling sparsely clustered data: Design-based, model-based, and single-level methods. Psychological Methods, 19(4), 552–563. doi: 10.1037/met0000024
   PubMed Web of Science ®Google Scholar
• McNeish, D. (2016a). Estimation methods for mixed logistic models with few clusters. Multivariate Behavioral Research, 51, 790–804. doi: 10.1080/00273171.2016.1236237
   PubMed Web of Science ®Google Scholar
• McNeish, D. (2016b). On using Bayesian methods to address small sample problems. Structural Equation Modeling, 23(5), 750–773. doi: 10.1080/10705511.2016.1186549
   Web of Science ®Google Scholar
• McNeish, D., & Stapleton, L. M. (2016a). Modeling clustered data with very few clusters. Multivariate Behavioral Research, 51(4), 495–518. doi: 10.1080/00273171.2016.1167008
   PubMed Web of Science ®Google Scholar
• McNeish, D., & Stapleton, L. M. (2016b). The effect of small sample size on two level model estimates: A review and illustration. Educational Psychology Review, 28(2), 295–314. doi: 10.1007/s10648-014-9287-x
   Web of Science ®Google Scholar
• Moineddin, R., Matheson, F. I., & Glazier, R. H. (2007). A simulation study of sample size for multilevel logistic regression models. BMC Medical Research Methodology, 7, 34. doi: 10.1186/1471-2288-7-34
   PubMed Web of Science ®Google Scholar
• Paccagnella, O. (2011). Sample size and accuracy of estimates in multilevel models: New simulation results. Methodology, 7(3), 111–120. doi: 10.1027/1614-2241/a000029
   Web of Science ®Google Scholar
• Pinheiro, J. C., & Bates, D. M. (1995). Approximations to the log-likelihood function in the nonlinear mixed-effects model. Journal of Computational and Graphical Statistics, 4, 12–35. doi: 10.2307/1390625
   Google Scholar
• Pinheiro, J. C., & Chao, E. C. (2006). Efficient Laplacian and adaptive Gaussian quadrature algorithms for multilevel generalized linear mixed models. Journal of Computational and Graphical Statistics, 15(1), 58–81. doi: 10.1198/106186006X96962
   Web of Science ®Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Newbury Park, CA: Sage Publications.
   Google Scholar
• Raudenbush, S. W., Yang, M. L., & Yosef, M. (2000). Maximum likelihood for generalized linear models with nested random effects via high-order, multivariate Laplace approximation. Journal of Computational and Graphical Statistics, 9, 141–157. doi: 10.2307/1390617
   Web of Science ®Google Scholar
• Rodriguez, G., & Goldman, N. (1995). An assessment of estimation procedures for multilevel models with binary responses. Journal of the Royal Statistical Society, Series A, 158(1), 73–89. doi: 10.2307/2983404
   Web of Science ®Google Scholar
• Schall, R. (1991). Estimation in generalized linear models with random effects. Biometrika, 78(4), 719–727. doi: 10.1093/biomet/78.4.719
   Web of Science ®Google Scholar
• Scherbaum, C. A., & Ferreter, J. M. (2009). Estimating statistical power and required sample sizes for organizational research using multilevel modeling. Organizational Research Methods, 12(2), 347–367.
   Web of Science ®Google Scholar
• Schoeneberger, J. A. (2016). The impact of sample size and other factors when estimating multilevel logistic models. Journal of Experimental Education, 84(2), 373–397. doi: 10.1080/00220973.2015.1027805
   Web of Science ®Google Scholar
• StataCorp., (2013). Stata Multilevel Mixed-Effects Reference Manual Release 13. College Station, TX: StataCorp LP.
   Google Scholar
• Stegmueller, D. (2013). How many countries for multilevel modeling? A comparison of frequentist and Bayesian approaches. American Journal of Political Science, 57(3), 748–761. doi: 10.1111/ajps.12001
   Web of Science ®Google Scholar
• Stram, D. O., & Lee, J. W. (1994). Variance components testing in the longitudinal mixed effects model. Biometrics, 50(4), 1171–1177. doi: 10.2307/2533455
   PubMed Web of Science ®Google Scholar
• Tierney, L., & Kadane, J. B. (1986). Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81(393), 82–86. doi: 10.1080/01621459.1986.10478240
   Web of Science ®Google Scholar
• Van De Schoot, R., Broere, J. J., Perryck, K. H., Zondervan-Zwijnenburg, M., & Van Loey, N. E. (2015). Analyzing small data sets using Bayesian estimation: The case of posttraumatic stress symptoms following mechanical ventilation in burn survivors. European Journal of Psychotraumatology, 6. doi: 10.3402/ejpt.v6.25216
   Web of Science ®Google Scholar
• Wolfinger, R., & O’Connell, M. (1993). Generalized linear mixed models a pseudo likelihood approach. Journal of Statistical Computation and Simulation, 48(3-4), 233–243. doi: 10.1080/00949659308811554
   Web of Science ®Google Scholar
• Zhou, X. H., Perkins, A. J., & Hui, S. L. (1999). Comparisons of software packages for generalized linear multilevel models. The American Statistician, 53, 282–290. doi: 10.2307/2686112
   Web of Science ®Google Scholar