Evaluating Supplemental Samples in Longitudinal Research: Replacement and Refreshment Approaches

References

• Alemu, T., Asgedom, G., Liebenberg, J., Mekonnen, A., Seager, J., Tefera, B., & Woldehanna, T. (2003). Young lives preliminary country report: Ethiopia. London: Young Lives. Retrieved from https://www.younglives.org.uk/sites/www.younglives.org.uk/files/YL-CR1-Ethiopia-2003-revised_2.pdf
   Google Scholar
• Aldridge, A. A., & Roesch, S. C. (2008). Coping with daily stressors modeling intraethnic variation in Mexican American adolescents. Hispanic Journal of Behavioral Sciences, 30(3), 340–356. doi: 10.1177/0739986308318708
   Web of Science ®Google Scholar
• Baltes, P. B., & Nesselroade, J. R. (1979). History and rationale of longitudinal research. In J. R. Nesselroade & P. B. Baltes (Eds.), Longitudinal research in the study of behavior and development (pp. 1–59). New York: Academic Press.
   Google Scholar
• Baraldi, A. N., & Enders, C. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48(1), 5–37. doi:10.1016/j.jsp.2009.10.001
   PubMed Web of Science ®Google Scholar
• Barnett, I., Ariana, P., Petrou, S., Penny, M. E., Duc, L. T., Galab, S., … Boyden, J. (2013). Cohort profile: The young lives study. International Journal of Epidemiology, 42(3), 701–708. doi:10.1093/ije/dys082
   PubMed Web of Science ®Google Scholar
• Betancourt, T. S., Borisova, I. I., Williams, T. P., Brennan, R. T., Whitfield, T. H., De La Soudiere, M., … Gilman, S. E. (2010). Sierra Leone's former child soldiers: A follow-up study of psychosocial adjustment and community reintegration. Child Development, 81(4), 1077–1095. doi:10.1111/j.1467-8624.2010.01455.x
   PubMed Web of Science ®Google Scholar
• Boxer, P., Rowell, L., Dubow, E. F., Landau, S. F., Gvirsman, S. D., Shikaki, K., & Ginges, J. (2013). Exposure to violence across the social ecosystem and the development of aggression: A test of ecological theory in the Israeli–Palestinian conflict. Child Development, 84(1), 163–177. doi:10.1111/j.1467-8624.2012.01848.x
   PubMed Web of Science ®Google Scholar
• Bradley, J. V. (1978). Robustness?. British Journal of Mathematical and Statistical Psychology, 31(2), 144–152. doi:10.1111/j.2044-8317.1978.tb00581.x
   Web of Science ®Google Scholar
• Browning, C. R., Burrington, L. A., Leventhal, T., & Brooks-Gunn, J. (2008). Neighborhood structural inequality, collective efficacy, and sexual risk behavior among urban youth. Journal of Health and Social Behavior, 49(3), 269–285. doi:10.1177/002214650804900303
   PubMed Web of Science ®Google Scholar
• Capaldi, D. M., & Patterson, G. R. (1987). An approach to the problem of recruitment rates for longitudinal research. Behavioral Assessment, 9(2), 169–178.
   Google Scholar
• Chapman, D. W. (2003). To substitute or not to substitute – that is the question. Survey Statistician, 48, 32–34.
   Google Scholar
• Chapman, D. W., & Roman, A. M. (1985). An investigation of substitution for an RDD survey. Retrieved June 19, 2019 from http://www.asasrms.org/Proceedings/papers/1985_048.pdf.
   Google Scholar
• Conger, R. D., & Conger, K. J. (2002). Resilience in Midwestern families: Selected findings from the first decade of a prospective, longitudinal study. Journal of Marriage and Family, 64(2), 361–373. doi:10.1111/j.1741-3737.2002.00361.x
   Web of Science ®Google Scholar
• Cortes, C., Mohri, M., Riley, M., & Rostamizadeh, A. (2008). Sample Selection Bias Correction Theory. In Y. Freund, L. Györfi, G. Turán & T. Zeugmann (Eds.), Algorithmic learning theory. ALT 2008 (pp. 38–53). (Lecture Notes in Computer Science, 5254). Berlin, Heidelberg: Springer.
   Google Scholar
• Cotter, R. B., Burke, J. D., Loeber, R., & Navratil, J. L. (2002). Innovative retention methods in longitudinal research: A case study of the developmental trends study. Journal of Child and Family Studies, 11(4), 485–498. doi:10.1023/A:1020939626243
   Google Scholar
• Cummings, E. M., Merrilees, C. E., Taylor, L. K., Shirlow, P., Goeke-Morey, M., & Cairns, E. (2013). Longitudinal relations between sectarian and non-sectarian community violence and child adjustment in Northern Ireland. Development and Psychopathology, 25(3), 615–627. doi:10.1017/S0954579413000059
   PubMed Web of Science ®Google Scholar
• D’Amico, A. M. (2011). Appendix A.2. High School and Beyond Longitudinal Study. In National Center for Education Statistics Sources. Retrieved from http://nces.ed.gov/programs/digest/d11/app_a2_9.asp.
   Google Scholar
• Deng, Y., Hillygus, D. S., Reiter, J. P., Si, Y., & Zheng, S. (2013). Handling attrition in longitudinal studies: The case for refreshment samples. Statistical Science, 28(2), 238–256. doi:10.1214/13-STS414
   Web of Science ®Google Scholar
• Dorsett, R. (2010). Adjusting for nonignorable sample attrition using survey substitutes identified by propensity score matching: An empirical investigation using labour market data. Journal of Official Statistics, 26(1), 105–125. Retrieved from http://www.jos.nu/Articles/abstract.asp?article=260105
   Web of Science ®Google Scholar
• Elliot, D. S., Huizinga, D., & Menard, S. (1989). Multiple problem youth: Delinquency, substance use, and mental health problems. New York. Springer-Verlag. doi:10.1007/078-1-4613-9637-6
   Google Scholar
• Enders, C. K. (2010). Applied missing data analysis. New York, NY: Guildford Press.
   Google Scholar
• Enders, C. K. (2013). Dealing with missing data in developmental research. Child Development Perspectives, 7(1), 27–31. doi:10.1111/cdep.12008
   Web of Science ®Google Scholar
• English Longitudinal Study of Ageing (ELSA). (2015). User Guide for the Wave 0 (HSE) Core Datasets. Retrieved from http://www.esds.ac.uk/doc/5050%5Cmrdoc%5Cpdf%5C5050_Wave_0_User_Guide.pdf
   Google Scholar
• Frick, J. R., Goebel, J., Schechtman, E., Wagner, G. G., & Yitzhaki, S. (2006). Using analysis of Gini (ANOGI) for detecting whether two subsamples represent the same universe: The German SocioEconomic Panel Study (SOEP) experience. Sociological Methods Research, 34(4), 427–468. doi:10.1177/0049124105283109
   Web of Science ®Google Scholar
• Fritz, M. S. (2014). An exponential decay model for mediation. Prevention Science, 15(5), 611–622. doi:10.1007/s11121-013-0390-x
   PubMed Web of Science ®Google Scholar
• Gouskova, E., Heeringa, S. G., McGonagle, K., & Schoeni, R. F. (2008. June). Technical Report Panel Study of Income Dynamics Revised Longitudinal Weights 1993-2005. Survey Research Center, Institute for Social Research, University of Michigan, Ann Arbor, MI. Retrieved from https://psidonline.isr.umich.edu/data/weights/Long-weights-doc.pdf
   Google Scholar
• Graham, J. W., & Donaldson, S. I. (1993). Evaluating interventions with differential attribution: The importance of nonresponse mechanisms and use of follow-up data. Journal of Applied Psychology, 78(1), 119–128. doi:10.1037/0021-9010.78.1.119
   PubMed Web of Science ®Google Scholar
• Graham, J. W., Hofer, S. M., & MacKinnon, D. P. (1996). Maximizing the usefulness of data obtained with planned missing value patterns: An application of maximum likelihood procedures. Multivariate Behavioral Research, 31(2), 197–218. doi:10.1207/s15327906mbr3102_3
   PubMed Web of Science ®Google Scholar
• Graham, J. W., Taylor, B. J., & Cumsille, P. E. (2001). Planned missing-data designs in analysis of change. In J. W. Graham, B. J. Taylor, & P. E. Cumsille (Eds.), New methods for the analysis of change (pp. 335–353). Washington, DC: American Psychological Association. http://dx.doi.org/10.1037/10409-011
   Google Scholar
• Graham, J. W., Taylor, B. J., Olchowski, A. E., & Cumsille, P. E. (2006). Planned missing data in psychological research. Psychological Methods, 11(4), 323–343. doi:10.1037/1082-989X.11.4.323
   PubMed Web of Science ®Google Scholar
• Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60(1), 549–576. doi:10.1146/annurev.psych.58.110405.085530
   PubMed Web of Science ®Google Scholar
• Hartsough, C. S., Babinski, L. M., & Lambert, N. M. (1996). Tracking procedures and attrition containment in a long-term follow-up of a community-based ADHD sample. Journal of Child Psychology and Psychiatry, 37(6), 705–713. doi:10.1111/j.1469-7610.1996.tb01462.x
   PubMed Web of Science ®Google Scholar
• Hirano, K., Imbens, G. W., Ridder, G., & Rubin, D. B. (2001). Combining panel data sets with attrition and refreshment samples. Econometrica, 69(6), 1645–1659. doi:10.1111/1468-0262.00260
   Web of Science ®Google Scholar
• Höfler, M., Pfister, H., Lieb, R., & Wittchen, H. (2005). The use of weights to account for non-response and drop-out. Social Psychiatry and Psychiatric Epidemiology, 40(4), 291–299. doi:10.1007/s00127-005-0882-5
   PubMed Web of Science ®Google Scholar
• Jeličić, H., Phelps, E., & Lerner, R. M. (2009). Use of missing data methods in longitudinal studies: The persistence of bad practices in developmental psychology. Developmental Psychology, 45(4), 1195–1199. doi:10.1037/a0015665
   PubMed Web of Science ®Google Scholar
• Jorgensen, T. D., Rhemtulla, M., Schoemann, A., McPherson, B., Wu, W., & Little, T. D. (2014). Optimal assignment methods in three-form planned missing data designs for longitudinal panel studies. International Journal of Behavioral Development, 38(5), 397–410. doi:10.1177/0165025414531094
   Web of Science ®Google Scholar
• Karrifer-Jafee, K. J., Foshee, V. A., Ennett, S. T., & Suchindran, C. (2013). Associations of neighborhood and family factors with trajectories of physical and social aggression during adolescence. Journal of Youth and Adolescence, 42(6), 861–877. doi:10.1007/s10964-012-9832-1
   PubMed Web of Science ®Google Scholar
• Kellam, S. G., Rebok, G. W., Ialongo, N., & Mayer, L. S. (1994). The course and malleability of aggressive behavior from early first grade into middle school: Results of a developmental epidemiologically-based preventive trial. Journal of Child Psychology and Psychiatry, 35(2), 259–281. doi:10.1111/j.1469-7610.1994.tb01161.x
   PubMed Web of Science ®Google Scholar
• Kronenberg, M. E., Hansel, T. C., Brennan, A. M., Osofsky, H. J., Osofsky, J. D., & Lawrason, B. (2010). Children of Katrina: Lessons learned about postdisaster symptoms and recovery patterns. Child Development, 81(4), 1241–1259. doi:10.1111/j.1467-8624.2010.01465.x
   PubMed Web of Science ®Google Scholar
• Kruse, Y., Callegaro, M., Dennis, J., Subias, S., Lawrence, M., DiSogra, C., & Tompson, T. (2009). Panel conditioning and attrition in the AP-Yahoo! News Election Panel Study. Paper presented at the 64th conference of the American Association for Public Opinion Research (AAPOR), Hollywood, FL. Retrieved from https://www.researchgate.net/publication/253431812_Panel_Conditioning_and_Attrition_in_the_AP-Yahoo_News_Election_Panel_Study
   Google Scholar
• Langkamp, D. L., Lehman, A., & Lemeshow, S. (2010). Methods: Techniques for handling missing data in secondary analyses of large surveys. Academic Pediatrics, 10(3), 205–210. doi:10.1016/j.acap.2010.01.005
   PubMed Web of Science ®Google Scholar
• Little, R. J. A. (1993). Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association, 88(421), 125–134. doi:10.1080/01621459.1993.10594302
   Web of Science ®Google Scholar
• Little, R. J. A. (1995). Modeling the drop-out mechanism in repeated-measures studies. Journal of the American Statistical Association, 90(431), 1112–1121. doi:10.1080/01621459.1995.10476615
   Web of Science ®Google Scholar
• Little, R. J. A., & Rubin, D. B. (2002). Statistical analysis with missing data (2nd ed). Hoboken, NJ: Wiley.
   Google Scholar
• Little, T. D., & Rhemtulla, M. (2013). Planned missing data designs for developmental researchers. Child Development Perspectives, 7(4), 199–204. doi:10.1111/cdep.12043
   Web of Science ®Google Scholar
• Lucas, R. E. (2005). Time does not heal all wounds: A longitudinal study of reaction and adaptation to divorce. Psychological Science, 16(12), 945–950. doi:10.1111/j.1467-9280.2005.01642.x
   PubMed Web of Science ®Google Scholar
• Magee, L., Robb, A. L., & Burbidge, J. B. (1998). On the use of sampling weights when estimating regression models with survey data. Journal of Econometrics, 84(2), 251–271. doi:10.1016/S0304-4076(97)00086-9
   Web of Science ®Google Scholar
• Maldonado-Molina, M. M., Jennings, W. G., & Komro, K. A. (2010). Effects of alcohol on trajectories of physical aggression among urban youth: An application of latent trajectory modeling. Journal of Youth and Adolescence, 39(9), 1012–1026. doi:10.1007/s10964-009-9484-y
   PubMed Web of Science ®Google Scholar
• Mason, M. J. (1999). A review of procedural and statistical methods for handling attrition and missing data in clinical research. Measurement & Evaluation in Counseling & Development (American Counseling Association), 32(2), 111–118. Retrieved from https://doi.org/https://search.proquest.com/openview/9357306c450dae84948415184f29763d/1?pq-origsite=gscholar&cbl=34423
   Web of Science ®Google Scholar
• Mazen, J., & Tong, X. (2018). Bias correction for replacement samples in longitudinal research. Whitefish, MT: Developmental Methods Conference. Retrieved from http://www.developmentalmethods.org/wp-content/uploads/2018/08/DM2018_ConferenceProgram_FINAL.pdf
   Google Scholar
• Mazen, J. A. M., Tong, X., & Taylor, L. K. (2019). Evaluation of supplemental samples in longitudinal research with non-normal missingness. Behavior Research Methods, 51(3), 1321–1335. doi: 10.3758/s13428-018-1070-3
   PubMed Web of Science ®Google Scholar
• Mistler, S. A., & Enders, C. K. (2012). Planned missing data designs for developmental research. In B. Laursen, T. D. Little, & N. A. Card (Eds.), Handbook of developmental research methods (pp. 742–754). New York, NY: Guilford Press.
   Google Scholar
• National Youth Longitudinal Survey (NYLS). (1997). Sample weights & design effects. Retrieved from https://www.nlsinfo.org/content/cohorts/nlsy97/using-and-understanding-the-data/sample-weights-design-effects
   Google Scholar
• Newman, D. A. (2003). Longitudinal modeling with randomly and systematically missing data: A simulation of ad hoc, maximum likelihood, and multiple imputation techniques. Organizational Research Methods, 6(3), 328–362. doi:10.1177/1094428103254673
   Web of Science ®Google Scholar
• Nicholson, J. S., Deboeck, P. R., & Howard, W. (2017). Attrition in Developmental Psychology: A review of modern missing data reporting and practices. International Journal of Behavioral Development, 41(1), 143–153. doi:10.1177/0165025415618275
   Web of Science ®Google Scholar
• Nuttall, A., Valentino, K., & Borkowski, J. (2012). Maternal history of parentification, maternal warm responsiveness, and children's externalizing behavior. Journal of Family Psychology, 26(5), 767–775. doi:10.1037/a0029470
   PubMed Web of Science ®Google Scholar
• Pearl, J. (2018. January 10). Facts and Fiction from the “Missing data Framework”. Retrieved from http://causality.cs.ucla.edu/blog/index.php/2018/01/10/facts-and-fiction-in-the-missing-data-framework/#comments
   Google Scholar
• Pierce, B., & Hartford, P. (2004). White paper on evaluation of sampling design options for the National Children’s Study. Rockville, MD: National Children’s Study Program Office National Institute for Child Health and Human Development.
   Google Scholar
• R Development Core Team. (2011). R: A language and environment for statistical computing [Computer software manual]. Vienna, Austria. Retrieved from http://www.R-project.org (ISBN 3-900051-07-0)
   Google Scholar
• Raudenbush, S. W., & Chan, W. (1993). Application of a hierarchical linear model to the study of adolescent deviance in an overlapping cohort design. Journal of Consulting and Clinical Psychology, 61(6), 941–951. doi:10.1037//0022-006X.61.6.941
   PubMed Web of Science ®Google Scholar
• Rhemtulla, M., Jia, F., Wu, W., & Little, T. D. (2014). Planned missing designs to optimize the efficiency of latent growth parameter estimates. International Journal of Behavioral Development, 38(5), 423–434. doi:10.1177/0165025413514324
   Web of Science ®Google Scholar
• Rhemtulla, M., Savalei, V., & Little, T. D. (2016). On the asymptotic relative efficiency of planned missingness designs. Psychometrika, 81(1), 60–89. doi:10.1007/s11336-014-9422-0
   PubMed Web of Science ®Google Scholar
• Rubin, D. B. (1976). Inference and missing data. Biometrika, 63(3), 581–592. doi:10.1093/biomet/63.3.581
   Web of Science ®Google Scholar
• Savalei, V. (2008). Is the ML chi-square ever robust to nonnormality? A cautionary note with missing data. Structural Equation Modeling: A Multidisciplinary Journal, 15(1), 1–22. doi:10.1080/10705510701758091
   Web of Science ®Google Scholar
• Savalei, V., & Bentler, P. M. (2009). A two-stage approach to missing data: Theory and application to auxiliary variables. Structural Equation Modeling: A Multidisciplinary Journal, 16(3), 477–497. doi:10.1080/10705510903008238
   Web of Science ®Google Scholar
• Savalei, V., & Falk, C. F. (2014). Robust two-stage approach outperforms robust full information maximum likelihood with incomplete nonnormal data. Structural Equation Modeling: A Multidisciplinary Journal, 21(2), 280–302. doi:10.1080/10705511.2014.882692
   Web of Science ®Google Scholar
• Schoemann, A. M., Miller, P., Pornprasertmanit, S., & Wu, W. (2014). Using Monte Carlo simulations to determine power and sample size for planned missing designs. International Journal of Behavioral Development, 38(5), 471–479. doi:10.1177/0165025413515169
   Web of Science ®Google Scholar
• Scott, C. K. (2004). A replicable model for achieving over 90% follow-up rates in longitudinal studies of substance abusers. Drug and Alcohol Dependence, 74(1), 21–36. doi:10.1016/j.drugalcdep.2003.11.007
   PubMed Web of Science ®Google Scholar
• Si, Y., Reiter, J. P., & Hillygus, D. S. (2015). Semi-parametric selection models for potentially non-ignorable attrition in panel studies with refreshment samples. Political Analysis, 23(1), 92–112. doi:10.1093/pan/mpu009
   Web of Science ®Google Scholar
• Stolzenberg, R. M., & Relles, D. A. (1997). Tools for intuition about sample selection bias and its correction. American Sociological Review, 62(3), 494–507. doi:10.2307/2657318
   Web of Science ®Google Scholar
• Thornberry, T. P., Bjerregaard, B., & Miles, W. (1993). The consequences of respondent attrition in panel studies: A simulation based on the Rochester Youth Development Study. Journal of Quantitative Criminology, 9(2), 127–158. doi:10.1007/BF01071165
   Google Scholar
• van Soest, A., & Kapteyn, A. (2011). Mode and context effects in measuring household assets. In M., Das, P. Ester, & L. Kaczmirek (Eds.), Social and behavioral research and the Internet: Advances in applied methods and research strategies (pp. 291–323). New York, NY, US: Routledge/Taylor & Francis Group.
   Google Scholar
• Vehovar, V. (2003). Field substitutions redefined. Survey Statistician, 48, 32–34. Retrieved from http://isi-iass.org/home/wp-content/uploads/N48.pdf.
   Google Scholar
• Vehovar, V. (1999). Field substitution and unit nonresponse. Journal of Official Statistics, 15(2), 335–350. Retrieved from https://doi.org/https://www.scb.se/contentassets/ff271eeeca694f47ae99b942de61df83/field-substitution-and-unit-nonresponse.pdf
   Google Scholar
• Widaman, K. F. (2006). Best practices in quantitative methods for developmentalists: III. Missing data: What to do with or without them. Monographs of the Society for Research in Child Development, 71(3), 42–64. https://doi.org/10.1111/j.1540-5834.2006.00404.x
   Web of Science ®Google Scholar
• Yee, J. L., & Neimeier, D. A. (1996). Advantages and disadvantages: Longitudinal vs. repeated cross-section surveys. Project Battelle 94-16, FHWA, HPM-40. Retrieved from https://www.semanticscholar.org/paper/Advantages-and-Disadvantages-%3A-Longitudinal-vs-.-Yee-Niemeier/fcd95131c91c06f38c4a84eed6fbbdf24221370c
   Google Scholar
• Yuan, K. H. (2009). Normal distribution based pseudo ML for missing data: With applications to mean and covariance structure analysis. Journal of Multivariate Analysis, 100(9), 1900–1918. doi:10.1016/j.jmva.2009.05.001
   Web of Science ®Google Scholar
• Yuan, K. H., & Lu, L. (2008). SEM with missing data and unknown population distributions using two-stage ML: Theory and its application. Mulitvariate Behavioral Research, 43(4), 621–652. doi:10.1080/00273170802490699
   PubMed Web of Science ®Google Scholar
• Yuan, K. H., & Zhang, Z. (2012). Robust structural equation modeling with missing data and auxiliary variables. Psychometrika, 77(4), 803–826. doi:10.1007/s11336-012-9282-4
   Web of Science ®Google Scholar
• Yuan, K. H., Yang-Wallentin, F., & Bentler, P. M. (2012). ML Versus MI for missing data with violation of distribution conditions. Sociological Methods & Research, 41(4), 598–629. doi:10.1177/0049124112460373
   PubMed Web of Science ®Google Scholar
• Zwane, A. P., Zinman, J., Van Dusen, E., Pariente, W., Null, C., Miguel, E., … Banerjee, A. (2011). Being surveyed can change later behavior and related parameter estimates. Proceedings of the National Academy of Sciences, 108(5), 1821–1826. doi:10.1073/pnas.1000776108
   PubMed Web of Science ®Google Scholar