Time-Indexed Effect Size for Educational Research and Evaluation: Reinterpreting Program Effects and Achievement Gaps in K–12 Reading and Math

References

• American Educational Research Association. (2008). Time to learn. Research Points, 5(2), 1–4.
   Google Scholar
• American Psychological Association. (2001). Publication manual of the American Psychological Association (5th ed.). Washington, DC: Author.
   Google Scholar
• Baltes, P. B., Reese, H. W., & Nesselroade, J. R. (1977). Life-span developmental psychology: Introduction to research methods. Monterey, CA: Brooks/Cole.
   Google Scholar
• Barnett, W. S. (1995). Long-term effects on cognitive development and school success. The Future of Children, 5(3), 25–50. doi:10.2307/1602366
   Web of Science ®Google Scholar
• Bergman, L., Eklund, G., & Magnusson, D. (1991). Problems and methods in longitudinal research: Stability and change. In D. Magnusson, L. Bergman & G Kudinger, et al., (Eds.), Studying individual development: Problems and methods New York, NY: Cambridge University Press.
   Google Scholar
• Berliner, D. C. (1990). The nature of time in schools: Theoretical concepts, practitioner perceptions. New York, NY: Teachers College Press.
   Google Scholar
• Bloom, B. S. (1964). Stability and change in human characteristics. New York, NY: John Wiley & Sons.
   Google Scholar
• Bloom, B. S. (1976). Human characteristics and school learning. New York, NY: McGraw-Hill.
   Google Scholar
• Bloom, H. S., Hill, C. J., Black, A. R., & Lipsey, M. W. (2008). Performance trajectories and performance gaps as achievement effect-size benchmarks for educational interventions. Journal of Research on Educational Effectiveness, 1, 289–328. doi:10.1080/19345740802400072
   Google Scholar
• Carroll, J. B. (1963). “A model of school learning,” Teachers College Record, 64(8), 723–733.
   Web of Science ®Google Scholar
• Cohen, J. (1994). The earth is round (p < .05). American Psychologist, 49, 997–1003. doi:10.1037/0003-066X.49.12.997
   Web of Science ®Google Scholar
• Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
   Google Scholar
• Cooper, H., & Hedges, L. V. ( Eds.). (1994). The handbook of research synthesis. New York: Russell Sage Foundation.
   Google Scholar
• CTB/McGraw-Hill. (1997). Technical bulletin 1. Monterey, CA: Author.
   Google Scholar
• CTB/McGraw-Hill. (2003). TerraNova 2nd edition CAT technical report. Monterey, CA: Author.
   Google Scholar
• Finn, J. D., Gerber, S. B., Achilles, C. M., & Boyd-Zaharias, J. (2001). The enduring effects of small classes. Teachers College Record, 103(2), 145–183. doi:10.1111/0161-4681.00112
   Web of Science ®Google Scholar
• Fisher, C. W. (1980). Teaching behaviors, academic learning time, and student achievement: An overview. In C. Dehman & A. Lieberman ( Eds.), Time to learn. (pp. 7–22). Washington, DC: National Institute of Education.
   Google Scholar
• Fryer, R. G., & Levitt, S. D. (2004). Understanding the black-white test score gap in the. The Review of Economics and Statistics, 86(2), 447–464. doi:10.1162/003465304323031049
   Web of Science ®Google Scholar
• Gormley, W. T., Gayer, T., Phillips, D., & Dawson, B. (2005). The effects of universal pre-K on cognitive development. Developmental Psychology, 41(6), 872–884. doi:10.1037/0012-1649.41.6.872
   PubMed Web of Science ®Google Scholar
• Hall, J. A., Tickle-Degnen, L., Rosenthal, R., & Mosteller, F. (1994). Hypotheses and problems in research synthesis. In H. Cooper & L. V. Hedges ( Eds.), The handbook of research synthesis. New York, NY: Russell Sage Foundation.
   Google Scholar
• Harcourt. (2002). Metropolitan8 Form V technical manual. (Metropolitan Achievement Tests 8th edition). San Antonio, TX: Author.
   Google Scholar
• Harcourt. (2004). Stanford Achievement Test 10th Edition technical data report. San Antonio, TX: Author.
   Google Scholar
• Hill, C. J., Bloom, H. S., Rebeck Black, A., & Lipsey, M. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2(3), 172–177. doi:10.1111/j.1750-8606.2008.00061.x
   Web of Science ®Google Scholar
• Kane, M. T. (2006). Validation. In R. L. Brennan ( Ed.), Educational measurement (4th ed., pp. 17–64). Westport, CT: Praeger.
   Google Scholar
• Kirk, R. E. (1996). Practical significance: A concept whose time has come. Educational and Psychological Measurement, 56, 746–759. doi:10.1177/0013164496056005002
   Web of Science ®Google Scholar
• Kolen, M. J. (2006). Scaling and norming. In R. L. Brennan (Ed.), Educational Measurement (4th ed., pp. 155–186). Westport, CT: Praeger.
   Google Scholar
• Knapp, T. R., & Sawilowsky, S. S. (2001). Strong arguments: Rejoinder to Thompson. Journal of Experimental Education, 70, 94–95. doi:10.1080/00220970109599500
   Web of Science ®Google Scholar
• Krueger, A. B. (1999). Experimental estimates of education production functions. Quarterly Journal of Economics, 114, 497–532. doi:10.1162/003355399556052
   Web of Science ®Google Scholar
• Lee, J. (2016). The anatomy of achievement gaps: Why and how American education is losing (but can still win) the war on underachievement. New York, NY: Oxford University Press.
   Google Scholar
• Lee, J. (2010). Tripartite growth trajectories of reading and math achievement: Tracking national academic progress at primary, middle and high school levels. American Educational Research Journal, 47(4), 800–832. doi:10.3102/0002831210365009
   Web of Science ®Google Scholar
• Lee, V. E., Brooks-Gunn, J., Schnur, E., & Liaw, F. R. (1990). Are Head Start effects sustained? A longitudinal follow-up comparison of disadvantaged children attending Head Start, no preschool, and other preschool programs. Child Development, 61, 495–507. doi:10.2307/1131110
   PubMed Web of Science ®Google Scholar
• Lichten, W. (2004). On the law of intelligence. Developmental Review, 24(3), 252–288. doi:10.1016/j.dr.2004.04.001
   Web of Science ®Google Scholar
• McCaffrey, D. F., Lockwood, J. R., Koretz, D. M., & Hamilton, L. S. (2003). Evaluating value-added models for teacher accountability. Santa Monica, CA: Rand.
   Google Scholar
• McGrew, K. S., & Woodcock, R. W. (2001). Woodcock-Johnson III technical manual. Itasca, IL: Riverside.
   Google Scholar
• Molnar, A., Smith, P., & Zahorik, J. (1999). Evaluating the SAGE program: A Pilot program in targeted pupil-teacher reduction in Wisconsin. Educational Evaluation and Policy Analysis, 21(2), 165–177. doi:10.3102/01623737021002165
   Web of Science ®Google Scholar
• Najarian, M., Pollack, J. M., & Sorongon, A. G. (2009). Early childhood longitudinal study, kindergarten class of 1998–99 (ECLS-K), psychometric report for the Eighth Grade. ( NCES 2009-002). Washington, DC: National Center for Education Statistics.
   Google Scholar
• National Education Commission on Time and Learning. (1994). Prisoners of time: Report of the National Education Commission on Time and Learning. Washington, DC: Author.
   Google Scholar
• Petersen, N. S., Kolen, M. J., & Hoover, H. D. (1989). Scaling, norming, and equating. In R. L. Linn ( Ed.), Educational measurement. (3rd ed., pp. 221–262). New York, NY: Macmillan.
   Google Scholar
• Phillips, M., Crouse, J., & Ralph, J. (1998). Does the black-white test score gap widen after children enter school? In C. Jencks & M. Phillips ( Eds.), The black/white test score gap. Washington, DC: Brookings.
   Google Scholar
• Pollack, J., Atkins-Burnett, S., Rock, D., & Weiss, M. (2005). Early childhood longitudinal study, kindergarten class of 1998–99 (ECLS-K), Psychometric report for the third grade. ( NCES 2005-062). Washington, DC: National Center for Education Statistics.
   Google Scholar
• Psychological Corporation. (1985). Stanford Achievement Test Series Technical Data Report. San Antonio, TX.
   Google Scholar
• Ramey, C. T., & Ramey, S. L. (1998). Early intervention and early experience. American Psychologist, 53(2), 109–120 doi:10.1037/0003-066X.53.2.109
   PubMed Web of Science ®Google Scholar
• Raudenbush, S. W., & Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis (2nd ed.). Newbury Park, CA: Sage.
   Google Scholar
• Rock, D. A., & Quinn, P. (1995). Psychometric report for the NELS: 88 base year through second follow-up. ( NCES-95-382). Washington, DC: National Center for Education Statistics.
   Google Scholar
• Schaie, K. W. (1965). A general model for the study of developmental change. Psychological Bulletin, 64, 92–107. doi:10.1037/h0022371
   PubMedGoogle Scholar
• Schmidt, F. (1996). Statistical significance testing and cumulative knowledge in psychology: Implications for the training of researchers. Psychological Methods, 1, 115–129. doi:10.1037/1082-989X.1.2.115
   Web of Science ®Google Scholar
• Schulz, E. M., & Nicewander, W. A. (1997). Grade equivalent and IRT representations of growth. Journal of Educational Measurement, 34, 315–331. doi:10.1111/j.1745-3984.1997.tb00521.x
   Web of Science ®Google Scholar
• Seltzer, M. H., Frank, K. A., & Bryk, A. S. (1994). The metric matters: The sensitivity of conclusions concerning growth in student achievement to choice of metric. Educational Evaluation and Policy Analysis, 16(1), 41–49.
   Web of Science ®Google Scholar
• Shin, J., Espin, C. A., Deno, S. L. et al. (2004). Use of hierarchical linear modeling and curriculum-based measurement for assessing academic growth and instructional factors for students with learning difficulties. Asia Pacific Education Review, 52(2), 136–148.
   Google Scholar
• Smith, B. (2005). Extended learning time and student accountability: assessing outcomes and options for elementary and middle grades, Educational Administration Quarterly, 41(2), 195–236. doi:10.1177/0013161X04269864
   Web of Science ®Google Scholar
• Thompson, B. (2001). Significance, effect sizes, stepwise methods, and other issues: Strong arguments move the field. Journal of Experimental Education, 70, 80–93. doi:10.1080/00220970109599499
   Web of Science ®Google Scholar
• Thompson, B. (1996). AERA editorial policies regarding statistical significance testing: Three suggested reforms. Educational Researcher, 25(2), 26–30.
   Google Scholar
• Wilkinson, L., & American Psychological Association Task Force on Statistical Inference. (1999). Statistical methods in psychology journals: Guidelines and explanation. American Psychologist, 54, 594–604. [ Reprint available through the APA home page: [http://www.apa.org/journals/amp/amp548594.html.] doi:10.1037/0003-066X.54.8.594
   Web of Science ®Google Scholar
• Word, E., Johnson, J., Bain, H. P., Fulton, D. B., Boyd-Zaharias, J., Lintz, M. N., Achiles, C. M., Folger, J., & Breda, C. (1990). Student/teacher achievement ratio (STAR): Tennessee's K–3 class size study. Nashville, TN: Tennessee State Department of Education.
   Google Scholar
• Yen, W. M. (1986). The choice of scale for educational measurement: An IRT perspective. Journal of Educational Measurement, 23, 299–325. doi:10.1111/j.1745-3984.1986.tb00252.x
   Web of Science ®Google Scholar