Validation of the Preschool Child Observation Record: Does It Pass the Test for Use in Head Start?

REFERENCES

• Adams , R. J. , Wu , M. L. , & Wilson , M. ( 2012 ). The Rasch rating model and the disordered threshold controversy . Educational and Psychological Measurement , 72 , 547 – 573 . doi: 10.1177/0013164411432166
   Web of Science ®Google Scholar
• Advisory Committee on Head Start Research and Evaluation . ( 2012 ). Advisory Committee on Head Start Research and Evaluation: Final report . Retrieved from http://www.acf.hhs.gov/sites/default/files/opre/eval_final.pdf
   Google Scholar
• Alkens , N. , Tarullo , L. , Hulsey , L. , Ross , J. , West , J. , & Xue , Y. ( 2010 ). ACF-OPRE report: A year in Head Start: Children, families and programs . Washington , DC : Administration for Children and Families, Office of Planning, Research and Evaluation .
   Google Scholar
• American Educational Research Association, American Psychological Association, and National Council on Measurement in Education . ( 1999 ). Standards for educational and psychological testing . Washington , DC : Author .
   Google Scholar
• Andrich , D. ( 2010 ). Understanding the response structure and process in the polytomous Rasch model . In M. Nering & R. Ostini (Eds.), Handbook of polytomous item response theory models (pp. 123 – 152 ). New York , NY : Taylor & Francis .
   Google Scholar
• Andrich , D. , de Jong , J. H. , & Sheridan , B. E. ( 1997 ). Diagnostic opportunities with the Rasch model for ordered response categories . In J. Rost & R. Langeheine (Eds.), Applications of latent trait and latent class models in the social sciences (pp. 59 – 70 ). Münster , Germany : Waxmann .
   Google Scholar
• Andrich , D. , & Styles , I. ( 2004 ). Final report on the psychometric analysis of the Early Development Instrument (EDI) using the Rasch model: A technical paper commissioned for the development of the Australian Early Development Instrument (AEDI) . Retrieved from http://www.rch.org.au/emplibrary/australianedi/Final_Rasch_report.pdf
   Google Scholar
• Bernstein , I. H. , & Teng , G. ( 1989 ). Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization . Psychological Bulletin , 105 , 467 – 477 . doi: 10.1037/0033-2909.105.3.467
   Web of Science ®Google Scholar
• Bond , T. G. , & Fox , C. M. ( 2007 ). Applying the Rasch model: Fundamental measurement in the human sciences () , 2nd ed. . Mahwah , NJ : Erlbaum .
   Google Scholar
• Brown , T. A. ( 2006 ). Confirmatory factor analysis for applied research . New York , NY : Guilford Press .
   Google Scholar
• Brown , T. A. , & Moore , M. T. ( 2012 ). Confirmatory factor analysis . In R. H. Hoyle (Ed.), Handbook of structural equation modeling (pp. 361 – 379 ). New York , NY : Guilford Press .
   Google Scholar
• Cizek , G. J. ( 2012 ). Defining and distinguishing validity: Interpretations of score meaning and justifications of test use . Psychological Methods , 17 ( 1 ), 31 – 43 . doi: 10.1037/a0026975
   PubMed Web of Science ®Google Scholar
• Comrey , A. L. ( 1988 ). Factor-analytic methods of scale development in personality and clinical psychology . Journal of Consulting and Clinical Psychology , 56 , 754 – 761 . doi: 10.1037/0022-006X.56.5.754
   PubMed Web of Science ®Google Scholar
• Cook , D. A. , & Beckman , T. J. ( 2006 ). Current concepts in validity and reliability for psychometric instruments: Theory and application . American Journal of Medicine , 119 , 166.e7 – 166.e16 . doi: 10.1016/j.amjmed.2005.10.036
   PubMedGoogle Scholar
• Denton Flanagan , K. , McPhee , C. , & Mulligan , G. ( 2009 ). The children born in 2001 at kindergarten entry: First findings from the kindergarten data collections of the Early Childhood Longitudinal Study, Birth Cohort (ECLS-B) (Publication No. NCES 2010005). Retrieved from http://nces.ed.gov/pubsearch/pubsinfo.asp?pubid=2010005
   Google Scholar
• Downing , S. M. ( 2003 ). Validity: On the meaningful interpretation of assessment data . Medical Education , 37 , 830 – 837 . doi: 10.1046/j.1365-2923.2003.01594.x
   PubMed Web of Science ®Google Scholar
• Downing , S. M. , & Haladyna , T. M. ( 1997 ). Test item development: Validity evidence from quality assurance procedures . Applied Measurement in Education , 10 , 61 – 82 . doi: 10.1207/s15324818ame1001_4
   Web of Science ®Google Scholar
• Downing , S. M. , & Haladyna , T. M. (2006). Handbook of test development . Mahwah , NJ : Erlbaum.
   Google Scholar
• du Toit , M. ( 2003 ). IRT from SSI: BILOG-MG, MULTILOG, PARSCALE, TESTFACT . Lincolnwood , IL : Scientific Software International .
   Google Scholar
• Embretson , S. E. , & Reise , S. P. ( 2000 ). Item response theory for psychologists . Mahwah , NJ : Erlbaum .
   Google Scholar
• Epstein , A. S. ( 1993 ). Training for quality: Improving early childhood programs through systematic in-service training (Monographs of the HighScope Educational Research Foundation No. 9) . Ypsilanti , MI : HighScope Press .
   Google Scholar
• Epstein , A. S. ( 2006 ). HighScope and Head Start: A good fit: Forty years of commitment and compatibility . Retrieved from http://www.highscope.org/file/NewsandInformation/ReSourceReprints/Spring06pdfs/AGoodFit.pdf
   Google Scholar
• Epstein , A. S. , & Schweinhart , L. J. ( 2009 ). The HighScope preschool curriculum and dimensions of preschool curriculum decision-making . Early Childhood Services , 3 , 193 – 208 .
   Google Scholar
• Fabrigar , L. R. , Wegener , D. T. , MacCallum , R. C. , & Strahan , E. J. ( 1999 ). Evaluating the use of exploratory factor analysis in psychological research . Psychological Methods , 4 , 272 – 299 . doi: 10.1037/1082-989X.4.3.272
   Web of Science ®Google Scholar
• Fantuzzo , J. W. , Gadsden , V. , & McDermott , P. ( 2010 ). 2010 EPIC research brief: Evidence-based Program for the Integration of Curricula (EPIC) . Retrieved from http://www.gse.upenn.edu/pdf/pennchild/EPIC.pdf
   Google Scholar
• Fantuzzo , J. W. , Hightower , D. , Grim , S. , & Montes , G. ( 2002 ). Generalization of the Child Observation Record: A validity study for diverse samples of urban, low-income preschool children . Early Childhood Research Quarterly , 17 , 106 – 125 . doi: 10.1016/S0885-2006(02)00131-X
   Web of Science ®Google Scholar
• Fantuzzo , J. W. , McDermott , P. A. , Manz-Holliday , P. , Hampton , V. R. , & Burdick-Alvarez , N. ( 1996 ). The Pictorial Scale of Perceived Competence and Social Acceptance: Does it work with low-income urban children? Child Development , 67 , 1071 – 1084 . doi: 10.2307/1131880
   PubMed Web of Science ®Google Scholar
• Flora , D. B. , & Curran , P. J. ( 2004 ). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data . Psychological Methods , 9 , 466 – 491 . doi: 10.1037/1082-989X.9.4.466
   PubMed Web of Science ®Google Scholar
• Gordon , R. A. , Fujimoto , K. , Kaestner , R. , Korenman , S. , & Abner , K. ( 2012 ). An assessment of the validity of the ECERS–R with implications for measures of child care quality and relations to child development . Developmental Psychology . Advance online publication . doi: 10.1037/a0027899
   PubMed Web of Science ®Google Scholar
• Gorsuch , R. L. ( 2003 ). Factor analysis . In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology: Research methods in psychology (Vol. 2 , pp. 143 – 164 ). New York , NY : Wiley .
   Google Scholar
• Halle , T. , Zaslow , M. , Wessel , J. , Moodie , S. , & Darling-Churchill , K. ( 2011 ). Understanding and choosing assessments and developmental screeners for young children: Profiles of selected measures (OPRE Report No. 2011–23). Retrieved from http://www.acf.hhs.gov/programs/opre/hs/dev_screeners/reports/screeners_final.pdf
   Google Scholar
• HighScope Educational Research Foundation . ( 1992 ). HighScope Child Observation Record (COR) for ages 2½–6 . Ypsilanti , MI : HighScope Press .
   Google Scholar
• HighScope Educational Research Foundation . ( 2003 ). What's different about the new Preschool Child Observation Record (COR)? Retrieved from http://www.highscope.org/file/Assessment/Whatsdiff2.pdf
   Google Scholar
• HighScope Educational Research Foundation . ( 2010 ). Preschool Child Observation Record, 2nd edition: User guide . Ypsilanti , MI : HighScope Press .
   Google Scholar
• Hu , L. , & Bentler , P. M. ( 1999 ). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives . Structural Equation Modeling , 6 , 1 – 55 . doi: 10.1080/10705519909540118
   Web of Science ®Google Scholar
• Improving Head Start for School Readiness Act of 2007, P.L. 110–134, 42 U.S.C. § 9801 et seq (2007) .
   Google Scholar
• Kane , M. T. ( 2006a ). Content-related validity evidence . In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 131 – 153 ). Mahwah , NJ : Erlbaum .
   Google Scholar
• Kane , M. T. ( 2006b ). Validation . In R. L. Brennan (Ed.), Educational measurement ( , 4th ed. , pp. 17 – 64 ). Westport , CT : American Council on Education/Praeger .
   Google Scholar
• Kline , R. B. ( 2005 ). Principles and practice of structural equation modeling () , 2nd ed. . New York , NY : Guilford Press .
   Google Scholar
• Knol , D. L. , & Berger , M. P. F. ( 1988 ). Empirical comparison between factor analysis and item response models (Research Report No. 88–11) . Enschede , The Netherlands : University of Twente, Department of Education .
   Google Scholar
• LeBoeuf , W. A. , Fantuzzo , J. W. , & Lopez , M. L. ( 2010 ). Measurement and population miss-fits: A case study on the importance of using appropriate measures to evaluate early childhood interventions . Applied Developmental Science , 14 , 45 – 53 . doi: 10.1080/10888690903510349
   Web of Science ®Google Scholar
• Mathematica Policy Research . ( 2007 ). Measuring children's progress from preschool through third grade . Retrieved from http://www.pewtrusts.org/uploadedFiles/wwwpewtrustsorg/Reports/Pre-k_education/atkins-burnett%20final%20apper%207-3-07.pdf
   Google Scholar
• McBride-Chang , C. (1999). The ABC's of the ABC's: The development of letter-name and letter-sound knowledge. Merrill-Palmer Quarterly , 45, 285–308.
   Web of Science ®Google Scholar
• McDermott , P. A. , Fantuzzo , J. W. , Warley , H. P. , Waterman , C. , Angelo , L. E. , Gadsden , V. L. , & Sekino , Y. ( 2011 ). Multidimensionality of teachers' graded responses for preschoolers' stylistic learning behavior: The Learning-to-Learn Scales . Educational and Psychological Measurement , 71 , 148 – 169 . doi: 10.1177/0013164410387351
   Web of Science ®Google Scholar
• McDermott , P. A. , Fantuzzo , J. W. , Waterman , C. , Angelo , L. E. , Warley , H. P. , Gadsden , V. L. , & Zhang , X. ( 2009 ). Measuring preschool cognitive growth while it's still happening: The Learning Express . Journal of School Psychology , 47 , 337 – 366 . doi: 10.1016/j.jsp.2009.07.002
   PubMed Web of Science ®Google Scholar
• Mislevy , R. J. , & Riconscente , M. M. ( 2006 ). Evidence-centered assessment design . In S. M. Downing & T. M. Haladyna (Eds.), Handbook of test development (pp. 61 – 90 ). Mahwah , NJ : Erlbaum .
   Google Scholar
• Muraki , E. , & Bock , D. ( 2002 ). PARSCLE (Version 4.1) [Computer software] . Chicago , IL : Scientific Software International .
   Google Scholar
• Muthén , B. O. , & Muthén , L. K. ( 2010 ). Mplus (Version 6.1) [Computer software] . Los Angeles , CA : Author .
   Google Scholar
• National Research Council . ( 2008 ). Early childhood assessment: Why, what, and how . Washington , DC : National Academies Press .
   Google Scholar
• Neill , P. ( 2004 ). A better way to do preschool assessment: Announcing the Revised Preschool COR . HighScope ReSource , 23 . Retrieved from http://www.highscope.org/file/NewsandInformation/ReSourceReprints/CORarticle.pdf
   Google Scholar
• Office of Head Start . ( 2010 ). The Head Start child development and early learning framework promoting positive outcomes in early childhood programs serving children 3–5 years old: Revised . Retrieved from http://eclkc.ohs.acf.hhs.gov/hslc/tta-system/teaching/eecd/Assessment/Child%20Outcomes/HS_Revised_Child_Outcomes_Framework%28rev-Sept2011%29.pdf
   Google Scholar
• Schmid , J. , & Leiman , J. M. ( 1957 ). The development of hierarchical factor solutions . Psychometrika , 22 , 53 – 61 . doi: 10.1007/BF02289209
   Web of Science ®Google Scholar
• Schweinhart , L. J. , McNair , S. , Barnes , H. , & Larner , M. ( 1993 ). Observing young children in action to assess their development: The HighScope Child Observation Record study . Educational and Psychological Measurement , 53 , 445 – 455 . doi: 10.1177/0013164493053002014
   Web of Science ®Google Scholar
• Sekino , Y. , & Fantuzzo , J. W. ( 2005 ). Validity of the Child Observation Record: An investigation of the relationship between COR dimensions and social-emotional and cognitive outcomes for Head Start children . Journal of Psychoeducational Assessment , 23 , 242 – 260 . doi: 10.1177/073428290502300304
   Web of Science ®Google Scholar
• Snook , S. C. , & Gorsuch , R. L. ( 1989 ). Component analysis versus common factor analysis: A Monte Carlo study . Psychological Bulletin , 106 , 148 – 154 . doi: 10.1037/0033-2909.106.1.148
   Web of Science ®Google Scholar
• Treiman , R. , Tincoff , R. , Rodriguez , K. , Mouzaki , A. , & Francis , D. J. ( 1998 ). The foundations of literacy: Learning the sounds of letters . Child Development , 69 , 1524 – 1540 . doi: 10.1111/j.1467-8624.1998.tb06175.x
   PubMed Web of Science ®Google Scholar
• Velicer , W. F. ( 1976 ). Determining the number of components from the matrix of partial correlations . Psychometrika , 41 , 321 – 327 . doi: 10.1007/BF02293557
   Web of Science ®Google Scholar
• Waller , N. G. ( 2001 ). MicroFACT: A microcomputer factor analysis program for ordered polytomous data and mainframe size problems (Version 2.0) [Computer software] . St. Paul , MN : Assessment Systems .
   Google Scholar
• Waterman , C. , McDermott , P. A. , Fantuzzo , J. W. , & Gadsden , V. L. ( 2012 ). The matter of assessor variance in early childhood education: Or whose score is it anyway? Early Childhood Research Quarterly , 27 ( 1 ), 46 – 54 . doi: 10.1016/j.ecresq.2011.06.003
   Web of Science ®Google Scholar
• Watkins , M. W. , Wilson , S. M. , Kotz , K. M. , Carbone , M. C. , & Babula , T. ( 2006 ). Factor structure of the Wechsler Intelligence Scale for Children–Fourth Edition among referred students . Educational and Psychological Measurement , 66 , 975 – 983 . doi: 10.1177/0013164406288168
   Web of Science ®Google Scholar
• Williams , L. J. , Ford , L. R. , & Nguyen , N. ( 2002 ). Basic and advanced measurement models for confirmatory factor analysis . In S. G. Rogelberg (Ed.), Handbook of research methods in industrial and organizational psychology (pp. 366 – 389 ). Malden , MA : Blackwell .
   Google Scholar
• Yates , A. ( 1987 ). Multivariate exploratory data analysis: A prospective on exploratory factor analysis . Albany : State University of New York Press .
   Google Scholar
• Yu , C. Y. ( 2002 ). Evaluating cutoff criteria of model fit indices for latent variable models with binary and continuous outcomes (Doctoral dissertation, University of California). Retrieved from http://www.statmodel.com/download/Yudissertation.pdf
   Google Scholar
• Zigler , E. , & Styfco , S. ( 2010 ). The hidden history of Head Start . New York , NY : Oxford University Press .
   Google Scholar