Construct Definition Using Cognitively Based Evidence: A Framework for Practice

REFERENCES

• Alonzo , A. C. and Steedle , J. T. 2008 . Developing and assessing a force and motion learning progression . Science Education , 93 : 389 – 421 .
   Web of Science ®Google Scholar
• American Educational Research Association, American Psychological Association, & National Council on Measurement in Education . 1999 . Standards for educational and psychological testing Washington , DC : American Psychological Association. .
   Google Scholar
• Black , P. and Wiliam , D. 1998 . Inside the black box: Raising standards through classroom assessment . Phi Delta Kappan , 80 : 139 – 148 .
   Web of Science ®Google Scholar
• Bransford , J. , Brown , L. A. and Cocking , R. R. 2000 . How people learn: Brain, mind, experience, and school. Washington , DC : National Academy Press. .
   Google Scholar
• Bryant , D. U. and Wooten , W. 2006 . Developing an essentially unidimensional test with cognitively designed items . International Journal of Testing , 6 : 205 – 228 .
   Google Scholar
• Cronbach , L. J. and Meehl , P. E. 1955 . Construct validity in psychological tests . Psychological Bulletin , 52 : 281 – 302 .
   PubMed Web of Science ®Google Scholar
• Crooks , T. J. , Kane , M. T. and Cohen , A. S. 1996 . Threats to the valid use of assessments . Assessment in Education: Principles, Policy & Practice , 3 : 265 – 285 . Retrieved from Academic Search Premier database
   Google Scholar
• de la Torre , J. 2009 . A cognitive diagnosis model for cognitively based multiple-choice options . Applied Psychological Measurement , 33 : 163 – 183 .
   Web of Science ®Google Scholar
• DiBello , L. V. , Roussos , L. A. and Stout , W. 2007 . Review of cognitively diagnostic assessment and a summary of psychometric models . Handbook of Statistics , 26 : 1 – 85 .
   Google Scholar
• Didierjean , A. and Gobet , F. 2008 . Sherlock Holmes—An expert's view of expertise . British Journal of Psychology , 99 : 109 – 125 .
   PubMed Web of Science ®Google Scholar
• Downing , S. M. 2006 . “ Twelve steps for effective test development. ” . In Handbook of test development Edited by: Downing , S. M. and Haladyna , T. M. 3 – 25 . Mahwah , NJ : Erlbaum. .
   Google Scholar
• Embretson , S. and Gorin , J. 2001 . Improving construct validity with cognitive psychology principles . Journal of Educational Measurement , 38 : 343 – 368 .
   Web of Science ®Google Scholar
• Engelmann , S. and Carnine , D. 1991 . Theory of instruction: Principles and applications. Eugene , OR : ADI Press. .
   Google Scholar
• Gierl , M. J. , Leighton , J. P. and Hunka , S. M. 2007 . “ Using the Attribute Hierarchy Method to make diagnostic inferences about examinees' cognitive skills. ” . In Cognitive diagnostic assessment for education: Theory and applications Edited by: Leighton , J. P. and Gierl , M. J. 242 – 274 . New York , NY : Cambridge University Press. .
   Google Scholar
• Gorin , J. S. 2006 . Test design with cognition in mind . Educational Measurement: Issues and Practice , 25 ( 4 ) : 21 – 35 .
   Google Scholar
• Haertel , E. H. 1989 . Using restricted latent class models to map the skill structure of achievement items . Journals of Educational Measurement , 26 : 333 – 352 .
   Web of Science ®Google Scholar
• Henson , R. , Templin , J. and Douglas , J. 2007 . Using efficient model based sum-scores for conducting skills diagnoses . Journal of Educational Measurement , 44 : 361 – 376 .
   Web of Science ®Google Scholar
• Kane , M. 2006 . “ Validation. ” . In Educational measurement, , 4th ed. Edited by: Brennan , R. 17 – 64 . Westport , CT : American Council on Education and Praeger. .
   Google Scholar
• Ketterlin-Geller , L. R. 2008 . Testing students with special needs: A model for understanding the interaction between assessment and student characteristics in a universally designed environment . Educational Measurement: Issues and Practice , 27 ( 3 ) : 3 – 16 . doi:http://dx.doi.org/10.1111/j.1745–3992.2008.00124.x
   Google Scholar
• Ketterlin-Geller , L. R. and Chard , D. J. 2011 . Algebra readiness for students with learning difficulties in Grades 4–8: Support through the study of number . Australasian Journal of Learning Disabilities , 16 : 65 – 78 .
   Google Scholar
• Leighton , J. P. 2004 . Avoiding misconception, misuse and missed opportunities: The collection of verbal reports in educational achievement testing . Educational Measurement: Issues and Practice , 23 ( 4 ) : 6 – 15 .
   Google Scholar
• Leighton , J. P. and Gierl , M. J. 2011 . The learning sciences in educational assessment: The role of cognitive models New York , NY : Cambridge University Press. .
   Google Scholar
• Lissitz , R. W. and Samuelsen , K. 2007 . A suggested change in terminology and emphasis regarding validity and education . Educational Researcher , 36 : 437 – 448 .
   Google Scholar
• Maris , E. 1999 . Estimating multiple classification latent class models . Psychometrika , 64 : 187 – 212 .
   Web of Science ®Google Scholar
• Martin , M. O. and Mullis , I. V. S. , eds. 2012 . Methods and Procedures in TIMSS and PIRLS 2011. Retrieved from http://timssandpirls.bc.edu/methods/t-instrument.html
   Google Scholar
• Messick , S. 1988 . “ The once and future issues of validity: Assessing the meaning and consequences of measurement. ” . In Test validity Edited by: Wainer , H. and Braun , H. 33 – 45 . Hillsdale , NJ : Erlbaum. .
   Google Scholar
• Mislevy , R. J. 2006 . “ Cognitive psychology and educational assessment. ” . In Educational measurement, , 4th ed. Edited by: Brennan , R. 257 – 306 . Westport , CT : American Council on Education and Praeger. .
   Google Scholar
• Pellegrino , J. W. , Chudowsky , N. and Glaser , R. 2001 . Knowing what students know: The science and design of educational assessment Washington , DC : National Academy Press. .
   Google Scholar
• Perie , M. , Marion , S. and Gong , B. 2009 . Moving toward a comprehensive assessment system: A framework for considering interim assessments . Educational Measurement: Issues and Practice , 28 ( 3 ) : 5 – 13 .
   Google Scholar
• Rupp , A. A. 2007 . The answer is in the question: A guide for describing and investigating the conceptual foundations and statistical properties of cognitive psychometric models . International Journal of Testing , 7 : 95 – 126 .
   Google Scholar
• Rupp , A. A. and Templin , J. L. 2008 . Unique characteristics of diagnostic classification models: A comprehensive review of the current state-of-the-art . Measurement , 6 : 219 – 262 .
   Google Scholar
• Siegler , R. , Carpenter , T. , Fennell , F. , Geary , D. , Lewis , J. , Okamoto , Y. and Wray , J. 2010 . Developing effective fractions instruction for kindergarten through 8th grade: A practice guide Washington , DC : National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. . Retrieved from http://whatworks.ed.gov/publications/practiceguides(NCEE #2010–4039)
   Google Scholar
• Smith , C. , Wiser , M. , Anderson , C. and Krajcik , J. 2006 . Implications of research on children's learning for standards and assessment: A proposed learning progression for matter and the atomic-molecular theory . Measurement , 14 : 1 – 98 .
   Google Scholar
• Someren , M. W. , Barnard , Y. F. and Sandberg , J. A. C. 1994 . The Think Aloud Method: A practical guide to modeling cognitive process. San Diego , CA : Academic Press. .
   Google Scholar
• Stout , W. 2007 . Skills diagnosis using IRT-based continuous latent trait models . Journal of Educational Measurement , 44 : 313 – 324 .
   Web of Science ®Google Scholar
• Svetina , D. , Gorin , J. S. and Tatsuoka , K. K. 2011 . Defining and comparing the reading comprehension construct: A cognitive-psychometric modeling approach . International Journal of Testing , 11 : 1 – 23 .
   Google Scholar
• Tatsuoka , K. K. and Tatsuoka , M. M. Diagnosis of cognitive errors by statistical pattern recognition methods . Paper presented at the annual meeting of the Psychometric Society . Nashville , TN . June .
   Google Scholar
• Thissen , D. , Steinberg , L. and Fitzpatrick , A. R. 1989 . Multiple-choice models: The distractors are also part of the item . Journal of Educational Measurement , 26 : 161 – 176 .
   Web of Science ®Google Scholar
• Wilson , M. 2009 . Measuring progressions: Assessment structures underlying a learning progression . Journal of Research in Science Teaching , 46 : 716 – 730 .
   Web of Science ®Google Scholar