Design Decisions in Developing Learning Trajectories–Based Assessments in Mathematics: A Case Study

REFERENCES

• Alexander , I. and Maiden , N. 2004 . Scenarios, stories, use cases , New York , NY : Wiley .
   Google Scholar
• Alonzo , A. C. and Gearhart , M. 2006 . Considering learning progressions from a classroom assessment perspective . Measurement: Interdisciplinary Research and Perspectives , 4 ( 1&2 ) : 99 – 104 .
   Google Scholar
• Alonzo , A. C. and Gotwals , A. W. , eds. 2012 . Learning progressions in science: Current challenges and future directions , Rotterdam : The Netherlands: Sense .
   Google Scholar
• Alonzo , A. C. , Neidorf , T. and Anderson , C. W. 2012 . “ Using learning progressions to inform large-scale assessment ” . In Learning progressions in science: Current challenges and future directions , Edited by: Alonzo , A. C. and Gotwals , A. W. pp. 211 – 240 . Rotterdam : The Netherlands: Sense .
   Google Scholar
• Anderson, C. W., Cobb, P., Calabrese Barton, A., Confrey, J., Penuel, W. R., & Schauble, L. (2012). Learning Progressions Footprint Conference final report. East Lansing: Michigan State University.
   Google Scholar
• Bakhtin , M. M. 1984 . Problems of Dostoevsky's poetics , Minneapolis : University of Minnesota Press . C. Emerson, Trans.
   Google Scholar
• Baxter, G. P., & Glaser, R. (1998). Investigating the cognitive complexity of science assessments. Educational Measurement: Issues and Practice, 17(3), 37–45.
   Google Scholar
• Blue Ribbon Commission on Testing and Accountability. (2008). Report of the Blue Ribbon Commission on Testing and Accountability. Raleigh, NC: Author.
   Google Scholar
• Briggs, D. (2012). Making progress in the modeling of learning progressions. In A. C. Alonzo & A. W. Gotwals (Eds.), Learning progressions in science: Current challenges and future directions (pp. 345–358). Rotterdam, The Netherlands: Sense Publishers.
   Google Scholar
• Brown , J. S. and Burton , R. L. 1978 . Diagnostic models for procedural bugs in basic mathematical skills . Cognitive Science , 2 ( 2 ) : 155 – 192 .
   Google Scholar
• Burge , J. E. , Carroll , J. M. , McCall , R. and Mistrik , I. 2009 . Rationale-based software engineering , Heidelberg , Germany : Springer .
   Google Scholar
• Callon , M. 1986 . “ Some elements of a sociology of translation: Domestication of the scallops and the fishermen of St. Brieuc Bay ” . In Power, action, and belief: A new sociology of knowledge , Edited by: Law , J. 196 – 233 . London , England : Routledge & Kegan Paul .
   Google Scholar
• Clements , D. H. and Sarama , J. 2004 . Learning trajectories in mathematics education . Mathematical Thinking and Learning , 6 ( 2 ) : 81 – 90 .
   Google Scholar
• Clements , D. H. and Sarama , J. 2007 . “ Early childhood mathematics learning ” . In Second handbook of research on mathematics teaching and learning , Edited by: Lester , F. K. Vol. 1 , 461 – 555 . New York , NY : Information Age .
   Google Scholar
• Cobb , P. A. , Confrey , J. , diSessa , A. A. , Lehrer , R. and Schauble , L. 2003 . Design experiments in educational research . Educational Researcher , 32 ( 1 ) : 9 – 13 .
   Google Scholar
• Collins, A. (1992). Toward a design science of education. In E. Scanlon & T. O'Shea (Eds.), New directions in educational technology (pp. 15–22). New York, NY: Springer-Verlag.
   Google Scholar
• Confrey , J. 1989, April . Splitting and counting: A conjecture , San Francisco , CA : Paper presented at the annual meeting of the American Educational Research Association .
   Google Scholar
• Confrey , J. 1990 . A review of the research on student conceptions in mathematics, science, and programming . Review of Research in Education , 16 : 3 – 56 .
   Web of Science ®Google Scholar
• Confrey , J. 2006 . “ The evolution of design studies as methodology ” . In Cambridge handbook of the learning sciences , Edited by: Sawyer , K. 135 – 152 . Cambridge , England : Cambridge University Press. .
   Google Scholar
• Confrey , J. 2008, July . A synthesis of the research on rational number reasoning , Monterrey , Mexico : Paper presented at the International Congress of Mathematics Instruction XI .
   Google Scholar
• Confrey , J. , Maloney , A. , Mojica , G. , Nguyen , K. , Wilson , H. and Booth , S. 2008, February 29 . Analysis of the North Carolina K-5 Standard Course of Study in relation to research on rational number , Report to the North Carolina Department of Public Instruction . Raleigh, NC: Friday Institute of Educational Innovation.
   Google Scholar
• Confrey , J. , Maloney , A. , Nguyen , K. , Mojica , G. and Myers , M. 2009 . “ Equipartitioning/splitting as a foundation of rational number reasoning using learning trajectories ” . In Proceedings of the 33rd Conference of the International Group for the Psychology of Mathematics Education , Edited by: Tzekaki , M. , Kaldrimidou , M. and Sakonidis , C. Vol. 1 , 345 – 352 . Thessaloniki , Greece : International Group for the Psychology of Mathematics Education .
   Google Scholar
• Confrey , J. and Penuel , W. R. 2010, December . Developing diagnostic assessments of STEM learning: Key decisions and alternative approaches , Washington , DC : Paper presented at the DRK-12 Principal Investigators Meeting .
   Google Scholar
• Confrey , J. and Scarano , G. H. 1995, October . Splitting re-examined: Results from a three-year longitudinal study of children in grades three to five , Columbus , OH : Paper presented at the annual meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education .
   Google Scholar
• Confrey , J. and Smith , E. 1995 . Splitting, covariation, and their role in the development of exponential functions . Journal for Research in Mathematics Education , 26 ( 1 ) : 66 – 86 .
   Web of Science ®Google Scholar
• Conklin , E. J. 2005 . Dialogue mapping: Building shared understanding of wicked problems , New York , NY : Wiley .
   Google Scholar
• Conklin , E. J. and Burgess-Yakemovic , K. C. 1996 . “ A process-oriented approach to design rationale ” . In Design rationale: Concepts, techniques, and use , Edited by: Moran , T. P. and Carroll , J. M. 393 – 428 . Mahwah , NJ : Erlbaum .
   Google Scholar
• Crocker , L. and Algina , J. 1986 . Introduction to classical and modern test theory , Orlando , FL : Holt, Rinehart & Winston .
   Google Scholar
• Cronbach , L. J. and Meehl , P. E. 1955 . Construct validity in psychological tests . Psychological Bulletin , 52 : 281 – 302 .
   PubMed Web of Science ®Google Scholar
• Damian , D. , Kwan , I. and Marczak , S. 2010 . “ Requirements-driven collaboration: Leveraging the invisible relationships between requirements and people ” . In Collaborative software engineering , Edited by: Mistrik , I. , Grundy , J. , Hoek , A. and Whitehead , J. 57 – 76 . Heidelberg , Germany : Springer .
   Google Scholar
• Daro , P. , Mosher , F. A. and Corcoran , T. 2011 . Learning trajectories in mathematics: A foundation for standards, curriculum, assessment, and instruction , Philadelphia , PA : Consortium for Policy Research in Education .
   Google Scholar
• Davis , G. and Pitkethly , A. 1990 . Cognitive aspects of sharing . Journal for Research in Mathematics Education , 21 : 145 – 153 .
   Web of Science ®Google Scholar
• de Ayala , R. J. 2009 . The theory and practice of item response theory , New York , NY : Guilford Press .
   Google Scholar
• de Boeck , P. and Wilson , M. 2004 . Explanatory item response models: A generalized linear and nonlinear approach , New York , NY : Springer .
   Google Scholar
• Design-Based Research Collective. (2003). Design-based research: An emerging paradigm for educational inquiry. Educational Researcher, 32(1), 5–8.
   Google Scholar
• Donovan, M. S., & Pellegrino, J. W. (2003). Learning and instruction: A SERP research agenda. Washington, DC: National Research Council.
   Google Scholar
• Duncan , R. G. and Hmelo-Silver , C. E. 2009 . Learning progressions: Aligning curriculum, instruction, and assessment . Journal of Research in Science Teaching , 46 : 606 – 609 .
   Web of Science ®Google Scholar
• Emerson , R. M. , Fretz , R. I. and Shaw , L. L. 1995 . Writing ethnographic fieldnotes , Chicago , IL : University of Chicago Press .
   Google Scholar
• Empson , S. 1999 . Equal sharing and shared meaning: The development of fraction concepts in a first-grade classroom . Cognition and Instruction , 17 ( 3 ) : 283 – 342 .
   Web of Science ®Google Scholar
• Foster , J. and Wiser , M. 2012 . “ The potential of learning progression research to inform the design of state science standards ” . In Learning progressions in science: Current challenges and future directions , Edited by: Alonzo , A. C. and Gotwals , A. W. 435 – 460 . Rotterdam : The Netherlands: Sense .
   Google Scholar
• Frederiksen , J. R. and Collins , A. 1989 . A systems approach to educational testing . Educational Researcher , 18 ( 9 ) : 27 – 32 .
   Google Scholar
• Frey , A. , Hartig , J. and Rupp , A. A. 2009 . An NCME instructional module on booklet designs in large-scale assessments of student achievement: Theory and practice . Educational Measurement: Issues and Practice , 28 ( 3 ) : 39 – 53 .
   Google Scholar
• Gotwals, A. W., Songer, N. B., & Bullard, L. (2012). Assessing students’ progressing abilities to construct scientific explanations. In A. C. Alonzo & A. W. Gotwals (Eds.), Learning progressions in science: Current challenges and future directions (pp. 183–210). Rotterdam, The Netherlands: Sense Publishers.
   Google Scholar
• Gunckel , K. L. , Mohan , L. , Covitt , B. A. and Anderson , C. W. 2012 . “ Addressing challenges in developing learning progressions for environmental science literacy ” . In Learning progressions in science: Current challenges and future directions , Edited by: Alonzo , A. C. and Gotwals , A. W. 39 – 76 . Rotterdam : The Netherlands: Sense .
   Google Scholar
• Hand , V. , Penuel , W. R. and Gutiérrez , K. D. 2012 . (Re)framing educational possibility: Attending to power and equity in shaping access to and within learning opportunities . Human Development , 55 : 250 – 268 .
   Web of Science ®Google Scholar
• Harel , G. and Confrey , J. 1994 . The development of multiplicative reasoning in the learning of mathematics , Albany : State University of New York Press .
   Google Scholar
• Horner , J. and Atwood , M. E. 2006 . “ Effective design rationale: Understanding the barriers ” . In Rationale management in software engineering , Edited by: Dutoit , A. , McCall , R. , Mistrik , I. and Paech , B. 77 – 88 . Heidelberg , Germany : Springer Verlag Heidelberg .
   Google Scholar
• Hunting , R. and Sharpley , C. 1991 . “ Pre-fraction concepts of preschoolers ” . In Early fraction fractions , Edited by: Hunting , R. and Davis , G. 27 – 54 . New York , NY : Springer Verlag .
   Google Scholar
• Jarczyk , A. P. J. , Loffler , P. and Shipman , F. M. 1992 . “ Design rationale for software engineering: A survey ” . In Proceedings of the 25th Hawai'i International Conference on System Sciences , Vol. 2 , 577 – 586 . Honolulu , HI : Institute of Electrical and Electronics Engineers .
   Google Scholar
• Kane , M. T. 1992 . An argument-based approach to validity . Psychological Bulletin , 112 : 527 – 535 .
   Web of Science ®Google Scholar
• Kelly , A. E. 2004 . Design research in education: Yes, but is it methodological? . Journal of the Learning Sciences , 13 ( 1 ) : 113 – 128 .
   Google Scholar
• Krutchen , P. , Capilla , R. and Duenas , J. C. 2009 . The decision view's role in software architecture practice . IEEE Software , 26 ( 2 ) : 36 – 42 .
   Web of Science ®Google Scholar
• Latour , B. 1987 . Science in action: How to follow scientists and engineers through society , Cambridge , MA : MIT Press .
   Google Scholar
• Lee , J. 1997 . Design rationale systems: Understanding the issues . Intelligent Systems , 12 ( 3 ) : 78 – 85 .
   Google Scholar
• Lee , J. and Lai , K.-Y. 1991 . What's in design rationale? . Human Computer Interaction , 6 ( 3 ) : 251 – 280 .
   Google Scholar
• Lehrer , R. 2012 . A learning progression emerges in a trading zone of professional community and identity , Nashville , TN : Vanderbilt University .
   Google Scholar
• Lehrer , R. , Kim , M.-J. and Schauble , L. 2007 . Supporting the development of conceptions of statistics by engaging students in measuring and modeling variability . International Journal of Computers for Mathematical Learning , 12 ( 3 ) : 195 – 216 .
   Google Scholar
• Lehrer , R. and Schauble , L. 2011 . “ Designing to support long-term growth and development ” . In Theories of learning and studies of instructional practice , Edited by: Koschmann , T. 19 – 38 . New York , NY : Springer .
   Google Scholar
• Lehrer , R. and Schauble , L. 2012 . Seeding evolutionary thinking by engaging children in modeling its foundations . Science Education , 96 : 701 – 724 .
   Web of Science ®Google Scholar
• Leighton , J. P. and Gierl , M. J. 2007 . “ Why cognitive diagnostic assessment? ” . In Cognitive diagnostic assessment for education: Theory and applications , Edited by: Leighton , J. P. and Gierl , M. J. 3 – 18 . New York , NY : Cambridge University Press .
   Google Scholar
• Lesh , R. A. and Sriraman , B. 2005 . Mathematics education as a design science . ZDM: The International Journal of Mathematics Education , 37 : 490 – 505 .
   Google Scholar
• Lynch , M. 1993 . Scientific practice and ordinary action: Ethnomethodology and social studies of science , New York , NY : Cambridge University Press .
   Google Scholar
• McDonnell, L. M. (1995). Opportunity to learn as a research concept and policy instrument. Educational Evaluation and Policy Analysis, 11, 181–199.
   Google Scholar
• Messick , S. 1984 . Assessment in context: Appraising student performance in relation to instructional quality . Educational Researcher , 13 ( 3 ) : 3 – 8 .
   Google Scholar
• Messick , S. 1989 . “ Validity ” . In Educational measurement , 3rd ed. , Edited by: Linn , R. L. 13 – 103 . New York , NY : Macmillan .
   Google Scholar
• Messick , S. 1995 . Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning . American Psychologist , 50 : 741 – 749 .
   Web of Science ®Google Scholar
• Mislevy , R. J. 1994 . Evidence and inference in educational assessment . Psychometrika , 59 : 439 – 483 .
   Web of Science ®Google Scholar
• Mislevy , R. J. 1996 . Evidence and inference in educational assessment (Center for the Study of Evaluation Tech. Rep. No. 414) , Los Angeles : University of California, Los Angeles, National Center for Research on Evaluation, Standards, and Student Testing .
   Google Scholar
• Mislevy , R. J. 2007 . Validity by design . Educational Researcher , 36 : 463 – 469 .
   Google Scholar
• Mislevy , R. J. 2008 . “ Issues of structure and issues of scale in assessment from a situative/sociocultural perspective ” . In Assessment, equity, and opportunity to learn , Edited by: Moss , P. A. , Pullia , D. , Haertel , E. H. , Gee , J. P. and Young , L. J. 259 – 294 . New York , NY : Cambridge University Press .
   Google Scholar
• Mislevy, R. J., Almond, R. J., & Lukas, J. F. (2004). A brief introduction to evidence centered design. Center for the Study of Evaluation Report 632. Los Angeles, CA: National Center for Research on Evaluation, Standards, and Student Testing, University of California, Los Angeles.
   Google Scholar
• Mislevy , R. J. , Behrens , J. T. , DiCerbo , K. E. and Levy , R. 2012 . Design and discovery in educational assessment: Evidence-centered design, psychometrics, and educational data mining . Journal of Educational Data Mining , 4 ( 1 ) : 11 – 48 .
   Google Scholar
• Mislevy , R. J. and Haertel , G. D. 2006 . Implications of evidence-centered design for educational testing . Educational Measurement: Issues and Practice , 25 ( 4 ) : 6 – 20 .
   Google Scholar
• Mislevy , R. J. , Hamel , L. , Fried , R. , Gaffney , T. , Haertel , G. , Hafter , A. and Wenk , A. 2003 . Design patterns for assessing science inquiry (PADI Tech. Rep. No. 1) , Menlo Park , CA : SRI International .
   Google Scholar
• Mislevy , R. J. and Riconscente , M. M. 2006 . “ Evidence-centered assessment design: Layers, concepts, and terminology ” . In Handbook of test development , Edited by: Downing , S. and Haladyna , M. T. 61 – 90 . Mahwah , NJ : Erlbaum .
   Google Scholar
• Mislevy , R. J. , Steinberg , L. and Almond , R. J. 2003 . On the structure of educational assessments . Measurement: Interdisciplinary Research & Perspective , 1 ( 1 ) : 3 – 62 .
   Google Scholar
• Mitchell , K. J. , Murphy , R. F. , Jolliffe , D. , Leinwand , S. and Hafter , A. 2004 . “ student work as measures of opportunity to learn ” . In Teacher assignments and , Menlo Park , CA : SRI International .
   Google Scholar
• Mohan , L. and Anderson , C. W. 2012 . “ Exploring challenges to defining learning progressions ” . In Learning progressions in science: Current challenges and future directions , Edited by: Alonzo , A. C. and Gotwals , A. W. 139 – 150 . Rotterdam : The Netherlands: Sense .
   Google Scholar
• Mohan , L. , Chen , J. and Anderson , C. W. 2009 . Developing a multi-year learning progression for carbon cycling . Journal of Research in Science Teaching , 46 : 675 – 698 .
   Web of Science ®Google Scholar
• Mojica , G. 2010 . Preparing pre-service elementary teachers to teach mathematics with learning trajectories , Raleigh : North Carolina State University .
   Google Scholar
• Moran , T. P. and Carroll , J. M. 1996a . Design rationale: Concepts, techniques, and use , Mahwah , NJ : Erlbaum .
   Google Scholar
• Moran , T. P. and Carroll , J. M. 1996b . “ Overview of design rationale ” . In Design rationale: Concepts, techniques, and use , Edited by: Moran , T. P. and Carroll , J. M. 1 – 20 . Mahwah , NJ : Erlbaum .
   Google Scholar
• National Research Council . 2001 . Knowing what students know , Washington , DC : National Academies Press .
   Google Scholar
• National Research Council. (2007). Taking science to school: Learning and teaching science in grades K–8. Washington, DC: National Academies Press.
   Google Scholar
• Nichols , P. D. , Chipman , S. F. and Brennan , R. L. 1995 . Cognitively diagnostic assessment , Hillsdale , NJ : Erlbaum .
   Google Scholar
• Norman , D. A. 1990 . The design of everyday things , New York , NY : Doubleday .
   Google Scholar
• Pea , R. D. and Collins , A. 2008 . “ Learning how to do science education: Four waves of reform ” . In Designing coherent science education , Edited by: Kali , Y. , Linn , M. C. and Roseman , J. E. Vol. pp. 3–12 , New York , NY : Teachers College Press .
   Google Scholar
• Pickering , A. 1989 . “ Editing and epistemology: Three accounts of the discovery of the weak neutral current ” . In Knowledge and society: Studies in the sociology of science, past and present , Edited by: Hargens , L. , Jones , R. A. and Pickering , A. 217 – 232 . Greenwich , CT : JAI Press .
   Google Scholar
• Plummer , J. D. 2012 . “ Challenges in defining and validating an astronomy learning progression ” . In Learning progressions in science: Current challenges and future directions , Edited by: Alonzo , A. C. and Gotwals , A. W. 77 – 100 . Rotterdam : The Netherlands: Sense .
   Google Scholar
• Porter , A. C. 2002 . Measuring the content of instruction: Uses in research and practice . Educational Researcher , 31 ( 7 ) : 3 – 14 .
   Google Scholar
• Pothier , Y. and Sawada , D. 1983 . Partitioning: The emergence of rational number ideas in young children . Journal for Research in Mathematics Education , 14 : 307 – 317 .
   Google Scholar
• Ralph , P. and Wand , Y. 2009 . “ A proposal for a formal definition of the design concept ” . In Design requirements engineering: A ten-year perspective , Edited by: Lyytinen , K. , Loucopoulos , P. , Mylopoulos , J. and Robinson , W. 103 – 136 . The Netherlands : Springer Verlag . Dordrecht
   Google Scholar
• Reckase, M. D. (2009). Multidimensional item response theory. New York, NY: Springer.
   Google Scholar
• Reeve , S. and Bell , P. 2009 . Children's self-documentation and understanding of the concepts “healthy” and “unhealthy.” . International Journal of Science Education , 31 : 1953 – 1974 .
   Web of Science ®Google Scholar
• Rittell , H. W. J. and Webber , M. M. 1984 . “ Planning problems are wicked problems ” . In Developments in design methodology , Edited by: Cross , N. 135 – 144 . New York , NY : Wiley .
   Google Scholar
• Rowan , B. , Camburn , E. and Correnti , R. 2004 . Using teacher logs to measure the enacted curriculum: A study of literacy teaching in third-grade classrooms . Elementary School Journal , 105 ( 1 ) : 75 – 102 .
   Web of Science ®Google Scholar
• Rupp, A. A., Gushta, M., Mislevy, R. J.Shaffer, D. W.2010Evidence-centered design of epistemic games: Measurement principles for complex learning environments. Journal of Technology, Learning, and Assessment, 8(4). Retrieved from http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1623/1467 (http://ejournals.bc.edu/ojs/index.php/jtla/article/view/1623/1467)
   Google Scholar
• Rupp , A. A. and Templin , J. 2008 . Unique characteristics of diagnostic classification models . Measurement: Interdisciplinary Research & Perspective , 6 ( 4 ) : 219 – 262 .
   Google Scholar
• Rupp , A. A. , Templin , J. and Henson , R. A. 2010 . Diagnostic assessment: Theory, methods, and applications , New York , NY : Guilford Press .
   Google Scholar
• Schwarz , C. V. , Reiser , B. J. , Acher , A. , Kenyon , L. and Fortus , D. 2012 . “ MoDeLS: Challenges in defining a learning progression for scientific modeling ” . In Learning progressions in science: Current challenges and future directions , Edited by: Alonzo , A. C. and Gotwals , A. W. 101 – 138 . Rotterdam : The Netherlands: Sense .
   Google Scholar
• Schwarz, C. V., Reiser, B. J., Davis, E. A., Kenyon, L., Acher, A., Fortus, D., … Krajcik, J. (2009). Developing a learning progression for scientific modeling: Making scientific modeling accessible and meaningful for learners. Journal of Research in Science Teaching, 46, 632–654.
   Google Scholar
• Sharp , H. , Rogers , Y. and Preece , J. 2011 . Interaction design: Beyond human-computer interaction , 3rd ed. , New York , NY : Wiley .
   Google Scholar
• Shea, N. A., & Duncan, R. G. (2013). From theory to data: The process of refining learning progressions. Journal of the Learning Sciences, 22, 7–32.
   Google Scholar
• Shinohara , M. and Lehrer , R. 2013, May . Epistemology in flux: How teachers interpret the practice of inventing statistics , San Francisco , CA : Paper presented at the annual meeting of the American Educational Research Association .
   Google Scholar
• Shipman , F. M. and McCall , R. 1994 . “ Supporting knowledge-base evolution with incremental formalization ” . In Proceedings of the SIGCHI conference on human factors in computing systems: Celebrating interdependence , Edited by: Adelson , B. , Dumais , S. and Olson , J. 285 – 291 . New York , NY : Association for Computing Machinery .
   Google Scholar
• Simon , M. A. 1995 . Reconstructing mathematics pedagogy from a constructivist perspective . Journal for Research in Mathematics Education , 26 : 114 – 145 .
   Web of Science ®Google Scholar
• Slimani , K. , Da Silva , C. F. , Medini , L. and Ghodous , P. 2006 . Conflict mitigation in collaborative design . International Journal of Production Research , 44 : 1681 – 1702 .
   Web of Science ®Google Scholar
• Smith , C. L. , Wiser , M. , Anderson , C. W. and Krajcik , J. 2006 . Implications of research on children's learning for standards and assessment: A proposed learning progression for matter and the atomic-molecular theory . Measurement: Interdisciplinary Research & Perspective , 4 ( 1&2 ) : 1 – 98 .
   Google Scholar
• Songer , N. B. , Kelcey , B. and Gotwals , A. W. 2009 . How and when does complex reasoning occur? Empirically driven development of a learning progression focused on complex reasoning about biodiversity . Journal of Research in Science Teaching , 46 : 610 – 631 .
   Web of Science ®Google Scholar
• Star , S. L. and Griesemer , J. R. 1989 . Institutional ecology, “translations” and boundary objects: Amateurs and professionals in Berkeley's Museum of Vertebrate Zoology, 1907-1939 . Social Studies of Science , 19 : 387 – 420 .
   Web of Science ®Google Scholar
• Steedle , J. T. and Shavelson , R. J. 2009 . Supporting valid interpretations of learning progression level diagnoses . Journal of Research in Science Teaching , 46 : 699 – 715 .
   Web of Science ®Google Scholar
• Tatar , D. 2007 . The design tensions framework . Human-Computer Interaction , 22 : 413 – 451 .
   Web of Science ®Google Scholar
• U.S. Department of Education. (2009). Race to the Top: Executive summary. Washington, DC: Author.
   Google Scholar
• Valetto , G. , Helander , M. , Ehrlich , K. , Chulni , S. , Wegman , M. and Williams , C. 2007 . Using software repositories to investigate socio-technical congruence in development projects , Paper presented at the Fourth International Workshop on Mining Software Repositories . May Minneapolis, MN.
   Google Scholar
• Wang, F., & Hannafin, M. J. (2005). Design-based research and technology-enhanced learning environments. Educational Technology Research and Development, 53(4), 5–23.
   Google Scholar
• Wilson , M. 2005 . Constructing measures: An item response modeling approach , Mahwah , NJ : Erlbaum .
   Google Scholar
• Wilson , M. 2009 . Measuring progressions: Assessment structures underlying a learning progression . Journal of Research in Science Teaching , 46 : 716 – 730 .
   Web of Science ®Google Scholar
• Wilson , P. H. 2009 . Teachers’ uses of a learning trajectory for equipartitioning (Unpublished doctoral dissertation) , Raleigh, NC : North Carolina State University .
   Google Scholar
• Woolf, S. H. (2008). The meaning of translational research and why it matters. Journal of the American Medical Association, 299(2), 211–213.
   Google Scholar
• Yoon , B. and Resnick , L. B. 1998 . Instructional validity, opportunity to learn and equity: New standards examinations for the California mathematics renaissance , Los Angeles , CA : Center for the Study of Evaluation, National Center for Research on Evaluation, Standards, and Student Testing . (Center for the Study of Evaluation Tech. Rep. No. 484)
   Google Scholar