An Argument Approach to Observation Protocol Validity

REFERENCES

• Allen , J. P. , Gregory , A. , Mikami , A. Y. , Lun , J. , Hamre , B. K. and Pianta , R. C. 2012 . Observations of effective teaching in secondary school classroom: Predicting student achievement with CLASS-S Unpublished manuscript
   Google Scholar
• Allen , J. P. , Pianta , R. C. , Gregory , A. , Mikami , A. Y. and Lun , J. 2011 . An interaction-based approach to enhancing secondary school instruction and student achievement . Science , 333 : 1034 – 1037 . doi:10.1126/science.1207998
   PubMed Web of Science ®Google Scholar
• Ball , D. L. , Thames , M. H. and Phelps , G. 2008 . Content knowledge for teaching: What makes it special? . Journal of Teacher Education , 59 : 389 – 407 . doi:10.1177/0022487108324554
   Web of Science ®Google Scholar
• Bell , C. A. , Gitomer , D. H. , McCaffrey , D. , Hamre , B. K. , Pianta , R. and Qi , Y. 2012 . Final report on the toward an understanding of classroom context study Unpublished manuscript
   Google Scholar
• Bill and Melinda Gates Foundation . 2012 . Gathering feedback for teaching: Combining high quality observations with student surveys and achievement gains Seattle , WA : Author. .
   Google Scholar
• Blackwell , L. S. , Trzesniewski , K. H. and Dweck , C. 2007 . Implicit theories of intelligence predict achievement across an adolescent transition: A longitudinal study and an intervention . Society for Research in Child Development , 78 : 246 – 263 . doi:10.1111/j.1467–8624.2007.00995.x
   Google Scholar
• Brennan , R. L. 2001 . Generalizability theory New York , NY : Springer-Verlag. .
   Google Scholar
• Casabianca , J. , McCaffrey , D. F. , Gitomer , D. H. , Bell , C. A. and Hamre , B. 2012 . Effect of observation mode on measures of secondary mathematics teaching Unpublished manuscript
   Google Scholar
• Cicchetti , D. V. and Sparrow , S. A. 1981 . Developing criteria for establishing interobserver reliability of specific items: Applications to assessment of adaptive behavior . American Journal of Mental Deficiency , 86 : 127 – 137 .
   PubMedGoogle Scholar
• Cronbach , L. J. 1971 . “ Test validation. ” . In Education measurement, , 2nd ed. Edited by: Thorndike , R. L. 443 – 507 . Washington , DC : American Council on Education. .
   Google Scholar
• Cronbach , L. J. , Gleser , G. C. , Nanda , H. and Rajaratnam , N. 1972 . The dependability of behavioral measurements: Theory of generalizability for scores and profiles. New York , NY : Wiley. .
   Google Scholar
• Goe , L. 2007 . The link between teacher quality and student outcomes: A research synthesis Washington , DC : National Comprehensive Center for Teacher Quality. .
   Google Scholar
• Goe , L. , Bell , C. and Little , O. 2008 . Approaches to evaluating teacher effectiveness: A research synthesis Washington , DC : National Comprehensive Center for Teacher Quality. .
   Google Scholar
• Hamre , B. K. , Hafen , C. , Pianta , R. , Bell , C. , Gitomer , D. H. and McCaffrey , D. 2012 . Teaching through Interactions in middle and high school classrooms: Validating the factor structure of the Classroom Assessment Scoring System-Secondary Unpublished manuscript
   Google Scholar
• Hamre , B. K. and Pianta , R. C. 2005 . Can instructional and emotional support in the first-grade classroom make a difference for children at risk of school failure? . Child Development , 76 : 949 – 967 . doi:10.1111/j.1467–8624.2005.00889.x
   PubMed Web of Science ®Google Scholar
• Hamre , B. K. , Pianta , R. C. , Downer , J. T. , Hakigami , A. , Mashburn , A. J. , Jones , S. and Brackett , M. 2011 . Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms Unpublished manuscript
   Google Scholar
• Hill , H. C. , Ball , D. L. , Blunk , M. , Goffney , I. M. and Rowan , B. 2007 . Validating the ecological assumption: The relationship of measure scores to classroom teaching and student learning . Measurement: Interdisciplinary Research and Perspective , 5 : 107 – 118 . doi:10.1080/15366360701487138
   Google Scholar
• Hill , H. C. , Blunk , M. L. , Charalambous , C. Y. , Lewis , J. M. , Phelps , G. C. , Sleep , L. and Ball , D. L. 2008 . Mathematical knowledge for teaching and the mathematical quality of instruction: An exploratory study . Cognition & Instruction , 26 : 430 – 511 . doi:10.1080/07370000802177235
   Web of Science ®Google Scholar
• Hill , H. C. , Kapitula , L. and Umland , K. 2011 . A validity argument approach to evaluating teacher value-added scores . American Educational Research Journal , 48 : 794 – 831 . doi:10.3102/0002831210387916
   Web of Science ®Google Scholar
• Howes , C. , Burchinal , M. , Pianta , R. , Bryant , D. , Early , D. , Clifford , R. and Barbarin , O. 2008 . Ready to learn? Children's pre-academic achievement in pre-Kindergarten programs . Early Childhood Research Quarterly , 23 : 27 – 50 . doi:10.1016/j.ecresq.2007.05.002
   Web of Science ®Google Scholar
• Jaeger , R. M. 1993 . Live vs. Memorex: Psychometric and practical issues in the collection of data on teachers' performances in the classroom Retrieved from ERIC database. (ED360325)
   Google Scholar
• Kane , M. T. 2006 . “ Validation. ” . In Educational measurement Edited by: Brennan , R. L. 17 – 64 . New York , NY : Praeger. .
   Google Scholar
• La Paro , K. M. , Pianta , R. C. and Stuhlman , M. 2004 . The classroom assessment scoring system: Findings from the prekindergarten year . The Elementary School Journal , 104 : 409 – 426 . doi:10.1086/499760
   Web of Science ®Google Scholar
• Lockwood , J. R. , McCaffrey , D. F. , Hamilton , L. S. , Stecher , B. M. , Le , V.-N. and Martinez , J. F. 2007 . The sensitivity of value-added teacher effect estimates to different mathematics achievement measures . Journal of Educational Measurement , 44 : 47 – 67 . doi:10.1111/j.1745–3984.2007.00026.x
   Web of Science ®Google Scholar
• Medina , J. 2010 . Agreement will alter teacher evaluations . The New York Times , May 10 : A17 Retrieved from http://www.nytimes.com/2010/05/11/nyregion/11teacher.html
   Google Scholar
• Messick , S. 1989 . “ Validity. ” . In Educational measurement, , 3rd ed. Edited by: Linn , R. L. 13 – 103 . New York , NY : American Council of Education and Macmillan. .
   Google Scholar
• New Jersey Educator Effectiveness Task Force . 2011 . Interim report: New Jersey Educator Effectiveness Task Force Retrieved from http://www.state.nj.us/education/educators/effectiveness.pdf
   Google Scholar
• Nunnally , J. and Bernstein , I. 1994 . Psychometirc theory, , 3rd ed. New York , NY : McGraw-Hill. .
   Google Scholar
• Pajares , M. F. 1992 . Teachers' beliefs and educational research: Cleaning up a messy construct . Review of Educational Research , 62 : 307 – 332 .
   Web of Science ®Google Scholar
• Pianta , R. C. , Hamre , B. K. , Haynes , N. J. , Mintz , S. L. and La Paro , K. M. 2007 . Classroom assessment scoring system manual, middle/secondary version Charlottesville : University of Virginia. .
   Google Scholar
• Pianta , R. , Howes , C. , Burchinal , M. , Bryant , D. , Clifford , R. , Early , D. and Barbarin , O. 2005 . Features of prekindergarten programs, classrooms, and teachers: Do they predict observed classroom quality and child–teacher interactions? . Applied Developmental Science , 9 : 144 – 159 . doi:10.1207/s1532480xads0903_2
   Google Scholar
• Rimm-Kaufman , S. E. , Curby , T. W. , Grimm , K. J. , Nathanson , L. and Brock , L. L. 2009 . The contribution of children's self-regulation and classroom quality to children's adaptive behaviors in the kindergarten classroom . Developmental Psychology , 45 : 958 – 972 . doi:101037/a0015861
   PubMed Web of Science ®Google Scholar
• Rimm-Kaufman , S. E. , La Paro , K. M. , Downer , J. T. and Pianta , R. C. 2005 . The contribution of classroom setting and quality of instruction to children . The Elementary School Journal , 105 : 377 – 394 . doi:10.1086/429948
   Web of Science ®Google Scholar
• Shavelson , R. J. and Webb , N. M. 1991 . Generalizability theory: A primer Newbury Park , CA : Sage. .
   Google Scholar
• Shavelson , R. J. , Webb , N. M. and Burstein , L. 1986 . “ Measurement of teaching. ” . In Handbook of research on teaching, , 3rd ed. Edited by: Wittrock , M. C. 50 – 91 . New York , NY : Macmillan. .
   Google Scholar
• Spillane , J. P. and Zeuli , J. S. 1999 . Reform and teaching: Exploring patterns of practice in the context of national and state mathematics reforms . Educational Evaluation and Policy Analysis , 21 : 1 – 27 .
   Web of Science ®Google Scholar
• Stecher , B. , Le , V.-N. , Hamilton , L. , Ryan , G. , Robyn , A. and Lockwood , J. R. 2006 . Using structured classroom vignettes to measure instructional practices in mathematics . Educational Evaluation and Policy Analysis , 28 : 101 – 130 . doi:10.3102/01623737028002101
   Web of Science ®Google Scholar
• United States Department of Education . October 6 2009 . U.S. Secretary of Education announces national competition to invest in innovation October 6 , [Press release]Retrieved from http://www2.ed.gov/news/pressreleases/2009/10/10062009a.html
   Google Scholar
• United States Department of Education Office of Planning Evaluation and Policy Development . March 2010 . ESEA a blueprint for reform: The reeditorization of the Elementary and Secondary Education Act March , Retrieved from http://www2.ed.gov/policy/elsec/leg/blueprint/blueprint.pdf
   Google Scholar
• Valentine , J. C. , DuBois , D. L. and Cooper , H. 2004 . The relation between self-beliefs and academic achievement: A meta-analytic review . Educational Psychologist , 39 : 111 – 133 .
   Web of Science ®Google Scholar
• Wayne , A. J. and Youngs , P. 2003 . Teacher characteristics and student achievement gains: A review . Review of Educational Research , 73 : 89 – 122 . doi:10.3102/00346543073001089
   Web of Science ®Google Scholar
• Weisberg , D. , Sexton , S. , Mulhern , J. and Keeling , D. 2009 . The widget effect: Our national failure to acknowledge and act on differences in teacher effectiveness New York , NY : The New Teacher Project. .
   Google Scholar