The effect of clustering on statistical tests: an illustration using classroom environment data

References

• Alker , H.R. 1969 . “ A typology of ecological fallacies ” . In Quantitative ecological analysis in the social sciences , Edited by: Dogan , H. and Rokkan , S. 69 – 86 . London : MIT Press .
   Google Scholar
• Allen , D. and Fraser , B.J. 2007 . Parent and student perceptions of the classroom learning environment and its association with student outcomes . Learning Environments Research , 10 : 67 – 82 .
   Google Scholar
• Anderson , L. 1981 . Assessing affective characteristics in the schools , Boston , MA : Allyn & Bacon .
   Google Scholar
• Antia , S.D. , Sabers , D.L. and Stinson , M.S. 2006 . Validity and reliability of the Classroom Participation Questionnaire with deaf and hard of hearing students in public schools . Journal of Deaf Studies and Deaf Education , 12 : 158 – 171 .
   PubMed Web of Science ®Google Scholar
• Aitkin , M. and Longford , N. 1986 . Statistical modelling issues in school effectiveness studies (with discussion) . Journal of the Royal Statistical Society, Series A , 149 : 1 – 43 .
   Web of Science ®Google Scholar
• Azimioara , M. and Fraser , B.J. The effect of extended instructional time on learning environment, achievement, and attitudes in middle schools algebra classes . Paper presented at the annual meeting of the American Educational Research Association . Chicago . April .
   Google Scholar
• Burstein , L. 1980 . “ The analysis of multi‐level data in educational research and evaluation ” . In Review of research in education , Edited by: Berliner , D.C. Vol. 8 , 158 – 233 . Washington : American Educational Research Association .
   Google Scholar
• Cavanagh , R.F. and Romanoski , J.T. 2006 . Rating scale instruments and measurement . Learning Environments Research , 9 : 273 – 289 .
   Google Scholar
• Cronbach , L.J. 1976 . Research on classrooms and schools: Formulation of questions, design and analysis , Stanford , CA : Stanford University . Occasional paper of the Stanford Evaluation Consortium
   Google Scholar
• den Brok , P. , Brekelmans , M. and Wubbels , T. 2006 . Multilevel issues in research using students’ perceptions of learning environments: The case of the Questionnaire on Teacher Interaction . Learning Environments Research , 9 : 199 – 213 .
   Google Scholar
• Dorman , J.P. 1994 . A study of school and classroom environments in Queensland Catholic secondary schools , Perth , , Australia : Curtin University of Technology . Unpublished PhD thesis
   Google Scholar
• Dorman , J.P. 2002 . Classroom environment research: Progress and possibilities . Queensland Journal of Educational Research , 18 : 112 – 140 .
   Google Scholar
• Dorman , J.P. 2003 . Cross national validation of the What Is Happening In this Class? questionnaire using confirmatory factor analysis . Learning Environments Research , 6 : 231 – 245 .
   Google Scholar
• Dorman , J.P. in press . Partitioning the variance in scores on classroom environment instruments . Journal of Educational Research ,
   Google Scholar
• Dorman , J.P. in press . Use of multitrait‐multimethod modelling to validate actual and preferred forms of the ‘What Is Happening In this Class?’ questionnaire . Learning Environments Research ,
   PubMedGoogle Scholar
• Dorman , J.P. , McRobbie , C.J. and Foster , W.J. 2002 . Associations between psychosocial environment in religious education classes and students’ attitude to Christianity . Religious Education , 97 : 23 – 42 .
   Web of Science ®Google Scholar
• Fiedler , M.L. 1975 . Bidirectionality of influence in classroom interaction . Journal of Educational Psychology , 67 : 735 – 744 .
   Web of Science ®Google Scholar
• Fisher , D.L. and Khine , M.S. , eds. 2006 . Contemporary approaches to research on learning environments , Singapore : World Scientific .
   Google Scholar
• Frailich , M. , Kesner , M. and Hofstein , A. 2007 . The influence of web‐based chemistry learning on students’ perceptions, attitudes, and achievements . Research in Science and Technological Education , 25 : 179 – 197 .
   Google Scholar
• Fraser , B.J. 1986 . Classroom environment , London : Croom Helm .
   Google Scholar
• Fraser , B.J. 1990 . Individualised classroom environment questionnaire , Melbourne , NSW : Australian Council for Educational Research .
   Google Scholar
• Fraser , B.J. 1998 . “ Science learning environments: Assessments, effects and determinants ” . In International handbook of science education , Edited by: Fraser , B.J. and Tobin , K.G. 527 – 564 . Dordrecht , , the Netherlands : Kluwer .
   Google Scholar
• Fraser , B.J. , Anderson , G.J. and Walberg , H.J. 1982 . Assessment of learning environments: Manual for learning environment inventory (LEI) and My Class Inventory (MCI) (3rd version) , Perth : Western Australian Institute of Technology .
   Google Scholar
• Fraser , B.J. , Giddings , G.J. and McRobbie , C.J. 1995 . Evolution and validation of a personal form of an instrument for assessing science laboratory classroom environment . Journal of Research in Science Teaching , 32 : 399 – 422 .
   Web of Science ®Google Scholar
• Freedman , D.A. 1999 . Ecological inference and the ecological fallacy Report prepared for the International Encyclopedia of the Social and Behavioral Sciences (Technical Report no. 549). Retrieved August 30, 2007, from http://www.stanford.edu/class/ed260/freedman549.pdf
   Google Scholar
• Goh , S.C. and Fraser , B.J. 1998 . Teacher interpersonal behaviour, classroom environment and student outcomes in primary mathematics in Singapore . Learning Environments Research , 1 : 199 – 229 .
   Google Scholar
• Goldstein , H. 2003 . Multilevel statistical models , (3rd ed.) , London : Edward Arnold .
   Google Scholar
• Goldstein , H. 2004 . “ Some observations on the definition and estimation of effect sizes ” . In But what does it mean? The use of effect sizes in educational research , Edited by: Schagen , I. and Elliot , K. 67 – 71 . Slough , , UK : NFER .
   Google Scholar
• Goldstein , H. , Browne , W. and Rasbash , J. 2002 . Partitioning variation in multilevel models . Understanding Statistics , 1 : 223 – 231 .
   Google Scholar
• Hedges , L.V. 2007 . Correcting a significance test for clustering . Journal of Educational and Behavioral Statistics , 32 : 151 – 179 .
   Web of Science ®Google Scholar
• Hedges , L.V. and Hedberg , E.C. 2007 . Intraclass correlations for planning group‐randomised trials in education . Educational Evaluation and Policy Analysis , 29 : 60 – 87 .
   Web of Science ®Google Scholar
• Hox , J.J. 2002 . Multilevel analysis: Techniques and applications , Mahwah , NJ : Erlbaum .
   Google Scholar
• Khine , M.S. and Fisher , D.L. , eds. 2003 . Technology‐rich learning environments: A future perspective , Singapore : World Scientific .
   Google Scholar
• Kunter , M. and Baumert , J. 2006 . Who is the expert? Construct and criteria validity of student and teacher ratings of instruction . Learning Environments Research , 9 : 231 – 251 .
   Google Scholar
• Lee , V.E. 2000 . Using hierarchical linear modeling to study social contexts: The case of school effects . Educational Psychologist , 35 : 125 – 141 .
   Web of Science ®Google Scholar
• Logan , K.A. 2007 . Should computing be taught in single‐sex environments? An analysis of the computing learning environment of upper secondary students . Educational Studies , 33 : 233 – 248 .
   Web of Science ®Google Scholar
• Moos , R.H. and Trickett , E.J. 1987 . Classroom Environment Scale manual , (2nd ed.) , Palo Alto , CA : Consulting Psychologists Press .
   Google Scholar
• Murray , H.A. 1938 . Explorations in personality , New York : Oxford University Press .
   Google Scholar
• Patrick , H. , Ryan , A.M. and Kaplan , A. 2007 . Early adolescents’ perceptions of the classroom social environment, motivational beliefs, and engagement . Journal of Educational Psychology , 99 : 83 – 98 .
   Web of Science ®Google Scholar
• Rasbash , J. , Steele , F. , Browne , W. and Prosser , B. 2005 . A user’s guide to MLwiN version 2.0 , Bristol , , UK : Centre for Multilevel Modelling, University of Bristol .
   Google Scholar
• Raudenbush , S. and Bryk , A. 2002 . Hierarchical linear models , Thousand Oaks , CA : Sage .
   Google Scholar
• Raudenbush , S.W. and Willms , J.D. , eds. 1991 . Schools, classrooms and pupils: International studies of schooling from multilevel perspective , San Diego , CA : Academic .
   Google Scholar
• Rosenshine , B. 1970 . Evaluation of classroom instruction . Review of Educational Research , 40 : 279 – 300 .
   Web of Science ®Google Scholar
• Rowe , K.J. 2007 . Practical multilevel analysis with MLwiN and LISREL: An integrated course , (7th ed.) , Camberwell , VIC : ACER .
   Google Scholar
• Schmidt , M. and Čagran , B. 2006 . Classroom climate in regular primary school settings with children with special needs . Educational Studies , 32 : 361 – 372 .
   Web of Science ®Google Scholar
• Seidel , T. 2006 . The role of student characteristics in studying micro teaching‐learning environments . Learning Environments Research , 9 : 253 – 271 .
   Google Scholar
• Shavelson , R.J. and Seidel , T. 2006 . Approaches in measuring learning environments . Learning Environments Research , 9 : 195 – 197 .
   Google Scholar
• Snijders , T.A.B. and Bosker , R.J. 1999 . Multilevel analysis: An introduction to basic and advanced multilevel modeling , London : Sage .
   Google Scholar
• Tabachnick , B.G. and Fidell , L.S. 2007 . Understanding multivariate statistics , (5th ed.) , Boston , MA : Pearson .
   Google Scholar
• Telli , S. , den Brok , P. and Cakiroglu , J. 2007 . students’ perceptions of science teachers’ interpersonal behaviour in secondary schools: Development of a Turkish version of the Questionnaire on Teacher Interaction . Learning Environments Research , 10 : 115 – 129 .
   Google Scholar
• Veltri , S. , Banning , J.H. and Davies , T.G. 2006 . The community college classroom environment: Student perceptions . College Student Journal , 40 : 517 – 527 .
   Google Scholar
• Villar , L.M. and Alegre , O.M. 2007 . Student perceptions of classroom environment and instructors’ reflections , University of Seville . (ERIC Document Reproduction Service No. ED495249)
   Google Scholar
• Walberg , H.J. 1976 . Psychology of learning environments: Behavioral, structural, or perceptual? . Review of Research in Education , 4 : 142 – 178 .
   Google Scholar
• Waldrip , B.G. , Reene , P. , Fisher , D.L. and Dorman , J.P. 2008 . Changing primary students’ perceptions of teacher interpersonal behaviours . Research in Science Education , 38 : 213 – 235 .
   Web of Science ®Google Scholar
• Wheldall , K. , Beaman , R. and Mok , M. 1999 . Does the Individualized Classroom Environment Questionnaire (ICEQ) measure classroom climate? . Educational and Psychological Measurement , 59 : 847 – 854 .
   Web of Science ®Google Scholar
• Wubbels , T. and Levy , J. , eds. 1993 . Do you know what you look like? Interpersonal relationships in education , London : Falmer .
   Google Scholar