Item format as a factor affecting the relative standing of countries in the third international mathematics and science study (TIMSS)

References

• Airasian , P.W. 1997 . Classroom Assessment , New York : McGraw‐Hill Companies, Inc .
   Google Scholar
• Airasian , P. W. and Madaus , G. F. 1983 . Linking testing and instruction: Policy issues . Journal of Educational Measurement , 20 : 103 – 118 .
   Web of Science ®Google Scholar
• Aschbacher , P.R. 1991 . Performance assessment: State activity, interest, and concerns . Applied Measurement in Education , 4 : 275 – 278 .
   Google Scholar
• Atkin , J.M. and Black , P. 1997 . Policy perils of international comparisons . Phi Delta Kappan , 79 ( 1 ) : 22 – 28 .
   Web of Science ®Google Scholar
• Baker , D.P. 1997 . Surviving TIMSS: Or everything you blissfully forgot about international comparisons . Phi Delta Kappan , 79 : 295 – 300 .
   Web of Science ®Google Scholar
• Beaton , A.E. 1998 . Comparing cross‐national student performance on TIMSS using different test items . International Journal of Educational Research , 29 : 529 – 542 .
   Google Scholar
• Beaton , A.E. and Gonzalez , E.J. 1997 . “ TIMSS test‐curriculum matching analysis ” . In Third International Mathematics and Science Study Technical Report, Vol. 2: Design and development , Edited by: Martin , M.O. and Kelly , D.L. 187 – 193 . Chestnut Hill , MA : Center for the Study of Testing, Evaluation, and Educational Policy, Boston College .
   Google Scholar
• Beaton , A.E. , Martin , M.O. and Mullis , I.V.S. 1997 . Providing data for educational policy in an international context: The Third International Mathematics and Science Study (TIMSS) . European Journal of Psychological Assessment , 13 : 49 – 58 .
   Web of Science ®Google Scholar
• Beaton , A.E. , Martin , M.O. and Mullis , I.V.S. 1996b . Science achievement in the middle school years: IEA's Third International Mathematics and Science Study , Edited by: Gonzalez , E.J. , Smith , T.A. and Kelly , D.L. Chestnut Hill , MA : Center for the Study of Testing, Evaluation, and Educational Policy, Boston College .
   Google Scholar
• Bennet , R.E. , Rock , D.A. and Wang , M. 1991 . Equivalence of free response and multiple‐choice items . Journal of Educational Measurement , 28 : 77 – 92 .
   Web of Science ®Google Scholar
• Bennet , R.E. and Ward , W.C. , eds. 1993 . Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessments , Hillsdale , NJ : Erlbaum .
   Google Scholar
• Birenbaum , M. and Tatsuoka , K.K. 1987 . Open‐ended versus multiple‐choice response formats ‐ it does make a difference for diagnostic assessment . Applied Psychological Measurement , 11 : 385 – 395 .
   Web of Science ®Google Scholar
• Birenbaum , M. , Tatsuoka , K.K. and Gutvirtz , Y. 1992 . Effects of response format on diagnostic assessment of scholastic achievement . Applied Psychological Measurement , 16 : 353 – 363 .
   Web of Science ®Google Scholar
• Bolger , N. and Kellaghan , T. 1990 . Method of measurement and gender differences in scholastic achievement . Journal of Educational Measurement , 27 : 165 – 174 .
   Web of Science ®Google Scholar
• Bridgeman , B. 1992 . A comparison of quantitative questions in open‐ended and multiple‐choice format . Journal of Educational Measurement , 29 : 253 – 271 .
   Web of Science ®Google Scholar
• Choppin , B.F. and Purves , A.L. 1969 . A comparison of open‐ended and multiple‐choice items dealing with literacy understanding . Research in the Teaching of English , 3 : 15 – 24 .
   Google Scholar
• Colvin , R.L. 1996 . Global study finds U.S. students weak in math . Los Angeles Times , Nov. 21 : 1
   Google Scholar
• Comber , L.C. and Keeves , J.P. 1973 . Science education in nineteen countries: An empirical study , New York : John Wiley .
   Google Scholar
• Cooley , W.W. and Leinhardt , G. 1980 . The instructional dimensions study . Educational Evaluation and Policy Analysis , 2 : 7 – 25 .
   Google Scholar
• Darling‐Hammond , L. 1994 . Performance assessment and educational equity . Harvard Educational Review , 64 : 5 – 30 .
   Web of Science ®Google Scholar
• Elley , W.B. , ed. 1992 . How in the world do students read? , The Hague , , Netherlands : International Association for the Evaluation of Educational Achievement .
   Google Scholar
• Elley , W.B. and Mangubhai , F. 1992 . Multiple‐choice and open‐ended items in reading tests: Same or different? . Studies in Educational Evaluation , 18 : 191 – 199 .
   Google Scholar
• Gipps , C.V. 1995 . “ Reliability, validity, and manageability in large‐scale assessment ” . In Evaluating authentic assessment , Edited by: Torrance , H. 105 – 123 . Buckingham , , England : Open University Press .
   Google Scholar
• Gipps , C.V. and Murphy , P. 1994 . A fair test?: Assessment, achievement, and equality. Buckingham , England : Open University Press .
   Google Scholar
• Goldstein , H. 1997 . “ International comparisons of student achievement ” . In Assessment in transition: Learning, monitoring and selection in international perspective , Edited by: Little , A. and Wolf , A. 58 – 87 . Oxford , , England : Pergamon .
   Google Scholar
• Huchison , D. and Schagen , I. , eds. 1994 . How reliable is National Curriculum Assessment , Slough , , England : NFER‐Nelson .
   Google Scholar
• IEA . 1997 . TIMSS International Database: Middle School Years 1995 Assessment: CD ROM , Chestnut Hill , MA : TIMSS International Study Center, Boston College .
   Google Scholar
• Innerst , C. 1996 . U.S. Students lag in math, science . Washington Times , Nov. 21 : 1
   Google Scholar
• Jakwerth , P.M. , Bianchi , L.J. , Houang , R.T. , Schmidt , W.H. , Valverde , G.A. , Wolfe , R.G. and Yang , W. Validity in cross‐national assessments: Pitfalls and possibilities . paper presented at the meeting of the American Educational Research Association . Chicago , IL . March .
   Google Scholar
• Kapinus , B. and Atash , N. 1995 . “ Exploring the possibilities of constructed‐response items ” . In Methodological issues in comparative educational studies , Edited by: Binkley , M. , Rust , K. and Winglee , M. 105 – 129 . Washington, DC : U.S. Department of Education, National Center for Education Statistics .
   Google Scholar
• Kellaghan , T. and Grisay , A. 1995 . “ International comparisons of student achievement: Problems and prospects ” . In Measuring what students learn , Edited by: OECD . Paris : OECD .
   Google Scholar
• Kiplinger , V.L. and Linn , R.L. 1995/1996 . Raising the stakes of test administration: The impact on student performance on the National Assessment of Educational Progress . Educational Assessment , 3 : 111 – 133 .
   Google Scholar
• Kjoemsli , M. and Jorde , D. Evaluation in science: Content or process . paper presented at the annual meeting of the American Educational Research Association . San Francisco , CA . April .
   Google Scholar
• Lally , C. 1997 . Poor literacy linked to course attendance . The Irish Times , August 31 : 8
   Google Scholar
• Lapointe , A.E. , Askew , J.M. and Mead , N.A. 1992 . Learning science , Princeton , NJ : Educational Testing Service .
   Google Scholar
• Lukhele , R. , Thissen , D. and Wainer , H. 1994 . On the relative value of multiple‐choice, constructed response and examinee selected items on two achievement tests . Journal of Educational Measurement , 31 : 234 – 250 .
   Web of Science ®Google Scholar
• Madaus , G.F. and Kellaghan , T. 1992 . “ Curriculum evaluation and assessment ” . In Handbook of curriculum research , Edited by: Jackson , P.W. New York : Macmillan .
   Google Scholar
• Madaus , G.F. and Kellaghan , T. 1993 . The British experience with authentic assessment . Phi Delta Kappan , 74 : 485 – 469 .
   Web of Science ®Google Scholar
• Martin , M.O. and Kelly , D.L. , eds. 1996 . Third International Mathematics and Science Study Technical Report Volume 1: Design and development , Chestnut Hill , MA : Center for the Study of Testing, Evaluation, and Educational Policy, Boston College .
   Google Scholar
• Martin , M.O. and Kelly , D.L. , eds. 1997 . Third International Mathematics and Science Study Technical Report Volume 2: Implementation and analysis , Chestnut Hill , MA : Center for the Study of Testing, Evaluation, and Educational Policy, Boston College .
   Google Scholar
• Messick , S. 1989 . “ Validity ” . In Educational measurement: Third edition , Edited by: Linn , R.L. 13 – 103 . New York : American Council on Education, Macmillan Publishing Company .
   Google Scholar
• Messick , S. 1993 . “ Trait equivalence as construct validity of score interpretation across multiple methods of measurement ” . In Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessments , Edited by: Bennet , R.E. and Ward , W.C. 61 – 73 . Hillsdale , NJ : Erlbaum .
   Google Scholar
• Mislevy , R.J. 1995 . What can we Ieam from international assessments . Educational Evaluation and Policy Analysis , 4 : 419 – 437 .
   Google Scholar
• Morgan , M. , Hickey , B. and Kellaghan , T. 1997 . International Adult Literacy Survey: Results for Ireland , Dublin : Stationery Office .
   Google Scholar
• OECD . 1999 . Measuring student knowledge and skills: A new framework for assessment , Paris : OECD .
   Google Scholar
• O'Leary , M. 1999 . The validity and consistency of findings from international comparative studies of student achievement: A comparison of outcomes from IAEP2 and T1MSS , Boston College : Massachusetts . unpublished doctoral dissertation
   Google Scholar
• O'Neill , H.F. , Sugrue , B. and Baker , E.L. 1995/1996 . Effects of motivational interventions on the National Assessment of Educational Progress mathematics performance . Educational Assessment , 3 : 135 – 157 .
   Google Scholar
• Perkhounkova , Y. , Hoover , H.D. and Ankemann , R.D. An examination of construct validity of multiple choice versus constructed response tests . paper presented at the meeting of the American Educational Research Association . Chicago , IL . March .
   Google Scholar
• Ramseier , E. Task difficulty and curricular priorities in Science: Analysis of typical features of the Swiss performance in TIMSS . paper presented at the annual meeting of the European Conference on Educational Research . Frankfurt , Germany.
   Google Scholar
• Robitaille , D.F. , Schmidt , W.H. , Raizen , S. , McKnight , C , Britton , E. and Nicol , C. 1993 . Curriculum frameworks for mathematics and science: TIMSS Monograph No.1 , Vancouver , Canada : Pacific Educational Press .
   Google Scholar
• Shiel , G. , Forde , P. and Morgan , M. 1996 . International studies of achievement: What do they tell us? . Oideas , 44 : 80 – 97 .
   Google Scholar
• Stedman , L.C. 1994 . Incomplete explanations: The case of U.S. performance in the international assessments of education . Educational Researcher , 23 ( 7 ) : 24 – 32 .
   Google Scholar
• Swinton , S.S. Block position effects as indirect indicators of motivation in the 1996 NAEP science assessment . paper presented at the annual meeting of the American Educational Research Association . Chicago , Il . March .
   Google Scholar
• Thissen , D. , Wainer , H. and Wang , X.B. 1994 . Are tests comprising both multiple‐choice and free‐response items necessarily less unidimensional than multiple‐choice tests: An analysis of two tests . Journal of Educational Measurement , 31 : 113 – 123 .
   Web of Science ®Google Scholar
• TIMSS . 1995 . Main Survey Test Items , Chestnut Hill , MA : TIMSS International Study Center, Boston College .
   Google Scholar
• TIMSS . 1996 . P‐value almanac for cognitive items. Science population 2: Upper grade , Chestnut Hill , MA : TIMSS International Study Center, Boston College .
   Google Scholar
• Traub , R.E. and Fisher , C.W. 1977 . On the equivalence of constructed‐response and multiple‐choice tests . Applied Psychological Measurement , 1 : 355 – 369 .
   Google Scholar
• Van den Berg , H. 1988 . Examens Geexamineerd , The Hague , , Netherlands : S.V.O .
   Google Scholar
• Vemon , P.E. 1962 . The determinants of reading comprehension . Educational and Psychological Measurement , 22 : 269 – 286 .
   Web of Science ®Google Scholar
• Winer , B.J. , Brown , D.R. and Michels , K.M. 1991 . Statistical principles in experimental design , New York : McGraw Hill .
   Google Scholar
• Winfield , L.F. 1993 . Investigating test content and curriculum content overlap to assess opportunity to learn . Journal of Negro Education , 62 : 288 – 310 .
   Google Scholar
• Wolf , R. 1977 . Achievement in America , New York : Teachers College Press .
   Google Scholar
• Wolf , R.M. 1998 . Validity issues in international assessments . International Journal of Educational Research , 29 : 491 – 501 .
   Google Scholar