Some Effects of Changes in Question Structure and Sequence on Performance in a Multiple Choice Chemistry Test

REFERENCES

• Ace , M.G. and Dawis , R.V. 1973 . Item structure as a determinant of item difficulty in verbal analogies . Educational and Psychological Measurement , 30 : 353 – 358 .
   Google Scholar
• Asmus , E.P. 1981 . The effect of altering the number of choices per item on test statistics . Bulletin of the Council for Research in Music Education , 65 : 1 – 15 .
   Google Scholar
• Atwell , C.R. and Wells , F.L. 1937 . Wide range multiple choice vocabulary tests . Journal of Applied Psychology , 21 : 550 – 555 .
   Google Scholar
• Berger , V.F. , Munz , D.C. , Smouse , A.D. and Angelino , H. 1969 . The effects of item difficulty sequencing and anxiety reaction type on aptitude test performance . Journal of Psychology , 71 : 253 – 258 .
   PubMed Web of Science ®Google Scholar
• Brenner , M.H. 1964 . Test difficulty, reliability and discrimination as functions of item difficulty order . Journal of Applied Psychology , 48 : 98 – 100 .
   Web of Science ®Google Scholar
• Carter , H. 1942 . How reliable are the common measures of difficulty and validity of objective test items? . Journal of Psychology , 13 : 31
   Google Scholar
• Clarke , E.L. 1956 . General response pattern to five‐choice items . Journal of Educational Psychology , 47 : 110 – 117 .
   Google Scholar
• Costin , F. 1970 . The optimal number of alternatives in multiple‐choice achievement tests: some empirical evidence for a mathematical proof . Educational and Psychological Measurement , 30 : 353 – 358 .
   Web of Science ®Google Scholar
• Cronbach , L.J. 1941 . An experimental comparison of the multiple true‐false and multiple multiple‐choice tests . Journal of Educational Psychology , 32 : 533 – 543 .
   Google Scholar
• Cronbach , L.J. 1946 . Response sets and test validity . Educational and Psychological Measurement , 6 : 475 – 494 .
   Web of Science ®Google Scholar
• Cronbach , L.J. 1950 . Further evidence on response sets and test design . Educational and Psychological Measurement , 10 : 3 – 31 .
   Web of Science ®Google Scholar
• Cronbach , L.J. 1960 . Essentials of Psychological Testing , New York : Harper & Row .
   Google Scholar
• Davis , F.B. 1951 . “ Item selection techniques ” . In Educational Measurement , Edited by: Lindquist , E.F. 226 – 328 . Washington, DC : American Council on Education .
   Google Scholar
• Ebel , R.L. 1969 . Expected reliability as a function of choices per item . Educational and Psychological Measurement , 29 : 565 – 570 .
   Google Scholar
• Ebel , R.L. 1972 . Essentials of Educational Measurement , Englewood Cliffs : Prentice‐Hall .
   Google Scholar
• Ebel , R.L. and Williams , B.G. 1957 . “ The effect of varying the number of alternatives per item on multiple‐choice vocabulary test items ” . In Fourteenth Yearbook of the National Council on Measurement used in Education , 63 – 65 . East Lancing : Michigan State University .
   Google Scholar
• Friel , S. and Johnstone , A.H. 1979 . Does the position matter? . Education in Chemistry , 16 : 175
   Google Scholar
• Gaier , E.L. , Lee , M.C. and McQuitty , L.L. 1953 . Response patterns in a test of logical inference . Educational and Psychological Measurement , 13 : 550 – 556 .
   Google Scholar
• Gerberich , J.R. , Greene , H.A. and Jorgenson , A.S. 1962 . Measurement and Evaluation in the Modem School , New York : David Mackay .
   Google Scholar
• Gibbons , C.C. 1940 . The predictive value of the most valid items of an examination . Journal of Educational Psychology , 31 : 616 – 621 .
   Google Scholar
• Guilford , J.P. 1964 . Psychometric Methods , New York : McGraw‐Hill .
   Google Scholar
• Hopkins , K.D. and Hopkins , B.R. 1964 . Intra‐individual and inter‐individual positional preference response styles in ability tests . Educational and Psychological Measurement , 24 : 801 – 805 .
   Google Scholar
• Huck , S.W. and Bowers , W.D. 1972 . Item difficulty level and sequence effects in multiple‐choice achievement tests . Journal of Educational Measurement , 9 : 105 – 111 .
   Web of Science ®Google Scholar
• Jessel , J.C. and Sullins , W.L. 1975 . The effect of keyed response sequencing of multiple choice items on performance and reliability . Journal of Educational Measurement , 12 : 45 – 48 .
   Web of Science ®Google Scholar
• Lord , F.M. 1977 . Optimal number of choices per item‐‐a comparison of four approaches . Journal of Educational Measurement , 14 : 33 – 38 .
   Web of Science ®Google Scholar
• Marso , R.N. 1970 . Test item arrangement, testing time and performance . Journal of Educational Measurement , 7 : 113 – 118 .
   Web of Science ®Google Scholar
• Marcus , A. 1963 . The effect of correct response location on the difficulty level of multiple‐choice questions . Journal of Applied Psychology , 47 : 48 – 51 .
   Web of Science ®Google Scholar
• McNamara , W.J. and Weitzman , E. 1945 . The effect of choice placement on the difficulty of multiple‐choice questions . Journal of Educational Psychology , 36 : 103 – 113 .
   Google Scholar
• Metfessel , M.S. and Sax , G. 1958 . Systematic biases in the keying of correct responses on certain standardized tests . Educational and Psychological Measurement , 18 : 787 – 790 .
   Web of Science ®Google Scholar
• Monk , J.J. and Stallings , W.M. 1970 . Effects of item order on test score . Journal of Educational Research , 63 : 463 – 465 .
   Web of Science ®Google Scholar
• Munz , D.C. and Jacobs , P.D. 1971 . An evaluation of perceived item‐difficulty sequencing in academic testing . British Journal of Educational Psychology , 41 : 195 – 205 .
   Google Scholar
• Munz , D.C. and Smouse , A.D. 1968 . Interaction effects of item‐difficulty sequence and achievement‐anxiety reaction on academic performance . Journal of Educational Psychology , 59 : 370 – 374 .
   PubMed Web of Science ®Google Scholar
• Myers , C.T. 1962 . The relationship between item difficulty and test validity and reliability . Educational and Psychological Measurement , 22 : 565 – 571 .
   Google Scholar
• Noll , V.H. , Scannell , D.P. and Craig , R.C. 1979 . Introduction to Educational Measurement , Boston : Houghton Mifflin .
   Google Scholar
• Plake , B.S. , Ansorge , C.J. , Parker , C.S. and Lowry , S.R. 1982 . Effects of item arrangement, knowledge of arrangement, test anxiety and sex on test performance . Journal of Educational Measurement , 19 : 49 – 57 .
   Web of Science ®Google Scholar
• Ramos , R.A. and Stern , J. 1973 . Item behaviour associated with changes in the number of alternatives in multiple choice items . Journal of Educational Measurement , 10 : 305 – 310 .
   Google Scholar
• Rapaport , G.M. and Berg , I.A. 1955 . Response sets in a multiple‐choice test . Educational and Psychological Measurement , 15 : 58 – 62 .
   Web of Science ®Google Scholar
• Rorer , L.G. 1965 . The great response‐style myth . Psychological Bulletin , 63 : 129 – 156 .
   PubMed Web of Science ®Google Scholar
• Sax , G. and Carr , A. 1962 . An investigation of response sets on altered parallel forms . Educational and Psychological Measurement , 22 : 371 – 376 .
   Web of Science ®Google Scholar
• Sax , G. and Cromack , T.R. 1966 . The effects of various forms of item arrangements on test performance . Journal of Educational Measurement , 2 : 309 – 311 .
   Google Scholar
• Thorndike , R.L. and Hagen , E.P. 1955 . Measurement and Evaluation in Psychology and Education , New York : Wiley .
   Google Scholar
• Tversky , A. 1964 . On the optimal number of alternatives at a choice point . Journal of Mathematical Psychology , 1 : 386 – 391 .
   Web of Science ®Google Scholar
• Wilbur , P.H. 1970 . Positional response set among high school students on multiple‐choice tests . Journal of Educational Measurement , 7 : 161 – 163 .
   Google Scholar
• Zimmerman , W.S. and Humphreys , L.G. 1953 . Item reliability as a function of the omission of misleads . American Psychologist , 8 : 460 – 461 .
   Google Scholar