Multiple choice and true/false tests: reliability measures and some implications of negative marking

References

• Angoff , WH and Schrader , WB . (1984) . A study of hypotheses basic to the use of rights and formula scores . Journal of Educational Measurement , 21 (1) : 1 – 17 .
   Web of Science ®Google Scholar
• Bereby‐Beyer , J , Meyer , J and Flascher , OM . (2002) . Prospect theory analysis of guessing in multiple choice tests . Journal of Behavioral Decision Making , 15 : 313 – 327 .
   Google Scholar
• Burton , RF . (2001a) . Quantifying the effects of chance in multiple‐choice and true/false tests: item selection and guessing of answers . Assessment & Evaluation in Higher Education , 26 (1) : 41 – 50 .
   Google Scholar
• Burton , RF . (2001b) . Do item‐discrimination indices really help us to improve our tests? . Assessment & Evaluation in Higher Education , 26 (3) : 213 – 220 .
   Google Scholar
• Burton , RF . (2002) . Misinformation, partial knowledge and guessing in true/false tests . Medical Education , 36 (9) : 805 – 811 .
   PubMed Web of Science ®Google Scholar
• Burton , RF and Miller , DJ . (1999) . Statistical modelling of multiple‐choice and true/false tests: ways of considering, and of reducing, the uncertainties attributable to guessing . Assessment & Evaluation in Higher Education , 24 (4) : 399 – 411 .
   Google Scholar
• Crocker L Algina J (1986) Introduction to classical and modern test theory (Fort Worth, TX, Harcourt Brace Jovanovich)
   Google Scholar
• Cronbach , LJ . (1951) . Coefficient alpha and the internal structure of tests . Psychometrika , 16 (3) : 297 – 334 .
   Web of Science ®Google Scholar
• Ebel , RL . (1968) . Blind guessing on objective achievement tests . Journal of Educational Measurement , 5 (4) : 321 – 325 .
   Web of Science ®Google Scholar
• Ebel RL (1979) Essentials of educational measurement (3rd edn) (Englewood Cliffs, NJ, Prentice‐Hall)
   Google Scholar
• Harden , RM , Brown , RA , Biran , LA , Dallas Ross , WP and Wakeford , RE . (1976) . Multiple choice questions: to guess or not to guess . Medical Education , 10 : 27 – 32 .
   PubMedGoogle Scholar
• Jansen , JJM , Tan , LHC , van der Vleuten , CPM , van Luijk , SJ , Rethans , JJ and Grol , RPTM . (1995) . Assessment of competence in technical clinical skills of general practitioners . Medical Education , 29 (3) : 247 – 253 .
   PubMed Web of Science ®Google Scholar
• Kuder , GF and Richardson , MW . (1937) . The theory of the estimation of test reliability . Psychometrika , 2 (3) : 151 – 160 .
   Google Scholar
• Lord , FM . (1959) . Tests of the same length do have the same standard error of measurement . Educational & Psychological Measurement , 19 (2) : 233 – 239 .
   Web of Science ®Google Scholar
• McDonald RP (1999) Test theory: a unified treatment (Mahwah, NJ, Lawrence Erlbaum Associates)
   Google Scholar
• Muijtjens , AMM , van Mameren , H , Hoogenboom , RJI , Evers , JLH and van der Vleuten , CPM . (1999) . The effect of a ‘don’t know' option on test scores: number‐right and formula scoring compared . Medical Education , 33 (4) : 267 – 275 .
   PubMed Web of Science ®Google Scholar
• Nitko AJ (1983) Educational tests and measurement. An introduction (New York, Harcourt Brace Jovanovich)
   Google Scholar
• Norcini , J . (2000) . What should we do about unreliable scores? . Medical Education , 34 (7) : 501 – 502 .
   PubMed Web of Science ®Google Scholar
• Nunnally JC Bernstein IH (1994) Psychometric theory (3rd edn) (New York, McGraw‐Hill)
   Google Scholar
• Posey , C . (1932) . Luck and examination grades . Journal of Engineering Education , 60 : 292 – 296 .
   Google Scholar
• Rees , J . (1999) . Counting the cost of international assessment: why universities may need to get a second opinion . Assessment & Evaluation in Higher Education , 24 : 427 – 438 .
   Google Scholar
• Sanderson , PH . (1973) . The ‘don’t know' option in MCQ examinations . British Journal of Medical Education , 7 : 25 – 29 .
   PubMedGoogle Scholar
• Schuwirth , LWT , van der Vleuten , CPM and Donkers , HHLM . (1996) . A closer look at cueing effects in multiple‐choice questions . Medical Education , 30 (1) : 44 – 49 .
   PubMed Web of Science ®Google Scholar
• Swineford , F . (1959) . Note on “Tests of the same length do have the same standard error measurement” . Educational & Psychological Measurement , 19 (2) : 241 – 242 .
   Web of Science ®Google Scholar