Advanced search
Publication Cover
Medical Teacher Volume 27, 2005 - Issue 1
Submit an article Journal homepage
85
Views
3
CrossRef citations to date
0
Altmetric
Original Article

Ensuring reliability in UK written tests of general practice: the MRCGP examination 1998–2003

Neil Munro Panel of Examiners, MRCGP ExaminationCorrespondence[email protected]
,
Mei Ling Denney Panel of Examiners, MRCGP Examination
,
Amar Rughani Panel of Examiners, MRCGP Examination
,
John Foulkes Panel of Examiners, MRCGP Examination
,
Andrew Wilson Panel of Examiners, MRCGP Examination
&
Peter Tate Panel of Examiners, MRCGP Examination
Pages 37-45 | Published online: 03 Jul 2009

  • BARNETT, R. (1989) How Shall We Assess Them?, Information Services, Discussion Paper 1 (London, Council for National Academic Awards)
  • BELTON, A. (1986) How to increase your trainee pass rate in the MRCGP examination, Journal of the Association of Course Organizers, 2, pp. 56–64. BFaucowtrz, D., Woucowrrz, B., Frrot, R. & KOPIUVA, R. (2000) The Use of Tests as Part of high-Stakes Decision for Students: A Resources Guide for Educators and Policy-Makers (Washington, DC, US Department of Education).
  • BIGGS, J. (1999) Teaching for Quality at University (Buckingham, SRHE/ Open University Press).
  • BLOOM, B.S. (1956) Taxonomy of Educational Objectives: Handbook 1, Cognitive Domain (New York, D. Mckay).
  • BRADDOCK, R., LLOYD-JONES, R. & SCHOER, L. (1963) Research in Written Composition (Urbana, IL, National Council of Teachers of English). BRENNAN, R.L. (1983) Elements of Generalisability Theory (Iowa, ACT Publications).
  • CHASE, C.I. (1986) The impact of some obvious variables on essay test scores, Journal of Educational Measurement, 23, pp. 33–42.
  • CRONBACH, L.J. (1951) Co-efficient alpha and the internal structure of tests, Psychometrika, 16, pp. 292–334.
  • CROSSLEY, J., DAVIES, H., HUMPHIUS, G. & JOLLY, B. (2002) Generalisability: a key to unlock professional assessment, Medical Education, 36, pp. 972–978.
  • FELDT, L.S. & BRENNAN, R.L. (1989) Reliability, in: R.L. Litvx (Ed.) Educational Measurement, 3rd edn (Washington, DC, American Council on Education/Macmillan Series on Higher Education).
  • FoRstw, M. & MASTERS, G. (1996) Portfolios (Victoria, AustralianCouncil for Educational Research).
  • FRENCH, J.W. (1966) Schools of thought in judging excellence of English themes, in: A. ANASTASI (Ed.) Testing Problems in Perspective (Washington, DC, American Council on Education). P.H.A.M., VAN DER VLEuTEN, C.P.M., VERWIJNEN, G.M. & VAN T .FAUWEN, T.D. (1990) The effect of structure in scoring methods on the reproducibility of tests using open ended questions, in: W. BENDER, R.J. flinms-ntA, A.J.J.A. SCHERMER & RP. ZWIERSTRA (Eds) Teaching and Assessing Clinical Competence (Amsterdam, Boekwerk), pp. 466–471.
  • FRY, J., FAWLEY, J.H., PiNsENT, R.J.F.H. (Eds) (1983) A History of the Royal College of General Practitioners: the First 25 Years (Lancaster, MTP Press).
  • GORMAN, T.P., WHITE, J., ORCHARD, L. et al. (1983) Language Performance in School: Secondary Survey Report No 2 (London, HMSO).
  • GREEN, J.A. (1975) Teacher Made Tests, 2nd edn (London, Harper & Row).
  • HAkroG, P. & RHODES, E.G. (1936) The Marks of Examiners (London, Macmillan).
  • HYLAND, T. (1994) Competence, Education and NVQs: Dissenting Perspectives (London, Cassell Education).
  • JOLLY, B. (2000) "The Professor has submitted her questions and thus we may proceed to set the examination paper," Medical Education, 34, pp. 7–8.
  • KUISMA, R. (1999) Criteria referenced marking of written assignments, Assessment & Evaluation in Higher Education, 24, p. 27.
  • LADucA, A. (1994) Validation of professional licensure examinations: professions theory, test design, and construct validation, Evaluation and the Health Professions, 17, pp. 178–197.
  • MACNAMARA, J. & MADAUS, G.F. (1969) Marker reliability in the Irish leaving certificate, Irish journal of Education, 3, pp. 15–21.
  • MARSH, H.W. & IRELAND, R. (1987) The assessment of writing effectiveness: a multidimensional perspective, Australian Journal of Psychology, 39, pp. 353–367.
  • MYTCHELMORE, M.G. (1981) Reporting student achievement: how many grades?, British Journal of Educational Psychology, 51, pp. 218–227. MULHOLLAND, H. & MCALEER, S. (1988) Report to the Examination Board of the Royal College of General Practitioners. Dundee, Centre for Medical Education, unpublished.
  • MUNRO, N., RUGHANI, A., FOULKES, J., WILSON, A. & NEIGHBOUR, R. (2000) Assessing validity in written tests of general practice: exploration by factor analysis of candidate response patterns to paper 1 of the MRCGP examination, Medical Education, 34, pp. 35–41.
  • MURPHY, R.J.L. (1978) Reliability of marking in eight GCE examinations, British Journal of Education and Psychology, 48, pp. 196 200-44
  • MURPHY, R.J.L. (1982) A further report into the reliability of marking of GCE examinations, British Journal of Educational Psychology, 52, pp. 58–63.
  • NEWBLE, D.L. & EmrwisTLE, N.J. (1986) Learning styles and approaches: implications for medical education, Medical Education, 20, pp. 162–175.
  • NoRom, J.J., SWANSON, D.B., GROSSO, L.J. et al. (1985) Reliability, validity and efficiency of various item formats in assessment of physician competence, Medical Education, 19, pp. 238–247.
  • Nur:TALL, D.L. & WILLmoTT, A.S. (1972) British Examinations: Techniques of Analysis P12 (Slough, NFER Publishing).
  • PILLINER, A.E.G. (1969) Estimation of number of grades to be awarded in one examination by consideration of its reliability coefficient, internal research paper, Godfrey Thompson Unit, Edinburgh.
  • RAFOTH, B.A. & RuBsr, D.L. (1984) The impact of content and mechanics on judgments of writing quality, Written communication, 1, pp. 446–458. SouTHGAIR, L. & GRANT, J. (2003) Principles and standards for an assessment system for postgraduate medical training, Joint Statement by Postgraduate Medical Education and Training Board and Academy of the Medical Royal Colleges.
  • SWANSON, D.B. (1987) Review of membership examination procedures of the Royal College of General Practitioners, unpublished.
  • The General and Specialist Medical Practice (Education, Training and Qualifications) Order 2003, Statutory Instrument 2003 No. 1250.
  • VAN DER VLEUTEN, C.P.M. (1996) The assessment of professional competence: developments, research and practical implications, Advances in Health Science Education, 1, pp. 41–67.
  • VERMA, M., CHANTwAL, J. & SINGH, T. (1997) Reliability of essay type questions—effect of structuring, Assessment in Education, 4, pp. 265-270. WASS, V., MCGIBBON, D. & VAN DER VLEUTEN, C. (2001) Composite undergraduate examinations: how should components be combined to maximize reliability?, Medical Education, 35, pp. 326–330.
  • WwLmoTT, A.S. & NuaTALL, D.L. (1975) The reliability of examinations at 16+ (London, Macmillan Education Ltd).
  • WOOD, R. (1991) Assessment & Testing: A Survey of Research (Cambridge, Cambridge University Press), pp. 144–145.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.