A Predictive and Construct Validity Study of a High-Stakes Objective Clinical Examination for Assessing the Clinical Competence of International Medical Graduates

REFERENCES

• Harden , R and Gleeson , F . 1979 . Assessment of clinical competence using an objective structured clinical examination (OSCE) . Medical Education , 13 : 41 – 54 .
   PubMed Web of Science ®Google Scholar
• Newble , D . 2004 . Techniques for measuring clinical competence: objective structured clinical examinations . Medical Education , 38 : 199 – 203 .
   PubMed Web of Science ®Google Scholar
• Wass , V , van der Vleuten , C , Shatzer , J and Jones , R . 2001 . Assessment of clinical competence . Lancet , 357 : 945 – 9 .
   PubMed Web of Science ®Google Scholar
• Harden , R , Stevenson , M , Wilson Downie , W and Wilson , G . 1975 . Assessment of clinical competence using objective structure examination . British Medical Journal , 1 : 447 – 51 .
   PubMed Web of Science ®Google Scholar
• Carraccio , C and Englander , R . 2000 . The Objective Structured Clinical Examination: A step in the direction of competency-based evaluation . Archives of Pediatric and Adolescent Medicine , 154 : 736 – 41 .
   PubMed Web of Science ®Google Scholar
• Mavis , B and Henry , R . 2002 . Between a rock and a hard place: Finding a place for the OSCE in medical education . Medical Education , 36 : 408 – 9 .
   PubMed Web of Science ®Google Scholar
• Cronbach , L. 1984 . Essentials of psychological testing , 4th ed. , San Francisco , CA : Harper & Row .
   Google Scholar
• Cronbach , L , Gleser , G , Nanda , H and Rajaratnam , N . 1972 . The dependability of behavioral measurements: Theory of generalizability for scores and profiles. , New York , NY : Wiley .
   Google Scholar
• Shea , J and Fortna , G . 2002 . “ Psychometric methods ” . In International handbook of research in medical education , Edited by: Norman , G. , Van der Vleuten , C. and Newble , D. 97 – 126 . Dordrecht , , the Netherlands : Kluwer Academic .
   Google Scholar
• Cronbach , L and Meehl , P . 1955 . Construct validity in psychological tests . Psychological Bulletin , 52 : 281 – 302 .
   PubMed Web of Science ®Google Scholar
• Thomas , J , Nelson , J and Silverman , S . 2005 . Research methods in physical activity , 5th ed. , Champaign , IL : Human Kinetics .
   Google Scholar
• Downing , S and Haladyn , T . 2004 . Validity threats: Overcoming interference with proposed interpretations of assessment data . Medical Education , 38 : 327 – 33 .
   PubMed Web of Science ®Google Scholar
• Bridge , P , Musial , J , Frank , R , Roe , T and Sawilowsky , S . 2003 . Measurement practices: methods for developing content-valid student examinations . Medical Teacher , 25 : 414 – 21 .
   PubMed Web of Science ®Google Scholar
• Hopkins , K , Stanley , J and Hopkins , B . 1990 . Educational and psychological measurement and evaluation , 7th ed. , Englewood Cliffs , NJ : Prentice-Hall .
   Google Scholar
• Patricio , M , Juliao , M , Fareleira , F , Young , M , Norman , G and Vaz Carneiro , A . 2009 . A comprehensive checklist for reporting the use of OSCEs . Medical Teacher , 31 : 112 – 24 .
   PubMed Web of Science ®Google Scholar
• Wilkinson , T and Frampton , C . 2004 . Comprehensive undergraduate medical assessments improve prediction of clinical performance . Medical Education , 38 : 1111 – 6 .
   PubMed Web of Science ®Google Scholar
• Martin , I and Jolly , B . 2002 . Predictive validity and estimated cut score of an objective structured clinical examination (OSCE) used as an assessment of clinical skills at the end of the first clinical year . Medical Education , 36 : 418 – 25 .
   PubMed Web of Science ®Google Scholar
• Simon , S , Volkan , K , Hamann , C , Duffey , C and Fletcher , S . 2002 . The relationship between second-year medical students’ OSCE scores and USMLE Step 1 scores . Medical Teacher , 24 : 535 – 9 .
   PubMed Web of Science ®Google Scholar
• Park , R , Chibnall , J , Blaskiewicz , R , Furman , G , Powell , J and Mohr , C . 2004 . Construct validity of an objective structured clinical examination (OSCE) in psychiatry: Associations with the clinical skills examination and other indicators . Academic Psychiatry , 28 : 122 – 8 .
   PubMed Web of Science ®Google Scholar
• Baig , L , Violato , C and Crutcher , R . 2010 . A construct validity study of clinical competence: A mulittrait mulitmethod matrix approach . Journal of Continuing Education in the Health Professions , 30 : 19 – 25 .
   PubMed Web of Science ®Google Scholar
• Boulet , J , McKinley , D , Whelan , G and Hambleton , R . 2003 . Quality assurance methods for performance-based assessments . Advances in Health Science Education , 8 : 27 – 47 .
   PubMed Web of Science ®Google Scholar
• Violato , C and Baig , L. Psychometric Report of the Western Alliance for Assessment of International Physicians Project (p. 68), University of Calgary .
   Google Scholar
• 2011 . Evaluating Examination , Ottawa : Medical Council of Canada . Available at: http://mcc.ca/en/exams/ee/. Accessed December 29, 2010
   Google Scholar
• 2011 . Evaluating Examination , Ottawa : Medical Council of Canada . Available at: http://mcc.ca/en/exams/qe1/. Accessed December 29, 2010
   Google Scholar
• 2011 . Evaluating Examination , Ottawa : Medical Council of Canada . Available at: http://mcc.ca/en/exams/qe2/. Accessed December 29, 2010
   Google Scholar
• Downing , S . 2004 . Reliability: On the reproducibility of assessment data. . Medical Education , 38 : 1006 – 12 .
   PubMed Web of Science ®Google Scholar
• van der Vleuten , C and Swanson , D . 1990 . Assessment of clinical skills with standardized patients: State of the art . Teaching and Learning in Medicine , 2 : 58 – 76.2 .
   Google Scholar
• Cohen , R , Rothman , A , Poldre , P and Ross , J . 1991 . Validity and generalizability of global ratings in an Objective Structured Clinical Examination . Academic Medicine , 66 : 545 – 8 .
   PubMed Web of Science ®Google Scholar
• Cunnington , J , Neville , A and Norman , G . 1997 . The risks of thoroughness: Reliability and validity of global ratings and checklists in an OSCE . Advances in Health Sciences Education , 1 : 227 – 33 .
   Web of Science ®Google Scholar
• Reznick , R , Regehr , G , Yee , G , Rothman , A , Blackmore , D and Dauphinee , D . 1998 . High-stakes examinations: What do we know about measurement? Process-rating forms versus task-specific checklists in OSCE for medical licensure . Academic Medicine , 73 ( 10, Suppl. ) : S97 – S9 .
   Web of Science ®Google Scholar
• Norman , G , van der Vleuten , C and De Graaff , E . 1991 . Pitfalls in the pursuit of objectivity: Issues of validity, efficiency and acceptability . Medical Education , 25 : 119 – 26 .
   PubMed Web of Science ®Google Scholar
• Vallevand , A. 2008 . Reliability, validity and sources of errors in assessing physician performance in an Objective Structured Clinical Examination: A generalizability theory analysis , Calgary , , Canada : University of Calgary .
   Google Scholar
• Petrusa , E , Blackwell , T and Ainsworth , M . 1990 . Reliability and validity of an objective structured clinical examination for assessing clinical performance of residents . Archives of Internal Medicine , 150 : 573 – 7 .
   PubMed Web of Science ®Google Scholar