Using the Objective Borderline Method (OBM) to support Board of Examiners’ decisions in a medical programme

References

• Abramson, H. J. 1988. Making Sense of Data. Oxford: Oxford University Press.
   Google Scholar
• Arulampalam, W., R. Naylor, and J. Smith. 2003. A Hazard Model of the Probability of Medical School Dropout in the United Kingdom. Coventry, England: University of Warwick, Department of Economics.
   Google Scholar
• Ben-David, M. 2000. “AMEE Guide No. 18: Standard Setting in Student Assessment.” Medical Teacher 22 (2): 120–130.10.1080/01421590078526
   Web of Science ®Google Scholar
• Berk, R. A. 1996. “Standard Setting: The Next Generation (Where Few Psychometricians Have Gone before!).” Applied Measurement in Education 9 (3): 215–225.10.1207/s15324818ame0903_2
   Web of Science ®Google Scholar
• Blakely, T., and C. Salmond. 2002. “Probabilistic Record Linkage and a Method to Calculate the Positive Predictive Value.” International Journal of Epidemiology 31 (6): 1246–1252.10.1093/ije/31.6.1246
   PubMed Web of Science ®Google Scholar
• Chang, L., C. Dziuban, M. Hynes, and A. Olson. 1996. “Does a Standard Reflect Minimal Competency of Examinees or Judge Competency?” Applied Measurement in Education 9 (2): 161.10.1207/s15324818ame0902_5
   Web of Science ®Google Scholar
• Chu, K. 1999. “An Introduction to Sensitivity, Specificity, Predictive Values and Likelihood Ratios.” Emergency Medicine Australasia 11 (3): 175–181.10.1046/j.1442-2026.1999.00041.x
   Google Scholar
• Cizek, G. 1993. “Reconsidering Standards and Criteria.” Journal of Educational Measurement 30 (2): 93–106.10.1111/jedm.1993.30.issue-2
   Web of Science ®Google Scholar
• Cizek, G. 2012a. “Defining and Distinguishing Validity: Interpretations of Score Meaning and Justifications of Test Use.” Psychological Methods 17 (1): 31–43.10.1037/a0026975
   PubMed Web of Science ®Google Scholar
• Cizek, G. 2012b. Setting Performance Standards: Foundations, Methods, and Innovations. London: Routledge.
   Google Scholar
• Cizek, G., and M. Bunch. 2007. Standard Setting: A Guide to Establishing and Evaluating Performance Standards on Tests. London: Sage Pubns.
   Google Scholar
• Cortina, J. 1993. “What is Coefficient Alpha? An Examination of Theory and Applications.” Journal of Applied Psychology 78 (1): 98–104.10.1037/0021-9010.78.1.98
   Web of Science ®Google Scholar
• Cronbach, L. J. 1951. “Coefficient Alpha and the Internal Structure of Tests.” Psychometrika 16 (3): 297–334.10.1007/BF02310555
   Web of Science ®Google Scholar
• Downing, S., A. Tekian, and R. Yudkowsky. 2006. “RESEARCH METHODOLOGY: Procedures for Establishing Defensible Absolute Passing Scores on Performance Examinations in Health Professions Education.” Teaching and Learning in Medicine 18 (1): 50–57.10.1207/s15328015tlm1801_11
   PubMed Web of Science ®Google Scholar
• George, S., S. Haque, and F. Oyebode. 2006. “Standard Setting: Comparison of Two Methods.” BMC Medical Education 6 (1): 46.10.1186/1472-6920-6-46
   PubMedGoogle Scholar
• Grindle, C. 2009. An Analysis of Court Cases Involving Student Due Process in Dismissal from Higher Education. Tuscaloosa, Alabama: The University of Alabama.
   Google Scholar
• Hattie, J. 1985. “Methodology Review: Assessing Unidimensionality of Tests and Ltenls.” Applied Psychological Measurement 9 (2): 139–164.10.1177/014662168500900204
   Web of Science ®Google Scholar
• Hays, R., T. Sen Gupta, and J. Veitch. 2008. “The Practical Value of the Standard Error of Measurement in Borderline Pass/Fail Decisions.” Medical Education 42: 810–815.10.1111/med.2008.42.issue-8
   PubMed Web of Science ®Google Scholar
• Kane, M. 2013. “So Much Remains the Same: Conception and Status of Validation in Setting Standards.” In Standard Setting: Concepts, Methods, and Perspectives, edited by G. Cizek, 53–88. London: Routledge.
   Google Scholar
• Karantonis, A., and S. G. Sireci. 2006. “The Bookmark Standard-Setting Method: A Literature Review.” Educational Measurement: Issues and Practice 25 (1): 4–12.10.1111/j.1745-3992.2006.00047.x
   Google Scholar
• Kellett, A. 2011. 2012 Calendar. Auckland: University of Auckland.
   Google Scholar
• Kolen, M., and R. L. Brennan. 2004. “Item Response Theory Methods.” In Test Equating, Scaling, and Linking, 155–230. New York, NY: Springer.
   Google Scholar
• van der Linden, W., and R. Hambleton. 1996. Handbook of Modern Item Response Theory. New York: Springer.
   Google Scholar
• Martin, I. G., and B. Jolly. 2002. “Predictive Validity and Estimated Cut Score of an Objective Structured Clinical Examination (OSCE) Used as an Assessment of Clinical Skills at the End of the First Clinical Year.” Medical Education 36 (5): 418–425.10.1046/j.1365-2923.2002.01207.x
   PubMed Web of Science ®Google Scholar
• Norcini, J., J. Shea, and D. T. Kanya. 1988. “The Effect of Various Factors on Standard Setting.” Journal of Educational Measurement 25 (1): 57–65.10.1111/jedm.1988.25.issue-1
   Web of Science ®Google Scholar
• Pant, H., A. Rupp, S. Tiffin-Richards, and O. Köller. 2009. “Validity Issues in Standard-Setting Studies.” Studies in Educational Evaluation 35 (2-3): 95–101.10.1016/j.stueduc.2009.10.008
   Google Scholar
• Pitman, J. 1993. Probability. New York: Springer.10.1007/978-1-4612-4374-8
   Google Scholar
• Poole, P., B. Shulruf, J. Rudland, and T. Wilkinson. 2012. “Comparison of UMAT and Admission GPA on the Prediction of Performance on Medical School Assessments: A National, Cross-Institution Study.” Medical Education 46: 163–171.10.1111/med.2012.46.issue-2
   PubMed Web of Science ®Google Scholar
• Rendel, S., P. Foreman, and A. Freeman. 2014. “Licensing Exams and Judicial Review: The Closing of One Door and Opening of Others?” British Journal of General Practice 65 (630): 8–9.
   Web of Science ®Google Scholar
• Rosner, B. 2006. Fundamentals of Biostatistics. Boston, MA: Duxbury Pr.
   Google Scholar
• Schuwirth, L., and C. van der Vleuten. 2012. “Programmatic Assessment and Kane’s Validity Perspective.” Medical Education 46 (1): 38–48.10.1111/med.2011.46.issue-1
   PubMed Web of Science ®Google Scholar
• Shulruf, B. 2011. “Do Extra-Curricular Activities in Schools Improve Educational Outcomes? A Critical Review and Meta-Analysis of the Literature.” International Review of Education 56: 591–612.
   Google Scholar
• Shulruf, B., R. Turner, P. Poole, and T. Wilkinson. 2013. “The Objective Borderline Method (OBM): a Probability-Based Model for Setting up an Objective Pass/Fail Cut-off Score for Borderline Grades in Medical Education Programmes.” Advances in Health Sciences Education 18 (2): 231–244.10.1007/s10459-012-9367-y
   PubMed Web of Science ®Google Scholar
• Skorupski, W. 2012. “Understanding the Cognitive Processes of Standard Setting Panelists.” In Setting Performance Standards: Foundations, Mathods, and Innovations, edited by M. J. Zieky, 135–147. London: Routledge.
   Google Scholar
• Wayne, D. B., J. H. Barsuk, E. Cohen, and W. C. McGaghie. 2007. “Do Baseline Data Influence Standard Setting for a Clinical Skills Examination?” Academic Medicine 82 (Suppl): S105–S108. doi:10.1097/ACM.0b013e318141f464.
   Google Scholar
• W. H. O. 2005. Training Modules for Teaching of Public Health in Medical Schools in South-East Asia Region. Bangkok: World Health Organization.
   Google Scholar
• Yudkowsky, R., S. Tumuluru, P. Casey, N. Herlich, and C. Ledonne. 2014. “A Patient Safety Approach to Setting Pass/Fail Standards for Basic Procedural Skills Checklists.” Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare 9 (5): 277–282.10.1097/SIH.0000000000000044
   Web of Science ®Google Scholar