Challenging the arbitrary cutoff score of 60%: Standard setting evidence from preclinical Operative Dentistry course

Abstract

Introduction: This paper conducted standard setting (SS) (Angoff and Hofstee methods) to determine cutoff scores for summative examinations and to compare the derived passing levels to the existing fixed passing score of 60% in the Faculty of Dentistry at King Abdulaziz University.

Methods: Historic performance data for final examinations in preclinical Operative Dentistry course were used by four raters to conduct both Angoff and Hofstee methods to determine the cut off scores for three academic years (2012, 2013, and 2014).

Results: Both methods yielded higher than 60% cut off scores for each year. For the first examination of academic year 2012, the cutoff score was 64.75, while it was 63.5 for year 2013, and 66.75 for the last academic year of 2014. Hofstee scores were 64.5, 65.25, and 62.25 consecutively for years 2012 through 2014.

Conclusions: Using Angoff or Hofstee methods, yielded higher than the fixed 60% passing score currently used by the dental school. The use of Angoff method alone is encouraged as there were limitations to using the Hofstee method to determine the cut off score. This finding provides preliminary support to use evidence-based SS methods to determine the cutoff score for the whole Dentistry program.

Disclosure statement

The authors report no conflicts of interest. The authors alone are responsible for the content and writing of this article.

Funding

The publication of this supplement has been made possible with the generous financial support of the Dr Hamza Alkholi Chair for Developing Medical Education in KSA.

Glossary

Standard: Refers to a model, example or rule for the measure of quantity, weight, extent, value, or quality, established by authority, custom or general consent. It is also defined as a criterion, gauge or yardstick by which judgments or decisions may be made.

Criterion-referenced assessment: Refers to testing against an absolute standard such as an individual’s performance against a benchmark.

Wojtczak A. 2003. Glossary of medical education terms. AMEE Occasional Paper No 3. Dundee: AMEE.

Notes on contributors

Mohammed K. Yousef, MSD, PhD Professor of Operative Dentistry at Faculty of Dentistry at King Abdulaziz University, Jeddah, Saudi Arabia. Dr. Yousef conceptualized and designed the study, acquired and interpreted the data, drafted the initial manuscript, revised the manuscript, and approved the final manuscript.

Lana A. Alshawwa, MSD, PhD Associate Professor of Medical Education at Faculty of Medicine, at King Abdulaziz University, Jeddah, Saudi Arabia. Dr. Alshawwa conceptualized and designed the study, acquired and interpreted the data, drafted the initial manuscript, revised the manuscript, and approved the final manuscript.

Ara Tekian, PhD, MHPE Professor and Director of International Programs at the Department of Medical Education (DME) and the Associate Dean for the International Affairs at the College of Medicine, the University of Illinois at Chicago (UIC). Dr. Tekian contributed to conceptualization and revision of the manuscript.

Yoon Soo Park, PhD Assistant Professor in the Department of Medical Education at the College of Medicine, University of Illinois at Chicago. Dr. Park contributed to conceptualization and revision of the manuscript.