Impact of adopting a newly developed blueprinting method and relating it to item analysis on students’ performance

Abstract

Background: In order to achieve validity of assessment results in the basic imaging module, an integrated assessment practice was introduced. The purpose of this article is to evaluate the impact of utilizing the created exam blueprint and relating its results to item analysis on students’ achievement of the learning objectives as reflected in their overall performance scores and satisfaction.

Methods: A simple blueprint method was created by the authors. Cross-sectional study was performed on two groups of students: one did not utilize blueprinting while the other did. Data were retrieved from the results of two questionnaires evaluating the students’ satisfaction of the course and of their perception of ILO; students’ scores; and from item analysis results. The adopted assessment practice was evaluated using the modified and expanded version of Kirkpatrick’s model.

Results: Group B results outperformed group A reflected as statistically higher students’ scores, satisfaction, perceived and actual achievement of the assessed learning outcomes, and higher psychometric indices of the exams.

Conclusion: The method adopted by using the newly developed blueprinting method and relating it to item analysis results has positive impact on the validity and reliability of students’ performance results and their satisfaction in relation to intended learning outcomes.

Acknowledgements

First and most importantly, the authors want to give their deepest thanks to their college for the constant support. Special thanks to Prof. Mahmoud Al-Ahwal, the Dean, Dr Amr Alhibshi, the Vice Dean and Hospital Director, and Prof. Yasser Bahader, the Head of Radiology Department. I am very thankful to Dr Ara Tekian and Dr Yoon Park, the instructors in the Master of medical education program, who inspired me to write this article. Finally, I want to deliver my deepest thanks to all members of the Quality and Academic Accreditation Unit, as their perfection of doing their jobs, had helped me in all aspect regarding medical education.

The publication of this supplement has been made possible with the generous financial support of the Dr Hamza Alkholi Chair for Developing Medical Education in KSA.

Declaration of interest: The authors report no declarations of interest.