Construct validation of progress testing to measure knowledge and visual skills in radiology

Cecile RaveslootUniversity Medical Center Utrecht, The Netherlands; CECILE RAVESLOOT, MD, is a resident in radiology at University Medical Center (UMC) Utrecht and started with her PhD project on assessment in radiology in 2009.Correspondence[email protected]

Marieke van der SchaafUtrecht University, The Netherlands; MARIEKE VAN DER SCHAAF, PhD, is an Assistant Professor at the Department of Pedagogical and Educational Sciences, Utrecht University, the Netherlands. She has been involved in Educational Sciences as a lecturer and a researcher for more than a decade. Her main areas of research are assessment, feedback, reflection, and professionalism.

Cees HaaringUniversity Medical Center Utrecht, The Netherlands; CEES HAARING started his career in healthcare in 1972 at the UMC Utrecht and worked as Radiologic Technologist (1972–1980), Nuclear Medicine Head Technologist (1980–1990), Administrator Radiology Department (1990–1993), Research Assistant (1993–1996), and as IT-Specialist at the Research Office Radiology from 1996 until now.

Cas KruitwagenUniversity Medical Center Utrecht, The Netherlands; CAS KRUITWAGEN, PhD, is a registered biostatistican and has taught biostatistics courses for almost 20 years for students in biomedical disciplines, at Utrecht University, and later at UMC Utrecht. He coordinates the statistics educational activities of the Julius Center of UMC Utrecht and is member of the examination committee of the Clinical Health Science program.

Erik BeekUniversity Medical Center Utrecht, The Netherlands; ERIK BEEK, MD, completed residency in radiology in 1989 and worked since then at the department of radiology of UMC Utrecht with a subspecialization in pediatric radiology. He was president of the Educational Committee of the Dutch Radiological Society.

Olle Ten CateUniversity Medical Center Utrecht, The Netherlands; OLLE TEN CATE, PhD, is a Professor of Medical Education and Director of the Center for Research and Development of Education, UMC Utrecht.

Jan van SchaikUniversity Medical Center Utrecht, The Netherlands; JAN VAN SCHAIK, MD, PhD, is a Professor of Radiology and Residency Program Director at the University of Utrecht Medical Center, the Netherlands. His main interests are in radiology education at both the undergraduate and graduate levels.

show all

Abstract

Background: The Dutch Radiology Progress Test (DRPT) monitors the acquisition of knowledge and visual skills of radiology residents in the Netherlands.

Aim: We aimed to evaluate the quality of progress testing in postgraduate radiology training by studying the reliability of the DRPT and finding an indication for its construct validity. We expected that knowledge would increase rapidly in the first years of residency, leveling-off in later years, to allow for the development of visual skills. We hypothesized that scores on the DRPT reflect this pattern.

Methods: Internal consistencies were estimated with Cronbach's alpha. Performance increase over program years were tested using one-way analysis of variance.

Results: Data were available for 498 residents (2281 test results). Reliabilities were around Cronbach's alpha 0.90. There was a significant difference in the mean test results between the first three years of residency. After the fourth year no significant increase in test scores on knowledge could be measured on eight tests. The same pattern occurred for scores on visual skills. However, visual skills scores tend to increase more sharply than knowledge scores.

Conclusion: We found support for the reliability and construct validity of the DRPT. However, assessment on visual skill development needs further exploration.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Order Reprints Request Corporate Permissions

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

Request Academic Permissions

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.

Construct validation of progress testing to measure knowledge and visual skills in radiology

Information for

Open access

Opportunities

Help and information

Construct validation of progress testing to measure knowledge and visual skills in radiology

Abstract

Reprints and Corporate Permissions

Academic Permissions

Related research

To cite this article:

Download citation

Information for

Open access

Opportunities

Help and information

Keep up to date

Your download is now in progress and you may close this window

Login or register to access this feature