A KSA system for competency-based assessment of clinicians’ professional development in China and quality gap analysis

ABSTRACT

Background

We aim to create a holistic competency-based assessment system to measure competency evolution over time – one of the first such systems in China.

Method

Two rounds of self-reported surveys were fielded among the graduates from the Shantou University Medical College: June through December 2017, and May through August 2018. Responses from three cohorts of graduates specializing in clinical medicine – new graduates, resident physicians, and senior physicians – were analyzed. Gaps between respondents’ expected and existing levels of competencies were examined using a modified service quality model, SERVQUAL

Results

A total of 605 questionnaires were collected in 2017 for the construction of competency indicators and a 5-level proficiency rating scale, and 407 in 2018, for confirmatory factor and competency gap analysis. Reliability coefficients of all competency indicators (36) were greater than 0.9. Three competency domains were identified through exploratory factor analysis: knowledge (K), skills (S), and attitude (A). The confirmatory factor analysis confirmed the fit of the scale (CMIN/DF < 4; CFI > 0.9; IFI > 0.9; RMSEA ≤ 0.08). Within the cohorts of resident and senior physicians, the largest competency gap was seen in the domain of knowledge (K): −1.84 and −1.41, respectively. Among new graduates, the largest gap was found in the domain of skills (S) (−1.92), with the gap in knowledge (−1.91) trailing closely behind.

Conclusions

A competency-based assessment system is proposed to evaluate clinician’s competency development in three domains: knowledge (K), skills (S), and attitude (A). The system consists of 36 competency indicators, a rating scale of 5 proficiency levels, and a gap analysis to measure competency evolution through 3 key milestones in clinician’s professional career: new graduate, resident physician, and senior physician. The competency gaps identified can provide evidence-based guide to clinicians’ own continuous development as well as future medical curriculum improvements.

KEYWORDS:

• Core competency
• medical graduate
• educational assessment
• service quality model
• quality gap analysis

Acknowledgments

The authors wish to thank the support from all the respondents, the National Medical Examination Center in China, and the late Dr. Ting Long (Shantou University Medical College) who was involved in the study design as well as the creation of the questionnaire and 36 core competency indicators. The authors also appreciate the guidance and suggestions furnished by Prof. Junhui Bian (Former Dean of the Shantou University Medical College) and Mianhua Yang (Shantou University Medical College).

Disclosure statement

No potential conflict of interest was reported by the author(s).

Data availability

Data are available from the corresponding author upon reasonable request.

Additional information

Funding

This work was sponsored, guided, and assisted (for its implementation) by the National Medical Examination Center, the Ministry of Education Humanities and Social Science Project in the People’s Republic of China [17YJA880107], and the 2017 College Students’ Innovative Entrepreneurial Training Plan Program in Guangdong Province [No. 201710560108 & No. 201710560114] in the People’s Republic of China.