Evaluation of Educational Workshops for Family Medicine Residents Using the Kirkpatrick Framework

Figures & data

Figure 1a Continued.

Figure 1b Workshop hands-on training on minor office procedures; (A) neonatal circumcision model; (B) incision and drainage of superficial abscess; (C) suture and laceration repair; (D) applying below knee cast to simulated patient.

Table 1 Overall Perception and Impact of the Workshop (Kirkpatrick; Reaction)

Perception	Mean	SD
The workshop information was available before you commenced the program.	4.43	0.813
The workshop registration process was convenient.	4.73	0.506
I understood the learning objectives.	4.63	0.586
I was able to relate each of the learning objectives for the learning I achieved.	4.48	0.599
I felt that the workshop materials will be essential for my success.	4.43	0.747
Generally, the instructors were adequate to facilitate the educational process.	4.50	0.641
My learning was enhanced by the knowledge of the facilitator.	4.60	0.709
My learning was enhanced by the experiences shared by the facilitator.	4.50	0.599
It was easy for me to get actively involved during the workshop sessions.	4.58	0.594
I was given ample opportunity to practice the skills I am asked to learn.	4.53	0.599
I was given ample opportunity to demonstrate my skills.	4.53	0.599
I will be able to immediately apply what I learned.	4.28	0.751
I was comfortable with the duration of the session.	3.90	1.057
The educational environment, including the venue and classrooms, were comfortable and convenient.	4.43	0.844
The audio-visual facilities effectively facilitated the educational process.	4.48	0.716
There were minimal distractions during the workshop sessions.	3.95	1.319
Impact
The learning objectives in general met my learning objectives.	4.53	0.599
I have learned a valuable knowledge and skills during this minor office procedure workshop.	4.63	0.540
I felt confident as a future family physician.	4.48	0.599
The workshop changed my competency toward the minor office procedures.	4.55	0.597
I will be able to apply what I learned during this workshop to the job.	4.30	0.687
I do not anticipate any barriers to applying what I learned.	3.85	1.027
I anticipate that I will eventually see positive results as a result of my training in this workshop.	4.45	0.677

Table 2 The Benefit and Effectiveness of the Educational Workshop Activities (Kirkpatrick; Reaction)

	Usefulness		Teaching Method		Amount Learned		Stimulation		Overall
	Mean	SD	Mean	SD	Mean	SD	Mean	SD	Mean	SD
General surgery
Suturing and laceration repair	4.73	0.51	4.80	0.41	4.63	0.49	4.65	0.53	4.75	0.44
Neonatal circumcision	4.00	1.09	4.23	0.92	4.33	0.76	4.08	1.00	4.20	0.88
I and D of superficial abscesses	4.70	0.56	4.55	0.75	4.53	0.68	4.40	0.96	4.63	0.59
Excision of ingrown nails	3.90	1.10	3.75	1.10	4.03	0.89	3.53	1.18	3.88	0.82
Proctoscopy	4.63	0.67	4.58	0.78	4.68	0.53	4.58	0.68	4.55	0.71
Wound care	4.20	1.07	3.93	1.02	3.98	1.00	3.60	1.03	3.98	0.97
OB/GYN
Pelvic exam	4.75	0.588	4.68	0.764	4.65	0.770	4.63	0.807	4.68	0.730
Pap smear	4.83	0.446	4.80	0.464	4.80	0.464	4.80	0.464	4.85	0.427
IUCD insertion and removal	4.70	0.648	4.70	0.648	4.73	0.599	4.65	0.700	4.70	0.608
Obstetric US	4.58	0.712	4.63	0.705	4.43	0.747	4.68	0.656	4.55	0.714
Endometrial Bx	4.78	0.480	4.80	0.405	4.80	0.405	4.78	0.423	4.80	0.405
Orthopedic
Soft tissue injection	4.18	1.130	3.60	1.277	3.70	1.203	3.68	1.185	3.75	1.171
Large joints Aspirations and injections	4.73	0.506	4.68	0.572	4.63	0.586	4.60	0.632	4.63	0.586
Small joints Aspirations and injections	4.75	0.543	4.55	0.714	4.55	0.639	4.35	0.834	4.60	0.591
Splint and immobilization (upper limb)	4.28	1.037	4.58	0.781	4.55	0.783	4.53	0.847	4.53	0.816
Splint and immobilization (lower limb)	4.43	0.984	4.45	0.959	4.53	0.905	4.43	0.958	4.45	0.932
Closed reduction (joint dislocations)	4.35	0.864	4.43	0.874	4.23	0.974	4.25	0.927	4.38	0.868
Dermatology
Cryotherapy for warts	4.73	0.679	4.58	0.781	4.73	0.452	4.50	0.934	4.70	0.608
Punch skin Bx	4.65	0.736	4.70	0.608	4.73	0.554	4.53	0.784	4.65	0.622
Shave skin Bx	4.63	0.774	4.60	0.709	4.70	0.564	4.58	0.712	4.73	0.554
Scraping for mycology	4.30	0.883	4.13	1.114	4.38	0.807	4.03	1.310	4.38	0.952
Cryosurgery of skin tumours	4.23	1.050	4.48	0.751	4.43	0.712	4.45	0.749	4.43	0.747
ENT/OPHTHA
Ant nasal packing for epistaxis	4.78	0.530	4.40	0.928	4.60	0.709	4.03	1.209	4.45	0.749
Ear FB/Wax removal	4.38	0.774	3.85	1.312	3.98	1.121	3.48	1.339	3.90	1.081
Nasal FB removal	4.50	0.751	4.20	1.067	4.25	1.006	3.75	1.256	4.20	1.114
Fundoscopy examination	4.80	0.516	4.65	0.864	4.63	0.705	4.48	0.933	4.65	0.700
Corneal FB removal	4.13	1.137	4.05	1.176	4.05	1.154	3.68	1.269	3.93	1.185
Slit-lamp examination	3.88	1.223	3.95	1.154	3.95	1.131	3.85	1.167	3.90	1.105

Table 3 Training Outcomes Levels Before and After the Educational Minor Procedure Workshop (Kirkpatrick; Learning and Behavioral Levels). Outcome Level Rescaled to (0–10) Following the Equation; Y = (X–X_min/X_range)n

	Pre-Workshop Learning (n 40)		Post-Workshop Learning (n 40)		12-Week Post-Workshop Learning (n 24)		12-Month Post-Workshop Learning (n 16)
	Mean	SD	Mean	SD	Mean	SD	Mean	SD
General surgery
Suturing and laceration repair	5.50	2.42	8.69	1.49	7.71	2.75	7.97	2.27
Neonatal circumcision	1.19	1.79	5.75	1.97	3.02	1.27	3.91	2.23
I and D of abscesses	4.88	2.65	8.00	1.81	6.67	2.52	7.19	2.21
Excision of ingrown nails	2.63	2.59	4.56	2.52	4.06	1.92	5.00	2.73
Proctoscopy	4.25	2.61	8.88	1.95	6.15	2.85	7.97	2.27
Wound care	6.25	2.88	7.69	2.22	7.60	2.71	8.13	2.50
OB/GYN
Pelvic exam	4.81	2.68	8.75	1.60	6.98	2.76	7.81	2.01
Pap smear	5.81	2.90	9.13	1.33	7.29	2.84	8.59	2.03
IUCD insertion and removal	2.44	2.08	7.88	1.92	5.21	2.43	6.09	3.02
Obstetric US	2.44	2.00	6.25	2.19	5.21	2.43	4.22	1.98
Endometrial Bx	3.13	2.38	8.25	1.62	5.104	2.80	5.31	2.56
Orthopedic
Soft tissue injection	3.50	2.93	5.94	2.31	6.15	2.65	7.19	2.21
Aspirations and injections (Large joints)	3.63	2.18	7.56	1.74	5.31	2.24	6.72	2.69
Aspirations and injections (Small joints)	2.88	2.43	7.13	2.15	4.48	1.64	5.16	1.92
Splinting and immobilization (upper limb)	4.44	2.49	8.31	1.73	5.94	3.02	5.78	1.98
Splinting and immobilization (lower limb)	4.44	2.74	8.25	1.89	5.73	2.99	5.63	2.14
Closed reduction (joint dislocations)	2.37	2.52	6.06	2.39	4.27	1.87	5.31	2.01
Dermatology
Cryotherapy warts	4.75	3.03	8.88	1.69	6.04	2.64	8.75	2.04
Punch skin Bx	3.44	2.51	8.44	1.67	5.63	2.58	7.03	2.45
Shave skin Bx	3.31	2.73	8.38	1.83	5.73	2.60	7.34	1.92
Scraping for mycology	3.31	2.67	7.63	2.03	5.83	2.72	6.25	2.73
Cryosurgery skin tumors	2.06	2.03	7.81	1.62	4.27	2.01	5.16	2.80
ENT/OPHTHA
Ant nasal packing epistaxis	4.06	2.97	7.00	2.05	5.83	2.62	6.41	2.23
Ear FB/Wax removal	4.00	2.76	6.69	2.61	5.83	2.72	6.56	2.39
Nasal FB removal	4.25	2.66	6.63	2.68	5.63	2.78	6.25	2.73
Fundoscopy examination	2.31	2.55	5.31	3.05	4.79	2.54	4.69	2.39
Corneal FB removal	4.75	2.25	7.63	2.11	6.56	2.83	7.66	2.13
Slit-lamp examination	2.44	2.49	5.44	2.58	4.48	2.21	5.16	2.95

Figure 2 Minor procedures’ learning outcome over time (blue: pre-workshop, red: post-workshop, grey: 12 weeks post-workshop, orange: 12 months post-workshop).