Impact of virtual reality simulation on learning barriers of phacoemulsification perceived by residents

Abstract

Objective

To identify residents’ perceived barriers to learning phacoemulsification surgical procedures and to evaluate whether virtual reality simulation training changed these perceptions.

Design

The ophthalmology residents undertook a simulation phacoemulsification course and proficiency assessment on the Eyesi system using the previously validated training modules of intracapsular navigation, anti-tremor, capsulorrhexis, and cracking/chopping. A cross-sectional, multicenter survey on the perceived difficulties in performing phacoemulsification tasks on patients, based on the validated International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric (ICO-OSCAR), using a 5-point Likert scale (1 = least and 5 = most difficulty), was conducted among residents with or without prior simulation training. Mann–Whitney U tests were carried out to compare the mean scores, and multivariate regression analyses were performed to evaluate the association of lower scores with the following potential predictors: 1) higher level trainee, 2) can complete phacoemulsification most of the time (>90%) without supervisor’s intervention, and 3) prior simulation training.

Setting

The study was conducted in ophthalmology residency training programs in five regional hospitals in Hong Kong.

Results

Of the 22 residents, 19 responded (86.3%), of which 13 (68.4%) had completed simulation training. Nucleus cracking/chopping was ranked highest in difficulty by all respondents followed by capsulorrhexis completion and nucleus rotation/manipulation. Respondents with prior simulation training had significantly lower difficulty scores on these three tasks (nucleus cracking/chopping 3.85 vs 4.75, P = 0.03; capsulorrhexis completion 3.31 vs 4.40, P = 0.02; and nucleus rotation/manipulation 3.00 vs 4.75, P = 0.01). In multivariate analyses, simulation training was significantly associated with lower difficulty scores on these three tasks.

Conclusion

Residents who had completed Eyesi simulation training had higher confidence in performing the most difficult tasks perceived during phacoemulsification.

Keywords:

• virtual reality
• simulation surgical education
• cataract surgery

Introduction

The global number of blindness due to cataract has increased from 12.3 million in 1990 to 20 million in 2010.^1,2 In East Asia, including Hong Kong, cataract is the leading cause of blindness and visual impairment in the pooled data of population-based studies.^3,4 Various initiatives have been undertaken in response to fight the cataract epidemic in Hong Kong, including implementation of key performance indicator based on the waiting time for cataract surgery in public hospitals and subsidization for cataract surgery in public–private partnership programs. As a result, the average waiting time for cataract surgery in public hospitals has markedly reduced approximately threefold, from over 44 months before 2008 to 15 months after 2013.⁵ As physicians have pledged to keep shortening the waiting time, the demand for cataract surgeries will continue to be relentless.

Alongside the rising demand for cataract surgeries, there is a constant influx of ophthalmic residents. Learning to competently perform phacoemulsification is one of their top training priorities. Traditionally, residents learned phacoemulsification based on the Halsted apprenticeship model,⁶ in which they perform the techniques step by step on actual patients under the close supervision of an attending physician. A wide range of intraoperative complication rates from 2.0% to 14.7% in resident-performed phacoemulsification surgeries have been reported; while some phacoemulsification surgeries performed by residents have comparable outcomes,^7–9 others have increased complication rates and worse patient outcomes.^10–16 The highly variable complication rates could be due to the lack of systematic consideration of potential perioperative risk factors, such as history of traumatic cataracts, hypermature cataracts, and zonular loosening.¹⁰ Nonetheless, the cost of training during live surgeries may be higher due to prolonged operation time.^17,18 With rising patient expectations and demands of high-quality surgical outcomes, it is vital that ophthalmic residents learn to operate in a manner that is safe and time efficient.

A pilot virtual reality simulation cataract surgery training course was conducted in Hong Kong using the validated training modules on the Eyesi (VRmagic, Holding AG, Mannheim, Germany) computer-generated three-dimensional cataract operation environment for ophthalmic residents. A cross-sectional survey was conducted after the course for participants and nonparticipants of the course. The objectives of this study were to identify the residents’ perceived barriers to learning phacoemulsification procedures and whether simulation training on Eyesi changed these perceptions.

Methods

Simulation training curriculum

A structured, certified phacoemulsification simulation training course was held for ophthalmic residents who participated on a voluntary basis at The Chinese University of Hong Kong Ophthalmic Microsurgical Training Centre, the only virtual reality eye surgery simulation training facility in Hong Kong. The course included didactic lectures and hands-on practicum on the Eyesi simulator. Before simulation training began, all participants were given a 2-hour formal introduction and standardized instructions on how to use the Eyesi phacoemulsification interface software version 2.8 by the training coordinator. Four training modules with specific difficulty levels were chosen because their construct validities had been demonstrated previously.^19–24 The modules consisted of a mix of generic three-dimensional and cataract-specific, static and dynamic tasks in order to capture a full range of dexterity and skill as measured and trained by the simulator. Three of them were single-handed tasks (cataract navigation training [intracapsular], level 3; cataract anti-tremor training [intracapsular], level 2; capsulorrhexis training, level 1), and one was a bimanual task (cataract cracking and chopping training, level 2). The participants were given as much practice time as possible before sitting in for a test at the end of the 4-week course. For each of the four tasks, participants could achieve a maximum score of 100, resulting in a total maximum course score of 400. A proficiency test was performed under supervision, which required 80% passing mark. A certificate was awarded upon successful completion of the course.

Survey

A cross-sectional, anonymous, self-administered territory-wide survey of ophthalmic residents’ self-perceived learning barriers to phacoemulsification techniques, based on modifications of the validated International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric (ICO-OSCAR) – Phacoemulsification tool,²⁵ was conducted among ophthalmic residents in Hong Kong regardless of their participation in the simulation training course or not (Figure 1). The study adhered to the tenets of the Declaration of Helsinki. Informed consent was signed by all subjects. The study was approved by the Hong Kong hospital authority cluster institutional review board. The residents were affiliated with five regional hospitals throughout the three major districts in Hong Kong: Tung Wah Eastern Hospital and Pamela Youde Nethersole Eastern Hospital in Hong Kong Island, Hong Kong Eye Hospital in Kowloon, Alice Ho Miu Ling Nethersole Hospital, and Prince of Wales Hospital in the New Territories. The coverage was about 50% of all ophthalmic resident doctors throughout the Hong Kong Special Administrative Region. After reading the specific guidelines for grading of each surgical step listed on the ICO-OSCAR, the respondents ranked the levels of perceived difficulty on a 5-point scale (1 = least and 5 = most difficult) for each of the 14 phacoemulsification procedures and six global indices on the survey. In addition, they provided demographic information, and answered questions on their training status (basic or higher ophthalmic trainees, as determined by whether they had passed the intermediate examination to obtain the Membership of the Royal College of Surgeons of Edinburgh [MRCSEd]), whether they were able to complete phacoemulsification cataract extraction surgery in patients most of the time (>90%) without any intervention from their supervisor (Yes or No), and whether they received the certification for the Eyesi phacoemulsification training course (Yes or No).

Figure 1 Survey on ophthalmic residents’ perceived difficulties during phacoemulsification cataract extraction surgery.

Statistical analysis

Mann–Whitney U tests were carried out to compare the means of continuous variables between the subgroups with or without training on Eyesi. Univariate and multivariate regression analyses were performed for potential predictors (higher trainee, can complete phacoemulsification most of the time [90%] without supervisor’s intervention, and certification in the Eyesi training course) and their associations with the tasks in which Eyesi simulation-trained residents had significantly lower difficulty scores. A P-value of <0.05 was considered to be statistically significant. All of the statistical analyses were performed with SPSS software version 18.0 (SPSS Inc, Chicago, IL, USA).

Results

There were 22 residents in all five of the regional hospitals, and all were invited to participate in the survey. Nineteen completed the survey, and the response rate was 86.3%. The mean ± SD age of ophthalmic residents who participated in the survey was 28.7 ± 1.8 years (range 25–35 years), of which 11 (57.9%) were female. Thirteen (68.4%) had participated and were certified in the Eyesi simulation training course. The mean number of years of training was 3.5 ± 1.8 (range 1–5 years), and 12 (63.2%) were basic trainees (first year: six trainees; second year: six trainees) and seven (36.8%) were higher trainees (third year: four trainees; fourth year: two trainees; fifth year: one trainee). Five out of the 19 trainees could complete phacoemulsification in >90% of cases without intervention from attending physicians. All five of them were higher trainees.

The mean self-perceived difficulty scores on phacoemulsification procedures of the overall group, the group that did not have Eyesi training, and the group that had Eyesi training are shown in Table 1. Nucleus cracking or chopping was ranked the highest in difficulty by the overall group (mean score 4.06 ± 0.83). This was followed by capsulorrhexis formation and completion (mean score 3.61 ± 0.92), nucleus rotation and manipulation (mean score 3.41 ± 1.28), hydrodissection (mean score 3.22 ± 1.26), nucleus sculpting or primary chop (mean score 3.12 ± 1.36), and effective use and stability of phacoemulsification probe and secondary instruments within the eye (mean score 3.12 ± 1.36). For the global indices, overall speed and fluidity of the procedure ranked the highest in difficulty (mean score 3.26 ± 1.24). Except for hydrodissection and effective use and stability of phacoemulsification probe and secondary instruments within the eye, trainees without prior Eyesi simulation training had significantly higher mean difficulty scores in all the top ranking procedures and global indices. A histogram (Figure 2) illustrates the eight tasks (specific and global) that residents without Eyesi training had significantly higher mean difficulty scores than those who had Eyesi training. These tasks were ordered from left to right on the histogram according to the highest difficulty ranking perceived by the overall group to the least difficult.

Figure 2 Histogram of mean difficulty scores of the eight tasks that trainees without Eyesi training had significantly higher scores than trainees who had the Eyesi training. These tasks were ordered from left to right on the histogram according to the highest difficulty ranking perceived by the overall group to the least difficult.

Abbreviation: IOL, intraocular lens.

Table 1 Mean difficulty scores on 14 specific tasks and six global indices for phacoemulsification based on the International Council of Ophthalmology’s Ophthalmology Surgical Competency Assessment Rubric perceived by all respondents (N = 19), the subgroup which had no Eyesi simulation training (N = 6), and the subgroup which had Eyesi simulation training (N = 13)

Task descriptions	Overall mean ± SD difficulty scores	Median	Mean ± SD difficulty scores (no Eyesi training)	Median	Mean ± SD difficulty scores (Eyesi trained)	Median	P-value (Eyesi vs no Eyesi)
Task-specific indices
1 Draping: surgical field clear of lashes	1.95±1.268	2.00	1.83±1.602	1.00	2±1.155	2.00	0.40
2 Incision and paracentesis: formation and technique	2.5±1.295	2.50	2.83±0.753	3.00	2.33±1.497	2.00	0.27
3 Viscoelastic: appropriate use and safe insertion	1.95±1.026	2.00	2.5±0.548	2.50	1.69±1.109	1.00	0.02
4 Capsulorrhexis: commencement of flap	2.83±1.425	3.00	4±1.225	4.00	2.38±1.261	2.00	0.04
5 Capsulorrhexis: formation and circular completion	3.61±0.916	4.00	4.4±0.548	4.00	3.31±0.855	3.00	0.02
6 Hydrodissection: visible fluid wave and free nuclear rotation	3.22±1.263	3.00	3.8±1.095	3.00	3.0±1.291	3.00	0.29
7 Phacoemulsification probe and second instrument: insertion into eye	2.11±1.41	2.00	2.8±1.643	2.00	1.85±1.281	1.00	0.17
8 Phacoemulsification probe and second instrument: effective use and stability within eye	3.12±1.364	3.00	3.5±1.291	4.00	2.83±1.115	3.00	0.35
9 Nucleus: sculpting or primary chop	3.12±1.364	3.00	4.5±1	5.00	2.69±1.182	3.00	0.02
10 Nucleus: rotation and manipulation	3.41±1.278	4.00	4.75±0.5	5.00	3±1.155	3.00	0.01
11 Nucleus: cracking or chopping with safe phacoemulsification of segments	4.06±0.827	4.00	4.75±0.5	5.00	3.85±0.801	4.00	0.03
12 Irrigation and aspiration technique with adequate removal of cortex	2.76±1.251	2.00	3.75±0.957	3.50	2.46±1.198	2.00	0.05
13 Lens insertion, rotation, and final position of intraocular lens	2.37±1.065	2.00	3.17±0.408	3.00	2±1.08	2.00	0.01
14 Wound closure (including suturing, hydration, and check security)	2.05±0.97	2.00	2.33±0.816	2.50	1.92±1.038	2.00	0.15
Global indices
1 Wound neutrality and minimizing eye rolling and corneal distortion	2.05±0.97	3.00	2.83±0.753	3.00	2.83±1.193	3.00	0.96
2 Eye positioning centrally within microscope view	2.16±1.119	2.00	1.83±0.753	2.00	2.31±1.251	2.00	0.49
3 Conjunctival and corneal tissue handling	2.53±0.964	3.00	2.83±0.408	3.00	2.38±1.121	2.00	0.20
4 Capsule: protection of anterior and posterior capsules	3±1	3.00	3.17±0.753	3.00	2.92±1.188	3.00	0.70
5 Iris protection	2.89±1.049	3.00	3.17±0.753	3.00	2.77±1.166	3.00	0.41
6 Overall speed and fluidity of procedure	3.26±1.24	3.00	4.33±0.816	4.50	2.77±1.092	3.00	0.01

Note: Statistically significant values are shown in bold (P<0.05).

Regression analyses were performed to evaluate the associations of the eight tasks that the residents with Eyesi simulation training had significantly lower mean difficulty scores (Tables 2 and 3) with potential predictors. In univariate analyses, higher trainees were significantly associated with lower difficulty scores in overall speed and fluidity of procedure, commencement of capsulorrhexis flap, intraocular lens (IOL) insertion, and appropriate use and safe insertion of viscoelastic. Residents who could complete phacoemulsification most of the time (>90%) without supervisor’s intervention were significantly associated with lower difficulty score in commencement of capsulorrhexis flap. In multivariate analyses, residents who were certified in the Eyesi simulation course were significantly associated with lower difficulty scores in cracking and chopping of lens nucleus, completion of capsulorrhexis, rotation and manipulation of lens nucleus, and sculpting or primary chopping of nucleus.

Table 2 Regression analyses of four tasks (cracking and chopping of lens nucleus, completion of capsulorrhexis, rotation and manipulation of lens nucleus, and overall speed and fluidity) that trainees who had Eyesi simulation training had significantly lower difficulty scores than trainees who did not have Eyesi simulation training

Potential predictors	Cracking and chopping of lens nucleus			Completion of capsulorrhexis			Rotation and manipulation of lens nucleus			Overall speed and fluidity of procedure
	OR	95% CI	P-value	OR	95% CI	P-value	OR	95% CI	P-value	OR	95% CI	P-value
Univariate analysis
The respondent is a higher trainee	0.256	0.034, 1.917	0.185	0.169	0.024, 1.171	0.072	0.286	0.046, 1.758	0.177	0.046	0.004, 0.548	0.015
Can complete phacoemulsification most of the time (>90%) without supervisor’s intervention	0.256	0.034, 1.917	0.185	0.169	0.024, 1.171	0.072	0.286	0.046, 1.758	0.177	0.210	0.33, 1.333	0.098
Certification in Eyesi training course	0.573	0.038, 0.861	0.039	0.578	0.045, 0.74	0.028	0.227	0.001, 0.467	0.014	0.047	0.005, 0.463	0.009
Multivariate analysis
The respondent is a higher trainee	4.199	0.121, 145.9	0.428	2.622	0.083, 82.847	0.584	12.705	0.303, 533.255	0.182	0.116	0.003, 4.027	0.234
Can complete phacoemulsification most of the time (>90%) without supervisor’s intervention	0.125	0.005, 3.438	0.219	0.115	0.005, 2.901	0.189	0.052	0.002, 1.828	0.103	0.857	0.051, 14.411	0.915
Certification in Eyesi training course	0.030	0.001, 1.017	0.041	0.044	0.002, 0.912	0.043	0.004	0.001, 0.378	0.017	0.099	0.008, 1.157	0.065

Note: Statistically significant values are shown in bold (P<0.05).

Table 3 Regression analyses of four tasks (sculpting or primary chopping of nucleus, commencement of capsulorrhexis flap, IOL insertion, and appropriate use and safe insertion of viscoelastic) that trainees who had Eyesi simulation training had significantly lower difficulty scores than trainees who did not have Eyesi simulation training

Potential predictors	Sculpting or primary chopping of nucleus			Commencement of capsulorrhexis flap			IOL insertion			Appropriate use and safe insertion of viscoelastic
	OR	95% CI	P-value	OR	95% CI	P-value	OR	95% CI	P-value	OR	95% CI	P-value
Univariate analysis
The respondent is a higher trainee	0.303	0.05, 1.84	0.195	0.099	0.014, 0.723	0.023	0.044	0.004, 0.513	0.013	0.068	0.007, 0.620	0.019
Can complete phacoemulsification most of the time (>90%) without supervisor’s intervention	0.303	0.05, 1.84	0.195	0.049	0.005, 0.455	0.008	0.220	0.035, 1.384	0.107	0.180	0.026, 1.241	0.082
Certification in Eyesi training course	0.043	0.003, 0.612	0.020	0.089	0.01, 0.77	0.028	0.030	0.002, 0.419	0.009	0.064	0.006, 0.71	0.025
Multivariate analysis
The respondent is a higher trainee	5.238	0.195, 140.330	0.324	2.130	0.087, 51.832	0.642	0.055	0.001, 2.212	0.124	0.190	0.006, 6.05	0.347
Can complete phacoemulsification most of the time (>90%) without supervisor’s intervention	0.102	0.005, 2.252	0.149	0.031	0.001, 0.744	0.032	2.447	0.12, 49.899	0.561	0.743	0.036, 15.348	0.847
Certification in Eyesi training course	0.020	0.001, 0.578	0.023	0.082	0.006, 1.089	0.058	0.086	0.006, 1.311	0.078	0.145	0.011, 1.906	0.142

Note: Statistically significant values are shown in bold (P<0.05).

Abbreviation: IOL, intraocular lens.

Discussion

In this study, we have identified the top learning barriers to phacoemulsification cataract extraction surgery perceived by ophthalmic residents in Hong Kong. We expected that higher trainees, and trainees who were able to complete phacoemulsification most of the time without needing attending physician intervention, would also have the lowest difficulty scores in the surgical tasks.²⁶ However, after adjusting for these two potential confounding factors, Eyesi simulation training was significantly associated with increased confidence in higher difficulty surgical tasks. Virtual reality simulation training on the validated Eyesi modules followed by proficiency assessment appeared to be effective in lowering the perceived difficulties in performing the most skills-demanding phacoemulsification procedures on actual patients as rated by the residents.

Our survey was designed according to the ICO-OSCAR tool.²⁵ The rubric draft was developed by content experts from around the world based on the Dreyfus model of skill acquisition and revised by expert panels in teaching cataract surgery.²⁷ Hence, the respondents were able to gain thorough understandings on how their surgical proficiencies on actual patients would be assessed objectively based on the ICO-OSCAR before ranking the difficulty levels on the survey. Previous surveys on self-perceived training difficulties in phacoemulsification cataract extraction surgery did not use a standardized format to describe the specific surgical tasks.^28,29 In 2006, Dooley and O’Brien reported the surgical procedures that were perceived to be most difficult by eight trainees during phacoemulsification cataract extraction surgery were 1) phacoemulsification, 2) capsulorrhexis, 3) irrigation/aspiration (I/A), 4) IOL insertion, and 5) hydrodissection.²⁸ Prakash et al reported in 2009 that 36 trainees ranked 1) foldable IOL insertion as the most difficult task, followed by 2) nucleus emulsification, 3) I/A, 4) capsulorrhexis, and 5) hydrodelineation.²⁹ Our questionnaire, based on the ICO-OSCAR guideline, had dissected the specific steps required to accomplish phacoemulsification of the nucleus, and we have identified that cracking and chopping, rotation and manipulation, and sculpting of the nucleus were among the most difficult tasks perceived by residents. Our survey provided important and updated information on the perceived learning barriers by ophthalmic residents in phacoemulsification, which could have changed from the previous decade because of the availability of improved fluidics and followability of advanced phacoemulsification systems, and newer inserters for rolled IOL through small corneal incisions.³⁰

Nevertheless, the development of user-friendly phacoemulsification systems has not changed the skills demanded from the surgeon when performing capsulorrhexis, other than the availability of femtosecond laser assistance which has not yet been implemented in public hospitals in Hong Kong. Capsulorrhexis had been regarded as one of the most challenging procedures during phacoemulsification cataract extraction surgery in this study as well as in a number of previous studies.^26,28,29,31 When capsulorrhexis is attempted, there is a natural tendency for the flap to extend radially which increases the subsequent risk of posterior capsule tear resulting in vitreous loss and lens nucleus drop. Thus, it is considered crucial for residents to master the skills in performing capsulorrhexis to minimize the rates of cataract surgery complications. Because capsulorrhexis and lens nucleus cracking and chopping are among the initial steps of phacoemulsification cataract extraction surgery which have a steep learning curve, some attending physicians would prefer to teach phacoemulsification starting from reverse order: the trainee surgeon performs I/A and IOL insertion after the supervisor completes capsulorrhexis and phacoemulsification of the lens.^28,32,33 This reverse teaching approach could deprive the chances of novice surgeons to practice performing the tasks that have the steepest learning curves, but this approach is better for patient care and safety.

The paradox of traditional apprenticeship-based surgical training is that today’s patients can be harmed in the training of tomorrow’s surgeons. Moreover, the patient can be an unforgiving teacher. The trainees are exposed to real-time pressures during surgery on actual patients, especially when the majority of cataract extraction surgeries are performed under local anesthesia. The rate of posterior capsule tear among trainee surgeons has been shown to vary from 4.8% to 15%.^10–16 Experienced surgeons tend to have much lower complication rates, with a vitreous loss rate of 0.53%–1.63%.^34–36 Simulation surgical training allows the trainees to experience the consequences of their decisions and actions as they learn new skills without putting patients at risk. The construct validity of a number of training modules on the Eyesi simulator has been reported.^19–23,37 Saleh et al evaluated the repeatability and reproducibility of the capsulorrhexis, nucleus cracking and chopping, navigation, bimanual training, and anti-tremor modules in 18 residents.³⁷ Mahr and Hodge showed construct validity of anterior segment anti-tremor and forceps training modules in 15 participants comprising residents and experienced surgeons, and the experienced surgeons showed statistically significant better scores and faster time to complete the designated tasks.¹⁹

Our simulation course was implemented based on a training program that had been established by the International Forum of Ophthalmic Simulation (IFOS) using the Eyesi simulator.²⁴ Saleh et al compared the entry and exit proficiency scores of 16 novice eye surgeons in performing the four validated modules (navigation, anti-tremor, capsulorrhexis, and nucleus cracking and chopping training) and showed a significant improvement for all these tasks in addition to the overall scores.²⁴ Our survey found that the proficiency-based Eyesi simulation course had boosted the confidence of ophthalmic residents in performing the most difficult tasks in phacoemulsification, regardless of their training status and prior experience in cataract surgery on actual patients. Our simulation course did not have an impact on the residents’ confidence in performing hydrodissection and effective use and stability of phacoemulsification probe and secondary instruments within the eye, which highlights the necessity of utilizing and assessing the effect of the hydrodissection/hydrodelineation and instruments insertion/removal training modules on Eyesi in the future.

The encouraging results of our survey lay the foundation for future research to evaluate the efficacy of virtual reality simulation phacoemulsification training on patient-related outcomes. Three retrospective studies had reported improved outcomes in the operating theatre associated with Eyesi simulation training.^38–40 Belyea et al reported a significant decrease in phacoemulsification time and power use (2.4 vs 1.9 minutes, P < 0.002; 28.2% vs 25.3%, P < 0.0001, respectively) following training on Eyesi.³⁹ Baxter et al found that the complication rates of cataract surgeries performed by resident trainees who had Eyesi training were lower than those previously reported in the literature.^40,41 McCannel et al found a significant decrease in the number of errant continuous curvilinear capsulorrhexes during cataract surgery after a capsulorrhexis-intensive training curriculum on the Eyesi simulator (15.7% vs 5.0% in the postintervention cohort; P < 0.0001).³⁸ Two prospective studies have been performed.^41,42 Pokroy et al found significant decrease in operation time but nonsignificant difference in complication rates before and after training with Eyesi.⁴¹ Recently, Thomsen et al reported that Objective Structured Assessment of Cataract Surgical Skill (OSACSS) scores when performing phacoemulsification on actual patients significantly improved by 32% in novice surgeons and 38% in intermediate-level surgeons who performed >75 surgeries even after adjusted for the effect of learning curve in a prospective, cohort study.⁴²

Our study was limited by lack of evaluation of patient-related outcomes associated with Eyesi simulation training and small sample size. We did not use other simulation modalities, such as porcine eyes, MicroVisTouch (ImmersiveTouch, Chicago, IL, USA), and PhacoVision (Melerit Medical, Linkoping, Sweden), for comparison with the Eyesi platform. Hence, we cannot ascertain whether any one of these simulation tools were just as effective as Eyesi in surgical training of novice surgeons at the initial stages of their learning curves. We reported subjective rankings perceived by the trainees without self-evaluations on surgical videos or objective rankings by experienced attending physicians. Using the OSACSS, Casswell et al studied the agreement between trainees and their evaluators in grading their own performances in surgical tasks during phacoemulsification on actual patients and found that senior trainees were more able to assess their performance than junior trainees, supporting the notion that trainees progress from being relatively unconsciously incompetent to becoming consciously competent during their surgical training.⁴³

Conclusion

Our study identified the updated perceptions on training barriers from ophthalmic residents. The responses of our survey reflected that ophthalmic residents were satisfied with the outcome of a structured Eyesi training course using validated training modules followed by a proficiency test. Our study has demonstrated level 1 evidence of the Kirkpatrick model in the evaluation of educational intervention.⁴⁴ The efficacy of virtual reality simulation cataract surgery training has only been proven to a certain extent.⁴⁵ Current evidence and assessment of simulator-based training is characterized by a scattered focus and lack of rigorous methodologies to ensure effective skills transfer to the operation theatre.⁴⁵ The ultimate goal of simulator use is to improve patient safety and outcomes by trainees. Given the wide adoption of simulator-based training by universities and tertiary ophthalmic centers in many parts of the world, there is an imminent need for a robust clinical trial to justify the efficacy of implementing virtual reality simulator training modules in structured phacoemulsification surgery training programs.

Disclosure

The authors report no conflicts of interest in this work.