Simulation training in neurosurgery: advances in education and practice

Abstract

The current simulation technology used for neurosurgical training leaves much to be desired. Significant efforts are thoroughly exhausted in hopes of developing simulations that translate to give learners the “real-life” feel. Though a respectable goal, this may not be necessary as the application for simulation in neurosurgical training may be most useful in early learners. The ultimate uniformly agreeable endpoint of improved outcome and patient safety drives these investments. We explore the development, availability, educational taskforces, cost burdens and the simulation advancements in neurosurgical training. The technologies can be directed at achieving early resident milestones placed by the Accreditation Council for Graduate Medical Education. We discuss various aspects of neurosurgery disciplines with specific technologic advances of simulation software. An overview of the scholarly landscape of the recent publications in the realm of medical simulation and virtual reality pertaining to neurologic surgery is provided. We analyze concurrent concept overlap between PubMed headings and provide a graphical overview of the associations between these terms.

Keywords:

• residency education
• simulation
• neurosurgery training
• virtual reality
• haptic feedback
• task analysis
• ACGME

Introduction

Education in medicine in the past decade has progressively started to adopt virtual reality (VR) as a primary tool in training learners. A tool that can be exploited for both its cognitive task analysis and technical skills training, VR has been assuming a paramount role in medical and, more specifically, surgical training. Continued rapid development of medical technology, portable electronic devices and software with easy-to-use, friendly interfaces has seamlessly paved a path for implementation of VR for training across a wide array of applications.¹

With its unique combination of a high-yield/low-risk investment, VR embraces learners of all types. From practicing surgeons, residents and medical students to nurses and allied health professionals, VR can strengthen skills from basic knowledge and core thought processes to the most complex technical nuances in neurosurgical procedures. Moreover, it can also serve as a useful tool for educators to objectively review assessments, track learning and follow improvement of learners.

Most of the core foundations in medical education, particularly in the USA, can be traced back to Abraham Flexner, who authored the self-titled Flexner Report in 1910.² Credited in this report were advances of the “self-registering” thermometer, stethoscope, microscope and laboratory services of the times. These were noted to “extend the physician’s range”. The report eloquently noted the importance of teaching and research and the necessity of establishing a modus vivendi. With this article, like many others, we advocate the collaboration of neurosurgical education and VR. The politically controversial excerpts notwithstanding, the rudimentary principles and general educational values that resound in the Flexner Report are timelessly applicable. With profound literature unveiling striking estimates of nearly 100,000 hospital deaths per year in the USA due to medical errors,³ it behooves us to take advantage of our era and optimize medical and neurosurgical training. Aiming to reduce complications and medical errors in neurosurgery by developing VR training tools calls for not only precise, but also accurate representations of real-life situations and tactile feedback.

Cruces of the neurosurgical training paradigm

Neurosurgical training programs share many obstacles with other surgical training programs when it comes to resident education. Most importantly, educators must balance optimizing learner education with appropriately graduated learner autonomy against the goal of patient safety.

The recent changes by the Accreditation Council for Graduate Medical Education (ACGME) which instituted an 80-hour work-week for residents makes a strong call for a refurbished training paradigm. Historically, residents had time-intensive apprenticeship models, which were reasoned to gain necessary experience. However, some argue that less time allowed in the hospital equates to less time spent gaining the surgical training that one requires.⁴

With much debate, however, this also creates more time for an adequate work-life balance and encourages involvement in scholarly academic extracurricular projects.⁵ Though a new obstacle in neurosurgery residency training, it is one of the many challenges a neurosurgery training program faces.

More so, in the last decade, health care administrators, physicians and nonphysicians alike have been advocating for transparency of outcomes, complications, expenses and patient satisfaction.^6,7 A national mission statement for patient-centered care has arrived at the forefront of the development of institutional policy and safety measures. Physicians now perhaps more than ever operate with these factors in mind. These factors, though uniformly and holistically endorsed, pose challenges to neurosurgery training programs. To best meet patient needs, neurosurgeons need to perform increasingly complex and risky procedures without compromising patient care, all while training new learners to accomplish the same. The present time is better than any to utilize the technologies at hand. Neurosurgery needs to explore and develop VR methods for its trainees to garner the experience and comfort with its increasingly complex procedures that are advancing rapidly.

In neurosurgical training, residents and medical students can enjoy and absorb a vast array of knowledge from various learning opportunities. The operating room (OR) setting offers the most fruitful of experiences; however, the greatest yield for the learner must be from tactful and experienced educators. Orchestrating a successful, smooth surgery while building on a resident’s observational learning does not come easy. Residents in every program have access to large libraries with more than enough literature to satisfy curious minds. This also is monitored by the ACGME. Clinical rounds, especially in the neurosurgical intensive care unit, are filled with learning opportunities that also have been supported by off-site patient simulations with specific critical fast-paced scenarios. These patient simulations replicate the intensive care unit or the OR setting to help the resident learn to deal with critically ill patients or with intraoperative complications. Cadaver labs are available to many residency programs, but are not easily and readily accessible in many places. These resources help in taking the resident away from areas of high stress and use a more relaxed environment to build learning. The courses are key in advancing cognitive task rehearsals, but the tactile and technical skills may plateau with less-than-ideal simulations or with bloodless/poorly preserved cadavers.

Advances in imaging modalities such as magnetic resonance imaging (MRI) with diffusion tensor imaging with fiber tracking sequences, functional MRIs (fMRIs) and 3-D reconstructions allow the learner to conceptualize anatomy and pathologies like never before.^8,9 These types of software applications already in daily use by health care providers for surgical planning with goals of improving patient outcome can be essential tools for improving resident learning. Preoperative discussions between the educators and residents about imaging findings, surgical options and anatomic and functional relationships can explore key concepts to evaluate residents. These, among others, are examples of current VR integrations that highlight the importance of cognitive analytics in today’s neurosurgical training paradigm.

Background of simulation in medicine

Medical training has always relied on simulation in some capacity. To better understand human anatomy, early pioneers in the field first used cadavers. Careful dissection of these cadavers led curious minds to a better understanding of disease and pathology. In modern medical training, students are introduced to actors in simulated patient interactions. The goal of these interactions is to teach students how to interact with patients, how to take histories, how to perform a physical exam thoroughly while maintaining a patient’s modesty – all before they begin working in a clinical setting and meet actual patients.^10–17

It makes sense that practicing skills and encounters would help improve experiences and outcomes. This same thought was applied to the surgical field with simulators. General surgery has perhaps the most well-established and researched use of simulators. General surgeons, to become familiar with tools that offer a different sense of visual and tactile feedback, have used laparoscopic simulators. Studies have been performed looking at groups that can practice on a VR simulator before a laparoscopic cholecystectomy. Results show that the groups allowed to practice are less likely to have errors or make critical mistakes and complete the procedure quicker.¹⁸

A review of simulators used in general surgery performed by Carter et al determined that there are several criteria needed for a simulator to be effective.¹⁸ In order to judge a simulator and its ability to act as a true substitute for real-world scenarios, it must have reliability and validity. The goal for a simulator is to achieve several levels of validity: face, content, construct and predictive. Face validity is defined as the degree to which a procedure, especially a physiologic test or assessment, appears effective in terms of its stated goal. Content validity is the ability of the simulator to represent all facets of a given construct. Construct validity is defined as the ability to distinguish between subjects with different levels of experience. Predictive validity is measured by the correlation between the performance measured and the technical ability in vivo. To summarize, an ideal simulator must be able to perform the task it advertises, in its entirety, separate novices from experts and have these learned skills be transferrable to patients. This would be the perfect situation; however, we have yet to achieve this degree of simulation.

Simulators can be classified in various ways and a universal classification scheme remains elusive reflecting different aspects that may be emphasized independent of the point of view.^19,20 Numerous attempts at classification of simulators have been made in the past. They invariably are either overly broad and lack specificity or end up focusing on narrow aspects of simulation only. The ideal scheme would give the user adequate information about the technology used in the planning and the design of the simulator, and an indication of how the simulator may be utilized. Other desirable characteristics are that the classification system should be easy to remember. Such a classification scheme should map existing simulators in a rather straightforward way, but it would be even more desirable if it provides a roadmap both by demonstrating gaps and directions that research and development need to take.²⁰ Understanding the properties of simulators may aid the decisions leading to the choice of an appropriate device for teaching, training and for assessing a particular skill or task (Figure 1).

Figure 1 Classification of simulators.

Note: Data from Pott et al.²⁰

Simulation in training

Simulators have the power of automation. A cause and effect relationship with computer integration allows for immediate feedback and production of score reports. Several metrics such as scales of precision and accuracy are set by predetermined values that represent ideal dexterous technique.^21–25 Variations from these values produce feedback reports. The time to completion, number of errors performed and the need for assistance can be measured. In addition to focusing on technical skills and cognitive analysis, simulations allow learners to improve upon other qualities that mold able neurosurgeons. These include patient communication, teamwork, judgment and leadership.

These nontechnical areas address the six core competencies that the ACGME has laid out for resident evaluation: medical knowledge, patient care, practice-based learning and improvement, interpersonal and communication skills, professionalism and system-based practice. By engaging in simulations, residents can not only improve their skills in the OR, but also address core competencies that are needed to meet ACGME milestones.

Simulation in neurosurgery

There has been a significant interest in the field of neurosurgery to explore and utilize medical simulation and VR for purposes of training, skill maintenance, refinement, demonstration and assessment (Figures 2 and 3). Using PubMed keywords and phrases, which were also included into a MeSH search, yielded a total of 124 results and of these, we reference a selection of publications deemed relevant to this article.^{14,16,23,25–80}

Figure 2 Number of citations in PubMed covering the concepts of medical simulation and virtual reality in neurosurgery.

Figure 3 General landscape of scholarly contributions between the concepts of neurosurgery and medical simulation.

We utilized the PubAtlas⁸¹ interface for PubMed to derive the results of the pairwise intersections between search terms. This allows extending PubMed with a literature analysis interface. Correspondingly, the basic form of a literature map that PubAtlas provides explores associations among sets of terms in a graphical format. A high-level concurrent concept overview between the concepts of “neurosurgery”, “medical simulation” and “virtual reality” can be developed (Figure 3). We allowed the algorithm to explore the MeSH terms and find subassociations. To explore how these terms may correlate with the traditional subspecialties in neurosurgery, we added terms for these, for example, “trauma”, “vascular” and other similar terms. We subsequently allowed for a modifier for “training” and explored the concurrent concepts with a graphical literature analysis. The rather complex result is shown in Figure 4.

Figure 4 Graphical display of term associations with co-occurrence histories for the concepts of medical simulation, virtual reality and neurosurgery and its subspecialties through 2015.

In 2010, the Congress of Neurological Surgeons (CNS) created a committee called the CNS Simulation Committee. Their goal was to create simulations to maximize resident education and improve outcomes efficiently and safely. In 2012, the CNS created a simulator course that was unveiled at the annual CNS conference. Three main areas were displayed: vascular, cranial and spine. Within each area were courses for medical students, residents, fellows and attendings to participate in. To provide objective data, there was a standardized algorithm for assessment. The participants were given pretests and posttests along with instruction and practice before they were graded for their performance completing certain tasks with each simulation.⁶²

An endovascular course that was described by Fargen et al was put on and involved 37 participants. They were tasked with performing a diagnostic angiogram using a simulator provided by Vist-C Simulator Systems (Mentice, Evanston, IL, USA), Simbionix Systems (Stryker, Kalamazoo, MI, USA) and SimSuite Compass (MicroVention, Tustin, CA, USA). Results showed those who completed the course had a significant improvement in their posttest score and overall performance.⁸² Similar results have been achieved by others for the specific part-task simulations that involved endovascular procedures,^57,83,84 and more comprehensive simulators for the endovascular environment are underway.

The spine courses included a simulator for an anterior cervical discectomy and fusion, which was the first of its kind.⁸⁵ It too followed the same training algorithm as the other modules. Medtronic (Memphis, TN, USA) provided physical models that mimicked the soft tissue of the anterior approach and the bony elements. This allowed participants to practice using Kerrison rongeurs, drills and other real-world tools to increase their familiarity with instrument utilization. This simulator study, although limited in sample size, demonstrated an ability to achieve its goal of improving pretest and posttest scores. There are several other spinal surgery simulators that explore other aspects of spinal surgery and, in particular, complication avoidance in this realm.^{36,69,86–88} When training neurosurgical residents, the training on events that should not happen when providing actual patient care is key and the innovative development of a simulator that teaches the management of cerebrospinal fluid leaks during spinal surgery is one example.⁸⁹

The course put on at CNS shows that there is a large market of different surgical simulators, but they can be mainly categorized into physical and VR simulators. Each has its advantages and disadvantages. Physical models can achieve anatomical accuracy, especially with the engineering tools available today. Three-D printing allows us to create reproducible models that can be subjected to real-world manipulation.⁸ Some physical models are incredibly ornate, such as the traumatic brain injury model used during a course at CNS and the Vascular Simulations Replicator (Stony Brook, NY, USA). They allow real tools and instruments to be used for the learner to become easily accustomed to them and their intended use. However, there are several downsides to physical models. They are generally limited in repetitive use, which in turn requires additional units to be purchased driving up costs. The initial cost of several physical models can be quite daunting. Also, since physical models are mass produced, they often do not demonstrate any anatomic variance or pathologic variance.

When compared to physical models, VR simulators have several advantages. They do not suffer from the issue of repetition since they are digital programs. Their cost can be substantially less as a result.^{28,54,87,90,91} Due to programming and a lack of graphical limitations, VR models can mimic a wide range of anatomic and physical variance. A significant downside to the virtual model is the inability to accurately emulate real tools and instruments so that the user can gain an appreciation for their physical properties and proprioception. This is an evolving field, however, and significant advances have already been made in providing haptic feedback to emulate the real-world properties of tissue and bone.

Simulation in cranial neurosurgery has acquired much attention with the NeuroTouch simulator.^58,72,92 The Neuro-Touch training tool was developed by the National Research Council in Canada and is a simulator built around a stereoscope, which incorporates bimanual tools that provide haptic feedback and a real-time computer-generated virtual tissue that reacts to manipulation. By taking advantage of the applied kinesthetic principles, users can simulate real conditions of resecting a lesion using this system. The stereoscope provides binocular vision of the surgical field that conveys depth. The surgical tools include an ultrasonic aspirator, suction, bipolar cautery and microscissors that closely approximate real tools. These tools interface with the real-time virtual tissue to provide sensations to the user that can help differentiate normal brain from tumor and resect it, while also accounting for complications such as bleeding. The argument still holds that it is not identical to real tissue and sensations, but it is a step forward.

This is the only model designed to date that provides computer-generated metrics. The NeuroTouch can generate measurable markers that are categorized into tier 1, tier 2 and advanced tier 2.²⁸ Tier 1 is meant to evaluate safety and quality; metrics are amount of blood loss, tumor resection percentage and brain volume removed. Tier 2 is meant to study motor skills; metrics are total tip path length, maximum force applied, sum of forces utilized, average forces utilized and pedal activation frequency. Advanced tier 2 is used to study complex motor and cognitive bimanual skills interactions; metrics are instrument tips average separation distance, efficiency index, simulated aspirator path length index, coordination index, simulated ultrasonic aspirator bimanual forces ratio. These 13 metrics are designed to assess performance and efficiency.

Data produced here are being used to develop validated levels of achievement to separate levels of training. One study compared the performance of residents and attending neurosurgeons and found significant differences when comparing efficiency index, extent of tumor resection and blood loss, with attending neurosurgeons performing better than residents.⁹³ If these significant findings can be converted into benchmarks or milestones and further validated to differentiate students, junior residents, senior residents and attending neurosurgeons from each other, then there is a great deal of potential for educational applications. This, however, only concludes to establish the difference in skill level using the simulator and not the difference in skill level of handling real tissue or performing surgeries. An attending neurosurgeon may score higher in the simulations due to their real-life experience. A junior learner mastering the simulations may not translate to have matching skill level gained through attending real-life experience. A plateau likely exists, but this has yet to be elucidated. The application of simulations may be limited to early learners.

Cost

It is at best difficult to demonstrate that simulation in neurosurgery can provide real benefits to patients and providers, although it appears intuitive that there is value that benefits patients.^36,88,94 However, little research has been done to evaluate the financial feasibility of implementing a program. In an article by Gasco et al, a cost analysis was performed to determine what the financial burden would be on a program that created such a course.⁹⁵

At the University of Texas Galveston, a simulation program was started for the residents. The department developed a simulation curriculum that offered cadaveric simulations, physical simulator products and haptic feedback simulators. They could institute a curriculum with 68 core exercises per year for each resident for $341,978 to start and $27,876.36 each year to maintain it. These costs include materials, equipment, space and OR time. Costs were mitigated by pursuing industry collaboration, obtaining grants and by using equipment rental programs.⁹⁵

While these numbers are not transferrable to every academic program, they do serve as a framework for future endeavors. A simulation program can be expected to have high startup costs, but yearly upkeep fees are considerably less. Whether this model can be applied toward programs with more than one resident per year is uncertain, but likely feasible. Along with cost, the study analyzed the overall improvement in resident performance, with the greatest strides seen in the more junior groups. This again highlights the utility of simulators in providing a safe environment for novice learners to grow.

Future direction

The future is promising for simulators in neurosurgery as they become more engaging and representative of real surgery. However, their widespread use across neurosurgical training has not yet taken hold. In addition to hurdles such as cost and logistics, simulators still face other obstacles. While several studies have sought to provide validity to both the physical models and VR models, they have not been shown to translate to real surgery. They can distinguish experience based on seniority within the simulator itself. It stands to reason that practicing with NeuroTouch or an anterior cervical discectomy and fusion model before operating on a patient would provide optimal results, but there are no studies investigating this. Large randomized controlled prospective studies are currently of high interest to validate the degree of translation from simulation model to patient. Results obtained from these studies may push for the acceptance of simulators in neurosurgical training for the goal of patient safety.

VR with haptic feedback is providing an immersive experience that is approaching real-world scenarios and situations. Breakthrough training simulation using 3-D printing technology holds promise for future simulation practice, proving high-fidelity patient-specific models to complement residency surgical learning.⁹

Conclusion

Advances in imaging, computing power and interface technology have led to significant interest in and successful development of different simulation models to complement traditional neurosurgical training. Sophisticated VR simulators with some haptic feedback and impressive imaging technology have provided novel options for training in neurosurgery. The current models and simulations at our disposal are less than ideal for real-life translation, but significant strides with haptics have been encouraging. Current studies are assessing improvements, scores and skill levels in learners who use simulation models. The horizon will likely change focus on improvements, scores and skill levels in learners when working on real patients. The application of simulation training in neurosurgery may be limited to early learners. With the support of educational agendas led by national neurosurgical committees, industry and new technology, simulators will become readily available, translatable, affordable and effective.

Disclosure

Dr Schirmer reports honoraria from the American Association of Neurological Surgeons, and ownership stakes in Neurotechnology Investors. The other authors report no conflicts of interest in this work.