3,064
Views
0
CrossRef citations to date
0
Altmetric
Medical Education

From static web to metaverse: reinventing medical education in the post-pandemic era

ORCID Icon, ORCID Icon & ORCID Icon
Article: 2305694 | Received 01 Sep 2023, Accepted 06 Jan 2024, Published online: 23 Jan 2024

Abstract

The World Wide Web and the advancement of computer technology in the 1960s and 1990s respectively set the ground for a substantial and simultaneous change in many facets of our life, including medicine, health care, and medical education. The traditional didactic approach has shifted towards more dynamic and interactive methods, leveraging technologies such as simulation tools, virtual reality, and online platforms. At the forefront is the remarkable evolution that has revolutionized how medical knowledge is accessed, disseminated, and integrated into pedagogical practices. The COVID-19 pandemic also led to rapid and large-scale adoption of e-learning and digital resources in medical education because of widespread lockdowns, social distancing measures, and the closure of medical schools and healthcare training programs. This review paper examines the evolution of medical education from the Flexnerian era to the modern digital age, closely examining the influence of the evolving WWW and its shift from Education 1.0 to Education 4.0. This evolution has been further accentuated by the transition from the static landscapes of Web 2D to the immersive realms of Web 3D, especially considering the growing notion of the metaverse. The application of the metaverse is an interconnected, virtual shared space that includes virtual reality (VR), augmented reality (AR), and mixed reality (MR) to create a fertile ground for simulation-based training, collaborative learning, and experiential skill acquisition for competency development. This review includes the multifaceted applications of the metaverse in medical education, outlining both its benefits and challenges. Through insightful case studies and examples, it highlights the innovative potential of the metaverse as a platform for immersive learning experiences. Moreover, the review addresses the role of emerging technologies in shaping the post-pandemic future of medical education, ultimately culminating in a series of recommendations tailored for medical institutions aiming to successfully capitalize on revolutionary changes.

KEY MESSAGES

  1. The evolution of medical education from the Flexnerian era to the digital age provides valuable insight into how medical education has evolved and adapted to changing social needs, technological advancements, and educational paradigm shifts (Education 1.0, Education 2.0, Education 3.0, Education 4.0).

  2. The transition from static web to metaverse applications (Virtual Reality, Augmented Reality, and Mixed Reality) has brought about transformative changes in medical education merging physical and virtual reality, where users interact in real-time to have immersive and interactive learning experiences.

  3. Metaverse platforms enable external collaboration among medical learners, faculty educators, and other healthcare professionals from various parts of the world without the limitations of physical distance allowing them to exchange insights, discuss cases, and learn from diverse perspectives, including opportunities for collaborative research.

  4. Developing strategic implementation plans can help ensure that institutions and faculty educators can harness the benefits of emerging technologies while proactively addressing potential challenges, ensuring a well-rounded and effective learning experience for future medical professionals.

This article is part of the following collections:
The Role of the Metaverse in Medical Education

Introduction

As technology has progressed over the years, it has gradually found its indispensable place within the field of medical education. This integration began to take shape sometime after the release of the Flexner Report in 1910 [Citation1]. When the Flexner Report was written, technology, especially in the context of education, was not as developed and widespread as it is today. The report’s scope was primarily concerned with the structure of medical schools, their facilities, faculty qualifications, curriculum content, and the standardization of medical education [Citation2,Citation3]. Thus, the focus was on addressing shortcomings related to medical school quality, education content, and training methods at the time, rather than examining technology integration into medical education. As we all know, technology’s role in education was not as significant during that historical period. However, the development of computer technology in the 1960s and the World Wide Web (WWW) in the early 1990s paved the way for a profound and simultaneous transformation across various dimensions of education, medical practice, and healthcare delivery. A growing reliance on computers and interconnected communication within medical centers has led to an increase in the importance of biomedical computing experts, which contributes significantly to the provision of quality health care and health data administration. Furthermore, in today’s digital world, technology plays a crucial role in medical education, with simulation-based training, virtual patient scenarios, electronic health record systems, and other digital tools enhancing medical learners’ and other healthcare professionals ‘ learning experiences [Citation4–7].

Much progress has been made with the progression of Internet technologies from a static and one-way information Web 1.0 platform to an interactive, personalized, and intelligent Web 4.0 network over the past three decades. As a result, fundamental changes took place creating new value in shaping the learning experiences of medical professionals and students, and promoting flexible, accessible, and personalized medical education through e-learning or online courses [Citation8]. Moreover, following the COVID-19 pandemic, a significant amount of attention has been paid to e-learning in medical education. With the closure of educational institutions and restrictions on in-person teaching, medical education quickly transitioned to online platforms and institutions rapidly adopted e-learning strategies to ensure continuity of education [Citation9,Citation10]. This radical shift necessitated the development and implementation of more e-learning solutions such as self-paced interactive modules, online courses, virtual lectures, webinars, podcasts, blogs, social media content, and other digital learning resources [Citation11,Citation12]. However, medical professionals have found it difficult to adapt to the sudden switch to an online environment with an unfamiliar mode of teaching, due to their lack of knowledge about how they can meet the educational needs of their learners. Having no substitute plan for the ‘traditional’ classroom approaches of teaching and learning, they encountered challenges such as communication difficulties, learner assessment and evaluation, use of technology tools, online experience, anxiety or stress associated with the pandemic, time management, and technophobia [Citation13]. Furthermore, not knowing various e-learning modalities, technological and pedagogical affordances, and disciplinary differences are overlooked with respect to e-learning instructional design, course delivery format, and selecting suitable technology or learning management systems. Being an expert in the area of online learning field, the first author (KOL) received multiple requests and/or questions from faculty educators internally and externally regarding their challenges and how they can efficiently conduct online teaching. She even prepared an ‘E-learning: Survival guide for medical educators’ [Citation14]. While all these challenges are present, the transition from Static Web 1.0 to the metaverse holds immense promise in transforming how medical professionals are trained, educated, and engaged in ongoing learning.

Metaverse is a 3 Dimensions-based (3D), dynamic immersive, and interconnected virtual space where learners can interact with each other and digital content in real-time. Unlike Static Web 1.0, which primarily focuses on one-way information dissemination, the metaverse introduces elements of virtual reality (VR), augmented reality (AR), and mixed reality (MR) to create a multifaceted learning experience [Citation15]. The metaverse is a composite term, combining ‘meta’ and ‘universe,’ referring to a parallel or virtual environment intricately interconnected with the physical world and this concept has been popularized in science fiction, specifically in the 1992 novel ‘Snow Crash’ written by Neal Stephenson [Citation16]. In the book, the metaverse is depicted as a massive virtual reality-based successor to the Internet, where people can immerse themselves in a virtual world using specialized technology. As the concept continues to evolve, it holds significant promise in revolutionizing how we engage with digital content and interact with others. The use of metaverse or Meta platforms provides a new level of technological and pedagogical flexibility for developing medical professionals’ competencies that include patient care, medical knowledge, procedural training, interprofessional teamwork, diagnostic reasoning, and critical thinking.

In brief, several innovations and the adoption of emerging technologies have become an integral part of modern education, opening new possibilities for medical learners and educators worldwide [Citation17]. The massive changes brought by COVID-19, the explosive growth of recent artificial intelligence (AI), and the new teaching modalities still have lingering effects and seem to have a long-term impact on an entire generation of our learners. It is evident that the world we once knew has changed, and we should leverage these changes to advance medical education. At this point, we need to understand the evolving structure of Web and immersive technologies, including their potential and how to employ them in the learning design of medical education. Furthermore, due to the increasing complexity of technologies from the static Web to the metaverse, medical educators/faculty need in-depth information to be knowledgeable to take a proactive approach in their educational practices, especially to create a contingency plan for unexpected interruptions such as the COVID-19 pandemic. Thus, the purpose of this review paper is three-fold: (1) To explore the impact of Web evolution on medical teaching and curricular levels, examining how each generation of the Web has influenced curriculum design, content delivery, assessment methods, and competency-based medical education. (2) To examine how the metaverse has revolutionized medical education, specifically the integration of VR, AR, and MR technologies in medical curricula and their potential to enhance practical skills training. (3) To discuss the benefits, challenges, and opportunities of these emerging technologies in shaping the future of medical education in the post-pandemic era.

Transformation of medical education over the years

Medical education has undergone a significant transformation and evolution over the years, including the Flexner Report in 1910, the use of scientific methodology that led to the emergence of evidence-based medicine in the early 1960s [Citation18], and the digital revolution in recent years. Initially, the Flexner era brought significant improvements in shaping the modern medical education system in the United States by establishing higher standards, promoting scientific rigor, and ensuring the production of well-trained physicians [Citation1–3]. Its impact is still felt today, and the process of implementing significant changes is continuously evolving by embracing technological advancements, and innovative pedagogical approaches, promoting interdisciplinary collaboration, and fostering compassionate and competent medical professionals. Several key factors have contributed to these changes, shaping the way medical knowledge is taught, medical professionals are trained, and patient care is delivered. To understand and track the drastic changes, we need to look at the Flexner era (Early Twentieth Century) and the Modern era (Twenty-first Century). below highlights some of the key differences in medical education between these two eras, focusing on changes in curriculum, teaching methods, clinical training, patient interaction, and the integration of technology and research.

Table 1. Key aspects of medical education during the Flexner era and Modern era.

The most noticeable advancements in the Modern era placed greater emphasis on diversity/inclusion, global health, interprofessional education, technology integration, and a lifelong commitment to learning. All these changes reflect a shift towards more learner-centered, evidence-based, interdisciplinary, and patient-focused approaches, addressing the changing needs of healthcare and society.

The evolution of the World Wide Web and its impact on medical education

Since the invention of personal computers (PCs) in the 1980s, the WWW has continued to evolve from Web 1.0 to Web 4.0, including the growing amount of data that is exchanged and coordinated using digital technologies like artificial intelligence (AI), the Internet of Things (IoT), cloud computing, and cognitive computing [Citation8,Citation19]. These different phases and versions of the Web represent major shifts in the way people interact with the Internet and the technology-enhanced services offered to them. In the medical education concept, each generation of the Web has influenced curriculum design, content delivery, assessment methods, and competency-based medical education. presents descriptions of the four generations of the Web and their learning paradigms [Citation8,Citation19,Citation20,Citation21].

Table 2. Evolution of the WWW from Web 1.0 to Web 4.0.

Note: IoT-enabled devices or objects can range from everyday devices like smartphones, smartwatches, and home appliances to more specialized equipment used in industries, such as environmental sensors, medical devices (e.g. fitness trackers, smart insulin pumps), AirTag beacons, traffic management systems and industrial machinery [Citation19,Citation22,Citation23]

It is important to note that the transition from one Web phase to another is not strictly linear, and different elements of each phase can coexist. The concept of Web 4.0 is still evolving, and its full realization remains the subject of ongoing research and innovation. As indicated in , potential applications in medical education include virtual patient simulations, personalized learning algorithms, and AI-driven diagnosis and treatment recommendations. Moreover, telemedicine and telehealth could be seamlessly integrated into Web 4.0, enhancing access to medical expertise and remote learning opportunities. It is obvious that Web 4.0 continues to develop and has not yet reached its full potential. As an extension to Web 4.0, Web 5.0 is emerging to be a sensory and emotive capabilities, allowing users to engage with the Internet through immersive experiences that evoke and respond to human emotions [Citation19,Citation24,Citation25]. All these advancements in technology have created a different version of education.

The evolution of education from Education 1.0 to Education 4.0

Both Internet technologies and education are evolving, and their developments or advancements always influence and complement each other as a response to the changing needs of education and learners. The Internet serves as a catalyst for the digitalization and distribution of educational content, promotes distant learning methods for interactive and collaborative learning, and creates new avenues for knowledge access to produce a whole new educational experience [Citation26]. The evolution of education is evidence of humankind’s capacity for innovation, adaptation, and acceptance of change in all its forms. Every stage of education, from traditional classrooms to the digital frontier, has shaped the way we learn, teach, and interact with knowledge. Education 1.0 established the foundation, Education 2.0 fulfilled the demands of industrialization, and Education 3.0 tapped into the potential of the digital era [Citation27]. On the other hand, the progression from Education 1.0 to Education 4.0 somewhat draws parallels with the industrial revolution eras, specifically Industrial 1.0 to Industrial 4.0. While this analogy is often used to describe the evolution of education in response to technological advancements, the concept of parallelism is not perfect because education is a complex and multifaceted system influenced by various factors, including societal needs, cultural shifts, and pedagogical advancements. However, both industrial evolution and education demonstrate a parallel path toward the transitions from Health 1.0 to Health 4.0 due to the changing nature of technological advancements and toward more intelligent, innovative, and technologically integrated approaches [Citation28]. illustrates how the Web, education, and healthcare have evolved over the years ().

Figure 1. Evolution of the Web, education and healthcare.

Figure 1. Evolution of the Web, education and healthcare.

As we enter the era of Education 4.0, individualized/personalized learning experiences are being driven by cutting-edge technology, which is also fostering a culture of constant improvement [Citation29]. provides an overview of the main attributes associated with four generations of educational eras, highlighting distinctions in learning design across each phase.

Table 3. Major traits of the four educational generations.

As seen in , the variations and salient features in each generation’s approach illustrate the remarkable advancements and how our teaching and learning design have changed over the years. Medical education is no different and the evolution of medical education is a continuous process. Recognizing the potential and benefits of internet-based technology, medical institutions have developed a variety of approaches to enable more learner-centered and individualized types of more accessible education [Citation8]. Thus, today’s medical education has been trying to leverage technology-enhanced learning methods that represent metaverse concepts such as virtual simulations, virtual reality, augmented reality, mixed reality, and e-learning modules to facilitate interactive and immersive learning experiences for medical professionals and students. Some of the novel assessment methods in medical education include milestones assessments, objective structured clinical examinations, simulation-based assessments, electronic portfolios, and team-based assessments [Citation30–35]. These methods represent advancements compared to previous methods prevalent in Education 1.0–3.0 because they provide standardized and structured evaluations of clinical skills, offer realistic and immersive learning experiences, allow for continuous tracking of student progress, and emphasize teamwork and interprofessional collaboration, ultimately improving the preparation of students for real-world medical practice. Their use may facilitate a more comprehensive and objective assessment of students’ abilities and enhance their learning outcomes.

The evolution from Web 2D to Web 3D: Implications for medical education

Through continuous technological advancements, virtual worlds have evolved from 2 Dimensions (2D) to 3 Dimensions (3D) that support virtual technologies [Citation15]. 2D technology-enhanced learning refers to the use of two-dimensional digital media to deliver educational content. This can include text, images, videos, presentations, and interactive elements. On the contrary, 3D technology-enhanced learning utilizes three-dimensional digital media to create immersive and interactive educational experiences [Citation36]. It goes beyond flat images and text, presenting content in a more lifelike and engaging manner. While both methods utilize technology, they offer different ways of presenting and interacting with educational content as illustrated in .

Table 4. Differences between traditional 2D content and 3D Web-based content.

Both 2D and 3D technology-enhanced learning have their unique advantages and are often used in combination to create comprehensive and engaging educational experiences. While 2D learning is more accessible and widely used, 3D learning offers a more immersive and interactive approach, particularly suitable for medical education that benefits from hands-on exploration and visualization. For example, 3D learning can facilitate interactive anatomy lessons, enabling learners to explore and interact with detailed digital anatomical models for better understanding and retention of complex structures. The evolution of 3D virtual worlds will be an ongoing advancement since the potential for 3D virtual worlds is enormous to provide more realistic and interactive learning experiences in virtual spaces.

Metaverse and its applications in medical education

The origin of the metaverse can be traced back to science fiction literature as mentioned above, but the development of the metaverse concept and its application in medical education is a gradual progression that builds on advancements in technology, pedagogical approaches, and the desire to create more immersive and effective learning experiences. At this point, the integration of metaverse technologies into medical education and practices is still an emerging field with great potential. Furthermore, these technologies have the capability to enhance medical training, improve patient care, and advance medical research.

The metaverse is not limited to a single technology or platform but refers to a network of interconnected virtual spaces that exist within the broader spectrum of interactive and immersive digital experiences. These technologies include VR, AR, and MR that form the components of Extended Reality (XR), seamlessly integrating various digital and interactive experiences into a cohesive digital universe [Citation36–38]. While sharing certain similarities, each component of XR possesses distinctive characteristics, as well as unique pedagogical and technological affordances within this evolving digital landscape.

As technology advances, these three concepts can be combined to create more comprehensive educational experiences. For example, a medical learner might use VR to explore the human body, and then switch to AR to practice a surgical procedure on a physical model. This may give more learning opportunities in a variety of activities across multiple virtual and/or physical spaces. Another example can be virtual physician-patient interactions through metaverse applications mimicking and complementing standardized patient simulations. Physicians use AR and MR to examine patients, discuss diagnoses, and recommend treatments through remote consultations and telemedicine services. We can expand these examples to include collaborative medical conferences in virtual reality and medical training scenarios in shared virtual environments [Citation9,Citation39]. Overall, VR, AR, MR, and the metaverse are interconnected concepts that utilize 3D technology to create immersive and interactive experiences (). Each term represents a different level of immersion and interaction with the digital and physical worlds, with the metaverse being a more comprehensive concept that envisions a network of interconnected virtual experiences.

Benefits and challenges of the use of metaverse in medical education

The concept of a metaverse in medical education, which involves using virtual and augmented reality technologies to create immersive and interactive learning environments, has the potential to revolutionize how medical education is delivered. The use of the metaverse in medical education has several benefits and creates new opportunities that may be grouped under the following categories.

  1. Learner Engagement: Traditional educational methods usually fail to maintain students’ attention and interest, which results in passive learning. The metaverse, on the other hand, increases learner engagement with dynamic, interactive information that suits a variety of learning preferences and needs. We can foster different types of engagement such as academic, behavioral, cognitive, and affective engagement [Citation41] Through gamification, simulations, and interactive scenarios, learners can actively participate in the learning process, making education more enjoyable and effective. In particular, gamification principles that can elevate engagement and learning in metaverse applications include providing clear challenges, a personalized scoring/reward system, and individual pathways for learners to progress through the material and achieve mastery over time. Additional gamification strategies may enable social connections between learners, incorporating storytelling elements, allowing avatar customization, and building in surprises/secrets for learners to discover. The decision-making processes can be gamified to provide immediate feedback and consequences, fostering a dynamic learning environment. This pedagogical integration aligns seamlessly with the principles of Education 4.0, emphasizing adaptive, personalized, immersive, exploratory, collaborative, and technology-driven learning experiences [Citation42]. Research is still needed to optimize the balance between gamification and actual learning outcomes in next-generation medical training.

  2. Immersive Learning Experiences: The metaverse allows medical learners to immerse themselves in realistic 3D environments, such as virtual hospitals or surgical suites, providing hands-on experience without the risks associated with real-world practice. This level of immersion fosters experiential learning, allowing learners to apply theoretical knowledge in practical scenarios. As a result, learners can build confidence, hone their patient care skills, and develop a deeper understanding of complex concepts, ultimately translating into better-prepared medical professionals.

  3. Personalized Learning and Skill Development: The metaverse can adapt to individual learning preferences and paces, providing customized learning experiences that cater to each learner’s needs. Medical learners can practice a wide range of clinical skills and procedures in a safe and controlled virtual environment. This can accelerate skill acquisition and improve muscle memory before performing procedures on real patients.

  4. Novel Assessment and Evaluation Methods Coupled with Metaverse Applications: The collection of discrete, nuanced, and real-time data on trainee or team processes (such as behavior, visual attention, speech analysis, and emotional arousal) that unfold over time and that have previously been difficult or impossible to observe is now possible with the help of new high-fidelity sensor technology and computational models [Citation43]. Real-time team behavioral data collection can uncover significant correlations, spot patterns, and give each member personalized, learner-specific feedback. Multimodal learning analytics has the potential to prepare the next generation of healthcare professionals to provide patients with the best care possible.

  5. Collaboration Opportunities and Accessibility: The metaverse enables medical professionals from around the world to collaborate and learn together in shared virtual spaces, fostering a global community of learners and experts. This platform breaks down geographical barriers, making education accessible to individuals around the world. Learners from remote or underserved areas can access high-quality education without the need to relocate. Moreover, the metaverse enables unprecedented opportunities for external or global collaboration. Medical students, practitioners, and experts who are physically separated or from different countries can come together in shared virtual spaces to exchange knowledge, discuss cases, and collaborate on research projects [Citation44,Citation45]. This diverse and international perspective enriches learning, exposes learners to different healthcare systems, and encourages a broader understanding of medical practices. Other benefits can be listed as follows:

    • Learners can connect with leading experts and educators from different parts of the world, accessing insights and knowledge that might not be readily available locally.

    • Collaborating with peers and mentors from diverse backgrounds enhances cultural competency and prepares future professionals to deliver patient-centered care in a globalized environment.

    • Global collaboration in the metaverse can spur joint research initiatives and inspire creative solutions to medical problems that require a range of skills.

  6. Cost Efficiency: Metaverse-based approaches have the potential to greatly expand access and lower delivery costs per student for simulated clinical training. However, institutions must weigh the upfront investments needed in both technology infrastructure and human capital required to build and sustain these next-generation platforms. Specifically, current best practices involve manikin-based medical simulation which is limited by the availability of adequate facilities (physical, space, equipment), human resources, and scheduling challenges in many community, rural, and under-resourced hospitals, leading to inequity in access to training and contributing to disparities in care [Citation46]. In contrast, the metaverse offers a promising solution with an average headset cost of $430 [Citation47], allowing populations worldwide to access remote training at their convenience and at a fraction of the cost associated with conventional medical simulation training. However, to maintain the overall cost-effectiveness of this approach, institutional IT support and infrastructure costs must be carefully managed. The metaverse also excels in learner assessment by providing cost-effective automatic scoring and learning algorithms with real-time feedback [Citation48]. This not only enhances the educational experience but also allows learners to access medical content from anywhere, reducing the need for physical presence in a specific location. This aspect is particularly valuable for remote or underserved areas. While prioritizing cost efficiency for individual learners is crucial, adopting a holistic approach that considers both individual and institutional perspectives becomes essential for the successful and sustainable integration of the metaverse in medical education ().

Table 5. Immersive technologies.

We listed multiple benefits of metaverse applications in medical education, but some several challenges and obstacles must be carefully addressed to ensure successful implementation. Some of the key challenges include:

  1. Technical Limitations and Access: Not all learners may have access to the necessary hardware and high-speed internet required for seamless metaverse interactions, creating potential disparities in access, and learning opportunities. High-performance computers or devices, fast internet connections, and compatible peripherals (such as VR headsets) are often needed for seamless interactions. Technical limitations could hinder widespread adoption, especially in regions or communities with limited access to advanced technology.

  2. Content Quality and Accuracy: Ensuring that the content within the metaverse is accurate, up-to-date, and aligned with established medical standards is crucial to avoid misinformation. In medicine, precision is critical, and inaccuracies in simulations or scenarios could lead to improper training and potentially harm patient safety. At this point, encouraging collaborative content development fosters unity in simulation creation while this collaboration helps the establishment of consistent standards through standardization, working with accreditation bodies and professional organizations to uphold consistency, accuracy, and quality. Furthermore, robust peer review processes, quality assurance frameworks, and ongoing professional development help preserve the integrity of the content and keep faculty educators current in their teaching. Other strategies may include transparent reporting of the education recourses, fact-checking mechanisms, periodic content updates, informed by subject matter experts to create a dynamic framework for maintaining high-quality, accurate metaverse-integrated content in medical education.

  3. Faculty and Learner Training: Transitioning from traditional teaching methods to the metaverse can be challenging for both faculty educators and learners. Faculty need training in the new technology, and pedagogical knowledge for effective design principles and content delivery, while learners may require time to adapt to the new learning environment and tools [Citation49].

  4. Existing Curricula and Resistance to Change: Incorporating metaverse experiences seamlessly into existing medical curricula can be challenging and require careful planning. Further, resistance to adopting new technologies and methods is a common challenge. Some faculty or institutions may be hesitant to embrace the metaverse due to concerns about disrupting established teaching practices or a lack of familiarity with the technology.

  5. Lack of Human or Physical Interaction: Traditional medical education often involves strong mentor-learner relationships and interpersonal interactions that might be less prominent in virtual learning environments. The metaverse, while immersive, may not fully replicate the tactile and emotional aspects of real-world patient interactions (e.g. lack of the emotional and human aspects of face-to-face interactions). As we all know, patient care relies on empathy and interpersonal skills, and overreliance on virtual experiences could potentially lead to a loss of these crucial attributes.

  6. Data Privacy and Security Concerns: Effectively managing sensitive medical data within virtual environments requires robust security measures to protect patient confidentiality and ensure compliance with medical privacy regulations [Citation38]. Collecting and processing user data within the metaverse raises privacy and security concerns, given the inherent sharing of personal information, behaviors, and interactions. To address these challenges, a multifaceted strategy is crucial, beginning with the establishment of stringent security standards to safeguard sensitive data and maintain the integrity of educational platforms. This effort is necessary for digital partnership [Citation50] and collaborative engagement among academic institutions, IT companies, and cybersecurity specialists for continuous assessment and improvement of the security infrastructure. It is also critical to raise awareness and instruct users on cyber-security recommended practices. This covers users who interact with the metaverse for educational reasons, such as faculty instructors and learners. Creating a combination of security-focused platform engineering, comprehensive governance policies, widespread culture and training programs, advanced monitoring systems, and collaborative expert teams may go a long way toward making the learning environment safer and upholding stakeholders’ trust.

  7. Learner Data Accuracy and Reliability of AI Algorithms: This involves addressing biases, ensuring transparency in AI decision-making, and regularly validating and updating algorithms to align with evolving medical knowledge and practice standards. There is a need to establish clear guidelines and standards for using AI-driven assessments to ensure fair and equitable evaluation of learners’ competence and performance.

  8. Legal and Ethical Issues: Medical education strongly emphasizes the value of ethical judgment. Medical learners should be taught how to address ethical challenges and the benefit of having informed discussions about how to approach ethical dilemmas and make judgments [Citation48]. The metaverse introduces complex legal and ethical considerations. Therefore, issues related to medical liability, informed consent for simulated procedures, and the boundaries of medical practice in virtual environments need careful thought and regulation.

  9. Maintenance and Updates: The metaverse requires consistent maintenance, updates, and technical support to ensure a seamless user experience. Failing to address technical glitches or keep content current could lead to frustration and hinder learning outcomes.

  10. Cost Implications: Metaverse technologies can be costly to develop, implement, and maintain. The initial investment in hardware, software, content creation, and ongoing updates can strain the budgets of institutions or individuals with limited financial resources. The cost could become a significant barrier to entry for both learners and faculty.

In summary, the adoption of the metaverse in medical education offers numerous benefits, from immersive learning to global collaboration. However, addressing technology barriers, ensuring content quality, and managing human interaction and data security challenges are critical for its successful implementation. Addressing these challenges requires a multifaceted approach that involves collaboration between technology developers, educators, policymakers, and regulatory bodies. Finding solutions to technical, financial, ethical, and accessibility concerns is crucial to realizing the full potential of the metaverse in medical education. In addition, provides a comprehensive comparison of the benefits and challenges associated with the specified dimensions of using the metaverse in medical education.

Table 6. Benefits and challenges of the use of metaverse.

Case studies and examples of metaverse applications

We have compiled a selection of ten case studies that showcase the innovative spirit and underscore the potential for transformative learning experiences in medical training and education (see Supplementary Appendix 1). Through these initiatives, the impact on learner satisfaction and performance became evident, reinforcing the metaverse’s role in shaping the future of medical education. The metaverse has proven transformative, particularly in the field of anatomy and surgical training [Citation50–58] and patient outcomes [Citation60]. Some examples of the use of AR in surgery can be coupled with better performance of the actual surgical procedure itself and can overlay patient-specific anatomical information obtained from imaging scans, such as in spinal surgeries [Citation61,Citation62], transrectal prostate biopsy [Citation63], renal surgery [Citation63–66]. Other platforms are also available for teaching colonoscopies, such as GI Mentor™ and EndoVR™ (CAE Healthcare, the old AccuTouch®, Immersion) [Citation68], hysteroscopies such as EssureSim [Citation69], and complicated tibial shaft fracture surgical techniques [Citation70]. Further, virtual patients and immersive technologies are integrated into medical curricula, significantly enhancing learning experiences. Various medical schools, including NYU Langone Health Grossman School of Medicine and Stanford University, leverage VR and AR for anatomy education and surgical training, contributing to improved skills, learner satisfaction, and performance [Citation71].

In the context of treatment options, the metaverse, particularly through VR, proves effective for therapeutic goals in various medical conditions such as phobias, anxiety disorders [Citation72], rehabilitation [Citation72–76], Parkinson’s disease [Citation78], pain management and Angelman syndrome, a genetic neurological disorder resulting in cognitive and neuromuscular impairments [Citation79]. Integrating metaverse applications enhances learner engagement, nurtures clinical decision-making proficiencies to advance patient care, and bridges theoretical knowledge with practical implementations in medical training.

In addition, the metaverse plays a role in public awareness, with applications like the Immersive Nutrition Game and the Whyville platform demonstrating its potential for health education [Citation80,Citation81]. These platforms engage users in virtual environments to promote understanding of health consequences, encourage informed decision-making, and even facilitate public health campaigns. Moreover, the metaverse extends beyond clinical applications to support integrative medicine and mindfulness practices (e.g. yoga and guided meditation), contributing to overall wellness using the Roblox metaverse [Citation82]. Overall, the metaverse emerges as a transformative force with the potential to revolutionize medical education, treatment options, and public awareness across diverse aspects of the medical field.

Emerging technologies and reshaping the future of medical education in the post-pandemic era

In response to the growing demand for training medical professionals in VR and AR environments, a software platform [Citation83] was developed to simplify the creation of Interactive Mixed Reality (IMR) scenarios. These scenarios aim to replicate clinical settings by integrating patient physiology, emotions, and team dynamics. Overcoming the complexity associated with incorporating such parameters, the IMR platform combines elements like 360-degree video recording, annotated knowledge content, and assessment questionnaires into IMR scenarios. A sepsis prevention education scenario was created to demonstrate how this software accelerates novice students’ clinical exposure. The efficacy of IMR technology was evaluated through a study involving 28 novice students, with feedback collected using NASA-TLX and system usability scale questionnaires. This software advancement represents a step towards streamlining the development of VR-based medical education content, offering a promising tool for enhancing medical training [Citation83].

Similarly, another theoretical model to teach the cardiovascular system and interventional procedures, termed CardioVerse, was developed [Citation84]. CardioVerse opens a world of opportunities within the metaverse. It brings new ways of learning about diseases, preventive strategies, and diagnostic accuracy. It has many uses, especially in improving doctor visits, helping with heart treatments, and changing medical education. While there will be challenges in areas like security, technology, laws, and rules, using unique tokens to secure patient information might be a way to solve this issue.

As metaverse technology evolves, we expect more advanced and realistic virtual environments, simulations, and AI-driven patient interactions. A comprehensive framework for metaverse-based medical education may include the following.

  • Virtual Medical Campuses: Institutions can establish virtual campuses within the metaverse, replicating real-world medical facilities, classrooms, libraries, and laboratories.

  • Simulation Centers: Advanced simulations can provide realistic medical scenarios, enabling learners to practice skills and decision-making in a controlled environment.

  • Global Networks: Virtual conferences, seminars, and collaborative spaces can facilitate networking and knowledge-sharing among learners and professionals worldwide.

  • Continuous Assessment: AI-powered assessments can provide real-time feedback, allowing learners to track their progress and make informed adjustments to their learning strategies.

The metaverse can help prepare learners for the challenges of practicing medicine in the twenty first century and beyond by providing access to immersive virtual environments, global collaboration opportunities, and continuous feedback. However, careful planning, collaboration with technology experts, professional development of faculty members, and ongoing evaluations are essential for ensuring the success of this endeavor. Challenges such as the need for robust technical infrastructure, ethical considerations surrounding AI-driven patient interactions, and potential overreliance on virtual environments should also be considered.

In addition, navigating the dynamic landscape of technological evolution in medical education requires a strategic approach beyond the adoption of the latest innovations. Therefore, it is important to recognize that the objective is not only to adopt the latest technologies but also to leverage them effectively for educational enhancement. We believe that the process of learning will always require effortful thinking, and technology is powerful yet merely a tool to foster this process. While predicting a potential level of the need for advanced technology in medical education remains challenging, the overarching goal is to establish educational frameworks that evolve in harmony with technological progress, always emphasizing technology as a tool to meet the changing needs of healthcare as well as to enhance learning outcomes, patient care, and the overall educational experience.

Recommendations for medical institutions

This section provides recommendations for effectively incorporating the metaverse into the medical education curriculum. These recommendations are based on the best practices in curriculum development [Citation85,Citation86] and emerging research in this field.

Step 1: foundational work

Developing a metaverse curriculum involves careful planning and preparation to ensure its success. The following foundational work should be performed diligently:

  • Readiness or Needs Assessment: Readiness or needs assessment is a critical step as a starting point for any project, program, or initiative. While a readiness assessment focuses on evaluating the readiness and capacity for change or implementation, a needs assessment uncovers the specific requirements and deficiencies and/or identifies specific gaps, necessary conditions, resources, skills, and support. Both assessments play crucial roles in decision-making, planning, and resource allocation in various contexts.

  • Collaboration with Stakeholders: Collaboration with stakeholders such as faculty educators, learners, industry partners, and technical experts is a key element in designing and implementing successful educational programs like metaverse. By fostering collaboration with these stakeholders, we can address the needs, expectations, and expertise of all parties involved, which helps create a well-rounded and comprehensive curriculum. This collaborative approach not only enhances the quality of the curriculum but also leads to higher engagement, better outcomes, and a more positive learning experience.

By undertaking these initial tasks, we set a solid foundation for the development of a successful and impactful metaverse curriculum.

Step 2: curriculum design and development process

Designing and developing a curriculum for a metaverse environment requires input from various stakeholders to ensure its effectiveness and relevance for specific medical disciplines. Here are the essential tasks for each party:

  • Faculty Educators: As content experts and agents of change, faculty educators should define the scope of the metaverse curriculum, including the topics and skills to be covered. Their insights ensure that the curriculum aligns with educational goals and pedagogical strategies.

  • Instructional Designers: Instructional designers, who specialize in technology-enhanced learning, play a crucial role in creating a cohesive, effective, and engaging learning experience that would harness the capabilities of virtual environments for educational purposes. They can organize the metaverse curriculum into modules or units and outline learning outcomes for the greatest interactive learning experiences using the best instructional design principles, theoretical concepts, pedagogical tactics, and appropriate assessment strategies.

  • Evaluation and Assessment Specialists: Including evaluation and assessment specialists in the development of a metaverse curriculum ensures that the assessment and evaluation strategies are aligned with desired learning outcomes and the overall curriculum goals, promote effective learning, and provide valuable insights into learner progress and engagement.

  • Learners: The input from learners as the end users and the target learner population contributes to a curriculum that is academically rigorous and impactful for their personal and professional growth. Their involvement also helps tailor the curriculum to their specific needs and learning preferences by selecting the best pedagogies for an effective educational environment.

  • Ethics Experts: When dealing with sensitive medical content, we need specific guidelines and protocols for using AI-driven patient interactions and virtual scenarios ethically. At this point, including ethics experts in the curriculum development process ensures that learners are not only gaining technical skills but are also equipped with a deep understanding of ethical considerations, fostering responsible and ethical professionals within the metaverse context. Ethics experts can also guide the development of metaverse scenarios involving AI-driven patient interactions to ensure that patient privacy, confidentiality, and other ethical dilemmas are well-constructed and maintained even in virtual environments.

  • Technical Experts and Industry Partners: Incorporating technical experts and industry partners in the development of a metaverse curriculum plays a critical role in translating the educational vision into a functional and engaging metaverse curriculum. They are familiar with metaverse platforms, VR, AR, and other related technologies that would help select appropriate metaverse platforms, tools, and technologies based on the nature of the curriculum. Their expertise ensures that the technological aspects align with the pedagogical goals, creating a seamless and impactful learning environment for learners and faculty educators. In addition, depending on the subject area, we can consult relevant industry professionals’ insights to ensure that the curriculum aligns with real-world applications and industry trends.

Other important stakeholders would be research and development teams, institutional leaders, and community partners depending on the needs. By involving a diverse group of stakeholders, we gather insights from multiple perspectives, ensuring that the curriculum design is comprehensive, effective, and meets the needs of all parties involved. This collaborative approach results in a curriculum that is well-rounded, engaging, and aligned with the goals of metaverse-based education.

Step 3: curriculum implementation

The implementation stage is a critical phase for a metaverse curriculum because it is the point at which the carefully designed curriculum is put into action in a real setting. This stage allows learners to engage with content/learning materials, apply knowledge, and develop skills within an immersive virtual environment. However, the following are the essential steps to take before the actual implementation of the full curriculum with the end users:

  • Professional Development: Faculty educators should be trained in technology and pedagogical efficiency to become more proficient in using metaverse tools, platforms, and related technologies. Institutions can offer ongoing training workshops and webinars to help faculty, staff, and learners develop their metaverse teaching and learning skills, emerging technologies, and instructional design principles specific to virtual environments. Professional development activities can be designed to foster a sense of community where educators can share best practices and learn from each other.

  • Learner Orientation: An effective orientation session should start with a guided tour that shows learners how to move around, access resources, engage with avatars or virtual objects, and perform basic interactions. This session should also cover expectations that would maximize the learning experience within the metaverse. In this way, learners can navigate the metaverse curriculum with confidence and enthusiasm.

  • Piloting Curriculum: Piloting a curriculum involves implementing it on a small scale before introducing the curriculum to a wider audience. This test run helps us identify possible problems, gather feedback, and make necessary adjustments. At the same time, piloting provides faculty educators with a hands-on experience of how the curriculum works in real practice settings.

  • Implementation At Scale: Deploying the metaverse curriculum to a large number of learners on a widespread basis requires robust infrastructure to support the Extended Reality (VR, AR, and MR) environment and ensure uninterrupted access for users. Continuous monitoring and evaluation allow for feedback-driven improvements and the identification of best practices to enhance the learning experience and gains in the metaverse.

The immersive nature of the metaverse environment has the potential to significantly enhance learner engagement and motivation. As learners become more invested in their learning experiences, they can develop practical skills and competencies through the interactive and dynamic nature of the curriculum. During the implementation stage of metaverse-based medical education, it is crucial to address global disparities in access to technology and resources. This obstacle to equality requires collaborative efforts from various stakeholders, including governments, educational institutions, and technology providers. Strategies such as providing affordable access to the necessary infrastructure, fostering international partnerships, and developing tailored solutions for different regions can contribute to a more inclusive implementation. Moreover, prioritizing inclusion is crucial to preventing additional gaps in medical education, especially in light of the special conditions of developing countries. We may aim for a more equal integration of the metaverse in medical education globally by fostering international collaboration and conversations towards solutions. In addition, collecting data on learner interactions, engagement, and performance during the implementation stage provides valuable insights into the effectiveness of the curriculum. This data-driven approach informs decisions for future iterations, ensuring continuous improvement and adaptation to diverse learning needs.

Step 4: evaluation and continuous improvement

Evaluating a metaverse curriculum is a systematic process to measure its effectiveness, capture learner satisfaction, identify areas for improvement, and ensure that the intended learning outcomes are achieved (e.g. knowledge, skills, and competencies). This evaluation provides valuable insights into the impact of the curriculum on learners, faculty educators, and the overall educational process. Moreover, it fosters a culture of continuous improvement based on data-driven insights, ensures alignment with educational goals, and enhances the overall quality of the learning experience within the virtual environment. Finally, ongoing evaluation helps us explore innovative ways to update the curriculum content and pedagogical approaches based on emerging trends and metaverse-based technologies.

By following these steps, we can design, implement, and evaluate a metaverse curriculum that effectively engages learners and prepares them for the evolving digital landscape.

Conclusion

The evolution of medical education from the Flexnerian era to the present time has been marked by the integration of advanced technologies catalyzing a significant revolution, including the metaverse, which has expanded learning opportunities, enriched the educational experience, and transformed medical training into dynamic, immersive, and multidimensional learning opportunities. As we addressed in this review paper, the advent of the WWW ignited a revolution in access to medical information, reshaping how medical students and professionals acquire knowledge. The transition from traditional Education 1.0 to dynamic Education 4.0 ushered in new paradigms of learning, emphasizing adaptability and digital fluency. The emergence of the metaverse has already presented a paradigm shift, offering innovative and interactive platforms moving from the static Web 2D to the immersive Web 3D that bridge the gap between theoretical learning and practical application.

The transition from static Web platforms to immersive metaverse environments promises to revolutionize medical learning. The metaverse offers immersive simulated environments that can provide impactful experiential learning at scale. Integrating virtual, augmented, and mixed reality facilitates experiential learning through real-time simulations that merge physical and digital worlds. This interactivity promotes competencies like clinical reasoning, communication, teamwork, and empathy. Educators can leverage these technologies to create inclusive medical simulations that adapt to diverse learning needs. The personalized practical experiences refine clinical skills and decision-making capabilities in safe settings. As we have provided examples from case studies across various medical disciplines, the metaverse has the power to provide medical learners with hands-on experiences, collaborative learning environments, and realistic simulations. These examples underscore the metaverse’s capacity to revolutionize medical education and better prepare future healthcare professionals for the complexities of real-world practice. Furthermore, international collaboration is also made possible by the metaverse, allowing learners and experts from all over the world to connect at any time, from anywhere. This expands professional networks and perspectives, bringing together diverse skills and knowledge to enrich medical education. The metaverse also facilitates telemedicine and global outreach to underserved communities.

While metaverse offers immersive, interactive, and captivating learning experiences that have the potential to completely transform medical education, certain aspects of medical education could be difficult to completely replace or require careful thought when incorporating the metaverse. Especially, there may be no substitute for the fundamental components of hands-on practical clinical experience, the diversity of real patients, essential skills like physical examinations and communication, emotional intelligence, ethical dilemmas, and the nuances of interprofessional/multidisciplinary collaboration. Therefore, a balanced approach should be adopted in order to avoid misuse of the metaverse while maintaining the essential components of practical training.

As we look ahead to the post-pandemic era, emerging technologies will play a significant role in shaping the future of medical education. The lessons learned from the pandemic’s impact on education underscore the importance of blended learning approaches, where virtual and physical experiences are thoughtfully integrated. Medical institutions must embrace these changes, redefining their strategies to ensure learners are equipped with the skills and competencies demanded by a rapidly evolving healthcare landscape. However, thoughtfully addressing access barriers, content accuracy, data privacy, legal concerns, and ethical issues is vital for the successful implementation of metaverse-based solutions. Developing strategic plans through stakeholder collaboration helps institutions harness benefits while mitigating challenges. Careful planning, faculty development, and collaboration between educators, technologists, and policymakers are key. Gradually transitioning from static Web learning models to more interactive, personalized, and immersive platforms can bridge theory with practice and enhance the quality of medical education.

In brief, medical institutions must adopt a proactive approach, embracing emerging technologies to reshape medical learning and practice. Realizing the full potential of innovations requires investing in cutting-edge technology infrastructure, fostering collaboration between faculty educators and technologists, designing adaptive curricula, and integrating contemporary teaching methods/instructional approaches all in alignment. As technology progresses, medical education must also continue to reinvent itself, adapting creative solutions to transform how the next generation of physicians are prepared to meet society’s evolving healthcare needs. In this way, medical institutions can pave the way for a future where medical education not only keeps pace with technological innovation but also becomes a cornerstone of groundbreaking healthcare delivery. Finally, in this comprehensive review, our focus has been primarily on the diverse landscape of metaverse applications, encompassing simulations, virtual reality, augmented reality, and mixed reality experiences tailored for medical education. Our analysis did not include an exploration of Multi-user Virtual Environment (MUVE), Large Language Programs (LLPs), mobile learning, metaverse-related social networking, and collaboration tools. To provide a more holistic perspective, future research could delve into how those programs and tools are integrated into metaverse platforms in terms of accessibility, adaptability, and scalability in the evolving landscape of medical education.

Authors contributions

KOL played a pivotal role in the conception and design of this review paper. All authors were actively involved in drafting and revising the manuscript, and they collectively approved the final version for submission. We all conducted extensive literature searches, gathered relevant research articles, and synthesized the information to form the core content of the review. VP contributed to providing comprehensive insights into the main context of the overall structure and coherence of the paper, ensuring the logical flow of ideas and a cohesive presentation. SSF focused on analyzing case studies and practical applications, enhancing the paper’s real-world relevance. The first author’s leadership in the design of this paper and drafting, coupled with the valuable contributions of co-authors, led to the production of a comprehensive and informative review on the evolution of medical education from the static Web to the metaverse.

Supplemental material

Supplemental Material

Download MS Word (52.5 KB)

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The author(s) reported there is no funding associated with the work featured in this article.

References

  • Flexner A. Medical education in the United Sates and Canada. Science. 1910;32(810):1–20. doi: 10.1126/science.32.810.41.
  • Bailey M. The flexner report: standardizing medical students through region-, gender-, and Race-Based hierarchies. Am J Law Med. 2017;43(2–3):209–223. doi: 10.1177/0098858817723660.
  • Duffy TP. The flexner report–100 years later. Yale J Biol Med. 2011;84(3):269–276.
  • Guze PA. Using technology to meet the challenges of medical education. Trans Am Clin Climatol Assoc. 2015;126:260–270.
  • Lee J, Kim H, Kim KH, et al. Effective virtual patient simulators for medical communication training: a systematic review. Med Educ. 2020;54(9):786–795. doi: 10.1111/medu.14152.
  • Lees AF, Beni C, Lee A, et al. Uses of electronic health record data to measure the clinical learning environment of graduate medical education trainees: a systematic review. Acad Med. 2023;98(11):1326–1336. doi: 10.1097/ACM.0000000000005288.
  • Lövquist E. Simulation-based medical training: a user-centered design perspective. Newcastle upon Tyne: Cambridge Scholars Pub; 2011.
  • Lewis KO, Cidon MJ, Seto TL, et al. Leveraging e-learning in medical education. Curr Probl Pediatr Adolesc Health Care. 2014;44(6):150–163. doi: 10.1016/j.cppeds.2014.01.004.
  • Salavitabar A, Popov V, Nelson J, et al. Extended reality international grand rounds: an innovative approach to medical education in the pandemic era. Acad Med. 2022;97(7):1017–1020. doi: 10.1097/ACM.0000000000004636.
  • Samuel A, King B, Cervero RM. Medical school faculty perceptions of online education: implications for the future of medical education. Am J Distance Educ. 2023. doi: 10.1080/08923647.2023.2210492.
  • Maska E, Rosenberg EI, Verstegen D. 2019. Teaching in the electronic era: medical records and social media. In Rosenberg EI, Zaidi Z, Beyth RJ, editors. Contemporary challenges in medical education: from theory to practice (pp. 202–219. Florida: University Press of Florida. doi: 10.2307/j.ctvx06z7z.17.
  • Rodman A, Trivedi S. Podcasting: a roadmap to the future of medical education. Semin Nephrol. 2020;40(3):279–283. doi: 10.1016/j.semnephrol.2020.04.006.
  • Rajab MH, Gazal AM, Alkattan K. Challenges to online medical education during the COVID-19 pandemic. Cureus. 2020;13(2):e13536. doi: 10.7759/cureus.8966.
  • Lewis KO. E-learning: survival guide for medical educators. 2020. https://anatoliajournal.com/depo/Ek-2.pdf.
  • Tacgin Z. Virtual and augmented reality: an educational handbook. Newcastle upon Tyne: Cambridge Scholars Publishing; 2020.
  • Tlili A, Huang R, Shehata B, et al. Is metaverse in education a blessing or a curse: a combined content and bibliometric analysis. Smart Learn Environ. 2022;9(24):1–31. doi: 10.1186/s40561-022-00205-x.
  • Bonk CJ. The world is open: how web technology is revolutionizing education. San Francisco: Jossey-Bass; 2011.
  • Sur RL, Dahm P. History of evidence-based medicine. Indian J Urol. 2011;27(4):487. doi: 10.4103/0970-1591.91438.
  • Mbunge E, Jiyane S, Muchemwa B. Towards emotive sensory web in virtual health care: trends, technologies, challenges and ethical issues. Sens Int. 2022;3:100134. doi: 10.1016/j.sintl.2021.100134.
  • Anwar AA. A survey of the semantic web (web 3.0), its applications, challenges, future and its relation with internet of things (IOT). WEB. 2022;20(3):173–202. doi: 10.3233/WEB-210491.
  • Huk T, From education 1.0 to education 4.0 – challenges for the contemporary school. TNER. 2021;66(4):36–46. doi: 10.15804/tner.21.66.4.03.
  • Javaid M, Khan IH. Internet of things (IOT) enabled healthcare helps to take the challenges of covid-19 pandemic. J Oral Biol Craniofac Res. 2021;11(2):209–214. doi: 10.1016/j.jobcr.2021.01.015.
  • Srinidhi NN, Dilip Kumar SM, Venugopal KR. Network optimizations in the internet of things: a review. Eng Sci Technol. 2019;22(1):1–21. doi: 10.1016/j.jestch.2018.09.003.
  • Benito-Osorio D, Peris-Ortiz M, Armengot CR, et al. Web 5.0: the future of emotional competences in higher education. Glob Bus Perspect. 2013;1(3):274–287. doi: 10.1007/s40196-013-0016-5.
  • Nedeva V, Dineva S. Intelligent e-learning with new web technologies. IUP Journal of Computer Sciences. 2022;16(1):60–71.
  • Neame R, Murphy B, Stitt F, et al. Universities without walls: evolving paradigms in medical education. BMJ. 1999;319(7220):1296–1296. doi: 10.1136/bmj.319.7220.1296.
  • Kinal J. From education 1.0 to education 4.0.: teacher training models from the 19th century to the present day. Hist Educ Child Lit. 2021;16(2):555–565.
  • Latinovic T. The meaning of the new era of industry 4.0, healthcare 4.0 and education 4.0 concerning the development of 5G networks, IOT and smart everything. Ann Fac Eng Hunedoara. 2023;21(3):147–152.
  • Chaka C. Is education 4.0 a sufficient innovative, and disruptive educational trend to promote sustainable open education for higher education institutions? A review of literature trends. Front Educ. 2022;7:824976. doi: 10.3389/feduc.2022.824976.
  • David MFB, Davis MH, Harden RM, et al. AMEE medical education guide no. 24: portfolios as a method of student assessment. Med Teach. 2001;23(6):535–551. doi: 10.1080/01421590120090952.
  • Epstein RM. Assessment in medical education. N Engl J Med. 2007;356(4):387–396. doi: 10.1056/nejmra054784.
  • Lewis KO, Hathaway S, Bratcher DF, et al. Current milestones assessment practices, needs, and challenges of program directors: a collective case study in a pediatric hospital setting. Cureus. 2021;13(4):e14585. doi: 10.7759/cureus.14585.
  • Raee H, Amini M, Nasab AP, et al. Team-based assessment of professional behavior in medical students. DOAJ. 2014;2(3):126–130. https://doaj.org/article/6a5b87542e804e5094814c3ae4e66957
  • Tabish S. Assessment methods in medical education. Int J Health Sci. 2008;2(2):3–7. http://students.uthscsa.edu/data/wp-content/uploads/sites/6/2014/07/Assessment-Methods-in-Medical-Education.pdf
  • Wright MC, Phillips-Bute B, Petrusa E, et al. Assessing teamwork in medical education and practice: relating behavioural teamwork ratings and clinical performance. Med Teach. 2009;31(1):30–38. doi: 10.1080/01421590802070853.
  • Venkatesan M, Mohan H, Ryan JR, et al. Virtual and augmented reality for biomedical applications. Cell Rep Med. 2021;2(7):100348. doi: 10.1016/j.xcrm.2021.100348.
  • Curran V, Xu X, Aydin MY, et al. Use of extended reality in medical education: an integrative review. Med Sci Educ. 2022;33(1):275–286. doi: 10.1007/s40670-022-01698-4.
  • Ruiz Mejia JM, Rawat DB. 2022). Recent advances in a medical domain metaverse: status, challenges, and perspective. 2022 Thirteenth International Conference on Ubiquitous and Future Networks (ICUFN). doi: 10.1109/ICUFN55119.2022.9829645.
  • Benedict MD, Inniss DA, Kantor T, et al. 28. The role of XR technology in the field of plastic surgery training. Plast Reconstr Surg. 2023;11(2S):17–18. doi: 10.1097/01.GOX.0000921660.31205.22.
  • Chen, C. J. (2010). Theoretical bases for using virtual reality in education. Themes Sci Technol Educ, 2(1–2), 71–90.
  • Appleton JJ, Christenson SL, Furlong MJ. Student engagement with school: critical conceptual and methodological issues of the construct. Psychol Schools. 2008;45(5):369–386. doi: 10.1002/pits.20303.
  • Almeida F, Simoes J. The role of serious games, gamification and industry 4.0 tools in the education 4.0 paradigm. Cont ED Technology. 2019;10(2):120–136. doi: 10.30935/cet.554469.
  • Rochlen LR, Putnam EM, Tait AR, et al. Sequential behavioral analysis: a novel approach to help understand clinical decision-making patterns in extended reality simulated scenarios. Simul Healthc. 2022;18:10–1097.
  • Mahajan AP, Inniss DA, Benedict MD, et al. International mixed reality immersive experience: approach via surgical grand rounds. J Am Coll Surg. 2022;234(1):25–31. doi: 10.1016/j.jamcollsurg.2021.09.011.
  • Suh I, McKinney T, Siu K-C. Current perspective of metaverse application in medical education, research and patient care. Virtual Worlds. 2023;2(2):115–128. doi: 10.3390/virtualworlds2020007.
  • Harrington RA, Califf RM, Balamurugan A, et al. Call to action: rural health: a presidential advisory from the American Heart Association and American Stroke Association. Circulation. 2020;141(10):e615–e644. doi: 10.1161/CIR.0000000000000753.
  • Statista. Virtual reality (VR) headset unit sales worldwide from 2019 to 2024. 2023. https://www.statista.com/statistics/677096/vr-headsets-worldwide/?locale=en.
  • Chan KS, Zary N. Applications and challenges of implementing artificial intelligence in medical education: integrative review. JMIR Med Educ. 2019;5(1):e13930. doi: 10.2196/13930.
  • Antón-Sancho Á, Fernández-Arias P, Vergara D. Virtual reality in health science education: professors’ perceptions. MTI. 2022;6(12):110. doi: 10.3390/mti6120110.
  • Dwivedi YK, Hughes L, Baabdullah AM, et al. Metaverse beyond the hype: multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. Int J Inf Manage. 2022;66:102542. doi: 10.1016/j.ijinfomgt.2022.102542.
  • Bielsa VF. Virtual reality simulation in plastic surgery training. Literature review. J Plast Reconstr Aesthet Surg. 2021;74(9):2372–2378. doi: 10.1016/j.bjps.2021.03.066.
  • Cassidy DJ, Coe TM, Jogerst KM, et al. Transfer of virtual reality endoscopy training to live animal colonoscopy: a randomized control trial of proficiency vs. repetition-based training. Surg Endosc. 2022;36(9):6767–6776. doi: 10.1007/s00464-021-08958-1.
  • Chen Y, Lin W, Zheng Y, et al. Application of active learning strategies in metaverse to improve student engagement: an immersive blended pedagogy bridging patient care and scientific inquiry in pandemic. Available at SSRN 4098179. 2022.
  • Fahl JT, Duvivier R, Reinke L, et al. Towards best practice in developing motor skills: a systematic review on spacing in VR simulator-based psychomotor training for surgical novices. BMC Med Educ. 2023;23(1):154. doi: 10.1186/s12909-023-04046-1.
  • Fiani B, De Stefano F, Kondilis A, et al. Virtual reality in neurosurgery:“can you see it?”–a review of the current applications and future potential. World Neurosurg. 2020;141:291–298. doi: 10.1016/j.wneu.2020.06.066.
  • Goh GS, Lohre R, Parvizi J, et al. Virtual and augmented reality for surgical training and simulation in knee arthroplasty. Arch Orthop Trauma Surg. 2021;141(12):2303–2312. doi: 10.1007/s00402-021-04037-1.
  • Lanese N. New neuroanatomy lab bridges virtual reality, operating room. News Center. 2018, March 8. https://med.stanford.edu/news/all-news/2018/03/new-neuroanatomy-lab-bridges-virtual-reality-operating-room.html.
  • Precision OS. 2022. Orthopedic residency program and PrecisionOS team up for exclusive 3-year collaboration: virtual reality development and curriculum integration. https://www.prnewswire.com/news-releases/orthopedic-residency-program-and-precisionos-team-up-for-exclusive-3-year-collaboration-virtual-reality-development-and-curriculum-integration-301652907.html.
  • Stull AT, Hegarty M, Mayer RE. Getting a handle on learning anatomy with interactive three-dimensional graphics. J Educ Psychol. 2009;101(4):803–816. doi: 10.1037/a0016849.
  • Páez DG, Aparicio F, De Buenaga M, et al. Personalized health care system with virtual reality rehabilitation and appropriate information for seniors. Sensors. 2012;12(5):5502–5516. doi: 10.3390/s120505502.
  • Ghaednia H, Fourman MS, Lans A, et al. Augmented and virtual reality in spine surgery, current applications and future potentials. Spine J. 2021;21(10):1617–1625. doi: 10.1016/j.spinee.2021.03.018.
  • Godzik J, Farber SH, Urakov T, et al. “Disruptive technology” in spine surgery and education: virtual and augmented reality. Oper Neurosurg. 2021;21(Suppl 1):S85–S93. doi: 10.1093/ons/opab114.
  • Velazco‐Garcia JD, Navkar NV, Balakrishnan S, et al. Evaluation of how users interface with holographic augmented reality surgical scenes: interactive planning MR‐guided prostate biopsies. Int J Med Robot. 2021;17(5):e2290. doi: 10.1002/rcs.2290.
  • Esperto F, Prata F, Autrán-Gómez AM, et al. New technologies for kidney surgery planning 3D, impression, augmented reality 3D, reconstruction: current realities and expectations. Curr Urol Rep. 2021;22(7):35. doi: 10.1007/s11934-021-01052-y.
  • Nagayo Y, Saito T, Oyama H. A novel suture training system for open surgery replicating procedures performed by experts using augmented reality. J Med Syst. 2021;45(5):60. doi: 10.1007/s10916-021-01735-6.
  • Reis G, Yilmaz M, Rambach J, et al. Mixed reality applications in urology: requirements and future potential. Ann Med Surg. 2021;66:102394. doi: 10.1016/j.amsu.2021.102394.
  • Wolf J, Wolfer V, Halbe M, et al. Comparing the effectiveness of augmented reality-based and conventional instructions during single ECMO cannulation training. Int J Comput Assist Radiol Surg. 2021;16(7):1171–1180. doi: 10.1007/s11548-021-02408-y.
  • Harpham-Lockyer L, Laskaratos F-M, Berlingieri P, et al. Role of virtual reality simulation in endoscopy training. World J Gastrointest Endosc. 2015;7(18):1287–1294. doi: 10.4253/wjge.v7.i18.1287.
  • Janse JA, Veersema S, Broekmans FJ, et al. A virtual reality simulator for hysteroscopic placement of tubal sterilization micro-inserts: the face and construct validity. Gynecol Surg. 2013;10(3):181–188. doi: 10.1007/s10397-013-0790-8.
  • Blumstein G, Zukotynski B, Cevallos N, et al. Randomized trial of a virtual reality tool to teach surgical technique for tibial shaft fracture intramedullary nailing. J Surg Educ. 2020;77(4):969–977. doi: 10.1016/j.jsurg.2020.01.002.
  • NYU Langone Health. The education revolution: NYU Langone Health. 2023, November 13. https://give.nyulangone.org/stories/driving-the-education-revolution
  • Lindner P, Miloff A, Hamilton W, et al. Creating state of the art, next-generation virtual reality exposure therapies for anxiety disorders using consumer hardware platforms: design considerations and future directions. Cogn Behav Ther. 2017;46(5):404–420. doi: 10.1080/16506073.2017.1280843.
  • Cho S, Ku J, Cho YK, et al. Development of virtual reality proprioceptive rehabilitation system for stroke patients. Comput Methods Programs Biomed. 2014;113(1):258–265. doi: 10.1016/j.cmpb.2013.09.006.
  • Kim JH, Jang SH, Kim CS, et al. Use of virtual reality to enhance balance and ambulation in chronic stroke: a double-blind, randomized controlled study. Am J Phys Med Rehabil. 2009;88(9):693–701. doi: 10.1097/PHM.0b013e3181b33350.
  • Lloréns R, Noé E, Colomer C, et al. Effectiveness, usability, and cost-benefit of a virtual reality–based telerehabilitation program for balance recovery after stroke: a randomized controlled trial. Arch Phys Med Rehabil. 2015;96(3):418–425.e2. e412. doi: 10.1016/j.apmr.2014.10.019.
  • Salem Y, Gropack SJ, Coffin D, et al. Effectiveness of a low-cost virtual reality system for children with developmental delay: a preliminary randomised single-blind controlled trial. Physiotherapy. 2012;98(3):189–195. doi: 10.1016/j.physio.2012.06.003.
  • Turolla A, Dam M, Ventura L, et al. Virtual reality for the rehabilitation of the upper limb motor function after stroke: a prospective controlled trial. J Neuroeng Rehabil. 2013;10(1):85. doi: 10.1186/1743-0003-10-85.
  • Gandolfi M, Geroin C, Dimitrova E, et al. Virtual reality telerehabilitation for postural instability in Parkinson’s disease: a multicenter, single-blind, randomized, controlled trial. Biomed Res Int. 2017;2017:7962826–7962811. doi: 10.1155/2017/7962826.
  • Han S, Park C, You JH. Effects of robotic interactive gait training combined with virtual reality and augmented reality on balance, gross motor function, gait kinetic, and kinematic characteristics in angelman syndrome: a case report. Children. 2022;9(4):544. doi: 10.3390/children9040544.
  • Boulos MNK, Hetherington L, Wheeler S. Second life: an overview of the potential of 3‐D virtual worlds in medical and health education. Health Info Libr J. 2007;24(4):233–245. doi: 10.1111/j.1471-1842.2007.00733.x.
  • Fields DA, Kafai YB, Giang MT, et al. Plagues and people: engineering player participation and prevention in a virtual epidemic. Paper presented at the proceedings of the 12th international conference on the foundations of digital games. 2017.
  • Ahuja AS, Polascik BW, Doddapaneni D, et al. The digital metaverse: applications in artificial intelligence, medical education, and integrative health. Integr Med Res. 2023;12(1):100917. doi: 10.1016/j.imr.2022.100917.
  • Sankaran NK, Nisar HJ, Zhang J, et al. Efficacy study on interactive mixed reality (IMR) software with sepsis prevention medical education. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) IEEE Annual International Symposium Virtual Reality. 2019. https://ieeexplore.ieee.org/abstract/document/8798089. doi: 10.1109/VR.2019.8798089.
  • Skalidis I, Muller O, Fournier S. CardioVerse: the cardiovascular medicine in the era of metaverse. Trends Cardiovasc Med. 2022;33(8):471–476. https://www.sciencedirect.com/science/article/pii/S1050173822000718. doi: 10.1016/j.tcm.2022.05.004.
  • Kern DE. Curriculum development for medical education: a six step approach. Baltimore: Johns Hopkins University Press; 1998.
  • Mantilla G, Lewis KO. Determining faculty and student readiness for an online medical curriculum. MedSciEduc. 2012;22(4):228–243. doi: 10.1007/BF03341791.