Case study of virtual reality sepsis management- instructional design and ITEM outcomes

References

• Adams, N. E. (2015). Bloom’s taxonomy of cognitive learning objectives. Journal of the Medical Library Association : JMLA, 103(3), 152–153. doi:10.3163/1536-5050.103.3.010.
   PubMed Web of Science ®Google Scholar
• Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123.
   Google Scholar
• Beckhaus, S., & Lindeman, R. W. (2011). Experiential Fidelity: Leveraging the Mind to Improve the VR Experience. In G. Brunnett, S. Coquillart, & G. Welch (Eds.), Virtual realities: Dagstuhl seminar 2008 (pp. 39–49). Springer Vienna.
   Google Scholar
• Birbara, N. S., & Pather, N. (2021). Instructional design of virtual learning resources for anatomy education. In P. M. Rea (Ed.), Biomedical visualisation, Vol 9 (Vol. 1317, pp. 75–110). Springer.
   Google Scholar
• Bonnin, C., Pejoan, D., Ranvial, E., Marchat, M., Andrieux, N., Fourcade, L., & Perrochon, A. (2023). Immersive virtual patient simulation compared with traditional education for clinical reasoning: A pilot randomised controlled study. Journal of Visual Communication in Medicine, 46(2), 66–74. doi:10.1080/17453054.2023.2216243.
   PubMed Web of Science ®Google Scholar
• Burgess, A., van Diggele, C., Roberts, C., & Mellis, C. (2020). Key tips for teaching in the clinical setting. BMC Medical Education, 20(Suppl 2), 463. doi:10.1186/s12909-020-02283-2.
   PubMedGoogle Scholar
• Codd, A. M., & Choudhury, B. (2011). Virtual reality anatomy: Is it comparable with traditional methods in the teaching of human forearm musculoskeletal anatomy? Anatomical Sciences Education, 4(3), 119–125. doi:10.1002/ase.214.
   PubMed Web of Science ®Google Scholar
• de Melo, B. C. P., Falbo, A. R., Souza, E. S., Muijtjens, A. M. M., Van Merriënboer, J. J. G., & Van der Vleuten, C. P. M. (2022). The limited use of instructional design guidelines in healthcare simulation scenarios: An expert appraisal. Advances in Simulation (London, England), 7(1), 30. doi:10.1186/s41077-022-00228-x.
   PubMedGoogle Scholar
• Favre-Félix, J., Dziadzko, M., Bauer, C., Duclos, A., Lehot, J. J., Rimmelé, T., & Lilot, M. (2022). High-fidelity simulation to assess task load index and performance: A prospective observational study. Turkish Journal of Anaesthesiology and Reanimation, 50(4), 282–287. doi:10.5152/tjar.2022.21234.
   PubMed Web of Science ®Google Scholar
• Franklin, N., & Melville, P. (2015). Competency assessment tools: An exploration of the pedagogical issues facing competency assessment for nurses in the clinical environment. Collegian (Royal College of Nursing, Australia), 22(1), 25–31. doi:10.1016/j.colegn.2013.10.005.
   PubMed Web of Science ®Google Scholar
• Frendo, M., Frithioff, A., Konge, L., Sorensen, M. S., & Andersen, S. A. (2021). Cochlear implant surgery: Learning curve in virtual reality simulation training and transfer of skills to a 3D-printed temporal bone - A prospective trial. Cochlear Implants International, 22(6), 330–337. doi:10.1080/14670100.2021.1940629.
   PubMedGoogle Scholar
• Gagné, R. M., & Merrill, M. D. (1990). Integrative goals for instructional design. Educational Technology Research and Development, 38(1), 23–30. doi:10.1007/BF02298245.
   Web of Science ®Google Scholar
• George, O., Foster, J., Xia, Z., & Jacobs, C. (2023). Augmented reality in medical education: A mixed methods feasibility study. Cureus, 15(3), e36927. doi:10.7759/cureus.36927.
   PubMed Web of Science ®Google Scholar
• Grier, R. A. (2015). How high is high? A meta-analysis of NASA-TLX global workload scores. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59(1), 1727–1731. doi:10.1177/1541931215591373.
   Google Scholar
• Hart, S. G. (2006). Nasa-task load index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50(9), 904–908. doi:10.1177/154193120605000909.
   Google Scholar
• Hartstein, A. J., Verkuyl, M., Zimney, K., Yockey, J., & Berg-Poppe, P. (2022). Virtual reality instructional design in orthopedic physical therapy education: A mixed-methods usability test. Simulation & Gaming, 53(2), 111–134. doi:10.1177/10468781211073646.
   Web of Science ®Google Scholar
• Herrington, J., Reeves, T. C., & Oliver, R. (2007). Immersive learning technologies: Realism and online authentic learning. Journal of Computing in Higher Education, 19(1), 80–99. doi:10.1007/BF03033421.
   Google Scholar
• Hyzy, M., Bond, R., Mulvenna, M., Bai, L., Dix, A., Leigh, S., & Hunt, S. (2022). System usability scale benchmarking for digital health apps: Meta-analysis. JMIR mHealth and uHealth, 10(8), e37290. doi:10.2196/37290.
   PubMedGoogle Scholar
• Jacobs, C. (2023). Augmented resuscitation- simulacrum of AR. Journal of Visual Communication in Medicine, 46(1), 51–53. doi:10.1080/17453054.2023.2169111.
   PubMed Web of Science ®Google Scholar
• Jacobs, C., Foote, G., Joiner, R., & Williams, M. (2022). A narrative review of immersive technology enhanced learning in healthcare education. International Medical Education, 1(2), 43–72. doi:10.3390/ime1020008.
   Google Scholar
• Jacobs, C., Foote, G., & Williams, M. (2023). Evaluating user experience with immersive technology in simulation-based education: A modified Delphi study with qualitative analysis. PLOS One, 18(8), e0275766. doi:10.1371/journal.pone.0275766.
   PubMed Web of Science ®Google Scholar
• Jacobs, C., & Maidwell-Smith, A. (2022). Learning from 360-degree film in healthcare simulation: A mixed methods pilot. Journal of Visual Communication in Medicine, 45(4), 223–233. doi:10.1080/17453054.2022.2097059.
   PubMed Web of Science ®Google Scholar
• Jacobs, C., & Rigby, J. M. (2022). Developing measures of immersion and motivation for learning technologies in healthcare simulation: A pilot study. Journal of Advances in Medical Education & Professionalism, 10(3), 163–171. doi:10.30476/jamp.2022.95226.1632.
   PubMedGoogle Scholar
• Jensen, L., & Konradsen, F. (2018). A review of the use of virtual reality head-mounted displays in education and training. Education and Information Technologies, 23(4), 1515–1529. doi:10.1007/s10639-017-9676-0.
   Web of Science ®Google Scholar
• Jung, S., & Lindeman, R. W. (2021). Perspective: Does realism improve presence in VR? Suggesting a model and metric for VR experience evaluation. Frontiers in Virtual Reality, 2. doi:10.3389/frvir.2021.693327.
   Google Scholar
• Kari, T., & Kosa, M. (2023). Acceptance and use of virtual reality games: An extension of HMSAM. Virtual Reality, 27, 1585–1605. doi:10.1007/s10055-023-00749-4.
   Google Scholar
• Kirkpatrick, D. L. (1994). Evaluating training programs: The four levels: First edition. Berrett-Koehler, Publishers Group West [distributor].
   Google Scholar
• Kolb, D. (1984). Experiential learning: Experience as the source of learning and development. Prentice-Hall.
   Google Scholar
• Laurell, C., Sandström, C., Berthold, A., & Larsson, D. (2019). Exploring barriers to adoption of virtual reality through social media analytics and machine learning – an assessment of technology, network, price and trialability. Journal of Business Research, 100, 469–474. doi:10.1016/j.jbusres.2019.01.017.
   Web of Science ®Google Scholar
• LeBlanc, V. R., & Posner, G. D. (2022). Emotions in simulation-based education: Friends or foes of learning? Advances in Simulation (London, England), 7(1), 3. doi:10.1186/s41077-021-00198-6.
   PubMedGoogle Scholar
• Liu, X., Zhang, J., Hou, G., & Wang, Z. (2018). Virtual reality and its application in military. IOP Conference Series: Earth and Environmental Science, 170(3), 032155. doi:10.1088/1755-1315/170/3/032155.
   Google Scholar
• Loureiro, S. M. C., Guerreiro, J., Eloy, S., Langaro, D., & Panchapakesan, P. (2019). Understanding the use of virtual reality in marketing: A text mining-based review. Journal of Business Research, 100, 514–530. doi:10.1016/j.jbusres.2018.10.055.
   Web of Science ®Google Scholar
• Macnamara, A. F., Bird, K., Rigby, A., Sathyapalan, T., & Hepburn, D. (2021). High-fidelity simulation and virtual reality: An evaluation of medical students’ experiences. BMJ Simulation & Technology Enhanced Learning, 7(6), 528–535. doi:10.1136/bmjstel-2020-000625.
   PubMed Web of Science ®Google Scholar
• McVeigh, S. E. (2020). Sepsis management in the emergency department. The Nursing Clinics of North America, 55(1), 71–79. doi:10.1016/j.cnur.2019.10.009.
   PubMed Web of Science ®Google Scholar
• Merrill, M. D. (2002). First principles of instruction. Educational Technology Research and Development, 50(3), 43–59. doi:10.1007/BF02505024.
   Web of Science ®Google Scholar
• Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems, 77(12), 1321–1329. doi: 10.1.1.102.4646.
   Google Scholar
• Moore, W. R., Vermuelen, A., Taylor, R., Kihara, D., & Wahome, E. (2019). Improving 3-hour sepsis bundled care outcomes: Implementation of a nurse-driven sepsis protocol in the emergency department. Journal of Emergency Nursing, 45(6), 690–698. doi:10.1016/j.jen.2019.05.005.
   PubMed Web of Science ®Google Scholar
• Orland, M. D., Patetta, M. J., Wieser, M., Kayupov, E., & Gonzalez, M. H. (2020). Does virtual reality improve procedural completion and accuracy in an intramedullary tibial nail procedure? A randomized control trial. Clinical Orthopaedics and Related Research, 478(9), 2170–2177. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7431248/pdf/abjs-478-2170.pdf doi:10.1097/CORR.0000000000001362.
   PubMed Web of Science ®Google Scholar
• Pai, D. R., Minh, C. P., & Svendsen, M. B. (2018). Process of medical simulator development: An approach based on personal experience. Medical Teacher, 40(7), 690–696. doi:10.1080/0142159X.2018.1472753.
   PubMed Web of Science ®Google Scholar
• Philippe, S., Souchet, A. D., Lameras, P., Petridis, P., Caporal, J., Coldeboeuf, G., & Duzan, H. (2020). Multimodal teaching, learning and training in virtual reality: A review and case study. Virtual Reality & Intelligent Hardware, 2(5), 421–442. doi:10.1016/j.vrih.2020.07.008.
   Google Scholar
• Prineas, S., Mosier, K., Mirko, C., & Guicciardi, S. (2021). Non-technical skills in healthcare. In L. Donaldson, W. Ricciardi, S. Sheridan, & R. Tartaglia (Eds.), Textbook of patient safety and clinical risk management (pp. 413–434). Springer International Publishing.
   Google Scholar
• Rim, D., & Shin, H. (2021). Effective instructional design template for virtual simulations in nursing education. Nurse Education Today, 96, 104624. doi:10.1016/j.nedt.2020.104624.
   PubMed Web of Science ®Google Scholar
• Robson, W. P., & Daniels, R. (2008). The Sepsis Six: Helping patients to survive sepsis. British Journal of Nursing, 17(1), 16–21. doi:10.12968/bjon.2008.17.1.28055.
   PubMedGoogle Scholar
• Ryan, R. M., & Deci, E. L. (2017). Self-determination theory: Basic psychological needs in motivation, development, and wellness. The Guilford Press.
   Google Scholar
• Said, S., Gozdzik, M., Roche, T. R., Braun, J., Rössler, J., Kaserer, A., Spahn, D. R., Nöthiger, C. B., & Tscholl, D. W. (2020). Validation of the raw national aeronautics and space administration task load index (NASA-TLX) questionnaire to assess perceived workload in patient monitoring tasks: Pooled analysis study using mixed models. Journal of Medical Internet Research, 22(9), e19472. doi:10.2196/19472.
   PubMed Web of Science ®Google Scholar
• Skarbez, R., Smith, M., & Whitton, M. C. (2021). Revisiting milgram and Kishino’s reality-virtuality continuum. Frontiers in Virtual Reality, 2. doi:10.3389/frvir.2021.647997.
   Google Scholar
• Slater, M. (2009). Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences, 364(1535), 3549–3557. doi:10.1098/rstb.2009.0138.
   PubMed Web of Science ®Google Scholar
• Snarby, H., Gasbakk, T., Prasolova-Forland, E., Steinsbekk, A., & Lindseth, F. (2019). Procedural medical training in VR in a smart virtual university hospital. Smart Education and E-Learning 2018, 99, 132–141. doi:10.1007/978-3-319-92363-5.
   Google Scholar
• Standage, M., Duda, J. L., & Ntoumanis, N. (2005). A test of self-determination theory in school physical education. The British Journal of Educational Psychology, 75(Pt 3), 411–433. doi:10.1348/000709904X22359.
   PubMed Web of Science ®Google Scholar
• Tang, Y. M., Chau, K. Y., Kwok, A. P. K., Zhu, T., & Ma, X. (2022). A systematic review of immersive technology applications for medical practice and education - Trends, application areas, recipients, teaching contents, evaluation methods, and performance. Educational Research Review, 35, 100429. doi:10.1016/j.edurev.2021.100429.
   Web of Science ®Google Scholar
• Vernon, D. T., & Blake, R. L. (1993). Does problem-based learning work? A meta-analysis of evaluative research. ACADEMIC Medicine, 68(7), 550–563. https://journals.lww.com/academicmedicine/Fulltext/1993/07000/Does_problem_based_learning_work__A_meta_analysis.15.aspx doi:10.1097/00001888-199307000-00015.
   PubMed Web of Science ®Google Scholar
• Wang, A., Thompson, M., Uz-Bilgin, C., & Klopfer, E. (2021). Authenticity, interactivity, and collaboration in virtual reality games: Best practices and lessons learned. Frontiers in Virtual Reality, 2. doi:10.3389/frvir.2021.734083.
   Google Scholar
• Witmer, B. G., & Singer, M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments, 7(3), 225–240. doi:10.1162/105474698565686.
   Web of Science ®Google Scholar
• Yu, P., Pan, J. J., Wang, Z. X., Shen, Y., Wang, L. L., Li, J. L., Hao, A., & Wang, H. (2021). Cognitive load/flow and performance in virtual reality simulation training of laparoscopic surgery. In 2021 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW 2021), pp. 468–469.
   Google Scholar
• Zhou, Y., Hou, J., Liu, Q., Chao, X., Wang, N., Chen, Y., Guan, J., Zhang, Q., & Diwu, Y. (2021). VR/AR technology in human anatomy teaching and operation training. Journal of Healthcare Engineering, 2021, 9998427–13. doi:10.1155/2021/9998427.
   PubMed Web of Science ®Google Scholar
• Zimmerer, C., & Matthiesen, S. (2021). Study on the impact of cognitive load on performance in engineering design. Proceedings of the Design Society, 1, 2761–2770. doi:10.1017/pds.2021.537.
   Google Scholar