A review on the applications of virtual reality, augmented reality and mixed reality in surgical simulation: an extension to different kinds of surgery

References

• Bernardo A. Virtual reality and simulation in neurosurgical training. World Neurosurg. 2017;106:1015–1029.
   PubMed Web of Science ®Google Scholar
• Agha RA, Fowler AJ. The role and validity of surgical simulation. Int Surg. 2015;100(2):350–357.
   PubMed Web of Science ®Google Scholar
• Gupta A, Cecil J, Pirela-Cruz M, et al. A virtual reality enhanced cyber-human framework for orthopedic surgical training. IEEE Syst J. 2019;13(3):3501–3512.
   Web of Science ®Google Scholar
• Tai Y, Wei L, Zhou H, et al., “Integrating virtual reality and haptics for renal puncture surgical simulator,” in International Conference on Computer and Communications (ICCC), Chengdu, 2016.
   Google Scholar
• Kaluschke M, Weller R, Zachmann G, et al., “HIPS - A Virtual Reality Hip Prosthesis Implantation Simulator,” in IEEE Conference on Virtual Reality and 3D User Interfaces (VR); Reutlingen: 2018.
   Google Scholar
• Tai Y, Wei L, Xiao M, et al. A high-immersive medical training platform using direct intraoperative data. IEEE Access. 2018 October 31;6:69438–69452.
   Web of Science ®Google Scholar
• Tai Y, Wei L, Zhou H, et al., “Development of haptic-enabled virtual reality simulator for video-assisted thoracoscopic right upper lobectomy,” in IEEE International Conference on Systems, Man, and Cybernetics (SMC); Miyazaki: 2018.
   Google Scholar
• Egger J, Gall M, Wallner J, et al. HTC Vive MeVisLab integration via OpenVR for medical applications. Plos One. 2017;12(3):e0173972.
   PubMed Web of Science ®Google Scholar
• Wu F, Chen X, Lin Y, et al. A virtual training system for maxillofacial surgery using advanced haptic feedback and immersive workbench. Int J Med Rob Comput Assisted Surg. 2014 March; 10(1):78–87.
   PubMed Web of Science ®Google Scholar
• Pulijala Y, Ma M, Ayoub A. VR Surgery: interactive virtual reality application for training oral and maxillofacial surgeons using oculus rift and leap motion. In: Minhua Ma, Andreas Oikonomou(Eds.), Serious Games and Edutainment Applications: volume II. Cham: Springer International Publishing; 2017. p. 187–202.
   Google Scholar
• Srinivasan MA, Basdogan C. Haptics in virtual environments: taxonomy, research status, and challenges. Compu Graphics. 1997;21(4):393–404.
   Web of Science ®Google Scholar
• Sagardia M, Hertkorn K, Hulin T, et al. VR-OOS: the DLR’s virtual reality simulator for telerobotic on-orbit servicing with haptic feedback. in IEEE Aerospace Conference; Big Sky: 2015.
   Google Scholar
• Leeper A, Chan S, Salisbury K. Point clouds can be represented as implicit surfaces for constraint-based haptic rendering. in IEEE International Conference on Robotics and Automation; Saint Paul: 2012.
   Google Scholar
• Kaluschke M, Weller R, Zachmann G. A volumetric penetration measure for 6-DOF haptic rendering of streaming point clouds. in IEEE World Haptics Conference (WHC); Munich: 2017.
   Google Scholar
• Xu H, Barbič J. Adaptive 6-DoF haptic contact stiffness using the gauss map. IEEE Trans Haptics. 2016;9(3):323–332.
   PubMed Web of Science ®Google Scholar
• Yu G, Wang D, Zhang Y, et al. Simulating sharp geometric features in six degrees-of-freedom haptic rendering. IEEE Trans Haptics. 2015;8(1):67–78.
   PubMed Web of Science ®Google Scholar
• Sauer IM, Queisner M, Tang P, et al. Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases. Ann Surg. 2017 November;266(5):706–712.
   PubMed Web of Science ®Google Scholar
• Brewer ZE, Fann HC, Ogden WD, et al. Inheriting the learner’s view: a google glass-based wearable computing platform for improving surgical trainee performance. J Surg Educ. 2016;73(4):682–688.
   PubMed Web of Science ®Google Scholar
• Shao P, Ding H, Wang J, et al. Designing a wearable navigation system for image-guided cancer resection surgery. Ann Biomed Eng. 2014;42(11):2228–2237.
   PubMed Web of Science ®Google Scholar
• Zhang Z, Pei J, Wang D, et al. A wearable goggle navigation system for dual-mode optical and ultrasound localization of suspicious lesions: validation studies using tissue-simulating phantoms and an ex vivo human breast tissue model. PloS One. 2016;11(7):e0157854.
   Web of Science ®Google Scholar
• Liebert CA, Zayed MA, Aalami O, et al. Novel use of google glass for procedural wireless vital sign monitoring. Surg Innov. 2016;23(4):366–373.
   PubMed Web of Science ®Google Scholar
• Chen X, Xu L, Wang Y, et al. Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform. 2015;55:124–131.
   PubMed Web of Science ®Google Scholar
• Wang H, Wang F, Leong APY, et al. Precision insertion of percutaneous sacroiliac screws using a novel augmented reality-based navigation system: a pilot study. Int Orthop. 2015;40:1941–1947.
   PubMed Web of Science ®Google Scholar
• Liu X, Bai H, Song G, et al. Augmented reality system training for minimally invasive spine surgery. in International Conference on Robotics and Biomimetics (ROBIO); Macau: 2017.
   Google Scholar
• Viglialoro RM, Esposito N, Condino S, et al. Augmented reality to improve surgical simulation: lessons learned towards the design of a hybrid laparoscopic simulator for cholecystectomy. IEEE Trans Biomed Eng. 2019 July;66(7):2091–2104.
   Web of Science ®Google Scholar
• Kalavakonda N, Sekhar L, Hannaford B. Augmented reality application for aiding tumor resection in skull-base surgery,” in International Symposium on Medical Robotics (ISMR); Atlanta: 2019.
   Google Scholar
• Badiali G, Cercenelli L, Battaglia S, et al. Review on augmented reality in oral and cranio-maxillofacial surgery: toward “surgery-specific” head-up displays. IEEE Access. 2020 February 11;8:59015–59028.
   Web of Science ®Google Scholar
• Badiali G, Ferrari V, Cutolo F, et al. Augmented reality as an aid in maxillofacial surgery: validation of a wearable system allowing maxillary repositioning. J Craniomaxillofac Surg. 2014 December;42(8):1970–1976.
   PubMed Web of Science ®Google Scholar
• Andersen D, Lin C, Popescu V, et al. Augmented visual instruction for surgical practice and training. in IEEE Workshop on Augmented and Virtual Realities for Good (VAR4Good); Reutlingen: 2018.
   Google Scholar
• Krajancich B, Padmanaban N, Wetzstein G. Factored occlusion: single spatial light modulator occlusion-capable optical see-through augmented reality display. IEEE Trans Vis Comput Graph. 2020;26(5):1871–1879.
   PubMed Web of Science ®Google Scholar
• Wu TS, Dameff CJ, Tully JL. Ultrasound-guided central venous access using google glass. J Emerg Med. 2014;47(6):668–675.
   PubMed Web of Science ®Google Scholar
• Kaneko N, Sato M, Takeshima T, et al. Ultrasound-guided central venous catheterization using an optical see-through head-mounted display: a pilot study. J Clin Ultrasound. 2016;44(8):487–491.
   PubMed Web of Science ®Google Scholar
• Przkora R, McGrady W, Vasilopoulos T, et al. Evaluation of the head-mounted display for ultrasound-guided peripheral nerve blocks in simulated regional anesthesia. Pain Med. 2015;16(11):2192–2194.
   PubMed Web of Science ®Google Scholar
• Wang J, Suenaga H, Hoshi K, et al. Augmented reality navigation with automatic marker-free image registration using 3-D image overlay for dental surgery. IEEE Trans Biomed Eng. 2014 January 17;61(4):1295–1304.
   PubMed Web of Science ®Google Scholar
• Ma L, Zhao Z, Chen F, et al. Augmented reality surgical navigation with ultrasound-assisted registration for pedicle screw placement: a pilot study. Int J Comput Assist Radiol Surg. 2017;12(12):2205–2215.
   PubMed Web of Science ®Google Scholar
• Suenaga H, Tran HH, Liao H, et al. Vision-based markerless registration using stereo vision and an augmented reality surgical navigation system: a pilot study. BMC Med Imaging. 2015 November 2;15(1). DOI:10.1186/s12880-015-0089-5.
   PubMedGoogle Scholar
• Wang J, Shen Y, Yang S. A practical marker-less image registration method for augmented reality oral and maxillofacial surgery. Int J Comput Assist Radiol Surg. 2019;14(5):763–773.
   PubMed Web of Science ®Google Scholar
• Wang J, Suenaga H, Yang L, et al. Video see‐through augmented reality for oral and maxillofacial surgery. Int J Med Rob Comput Assisted Surg. 2016;13(2):e1754.
   Web of Science ®Google Scholar
• Quang T, Zhou M, Papay F, et al.Fluorescence to color feature-based image registration for medical augmented reality. in 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT); Louisville: 2018.
   Google Scholar
• Perkins SL, Lin MA, Srinivasan S, et al. A mixed-reality system for breast surgical planning. in International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct); Nantes: 2017.
   Google Scholar
• Mirchi N, Bissonnette V, Yilmaz R, et al. The Virtual Operative Assistant: an explainable artificial intelligence tool for simulation-based training in surgery and medicine. PLoS One. 2020 February;15(2):e0229596.
   PubMed Web of Science ®Google Scholar
• Wang D, Zhang Y, Hou J, et al. iDental: a haptic-based dental simulator and its preliminary user evaluation. IEEE Trans Haptics. 2012;5(4):332–343.
   PubMed Web of Science ®Google Scholar
• Choudhury N, Gélinas-Phaneuf N, Delorme S, et al. Fundamentals of neurosurgery: virtual reality tasks for training and evaluation of technical skills. World Neurosurg. 2013 November;80(5):e9–e19.
   PubMedGoogle Scholar
• Azarnoush H, Alzhrani G, Winkler-Schwartz A, et al. Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection. Int J Comput Assist Radiol Surg. 2015 May 1;10(5):603–618.
   PubMed Web of Science ®Google Scholar
• Chen X, Hu J. A review of haptic simulator for oral and maxillofacial surgery based on virtual reality. Expert Rev Med Devices. 2018;15(6):435–444.
   PubMed Web of Science ®Google Scholar
• Chheang V, Saalfeld P, Huber T, et al. Collaborative virtual reality for laparoscopic liver surgery training. in IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR); San Diego: 2019.
   Google Scholar
• Peral-Boiza M, Gómez-Fernández T, Sánchez-González P, et al. Position based model of a flexible ureterorenoscope in a virtual reality training platform for a minimally invasive surgical robot. IEEE Access. 2019;7:177414–177426.
   Web of Science ®Google Scholar
• Gupta A, Cecil J, Pirela-Cruz M, et al. Design of an immersive simulator for orthopedic surgical training. in 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC); Miyazaki: 2018.
   Google Scholar
• Hussain R, Lalande A, Guigou C, et al. Contribution of augmented reality to minimally invasive computer-assisted cranial base surgery. IEEE J Biomed Health Inform. 2019 November 18;1. doi:10.1109/JBHI.2019.2954003.
   Web of Science ®Google Scholar
• Winkler-Schwartz A, Bissonnette V, Mirchi N, et al. Artificial intelligence in medical education: best practices using machine learning to assess surgical expertise in virtual reality simulation. J Surg Educ. 2019;76(6):1681–1690.
   PubMed Web of Science ®Google Scholar
• Winkler-Schwartz A, Yilmaz R, Mirchi N, et al. Machine learning identification of surgical and operative factors associated with surgical expertise in virtual reality simulation. JAMA Network Open. 2019 August;2(8):e198363–e198363.
   PubMed Web of Science ®Google Scholar
• Bissonnette V, Mirchi N, Ledwos N, et al. Artificial intelligence distinguishes surgical training levels in a virtual reality spinal task. J Bone Joint Surg. 2019 December 4; 101(23):e127.
   PubMed Web of Science ®Google Scholar
• Mirchi N, Bissonnette V, Ledwos N, et al. Artificial Neural networks to assess virtual reality anterior cervical discectomy performance. Operative Neurosurg. 2019 December 13;16(1):65–75.
   Google Scholar
• Tomlinson S, Hendricks B, Cohen-Gadol A. Immersive three-dimensional modeling and virtual reality for enhanced visualization of operative neurosurgical anatomy. World Neurosurg. 2019;131:313–320.
   PubMed Web of Science ®Google Scholar
• Cohen A, Lohani S, Manjila S. Virtual reality simulation: basic concepts and use in endoscopic neurosurgery training. Childs Nerv Syst. 2015;29:1235–1244.
   Web of Science ®Google Scholar
• Breimer G, Haji F, Bodani V, et al. Simulation-based education for endoscopic third ventriculostomy: a comparison between virtual and physical training models. Oper Neurosurg (Hagerstown). 2017;13(1):89–95.
   PubMedGoogle Scholar
• Mazur T, Mansour T, Mugge L, et al. Virtual reality-based simulators for cranial tumor surgery: a systematic review. World Neurosurg. 2018;110:414–422.
   PubMed Web of Science ®Google Scholar
• Locketz G, Chan S, Lui J. Specific virtual reality simulation in temporal bone dissection: perceived utility and impact on surgeon confidence. Otolaryngol Head Neck Surg. 2017;156(6):1142–1149.
   PubMed Web of Science ®Google Scholar
• Alaraj A, Luciano C, Bailey D. Virtual reality cerebral aneurysm clipping simulation with real-time haptic feedback. Neurosurgery. 2015;11(1):52–58.
   PubMedGoogle Scholar
• Gmeiner M, Dirnberger J, Fenz W. Virtual cerebral aneurysm clipping with real-time haptic force feedback in neurosurgical education. World Neurosurg. 2018;112:e313-e323.
   PubMed Web of Science ®Google Scholar
• Yao S, Zhang J, Zhao Y. Multimodal image-based virtual reality presurgical simulation and evaluation for trigeminal neuralgia and hemifacial spasm. World Neurosurg. 2018;113:e499-e507.
   PubMed Web of Science ®Google Scholar
• Xin B, Chen G, Wang Y. The efficacy of immersive virtual reality surgical simulator training for pedicle screw placement: a randomized double-blind controlled trial. World Neurosurg. 2018;124:e324–e330.
   Google Scholar
• Lee C, Wong G. Virtual reality and augmented reality in the management of intracranial tumors: A review. J Clin Neurosci. 2019;62:14–20.
   PubMed Web of Science ®Google Scholar
• Kersten OM, Gerard I, Drouin S. Augmented reality in neurovascular surgery: feasibility and first uses in the operating room. Int J CARS. 2015;10:1823–1836.
   Google Scholar
• Yoon J, Chen R, ReFaey K. Technical feasibility and safety of image-guided parieto-occipital ventricular catheter placement with the assistance of a wearable head-up display. Int J Med Rob Comput Assisted Surg. 2017;13:e1836.
   Web of Science ®Google Scholar
• Watanabe E, Satoh M, Konno T, et al. The trans-visible navigator: a see-through neuronavigation system using augmented reality. World Neurosurg. 2016;87:399–405.
   PubMed Web of Science ®Google Scholar
• Karmonik C, Elias S, Zhang J. Augmented reality with virtual cerebral aneurysms: a feasibility study. World Neurosurgery. 2018;119:e617-e622.
   PubMed Web of Science ®Google Scholar
• Carl B, Bopp M, Saß B, et al. Augmented reality in intradural spinal tumor surgery. Acta Neurochir (Wien). 2019;161(10):2181‐2193.
   PubMed Web of Science ®Google Scholar
• Edström E, Burström G, Nachabe R, et al. A novel augmented-reality-based surgical navigation system for spine surgery in a hybrid operating room: design, workflow, and clinical applications. Oper Neurosurg (Hagerstown). 2020;18(5):496–502.
   PubMedGoogle Scholar
• Alfonso AG, Bec J, Sridharan SW. Real-time augmented reality for delineation of surgical margins during neurosurgery using autofluorescence lifetime contrast. J Biophotonics. 2020;13(1):e201900108.
   Web of Science ®Google Scholar
• Lavé A, Meling T, Schaller K, et al. Augmented reality in intracranial meningioma surgery: a case report and systematic review. J Neurosurg Sci. 2020;64. DOI:10.23736/S0390-5616.20.04945-0
   PubMed Web of Science ®Google Scholar
• Coelho G, Rabelo NN N, Vieira E. Augmented reality and physical hybrid model simulation for preoperative planning of metopic craniosynostosis surgery. Neurosurg Focus. 2020;48(3):E19.
   PubMed Web of Science ®Google Scholar
• Zhang Z, Duan W, Chen R, et al. Preliminary application of mxed reality in neurosurgery: development development and evaluation of a new intraoperative procedure. J Clin Neurosci. 2019;67:234–238.
   PubMed Web of Science ®Google Scholar
• McJunkin J, Jiramongkolchai P, Chung W. Development of a mixed reality platform for lateral skull base anatomy. Otol Neurotol. 2018;39(10):e1137–e1142.
   PubMed Web of Science ®Google Scholar
• Incekara F, Smits M, Dirven C. Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg. 2018;118:e422–e427.
   PubMed Web of Science ®Google Scholar
• Heuts S, Sardari PN, Maessen J. Preoperative planning of thoracic surgery with use of three-dimensional reconstruction, rapid prototyping, simulation and virtual navigation. J Vis Surg. 2016;77(2):PMC5638025.
   Google Scholar
• Wu X, Liu R, Yu J. Mixed reality technology-assisted orthopedics surgery navigation.. Surg Innov. 2018;25(3):304–305.
   PubMed Web of Science ®Google Scholar
• Coelho G, Figueiredo E, Rabelo N, et al. Development and evaluation of a new pediatric mixed-reality model for neurosurgical training. J Neurosurg Pediatr. 2020;24(4):353–449.
   Web of Science ®Google Scholar
• Pulijala Y, Ma M, Pears M, et al. Effectiveness of immersive virtual reality in surgical training-a randomized control trial. J Oral Maxillofac Surg. 2018;76(5):1065–1072.
   PubMed Web of Science ®Google Scholar
• Joda T, Gallucci G, Wismeijer D, et al. Augmented and virtual reality in dental medicine: a systematic review. Comput Biol Med. 2019;108:93–100.
   PubMed Web of Science ®Google Scholar
• Chen X, Sun P, Liao D. A patient-specific haptic drilling simulator based on virtual reality for dental implant surgery. Int J Comput Assist Radiol Surg. 2019;13(11):1861–1870.
   Web of Science ®Google Scholar
• Holzinger D, Juergens P, Shahim K. Accuracy of soft tissue prediction in surgery-first treatment concept in orthognathic surgery: A prospective study. J Craniomaxillofac Surg. 2018;46(9):1455–1460.
   PubMed Web of Science ®Google Scholar
• Pulijala Y, Ma M, Pears M, et al. An innovative virtual reality training tool for orthognathic surgery. Int J Oral Maxillofac Surg. 2018;47(9):1199–1205.
   PubMed Web of Science ®Google Scholar
• Maloney K, Rutner T. Virtual surgical planning and hardware fabrication prior to open reduction and internal fixation of atrophic edentulous mandible fractures. Craniomaxillofac Trauma Reconstr. 2019;12(2):156–162.
   PubMed Web of Science ®Google Scholar
• Hanken H, Schablowsky C, Smeets R. Virtual planning of complex head and neck reconstruction results in satisfactory match between real outcomes and virtual models. Clin Oral Investig. 2015;19(3):647–656.
   PubMed Web of Science ®Google Scholar
• Nguyen A, Vanderbeek C, Herford A, et al. Use of virtual surgical planning and virtual dataset with intraoperative navigation to guide revision of complex facial fractures: a case report. J Oral Maxillofacial Surg. 2019;77:790.e1-790.e17.
   Web of Science ®Google Scholar
• Drake V, Rizzi C, Greywoode J, et al. Midface fracture simulation and repair: a computer-based algorithm. Craniomaxillofac Trauma Reconstr. 2019;12(1):1–14.
   PubMed Web of Science ®Google Scholar
• Matsuo A, Hamada H, Oba H, et al. Virtual reality head-mounted display for endoscopically-assisted implant surgery. Br J Oral Maxillofac Surg. 2018;56(7):636–637.
   PubMed Web of Science ®Google Scholar
• Kwon H, Park Y, Han J. Augmented reality in dentistry: a current perspective. Acta Odontol Scand. 2018;76:497–503.
   PubMed Web of Science ®Google Scholar
• Katić D, Spengler P, Bodenstedt S. system for context-aware intraoperative augmented reality in dental implant surgery. Int J Comput Assist Radiol Surg. 2015;10(1):101–108.
   PubMed Web of Science ®Google Scholar
• Lin Y, Yau H, Wang I, et al. A novel dental implant guided surgery based on integration of surgical template and augmented reality. Clin Implant Dent Relat Res. 2015;17(3):543–553.
   PubMed Web of Science ®Google Scholar
• Pellegrino G, Mangano C, Mangano R. Augmented reality for dental implantology: a pilot clinical report of two cases. BMC Oral Health. 2019;19(1). DOI:10.1186/s12903-019-0853-y
   PubMedGoogle Scholar
• Ahn J, Choi H, Hong J. Tracking accuracy of a stereo camera-based augmented reality navigation system for orthognathic surgery. J Oral Maxillofac Surg. 2019;77(5):1070.e1-1070.e11.
   PubMed Web of Science ®Google Scholar
• Zhu M, Liu F, Chai G. A novel augmented reality system for displaying inferior alveolar nerve bundles in maxillofacial surgery. Sci Rep. 2017;7:e42365.
   Web of Science ®Google Scholar
• Karner F, Gsaxner C, Pepe A and et al. Single-shot deep volumetric regression for mobile medical augmented reality. in 10th International Workshop, ML-CDS, and 9th International Workshop CLIP, In Conjunction with MICCAI; Peru: 2020.
   Google Scholar
• Tepper, Rudy HL, Oren M, et al. Mixed reality with hololens: where virtual reality meets augmented reality in the operating room. Plast Reconstr Surg. 2017;140(5):1066–1070.
   PubMed Web of Science ®Google Scholar
• Tuladhar S, AlSallami N, Alsadoon A. A recent review and a taxonomy for hard and soft tissue visualization-based mixed reality. Int J Med Robot. 2019;16(5):1–22.
   Web of Science ®Google Scholar
• Venkata H, Alsadoon A, Prasad P. A novel mixed reality in breast and constructive jaw surgical tele-presence. Comput Methods Programs Biomed. 2019;177:253–268.
   PubMed Web of Science ®Google Scholar
• Fushima K, Kobayashi M. Mixed-reality simulation for orthognathic surgery. Maxillofac Plast Reconstr Surg. 2016;38(1). DOI:10.1186/s40902-016-0059-z
   PubMedGoogle Scholar
• Pepe A, Trotta G, Mohr-Ziak P. A marker-less registration approach for mixed reality-aided maxillofacial surgery: a pilot evaluation. Digit Imaging. 2019;32(6):1008–1018.
   PubMed Web of Science ®Google Scholar
• Gsaxner C, Pepe A, Wallner J, et al. Markerless image-to-face registration for untethered augmented reality in head and neck surgery. Miccai. 2019;11768:236–244.
   Google Scholar
• Gsaxner C, Wallner J, Chen X, et al. Facial model collection for medical augmented reality in oncologic cranio-maxillofacial surgery. Sci Data. 2019;6(1):310.
   PubMedGoogle Scholar
• Benish F, Fabrizio C. Augmented reality in open surgery. Updates Surg. 2018;70:389–400.
   Web of Science ®Google Scholar
• Okamoto T, Onda S, Yasuda J. Navigation surgery using an augmented reality for pancreatectomy. Dig Surg. 2015;32(2):117–123.
   PubMed Web of Science ®Google Scholar
• Ntourakis D, Memeo R, Soler L. Augmented reality guidance for the resection of missing colorectal liver metastases: an initial experience. World J Surg 40. 2016;440:419–426.
   Google Scholar
• Bell R, McDermott H, Fancher T. Impact of a randomized controlled educational trial to improve physician practice behaviors around screening for inherited breast cancer. J Gen Intern Med. 2015;30(3):334–341.
   PubMed Web of Science ®Google Scholar
• Onda S, Okamoto T, Kanehira M. Identification of inferior pancreaticoduodenal artery during pancreaticoduodenectomy using augmented reality-based navigation system. J Hepatobiliary Pancreat Sci. 2014;21(4):281–287.
   PubMed Web of Science ®Google Scholar
• Tang R, Ma L, Xiang C. Augmented reality navigation in open surgery for hilar cholangiocarcinoma resection with hemihepatectomy using video-based in situ three-dimensional anatomical modeling: a case report. Medicine (Baltimore). 2017;96:e8083.
   Web of Science ®Google Scholar
• Borgmann H, Rodriguez S, Salem J. Feasibility and safety of augmented reality-assisted urological surgery using smartglass. World J Urol. 2017;35:967–972.
   PubMed Web of Science ®Google Scholar
• Golse N, Petit A, Lewin M, et al. Augmented reality during open liver surgery using a markerless non-rigid registration system. J Gastrointest Surg. 2020. DOI:10.1007/s11605-020-04519-4
   PubMed Web of Science ®Google Scholar
• Kleinjan G, Van den Berg N, Van Oosterom M. Toward (hybrid) navigation of a fluorescence camera in an open surgery setting. J Nucl Med. 2016;57(19):1650–1653.
   PubMedGoogle Scholar
• Van Oosterom M, Meershoek P, Kleinjan G. Navigation of fluorescence cameras during soft tissue surgery-is it possible to use a single navigation setup for various open and laparoscopic urological surgery applications? J Urol. 2018;199(4):1061–1068.
   PubMed Web of Science ®Google Scholar
• Weidert S, Wang L, Landes J, et al. Video-augmented fluoroscopy for distal interlocking of intramedullary nails decreased radiation exposure and surgical time in a bovine cadaveric setting. Int J Med Robo. 2019;15(4):e1995.
   PubMed Web of Science ®Google Scholar
• Ameri G, Baxter J, Bainbridge D, et al. Mixed reality ultrasound guidance system: a case study in system development and a cautionary tale. Int J Comput Assist Radiol Surg. 2018;13(4):495–505.
   PubMed Web of Science ®Google Scholar
• Alaker M, Wynn G, Arulamalam T. Virtual reality training in laparoscopic. Int J Surg. 2016;29:85–94.
   PubMed Web of Science ®Google Scholar
• Frederiksen J, Sørensen S, Konge L, et al. Cognitive load and performance in immersive virtual reality versus conventional virtual reality simulation training of laparoscopic surgery: a randomized trial. Surg Endosc. 2020;34(3):1244–1252.
   PubMed Web of Science ®Google Scholar
• Bernhardt S, Nicolau S, Soler L, et al. The status of augmented reality in laparoscopic surgery as of 2016. Med Image Anal. 2017;37:66–90.
   PubMed Web of Science ®Google Scholar
• Lau L, Liu X, Plishker W, et al. Laparoscopic liver resection with augmented reality: a preclinical experience. J Laparoendosc Adv Surg Tech. 2018;29(1):88–93.
   Web of Science ®Google Scholar
• Prevost G, Eigl B, Paolucci I. Efficiency, accuracy and clinical applicability of a new image-guided surgery system in 3D laparoscopic liver surgery. J Gastrointest Surg. 2019;24:2251–2258.
   PubMed Web of Science ®Google Scholar
• Aoki T, Koizumi T, Mansour D, et al. Virtual reality with three-dimensional image guidance of individual patients’ vessel anatomy in laparoscopic distal pancreatectomy. Langenbecks Arch Surg. 2020;405(3):381–389.
   PubMed Web of Science ®Google Scholar
• Akladios C, Gabriele V, Agnus V, et al. Augmented reality in gynecologic laparoscopic surgery: development, evaluation of accuracy and clinical relevance of a device useful to identify ureters during surgery. Surg Endosc. 2020;34(3):1077–1087.
   PubMed Web of Science ®Google Scholar
• Byeon SP, Lee DY. Method for real-time simulation of haptic interaction with deformable objects using GPU-based parallel computing and homogeneous hexahedral elements. Comput Mech. 2020;65(5):1205–1218.
   Web of Science ®Google Scholar