Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1

References

• Andress S, Johnson A, Unberath M, Winkler AF, Yu K, Fotouhi J, Weidert S, Osgood GM, Navab N. 2018. On-the-fly augmented reality for orthopedic surgery using a multimodal fiducial. J Med Imaging. 5(2):021209. doi:10.1117/1.JMI.5.2.021209.
   Google Scholar
• Arun KS, Huang TS, Blostein SD. 1987. Least-squares fitting of two 3-d point sets. IEEE Trans Pattern Anal Mach Intell. PAMI-9(5):698–700. doi:10.1109/TPAMI.1987.4767965.
   Google Scholar
• Azimi E, Qian L, Navab N, Kazanzides P. 2018. Alignment of the virtual scene to the 3d display space of a mixed reality head-mounted display. arXiv Preprint arXiv:170305834.
   Google Scholar
• Berhouet J, Rol M, Spiry C, Slimane M, Chevalier C, Favard L. 2017. Shoulder patient-specific guide: first experience in 10 patients indicates room for improvement. Orthop Traumatol Surg Res, 104(1):45–51.
   Google Scholar
• Cao A, Dhanaliwala A, Shi J, Gade T, Park B. 2020. Image-based marker tracking and registration for intraoperative 3d image-guided interventions using augmented reality. Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications. p. 1131802. SPIE Medical Imaging 2020
   Google Scholar
• Chen X, Xu L, Wang Y, Wang H, Wang F, Zeng X, Wang Q, Egger J. 2015. Development of a surgical navigation system based on augmented reality using an optical see-through head-mounted display. J Biomed Inform. 55:124–131. doi:10.1016/j.jbi.2015.04.003.
   Google Scholar
• Creighton FX, Unberath M, Song T, Zhao Z, Armand M, Carey J. 2020. Early feasibility studies of augmented reality navigation for lateral skull base surgery. Otol. Neurotol. 41:883–888. doi:10.1097/MAO.0000000000002724.
   Google Scholar
• Deib G, Johnson A, Unberath M, Yu K, Andress S, Qian L, Osgood G, Navab N, Hui F, Gailloud P. 2018. Image guided percutaneous spine procedures using an optical see-through head mounted display: proof of concept and rationale. J Neurointerv Surg. 10(12):1187–1191. doi:10.1136/neurintsurg-2017-013649.
   Google Scholar
• Fotouhi J, Alexander C, Unberath M, Taylor G, Lee SC, Fuerst B, Johnson A, Osgood G, Taylor R, Khanuja H, et al. 2018. Plan in 2d, execute in 3d: an augmented reality solution for cup placement in total hip arthroplasty. J Med Imaging. 5:1. doi:10.1117/1.JMI.5.2.021205.
   Google Scholar
• Frantz T, Jansen B, Duerinck J, Vandemeulebroucke J. 2018. Augmenting microsoft’s hololens with vuforia tracking for neuronavigation. Healthc Technol Lett. 5(5):221–225. doi:10.1049/htl.2018.5079.
   Google Scholar
• Gsaxner C, Pepe A, Wallner J, Schmalstieg D, Egger J 2019. Markerless image-to-face registration for untethered augmented reality in head and neck surgery. In: International Conference on Medical Image Computing and Computer-Assisted Intervention. Shenzhen, China: Springer. p. 236–244.
   Google Scholar
• Hajek J, Unberath M, Fotouhi J, Bier B, Lee SC, Osgood G, Maier A, Navab N 2018. Closing the calibration loop: an inside-out-tracking paradigm for augmented reality in orthopedic surgery. Proc Conf on Medical Image Computing and Computer Assisted Intervention:1–8. Granada, Spain.
   Google Scholar
• Hopkins A, Hansen U, Amis A, Emery R. 2004. The effect of glenoid component alignment variations on cement mantle stresses in total shoulder arthroplasty. J Shoulder Elb Surg. 13:668–675. doi:10.1016/j.jse.2004.04.008.
   Google Scholar
• Hübner P, Clintworth K, Liu Q, Weinmann M, Wursthorn S. 2020. Evaluation of hololens tracking and depth sensing for indoor mapping applications. Sensors. 20(4):1021. doi:10.3390/s20041021.
   Google Scholar
• Iannotti J, Baker J, Rodriguez E, Brems J, Ricchetti E, Mesiha M, Bryan J. 2014. Three-dimensional preoperative planning software and a novel information transfer technology improve glenoid component positioning. JBJS. 96(9):e71. doi:10.2106/JBJS.L.01346.
   Google Scholar
• Kim S, Wise B, Zhang Y, Szabo R. 2011. Increasing incidence of shoulder arthroplasty in the united states. J Bone Joint Surg Am. 93:2249–2254. doi:10.2106/JBJS.J.01994.
   Google Scholar
• Kong SH, Haouchine N, Soares R, Klymchenko A, Andreiuk B, Marques B, Shabat G, Piechaud T, Diana M, Cotin S, et al. 2017. Robust augmented reality registration method for localization of solid organs’ tumors using ct-derived virtual biomechanical model and fluorescent fiducials. Surg Endosc. 31(7):2863–2871. doi:10.1007/s00464-016-5297-8
   Google Scholar
• Kuhlemann I, Kleemann M, Jauer P, Schweikard A, Ernst F. 2017. Towards x-ray free endovascular interventions–using hololens for on-line holographic visualisation. Healthc Technol Lett. 4(5):184–187. doi:10.1049/htl.2017.0061.
   Google Scholar
• Laverdière C, Corban J, Khoury J, Ge S, Schupbach J, Harvey E, Reindl R, Martineau P. 2019. Augmented reality in orthopaedics: a systematic review and a window on future possibilities. Bone Joint J. 101-B:1479–1488. doi:10.1302/0301-620X.101B12.BJJ-2019-0315.R1.
   Google Scholar
• Lee SC, Fuerst B, Fotouhi J, Fischer M, Osgood G, Navab N. 2016. Calibration of rgbd camera and cone-beam ct for 3d intra-operative mixed reality visualization. Int J Comput Assist Radiol Surg. 11:967–975. doi:10.1007/s11548-016-1396-1.
   Google Scholar
• Levy J, Everding N, Frankle M, Keppler L. 2014. Accuracy of patient-specific guided glenoid baseplate positioning for reverse shoulder arthroplasty. J Shoulder Elb Surg. 23:1563–1567. doi:10.1016/j.jse.2014.01.051.
   Google Scholar
• Liebmann F, Roner S, von Atzigen M, Scaramuzza D, Sutter R, Snedeker J, Farshad M, Fürnstahl P. 2019. Pedicle screw navigation using surface digitization on the microsoft hololens. Int J Comput Assist Radiol Surg. 14(7):1157–1165. doi:10.1007/s11548-019-01973-7.
   Google Scholar
• Liu H, Auvinet E, Giles J, Baena F. 2018. Augmented reality based navigation for computer assisted hip resurfacing: A proof of concept study. Ann Biomed Eng. 46:1595–1605. doi:10.1007/s10439-018-2055-1.
   Google Scholar
• Liu H, Baena F 2020. Automatic markerless registration and tracking of the bone for computer-assisted orthopaedic surgery. IEEE Access. 1.
   Google Scholar
• Mansat P, Briot J, Mansat M, Swider P. 2007. Evaluation of the glenoid implant survival using a biomechanical finite element analysis: influence of the implant design, bone properties, and loading location. J Shoulder Elb Surg. 16:S79–83. doi:10.1016/j.jse.2005.11.010.
   Google Scholar
• Microsoft. 2020. Hololens research mode - mixed reality. [accessed 2020 June 13]. https://docs.microsoft.com/en-us/windows/mixed-reality/research-mode.
   Google Scholar
• Norris T, Iannotti J. 2002. Functional outcome after shoulder arthroplasty for primary osteoarthritis: A multicenter study *. J Shoulder Elb Surg. 11:130–135. doi:10.1067/mse.2002.121146.
   Google Scholar
• Nyffeler R, Sheikh R, Atkinson T, Jacob H, Favre P, Gerber C. 2006. Effects of glenoid component version on humeral head displacement and joint reaction forces: an experimental study. J Shoulder Elb Surg. 15:625–629. doi:10.1016/j.jse.2005.09.016.
   Google Scholar
• Park SY, Subbarao M. 2003. An accurate and fast point-to-plane registration technique. Pattern Recognit Lett. 24(16):2967–2976. doi:10.1016/S0167-8655(03)00157-0.
   Google Scholar
• Pepe A, Trotta GF, Mohr-Ziak P, Gsaxner C, Wallner J, Bevilacqua V, Egger J. 2019. A marker-less registration approach for mixed reality–aided maxillofacial surgery: a pilot evaluation. J Digit Imaging. 32(6):1008–1018. doi:10.1007/s10278-019-00272-6.
   Google Scholar
• Phillips JM, Liu R, Tomasi C 2007. Outlier robust icp for minimizing fractional rmsd. In: Sixth International Conference on 3-D Digital Imaging and Modeling (3DIM 2007). Montreal, QC: IEEE. p. 427–434.
   Google Scholar
• Qian L, Deguet A, Kazanzides P. 2018. Arssist: augmented reality on a head-mounted display for the first assistant in robotic surgery. Healthc Technol Lett. 5(5):194–200. doi:10.1049/htl.2018.5065.
   Google Scholar
• Rusu RB, Cousins S 2011. 3d is here: point cloud library (pcl). In: 2011 IEEE international conference on robotics and automation. Shanghai, China: IEEE. p. 1–4.
   Google Scholar
• Schoch B, Haupt E, Leonor T, Farmer K, Wright T, King J. 2020. Computer navigation leads to more accurate glenoid targeting during total shoulder arthroplasty compared with 3-dimensional preoperative planning alone. J Shoulder Elb Surg. doi:10.1016/j.jse.2020.03.014
   Google Scholar
• Song T, Yang C, Dianat O, Azimi E. 2018. Endodontic guided treatment using augmented reality on a head-mounted display system. Healthc Technol Lett. 5(5):201–207. doi:10.1049/htl.2018.5062.
   Google Scholar
• Suenaga H, Huy Hoang T, Liao H, Masamune K, Dohi T, Hoshi K, Takato T. 2015. Vision-based markerless registration using stereo vision and an augmented reality surgical navigation system: A pilot study. BMC Med Imaging. 15. doi:10.1186/s12880-015-0089-5.
   Google Scholar
• Throckmorton T, Gulotta L, Bonnarens F, Wright S, Hartzell J, Rozzi W, Hurst J, Frostick S, Sperling J. 2014. Patient-specific targeting guides compared with traditional instrumentation for glenoid component placement in shoulder arthroplasty: A multi-surgeon study in 70 arthritic cadaver specimens. J Shoulder Elb Surg. 24(6):965–971. Elsevier.
   Google Scholar
• Wang J, Shen Y, Yang S. 2019. A practical marker-less image registration method for augmented reality oral and maxillofacial surgery. Int J Comput Assist Radiol Surg. 14(5):763–773. doi:10.1007/s11548-019-01921-5.
   Google Scholar
• Wierks C, Skolasky R, Ji J. 2009. Reverse total shoulder replacement: intraoperative and early postoperative complications. Clin Orthop Relat Res. 467:225–234. doi:10.1007/s11999-008-0406-1.
   Google Scholar