A tool-free neuronavigation method based on single-view hand tracking

References

• Alfonso-Garcia A, Bec J, Sridharan Weaver S, Hartl B, Unger J, Bobinski M, Lechpammer M, Girgis F, Boggan J, Marcu L. 2020. Real-time augmented reality for delineation of surgical margins during neurosurgery using autofluorescence lifetime contrast. J Biophoton. 13(1):e201900108. doi:10.1002/jbio.201900108.
   Google Scholar
• Bradski G. 2000. The OpenCV library. Dr Dobb’s Journal of Software Tools.
   Google Scholar
• Brainlab. 2022. Brainlab curve. https://www.brainlab.com/surgery-products/overview-platform-products/curve-image-guided-surgery/.
   Google Scholar
• Chen F, Nakaji P. 2012. Optimal entry point and trajectory for endoscopic third ventriculostomy: evaluation of 53 patients with volumetric imaging guidance. J Neurosurg. 116(5):1153–1157. doi:10.3171/2012.2.JNS111287.
   Google Scholar
• Chidambaram S, Stifano V, Demetres M, Teyssandier M, Palumbo MC, Redaelli A, Olivi A, Apuzzo ML, Pannullo SC. 2021. Applications of augmented reality in the neurosurgical operating room: a systematic review of the literature. Journal of Clinical Neuroscience. 91:43–61. doi:10.1016/j.jocn.2021.06.032.
   Google Scholar
• Cho J, Rahimpour S, Cutler A, Goodwin CR, Lad SP, Codd P. 2020. Enhancing reality: a systematic review of augmented reality in neuronavigation and education. World Neurosurg. 139:186–195. doi:10.1016/j.wneu.2020.04.043.
   Google Scholar
• Dewan MC, Rattani A, Fieggen G, Arraez MA, Servadei F, Boop FA, Johnson WD, Warf BC, Park KB. 2019. Global neurosurgery: the current capacity and deficit in the provision of essential neurosurgical care. executive summary of the global neurosurgery initiative at the program in global surgery and social change. J Neurosurg. 130:1055–1064. doi:10.3171/2017.11.JNS171500.
   Google Scholar
• Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, et al. 2012. 3d slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging. 30.1323–1341. doi:10.1016/j.mri.2012.05.001.
   Google Scholar
• Gerard IJ, Hall JA, Mok K, Collins DL. 2015. New protocol for skin landmark registration in image-guided neurosurgery: technical note. Clin Neurosurg. 11(3):376–381. doi:10.1227/NEU.0000000000000868.
   Google Scholar
• Grunert P, Darabi K, Espinosa J, Filippi R. 2003. Computer-aided navigation in neurosurgery. Neurosurg Rev. 26(2):73–99. doi:10.1007/s10143-003-0262-0.
   Google Scholar
• Haouchine N, Juvekar P, Golby A, Frisken S. 2021a. Predicted microscopic cortical brain images for optimal craniotomy positioning and visualisation. Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization. 9(4):407–413. doi:10.1080/21681163.2020.1834874.
   Google Scholar
• Haouchine N, Juvekar P, Nercessian M, Wells IW, Golby A, Frisken S. 2021b. Pose estimation and non-rigid registration for augmented reality during neurosurgery. IEEE Trans Biomed Eng. 69(4):1310–1317. doi:10.1109/TBME.2021.3113841.
   Google Scholar
• Heikkila J, Silven O. 1997. A four-step camera calibration procedure with implicit image correction. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition; San Juan, PR, USA: IEEE Comput. Soc. p. 1106–1112.
   Google Scholar
• Horn BKP. 1987. Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am A. 4(4):629–642. doi:10.1364/JOSAA.4.000629.
   Google Scholar
• Hou Y, Ma L, Zhu R, Chen X, Zhang J. 2016. A low-cost iPhone-assisted augmented reality solution for the localization of intracranial lesions. PloS One. 11(7):e0159185. doi:10.1371/journal.pone.0159185.
   Google Scholar
• Incekara F, Smits M, Dirven C, Vincent A. 2018. Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg. 118:e422–427. doi:10.1016/j.wneu.2018.06.208.
   Google Scholar
• Kersten-Oertel M, Gerard IJ, Drouin S, Petrecca K, Hall JA, Louis Collins D. 2016. Towards augmented reality guided craniotomy planning in tumour resections. In: International Conference on Medical Imaging and Augmented Reality; Bern, Switzerland: Springer. p. 163–174.
   Google Scholar
• Lacroix M, Abi-Said D, Fourney DR, Gokaslan ZL, Shi W, DeMonte F, Lang FF, McCutcheon IE, Hassenbusch SJ, Holland E, et al. 2001. A multivariate analysis of 416 patients with glioblastoma multiforme: prognosis, extent of resection, and survival. J Neurosurg. 95(2):190–198. doi:10.3171/jns.2001.95.2.0190.
   Google Scholar
• Léger É, Horvath S, Fillion-Robin JC, Allemang D, Gerber S, Juvekar P, Torio E, Kapur T, Pieper S, Pujol S, et al. 2022. Nousnav: a low-cost neuronavigation system for deployment in lower-resource settings. Int J Comput Assist Radiol Surg. 17.1745–1750. doi:10.1007/s11548-022-02644-w.
   Google Scholar
• Léger É, Reyes J, Drouin S, Popa T, Hall JA, Collins DL, Kersten-Oertel M. 2020. MARIN: an open-source mobile augmented reality interactive neuronavigation system. Int J Comput Assist Radiol Surg. 15(6):1013–1021. doi:10.1007/s11548-020-02155-6.
   Google Scholar
• Low D, Lee CK, Dip LLT, Ng WH, Ang BT, Ng I. 2010. Augmented reality neurosurgical planning and navigation for surgical excision of parasagittal, falcine and convexity meningiomas. Br J Neurosurg. 24(1):69–74. doi:10.3109/02688690903506093.
   Google Scholar
• Marcus HJ, Pratt P, Hughes-Hallett A, Cundy TP, Marcus AP, Yang GZ, Darzi A, Nandi D. 2015. Comparative effectiveness and safety of image guidance systems in neurosurgery: a preclinical randomized study. J Neurosurg. 123(2):307–313. doi:10.3171/2014.10.JNS141662.
   Google Scholar
• McGirt MJ, Chaichana KL, Attenello FJ, Weingart JD, Than K, Burger PC, Olivi A, Brem H, Quinoñes-Hinojosa A. 2008. Extent of surgical resection is independently associated with survival in patients with hemispheric infiltrating low-grade gliomas. Neurosurgery. 63(4):700–708. doi:10.1227/01.NEU.0000325729.41085.73.
   Google Scholar
• Rai SKR, Dandpat SK, Jadhav D, Ranjan S, Shah A, Goel AH. 2019. Optimizing burr hole placement for craniotomy: a technical note. J Neurosci Rural Pract. 10(03):413–416. doi:10.1055/s-0039-1695699.
   Google Scholar
• Robertson FC, Raahil MS, Amich JM, Essayed WI, Lal A, Lee BH, Prieto PC, Tokuda J, Weaver JC, Kirollos RW, et al. 2021. Frameless neuronavigation with computer vision and real-time tracking for bedside external ventricular drain placement: a cadaveric study. J Neurosurg. 136(5):1475–1484. doi:10.3171/2021.5.JNS211033.
   Google Scholar
• Sanai N, Polley MY, McDermott MW, Parsa AT, Berger MS. 2011. An extent of resection threshold for newly diagnosed glioblastomas. J Neurosurg. 115(1):3–8. doi:10.3171/2011.2.JNS10998.
   Google Scholar
• Simon T, Joo H, Matthews I, Sheikh Y. 2017. Hand keypoint detection in single images using multiview bootstrapping. In: Proceedings of the IEEE conference on Computer Vision and Pattern Recognition; Honolulu, HI, USA. p. 1145–1153.
   Google Scholar
• Smith JS, Chang EF, Lamborn KR, Chang SM, Prados MD, Cha S, Tihan T, VandenBerg S, McDermott MW, Berger MS. 2008. Role of extent of resection in the long-term outcome of low-grade hemispheric gliomas. Journal of Clinical Oncology. 26(8):1338–1345. doi:10.1200/JCO.2007.13.9337.
   Google Scholar
• Spivak CJ, Pirouzmand F. 2005. Comparison of the reliability of brain lesion localization when using traditional and stereotactic image-guided techniques: a prospective study. J Neurosurg. 103(3):424–427. doi:10.3171/jns.2005.103.3.0424.
   Google Scholar
• Sun G, Wang F, Chen X, Xg Y, Xd M, Zhou D, Zhu R, Bn X. 2016. Impact of virtual and augmented reality based on intraoperative magnetic resonance imaging and functional neuronavigation in glioma surgery involving eloquent areas. World Neurosurg. 96:375–382. doi:10.1016/j.wneu.2016.07.107.
   Google Scholar
• Terzakis G, Lourakis M. 2020. A consistently fast and globally optimal solution to the perspective-n-point problem. In: European Conference on Computer Vision; Glasgow, UK: Springer. p. 478–494.
   Google Scholar
• Tokuda J, Fischer GS, Papademetris X, Yaniv Z, Ibanez L, Cheng P, Liu H, Blevins J, Arata J, Golby AJ, et al. 2009. Openigtlink: an open network protocol for image-guided therapy environment. Int J Med Robot Comput Assist. 5(4):423–434. doi:10.1002/rcs.274.
   Google Scholar
• Wagner W, Gaab M, Schroeder H, Tschiltschke W. 2000. Cranial neuronavigation in neurosurgery: assessment of usefulness in relation to type and site of pathology in 284 patients. Min-Minimally Invasive Neurosurgery. 43(03):124–131. doi:10.1055/s-2000-8332.
   Google Scholar
• Watanabe E, Satoh M, Konno T, Hirai M, Yamaguchi T. 2016. The trans-visible navigator: a see-through neuronavigation system using augmented reality. World Neurosurg. 87:399–405. doi:10.1016/j.wneu.2015.11.084.
   Google Scholar
• Zhang Z. 2000. A flexible new technique for camera calibration. IEEE Trans Pattern Anal Mach Intell. 22(11):1330–1334. doi:10.1109/34.888718.
   Google Scholar
• Zhang F, Bazarevsky V, Vakunov A, Sung G, Chang CL, Grundmann M, Tkachenka A. 2020. Mediapipe hands: on-device real-time hand tracking. In: CVPR Workshop on Computer Vision for Augmented and Virtual Reality.
   Google Scholar