Towards natural 3D interaction for laparoscopic augmented reality registration

References

• Arun KS, Huang TS, Blostein SD. 1987. Least-squares fitting of two 3-d point sets. IEEE Trans Pattern Anal Mach Intell. 9(5):698–700. doi:10.1109/TPAMI.1987.4767965.
   Google Scholar
• Bernhardt S, Nicolau S, Soler L, Doignon C. 2017. The status of augmented reality in laparoscopic surgery as of 2016. Med Image Anal. 37:66–90. doi:10.1016/j.media.2017.01.007.
   Google Scholar
• Bogdanova R, Boulanger P, Zheng B. 2016. Depth perception of surgeons in minimally invasive surgery. Surg Innov. 23(5):515–524. doi:10.1177/1553350616639141.
   Google Scholar
• Bowman DA, McMahan RP, Ragan ED. 2012. Questioning naturalism in 3d user interfaces. Commun ACM. 55(9):78. doi:10.1145/2330667.2330687.
   Google Scholar
• Bradski G. 2000. The opencv library. Dr Dobb’s J Soft Tools. 25:120–125.
   Google Scholar
• Brooke J. 1996. Sus-a quick and dirty usability scale. Usab Eval Indus. 189(194):4–7.
   Google Scholar
• Chen Y, Li H, Wu D, Bi K, Liu C. 2014. Surgical planning and manual image fusion based on 3d model facilitate laparoscopic partial nephrectomy for intrarenal tumors. World J Urol. 32(6):1493–1499. doi:10.1007/s00345-013-1222-0.
   Google Scholar
• Conrad C, Fusaglia M, Peterhans M, Lu H, Weber S, Gayet B. 2016. Augmented reality navigation surgery facilitates laparoscopic rescue of failed portal vein embolization. J Am Coll Surg. 223(4):e31–4. doi:10.1016/j.jamcollsurg.2016.06.392.
   Google Scholar
• É L, Reyes J, Drouin S, Collins DL, Popa T, Kersten-Oertel M. 2018. Gesture-based registration correction using a mobile augmented reality image-guided neurosurgery system. Healthcare Technol Lett. 5(5):137–142. doi:10.1049/htl.2018.5063.
   Google Scholar
• de Araújo BR, Casiez G, Jorge JA, Hachet M. 2013. Mockup builder: 3d modeling on and above the surface. Comput Graph. 37(3):165–178. doi:10.1016/j.cag.2012.12.005.
   Google Scholar
• Detmer FJ, Hettig J, Schindele D, Schostak M, Hansen C. 2017. Virtual and augmented reality systems for renal interventions: A systematic review. IEEE Rev Biomed Eng. 10:78–94. doi:10.1109/RBME.2017.2749527.
   Google Scholar
• Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin JC, Pujol S, Bauer C, Jennings D, Fennessy F, Sonka M, et al. 2012. 3d slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging. 30(9):1323–1341. doi:10.1016/j.mri.2012.05.001
   Google Scholar
• Garrido-Jurado S, Muñoz-Salinas R, Madrid-Cuevas FJ, Marín-Jiménez MJ. 2014. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognit. 47(6):2280–2292. doi:10.1016/j.patcog.2014.01.005.
   Google Scholar
• Gong RH, Ö G, Kürklüoglu M, Lovejoy J, Yaniv Z. 2013. Interactive initialization of 2d/3d rigid registration. Med Phys. 40(12):121911. doi:10.1118/1.4830428.
   Google Scholar
• Hayashi Y, Misawa K, Hawkes DJ, Mori K. 2016. Progressive internal landmark registration for surgical navigation in laparoscopic gastrectomy for gastric cancer. Int J Comput Assist Radiol Surg. 11(5):837–845. doi:10.1007/s11548-015-1346-3.
   Google Scholar
• Heller N, Sathianathen N, Kalapara A, Walczak E, Moore K, Kaluzniak H, Rosenberg J, Blake P, Rengel Z, Oestreich M, et al. 2019. The kits19 challenge data: 300 kidney tumor cases with clinical context, ct semantic segmentations, and surgical outcomes. [accessed 2019 Sep 15] http://arxiv.org/pdf/1904.00445v1
   Google Scholar
• Mendes D, Caputo FM, Giachetti A, Ferreira A, Jorge J. 2019. A survey on 3d virtual object manipulation: from the desktop to immersive virtual environments. Comput Graph Forum. 38(1):21–45. doi:10.1111/cgf.13390.
   Google Scholar
• Nicolau S, Soler L, Mutter D, Marescaux J. 2011. Augmented reality in laparoscopic surgical oncology. Surg Oncol. 20(3):189–201. doi:10.1016/j.suronc.2011.07.002.
   Google Scholar
• Pratt P, Mayer E, Vale J, Cohen D, Edwards E, Darzi A, Yang GZ. 2012. An effective visualisation and registration system for image-guided robotic partial nephrectomy. J Robot Surg. 6(1):23–31. doi:10.1007/s11701-011-0334-z.
   Google Scholar
• Song P, Goh WB, Hutama W, Fu CW, Liu X. 2012. A handle bar metaphor for virtual object manipulation with mid-air interaction. In: Konstan JA, editor. Proceedings of the SIGCHI conference on human factors in computing systems. New York (NY): ACM; p. 1297. ACM Digital Library.
   Google Scholar
• Thompson S, Totz J, Song Y, Johnsen S, Stoyanov D, Ourselin S, Gurusamy K, Schneider C, Davidson B, Hawkes D, et al. 2015. Accuracy validation of an image guided laparoscopy system for liver resection. In: Webster RJ, Yaniv ZR, editors. Medical imaging 2015: image-guided procedures, robotic interventions, and modeling. SPIE Digital Library; 941509. SPIE Proceedings.
   Google Scholar
• Wang D, Zhang B, Yuan X, Zhang X, Liu C. 2015. Preoperative planning and real-time assisted navigation by three-dimensional individual digital model in partial nephrectomy with three-dimensional laparoscopic system. Int J Comput Assist Radiol Surg. 10(9):1461–1468. doi:10.1007/s11548-015-1148-7.
   Google Scholar