Visual kinematic force estimation in robot-assisted surgery – application to knot tying

References

• Abiri A, Askari SJ, Tao A, Juo YY, Dai Y, Pensa J, Candler R, Dutson EP, Grundfest WS. 2018. Suture breakage warning system for robotic surgery. IEEE Trans Biomed Eng. 66(4):1165–1171. doi:10.1109/TBME.2018.2869417.
   Google Scholar
• Abiri A, Paydar O, Tao A, LaRocca M, Liu K, Genovese B, Candler R, Grundfest WS, Dutson EP. 2017. Tensile strength and failure load of sutures for robotic surgery. Surg Endosc. 31(8):3258–3270. doi:10.1007/s00464-016-5356-1.
   Google Scholar
• Aviles AI, Alsaleh SM, Hahn JK, Casals A. 2017. Towards retrieving force feedback in robotic-assisted surgery: A supervised neuro-recurrent-vision approach. IEEE Trans Haptics. 10(3):431–443. doi:10.1109/TOH.2016.2640289.
   Google Scholar
• Du X, Allan M, Dore A, Ourselin S, Hawkes D, Kelly JD, Stoyanov D. 2016. Combined 2d and 3d tracking of surgical instruments for minimally invasive and robotic-assisted surgery. Int J Comput Assist Radiol Surg. 11(6):1109–1119. doi:10.1007/s11548-016-1393-4.
   Google Scholar
• Gao Y, Vedula SS, Reiley CE, Ahmidi N, Varadarajan B, Lin HC, Tao L, Zappella L, N Béjar B, Yuh DD, et al. 2014. JHU-ISI gesture and skill assessment working set (JIGSAWS): A surgical activity dataset for human motion modeling. In: Modeling and Monitoring of Computer Assisted Interventions (M2CAI) MICCAI Workshop, Boston, MA; vol. 3. p. 3.
   Google Scholar
• Giannarou S, Ye M, Gras G, Leibrandt K, Marcus HJ, Yang GZ. 2016. Vision-based deformation recovery for intraoperative force estimation of tool–tissue interaction for neurosurgery. Int J Comput Assist Radiol Surg. 11(6):929–936. doi:10.1007/s11548-016-1361-z.
   Google Scholar
• Haouchine N, Kuang W, Cotin S, Yip M. 2018. Vision-based force feedback estimation for robot-assisted surgery using instrument-constrained biomechanical three-dimensional maps. IEEE Rob Autom Lett. 3(3):2160–2165. doi:10.1109/LRA.2018.2810948.
   Google Scholar
• Kristan M, Leonardis A, Matas J, Felsberg M, Pflugfelder R, Cehovin Zajc L, Vojir T, Hager G, Lukezic A, Eldesokey A, et al. 2017. The visual object tracking vot2017 challenge results. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, Venice, Italy. p. 1949–1972.
   Google Scholar
• Lee D, Kim U, Gulrez T, Yoon WJ, Hannaford B, Choi HR. 2016. A laparoscopic grasping tool with force sensing capability. IEEE/ASME Trans Mechatron. 21(1):130–141.
   Google Scholar
• Li Y, Miyasaka M, Haghighipanah M, Cheng L, Hannaford B. 2016. Dynamic modeling of cable driven elongated surgical instruments for sensorless grip force estimation. In: 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden; May; p. 4128–4134.
   Google Scholar
• Lukežič A, Vojíř T, Čehovin Zajc L, Matas J, Kristan M. 2017. Discriminative correlation filter with channel and spatial reliability. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, Hawaii. p. 6309–6318.
   Google Scholar
• Marban A, Srinivasan V, Samek W, Fernndez J, Casals A. 2019. A recurrent convolutional neural network approach for sensorless force estimation in robotic surgery. Biomed Signal Process Control. 50:134–150. doi:10.1016/j.bspc.2019.01.011.
   Google Scholar
• Noohi E, Parastegari S, Efran M. 2014. Using monocular images to estimate interaction forces during minimally invasive surgery. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, Illinois; Sep; p. 4297–4302.
   Google Scholar
• Okamura A. 2009. Haptic feedback in robot-assisted minimally invasive surgery. Curr Opin Urol. 19(1):102–107. doi:10.1097/MOU.0b013e32831a478c.
   Google Scholar
• Reiley CE, Akinbiyi T, Burschka D, Chang DC, Okamura AM, Yuh DD. 2008. Effects of visual force feedback on robot-assisted surgical task performance. J Thorac Cardiovasc Surg. 135(1):196–202. doi:10.1016/j.jtcvs.2007.08.043.
   Google Scholar
• Richards C, Rosen J, Hannaford B, Pellegrini C, Sinanan M. 2000. Skills evaluation in minimally invasive surgery using force/torque signatures. Surg Endosc. 14(9):791–798. doi:10.1007/s004640000230.
   Google Scholar
• Romero-Ramirez FJ, Muoz-Salinas R, Medina-Carnicer R. 2018. Speeded up detection of squared fiducial markers. Image Vis Comput. 76:38–47. doi:10.1016/j.imavis.2018.05.004.
   Google Scholar
• Ye M, Zhang L, Giannarou S, Yang GZ. 2016. Real-time 3d tracking of articulated tools for robotic surgery. In: Proceedings of the International Conference on Medical image computing and computer-assisted intervention – MICCAI 2016, Athens, Greece. Springer; p. 386–394.
   Google Scholar
• Zhao W, Zhao T, Larkin DQ US Patent 2010/0169815, Intuitive Surgical Inc. 2010. Visual force feedback in a minimally invasive surgical procedure.
   Google Scholar