Advanced search
Publication Cover
Computer Assisted Surgery Volume 24, 2019 - Issue sup1: Advances in Minimally Invasive Surgery and Clinical Measurement. Guest Editors: Chengyu Liu & Lung-kwang Pan
Submit an article Journal homepage
4,616
Views
22
CrossRef citations to date
0
Altmetric
Research Article

Real-time tracking of surgical instruments based on spatio-temporal context and deep learning

Zijian ZhaoSchool of Control Science and Engineering, Shandong University, Jinan, China; Correspondence[email protected]
View further author information
,
Zhaorui ChenSchool of Control Science and Engineering, Shandong University, Jinan, China; View further author information
,
Sandrine VorosUniversity Grenoble-Alpes, CNRS, INSERM, TIMC-IMAG, Grenoble, France; View further author information
&
Xiaolin ChengLab of Laparoscopic Technique and Engineering, Qilu Hospital of Shandong University, Jinan, ChinaView further author information
Pages 20-29 | Published online: 14 Feb 2019

References

  • Du X, Maximilian A, Alessio D, et al. Combined 2D and 3D tracking of surgical instruments for minimally invasive and robotic assisted surgery. Int J Comp Assisted Radiol and Surg. 2016;11(6):1109–1119.
  • Austin R, Peter KA, Zhao T. Feature classification for tracking articulated surgical tools. Proceedings of the 15th International Conference on Medical Image Computing and Computer-Assisted Intervention-MICCAI; 2012 Oct 1–5; Nice, France. p. 592–600.
  • Wesierski D, Wojdyga G, Jezierska A. Instrument tracking with rigid part mixtures model. Proceedings of the International Workshop on Computer-Assisted and Robotic Endoscopy; 2015 Oct; Munich. p. 22–34.
  • Felzenszwalb PF, Girshick RB, McAllester D, et al. Object detection with discriminatively trained part-based models. IEEE transac pattern anal machine intel. 2010;32(9):1627–1645.
  • Reiter A, Allen PK, Zhao T. Appearance learning for 3D tracking of robotic surgical tools. The Int J Robot Res. 2014;33(2):342–356.
  • Sznitman R, Ali K, Richa R, et al. Data-driven visual tracking in retinal microsurgery. Proceedings of the 15th International Conference on Medical Image Computing and Computer-Assisted Intervention-MICCAI; 2012 Oct 1–5; Nice, France. p. 568–575.
  • Agustinos A, Voros S. 2D/3D real-time tracking of surgical instruments based on endoscopic image processing. Proceedings of the International Workshop on Computer-Assisted and Robotic Endoscopy; 2015 Oct; Munich. p. 90–100.
  • Allan M, Chang P, Ourselin S, et al. Image based surgical instrument pose estimation with multi-class labelling and optical flow. Proceedings of the International Workshop on Computer-Assisted and Robotic Endoscopy; 2015 Oct; Munich. p. 331–338.
  • Reiter A, Allen P K. An online learning approach to in-vivo tracking using synergistic features. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); 2010 Oct 18–22; Taipei. p. 3441–3446.
  • Sznitman R, Richa R, Taylor RH, et al. Unified detection and tracking of instruments during retinal microsurgery. IEEE transac patt anal machine intel. 2013;35(5):1263–1273.
  • Sznitman R, Becker C, Fua P. Fast part-based classification for instrument detection in minimally invasive surgery. Proceedings of International Conference on Medical Image Computing and Computer-Assisted Intervention-MICCAI. 2014 Sept 17; Boston. p. 692–699.
  • Liu Q, Lu X, He Z, et al. Deep convolutional neural networks for thermal infrared object tracking. Knowledge-Based Sys. 2017;134:189–198.
  • Yang W, Zhou Q, Fan Y, et al. Deep context convolutional neural networks for semantic segmentation. Proceedings of CCF Chinese Conference on Computer Vision; 2017 Oct; Tianjin. p. 696–704.
  • Nam H, Han B. Learning multi-domain convolutional neural networks for visual tracking. In: IEEE Conference on Computer Vision and Pattern Recognition; 2016 Jun 26–Jul 1; Las Vegas. p. 4293–4302.
  • Zhang K, Zhang L, Yang M, et al. Fast tracking via spatio-temporal context learning. In arXiv: 1311.1939, 2013.
  • Wang C, Palomar R, Cheikh FA. Stereo video analysis for instrument tracking in image-guide surgery. Proceedings of the 5th European Workshop on Visual Information Processing (EUVIP); 2014 Dec 10–12; Paris. p. 1–6.
  • Jaderberg M, Simonyan K, Zisserman A. Spatial transformer networks. Adv in Neu Info Proc Sys. 2015;28:2017–2025.
  • Garcia L, Li W,Gruijthuijsen C, et al. Real-time segmentation of non-rigid surgical tools based on deep learning and tracking. Proceedings of the International Workshop on Computer-Assisted and Robotic Endoscopy; 2016 Oct; Athens. p. 84–95.
  • Hinton GE, Srivastava N, Krizhevsky A, et al. Improving neural networks by preventing co-adaptation of feature detectors. In arXiv: 1207.0580, 2012.
  • Ma C, Huang J, Yang X, Yang M. Hierarchical convolutional features for visual tracking. Proceedings of the International Conference on Computer Vision; 2015 Dec 7–13; Santiago. p. 3074–3082.
  • Zhao Z. Real-time 3D visual tracking of laparoscopic instruments for robotized endoscope holder. Bio-medical mat and eng. 2014;24(6):2665–2672.
  • Babenko B, Yang M, Belongie S. Robust object tracking with online multiple instance learning. IEEE Transact patt anal and machine intel. 2011;33(8):1619–1632.
  • Giannarou S, Visentini-Scarzanella M, Yang G. Probabilistic tracking of affineinvariant anisotropic regions. IEEE Transact patt anal and machine intel. 2013;35(1):130–143.
  • Joseph R, Santosh D, Ross G. et al. You only look once: unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2016 Jun 26–Jul 1; Las Vegas. p. 779–788.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.