Automatic tracking of laparoscopic instruments for autonomous control of a cameraman robot

Abstract

Background An automated instrument tracking procedure was designed and developed for autonomous control of a cameraman robot during laparoscopic surgery. Material and methods The procedure was based on an innovative marker-free segmentation algorithm for detecting the tip of the surgical instruments in laparoscopic images. A compound measure of Saturation and Value components of HSV color space was incorporated that was enhanced further using the Hue component and some essential characteristics of the instrument segment, e.g., crossing the image boundaries. The procedure was then integrated into the controlling system of the RoboLens cameraman robot, within a triple-thread parallel processing scheme, such that the tip is always kept at the center of the image. Results Assessment of the performance of the system on prerecorded real surgery movies revealed an accuracy rate of 97% for high quality images and about 80% for those suffering from poor lighting and/or blood, water and smoke noises. A reasonably satisfying performance was also observed when employing the system for autonomous control of the robot in a laparoscopic surgery phantom, with a mean time delay of 200ms. Conclusion It was concluded that with further developments, the proposed procedure can provide a practical solution for autonomous control of cameraman robots during laparoscopic surgery operations.

Keywords:

• Minimally invasive surgery
• abdominal surgery
• image guidance
• robotic surgery

Acknowledgments

This research was supported by grant No. 91002447 from Iranian National Science Foundation.

Disclosure of interest

Keyvan Amini Khoiy, Alireza Mirbagheri, and Farzam Farahmand declare that they have no conflict of interest concerning the contents of this article.