Template-update-based visual tracking for automatic cell manipulation in FluidFM

References

• Alhaj Alabdulla, A.; Haşıloğlu, A.; Hicazi Aksu, E. A robust sperm cell tracking algorithm using uneven lighting image fixing and improved branch and bound algorithm. IET Image Proc. 2021, 15, 2068–2079. DOI: 10.1049/ipr2.12178.
   Web of Science ®Google Scholar
• Mostajer Kheirkhah, F.; Sadegh Mohammadi, H. R.; Shahverdi, A. Efficient and robust segmentation and tracking of sperm cells in microscopic image sequences. IET Comput. Vision 2019, 13, 489–499. DOI: 10.1049/iet-cvi.2018.5662.
   Web of Science ®Google Scholar
• Garitano-Trojaola, A.; Sancho, A.; Götz, R.; Eiring, P.; Walz, S.; Jetani, H.; Gil-Pulido, J.; Da Via, M. C.; Teufel, E.; Rhodes, N.; et al. Actin cytoskeleton deregulation confers midostaurin resistance in FLT3-mutant acute myeloid leukemia. Commun. Biol. 2021, 4, 799. DOI: 10.1038/s42003-021-02215-w.
   Web of Science ®Google Scholar
• Mathelié-Guinlet, M.; Viela, F.; Dehullu, J.; Filimonava, S.; Rauceo, J. M.; Lipke, P. N.; Dufrêne, Y. F. Single-cell fluidic force microscopy reveals stress-dependent molecular interactions in yeast mating. Commun. Biol. 2021, 4, 33. DOI: 10.1038/s42003-020-01498-9.
   Web of Science ®Google Scholar
• Dehullu, J.; Vorholt, J. A.; Lipke, P. N.; Dufrêne, Y. F. Fluidic force microscopy captures amyloid bonds between microbial cells. Trends Microbiol. 2019, 27, 728–730. DOI: 10.1016/j.tim.2019.06.001.
   PubMed Web of Science ®Google Scholar
• Dehullu, J.; Valotteau, C.; Herman-Bausier, P.; Garcia-Sherman, M.; Mittelviefhaus, M.; Vorholt, J. A.; Lipke, P. N.; Dufrêne, Y. F. Fluidic force microscopy demonstrates that homophilic adhesion Bycandida albicans Als proteins is mediated by amyloid bonds between cells. Nano Lett. 2019, 19, 3846–3853. DOI: 10.1021/acs.nanolett.9b01010.
   PubMed Web of Science ®Google Scholar
• Sancho, A.; Vandersmissen, I.; Craps, S.; Luttun, A.; Groll, J. A new strategy to measure intercellular adhesion forces in mature cell-cell contacts. Sci. Rep. 2017, 7, 46152. DOI: 10.1038/srep46152.
   Web of Science ®Google Scholar
• Zhang, Q.; Shao, Y.; Li, B.; Wu, Y.; Dong, J.; Zhang, D.; Wang, Y.; Yan, Y.; Wang, X.; Pu, Q.; Guo, G. Visually precise, low-damage, single-cell spatial manipulation with single-pixel resolution. Chem. Sci. 2021, 12, 4111–4118. DOI: 10.1039/d0sc05534d.
   PubMed Web of Science ®Google Scholar
• Liang, J. W.; Zhang, X. M.; Zhu, B. L. Nonlinear topology optimization of parallel-grasping microgripper. Precis. Eng. 2019, 60, 152–159. DOI: 10.1016/j.precisioneng.2019.08.004.
   Web of Science ®Google Scholar
• Juan, M. L.; Righini, M.; Quidant, R. Plasmon nano-optical tweezers. Nature Photon. 2011, 5, 349–356. DOI: 10.1038/nphoton.2011.56.
   Web of Science ®Google Scholar
• Ta, Q. M.; Cheah, C. C. Human–machine interaction control for stochastic cell manipulation systems. Automatica 2021, 131, 109721. DOI: 10.1016/j.automatica.2021.109721.
   Web of Science ®Google Scholar
• Erb, R. M.; Martin, J. J.; Soheilian, R.; Pan, C.; Barber, J. R. Actuating soft matter with magnetic torque. Adv. Funct. Mater. 2016, 26, 3859–3880. DOI: 10.1002/adfm.201504699.
   Web of Science ®Google Scholar
• Wei, T.; Liu, J.; Li, D.; Chen, S.; Zhang, Y.; Li, J.; Fan, L.; Guan, Z.; Lo, C. M.; Wang, L.; et al. Development of magnet-driven and image-guided degradable microrobots for the precise delivery of engineered stem cells for cancer therapy. Small 2020, 16, e1906908. DOI: 10.1002/smll.201906908.
   PubMed Web of Science ®Google Scholar
• Chen, P.; Li, S.; Guo, Y.; Zeng, X.; Liu, B.-F. A review on microfluidics manipulation of the extracellular chemical microenvironment and its emerging application to cell analysis. Anal. Chim. Acta 2020, 1125, 94–113. DOI: 10.1016/j.aca.2020.05.065.
   PubMed Web of Science ®Google Scholar
• Chaumette, F.; Hutchinson, S. Visual servo control, part I: basic approaches. IEEE Robot. Automat. Mag. 2006, 13, 82–90. DOI: 10.1109/MRA.2006.250573.
   Web of Science ®Google Scholar
• Li, H.; von Kleist-Retzow, F. T.; Haenssler, O. C.; Fatikow, S.; Zhang, X. Multi-Target Tracking for Automated RF On-Wafer Probing Based on Template Matching; International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS). Helsinki, Finland: IEEE, 2019; pp. 1–6.
   Google Scholar
• Zimmermann, S.; Tiemerding, T.; Li, T.; Wang, W.; Wang, Y.; Fatikow, S. Automated Mechanical characterization of 2-D materials using SEM based visual servoing. Int. J. Optomechatron. 2013, 7, 283–295. DOI: 10.1080/15599612.2013.879501.
   Web of Science ®Google Scholar
• Meister, A.; Gabi, M.; Behr, P.; Studer, P.; Vörös, J.; Niedermann, P.; Bitterli, J.; Polesel-Maris, J.; Liley, M.; Heinzelmann, H.; Zambelli, T. FluidFM: combining atomic force microscopy and nanofluidics in a universal liquid delivery system for single cell applications and beyond. Nano Lett. 2009, 9, 2501–2507. DOI: 10.1021/nl901384x.
   PubMed Web of Science ®Google Scholar
• Meister, A.; Polesel-Maris, J.; Niedermann, P.; Przybylska, J.; Studer, P.; Gabi, M.; Behr, P.; Zambelli, T.; Liley, M.; Vörös, J.; Heinzelmann, H. Nanoscale dispensing in liquid environment of streptavidin on a biotin-functionalized surface using hollow atomic force microscopy probes. Microelectron. Eng. 2009, 86, 1481–1484. DOI: 10.1016/j.mee.2008.10.025.
   Web of Science ®Google Scholar
• Dörig, P.; Stiefel, P.; Behr, P.; Sarajlic, E.; Bijl, D.; Gabi, M.; Vörös, J.; Vorholt, J. A.; Zambelli, T. Force-controlled spatial manipulation of viable mammalian cells and micro-organisms by means of FluidFM technology. Appl. Phys. Lett. 2010, 97, 023701. DOI: 10.1063/1.3462979.
   Web of Science ®Google Scholar
• Xie, H.; Zhang, H.; Song, J.; Meng, X.; Geng, J.; Sun, L. Living cell manipulation and in situ nanoinjection based on frequency shift feedback using cantilevered micropipette probes. IEEE Trans. Automat. Sci. Eng. 2020, 17, 142–150. DOI: 10.1109/TASE.2019.2904281.
   Web of Science ®Google Scholar
• He, T.; Mao, H.; Guo, J.; Yi, Z. Cell tracking using deep neural networks with multi-task learning. Image Vis. Comput. 2017, 60, 142–153. DOI: 10.1016/j.imavis.2016.11.010.
   Web of Science ®Google Scholar
• Barcellos, P.; Scharcanski, J. Part-based object tracking using multiple adaptive correlation filters. IEEE Trans. Instrum. Meas. 2021, 70, 1–10. DOI: 10.1109/TIM.2021.3088455.
   PubMed Web of Science ®Google Scholar
• Andrew Fitzgibbon, Svetlana Lazebnik, Pietro Perona, Yoichi Sato, and Cordelia Schmid, eds. Computer Vision – ECCV 2012: 12th European Conference on Computer Vision, Florence, Italy, October 7–13, 2012, Proceedings, Part IV, Vol. 7575 of Lecture Notes in Computer Science. Springer: Berlin; Heidelberg, 2012.
   Google Scholar
• Henriques, J. F.; Caseiro, R.; Martins, P.; Batista, J. High-speed tracking with kernelized correlation filters. IEEE Trans. Pattern Anal. Mach. Intell. 2015, 37, 583–596. DOI: 10.1109/TPAMI.2014.2345390.
   PubMed Web of Science ®Google Scholar
• Luo, W.; Xing, J.; Milan, A.; Zhang, X.; Liu, W.; Kim, T.-K. Multiple object tracking: a literature review. Artif. Intell. 2021, 293, 103448. DOI: 10.1016/j.artint.2020.103448.
   Web of Science ®Google Scholar
• Bolme, D. S.; Beveridge, J. R.; Draper, B. A.; Lui, Y. M. Visual Object Tracking Using Adaptive Correlation Filters; 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Francisco, CA, USA: IEEE, 2010; pp. 2544–2550.
   Google Scholar
• Li, H.; Zhang, X.; Zhu, B.; Lu, Y.; Wu, H. Micro-motion detection of the 3-DoF precision positioning stage based on iterative optimized template matching. Appl. Opt. 2017, 56, 9435–9443. DOI: 10.1364/AO.56.009435.
   PubMed Web of Science ®Google Scholar
• Karimirad, F.; Shirinzadeh, B.; Yan, W.; Fatikow, S. A vision-based methodology to dynamically track and describe cell deformation during cell micromanipulation. Int. J. Optomechatron. 2013, 7, 33–45. DOI: 10.1080/15599612.2012.744433.
   Web of Science ®Google Scholar
• Guillaume-Gentil, O.; Potthoff, E.; Ossola, D.; Dörig, P.; Zambelli, T.; Vorholt, J. A. Force-controlled fluidic injection into single cell nuclei. Small 2013, 9, 1904–1907. DOI: 10.1002/smll.201202276.
   PubMed Web of Science ®Google Scholar
• Guillaume-Gentil, O.; Gäbelein, C. G.; Schmieder, S.; Martinez, V.; Zambelli, T.; Künzler, M.; Vorholt, J. A. Injection into and extraction from single fungal cells. Commun. Biol. 2022, 5, 180. DOI: 10.1038/s42003-022-03127-z.
   PubMed Web of Science ®Google Scholar