Regularising disparity estimation via multi task learning with structured light reconstruction

References

• Allan M, McLeod AJ, Wang CC, Rosenthal JC, Hu Z, Gard N, Eisert P, Fu K, Zeffiro T, Xia W, et al. 2021. Stereo correspondence and reconstruction of endoscopic data challenge. ArXiv Abs/2101,01133.
   Google Scholar
• Beck J 2019. Scan the world; [https://www.myminifactory.com/scantheworld].
   Google Scholar
• Brigato L, Iocchi L 2021. A close look at deep learning with small data. 2020 25th International Conference on Pattern Recognition Virtual-Milan, Italy (ICPR):2490–2497.
   Google Scholar
• Cao Y, Wu Z, Shen C. 2018. Estimating depth from monocular images as classification using deep fully convolutional residual networks. IEEE Trans Circuits Syst Video Technol. 28:3174–3182. doi:10.1109/TCSVT.2017.2740321.
   Google Scholar
• Cartucho J, Tukra S, Li Y, Elson DS, Giannarou S. 2020. Visionblender: a tool to efficiently generate computer vision datasets for robotic surgery. Comput Methods Biomech Biomed Eng Imaging Vis. 9:331–338. doi:10.1080/21681163.2020.1835546.
   Google Scholar
• Chang JR, Chen YS 2018. Pyramid stereo matching network. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Salt Lake City, UT, USA: p. 5410–5418.
   Google Scholar
• Community BO 2018. Blender - a 3d modelling and rendering package. Stichting Blender Foundation, Amsterdam: Blender Foundation. Available from: http://www.blender.org
   Google Scholar
• Fu H, Gong M, Wang C, Batmanghelich K, Tao D 2018. Deep ordinal regression network for monocular depth estimation. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA: p. 2002–2011.
   Google Scholar
• Godard C, Aodha OM, Brostow GJ 2017. Unsupervised monocular depth estimation with left-right consistency. 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA (CVPR):6602–6611.
   Google Scholar
• Gupta M, Agrawal A, Veeraraghavan A, Narasimhan SG. 2011. Structured light 3d scanning in the presence of global illumination. Cvpr 2011. 713–720.
   Google Scholar
• Hashimoto DA, Rosman G, Rus D, Meireles OR. 2018. Artificial intelligence in surgery: promises and perils. Ann Surg. 268:70–76. doi:10.1097/SLA.0000000000002693.
   Google Scholar
• Hersh AM, Mahapatra S, Weber-Levine C, Awosika T, Theodore JN, Zakaria HM, Liu A, Witham TF, Theodore N. 2021. Augmented reality in spine surgery: a narrative review. HSS J®: The Musculoskelet J Hospital for Spec Surgery. 17:351–358. doi:10.1177/15563316211028595.
   Google Scholar
• Jensen S, Wilm J, Aanæs H 2017. An error analysis of structured light scanning of biological tissue. In: Scandinavian Conference on Image Analysis, Tromsø, Norway: Springer. p. 135–145.
   Google Scholar
• Kazanzides P, Chen Z, Deguet A, Fischer GS, Taylor RH, DiMaio SP 2014. An open-source research kit for the da vinci® surgical system. In: 2014 IEEE international conference on robotics and automation (ICRA), Hong Kong, China: IEEE. p. 6434–6439.
   Google Scholar
• Kendall A, Gal Y, Cipolla R 2018. Multi-task learning using uncertainty to weigh losses for scene geometry and semantics. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA: p. 7482–7491.
   Google Scholar
• Kingma DP, Ba J. 2015. Adam: a method for stochastic optimization. CoRr Abs/1412 abs/1412. p. 6980.
   Google Scholar
• Laga H, Jospin LV, Boussaïd F, Bennamoun M. 2020. A survey on deep learning techniques for stereo-based depth estimation. IEEE transactions on pattern analysis and machine intelligence. 44 p. 1738–1764.
   Google Scholar
• Lipson L, Teed Z, Deng J 2021. Raft-stereo: multilevel recurrent field transforms for stereo matching. 2021 International Conference on 3D Vision (3DV), Virtual-Surrey, UK: p. 218–227.
   Google Scholar
• Liu S, Johns E, Davison AJ 2019. End-to-end multi-task learning with attention. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA. p. 1871–1880.
   Google Scholar
• Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G, Killeen T, Lin Z, Gimelshein N, Antiga L, et al. 2019. Pytorch: an imperative style, high-performance deep learning library. In: Advances in neural information processing systems 32. Curran Associates, Inc.; p. 8024–8035. Available from: http://papers.neurips.cc/paper/9015-pytorch-an-imperative-style-high-performance-deep-learning-library.pdf.
   Google Scholar
• Qi GJ, Luo J 2020. Small data challenges in big data era: a survey of recent progress on unsupervised and semi-supervised methods. IEEE transactions on pattern analysis and machine intelligence. PP.
   Google Scholar
• Rachakonda PK, Muralikrishnan B, Sawyer D. 2019. Sources of errors in structured light 3d scanners. In: Dimensional Optical Metrology and Inspection for Practical Applications VIII, Baltimore, Maryland, USA. 10991 (SPIE). p. 25–37.
   Google Scholar
• Ronneberger O, Fischer P, Brox T. 2015. U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical image computing and computer-assisted intervention. Munich, Germany: Springer. p. 234–241.
   Google Scholar
• Salvi J, Pagès J, Batlle J. 2004. Pattern codification strategies in structured light systems. Pattern Recognit. 37:827–849. doi:10.1016/j.patcog.2003.10.002.
   Google Scholar
• Scharstein D, Hirschmüller H, Kitajima Y, Krathwohl G, Nesic N, Wang X, Westling P. 2014. High-resolution stereo datasets with subpixel-accurate ground truth. German conference on pattern recognition, Münster, Germany: Springer. p. 31–42.
   Google Scholar
• Scharstein D, Szeliski R 2003. High-accuracy stereo depth maps using structured light. 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003 Proceedings, Madison, WI, USA. 1 p.I–I.
   Google Scholar
• Schell J 2021. Projectors; [https://github.com/Ocupe/Projectors].
   Google Scholar
• Sener O, Koltun V. 2018. Multi-task learning as multi-objective optimization. Adv Neural Inf Process Syst. 31.
   Google Scholar
• Silberman N, Fergus R 2011. Indoor scene segmentation using a structured light sensor. 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), Barcelona, Spain: p. 601–608.
   Google Scholar
• Standley TS, Zamir AR, Chen D, Guibas LJ, Malik J, Savarese S. 2020. Which tasks should be learned together in multi-task learning? International Conference on Machine Learning, Virtual, PMLR. p. 9120–9132.
   Google Scholar
• Uhrig J, Schneider N, Schneider L, Franke U, Brox T, Geiger A 2017. Sparsity invariant cnns. In: International Conference on 3D Vision (3DV), Qingdao, China. p. 11–20.
   Google Scholar
• Willemink MJ, Koszek WA, Hardell C, Wu J, Fleischmann D, Harvey H, Folio LR, Summers RM, Rubin D, Lungren MP. 2020. Preparing medical imaging data for machine learning. Radiology:192224. 295:4–15. doi:10.1148/radiol.2020192224.
   Google Scholar
• Xu C, Huang B, Elson DS. 2022. Self-supervised monocular depth estimation with 3-d displacement module for laparoscopic images. EEE Trans Med Robot Bionics. 4(2):331–334. doi:10.1109/TMRB.2022.3170206.
   Google Scholar
• Ying X. 2019. An overview of overfitting and its solutions. J Phys Conf Ser. 1168:022022. doi:10.1088/1742-6596/1168/2/022022.
   Google Scholar
• Zhao C, Sun Q, Zhang C, Tang Y, Qian F. 2020. Monocular depth estimation based on deep learning: an overview. Sci China Technol Sci. 63:1–16. doi:10.1007/s11431-020-1582-8.
   Google Scholar