An automatic calibration algorithm for endoscopic structured light sensors in cylindrical environment

References

• Banerjee P, Palanisamy RP, Haq M, et al. Data-driven prognosis of fatigue-induced delamination in composites using optical and acoustic NDE methods. 2019 IEEE International Conference on Prognostics and Health Management (ICPHM); San Francisco, CA, USA. IEEE, 2019: 1–10.
   Google Scholar
• Schempf H, Mutschler E, Gavaert A, et al. Visual and nondestructive evaluation inspection of live gas mains using the explorer TM family of pipe robots. J Field Rob. 2010;27(3):217–249. DOI:10.1002/rob.20330
   Web of Science ®Google Scholar
• Geng J. Structured-light 3D surface imaging: a tutorial. Adv Opt Pho-Tonics. 2011;3(2):128–160.
   Web of Science ®Google Scholar
• Van der Jeught S, Dirckx JJJ. Real-time structured light profilometry: a review. Opt Lasers Eng. 2016;87:18–31.
   Web of Science ®Google Scholar
• Frankowski G, Hainich R. DLP-based 3D metrology by structured light or projected fringe technology for life sciences and industrial metrology. In: Emerging digital micromirror device based systems and applications. Vol. 7210. San Jose, California: SPIE; 2009. pp. 102–113.
   Google Scholar
• Lazaros N, Sirakoulis GC, Gasteratos A. Review of stereo vision algorithms: from software to hardware. Int J Optomechatronics. 2008;2(4):435–462.
   Web of Science ®Google Scholar
• Huynh P, Ross R, Martchenko A, et al. Anomaly inspection in sewer pipes using stereo vision. 2015 IEEE International Conference on Signal and Image Processing Applications (ICSIPA); Kuala Lumpur, Malaysia. IEEE, 2015: 60–64.
   Google Scholar
• Ullman S. The interpretation of structure from motion proceedings of the royal society of London. Series B, Biol Sci. 1979;203(1153):405–426.
   PubMed Web of Science ®Google Scholar
• Kagami S, Taira H, Miyashita N, et al. 3D Pipe network reconstruction based on structure from motion with incremental conic shape detection and cylindrical constraint. 2020 IEEE 29th International Symposium on Industrial Electronics (ISIE); Delft, The Netherlands. IEEE, 2020: 1345–1352.
   Google Scholar
• Woodham RJ. Photometric method for determining surface orientation from multiple images. Opt Eng. 1980;19(1):139–144.
   Web of Science ®Google Scholar
• Caracotte J, Morbidi F, Mouaddib EM Photometric stereo with twin-fisheye cameras. 2020 25th International Conference on Pattern Recognition (ICPR); Milan, Italy. IEEE, 2021: 5270–5277.
   Google Scholar
• Alzuhiri M, Farrag K, Lever E, et al. An electronically stabilized multi-color multi-ring structured light sensor for gas pipelines internal surface inspection. IEEE Sens J. 2021;21(17):19416–19426. DOI:10.1109/JSEN.2021.3086415
   Web of Science ®Google Scholar
• Schmalz C, Forster F, Schick A, et al. An endoscopic 3D scanner based on structured light. Med Image Anal. 2012;16(5):1063–1072. DOI:10.1016/j.media.2012.04.001
   PubMed Web of Science ®Google Scholar
• Kumar GA, Patil AK, Patil R, et al. A LiDAR and IMU integrated indoor navigation system for UAVs and its application in real-time pipeline classification. Sensors. 2017;17(6):1268. DOI:10.3390/s17061268
   PubMed Web of Science ®Google Scholar
• Dubayah RO, Drake JB. Lidar remote sensing for forestry. J For. 2000;98(6):44–46.
   Web of Science ®Google Scholar
• Zanuttigh P, Marin G, Dal Mutto C, et al. Time-of-flight and structured light depth cameras. Technol Applicatio. 2016;1:978–3.
   Google Scholar
• May S, Droeschel D, Holz D, et al. Three-dimensional mapping with time-of-flight cam- eras. J Field Rob. 2009;26(11–12):934–965. DOI:10.1002/rob.20321
   Web of Science ®Google Scholar
• Selvaraju RR, Cogswell M, Das A, et al. Proceedings of the IEEE international conference on computer vision. 2017.
   Google Scholar
• Guangjun Z. Mathematic model of inner surface 3d vision inspection based on circle structured light. Chin J Sci Instrum. 2004;25(4):481–484.
   Google Scholar
• Bell T, Li B, Zhang S. Structured light techniques and applications. Wiley Encycl Electr Electron Eng. 1999;1–24.
   Google Scholar
• Li B, Karpinsky N, Zhang S. Novel calibration method for structured-light system with an out-of-focus projector. Appl Optics. 2014;53(16):3415–3426.
   PubMed Web of Science ®Google Scholar
• Suresh V. Calibration of structured light system using unidirectional fringe patterns. Ann Arbor, MI: Iowa State University; 2019.
   Google Scholar
• Scharstein D, Szeliski R. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis. 2002;47(1):7–42.
   Web of Science ®Google Scholar
• Garcia RR, Zakhor A. Consistent stereo-assisted absolute phase unwrapping methods for structured light systems. IEEE J Sel Top Signal Process. 2012;6(5):411–424.
   Web of Science ®Google Scholar
• Kimura M, Mochimaru M, Kanade T Projector calibration using arbitrary planes and calibrated camera 2007 IEEE Conference on Computer Vision and Pattern Recognition; Minneapolis, MN. IEEE, 2007: 1–2.
   Google Scholar
• Falcao G, Hurtos N, Massich J. Plane-based calibration of a projector-camera system. VIBOT Master. 2008;9(1):1–12.
   Google Scholar
• Martynov I, Kamarainen JK, Lensu L Projector calibration by “inverse camera calibration” Scandinavian Conference on Image Analysis. Springer, Berlin, Heidelberg, 2011: 536–544.
   Google Scholar
• Zhang S, Huang PS. Novel method for structured light system calibration. Opt Eng. 2006;45(8):083601.
   Web of Science ®Google Scholar
• Lei Z, Liu X, Lu W, et al. A new calibration method of the projector in structured light measurement technology. Procedia CIRP. 2015;27:303–308.
   Google Scholar
• Albarelli A, Rodol`a E, Torsello A. Robust camera calibration using inaccurate targets. IEEE Trans Pattern Anal Mach Intell. 2009;31(2):376–383.
   PubMedGoogle Scholar
• Huang L, Zhang Q, Asundi A. Flexible camera calibration using not-measured imperfect target. Appl Optics. 2013;52(25):6278–6286.
   PubMed Web of Science ®Google Scholar
• Sun W, Cooperstock JR. An empirical evaluation of factors influencing camera calibration accuracy using three publicly available techniques. Mach Vision Appl. 2006;17(1):51–67.
   Web of Science ®Google Scholar
• Scaramuzza D, Martinelli A, Siegwart R A toolbox for easily calibrating omnidirectional cameras. 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems; Beijing, China. IEEE, 2006: 5695–5701.
   Google Scholar
• Wang HF, Wang YF, Zhang JJ, et al. Laser stripe center detection under the condition of uneven scattering metal surface for geometric measurement. IEEE Trans Instrum Meas. 2019;69(5):2182–2192. DOI:10.1109/TIM.2019.2921440
   Web of Science ®Google Scholar
• Li Z, Fairchild P, Alzuhiri M, et al. Automated pipeline inspection with an untethered structured light sensing robot. PRCI technical meeting, Phoenix, AZ, 2022.
   Google Scholar
• Alzuhiri M, Li Z, Rao A, et al. IMU-Assisted robotic structured light sensing with featureless registration under uncertainties for pipeline inspection. NDT and E International. 2023;1–13. (under review).
   Web of Science ®Google Scholar
• Garrido-Jurado S, Munoz-Salinas R, Madrid-Cuevas FJ, et al. Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recognition. 2014;47(6):2280–2292. DOI:10.1016/j.patcog.2014.01.005
   Web of Science ®Google Scholar
• Torr PHS, Zisserman A. MLESAC: a new robust estimator with application to estimating image geometry. Comput Vision Image Understanding. 2000;78(1):138–156.
   Web of Science ®Google Scholar