Introduction of the combination of thermal fundamentals and Deep Learning for the automatic thermographic inspection of thermal bridges and water-related problems in infrastructures

References

• Garrido I, Erazo-Aux J, Lagüela S, et al. Introduction of deep learning in thermographic monitoring of cultural heritage and improvement by automatic thermogram pre-processing algorithms. Sensors. 2021;21(3):750.
   PubMed Web of Science ®Google Scholar
• Garrido I, Lagüela S, Sfarra S, et al. Automatic detection of moistures in different construction materials from thermographic images. J Therm Anal Calorim. 2019;138(2):1649–1668.
   Web of Science ®Google Scholar
• Barreira E, Almeida RMSF, Simões ML, et al. Quantitative infrared thermography to evaluate the humidification of lightweight concrete. Sensors. 2020;20(6):1664.
   PubMed Web of Science ®Google Scholar
• Edis E, Flores-Colen I, de Brito J. Quasi-quantitative infrared thermographic detection of moisture variation in facades with adhered ceramic cladding using principal component analysis. Build Environ. 2015;94:97–108.
   Web of Science ®Google Scholar
• Balaras CA, Argiriou AA. Infrared thermography for building diagnostics. Energy Build. 2002;34(2):171–183.
   Web of Science ®Google Scholar
• Garrido I, Lagüela S, Otero R, et al. Thermographic methodologies used in infrastructure inspection: a review—Post-processing procedures. Appl Energy. 2020;266:114857.
   Web of Science ®Google Scholar
• Ge H, Baba F. Dynamic effect of thermal bridges on the energy performance of a low-rise residential building. Energy Build. 2015;105:106–118.
   Web of Science ®Google Scholar
• Dos Santos GH, Mendes N, Philippi PC. A building corner model for hygrothermal performance and mould growth risk analyses. Int J Heat Mass Transfer. 2009;52(21–22):4862–4872.
   Web of Science ®Google Scholar
• Dorafshan S, Maguire M. Bridge inspection: human performance, unmanned aerial systems and automation. J Civ Struct Heal Monit. 2018;8(3):443–476.
   Web of Science ®Google Scholar
• Riveiro B, Solla M. Non-destructive techniques for the evaluation of structures and infrastructure. London (United Kingdom): Taylor & Francis Ltd; 2016. 9781138028104.
   Google Scholar
• Garrido I, Lagüela S, Otero R, et al. Thermographic methodologies used in infrastructure inspection: a review—data acquisition procedures. Infrared Phys Technol. 2020;111:103481.
   Web of Science ®Google Scholar
• Madruga FJ, Sfarra S, Perilli S, et al. Measuring the water content in wood using step-heating thermography and speckle patterns-preliminary results. Sensors. 2020;20(1):316.
   PubMed Web of Science ®Google Scholar
• Pan D, Jiang Z, Gui W, et al. Compensation method for the influence of dust in optical path on infrared temperature measurement. IEEE Trans Instrum Meas. 2021;70:1–11.
   PubMed Web of Science ®Google Scholar
• Różański L, Ziopaja K. Applicability analysis of IR thermography and discrete wavelet transform for technical conditions assessment of bridge elements. Quant Infrared Thermogr J. 2019;16(1):87–110.
   Web of Science ®Google Scholar
• Shrestha R, Choi M, Kim W. Thermographic inspection of water ingress in composite honeycomb sandwich structure: a quantitative comparison among Lock-in thermography algorithms. Quant Infrared Thermogr J. 2021;18(2):92–107.
   Web of Science ®Google Scholar
• Solla M, Lagüela S, Fernández N, et al. Assessing rebar corrosion through the combination of nondestructive GPR and IRT methodologies. Remote Sens. 2019;11(14):1705.
   Google Scholar
• Bach PM, Kodikara JK. Reliability of infrared thermography in detecting leaks in buried water reticulation pipes. IEEE J Sel Top Appl Earth Obs Remote Sens. 2017;10(9):4210–4224.
   Web of Science ®Google Scholar
• Cadelano G, Bison P, Bortolin A, et al. Monitoring of historical frescoes by timed infrared imaging analysis. Opto-Electron Rev. 2015;23(1):100–106.
   Web of Science ®Google Scholar
• Georgescu MS, Ochinciuc CV, Georgescu ES, et al. Heritage and climate changes in Romania: the St. Nicholas church of densus, from degradation to restoration. Energy Procedia. 2017;133:76–85.
   Google Scholar
• Garrido I, Lagüela S, Sfarra S, et al. Algorithms for the automatic detection and characterization of pathologies in heritage elements from thermographic images. In: Technical Information Library (TIB), Leibniz Universität Hannover, Germany, editor. International archives of the photogrammetry, remote sensing and spatial information sciences - ISPRS archives. Vol. 42. Hannover (Germany): International Society for Photogrammetry and Remote Sensing; 2019. p. 497–501.
   Google Scholar
• Edis E, Flores-Colen I, De Brito J. Passive thermographic detection of moisture problems in façades with adhered ceramic cladding. Constr Build Mater. 2014;51:187–197.
   Web of Science ®Google Scholar
• Garrido I, Solla M, Lagüela S, et al. IRT and GPR techniques for moisture detection and characterisation in buildings. Sensors. 2020;20(22):6421.
   PubMed Web of Science ®Google Scholar
• O’Grady M, Lechowska AA, Harte AM. Quantification of heat losses through building envelope thermal bridges influenced by wind velocity using the outdoor infrared thermography technique. Appl Energy. 2017;208:1038–1052.
   Web of Science ®Google Scholar
• O’Grady M, Lechowska AA, Harte AM. Infrared thermography technique as an in-situ method of assessing heat loss through thermal bridging. Energy Build. 2017;135:20–32.
   Web of Science ®Google Scholar
• Baldinelli G, Bianchi F, Rotili A, et al. A model for the improvement of thermal bridges quantitative assessment by infrared thermography. Appl Energy. 2018;211:854–864.
   Web of Science ®Google Scholar
• Lei L, Bortolin A, Bison P, et al. Detection of insulation flaws and thermal bridges in insulated truck box panels. Quant Infrared Thermogr J. 2017;14(2):275–284.
   Web of Science ®Google Scholar
• Garrido I, Lagüela S, Arias P. Autonomous thermography: towards the automatic detection and classification of building pathologies. In 14th Quantitative InfraRed Thermography Conference; Berlin, Germany, 2018; pp. 359–368.
   Google Scholar
• Douguet R, Ha -T-T, Feuillet V, et al. A novel experimental method for the in situ detection of thermal bridges in building envelopes based on active infrared thermography and singular value decomposition analysis. In 14th Quantitative InfraRed Thermography Conference; Berlin, Germany, 2018; pp. 396–402.
   Google Scholar
• Garrido I, Lagüela S, Arias P, et al. Thermal-based analysis for the automatic detection and characterization of thermal bridges in buildings. Energy Build. 2018;158:1358–1367.
   Web of Science ®Google Scholar
• Fang Q, Nguyen BD, Ibarra Castanedo C, et al. Defects detection in infrared thermography by deep learning algorithm. In: Oswald-Tranta B, Zalameda JN, editors. Thermosense: thermal Infrared Applications XLII. Vol. 11409. Bellingham (WA): SPIE; 2020. p. 31.
   Google Scholar
• Mahony NO, Campbell S, Carvalho A, et al. Deep learning vs. traditional computer vision. In Proceedings of the Science and Information Conference; Tokyo, Japan, 2019; pp. 128–144.
   Google Scholar
• Cheng C, Shang Z, Shen Z. Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography. NDT E Int. 2020;116:102341.
   Web of Science ®Google Scholar
• Al-Habaibeh A, Sen A, Chilton J. Evaluation tool for the thermal performance of retrofitted buildings using an integrated approach of deep learning artificial neural networks and infrared thermography. Energy Built Environ. 2021;2(4):345–365.
   Google Scholar
• Bang HT, Park S, Jeon H. Defect identification in composite materials via thermography and deep learning techniques. Compos Struct. 2020;246:112405.
   Web of Science ®Google Scholar
• Duan Y, Liu S, Hu C, et al. Automated defect classification in infrared thermography based on a neural network. NDT E Int. 2019;107:102147.
   Web of Science ®Google Scholar
• Müller D, Netzelmann U, Valeske B. Defect shape detection and defect reconstruction in active thermography by means of two-dimensional convolutional neural network as well as spatiotemporal convolutional LSTM network. Quant Infrared Thermogr J. 2020;19:126–144. DOI:10.1080/17686733.2020.1810883
   Google Scholar
• Fang Q, Maldague X. A method of defect depth estimation for simulated infrared thermography data with deep learning. Appl Sci. 2020;10(19):6819.
   Google Scholar
• de Oliveira M, Araujo N, da Silva R, et al. Use of savitzky–golay filter for performances improvement of shm systems based on neural networks and distributed PZT sensors. Sensors. 2018;18(2):152.
   PubMedGoogle Scholar
• Balado J, Díaz-Vilariño L, Arias P, et al. Point clouds to indoor/outdoor accessibility diagnosis. In: Technical Information Library (TIB), Leibniz Universität Hannover, Germany, editor. ISPRS annals of the photogrammetry, remote sensing and spatial information sciences. Vol. 4. Hannover (Germany): International Society for Photogrammetry and Remote Sensing; 2017. p. 287–293.
   Google Scholar
• George D, Mallery P. SPSS for windows step by step: a simple guide and reference 17.0 update. 10th ed. Boston: Pearson; 2009.
   Google Scholar
• Usamentiaga R, Ibarra-Castanedo C, Maldague X. More than fifty shades of grey: quantitative characterization of defects and interpretation using SNR and CNR. J Nondestruct Eval. 2018;37(2):25.
   Web of Science ®Google Scholar
• He K, Gkioxari G, Dollár P, et al. Mask R-CNN. IEEE Trans Pattern Anal Mach Intell. 2020;42(2):386–397.
   PubMed Web of Science ®Google Scholar
• Lin T-Y, Maire M, Belongie S, et al. Microsoft COCO: common objects in context. Comput. Vis. – ECCV 2014. ECCV 2014. Lect Notes Comput Sci. 2014;8693:740–755.
   Google Scholar
• Manzano C, Ngo ACY, Sivaraja VKSO. Intelligent infrared thermography inspection of subsurface defects. In: SPIE Digital Library, editor. Thermosense: thermal Infrared Applications XLII. Vol. 11409. Bellingham (WA): International Society for Optics and Photonics; 2020. p. 114090V.
   Google Scholar
• Minatel PG, de Oliveira BCF, Junior AAG. Comparison of Unet and Mask R-CNN for impact damage segmentation in lock-in thermography phase images. In: SPIE Digital Library, editor. Automated visual inspection and machine vision IV. Vol. 11787. Bellingham (WA): International Society for Optics and Photonics; 2021. p. 117870S.
   Google Scholar
• Fang Q, Ibarra-Castanedo C, Maldague X. Automatic defects segmentation and identification by deep learning algorithm with pulsed thermography: synthetic and experimental data. Big Data Cogn Comput. 2021;5(1):9.
   Google Scholar
• He K, Zhang X, Ren S, et al. Deep residual learning for image recognition. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Las Vegas (NV): IEEE Computer Society; 2016; Vol. 2016-December, pp. 770–778.
   Google Scholar
• Rodríguez JD, Pérez A, Lozano JA. Sensitivity analysis of k-fold cross validation in prediction error estimation. IEEE Trans Pattern Anal Mach Intell. 2010;32(3):569–575.
   PubMed Web of Science ®Google Scholar
• Dutta A, Zisserman A. The VIA annotation software for images, audio and video. In MM 2019 - Proceedings of the 27th ACM International Conference on Multimedia. Nice (France): Association for Computing Machinery, Inc; 2019. p. 2276–2279.
   Google Scholar
• Mask_RCNN/samples/balloon at master matterport/Mask_RCNN · GitHub. https://github.com/matterport/Mask_RCNN/tree/master/samples/balloon (accessed on 2021 Jul 27).
   Google Scholar