355
Views
2
CrossRef citations to date
0
Altmetric
Research Article

Recognition of hidden distress in asphalt pavement based on convolutional neural network

, , &

References

  • Al-Nuaimy, W., et al., 2000. Automatic detection of buried utilities and solid objects with GPR using neural networks and pattern recognition. Journal of Applied Geophysics, 43 (2-4), 157–165. Available from: https://doi.org/10.1016/S0926-9851(99)00055-5.
  • Al-Nuaimy, W., Huang, Y., and Eriksen, A., 2001. Automatic detection of hyperbolic signatures in ground-penetrating radar data. In: C. Nguyen, ed. Subsurface and surface sensing technologies and applications IIISan Diego, CA, United States: SPIE, 327–335. Available from: https://doi.org/10.1117/12.450177.
  • Aydin, E., and Erdem, S.E.Y., 2019. Transfer and multitask learning using convolutional neural networks for buried wire detection from ground penetrating radar data. In: S.S. Bishop and J.C. Isaacs, eds. Detection and sensing of mines, explosive objects, and obscured targets XXIV. Baltimore, Maryland, United States: International Society for Optics and Photonics, 110120Y. Available from: https://doi.org/10.1117/12.2518875.
  • Barzegaran, J., Shahni Dezfoulian, R., and Fakhri, M., 2021. Estimation of IRI from Paser using ANN based on k-means and fuzzy c-means clustering techniques: A case study. International Journal of Pavement Engineering, 1–15. Available from: https://doi.org/10.1080/10298436.2021.2000988.
  • Besaw, L.E., 2016. Detecting buried explosive hazards with handheld GPR and deep learning. In: S.S. Bishop and J.C. Isaacs, eds. Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XXI, Baltimore, Maryland, United States: International Society for Optics and Photonics, 98230N. Available from: https://doi.org/10.1117/12.2223797.
  • Besaw, L.E., and Stimac, P.J., 2015. Deep convolutional neural networks for classifying GPR b-scans. In: S.S. Bishop and J.C. Isaacs, eds. Detection and sensing of mines, explosive objects, and obscured targets XXBaltimore, Maryland, United States: SPIE, 385–394. Available from: https://doi.org/10.1117/12.2176250.
  • Borgioli, G., et al., 2008. The detection of buried pipes from time-of-flight radar data. IEEE Transactions on Geoscience and Remote Sensing, 46 (8), 2254–2266. Available from: https://doi.org/10.1109/TGRS.2008.917211.
  • Bralich, J., et al., 2017. Improving convolutional neural networks for buried target detection in ground penetrating radar using transfer learning via pretraining. In: S.S. Bishop and J.C. Isaacs, eds. Detection and sensing of mines, explosive objects, and obscured targets XXII. Anaheim, CA: SPIE, 198–208. Available from: https://doi.org/10.1117/12.2263112.
  • Caorsi, S., and Cevini, G., 2005. An electromagnetic approach based on neural networks for the GPR investigation of buried cylinders. IEEE Geoscience and Remote Sensing Letters, 2 (1), 3–7. Available from: https://doi.org/10.1109/LGRS.2004.839648.
  • Capineri, L., Grande, P., and Temple, J., 1998. Advanced image-processing technique for real-time interpretation of ground-penetrating radar images. International Journal of Imaging Systems and Technology, 9 (1), 51–59. doi:10.1002/(SICI)1098-1098(1998)9:1<51::AID-IMA7>3.0.CO;2-Q.
  • Cui, F., et al., 2022. Automatic recognition and tracking of highway layer-interface using Faster R-CNN. Journal of Applied Geophysics, 196, 104477. Available from: https://doi.org/10.1016/j.jappgeo.2021.104477.
  • Dou, Q., et al., 2016. Real-time hyperbola recognition and fitting in GPR data. IEEE Transactions on Geoscience and Remote Sensing, 55 (1), 51–62. Available from: https://doi.org/10.1109/TGRS.2016.2592679.
  • Economou, N., and Vafidis, A., 2010. Spectral balancing GPR data using time-variant bandwidth in the t-f domain. Geophysics, 75 (3), J19–J27. Available from: https://doi.org/10.1190/1.3374464.
  • Elsaadouny, M., Barowski, J., and Rolfes, I., 2019. The subsurface objects classification using a convolutional neural network. In: S. Chakrabarti and H.N. Saha, eds. 2019 IEEE 10th annual information technology, electronics and mobile communication conference (IEMCON). Vancouver, BC, Canada: IEEE, 0874–0877. Available from: https://doi.org/10.1109/IEMCON.2019.8936250.
  • Gader, P.D., Mystkowski, M., and Zhao, Y., 2001. Landmine detection with ground penetrating radar using hidden Markov models. IEEE Transactions on Geoscience and Remote Sensing, 39 (6), 1231–1244. Available from: https://doi.org/10.1109/36.927446.
  • Garbin, C., Zhu, X., and Marques, O., 2020. Dropout vs. Batch normalization: An empirical study of their impact to deep learning. Multimedia Tools and Applications, 2020, 1–39. Available from: https://doi.org/10.1007/s11042-019-08453-9.
  • Gopalakrishnan, K., et al., 2017. Deep convolutional neural networks with transfer learning for computer vision-based data-driven pavement distress detection. Construction and Building Materials, 157, 322–330. Available from: https://doi.org/10.1016/j.conbuildmat.2017.09.110.
  • Goyal, P., et al., 2017. Accurate, large minibatch SGD: Training ImageNet in 1 hour. https://arxiv.org/abs/1706.02677.
  • Hou, F., et al., 2021. Improved Mask R-CNN with distance guided intersection over union for GPR signature detection and segmentation. Automation in Construction, 121, 103414. Available from: https://doi.org/10.1016/j.autcon.2020.103414.
  • Hsieh, Y.-A., and Tsai, Y.J., 2020. Machine learning for crack detection: Review and model performance comparison. Journal of Computing in Civil Engineering, 34 (5), 04020038. Available from: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000918.
  • Hsieh, Y.-A., and Tsai, Y., 2021. Automated asphalt pavement raveling detection and classification using convolutional neural network and macrotexture analysis. Transportation Research Record, 2675 (9), 984–994. Available from: https://doi.org/10.1177/03611981211005450.
  • Hussain, M., Bird, J.J., and Faria, D.R., 2018. A Study on CNN Transfer Learning for Image Classification. In: A. Lotfi et al., eds. UK workshop on computational intelligence. Nottingham, UK: Springer, 840, 191–202. Available from: https://doi.org/10.1007/978-3-319-97982-3_16.
  • Ioffe, S., and Szegedy, C., 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. In: International conference on machine learning, PMLR, 448-456.
  • Kafedziski, V., Pecov, S., and Tanevski, D., 2018. Detection and Classification of Land Mines from Ground Penetrating Radar Data Using Faster R-CNN. In: 2018 26th telecommunications forum (TELFOR). Belgrade, Serbia: IEEE, 392–395. Available from: https://doi.org/10.1109/TELFOR.2018.8612117.
  • Kara De Maeijer, P., et al., 2019. Fiber optics sensors in asphalt pavement: State-of-the-art review. Infrastructures, 4 (2), 36. Available from: https://doi.org/10.3390/infrastructures4020036.
  • Kaur, P., et al., 2015. Automated GPR rebar analysis for robotic bridge deck evaluation. IEEE Transactions on Cybernetics, 46 (10), 2265–2276. Available from: https://doi.org/10.1109/TCYB.2015.2474747.
  • Khamzin, A.K., et al., 2017. Utilization of air-launched ground penetrating radar (GPR) for pavement condition assessment. Construction Building Materials, 141 (2017), 130–139. Available from: https://doi.org/10.1016/j.conbuildmat.2017.02.105.
  • Kim, M., et al., 2018. GPR image enhancement based on frequency shifting and histogram dissimilarity. IEEE Geoscience and Remote Sensing Letters, 15 (5), 684–688. Available from: https://doi.org/10.1109/LGRS.2018.2809720.
  • Kim, N., et al., 2020. Deep learning-based underground object detection for urban road pavement. International Journal of Pavement Engineering, 21 (13), 1638–1650. Available from: https://doi.org/10.1080/10298436.2018.1559317.
  • Lameri, S., et al., 2017. Landmine detection from GPR data using convolutional neural networks. In: 2017 25th European signal processing conference (EUSIPCO)Kos, Greece: IEEE, 508–512. Available from: https://doi.org/10.23919/EUSIPCO.2017.8081259.
  • Lecun, Y., Bengio, Y., and Hinton, G., 2015. Deep learning. Nature, 521 (7553), 436–444. Available from: https://doi.org/10.1038/nature14539.
  • Lei, W., et al., 2019. Automatic hyperbola detection and fitting in GPR B-scan image. Automation in Construction, 106, 102839. Available from: https://doi.org/10.1016/j.autcon.2019.102839.
  • Li, F., et al., 2006. Research on damage of asphalt concrete by ultrasonic inspection method. Journal of Wuhan University of Technology, 30 (2), 293–296. Available from: https://doi.org/10.3963/j.issn.2095-3844.2006.02.030.
  • Li, S., et al., 2016a. Integrated processing of image and GPR data for automated pothole detection. Journal of Computing in Civil Engineering, 30 (6), 04016015. Available from: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000582.
  • Li, W., et al., 2016b. Tree Root Automatic Recognition in Ground Penetrating Radar Profiles Based on Randomized Hough Transform. Remote Sensing, 8 (5), 430. Available from: https://doi.org/10.3390/rs8050430.
  • Li, S., et al., 2021. Detection of concealed cracks from ground penetrating radar images based on deep learning algorithm. Construction and Building Materials, 273, 121949. Available from: https://doi.org/10.1016/j.conbuildmat.2020.121949.
  • Lin, M., Chen, Q., and Yan, S., 2013. Network in network. Available from: https://doi.org/10.48550/arXiv.1312.4400.
  • Liu, W., and Scullion, T., 2006. Pavecheck: Integrating deflection and ground penetrating radar data for pavement evaluation. College Station, TX: Texas Transportation Institute. No. FHWA/TX-06/0-4495-1.
  • Liu, W., and Scullion, T., 2009. Pavecheck: Integrating deflection and GPR for network condition surveys. College Station, TX: Texas Transportation Institute. No. FHWA/TX-09/5-4495-01-2.
  • Maniat, M., Camp, C.V., and Kashani, A.R., 2021. Deep learning-based visual crack detection using Google street view images. Neural Computing and Applications, 2021, 1–18. Available from: https://doi.org/10.1007/s00521-021-06098-0.
  • Masters, D., and Luschi, C., 2018. Revisiting small batch training for deep neural networks. https://arxiv.org/abs/1804.07612.
  • Mertens, L., et al., 2015. Automated detection of reflection hyperbolas in complex GPR images with no a priori knowledge on the medium. IEEE Transactions on Geoscience and Remote Sensing, 54 (1), 580–596. Available from: https://doi.org/10.1109/TGRS.2015.2462727.
  • Nuzzo, L., 2003. Coherent noise attenuation in GPR data by linear and parabolic radon transform techniques. Annals of Geophysics, 46 (3), 533–547.
  • Park, S., et al., 2019. Patch-based crack detection in black box images using convolutional neural networks. Journal of Computing in Civil Engineering, 33 (3), 04019017. Available from: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000831.
  • Pedret Rodés, J., Martínez Reguero, A., and Pérez-Gracia, V., 2020. GPR spectra for monitoring asphalt pavements. Remote Sensing, 12 (11), 1749. Available from: https://doi.org/10.3390/rs12111749.
  • Pereira, V, et al., 2018. A deep learning-based approach for road pothole detection in Timor Leste. In: 2018 IEEE international conference on service operations and logistics, and informatics (SOLI)Furama RiverFront Hotel, Singapore: IEEE. 279–284. Available from: https://doi.org/10.1109/SOLI.2018.8476795.
  • Pérez-Gracia, V., García, F.G., and Abad, I.R., 2008. GPR evaluation of the damage found in the reinforced concrete base of a block of flats: A case study. NDT and E International, 41 (5), 341–353. Available from: https://doi.org/10.1016/j.ndteint.2008.01.001.
  • Pham, M.-T., and Lefèvre, S., 2018. Buried object detection from B-scan ground penetrating radar data using Faster-RCNN. In: IGARSS 2018-2018 IEEE international geoscience and remote sensing symposiumValencia, Spain: IEEE, 6804–6807. Available from: https://doi.org/10.1109/IGARSS.2018.8517683.
  • Raheel Shah, S.A., et al., 2018. Saving energy in the transportation sector: An analysis of modified bitumen application based on Marshall test. Energies, 11 (11), 3025. Available from: https://doi.org/10.3390/en11113025.
  • Reichman, D., Collins, L.M., and Malof, J.M., 2017. Some good practices for applying convolutional neural networks to buried threat detection in ground penetrating radar. In: A. Giannopoulos and C. Warren, eds. 2017 9th international workshop on advanced ground penetrating radar (IWAGPR). Edinburgh, UK: IEEE, 1–5. Available from: https://doi.org/10.1109/IWAGPR.2017.7996100.
  • Robbins, H., and Monro, S., 1951. A stochastic approximation method. The Annals of Mathematical Statistics, 22 (3), 400–407. http://www.jstor.org/stable/2236626. doi:10.1214/aoms/1177729586
  • Sagnard, F., and Tarel, J.-P., 2016. Template-matching based detection of hyperbolas in ground-penetrating radargrams for buried utilities. Journal of Geophysics and Engineering, 13 (4), 491–504. Available from: https://doi.org/10.1088/1742-2132/13/4/491.
  • Salas, M.Á., and Pérez-Acebo, H., 2018. Introduction of recycled polyurethane foam in mastic asphalt. Građevinar, 70 (05.), 403–412. Available from: https://doi.org/10.14256/JCE.2181.2017.
  • Sbartaï, Z., et al., 2009. Non-destructive evaluation of concrete physical condition using radar and artificial neural networks. Construction and Building Materials, 23 (2), 837–845. Available from: https://doi.org/10.1016/j.conbuildmat.2008.04.002.
  • Sha, A.-M., and Tu, S., 2012. Cracks characteristics and damage mechanism of asphalt pavement with semi-rigid base. In: A. Scarpas et al., ed. 7th RILEM international conference on cracking in pavements. Chicago, USA: Springer, 985–995. Available from: https://doi.org/10.1007/978-94-007-4566-7_94.
  • Simonyan, K., and Zisserman, A., 2014. Very deep convolutional networks for large-scale image recognition. In: International conference on learning representations (ICLR), Banff, AB, Canada.
  • Singh, N.P., and Nene, M.J., 2013. Buried object detection and analysis of GPR images: Using neural network and curve fitting. In: 2013 annual international conference on emerging research areas and 2013 international conference on microelectronics, communications and renewable energyKanjirapally, India: IEEE. 1–6. Available from: https://doi.org/10.1109/AICERA-ICMiCR.2013.6576024.
  • Singla, V., et al., 2021. Shift invariance can reduce adversarial robustness. Advances in Neural Information Processing Systems, 34, 1858–1871.
  • Srivastava, N., et al., 2014. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15 (1), 1929–1958.
  • Szymczyk, P., and Szymczyk, M., 2015. Non-destructive building investigation through analysis of GPR signal by S-transform. Automation in Construction, 55 (2015), 35–46. Available from: https://doi.org/10.1016/j.autcon.2015.03.022.
  • Terrasse, G., et al., 2016. Automatic localization of gas pipes from GPR imagery. In: 2016 24th European signal processing conference (EUSIPCO)Budapest, Hungary: IEEE, 2395–2399. Available from: https://doi.org/10.1109/EUSIPCO.2016.7760678.
  • Tong, Z., Gao, J., and Zhang, H., 2017. Recognition, location, measurement, and 3D reconstruction of concealed cracks using convolutional neural networks. Construction and Building Materials, 146, 775–787. http://doi.org/10.1016/j.conbuildmat.2017.04.097.
  • Tong, Z., Gao, J., and Zhang, H., 2018. Innovative method for recognizing subgrade defects based on a convolutional neural network. Construction and Building Materials, 169, 69–82. Available from: https://doi.org/10.1016/j.conbuildmat.2018.02.081.
  • Torrione, P.A., et al., 2013. Histograms of oriented gradients for landmine detection in ground-penetrating radar data. IEEE Transactions on Geoscience and Remote Sensing, 52 (3), 1539–1550. Available from: https://doi.org/10.1109/TGRS.2013.2252016.
  • Tosti, F., and Benedetto, A., 2012. Pavement pumping prediction using ground penetrating radar. Procedia-Social Behavioral Sciences, 53 (2012), 1044–1053. Available from: https://doi.org/10.1016/j.sbspro.2012.09.954.
  • Uddin, W., 2014. An overview of GPR applications for evaluation of pavement thickness and cracking. In: S. Lambot et al., ed. Proceedings of the 15th International Conference on Ground Penetrating Radar. Brussels, Belgium: IEEE, 925-930. Available from: https://doi.org/10.1109/ICGPR.2014.6970561.
  • Vaswani, A., et al., 2017. Attention is all you need. In: Advances in neural information processing systems, 5998–6008.
  • Wang, Z.W., et al., 2010. Automatic detection of bridge deck condition from ground penetrating radar images. IEEE Transactions on Automation Science and Engineering, 8 (3), 633–640. Available from: https://doi.org/10.1109/TASE.2010.2092428.
  • Wang, H., Xiang, P., and Jiang, L., 2018. Optical fiber sensor based in-field structural performance monitoring of multilayered asphalt pavement. Journal of Lightwave Technology, 36 (17), 3624–3632. doi:10.1109/JLT.2018.2838122.
  • Weng, X., and Wang, W., 2011. Influence of differential settlement on pavement structure of widened roads based on large-scale model test. Journal of Rock Mechanics and Geotechnical Engineering, 3 (1), 90–96. Available from: https://doi.org/10.3724/SP.J.1235.2011.00090.
  • Williams, R.M., et al., 2014. Crevasse detection in ice sheets using ground penetrating radar and machine learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 7 (12), 4836–4848. Available from: https://doi.org/10.1109/JSTARS.2014.2332872.
  • Windsor, C.G., Capineri, L., and Falorni, P., 2013. A data pair-labeled generalized Hough transform for radar location of buried objects. IEEE Geoscience and Remote Sensing Letters, 11 (1), 124–127. Available from: https://doi.org/10.1109/LGRS.2013.2248119.
  • Woo, S., et al., 2018. CBAM: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 3-19. Available from: https://doi.org/10.1007/978-3-030-01234-2_1.
  • Xiang, P., and Wang, H., 2018. Optical fibre-based sensors for distributed strain monitoring of asphalt pavements. International Journal of Pavement Engineering, 19 (9), 842–850. Available from: https://doi.org/10.1080/10298436.2016.1211872.
  • Xie, X., et al., 2013a. GPR identification of voids inside concrete based on the support vector machine algorithm. Journal of Geophysics and Engineering, 10 (3), 034002. Available from: https://doi.org/10.1088/1742-2132/10/3/034002.
  • Xie, X., et al., 2013b. An automatic recognition algorithm for GPR images of RC structure voids. Journal of Applied Geophysics, 99 (2013), 125–134. Available from: https://doi.org/10.1016/j.jappgeo.2013.02.016.
  • Xu, X., Lei, Y., and Yang, F., 2018. Railway Subgrade Defect Automatic Recognition Method Based on Improved Faster R-CNN. Scientific Programming, 2018), Available from: https://doi.org/10.1155/2018/4832972.
  • Yan, G., and Zhao, Q., 2009. The effect of water content on the damage concrete ultrasonic detection [j]. Nondestructive Testing, 31 (1), 48–49. http://kns.cnki.net/kcms/detail/detail.aspx?FileName=WSJC200901015&DbName=CJFQ2009.
  • Yang, S., et al., 2022. Defect segmentation: Mapping tunnel lining internal defects with ground penetrating radar data using a convolutional neural network. Construction and Building Materials, 319, 125658. Available from: https://doi.org/10.1016/j.conbuildmat.2021.125658.
  • Ye, W., et al., 2021. Convolutional neural network for pothole detection in asphalt pavement. Road Materials and Pavement Design, 22 (1), 42–58. Available from: https://doi.org/10.1080/14680629.2019.1615533.
  • Youn, H.-S., and Chen, C.-C., 2002. Automatic GPR target detection and clutter reduction using neural network. In: S.K. Koppenjan and H. Lee, eds. Ninth international conference on ground penetrating radar. Santa Barbara, CA, United States: SPIE, 579–582. Available from: https://doi.org/10.1117/12.462229.
  • Yusof, N., et al., 2018. Crack detection and classification in asphalt pavement images using deep convolution neural network. In: 2018 8th IEEE international conference on control system, computing and engineering (ICCSCE)Penang, Malaysia: IEEE. 227–232. Available from: https://doi.org/10.1109/ICCSCE.2018.8685007.
  • Zhang, J., et al., 2020. Automatic detection of moisture damages in asphalt pavements from GPR data with deep CNN and IRS method. Automation in Construction, 113, 103119. Available from: https://doi.org/10.1016/j.autcon.2020.103119.
  • Zhang, B., et al., 2021. A BP neural network method for grade classification of loose damage in semirigid pavement bases. Advances in Civil Engineering, 2021), Available from: https://doi.org/10.1155/2021/6658235.
  • Zhang, K., Zhang, Z., and Luo, Y., 2018. Inspection method and evaluation standard based on cylindrical core sample for rutting resistance of asphalt pavement. Measurement, 117, 241–251. Available from: https://doi.org/10.1016/j.measurement.2017.12.002.
  • Zhou, Z., et al., 2016. Strain transfer analysis of the FBG sensor considering the creep of the concrete host. China meas. China Measurement & Test, 42, 1–32. Available from: https://doi.org/10.11857/j.issn.1674-5124.2016.05.001.
  • Zong, Z., et al., 2019. A deep learning approach for urban underground objects detection from vehicle-borne ground penetrating radar data in real-time. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 42, 293–299. Available from: https://doi.org/10.5194/isprs-archives-XLII-2-W16-293-2019.
  • Zou, L., Yi, L., and Sato, M., 2020. On the use of lateral wave for the interlayer debonding detecting in an asphalt airport pavement using a multistatic GPR system. IEEE Transactions on Geoscience and Remote Sensing, 58 (6), 4215–4224. Available from: https://doi.org/10.1109/TGRS.2019.2961772.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.