Automated pavement distress segmentation on asphalt surfaces using a deep learning network

References

• Badrinarayanan, V., Kendall, A., and Cipolla, R., 2017. Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (12), 2481–2495.
   PubMed Web of Science ®Google Scholar
• Cha, Y.J., 2017. Deep learning-based crack damage detection using convolutional neural networks. Computer-Aided Civil and Infrastructure Engineering, 32 (5), 361–378.
   Web of Science ®Google Scholar
• Cha, Y.-J., You, K., and Choi, W., 2016. Vision-based detection of ravelingned bolts using the hough transform and support vector machines. Automation in Construction, 71 (pt.2), 181–188.
   Google Scholar
• Chen, L.C., et al., 2018. Encoder-decoder with Atrous separable convolution for semantic image segmentation. In: F. Vittorio, et al., ed. Computer vision – ECCV 2018, 8-14 September 2018, Munich, Germany. Springer, 833–851.
   Google Scholar
• Chen, H., Lin, H., and Yao, M., 2019. Improving the efficiency of encoder-decoder architecture for pixel-level crack detection. IEEE Access, 7, 186657–186670.
   Google Scholar
• Choi, W., and Cha, Y.J., 2020. SDDnet: real-time crack segmentation. IEEE Transactions on Industrial Electronics, 67 (9), 8016–8025.
   Web of Science ®Google Scholar
• Du, Y., et al., 2020. Pavement distress detection and classification based on yolo network. International Journal of Pavement Engineering, 22 (13), 1659–1672. doi:10.1080/10298436.2020.1714047.
   Web of Science ®Google Scholar
• Fei, Y., et al., 2020. Pixel-level cracking detection on 3d asphalt pavement images through deep-learning- based cracknet-v. IEEE Transactions on Intelligent Transportation Systems, 21 (1), 273–284.
   Web of Science ®Google Scholar
• Hadjidemetriou, G. M., Vela, P. A., and Christodoulou, S. E., 2018. Automated pavement patch detection and quantification using support vector machines. Journal of Computing in Civil Engineering, 32 (1), 11.
   Web of Science ®Google Scholar
• He, K., et al., 2016. Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, 27-30 June 2016, Las Vegas, NV, USA. IEEE, 770–778. doi:10.1109/CVPR.2016.90.
   Google Scholar
• He, K., et al., 2017. Mask R-CNN. 2017 IEEE international conference on computer vision (ICCV), 22-29 October 2017, Venice, Italy. IEEE, 2980–2988. doi:10.1109/ICCV.2017.322.
   Google Scholar
• Heriberto, P.-A., 2018. Research trends in pavement management during the first years of the 21st century: a bibliometric analysis during the 2000–2013 period. Applied Ences, 8 (7), 1041.
   Google Scholar
• Hsieh, Y.-A., and Tsai, Y.J., 2020. Machine learning for crack detection: review and model performance comparison. Journal of Computing in Civil Engineering, 34 (5), 04020038.
   Web of Science ®Google Scholar
• Huang, Y., Copenhaver, T., and Hempel, P., 2013. Texas department of transportation 3d profiling system for high-speed rut measurement. Journal of Infrastructure Systems, 19 (2), 221–230.
   Web of Science ®Google Scholar
• Jiang, Y., et al., 2020. Development and application of skid resistance fog seal for pavements. Coatings, 10 (9), 867.
   Web of Science ®Google Scholar
• Ju, H., et al., 2020. Cracku-net: a novel deep convolutional neural network for pixelwise pavement crack detection. Structural Control & Health Monitoring, 27 (8), e2551. doi:10.1002/stc.2551.
   Web of Science ®Google Scholar
• Kalfarisi, R., Wu, Z. Y., and Soh, K., 2020. Crack detection and segmentation using deep learning with 3d reality mesh model for quantitative assessment and integrated visualization. Journal of Computing in Civil Engineering, 34 (3), 04020010.
   Web of Science ®Google Scholar
• Kim, B., and Cho, S., 2020. Automated multiple concrete damage detection using instance segmentation deep learning model. Applied Sciences, 10 (22), 8008.
   Google Scholar
• Krizhevsky, A., Sutskever, I., and Hinton, G.E., 2017. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60 (6), 84–90. doi:10.1145/3065386.
   Web of Science ®Google Scholar
• Lang, H., et al., 2020. Pavement cracking detection and classification based on 3d image using multiscale clustering model. Journal of Computing in Civil Engineering, 34 (5), 04020034.
   Web of Science ®Google Scholar
• Lang, H., 2021. 3d pavement crack detection method based on deep learning. Journal of Southeast University (Natural Science Edition), 51 (01), 53–60.
   Google Scholar
• Lecun, Y., 1998. Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86, 2278–2324.
   Web of Science ®Google Scholar
• Lei, X.U., 2020. Automated pavement distress detection and deterioration analysis using street view map. IEEE Access, 2020 (8), 76163–76172.
   Google Scholar
• Li, B., 2018. Automatic classification of pavement crack using deep convolutional neural network. International Journal of Pavement Engineering, 21, 1–7.
   Web of Science ®Google Scholar
• Lin, T.Y., et al., 2017. Focal loss for dense object detection. IEEE Transactions on Pattern Analysis & Machine Intelligence, 42 (1), 318–327. doi:10.1109/TPAMI.2018.2858826.
   Google Scholar
• Liu, W., et al. 2016. SSD: single shot multibox detector. In: L. Bastian, et al., ed. Computer vision – ECCV 2016, 11–14 October 2016, Amsterdam, The Netherlands. Springer International Publishing, 21–37.
   Google Scholar
• Liu, S., et al., 2018. Path aggregation network for instance segmentation. 2018 IEEE/CVF conference on computer vision and pattern recognition, 18-23 June 2018, Salt Lake City, UT, USA. IEEE, 8759–8768. doi:10.1109/CVPR.2018.00913.
   Google Scholar
• Liu, Z., et al., 2019. Computer vision-based concrete crack detection using u-net fully convolutional networks. Automation in Construction, 104, 129–139.
   Web of Science ®Google Scholar
• Liu, J., et al., 2020. Automated pavement crack detection and segmentation based on two-step convolutional neural network. Computer-Aided Civil and Infrastructure Engineering, 35 (11), 1291–1305.
   Web of Science ®Google Scholar
• Majidifard, H., et al., 2020. Pavement image datasets: a new benchmark dataset to classify and densify pavement distresses. Transportation Research Record, 2674 (2), 328–339.
   Web of Science ®Google Scholar
• Miller, T., and Zaloshnja, E., 2009. Cost of crashes related to road conditions. 53rd annual scientific conference of the association for the advancement of automotive medicine, 4-7 October 2009, Baltimore, Maryland, 01382043.
   Google Scholar
• Ouma, Y.O., and Hahn, M., 2017. Pothole detection on asphalt pavements from 2d-colour pothole images using fuzzy c-means clustering and morphological reconstruction. Automation in Construction, 83 (2016), 196–211.
   Google Scholar
• Park, S., et al., 2019. Patch-based crack detection in black box images using convolutional neural networks. Journal of Computing in Civil Engineering, 33 (3), 04019017.
   Web of Science ®Google Scholar
• Pellecuer, L., Assaf, G. J., and St-Jacques, M., 2014. Life cycle environmental benefits of pavement surface maintenance. Canadian Journal of Civil Engineering, 41, 695–702.
   Web of Science ®Google Scholar
• Raheel Shah, S.A., et al., 2018. Saving energy in the transportation sector: an analysis of modified bitumen application based on marshall test. Energies, 11 (11), 3025.
   Web of Science ®Google Scholar
• Redmon, J., and Farhadi, A., 2018. Yolov3: an incremental improvement. arXiv e-prints.
   Google Scholar
• Ren, S., et al., 2017. Faster r-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis & Machine Intelligence, 39 (6), 1137–1149.
   PubMed Web of Science ®Google Scholar
• Ronneberger, O., Fischer, P., and Brox, T., 2015. U-net: convolutional networks for biomedical image segmentation. In: N. Navab, et al., ed. International conference on medical image computing and computer-assisted intervention, 5-9 October 2015, Munich, Germany. Springer, 234–241.
   Google Scholar
• Safaei, N., et al., 2021a. Efficient road crack detection based on an adaptive pixel-level segmentation algorithm. Transportation Research Record, 2675 (9), 1–12. doi:10.1177/03611981211002203.
   Web of Science ®Google Scholar
• Safaei, N., et al., 2021b. An automatic image processing algorithm based on crack pixel density for pavement crack detection and classification. International Journal of Pavement Research and Technology, 15 (1), 159–172. doi:10.1007/s42947-021-00006-4.
   Google Scholar
• Salas, M.Á., et al., 2018. Bitumen modified with recycled polyurethane foam for employment in hot mix asphalt. Ingeniería e Investigación, 38 (1), 60–66.
   Web of Science ®Google Scholar
• Shi, Y., et al., 2016. Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems, 17 (12), 3434–3445.
   Web of Science ®Google Scholar
• Sidess, A., Ravina, A., and Oged, E., 2020. A model for predicting the deterioration of the international roughness index. International Journal of Pavement Engineering, 5 (1), 1–11.
   Google Scholar
• Subirats, P., et al., 2004. A combined wavelet-based image processing method for emergent crack detection on pavement surface images. 2004 12th European signal processing conference, 6-10 September 2004, Vienna, Austria, 257–260.
   Google Scholar
• Szegedy, C., et al., 2015. Going deeper with convolutions. 2015 IEEE conference on computer vision and pattern recognition (CVPR), 7-12 June 2015, Boston, MA, USA. IEEE, 1–9. doi:10.1109/CVPR.2015.7298594.
   Google Scholar
• Tan, Y., and Li, Y., 2019. UAV photogrammetry-based 3d road distress detection. ISPRS International Journal of Geo-Information, 8 (9), 409.
   Web of Science ®Google Scholar
• Tsai, Y.C., and Chatterjee, A., 2018. Pothole detection and classification using 3d technology and watershed method. Journal of Computing in Civil Engineering, 32 (2), 04017078.
   Web of Science ®Google Scholar
• Wu, H., et al., 2019. Road pothole extraction and safety evaluation by integration of point cloud and images derived from mobile mapping sensors. Advanced Engineering Informatics, 42 (3/4), 100936.
   Google Scholar
• Yang, X., 2018. Automatic pixel-level crack detection and measurement using fully convolutional network. Computer-Aided Civil and Infrastructure Engineering, 33 (12), 1090–1109.
   Web of Science ®Google Scholar
• Zhang, A., et al., 2016. Efficient system of cracking-detection algorithms with 1-mm 3d-surface models and performance measures. Journal of Computing in Civil Engineering, 30 (6), 04016020. doi:10.1061/(asce)cp.1943-5487.0000581.
   Web of Science ®Google Scholar
• Zhang, A., et al., 2017. Automated pixel-level pavement crack detection on 3d asphalt surfaces using a deep-learning network. Computer-Aided Civil and Infrastructure Engineering, 32 (10), 805–819.
   Web of Science ®Google Scholar
• Zhang, Y.F., et al., 2020. Aplcnet: automatic pixel-level crack detection network based on instance segmentation. IEEE Access, 8, 199159–199170.
   Google Scholar
• Zhang, A., Wang, K.C., and Ai, C., 2017. 3d shadow modeling for detection of descended patterns on 3d pavement surface. Journal of Computing in Civil Engineering, 31 (4), 04017019. doi:10.1061/(asce)cp.1943-5487.0000661.
   Web of Science ®Google Scholar
• Zhao, H., et al., 2017. Pyramid scene parsing network. 2017 IEEE conference on computer vision and pattern recognition (CVPR), 21-26 July 2017, Honolulu, HI, USA. IEEE, 6230–6239. doi:10.1109/CVPR.2017.660.
   Google Scholar
• Zhou, R., et al., 2019. Three-dimensional pavement disease detection based on three components decomposition and tuff algorithmed. In: 2019 2nd IEEE international conference on information communication and signal processing, 478–483.
   Google Scholar
• Zou, Q., et al., 2012. Crack tree: automatic crack detection from pavement images. Pattern Recognition Letters, 33 (3), 227–238.
   Web of Science ®Google Scholar
• Zou, Q., et al., 2019. Deepcrack: learning hierarchical convolutional features for crack detection. IEEE Transactions on Image Processing, 28 (3), 1498–1512.
   Web of Science ®Google Scholar