Automatic pavement crack detection using multimodal features fusion deep neural network

References

• Augustauskas, R. and Lipnickas, A., 2020. Improved pixel-level pavement-defect segmentation using a deep autoencoder. Sensors, 20 (9), 2557.
   PubMed Web of Science ®Google Scholar
• Badrinarayanan, V., Kendall, A., and Cipolla, R., 2017. Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 2481–2495.
   PubMed Web of Science ®Google Scholar
• Bang, S., et al., 2019. Encoder–decoder network for pixel-level road crack detection in black-box images. Computer-Aided Civil and Infrastructure Engineering, 34 (8), 713–727.
   Web of Science ®Google Scholar
• Cao, W., Liu, Q., and He, Z., 2020. Review of pavement defect detection methods. IEEE Access, 8, 14531–14544.
   Web of Science ®Google Scholar
• Chen, L.-C., et al., 2018. Rethinking atrous convolution for semantic image segmentation. Proceedings of the European Conference on Computer Vision, 801–818.
   Google Scholar
• Chen, T., et al., 2020a. Microstructure of synthetic composite interfaces and verification of mixing order in cold-recycled asphalt emulsion mixture. Journal of Cleaner Production, 263, 121467.
   Web of Science ®Google Scholar
• Chen, T., et al., 2020b. Pavement crack detection and recognition using the architecture of SegNet. Journal of Industrial Information Integration, 18, 100144.
   Web of Science ®Google Scholar
• Cui, B., et al., 2020. A multiphysics evaluation of the rejuvenator effects on aged asphalt using molecular dynamics simulations. Journal of Cleaner Production, 259, 120629.
   Web of Science ®Google Scholar
• Du, Y., et al., 2020. Pavement distress detection and classification based on YOLO network. International Journal of Pavement Engineering, 3, 1–14.
   Google Scholar
• Escalona, U., et al., 2019. Fully convolutional networks for automatic pavement crack segmentation. Computación y Sistemas, 23 (2), 451–460.
   Web of Science ®Google Scholar
• Fan, R., et al., 2020. S4Net: single stage salient-instance segmentation. Computational Visual Media, 6 (2), 191–204.
   Google Scholar
• Fan, Z., et al., 2021. Automatic crack detection on road pavements using encoder-decoder architecture. Materials, 13, 2960.
   Web of Science ®Google Scholar
• He, K., et al., 2016. Deep residual learning for image recognition. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, 770–778.
   Google Scholar
• He, K., et al., 2017. Mask R-CNN. 2017 IEEE International Conference on Computer Vision (ICCV).
   Google Scholar
• Hu, J., Shen, L., and Sun, G., 2018. Squeeze-and-excitation networks. 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
   Google Scholar
• Huang, G., Liu, Z., and van der Maaten, A., 2017. Densely connected convolutional networks. 2017 IEEE Conference on Computer Vision and Pattern Recognition, 2261–2269.
   Google Scholar
• Ibragimov, E., et al., 2020. Automated pavement distress detection using region based convolutional neural networks. International Journal of Pavement Engineering, 23 (6), 1981–1992.
   Web of Science ®Google Scholar
• Jenkins, M.D., et al., 2018. A deep convolutional neural network for semantic pixel-wise segmentation of road and pavement surface cracks. 2018 26th European Signal Processing Conference (EUSIPCO):2120-2124.
   Google Scholar
• Krizhevsky, A., Sutskever, I., and Hinton, G.E., 2017. Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60 (6), 84–90.
   Web of Science ®Google Scholar
• Li, G., et al., 2021. Automatic pavement crack detection based on single stage salient-instance segmentation and concatenated feature pyramid network. International Journal of Pavement Engineering, 5, 1–17.
   Google Scholar
• Li, S., Zhao, X., and Zhou, G., 2019. Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network. Computer-Aided Civil and Infrastructure Engineering, 34 (7), 616–634.
   Web of Science ®Google Scholar
• Lin, T.-Y., et al., 2017a. Feature pyramid networks for object detection. 2017 IEEE Conference on Computer Vision and Pattern Recognition.
   Google Scholar
• Lin, T.-Y., et al., 2017b. Focal loss for dense object detection. 2017 IEEE International Conference on Computer Vision (ICCV):2999-3007.
   Google Scholar
• Liu, W., et al., 2016. SSD: Single Shot MultiBox Detector. 9905.
   Google Scholar
• Liu, J., et al., 2020a. Automated pavement crack detection and segmentation based on two-step convolutional neural network. Computer-Aided Civil and Infrastructure Engineering, 35 (11), 1291–1305.
   Web of Science ®Google Scholar
• Liu, C., et al., 2021. Combination of pixel-wise and region-based deep learning for pavement inspection and segmentation. International Journal of Pavement Engineering, 7, 1–13.
   Google Scholar
• Liu, J., Yu, B., and Hong, Q., 2020b. Molecular dynamics simulation of distribution and adhesion of asphalt components on steel slag. Construction and Building Materials, 255, 119332.
   Web of Science ®Google Scholar
• Park, S., et al., 2019. Patch-based crack detection in black Box images using convolutional neural networks. Journal of Computing in Civil Engineering, 33 (3).
   Web of Science ®Google Scholar
• Redmon, J. and Farhadi, A., 2018. YOLOv3: an incremental improvement. arXiv preprint arXiv:1804.02767.
   Google Scholar
• Ren, S., et al., 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (6), 1137–1149.
   PubMed Web of Science ®Google Scholar
• Ronneberger, O., Fischer, P., and Brox, T., 2015. Unet convolutional networks for biomedical image segmentation. In: Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany, 5–9 October 2015, 234–241.
   Google Scholar
• Sarmiento, J.-A., 2021. Pavement Distress Detection and Segmentation using YOLOv4 and DeepLabv3 on Pavements in the Philippines. arXiv:12 pp.
   Google Scholar
• Shelhamer, E., Long, J., and Darrell, T., 2016. Fully convolutional networks for semantic segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 (4), 640–651. 7478072
   PubMed Web of Science ®Google Scholar
• Shen, T. and Nie, M., 2020. Pavement damage detection based on cascade R-CNN. In Proceedings of the 4th International Conference on Computer Science and Application Engineering, 1–5.
   Google Scholar
• Shi, Y., et al., 2016. Automatic road crack detection using random structured forests. IEEE Transactions on Intelligent Transportation Systems, 17 (12), 3434–3445.
   Web of Science ®Google Scholar
• Shi, C., et al., 2021. Fatigue crack density of asphalt binders under controlled-stress rotational shear load testing. Construction and Building Materials, 272, 121899.
   Web of Science ®Google Scholar
• Shrivastava, A., Gupta, A., and Girshick, R., 2016. Training region-based object detectors with online hard example mining. 2016 IEEE Conference on Computer Vision and Pattern Recognition.
   Google Scholar
• Simonyan, K. and Zisserman, A., 2015. Very deep convolutional networks for large-scale image recognition. International Conference on Learning Representations.
   Google Scholar
• Song, L. and Wang, X., 2021. Faster region convolutional neural network for automated pavement distress detection. Road Materials and Pavement Design, 22 (1), 23–41.
   Web of Science ®Google Scholar
• Sun, Y., et al., 2019. Concatenated feature pyramid network for instance segmentation. 2019 IEEE Fifth International Conference on Multimedia Big Data (BigMM):297–301.
   Google Scholar
• Szegedy, C., et al., 2015. Going deeper with convolutions. 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
   Google Scholar
• Tang, F., et al., 2020. Integrating three-dimensional road design and pavement structure analysis based on BIM. Automation in Construction, 113, 103152.
   Web of Science ®Google Scholar
• Tran, V.P., et al., 2021. One stage detector (RetinaNet)-based crack detection for asphalt pavements considering pavement distresses and surface objects. Journal of Civil Structural Health Monitoring, 11 (1), 205–222.
   Web of Science ®Google Scholar
• Wang, Q., et al., 2020a. ECA-Net: efficient channel attention for deep convolutional neural networks. 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 11531–11539.
   Google Scholar
• Wang, S.R., et al., 2020b. RDSNet: a new deep architecture forreciprocal object detection and instance segmentation. Proceedings of the AAAI Conference on Artificial Intelligence, 34 (07: AAAI-20 Technical Tracks 7), 12208–12215.
   Google Scholar
• Wu, Z., et al., 2020. Crack detecting by recursive attention U-Net. 2020 3rd International Conference on Robotics, Control and Automation Engineering (RCAE), 103–107.
   Google Scholar
• Wu, Y., et al., 2021. Asphalt pavement crack detection based on multi-scale full convolutional network. Journal of Intelligent & Fuzzy Systems, 40 (1), 1495–1508.
   Web of Science ®Google Scholar
• Xie, S. and Tu, Z., 2015. Holistically-nested edge detection. 2015 IEEE International Conference on Computer Vision (ICCV).
   Google Scholar
• Xu, Z., et al., 2019. Research progress on automatic image processing technology for pavement distress. Journal of Traffic and Transportation Engineering, 19, 172–190.
   Google Scholar
• Yang, F., et al., 2020. Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Transactions on Intelligent Transportation Systems, 21 (4), 1525–1535.
   Web of Science ®Google Scholar
• Yang, J., Li, Z., and Xu, X., 2021. Preparation and evaluation of cooling asphalt concrete modified with SBS and tourmaline anion powder. Journal of Cleaner Production, 289, 125135.
   Web of Science ®Google Scholar
• Yusof, N.A.M., et al., 2018. Crack detection and classification in asphalt pavement images using deep convolution neural network. 8th IEEE International Conference on Control System, Computing and Engineering (ICCSCE), 227–232.
   Google Scholar
• Yusof, N.A.M., et al., 2019. Automated asphalt pavement crack detection and classification using deep convolution neural network. 2019 9th IEEE International Conference on Control System, Computing and Engineering (ICCSCE).
   Google Scholar
• Zhang, Y., et al., 2020. APLCNet: automatic pixel-level crack detection network based on instance segmentation. IEEE Access, 8, 199159–199170.
   Google Scholar
• Zhang, Y., et al., 2021. TB-Net: a three-stream boundary-aware network for fine-grained pavement disease segmentation. In: 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), 3654–3663.
   Google Scholar
• Zou, Q., et al., 2018. Deepcrack: learning hierarchical convolutional features for crack detection. IEEE Transactions on Image Processing. doi:10.1109/TIP.2018.2878966.
   Web of Science ®Google Scholar