Combination of pixel-wise and region-based deep learning for pavement inspection and segmentation

ABSTRACT

This paper presents a new model combining pixel-wise and region-based deep learning to provide a pavement inspection technology for jointly obtaining the distress classes, locations, and geometric information. This proposed model, called the segmentation RCNN, added an extract branch in a faster region convolutional neural network (Faster RCNN) for assigning the pixels in each region of interest (ROI) from an image into one of the pavement distresses or background, in parallel with the existing branches for ROI classification and bounding-box regression in the Faster RCNN. The effectiveness of the proposed model was tested by a pavement-image database collected from 16 asphalt pavements. The results indicated that the proposed model detected and segmented the pavement distresses (cracks, potholes, and patches) with mean intersection over unions of 87.6% and 70.3%, respectively. The proposed model was stable under various real-world conditions. The model reduced the computation costs, which provided a novel direction to achieve real-time pavement inspection.

KEYWORDS:

• Distress detection
• pavement inspection
• deep learning
• intelligent inspection
• image processing

Acknowledgments

This work is funded by Research and Development Center of Transport Industry of Technologies, Materials and Equipment of Highway Construction and Maintenance (No. 2019-004), Science and Technology Research Project of Jiangxi Provincial Department of Education (No. GJJ190361), and Youth project of Natural Science Foundation of Jiangxi Province (No. 20202BABL214046).

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

This work is funded by Research and Development Center of Transport Industry of Technologies, Materials and Equipment of Highway Construction and Maintenance (No. 2019-004), Science and Technology Research Project of Jiangxi Provincial Department of Education (No. GJJ190361), and Youth project of Natural Science Foundation of Jiangxi Province (No. 20202BABL214046).