GCN-based multi-scale dual fusion for remote sensing building change detection

ABSTRACT

In recent years, Graph Neural Networks (GNN) have begun to receive extensive attention from researchers. Subsequently, ViG was proposed and its performance in learning irregular feature information in non-Euclidean data space was astonishing. Inspired by the success of ViG, we propose a GNN-based multi-scale fusion network model (GCNCD) to extract graph-level features for remote sensing building change detection (CD). GCNCD builds bitemporal images into a graph structure. It then learns richer features by aggregating the features (edge information) of neighbour vertices in the graph. To alleviate the over-smoothing problem caused by multi-layer graph convolution, the FNN module is used to improve the network’s ability to transform features and reduce the loss of spatial structure information. Compared with the traditional single-type feature fusion module, in the decoder, we perform feature fusion on adjacent-scale features and all scale features, respectively. It helps to promote information mobility and reduce spatial information loss. Our extensive experiments demonstrate the positive effects of graph convolution and fusion module in the field of remote sensing building change detection.

KEYWORDS:

• High-resolution optical remote sensing image
• graph neural networks(GNN)
• building change detection(CD)
• feature fusion

Acknowledgements

The authors acknowledge the National Natural Science Foundation of China (Grant nos. 61772319,62002200,62202268, 62272281), the Shandong Natural Science Foundation of China (Grant no. ZR2021MF107, ZR2022MA076) and Youth Innovation Technology Project of Higher School in Shandong Province under (Grant No. 2019KJN042).

Disclosure statement

No potential conflict of interest was reported by the author(s).

Additional information

Funding

The work was supported by the National Natural Science Foundation of China [61772319,62002200,62202268, 61972235].