A novel pansharpening model based on two parallel network architectures

ABSTRACT

Pansharpening is an important technology for obtaining high-resolution multispectral (HRMS) images by fusing low-resolution multispectral (LRMS) images and high-resolution panchromatic (PAN) images. Although many pansharpening models have emerged by taking advantage of deep learning (DL) technology, there remains a pressing need to further assess pansharpening accuracy and stability when LRMS images with complex land-cover types. What’s more, these models often overlook the exploitation of PAN images’ inherent high-frequency information. To address these issues, we propose a pansharpening model combining multi-level and multi-scale network architectures. The multi-level network architecture is used to build spatial-spectral dependence on LRMS-PAN pairs, and strengthen the network’s feature capture capability by keeping the multi-level texture details. The multi-scale architecture is subsequently used to extract the spatial structure and deep texture of the PAN images at different scales. Downsampled experiments and real experiments in four standard datasets show that the proposed model achieves a state-of-the-art performance.

KEYWORDS:

• Deep Learning (DL)
• multi-level architecture
• multi-scale architecture
• pansharpening
• remote sensing

Acknowledgements

This work was partially funded by the National Natural Science Foundation of China [Grant No.61971318, No.42001134, No.U2033216] and the Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation of Ministry of Natural Resources [Grant No. KF-2023-08-02].

Disclosure statement

No potential conflict of interest was reported by the author(s).

Supplementary material

Supplemental data for this article can be accessed online at https://doi.org/10.1080/01431161.2024.2382847.

Additional information

Funding

The work was supported by the National Natural Science Foundation of China [42001134,61971318,No.U2033216]; Open Fund of Key Laboratory of Urban Land Resources Monitoring and Simulation of Ministry of Natural Resources [KF-2023-08-02].