SpectralSWIN: a spectral-swin transformer network for hyperspectral image classification

ABSTRACT

Hyperspectral image (HSI) classification has received extensive attention by the development of deep learning and has achieved great success. However, most of the deep learning-based approaches tend to extract features of spatial content by disrupting spectral information or to extract sequential spectral features in short-range context. On the other hand, Transformers-based models address this problem by learning long-range relationship. This study introduces a novel spectral-swin transformer (SpectralSWIN) network. The proposed network effectively projects the HSI data from spectral characteristics into spatial and spectral feature representation. Specifically, SpectralSWIN network makes use of a newly proposed swin-spectral module (SSM) for processing the spatial and spectral features concurrently. As far as we know, this is the first time that a transformer backbone designed for vision domain has been proposed for HSI classification. Extensive experiments conducted on two different HSI prove the superiority and effectiveness of the proposed method over the state-of-the-art methods in terms of both quantitative and visual evaluations.

Acknowledgement(s)

Selen Ayas would like to thank the Scientific and Technological Research Council of Turkey (TUBITAK) BIDEB 2219 program.

Disclosure statement

No potential conflict of interest was reported by the author(s).