Open set classification of Hyperspectral images with energy models

ABSTRACT

Hyperspectral images are rich in spectral data, lending themselves well to pixel-level image classification tasks. Previous studies primarily focus on closed-set classification within the realm of hyperspectral image classification. However, real-world scenarios present the challenge of dealing with object classes not encountered during the training phase, a scenario known as open set classification, which has garnered less attention compared to the closed set paradigm. In this paper, we propose a methodology anchored on ConvMixer for tackling open-set classification by utilizing energy-based models. We incorporate a Selective Kernel Attention (SKA) to capture the notion that different feature maps usually correspond to different objects in deep neural networks. Our experimental validation, conducted on two datasets, specifically the WHU-Hi-HanChuan and WHU-Hi-HongHu datasets, showcases promising outcomes of the introduced method.

KEYWORDS:

• Hyperspectral image classification
• deep learning
• attention mechanisms
• open set classification
• energy score

Acknowledgements

This research was supported by the Researchers Supporting Project (RSPD-2023R607), King Saud University, Riyadh, Saudi Arabia

Disclosure statement

No potential conflict of interest was reported by the authors.

Correction Statement

This article has been corrected with minor changes. These changes do not impact the academic content of the article.

Additional information

Funding

This research was supported by the Researchers Supporting Project (RSPD-2023R607), King Saud University, Riyadh, Saudi Arabia