55
Views
0
CrossRef citations to date
0
Altmetric
Research article

Leveraging adaptive spatial shifts multi-layer perceptron with parameterized spatial offsets for hyperspectral image classification

ORCID Icon, ORCID Icon, , & ORCID Icon
Pages 1385-1417 | Received 13 Sep 2023, Accepted 16 Jan 2024, Published online: 13 Feb 2024

References

  • Antony, M. M., C. S. Suchand Sandeep, H.-T. Lim, and M. Vadakke Matham. 2022. “Hyperspectral Vision Based Probe for in situ Corrosion Monitoring in Saline Environments.” IEEE Transactions on Instrumentation and Measurement 71: 1–7. https://doi.org/10.1109/TIM.2022.3221115.
  • Audebert, N., B. Le Saux, and S. Lefevre. 2019. “Deep Learning for Classification of Hyperspectral Data: A Comparative Review.” IEEE Geoscience and Remote Sensing Magazine 7 (2): 159–173. https://doi.org/10.1109/mgrs.2019.2912563.
  • Cao, H., C. Song, Y. Chu, C. Zhao, M. Deng, and G. Liu. 2023. “Local Sensitive Discriminative Broad Learning System for Hyperspectral Image Classification.” Engineering Applications of Artificial Intelligence 123: 106307. https://doi.org/10.1016/j.engappai.2023.106307.
  • Chen, S., E. Xie, C. Ge, R. Chen, D. Liang, and P. Luo. 2022. “CycleMLP: A MLP-Like Architecture for Dense Prediction.” In The Tenth International Conference on Learning Representations, Virtual, Online, 1–21.
  • Claverie, M. 2023. “Evaluation of surface reflectance bandpass adjustment techniques.” ISPRS Journal of Photogrammetry and Remote Sensing 198: 210–222. https://doi.org/10.1016/j.isprsjprs.2023.03.011.
  • Ding, X., H. Chen, X. Zhang, J. Han, and G. Ding. 2022. “RepMlpnet: Hierarchical Vision MLP with Re-Parameterized Locality.” In IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Louisiana, 568–577.
  • Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2021. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” In 9th International Conference on Learning Representations, Virtual Event, Austria, 1–13.
  • Fang, Y., Q. Ye, L. Sun, Y. Zheng, and Z. Wu. 2023. “Multiattention Joint Convolution Feature Representation with Lightweight Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61: 1–14. https://doi.org/10.1109/TGRS.2023.3281511.
  • Firat, H., M. Emin Asker, M. Ilyas Bayindir, and D. Hanbay. 2023. “3D Residual Spatial-Spectral Convolution Network for Hyperspectral Remote Sensing Image Classification.” Neural Computing and Applications 35 (6): 4479–4497. https://doi.org/10.1007/s00521-022-07933-8.
  • Gao, H., Z. Chen, and C. Li. 2022. “Shallow Network Based on Depthwise Overparameterized Convolution for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2021.3133598.
  • Gao, Q., F. Xie, D. Huang, and C. Jin. 2022. “Spectral and Spatial Reduction of Hyperspectral Image Guided by Data Reconstruction and Superpixels.” Engineering Applications of Artificial Intelligence 111: 104803. https://doi.org/10.1016/j.engappai.2022.104803.
  • Ge, H., L. Wang, M. Liu, Y. Zhu, X. Zhao, H. Pan, and Y. Liu. 2023. “Two-Branch Convolutional Neural Network with Polarized Full Attention for Hyperspectral Image Classification.” Remote Sensing 15 (3): 848. https://doi.org/10.3390/rs15030848.
  • Gong, N., C. Zhang, H. Zhou, K. Zhang, Z. Wu, and X. Zhang. 2022. “Classification of Hyperspectral Images via Improved Cycle-MLP.” IET Computer Vision 16 (5): 468–478. https://doi.org/10.1049/cvi2.12104.
  • Guo, J., Y. Tang, K. Han, X. Chen, W. Han, X. Chao, X. Chang, and Y. Wang. 2022. “Hire-MLP: Vision MLP via Hierarchical Rearrangement.” In IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Louisiana, 816–826.
  • He, X., Y. Chen, and Z. Lin. 2021. “Spatial-Spectral Transformer for Hyperspectral Image Classification.” Remote Sensing 13 (3): 498. https://doi.org/10.3390/rs13030498.
  • He, J., L. Zhao, H. Yang, M. Zhang, and W. Li. 2020. “HSI-BERT: Hyperspectral Image Classification Using the Bidirectional Encoder Representation from Transformers.” IEEE Transactions on Geoscience and Remote Sensing 58 (1): 165–178. https://doi.org/10.1109/TGRS.2019.2934760.
  • Hou, Q., Z. Jiang, L. Yuan, M.-M. Cheng, S. Yan, and J. Feng. 2023. “Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 45 (1): 1328–1334. https://doi.org/10.1109/TPAMI.2022.3145427.
  • Jia, S., S. Jiang, Z. Lin, N. Li, M. Xu, and S. Yu. 2021. “A Survey: Deep Learning for Hyperspectral Image Classification with Few Labeled Samples.” Neurocomputing 448: 179–204. https://doi.org/10.1016/j.neucom.2021.03.035.
  • Ji, L., J. Liu, Y. Shao, and L. Xiao. 2023. “Spatial-Spectral Hierarchical Vision Permutator for Hyperspectral Image Classification.” European Journal of Remote Sensing 56 (1): 2153747. https://doi.org/10.1080/22797254.2022.2153747.
  • Khan, A., A. D. Vibhute, S. Mali, and C. H. Patil. 2022. “A Systematic Review on Hyperspectral Imaging Technology with a Machine and Deep Learning Methodology for Agricultural Applications.” Ecological Informatics 69: 101678. https://doi.org/10.1016/j.ecoinf.2022.101678.
  • Lian, D., Y. Zehao, X. Sun, and S. Gao. 2022. “AS-MLP: An Axial Shifted MLP Architecture for Vision.” In The Tenth International Conference on Learning Representations, Virtual, Online, 1–19.
  • Lin, M., W. Jing, D. Di, G. Chen, and H. Song. 2022. “Multi-Scale U-Shape MLP for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. https://doi.org/10.1109/LGRS.2022.3141547.
  • Liu, S., Z. Hu, J. Han, Y. Li, and T. Zhou. 2022. “Predicting Grain Yield and Protein Content of Winter Wheat at Different Growth Stages by Hyperspectral Data Integrated with Growth Monitor Index.” Computers and Electronics in Agriculture 200: 107235. https://doi.org/10.1016/j.compag.2022.107235.
  • Liu, X., L. Jiao, L. Li, L. Cheng, F. Liu, S. Yang, and B. Hou. 2022. “Deep Multiview Union Learning Network for Multisource Image Classification.” IEEE Transactions on Cybernetics 52 (6): 4534–4546. https://doi.org/10.1109/TCYB.2020.3029787.
  • Liu, R., Y. Li, L. Tao, D. Liang, and H.-T. Zheng. 2022. “Are We Ready for a New Paradigm Shift? A Survey on Visual Deep MLP.” Patterns 3 (7): 100520. https://doi.org/10.1016/j.patter.2022.100520.
  • Meng, Z., F. Zhao, and M. Liang. 2021. “SS-MLP: A Novel Spectral-Spatial MLP Architecture for Hyperspectral Image Classification.” Remote Sensing 13 (20): 4060. https://doi.org/10.3390/rs13204060.
  • Moharram, M. A., and D. M. Sundaram. 2023. “Land Use and Land Cover Classification with Hyperspectral Data: A Comprehensive Review of Methods, Challenges and Future Directions.” Neurocomputing 536: 90–113. https://doi.org/10.1016/j.neucom.2023.03.025.
  • Paoletti, M. E., S. Moreno-Álvarez, and J. Mario Haut. 2022. “Multiple Attention-Guided Capsule Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–20. https://doi.org/10.1109/TGRS.2021.3135506.
  • Qi, W., C. Huang, Y. Wang, X. Zhang, W. Sun, and L. Zhang. 2023. “Global-Local 3-D Convolutional Transformer Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61: 1–20. https://doi.org/10.1109/TGRS.2023.3272885.
  • Qing, Y., W. Liu, L. Feng, and W. Gao. 2021. “Improved Transformer Net for Hyperspectral Image Classification.” Remote Sensing 13 (11): 2216. https://doi.org/10.3390/rs13112216.
  • Sankararao, A. U. G., P. Rajalakshmi, and S. Choudhary. 2023. “Machine Learning-Based Ensemble Band Selection for Early Water Stress Identification in Groundnut Canopy Using UAV-Based Hyperspectral Imaging.” IEEE Geoscience and Remote Sensing Letters 20: 1–5. https://doi.org/10.1109/LGRS.2023.3284675.
  • Shao, Y., J. Liu, J. Yang, and Z. Wu. 2022. “Spatial-Spectral Involution MLP Network for Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15: 9293–9310. https://doi.org/10.1109/JSTARS.2022.3216590.
  • Sun, Y., B. Liu, R. Wang, P. Zhang, and M. Dai. 2023. “Spectral-Spatial MLP-Like Network with Reciprocal Points Learning for Open-Set Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 61:1–18. https://doi.org/10.1109/TGRS.2023.3335418.
  • Tang, X.-J., X. Liu, P.-F. Yan, B.-X. Li, H.-Y. Qi, and F. Huang. 2022. “An MLP Network Based on Residual Learning for Rice Hyperspectral Data Classification.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. https://doi.org/10.1109/LGRS.2022.3149185.
  • Tolstikhin, I. O., N. Houlsby, A. Kolesnikov, L. Beyer, X. Zhai, T. Unterthiner, J. Yung, A. Steiner, D. Keysers, J. Uszkoreit, M. Lucic, A. Dosovitskiy. 2021. “MLP-Mixer: An All-MLP Architecture for Vision.“ Advances in Neural Information Processing Systems, Virtual, Online 34: 24261–24272.
  • Tu, Z., H. Talebi, H. Zhang, F. Yang, P. Milanfar, A. C. Bovik, and L. Yinxiao 2022. “MAXIM: Multi-Axis MLP for Image Processing.” In IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Louisiana, 5759–5770.
  • Vane, G., R. Green, T. Chrien, H. Enmark, E. Hansen, and W. Porter. 1993. “The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS).” Remote Sensing of Environment 44 (2): 127–143. https://doi.org/10.1016/0034-4257(93)90012-M.
  • Vivone, G. 2023. “Multispectral and Hyperspectral Image Fusion in Remote Sensing: A Survey.” Information Fusion 89: 405–417. https://doi.org/10.1016/j.inffus.2022.08.032.
  • Wang, J., L. Wei, M. Zhang, R. Tao, and J. Chanussot. 2023. “Remote-Sensing Scene Classification via Multistage Self-Guided Separation Network.” IEEE Transactions on Geoscience and Remote Sensing 61: 1–12. https://doi.org/10.1109/TGRS.2023.3335484.
  • Wei, G., Z. Zhang, C. Lan, Y. Lu, and Z. Chen. 2022. “ActiveMLP: An MLP-Like Architecture with Active Token Mixer.” https://doi.org/10.48550/arXiv.2203.06108.
  • Windrim, L., A. Melkumyan, R. J. Murphy, A. Chlingaryan, and R. Leung. 2023. “Unsupervised Ore/Waste Classification on Open-Cut Mine Faces Using Close-Range Hyperspectral Data.” Geoscience Frontiers 14 (4): 101562. https://doi.org/10.1016/j.gsf.2023.101562.
  • Wu, Y., X. Hu, Y. Zhang, M. Gong, W. Ma, and Q. Miao. 2023. “SACF-Net: Skip-Attention Based Correspondence Filtering Network for Point Cloud Registration.” IEEE Transactions on Circuits and Systems for Video Technology 33 (8): 3585–3595. https://doi.org/10.1109/TCSVT.2023.3237328.
  • Wu, Y., J. Liu, M. Gong, P. Gong, X. Fan, A. K. Qin, Q. Miao, and W. Ma. 2023. “Self-Supervised Intra-Modal and Cross-Modal Contrastive Learning for Point Cloud Understanding.” IEEE Transactions on Multimedia 26: 1626–1638. https://doi.org/10.1109/TMM.2023.3284591.
  • Wu, Z., C. Liu, J. Wen, Y. Xu, J. Yang, and X. Li. 2023. “Selecting High-Quality Proposals for Weakly Supervised Object Detection with Bottom-Up Aggregated Attention and Phase-Aware Loss.” IEEE Transactions on Image Processing 32: 682–693. https://doi.org/10.1109/TIP.2022.3231744.
  • Wu, Y., Q. Yao, X. Fan, M. Gong, W. Ma, and Q. Miao. 2023. “PANet: A Point-Attention Based Multi-Scale Feature Fusion Network for Point Cloud Registration.” IEEE Transactions on Instrumentation and Measurement 72: 1–13. https://doi.org/10.1109/TIM.2023.3271757.
  • Wu, H., H. Zhou, A. Wang, and Y. Iwahori. 2022. “Precise Crop Classification of Hyperspectral Images Using Multi-Branch Feature Fusion and Dilation-Based MLP.” Remote Sensing 14 (11): 2713. https://doi.org/10.3390/rs14112713.
  • Ye, Z., C. Cuiling, Q. Liu, L. Bai, and J. E. Fowler. 2023. “Computationally Lightweight Hyperspectral Image Classification Using a Multiscale Depthwise Convolutional Network with Channel Attention.” IEEE Geoscience and Remote Sensing Letters 20: 1–5. https://doi.org/10.1109/LGRS.2023.3285208.
  • Yu, T., X. Li, Y. Cai, M. Sun, and P. Li. 2022. “S2-MLP: Spatial-Shift MLP Architecture for Vision.” In IEEE/CVF Winter Conference on Applications of Computer Vision, Waikoloa, HI, 3615–3624.
  • Zhang, H., Z. Dong, B. Li, and S. He. 2022. “Multi-Scale MLP-Mixer for image classification.” Knowledge-Based Systems 258: 109792. https://doi.org/10.1016/j.knosys.2022.109792.
  • Zhang, M., W. Li, Y. Zhang, R. Tao, and Q. Du. 2023. “Hyperspectral and LiDAR Data Classification Based on Structural Optimization Transmission.” IEEE Transactions on Cybernetics 53 (5): 3153–3164. https://doi.org/10.1109/TCYB.2022.3169773.
  • Zhao, J., L. Hu, L. Huang, C. Wang, and D. Liang. 2023. “MSRA-G: Combination of Multi-Scale Residual Attention Network and Generative Adversarial Networks for Hyperspectral Image Classification.” Engineering Applications of Artificial Intelligence 121: 106017. https://doi.org/10.1016/j.engappai.2023.106017.
  • Zhao, Z., D. Hu, H. Wang, and X. Yu. 2022. “Convolutional Transformer Network for Hyperspectral Image Classification.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. https://doi.org/10.1109/LGRS.2022.3169815.
  • Zhong, Y., X. Hu, C. Luo, X. Wang, J. Zhao, and L. Zhang. 2020. “WHU-Hi: UAV-Borne Hyperspectral with High Spatial Resolution (H2) Benchmark Datasets and Classifier for Precise Crop Identification Based on Deep Convolutional Neural Network with CRF.” Remote Sensing of Environment 250: 112012. https://doi.org/10.1016/j.rse.2020.112012.
  • Zhou, Q., S. Wang, N. Liu, P. A. Townsend, C. Jiang, B. Peng, W. Verhoef, and K. Guan. 2023. “Towards Operational Atmospheric Correction of Airborne Hyperspectral Imaging Spectroscopy: Algorithm Evaluation, Key Parameter Analysis, and Machine Learning Emulators.” Isprs Journal of Photogrammetry & Remote Sensing 196: 386–401. https://doi.org/10.1016/j.isprsjprs.2022.11.016.
  • Zhou, H., X. Zhang, C. Zhang, and Q. Ma. 2023. “Vision Transformer with Contrastive Learning for Hyperspectral Image Classification.” IEEE Geoscience & Remote Sensing Letters 20: 1–5. https://doi.org/10.1109/LGRS.2023.3255867.
  • Zhou, H., X. Zhang, C. Zhang, and M. Qiaoyu. 2023. “Quaternion Convolutional Neural Networks for Hyperspectral Image Classification.” Engineering Applications of Artificial Intelligence 123: 106234. https://doi.org/10.1016/j.engappai.2023.106234.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.