85
Views
0
CrossRef citations to date
0
Altmetric
Research article

Convolutional transformer attention network with few-shot learning for grassland degradation monitoring using UAV hyperspectral imagery

ORCID Icon, &
Pages 2109-2135 | Received 31 Oct 2023, Accepted 20 Feb 2024, Published online: 11 Mar 2024

References

  • Abdulridha, J., A. Min, M. N. Rouse, S. Kianian, V. Isler, and C. Yang. 2023. “Evaluation of Stem Rust Disease in Wheat Fields by Drone Hyperspectral Imaging.” Sensors 23 (8): 4154. https://doi.org/10.3390/s23084154.
  • Chao, S., M. Shaohui, M. Mingyang, X. Fulin, Z. Yifan, and Q. Du. 2022. “Hyperspectral Image Classification Using Hierarchical Spatial-Spectral Transformer.” IGARSS 2022 – 2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 3584–3587. IEEE.
  • Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, et al. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” arXiv.Org. https://doi.org/10.48550/arXiv.2010.11929.
  • Du, B., L. Zhen, H. Yan, and D. de Groot. 2016. “Effects of Government Grassland Conservation Policy on Household Livelihoods and Dependence on Local Grasslands: Evidence from Inner Mongolia, China.” Sustainability 8 (12): 1314. https://doi.org/10.3390/su8121314.
  • Fang, X., and J. Wu. 2022. “Causes of Overgrazing in Inner Mongolian Grasslands: Searching for Deep Leverage Points of Intervention.” Ecology and Society 27 (1): 8. https://doi.org/10.5751/ES-12878-270108.
  • Fang, X., J. Wu, and C. He. 2021. “Assessing Human-Environment System Sustainability Based on Regional Safe and Just Operating Space: The Case of the Inner Mongolia Grassland.” Environmental Science & Policy 116:276–286. https://doi.org/10.1016/j.envsci.2020.12.007.
  • Gao, X., S. Dong, Y. Xu, S. Wu, X. Wu, X. Zhang, Y. Zhi, et al. 2019. “Resilience of Revegetated Grassland for Restoring Severely Degraded Alpine Meadows is Driven by Plant and Soil Quality Along Recovery Time: A Case Study from the Three-River Headwater Area of Qinghai-Tibetan Plateau.” Agriculture, Ecosystems and Environment 279:169–177. https://doi.org/10.1016/j.agee.2019.01.010.
  • Gao, H., M. Zhu, X. Wang, C. Li, and S. Xu. 2023. “Lightweight Spatial-Spectral Network Based on 3D-2D Multi-Group Feature Extraction Module for Hyperspectral Image Classification.” International Journal of Remote Sensing 44 (11): 3607–3634. https://doi.org/10.1080/01431161.2023.2224099.
  • Li, M., Y. Lu, S. Cao, X. Wang, and S. Xie. 2023. “A Hyperspectral Image Classification Method Based on the Nonlocal Attention Mechanism of a Multiscale Convolutional Neural Network.” Sensors 23 (6): 3190. https://doi.org/10.3390/s23063190.
  • Lin, Y., G. Han, M. Zhao, and S. X. Chang. 2010. “Spatial Vegetation Patterns as Early Signs of Desertification: A Case Study of a Desert Steppe in Inner Mongolia, China.” Landscape Ecology 25 (10): 1519–1527. https://doi.org/10.1007/s10980-010-9520-z.
  • Li, W., J. Wang, Y. Gao M. Zhang, R. Tao, and B. Zhang. 2022. “Graph-Feature-Enhanced Selective Assignment Network for Hyperspectral and Multispectral Data Classification.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3.
  • Li, Y., L. Zhang, and L. Chen. 2022. “Spectral-Spatial Hyperspectral Image Classification Based on Capsule Network with Limited Training Samples.” International Journal of Remote Sensing 43 (8): 3049–3081. https://doi.org/10.1080/01431161.2022.2083459.
  • Ma, Y., J. Wang, Y. Qu, B. Chu, Z. Tang, D. Bao, R. Hua, and L. Hua. 2022. “Habitat Characteristics of Rodents in Desert Steppe in the Middle Part of Northern Piedmont of Qilian Mountains.” Chinese Journal of Ecology 42 (8): 1911–1919. https://doi.org/10.13292/j.1000-4890.202308.008.
  • Pi, W., J. Du, Y. Bi, X. Gao, and X. Zhu. 2021. “3D-CNN Based UAV Hyperspectral Imagery for Grassland Degradation Indicator Ground Object Classification Research.” Ecological Informatics 62:101278. https://doi.org/10.1016/j.ecoinf.2021.101278.
  • Pi, W., J. Du, H. Liu, and X. Zhu. 2020. “Desertification Glassland Classification and Three-Dimensional Convolution Neural Network Model for Identifying Desert Grassland Landforms with Unmanned Aerial Vehicle Hyperspectral Remote Sensing Images.” Journal of Applied Spectroscopy 87 (2): 309–318. https://doi.org/10.1007/s10812-020-01001-6.
  • Qiu, X., J. Hou, N. Guo, Z. Wang, and C. Wang. 2022. “Seasonal Variations and Influencing Factors of Gross Nitrification Rate in Desert Steppe Soil.” Sustainability 14 (8): 4787. https://doi.org/10.3390/su14084787.
  • Song, Y., Z. Guo, Y. Lu, D. Yan, Z. Liao, H. Liu, and Y. Cui. 2017. “Pixel-Level Spatiotemporal Analyses of Vegetation Fractional Coverage Variation and Its Influential Factors in a Desert Steppe: A Case Study in Inner Mongolia, China.” Water 9 (7): 478. https://doi.org/10.3390/w9070478.
  • Song, Y., Y. Lu, T. Liu, H. Li, Z. Yue, H. Liu, and T. Gao. 2020. “Variation of Vegetation Fractional Coverage and Its Relationship with Climate in a Desert Steppe: Optimization of Farmland Layout in a Farming–Pastoral Ecotone Using the Ecological Suitability Index.” Ecological Engineering 150:105834. https://doi.org/10.1016/j.ecoleng.2020.105834.
  • Sun, L., G. Zhao, Y. Zheng, and Z. Wu. 2022. “Spectral-Spatial Feature Tokenization Transformer for Hyperspectral Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3144158.
  • Sun, H., X. Zheng, X. Lu, and S. Wu. 2020. “Spectral-Spatial Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 58 (5): 3232–3245. https://doi.org/10.1109/TGRS.2019.2951160.
  • Su, R., T. Yu, B. Dayananda, R. Bu, J. Su, and Q. Fan. 2020. “Impact of Climate Change on Primary Production of Inner Mongolian Grasslands.” Global Ecology and Conservation 22:e928. https://doi.org/10.1016/j.gecco.2020.e00928.
  • Tang, T., J. Liu, X. Luo, X. Gao, and X. Pan. 2022. “Triple-Branch Ternary-Attention Mechanism Network with Deformable 3D Convolution for Hyperspectral Image Classification.” International Journal of Remote Sensing 43 (12): 4352–4377. https://doi.org/10.1080/01431161.2022.2111666.
  • Tangud, T., K. Nasahara, H. Borjigin, and H. Bagan. 2019. “Land-Cover Change in the Wulagai Grassland, Inner Mongolia of China Between 1986 and 2014 Analysed Using Multi-Temporal Landsat Images.” Geocarto International 34 (11): 1237–1251. https://doi.org/10.1080/10106049.2018.1478457.
  • Tao, H., H. Feng, L. Xu, M. Miao, G. Yang, X. Yang, and L. Fan. 2020. “Estimation of the Yield and Plant Height of Winter Wheat Using UAV-Based Hyperspectral Images.” Sensors 20 (4): 1231. https://doi.org/10.3390/s20041231.
  • Tian, Y., H. Huang, G. Zhou, Q. Zhang, J. Tao, Y. Zhang, and J. Lin. 2021. “Aboveground Mangrove Biomass Estimation in Beibu Gulf Using Machine Learning and UAV Remote Sensing.” Science of the Total Environment 781:146816. https://doi.org/10.1016/j.scitotenv.2021.146816.
  • Wang, Y., and Y. Bi. 2022. “Simplified Learning Classification Model Based on UAV Hyperspectral Remote Sensing for Desert Steppe Terrain.” Transactions of the Chinese Society for Agricultural Machinery 53 (11): 236–243. https://doi.org/10.6041/j.issn.1000-1298.2022.11.023.
  • Wang, J., D. G. Brown, and A. Agrawal. 2013. “Climate Adaptation, Local Institutions, and Rural Livelihoods: A Comparative Study of Herder Communities in Mongolia and Inner Mongolia, China.” Global Environmental Change 23 (6): 1673–1683. https://doi.org/10.1016/j.gloenvcha.2013.08.014.
  • Wang, X., and J. Dong. 2020. “Estimation of the Aboveground Biomass of Desert Steppe and Typical Steppe in Inner Mongolia Using Generalized Linear Model.” Acta Agrestia Sinica 28 (6): 1711–1718. https://doi.org/10.11733/j.issn.1007-0435.2020.06.026.
  • Wang, J., W. Li, Y. Gao, M. Zhang, R. Tao, and Q. Du. 2023. “Hyperspectral and SAR Image Classification via Multiscale Interactive Fusion Network.” IEEE Transactions on Neural Networks and Learning Systems 34 (12): 10823–10837. https://doi.org/10.1109/TNNLS.2022.3171572.
  • Wang, Y., H. Li, J. Li, and X. Li. 2017. “The Diversity and Co-occurrence Patterns of Diazotrophs in the Steppes of Inner Mongolia.” Catena 157:130–138. https://doi.org/10.1016/j.catena.2017.05.006.
  • Wang, J., W. Li, M. Zhang, and J. Chanussot. 2023. “Large Kernel Sparse ConvNet Weighted by Multi-Frequency Attention for Remote Sensing Scene Understanding.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2023.3333401.
  • Wang, J., W. Li, M. Zhang, R. Tao, and J. Chanussot. 2023. “Remote-Sensing Scene Classification via Multistage Self-Guided Separation Network.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2023.3295797.
  • Xing, F., R. An, B. Wang, J. Miao, T. Jiang, X. Huang, and Y. Hu. 2021. “Mapping the Occurrence and Spatial Distribution of Noxious Weed Species with Multisource Data in Degraded Grasslands in the Three-River Headwaters Region, China.” Science of the Total Environment 801:149714. https://doi.org/10.1016/j.scitotenv.2021.149714.
  • Yang, H., J. Du, P. Ruan, X. Zhu, H. Liu, and Y. Wang. 2021. “Vegetation Classification of Desert Steppe Based on Unmanned Aerial Vehicle Remote Sensing and Random Forest.” Transactions of the Chinese Society for Agricultural Machinery 52 (6): 186–194. https://doi.org/10.6041/j.issn.1000-1298.2021.06.019.
  • Ye, R., G. Liu, H. Chang, Y. Shan, L. Mu, C. Wen, R. Te, et al. 2020. “Response of Plant Traits of Stipa Breviflora to Grazing Intensity and Fluctuation in Annual Precipitation in a Desert Steppe, Northern China.” Global Ecology and Conservation 24:e1237. https://doi.org/10.1016/j.gecco.2020.e01237.
  • Zhang, T., Y. Bi, J. Du, X. Zhu, and X. Gao. 2022. “Classification of Desert Grassland Species Based on a Local-Global Feature Enhancement Network and UAV Hyperspectral Remote Sensing.” Ecological Informatics 72:101852. https://doi.org/10.1016/j.ecoinf.2022.101852.
  • Zhang, T., Y. Bi, F. Hao, J. Du, X. Zhu, and X. Gao. 2022. “Transformer Attention Network and Unmanned Aerial Vehicle Hyperspectral Remote Sensing for Grassland Rodent Pest Monitoring Research.” Journal of Applied Remote Sensing 16 (4): 44525. https://doi.org/10.1117/1.JRS.16.044525.
  • Zhang, T., Y. Bi, X. Zhu, and X. Gao. 2023. “Identification and Classification of Small Sample Desert Grassland Vegetation Communities Based on Dynamic Graph Convolution and UAV Hyperspectral Imagery.” Sensors 23 (5): 2856. https://doi.org/10.3390/s23052856.
  • Zhang, T., and J. Du. 2022. “Research on Micro-patch Identification of Desert Grassland Based on UAV Remote Sensing.” Journal of Guangxi Normal University (Natural Science Edition) 40 (6): 50–58. https://doi.org/10.16088/j.issn.1001-6600.2022022303.
  • Zhang, T., J. Du, X. Zhu, and X. Gao. 2023. “Research on Grassland Rodent Infestation Monitoring Methods Based on Dense Residual Networks and Unmanned Aerial Vehicle Remote Sensing.” Journal of Applied Spectroscopy 89 (6): 1220–1231. https://doi.org/10.1007/s10812-023-01489-8.
  • Zhang, B., S. Li, C. Gu, M. Zhao, J. Zou, H. Duan, H. Liu, and J. Li. 2022. “Biomass Allocation of Four Dominant Plant Species in Inner Mongolia Desert Grasslands in Response to Different Grazing Intensities.” Acta Agrectir Sinica 30 (12): 3355–3363. https://doi.org/10.11733/j.issn.1007-0435.2022.12.022.
  • Zhang, M., W. Li, X. Zhao, H. Liu, R. Tao, and Q. Du. 2023. “Morphological Transformation and Spatial-Logical Aggregation for Tree Species Classification Using Hyperspectral Imagery.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2022.3233847.
  • Zhang, J., Z. Meng, F. Zhao, H. Liu, and Z. Chang. 2022. “Convolution Transformer Mixer for Hyperspectral Image Classification.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3208935.
  • Zhang, X., S. Shang, X. Tang, J. Feng, and L. Jiao. 2022. “Spectral Partitioning Residual Network with Spatial Attention Mechanism for Hyperspectral Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2021.3074196.
  • Zhang, G., X. Sui, Y. Li, M. Jia, Z. Wang, G. Han, and L. Wang. 2020. “The Response of Soil Nematode Fauna to Climate Drying and Warming in Stipa Breviflora Desert Steppe in Inner Mongolia, China.” Journal of Soils and Sediments 20 (4): 2166–2180. https://doi.org/10.1007/s11368-019-02555-5.
  • Zhang, R., Z. Wang, G. Han, M. P. Schellenberg, Q. Wu, and C. Gu. 2018. “Grazing Induced Changes in Plant Diversity is a Critical Factor Controlling Grassland Productivity in the Desert Steppe, Northern China.” Agriculture, Ecosystems and Environment 265:73–83. https://doi.org/10.1016/j.agee.2018.05.014.
  • Zhao, Z., D. Hu, H. Wang, and X. Yu. 2022. “Convolutional Transformer Network for Hyperspectral Image Classification.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3169815.
  • Zhao, W., D. Wu, and Y. Liu. 2021. “Hyperspectral Image Classification with Multi-Scale Graph Convolution Network.” International Journal of Remote Sensing 42 (21): 8380–8397. https://doi.org/10.1080/01431161.2021.1978585.
  • Zhu, X., Y. Bi, J. Du, X. Gao, T. Zhang, W. Pi, Y. Zhang, Y. Wang, and H. Zhang. 2023. “Research on Deep Learning Method Recognition and a Classification Model of Grassland Grass Species Based on Unmanned Aerial Vehicle Hyperspectral Remote Sensing.” Grassland Science 69 (1): 3–11. https://doi.org/10.1111/grs.12379.
  • Zhu, M., L. Jiao, F. Liu, S. Yang, and J. Wang. 2021. “Residual Spectral-Spatial Attention Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 59 (1): 449–462. https://doi.org/10.1109/TGRS.2020.2994057.
  • Zuo, X., W. Mao, H. Qu, M. Chen, S. Zhao, L. Liu, S. Wang, et al. 2021. “Scale Effects on Spatial Heterogeneity of Herbaceous Vegetation in Desert Steppe Depend on Plant Community Type.” Ecological Indicators 127:107769. https://doi.org/10.1016/j.ecolind.2021.107769.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.