140
Views
0
CrossRef citations to date
0
Altmetric
Research article

Multi-scale fusion for few-shot remote sensing image classification

, , , & ORCID Icon
Pages 6012-6032 | Received 22 May 2023, Accepted 06 Sep 2023, Published online: 28 Sep 2023

References

  • Alajaji, D., H. S. Alhichri, N. Ammour, and N. Alajlan. 2020. “Few-Shot Learning for Remote Sensing Scene Classification.” In 2020 Mediterranean and Middle-East Geoscience and Remote Sensing Symposium (M2GARSS), 81–84. IEEE.
  • Bachman, P., A. Sordoni, and A. Trischler. 2017. “Learning Algorithms for Active Learning.” In international conference on machine learning, 301–310. PMLR.
  • Bazi, Y., L. Bashmal, M. M. Al Rahhal, R. Al Dayil, and N. Al Ajlan. 2021. “Vision Transformers for Remote Sensing Image Classification.” Remote Sensing 13 (3): 516. https://doi.org/10.3390/rs13030516.
  • Cheng, G., L. Cai, C. Lang, X. Yao, J. Chen, L. Guo, and J. Han. 2021. “SPNet: Siamese-Prototype Network for Few-Shot Remote Sensing Image Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–11. https://doi.org/10.1109/TGRS.2021.3099033.
  • Cheng, G., J. Han, and L. Xiaoqiang. 2017. “Remote Sensing Image Scene Classification: Benchmark and State of the Art.” Proceedings of the IEEE 105 (10): 1865–1883. https://doi.org/10.1109/JPROC.2017.2675998.
  • Cheng, G., X. Xie, J. Han, L. Guo, and G.-S. Xia. 2020. “Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:3735–3756. https://doi.org/10.1109/JSTARS.2020.3005403.
  • Cheng, G., C. Yang, X. Yao, L. Guo, and J. Han. 2018. “When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs.” IEEE Transactions on Geoscience and Remote Sensing 56 (5): 2811–2821. https://doi.org/10.1109/TGRS.2017.2783902.
  • Deng, P., X. Kejie, and H. Huang. 2021. “When CNNs Meet Vision Transformer: A Joint Framework for Remote Sensing Scene Classification.” IEEE Geoscience and Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2021.3109061.
  • Du, L., L. Li, Y. Guo, Y. Wang, K. Ren, and J. Chen. 2021. “Two-Stream Deep Fusion Network Based on VAE and CNN for Synthetic Aperture Radar Target Recognition.” Remote Sensing 13 (20): 4021. https://doi.org/10.3390/rs13204021.
  • Finn, C., P. Abbeel, and S. Levine. 2017. “Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks.” In International conference on machine learning, 1126–1135. PMLR.
  • Gatys, L. A., A. S. Ecker, and M. Bethge. 2016. “Image Style Transfer Using Convolutional Neural Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2414–2423.
  • Geng, J., X. Deng, M. Xiaorui, and W. Jiang. 2020. “Transfer Learning for SAR Image Classification via Deep Joint Distribution Adaptation Networks.” IEEE Transactions on Geoscience and Remote Sensing 58 (8): 5377–5392. https://doi.org/10.1109/TGRS.2020.2964679.
  • Huang, K., J. Geng, W. Jiang, X. Deng, and X. Zhe 2021. “Pseudo-Loss Confidence Metric for Semi-Supervised Few-Shot Learning.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 8671–8680.
  • Huang, J., V. Rathod, C. Sun, M. Zhu, A. Korattikara, A. Fathi, I. Fischer, et al. 2017. “Speed/Accuracy Trade-Offs for Modern Convolutional Object Detectors.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 7310–7311.
  • Huang, W., Z. Yuan, A. Yang, C. Tang, and X. Luo. 2021. “TAE-Net: Task-Adaptive Embedding Network for Few-Shot Remote Sensing Scene Classification.” Remote Sensing 14 (1): 111. https://doi.org/10.3390/rs14010111.
  • Jahromi, M. N., M. Naghdyzadegan Jahromi, H. Reza Pourghasemi, S. Zand-Parsa, and S. Jamshidi. 2021. “Accuracy Assessment of Forest Mapping in MODIS Land Cover Dataset Using Fuzzy Set Theory.“ In Forest Resources Resilience and Conflicts, edited by P. Kumar Shit, H. Reza Pourghasemi, P. Pratim Adhikary, G. Sankar Bhunia, and V. Prasad Sati, 165–183. Elsevier. https://doi.org/10.1016/B978-0-12-822931-6.00012-5.
  • Jégou, H., M. Douze, C. Schmid, and P. Pérez. 2010. “Aggregating Local Descriptors into a Compact Image Representation.” In 2010 IEEE computer society conference on computer vision and pattern recognition, 3304–3311. IEEE.
  • Keshari, R., M. Vatsa, R. Singh, and A. Noore. 2018. “Learning Structure and Strength of CNN Filters for Small Sample Size Training.” In proceedings of the IEEE conference on computer vision and pattern recognition, 9349–9358.
  • Li, H., Z. Cui, Z. Zhu, L. Chen, J. Zhu, H. Huang, and C. Tao. 2020. “RS-Metanet: Deep Meta Metric Learning for Few-Shot Remote Sensing Scene Classification.” arXiv preprint arXiv:2009.13364.
  • Li, L., J. Han, X. Yao, G. Cheng, and L. Guo. 2020. “DLA-Matchnet for Few-Shot Remote Sensing Image Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (9): 7844–7853. https://doi.org/10.1109/TGRS.2020.3033336.
  • Li, X., D. Shi, X. Diao, and X. Hao. 2021. “SCL-MLNet: Boosting Few-Shot Remote Sensing Scene Classification via Self-Supervised Contrastive Learning.” IEEE Transactions on Geoscience and Remote Sensing 60:1–12. https://doi.org/10.1109/TGRS.2021.3109268.
  • Liu, Y., J. Lee, M. Park, S. Kim, E. Yang, S. Ju Hwang, and Y. Yang. 2018. “Learning to Propagate Labels: Transductive Propagation Network for Few-Shot Learning.” arXiv preprint arXiv:1805.10002.
  • Liu, H., L. Wei, X.-G. Xia, M. Zhang, C.-Z. Gao, and R. Tao. 2022. “Central Attention Network for Hyperspectral Imagery Classification.” IEEE Transactions on Neural Networks and Learning Systems.
  • Li, Z., F. Zhou, F. Chen, and L. Hang 2017. “Meta-Sgd: Learning to Learn Quickly for Few-Shot Learning.” arXiv preprint arXiv:1707.09835.
  • Ma, C., M. Xiaodong, P. Zhao, and X. Yan. 2021. “Meta-Learning Based on Parameter Transfer for Few-Shot Classification of Remote Sensing Scenes.” Remote Sensing Letters 12 (6): 531–541. https://doi.org/10.1080/2150704X.2021.1903609.
  • Nichol, A., J. Achiam, and J. Schulman. 2018. “On First-Order Meta-Learning Algorithms.” arXiv preprint arXiv:1803.02999.
  • Noothout, J. M., B. D. De Vos, J. M. Wolterink, E. M. Postma, P. A. Smeets, R. A. Takx, T. Leiner, M. A. Viergever, and I. Išgum. 2020. “Deep Learning-Based Regression and Classification for Automatic Landmark Localization in Medical Images.” IEEE Transactions on Medical Imaging 39 (12): 4011–4022. https://doi.org/10.1109/TMI.2020.3009002.
  • Pahde, F., M. Puscas, T. Klein, and M. Nabi. 2021. “Multimodal Prototypical Networks for Few-Shot Learning.” In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2644–2653.
  • Peng, Y., Y. Liu, T. Bing, and Y. Zhang. 2023. “Convolutional Transformer-Based Few-Shot Learning for Cross-Domain Hyperspectral Image Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 16:1335–1349. https://doi.org/10.1109/JSTARS.2023.3234302.
  • Pires de Lima, R., and K. Marfurt. 2019. “Convolutional Neural Network for Remote-Sensing Scene Classification: Transfer Learning Analysis.” Remote Sensing 12 (1): 86. https://doi.org/10.3390/rs12010086.
  • Ran, Q., Y. Zhou, D. Hong, B. Meiqiao, L. Ni, L. Xuan, and M. Ahmad. 2023. “Deep Transformer and Few-Shot Learning for Hyperspectral Image Classification.” CAAI Transactions on Intelligence Technology. https://doi.org/10.1049/cit2.12181.
  • Ren, M., E. Triantafillou, S. Ravi, J. Snell, K. Swersky, J. B. Tenenbaum, H. Larochelle, and R. S. Zemel. 2018. “Meta-Learning for Semi-Supervised Few-Shot Classification.” arXiv preprint arXiv:1803.00676.
  • Rodríguez, P., I. Laradji, A. Drouin, and A. Lacoste. 2020. “Embedding Propagation: Smoother Manifold for Few-Shot Classification.” In European Conference on Computer Vision, 121–138. Springer.
  • Russakovsky, O., J. Deng, S. Hao, J. Krause, S. Satheesh, M. Sean, Z. Huang, et al. 2015. “Imagenet Large Scale Visual Recognition Challenge.” International Journal of Computer Vision 115 (3): 211–252. https://doi.org/10.1007/s11263-015-0816-y
  • Rusu, A. A., D. Rao, J. Sygnowski, O. Vinyals, R. Pascanu, S. Osindero, and R. Hadsell. 2018. “Meta-Learning with Latent Embedding Optimization.” arXiv preprint arXiv:1807.05960.
  • Sheng, G., W. Yang, X. Tao, and H. Sun. 2012. “High-Resolution Satellite Scene Classification Using a Sparse Coding Based Multiple Feature Combination.” International Journal of Remote Sensing 33 (8): 2395–2412. https://doi.org/10.1080/01431161.2011.608740.
  • Shi, C., X. Zhao, and L. Wang. 2021. “A Multi-Branch Feature Fusion Strategy Based on an Attention Mechanism for Remote Sensing Image Scene Classification.” Remote Sensing 13 (10): 1950. https://doi.org/10.3390/rs13101950.
  • Snell, J., K. Swersky, and R. Zemel. 2017. “Prototypical Networks for Few-Shot Learning.” Advances in Neural Information Processing Systems 30.
  • Sung, F., Y. Yang, L. Zhang, T. Xiang, P. H. Torr, and T. M. Hospedales. 2018. “Learning to Compare: Relation Network for Few-Shot Learning.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 1199–1208.
  • Sun, X., L. Yixuan, Z. Wang, and F. Kun. 2022. “SCAN: Scattering Characteristics Analysis Network for Few-Shot Aircraft Classification in High-Resolution SAR Images.” IEEE Transactions on Geoscience and Remote Sensing 60:1–17. https://doi.org/10.1109/TGRS.2022.3231215.
  • Tai, X., L. Mingjie, M. Xiang, and P. Ren. 2021. “A Mutual Guide Framework for Training Hyperspectral Image Classifiers with Small Data.” IEEE Transactions on Geoscience and Remote Sensing 60:1–17. https://doi.org/10.1109/TGRS.2021.3092351.
  • Tang, X., M. Qiushuo, X. Zhang, F. Liu, M. Jingjing, and L. Jiao. 2021. “Attention Consistent Network for Remote Sensing Scene Classification.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 14:2030–2045. https://doi.org/10.1109/JSTARS.2021.3051569.
  • Tian, T., X. Liu, and L. Wang. 2019. “Remote Sensing Scene Classification Based on Res-Capsnet.” In IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, 525–528. IEEE.
  • Vinyals, O., C. Blundell, T. Lillicrap, K. Kavukcuoglu, D. Wierstra et al. 2016. “Matching Networks for One Shot Learning.” Advances in Neural Information Processing Systems 29. https://proceedings.neurips.cc/paper_files/paper/2016/file/90e1357833654983612fb05e3ec9148c-Paper.pdf.
  • Wang, Y., X. Chengming, C. Liu, L. Zhang, and F. Yanwei 2020. “Instance Credibility Inference for Few-Shot Learning.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 12836–12845.
  • Wang, K., X. Wang, and Y. Cheng. 2022. “Few-Shot Aerial Image Classification with Deep Economic Network and Teacher Knowledge.” International Journal of Remote Sensing 43 (13): 5075–5099. https://doi.org/10.1080/01431161.2022.2128926.
  • Wang, J., J. Yang, Y. Kai, L. Fengjun, T. Huang, and Y. Gong. 2010. “Locality-Constrained Linear Coding for Image Classification.” In 2010 IEEE computer society conference on computer vision and pattern recognition, 3360–3367. IEEE.
  • Wu, B., D. Meng, and H. Zhao. 2021. “Semi-Supervised Learning for Seismic Impedance Inversion Using Generative Adversarial Networks.” Remote Sensing 13 (5): 909. https://doi.org/10.3390/rs13050909.
  • Xia, G.-S., H. Jingwen, H. Fan, B. Shi, X. Bai, Y. Zhong, L. Zhang, and L. Xiaoqiang. 2017. “AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 55 (7): 3965–3981. https://doi.org/10.1109/TGRS.2017.2685945.
  • Xu, Z., L. Cao, and X. Chen. 2019. “Learning to Learn: Hierarchical Meta-Critic Networks.” Institute of Electrical and Electronics Engineers Access 7:57069–57077. https://doi.org/10.1109/ACCESS.2019.2914469.
  • Xu, P., L. Qingyang, B. Zhang, W. Fan, K. Zhao, D. Xin, C. Yang, and R. Zhong. 2021. “On-Board Real-Time Ship Detection in HISEA-1 SAR Images Based on CFAR and Lightweight Deep Learning.” Remote Sensing 13 (10): 1995. https://doi.org/10.3390/rs13101995.
  • Yang, Y., and S. Newsam. 2010. “Bag-Of-Visual-Words and Spatial Extensions for Land-Use Classification.” In Proceedings of the 18th SIGSPATIAL international conference on advances in geographic information systems, 270–279.
  • Yang, L., and J. Yang. 2021. “Meta-Learning Baselines and Database for Few-Shot Classification in Agriculture.” Computers and Electronics in Agriculture 182:106055. https://doi.org/10.1016/j.compag.2021.106055.
  • Ying, W., Y. Zhang, J. Huang, and Q. Yang. 2018. “Transfer Learning via Learning to Transfer.” In International Conference on Machine Learning, 5085–5094. PMLR.
  • Yuan, Z., W. Huang, L. Lin, and X. Luo. 2020. “Few-Shot Scene Classification with Multi-Attention Deepemd Network in Remote Sensing.” Institute of Electrical and Electronics Engineers Access 9:19891–19901. https://doi.org/10.1109/ACCESS.2020.3044192.
  • Yuan, Z., W. Huang, C. Tang, A. Yang, and X. Luo. 2022. “Graph-Based Embedding Smoothing Network for Few-Shot Scene Classification of Remote Sensing Images.” Remote Sensing 14 (5): 1161. https://doi.org/10.3390/rs14051161.
  • Yue, X., Z. Zheng, S. Zhang, Y. Gao, T. Darrell, K. Keutzer, and A. Sangiovanni Vincentelli. 2021. “Prototypical Cross-Domain Self-Supervised Learning for Few-Shot Unsupervised Domain Adaptation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13834–13844.
  • Zamir, A. R., A. Sax, W. Shen, L. J. Guibas, J. Malik, and S. Savarese. 2018. “Taskonomy: Disentangling Task Transfer Learning.” In Proceedings of the IEEE conference on computer vision and pattern recognition, 3712–3722.
  • Zeng, Q., J. Geng, K. Huang, W. Jiang, and J. Guo. 2021. “Prototype Calibration with Feature Generation for Few-Shot Remote Sensing Image Scene Classification.” Remote Sensing 13 (14): 2728. https://doi.org/10.3390/rs13142728.
  • Zeng, Q., J. Geng, W. Jiang, K. Huang, and Z. Wang. 2021. “IDLN: Iterative Distribution Learning Network for Few-Shot Remote Sensing Image Scene Classification.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3224452.
  • Zhai, M., H. Liu, and F. Sun. 2019. “Lifelong Learning for Scene Recognition in Remote Sensing Images.” IEEE Geoscience and Remote Sensing Letters 16 (9): 1472–1476. https://doi.org/10.1109/LGRS.2019.2897652.
  • Zhang, C., Y. Cai, G. Lin, and C. Shen. 2020. “Deepemd: Few-Shot Image Classification with Differentiable Earth Mover’s Distance and Structured Classifiers.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 12203–12213.
  • Zhang, Y., L. Wei, W. Sun, R. Tao, and D. Qian. 2023. “Single-Source Domain Expansion Network for Cross-Scene Hyperspectral Image Classification.” IEEE Transactions on Image Processing 32:1498–1512. https://doi.org/10.1109/TIP.2023.3243853.
  • Zhang, M., L. Wei, Y. Zhang, R. Tao, and D. Qian 2022. “Hyperspectral and LiDar Data Classification Based on Structural Optimization Transmission.” In IEEE Transactions on Cybernetics.
  • Zhu, P., L. Zhang, Y. Wang, J. Mei, G. Zhou, F. Liu, W. Liu, and P. Takis Mathiopoulos. 2018. “Projection Learning with Local and Global Consistency Constraints for Scene Classification.” Isprs Journal of Photogrammetry & Remote Sensing 144:202–216. https://doi.org/10.1016/j.isprsjprs.2018.07.004.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.