A multitemporal snow-covered remote sensing image matching method considering global and contextual features

References

• Bousbaa, M., A. Htitiou, A. Boudhar, Y. Eljabiri, H. Elyoussfi, H. Bouamri, H. Ouatiki, and A. Chehbouni. 2022. “High-Resolution Monitoring of the Snow Cover on the Moroccan Atlas Through the Spatio-Temporal Fusion of Landsat and Sentinel-2 Images.” Remote Sensing 14 (22): 5814.
   Web of Science ®Google Scholar
• Cannistra, A. F., D. E. Shean, and N. C. Cristea. 2021. “High-Resolution CubeSat Imagery and Machine Learning for Detailed Snow-Covered Area.” Remote Sensing of Environment 258:112399.
   Web of Science ®Google Scholar
• Chen, Y., H. Wang, Y. Pang, J. Han, E. Mou, and E. Cao. 2023. “An Infrared Small Target Detection Method Based on a Weighted Human Visual Comparison Mechanism for Safety Monitoring.” Remote Sensing 15 (11): 2922.
   Web of Science ®Google Scholar
• Cui, S., M. Ailong, L. Zhang, X. Miaozhong, and Y. Zhong. 2021. “MAP-Net: SAR and Optical Image Matching via Image-Based Convolutional Network with Attention Mechanism and Spatial Pyramid Aggregated Pooling.” IEEE Transactions on Geoscience & Remote Sensing 60:1–13.
   Web of Science ®Google Scholar
• Dellinger, F., J. Delon, Y. Gousseau, J. Michel, and F. Tupin. 2014. “SAR-SIFT: A SIFT-Like Algorithm for SAR Images.” IEEE Transactions on Geoscience & Remote Sensing 53 (1): 453–466.
   Web of Science ®Google Scholar
• Deng, Y., and M. Jiayi. 2022. “ReDfeat: Recoupling Detection and Description for Multimodal Feature Learning.” IEEE Transactions on Image Processing 32:591–602.
   Web of Science ®Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, and S. Gelly. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” ICLR.
   Google Scholar
• Dusmanu, M., I. Rocco, T. Pajdla, M. Pollefeys, J. Sivic, A. Torii, and T. Sattler. 2019. “D2-Net: A Trainable Cnn for Joint Description and Detection of Local Features.” Paper presented at the Proceedings of the ieee/cvf conference on computer vision and pattern recognition, Long Beach, CA, USA, 8084–8093.
   Google Scholar
• Famao, Y., S. Yanfei, H. Xiao, X. Zhao, and W. Min. 2018. “Remote Sensing Image Registration Using Convolutional Neural Network Features.” IEEE Geoscience & Remote Sensing Letters 15 (2): 232–236.
   Web of Science ®Google Scholar
• Gregorio, D., M. C. Ludovica, C. Marin, M. Zebisch, L. Bruzzone, B. Demir, U. Strasser, T. Marke, D. Günther, and R. Nadalet. 2019. “A novel data fusion technique for snow cover retrieval.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 12 (8): 2862–2877.
   Web of Science ®Google Scholar
• Hong, D., L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot. 2020. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 59 (7): 5966–5978.
   Web of Science ®Google Scholar
• Hong, D., L. Gao, N. Yokoya, J. Yao, J. Chanussot, D. Qian, and B. Zhang. 2020. “More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification.” IEEE Transactions on Geoscience & Remote Sensing 59 (5): 4340–4354.
   Web of Science ®Google Scholar
• Huang, Q., G. Jin, X. Xiong, Y. Hao, and Y. Xie. 2023. “Monitoring Urban Change in Conflict from the Perspective of Optical and SAR Satellites: The Case of Mariupol, a City in the Conflict Between RUS and UKR.” Remote Sensing 15 (12): 3096.
   Web of Science ®Google Scholar
• Jiang, X., M. Jiayi, G. Xiao, Z. Shao, and X. Guo. 2021. “A Review of Multimodal Image Matching: Methods and Applications.” Information Fusion 73:22–71.
   Web of Science ®Google Scholar
• Jiayi, M., and Y. Deng. 2021. “SDGMNet: Statistic-Based Dynamic Gradient Modulation for Local Descriptor Learning.” arXiv preprint arXiv:2106.04434.
   Google Scholar
• Jiayi, M., X. Jiang, A. Fan, J. Jiang, and J. Yan. 2021. “Image Matching from Handcrafted to Deep Features: A Survey.” International Journal of Computer Vision 129:23–79.
   Web of Science ®Google Scholar
• Jiayuan, L., P. Shi, H. Qingwu, and Y. Zhang. 2023. “RIFT2: Speeding-Up RIFT with a New Rotation-Invariance Technique.” arXiv preprint arXiv:2303.00319.
   Google Scholar
• Jinlong, L., X. Yuan, L. Jinfeng, G. Huang, L. Feng, and J. Zhang. 2023. “MV-CDN: Multi-Visual Collaborative Deep Network for Change Detection of Double-Temporal Hyperspectral Images.” Remote Sensing 15 (11): 2834.
   Web of Science ®Google Scholar
• Kai, H., E. Zhang, M. Xia, L. Weng, and H. Lin. 2023. “Mcanet: A Multi-Branch Network for Cloud/Snow Segmentation in High-Resolution Remote Sensing Images.” Remote Sensing 15 (4): 1055.
   Web of Science ®Google Scholar
• Kern, J. P., and M. S. Pattichis. 2007. “Robust multispectral image registration using mutual-information models.” IEEE Transactions on Geoscience & Remote Sensing 45 (5): 1494–1505.
   Web of Science ®Google Scholar
• Kingma, D. P., and B. Jimmy. 2014. “Adam: A Method for Stochastic Optimization.” arXiv preprint arXiv:1412.6980.
   Google Scholar
• Kumar, B. V., G. Carneiro, and I. Reid. 2016. “Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by Minimising Global Loss Functions.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR.
   Google Scholar
• Kun, H., L. Yan, and S. Sclaroff. 2018. “Local descriptors optimized for average precision.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, CVPR.
   Google Scholar
• LeCun, Y., Y. Bengio, and G. Hinton. 2015. “Deep learning.” Nature 521 (7553): 436–444.
   PubMed Web of Science ®Google Scholar
• Liao, Y., D. Yide, H. Zhou, L. Anran, J. Liu, L. Mingyu, and Q. Duan. 2021. “Feature Matching and Position Matching Between Optical and SAR with Local Deep Feature Descriptor.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 15:448–462.
   Web of Science ®Google Scholar
• Lowe, D. G. 1999. “Object recognition from local scale-invariant features.” Paper presented at the Proceedings of the seventh IEEE international conference on computer vision, Kerkyra, Greece.
   Google Scholar
• Martinez, A., J. Garcia-Consuegra, and F. Abad. 1999. “A Correlation-Symbolic Approach to Automatic Remotely Sensed Image Rectification.” Paper presented at the IEEE 1999 International Geoscience and Remote Sensing Symposium, Hamburg, Germany.
   Google Scholar
• Mikolajczyk, K., and C. Schmid. 2005. “A performance evaluation of local descriptors.” IEEE Transactions on Pattern Analysis & Machine Intelligence 27 (10): 1615–1630.
   PubMed Web of Science ®Google Scholar
• Mishchuk, A., D. Mishkin, F. Radenovic, and J. Matas. 2017. “Working Hard to Know Your Neighbor’s Margins: Local Descriptor Learning Loss.” Advances in Neural Information Processing Systems 30.
   Google Scholar
• Nie, H., F. Zhitao, B.-H. Tang, L. Ziqian, S. Chen, and L. Wang. 2022. “A Dual-Generator Translation Network Fusing Texture and Structure Features for SAR and Optical Image Matching.” Remote Sensing 14 (12): 2946.
   Web of Science ®Google Scholar
• Paszke, A., S. Gross, F. Massa, A. Lerer, J. Bradbury, G. Chanan, T. Killeen, Z. Lin, N. Gimelshein, and L. Antiga. 2019. “Pytorch: An Imperative Style, High-Performance Deep Learning Library.” Advances in Neural Information Processing Systems 32.
   Google Scholar
• Premier, V., C. Marin, S. Steger, C. Notarnicola, and L. Bruzzone. 2021. “A Novel Approach Based on a Hierarchical Multiresolution Analysis of Optical Time Series to Reconstruct the Daily High-Resolution Snow Cover Area.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 14:9223–9240.
   Web of Science ®Google Scholar
• Quan, D., S. Wang, N. Huyan, Y. Li, R. Lei, J. Chanussot, B. Hou, and L. Jiao. 2022. “A Concurrent Multiscale Detector for End-to-End Image Matching.” IEEE transactions on neural networks and learning systems.
   Google Scholar
• Rao, Y., W. Dan, M. Han, T. Wang, Y. Yang, T. Lei, C. Zhou, H. Bai, and L. Xing. 2023. “AT-GAN: A Generative Adversarial Network with Attention and Transition for Infrared and Visible Image Fusion.” Information Fusion 92:336–349.
   Web of Science ®Google Scholar
• Reddy, B. S., and B. N. Chatterji. 1996. “An FFT-based technique for translation, rotation, and scale-invariant image registration.” IEEE Transactions on Image Processing 5 (8): 1266–1271.
   PubMed Web of Science ®Google Scholar
• Revaud, J., P. Weinzaepfel, C. De Souza, N. Pion, G. Csurka, Y. Cabon, and M. Humenberger. 2019. “R2D2: repeatable and reliable detector and descriptor.“ Advances in neural information processing systems.
   Google Scholar
• Sommervold, O., M. Gazzea, and R. Arghandeh. 2023. “A Survey on Sar and Optical Satellite Image Registration.” Remote Sensing 15 (3): 850.
   Web of Science ®Google Scholar
• Tian, Y., B. Fan, and W. Fuchao 2017. “L2-net: Deep learning of discriminative patch descriptor in euclidean space.” Paper presented at the Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI.
   Google Scholar
• Wang, Y., G. Lingjia, L. Xiaofeng, F. Gao, T. Jiang, and R. Ren. 2022. “An Improved Spatiotemporal Fusion Algorithm for Monitoring Daily Snow Cover Changes with High Spatial Resolution.” IEEE Transactions on Geoscience & Remote Sensing 60:1–17.
   Web of Science ®Google Scholar
• Wang, S., D. Quan, X. Liang, M. Ning, Y. Guo, and L. Jiao. 2018. “A Deep Learning Framework for Remote Sensing Image Registration.” Isprs Journal of Photogrammetry & Remote Sensing 145:148–164.
   Web of Science ®Google Scholar
• Wang, C., X. Rongtao, K. Lv, X. Shibiao, W. Meng, Y. Zhang, B. Fan, and X. Zhang. 2023. “Attention Weighted Local Descriptors.” IEEE Transactions on Pattern Analysis and Machine Intelligence 45:10632–10649.
   Google Scholar
• Wenping, M., Z. Wen, W. Yue, L. Jiao, M. Gong, Y. Zheng, and L. Liu. 2016. “Remote Sensing Image Registration with Modified SIFT and Enhanced Feature Matching.” IEEE Geoscience & Remote Sensing Letters 14 (1): 3–7.
   Web of Science ®Google Scholar
• Xiang, Y., F. Wang, and H. You. 2018. “OS-SIFT: A Robust SIFT-Like Algorithm for High-Resolution Optical-To-SAR Image Registration in Suburban Areas.” IEEE Transactions on Geoscience & Remote Sensing 56 (6): 3078–3090.
   Web of Science ®Google Scholar
• Xiang, D., Y. Xie, J. Cheng, X. Yihao, H. Zhang, and Y. Zheng. 2022. “Optical and SAR Image Registration Based on Feature Decoupling Network.” IEEE Transactions on Geoscience & Remote Sensing 60:1–13.
   Web of Science ®Google Scholar
• Xie, H., Y. Zhang, J. Qiu, X. Zhai, X. Liu, Y. Yang, S. Zhao, Y. Luo, and J. Zhong. 2023. “Semantics Lead All: Towards Unified Image Registration and Fusion from a Semantic Perspective.” Information Fusion 98:101835.
   Web of Science ®Google Scholar
• Yingxiao, X., L. Jun, D. Chun, and H. Chen. 2022. “NBR-Net: A Nonrigid Bidirectional Registration Network for Multitemporal Remote Sensing Images.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15.
   Web of Science ®Google Scholar
• Yuanxin, Y., L. Bruzzone, J. Shan, F. Bovolo, and Q. Zhu. 2019. “Fast and Robust Matching for Multimodal Remote Sensing Image Registration.” IEEE Transactions on Geoscience & Remote Sensing 57 (11): 9059–9070.
   Web of Science ®Google Scholar
• Yuanxin, Y., J. Shan, L. Bruzzone, and L. Shen. 2017. “Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity.” IEEE Transactions on Geoscience & Remote Sensing 55 (5): 2941–2958.
   Web of Science ®Google Scholar
• Yuanxin, Y., T. Tang, B. Zhu, C. Yang, B. Li, and S. Hao. 2022. “A Multiscale Framework with Unsupervised Learning for Remote Sensing Image Registration.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15.
   Web of Science ®Google Scholar
• Zhang, S., Z. Fu, J. Liu, X. Su, B. Luo, H. Nie, and B. H. Tang. 2023. “Multilevel Attention Siamese Network for Keypoint Detection in Optical and SAR Images.” IEEE Transactions on Geoscience & Remote Sensing 61:1–17. https://doi.org/10.1109/TGRS.2023.3293143.
   Web of Science ®Google Scholar
• Zhang, X., F. X. Yu, S. Kumar, and S.-F. Chang. 2017. “Learning spread-out local feature descriptors.” Paper presented at the Proceedings of the IEEE international conference on computer vision, Venice, Italy.
   Google Scholar
• Zhu, H., L. Jiao, M. Wenping, F. Liu, and W. Zhao. 2019. “A Novel Neural Network for Remote Sensing Image Matching.” IEEE Transactions on Neural Networks and Learning Systems 30 (9): 2853–2865.
   PubMed Web of Science ®Google Scholar
• Zhu, X. X., D. Tuia, L. Mou, G.-S. Xia, L. Zhang, X. Feng, and F. Fraundorfer. 2017. “Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources.” IEEE Geoscience and Remote Sensing Magazine 5 (4): 8–36.
   Web of Science ®Google Scholar