Progressive matching method of aerial-ground remote sensing image via multi-scale context feature coding

References

• Bay, H., T. Tuytelaars, and L. Van Gool. 2006. “SURF: Speeded Up Robust Features.” In Computer Vision–ECCV 2006: 9th European Conference on Computer Vision, Graz, Austria, May 7-13, 2006. Proceedings, Part I 9 404–417. Springer Berlin Heidelberg. https://doi.org/10.1007/1174402332.
   Google Scholar
• Castillo-Carrión, S., and J.-E. Guerrero-Ginel. 2017. “Autonomous 3D Metric Reconstruction from Uncalibrated Aerial Images Captured from UAVs.” International Journal of Remote Sensing 38 (8–10): 3027–3053. https://doi.org/10.1080/01431161.2017.1285087.
   Web of Science ®Google Scholar
• Cheng, M.-L., and M. Matsuoka. 2021. “Extracting Three-Dimensional (3D) Spatial Information from Sequential Oblique Unmanned Aerial System (UAS) Imagery for Digital Surface Modeling.” International Journal of Remote Sensing 42 (5): 1643–1663. https://doi.org/10.1080/01431161.2020.1842538.
   Web of Science ®Google Scholar
• Chen, L., F. Rottensteiner, and C. Heipke. 2021. “Feature Detection and Description for Image Matching: From Hand-Crafted Design to Deep Learning.” Geo-Spatial Information Science 24 (1): 58–74. https://doi.org/10.1080/10095020.2020.1843376.
   Web of Science ®Google Scholar
• Deng, H., T. Birdal, and S. Ilic. 2018. “PPFNet: Global Context Aware Local Features for Robust 3D Point Matching.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA, 195–205.
   Google Scholar
• Deng, L., and Y. Dong. 2014. “Deep Learning: Methods and Applications.” Foundations and trends® in Signal Processing 7 (3–4): 197–387. https://doi.org/10.1561/2000000039.
   Google Scholar
• Deng, J., W. Dong, R. Socher, L. Li-Jia, L. Kai, and L. Fei-Fei. 2009. “ImageNet: A Large-Scale Hierarchical Image Database.” In 2009 IEEE conference on computer vision and pattern recognition, Miami, FL, 248–255. IEEE.
   Google Scholar
• Derpanis, K. G. 2010. “Overview of the RANSAC Algorithm.” Image Rochester NY 4 (1): 2–3.
   Google Scholar
• Dusmanu, M., I. Rocco, T. Pajdla, M. Pollefeys, J. Sivic, A. Torii, and T. Sattler. 2019. “D2-Net: A Trainable CNN for Joint Description and Detection of Local Features.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 8092–8101.
   Google Scholar
• Efe, U., K. Gokalp Ince, and A. Alatan. 2021. “DFM: A Performance Baseline for Deep Feature Matching.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Nashville, TN, USA, 4284–4293.
   Google Scholar
• Fan, Z., L. Zhang, Y. Liu, Q. Wang, and S. Zlatanova. 2021. “Exploiting High Geopositioning Accuracy of SAR Data to Obtain Accurate Geometric Orientation of Optical Satellite Images.” Remote Sensing 13 (17): 3535. https://doi.org/10.3390/rs13173535.
   Web of Science ®Google Scholar
• Haigang, S. U., L. I. Chang, G. A. Zhe, J. I. Zhengjie, and X. U. Chuan. 2022. “Overview of Multi-Modal Remote Sensing Image Matching Methods.” Acta Geodaetica et Cartographica Sinica 51 (9): 1848–1861. https://doi.org/10.11947/j.AGCS.2022.20220126.
   Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 770–778.
   Google Scholar
• Hong, D., L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot. 2020. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (7): 5966–5978. https://doi.org/10.1109/TGRS.2020.3015157.
   Web of Science ®Google Scholar
• Hong, D., L. Gao, N. Yokoya, J. Yao, J. Chanussot, D. Qian, and B. Zhang. 2020. “More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (5): 4340–4354. https://doi.org/10.1109/TGRS.2020.3016820.
   Web of Science ®Google Scholar
• Jiang, X., M. Jiayi, G. Xiao, Z. Shao, and X. Guo. 2021. “A Review of Multimodal Image Matching: Methods and Applications.” Information Fusion 73:22–71. https://doi.org/10.1016/j.inffus.2021.02.012.
   Web of Science ®Google Scholar
• Joglekar, J., and S. S. Gedam. 2012. “Area Based Image Matching Methods—A Survey.” International Journal of Emerging Technology and Advanced Engineering 2 (1): 130–136.
   Google Scholar
• Lowe, G. 2004. “Sift-The Scale Invariant Feature Transform.” An International Journal 2 (91–110): 2. https://doi.org/10.1023/B:VISI.0000029664.99615.94.
   Google Scholar
• Luo, G. 2018. “Research on Air-to-ground Matching Algorithm Based on Matter Aspect Element.” Master’s thesis, Wuhan University, China.
   Google Scholar
• Ma, J., X. Jiang, A. Fan, J. Jiang, and J. Yan. 2021. “Image Matching from Handcrafted to Deep Features: A Survey.” International Journal of Computer Vision 129:23–79. https://doi.org/10.1007/s11263-020-01359-2.
   Web of Science ®Google Scholar
• Ma, Z., and S. Liu. 2018. “A Review of 3D Reconstruction Techniques in Civil Engineering and Their Applications.” Advanced Engineering Informatics 37:163–174. https://doi.org/10.1016/j.aei.2018.05.005.
   Web of Science ®Google Scholar
• Ma, W., Z. Wen, Y. Wu, L. Jiao, M. Gong, Y. Zheng, and L. Liu. 2016. “Remote Sensing Image Registration with Modified SIFT and Enhanced Feature Matching.” IEEE Geoscience and Remote Sensing Letters 14 (1): 3–7. https://doi.org/10.1109/LGRS.2016.2600858.
   Web of Science ®Google Scholar
• McMahan, B., E. Moore, D. Ramage, S. Hampson, and B. A. Y Arcas. 2017. “Communication-Efficient Learning of Deep Networks from Decentralized Data.” Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA, 1273–1282.
   Google Scholar
• Morel, J.-M., and Y. Guoshen. 2009. “ASIFT: A New Framework for Fully Affine Invariant Image Comparison.” SIAM Journal on Imaging Sciences 2 (2): 438–469. https://doi.org/10.1137/080732730.
   Web of Science ®Google Scholar
• Revaud, J., P. Weinzaepfel, Z. Harchaoui, and C. Schmid. 2016. “Deepmatching: Hierarchical Deformable Dense Matching.” International Journal of Computer Vision 120 (3): 300–323. https://doi.org/10.1007/s11263-016-0908-3.
   Web of Science ®Google Scholar
• Rocco, I., M. Cimpoi, R. Arandjelović, A. Torii, T. Pajdla, and J. Sivic. 2020. “Ncnet: Neighbourhood Consensus Networks for Estimating Image Correspondences.” IEEE Transactions on Pattern Analysis and Machine Intelligence 44 (2): 1020–1034. https://doi.org/10.1109/TPAMI.2020.3016711.
   Web of Science ®Google Scholar
• Rublee, E., V. Rabaud, K. Konolige, and G. B. Orb. 2017. “An Efficient Alternative to SIFT or SURF.” In Proceedings of International Conference on Computer Vision, Barcelona, 2564–2571.
   Google Scholar
• Sarlin, P.-E., D. DeTone, T. Malisiewicz, and A. Rabinovich. 2020. “SuperGlue: Learning Feature Matching with Graph Neural Networks.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Seattle, WA, USA, 4938–4947.
   Google Scholar
• Shafiq, M., and G. Zhaoquan. 2022. “Deep Residual Learning for Image Recognition: A Survey.” Applied Sciences 12 (18): 8972. https://doi.org/10.3390/app12188972.
   Google Scholar
• Shao, F., Z. Liu, and A. Jubai. 2020. “A Discriminative Point Matching Algorithm Based on Local Structure Consensus Constraint.” IEEE Geoscience and Remote Sensing Letters 18 (8): 1366–1370. https://doi.org/10.1109/LGRS.2020.2999438.
   Web of Science ®Google Scholar
• Wang, Z., E. P. Simoncelli, and A. C. Bovik. 2003. “Multiscale Structural Similarity for Image Quality Assessment.” The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers 2:1398–1402. https://doi.org/10.1109/ACSSC.2003.1292216.
   Google Scholar
• Wu, X., D. Hong, and J. Chanussot. 2022. “UIU-Net: U-Net in U-Net for Infrared Small Object Detection.” IEEE Transactions on Image Processing 32:364–376. https://doi.org/10.1109/TIP.2022.3228497.
   Web of Science ®Google Scholar
• Wu, X., D. Hong, J. Chanussot, Y. Wang, and Z. Guo. 2021. “Convolutional Neural Networks for Multimodal Remote Sensing Data Classification.” IEEE Transactions on Geoscience and Remote Sensing 60:1–10. https://doi.org/10.1109/TGRS.2020.3040277.
   Web of Science ®Google Scholar
• Xie, H., H. Yao, X. Sun, S. Zhou, and S. Zhang. 2019. “Pix2Vox: Context-Aware 3D Reconstruction from Single and Multi-View Images.” In Proceedings of the IEEE/CVF international conference on computer vision, Long Beach, CA, USA, 2690–2698.
   Google Scholar
• Ye, Y., L. Bruzzone, J. Shan, F. Bovolo, and Q. Zhu. 2019. “Fast and Robust Matching for Multimodal Remote Sensing Image Registration.” IEEE Transactions on Geoscience and Remote Sensing 57 (11): 9059–9070. https://doi.org/10.1109/TGRS.2019.2924684.
   Web of Science ®Google Scholar
• Ye, Y., J. Shan, L. Bruzzone, and L. Shen. 2017. “Robust Registration of Multimodal Remote Sensing Images Based on Structural Similarity.” IEEE Transactions on Geoscience and Remote Sensing 55 (5): 2941–2958. https://doi.org/10.1109/TGRS.2017.2656380.
   Web of Science ®Google Scholar
• Yong, Z. H., Y. U. Jian-Ping, S. U. Jun-Wei, and J. I. Tie. 2011. “Research on Corner Matching Method Based on Harris.” Computer and Modernization 1 (11): 78.
   Google Scholar
• Yu, X., L. Huang, and P. Chen. 2022. “Complex Street Scene Change Detection Based on Segnet Network and Migration Learning.” Journal of Chongqing University 45 (11): 100–107.
   Google Scholar
• Zhang, H., T. Huang, X. Junjie, X. Chuan, and W. Yang. 2023. “Robust Matching of the Aerial-Ground Image by Multi-Layer Progressive Matching Network.” Computer Engineering. https://doi.org/10.19678/j.issn.1000-3428.0065949.
   PubMedGoogle Scholar
• Zhang, Y., Y. Yao, Y. Wan, W. Liu, W. Yang, Z. Zheng, and R. Xiao. 2023. “Histogram of the Orientation of the Weighted Phase Descriptor for Multi-Modal Remote Sensing Image Matching.” ISPRS Journal of Photogrammetry and Remote Sensing 196:1–15. https://doi.org/10.1016/j.isprsjprs.2022.12.018.
   Web of Science ®Google Scholar
• Zhao, H., Shi, J., Qi, X., Wang, X. and Jia, J. 2017. “Pyramid scene parsing network”. In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 2881–2890.
   Google Scholar
• Zhao, L., H. Wang, Y. Zhu, and M. Song. 2023. “A Review of 3D Reconstruction from High-Resolution Urban Satellite Images.” International Journal of Remote Sensing 44 (2): 713–748. https://doi.org/10.1080/01431161.2023.2169844.
   Web of Science ®Google Scholar
• Zheng, Z., Y. Wei, and Y. Yang. 2020. “University-1652: A Multi-View Multi-Source Benchmark for Drone-Based Geo-Localization.” In Proceedings of the 28th ACM international conference on Multimedia, Seattle WA USA, 1395–1403.
   Google Scholar
• Zhou, Q., T. Sattler, and L. Leal-Taixe. 2021. “Patch2pix: Epipolar-Guided Pixel-Level Correspondences.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Nashville, TN, USA, 4669–4678.
   Google Scholar
• Zhu, Q., Z. Wang, H. Hu, L. Xie, X. Ge, and Y. Zhang. 2020. “Leveraging Photogrammetric Mesh Models for Aerial-Ground Feature Point Matching Toward Integrated 3D Reconstruction.” ISPRS Journal of Photogrammetry and Remote Sensing 166:26–40. https://doi.org/10.1016/j.isprsjprs.2020.05.024.
   Web of Science ®Google Scholar