93
Views
0
CrossRef citations to date
0
Altmetric
Research Article

A radiometric and rotational invariant feature descriptor for multimodal remote sensing image matching using the monogenic signal

ORCID Icon, , &
Pages 2567-2595 | Received 22 Nov 2023, Accepted 18 Mar 2024, Published online: 02 Apr 2024

References

  • Aguilera, C. A., F. J. Aguilera, A. D. Sappa, C. Aguilera, and R. Toledo. 2016. “Learning Cross-Spectral Similarity Measures with Deep Convolutional Neural Networks.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 1–9. Las Vegas, NV, USA.
  • Aguilera, C., F. Barrera, F. Lumbreras, A. D. Sappa, and R. Toledo. 2012. “Multispectral Image Feature Points.” Sensors 12 (9): 12661–12672. https://doi.org/10.3390/s120912661.
  • Aguilera, C. A., A. D. Sappa, and R. Toledo. 2015. “LGHD: A Feature Descriptor for Matching Across Non-Linear Intensity Variations.” IEEE International Conference on Image Processing (ICIP), 178–181. Quebec City, QC, Canada.
  • Balntas, V., K. Lenc, A. Vedaldi, and K. Mikolajczyk. 2017. “HPatches: A Benchmark and Evaluation of Handcrafted and Learned Local Descriptors.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 5173–5182. Honolulu, HI, USA.
  • Bay, H., A. Ess, T. Tuytelaars, and L. Van Gool. 2008. “Speeded-Up Robust Features (SURF.” Computer Vision and Image Understanding 110 (3): 346–359. https://doi.org/10.1016/j.cviu.2007.09.014.
  • Bodensteiner, C., W. Huebner, K. Juengling, J. Mueller, and M. Arens. 2010. “Local Multi-Modal Image Matching Based on Self-Similarity.” IEEE International Conference on Image Processing, 937–940. Hong Kong, China.
  • Canny, J. 1986. “A Computational Approach to Edge Detection.” IEEE Transactions on Pattern Analysis & Machine Intelligence PAMI-8 (6): 679–698. https://doi.org/10.1109/TPAMI.1986.4767851.
  • Chen, Z., D. Hong, and H. Gao. 2023. “Grid Network: Feature Extraction in Anisotropic Perspective for Hyperspectral Image Classification.” IEEE Geoscience & Remote Sensing Letters 20:1–5. https://doi.org/10.1109/LGRS.2023.3297612.
  • Chen, S., X. Li, H. Yang, and L. Zhao. 2018. “Robust Local Feature Descriptor for Multisource Remote Sensing Image Registration.” Journal of Applied Remote Sensing 12 (1): 015005.
  • Chen, Z., Z. Lu, H. Gao, Y. Zhang, J. Zhao, D. Hong, and B. Zhang. 2022. “Global to Local: A Hierarchical Detection Algorithm for Hyperspectral Image Target Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2022.3225902.
  • Chen, Z., Y. Wang, H. Gao, Y. Ding, Q. Zhong, D. Hong, and B. Zhang. 2023. “Temporal Difference-Guided Network for Hyperspectral Image Change Detection.” International Journal of Remote Sensing 44 (19): 6033–6059. https://doi.org/10.1080/01431161.2023.2258563.
  • Chen, Z., G. Wu, H. Gao, Y. Ding, D. Hong, and B. Zhang. 2023. “Local Aggregation and Global Attention Network for Hyperspectral Image Classification with Spectral-Induced Aligned Superpixel Segmentation.” Expert Systems with Applications 232:120828. https://doi.org/10.1016/j.eswa.2023.120828.
  • Dellinger, F., J. Delon, Y. Gousseau, J. Michel, and F. Tupin. 2015. “SAR-SIFT: A SIFT-Like Algorithm for SAR Images.” IEEE Transactions on Geoscience & Remote Sensing 53 (1): 453–466. https://doi.org/10.1109/tgrs.2014.2323552.
  • Dusmanu, M., I. Rocco, T. Pajdla, M. Pollefeys, J. Sivic, A. Torii, and T. Sattler. 2019. “D2-Net: A Trainable Cnn for Joint Description and Detection of Local Features.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 8092–8101. Long Beach, CA, USA.
  • Fan, J., Y. Ye, G. Liu, J. Li, and Y. Li. 2022. “Phase Congruency Order-Based Local Structural Feature for SAR and Optical Image Matching.” IEEE Geoscience & Remote Sensing Letters 19, 1–5.
  • Felsberg, M., and G. Sommer. 2001. “The Monogenic Signal.” IEEE Transactions on Signal Processing 49 (12): 3136–3144. https://doi.org/10.1109/78.969520.
  • Firmenichy, D., M. Brown, and S. Süsstrunk. 2011. “Multispectral Interest Points for RGB-NIR Image Registration.” 2011 18th IEEE International Conference on Image Processing, 181–184. Brussels, Belgium.
  • Fu, Z., Q. Qin, B. Luo, H. Sun, and C. Wu. 2018. “HOMPC: A Local Feature Descriptor Based on the Combination of Magnitude and Phase Congruency Information for Multi-Sensor Remote Sensing Images.” Remote Sensing 10 (8): 1234.
  • Hong, Y., C. Leng, X. Zhang, J. Peng, L. Jiao, and A. Basu. 2022. “Max-Index Based Local Self-Similarity Descriptor for Robust Multi-Modal Image Registration.” IEEE Geoscience & Remote Sensing Letters 19, 1–5.
  • Jevnisek, R. J., and S. Avidan. 2017. “Co-Occurrence Filter.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 3184–3192. Honolulu, HI, USA.
  • Jiang, X., J. Ma, G. Xiao, Z. Shao, and X. Guo. 2021. “A Review of Multimodal Image Matching: Methods and Applications.” Information Fusion 73, 22–71.
  • Kat, R., R. Jevnisek, and S. Avidan. 2018. “Matching Pixels Using Co-Occurrence Statistics.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1751–1759. Salt Lake City, UT, USA.
  • Kovesi, P. 1997. “Symmetry and Asymmetry from Local Phase.” Tenth Australian Joint Conference on Artificial Intelligence, 2–4. Perth, Australia.
  • Kovesi, P. 1999. “Image Features from Phase Congruency.” Videre: Journal of Computer Vision Research 1 (3), 1–26.
  • Lan, C., W. Lu, J. Yu, and Q. Xu. 2021. “Deep Learning Algorithm for Feature Matching of Cross Modality Remote Sensing Images.” Acta Geodetica et Cartographica Sinica 50 (2), 189–202.
  • Li, J., Q. Hu, and M. Ai. 2019. “RIFT: Multi-Modal Image Matching Based on Radiation-Variation Insensitive Feature Transform.” IEEE Transactions on Image Processing 29, 3296–3310.
  • Liu, X., Y. Ai, J. Zhang, and Z. Wang. 2018. “A Novel Affine and Contrast Invariant Descriptor for Infrared and Visible Image Registration.” Remote Sensing 10 (4), 658.
  • Li, W., J. Wang, Y. Gao, M. Zhang, R. Tao, and B. Zhang. 2022. “Graph-Feature-Enhanced Selective Assignment Network for Hyperspectral and Multispectral Data Classification.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3166252.
  • Lowe, D. G. 2004. “Distinctive Image Features from Scale-Invariant Keypoints.” International Journal of Computer Vision 60 (2), 91–110.
  • Luo, Z., T. Shen, L. Zhou, J. Zhang, Y. Yao, S. Li, T. Fang, and L. Quan. 2019. “Contextdesc: Local Descriptor Augmentation with Cross-Modality Context.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2527–2536. Long Beach, CA, USA.
  • Maurya, L., P. Mahapatra, and D. Chawla. 2022. “A Registration Strategy from Scale Adjustment to Fine for Thermal-Visible Face Images.” Infrared Physics & Technology 120:104001. https://doi.org/10.1016/j.infrared.2021.104001.
  • Mikolajczyk, K., and C. Schmid. 2005. “A performance evaluation of local descriptors.” IEEE Transactions on Pattern Analysis & Machine Intelligence 27 (10): 1615–1630. https://doi.org/10.1109/tpami.2005.188.
  • Mouats, T., and N. Aouf. 2013. “Multimodal Stereo Correspondence Based on Phase Congruency and Edge Histogram Descriptor.” Proceedings of the 16th International Conference on Information Fusion, 1981–1987. Istanbul, Turkey.
  • Nunes, C. F. G., and F. Luis Cardeal Padua. 2017. “A Local Feature Descriptor Based on Log-Gabor Filters for Keypoint Matching in Multispectral Images.” IEEE Geoscience & Remote Sensing Letters 14 (10), 1850–1854.
  • Quan, D., S. Wang, X. Liang, R. Wang, S. Fang, B. Hou, and L. Jiao. 2018. “Deep Generative Matching Network for Optical and SAR Image Registration.” IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, 6215–6218. Valencia, Spain.
  • Sarfraz, M. S., and O. Hellwich. 2008. “Head Pose Estimation in Face Recognition Across Pose Scenarios.” VISAPP 8 (1), 235–242.
  • Sedaghat, A., and H. Ebadi. 2015. “Distinctive Order Based Self-Similarity Descriptor for Multi-Sensor Remote Sensing Image Matching.” Isprs Journal of Photogrammetry & Remote Sensing 108:62–71. https://doi.org/10.1016/j.isprsjprs.2015.06.003.
  • Shechtman, E., and M. Irani. 2007. “Matching Local Self-Similarities Across Images and Videos.” 2007 IEEE Conference on Computer Vision and Pattern Recognition, 1–8. Minneapolis, MN, USA.
  • Wang, W. Q., H. Feng Ding, X. Jiang Xiao, J. Xu, and Y. Zhang. 2011. “The Improved Algorithm of Edge Detection Based on Canny Operator.” Advanced Materials Research 179: 97–102.
  • Wang, J., W. Li, M. Zhang, and J. Chanussot. 2023. “Large Kernel Sparse ConvNet Weighted by Multi-Frequency Attention for Remote Sensing Scene Understanding.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2023.3333401.
  • Weickert, J., B. M. Ter Haar Romeny, and M. A. Viergever. 1998. “Efficient and Reliable Schemes for Nonlinear Diffusion Filtering.” IEEE Transactions on Image Processing 7 (3), 398–410.
  • Wu, Q., G. Xu, Y. Cheng, W. Dong, L. Ma, and Z. Li. 2020. “Histogram of Maximal Point-Edge Orientation for Multi-Source Image Matching.” International Journal of Remote Sensing 41 (14), 5166–5185.
  • Wu, Q., and S. Zhu. 2021. “Multispectral Image Matching Method Based on Histogram of Maximum Gradient and Edge Orientation.” IEEE Geoscience & Remote Sensing Letters 19, 1–5.
  • Xiong, X., G. Jin, Q. Xu, and H. Zhang. 2021. “Self-Similarity Features for Multimodal Remote Sensing Image Matching.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 14, 12440–12454.
  • Xiong, X., Q. Xu, G. Jin, H. Zhang, and X. Gao. 2019. “Rank-Based Local Self-Similarity Descriptor for Optical-To-SAR Image Matching.” IEEE Geoscience & Remote Sensing Letters 17 (10), 1742–1746.
  • Yao, Y., Y. Zhang, Y. Wan, X. Liu, and H. Guo. 2021. “Heterologous Images Matching Considering Anisotropic Weighted Moment and Absolute Phase Orientation.” Geomatics and Information Science of Wuhan University 46 (11), 1727–1736.
  • Yao, Y., Y. Zhang, Y. Wan, X. Liu, X. Yan, and J. Li. 2022. “Multi-Modal Remote Sensing Image Matching Considering Co-Occurrence Filter.” IEEE Transactions on Image Processing 31, 2584–2597.
  • Ye, Y., and L. Shen. 2016. “HOPC: A Novel Similarity Metric Based on Geometric Structural Properties for Multi-Modal Remote Sensing Image Matching.” ISPRS Annals of the Photogrammetry, Remote Sensing & Spatial Information Sciences 3:9–16.
  • Yue, W., M. Wenping, G. Maoguo, S. Linzhi, and J. Licheng. 2015. “A Novel Point-Matching Algorithm Based on Fast Sample Consensus for Image Registration.” IEEE Geoscience & Remote Sensing Letters 12 (1): 43–47. https://doi.org/10.1109/lgrs.2014.2325970.
  • Yu, G., and S. Zhao. 2020. “A New Feature Descriptor for Multimodal Image Registration Using Phase Congruency.” Sensors 20 (18), 5105.
  • Zeng, L., Y. Du, H. Lin, J. Wang, J. Yin, and J. Yang. 2020. “A Novel Region-Based Image Registration Method for Multisource Remote Sensing Images via CNN.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 14, 1821–1831.
  • Zhang, W. 2020. “Combination of SIFT and Canny Edge Detection for Registration Between SAR and Optical Images.” IEEE Geoscience & Remote Sensing Letters 19, 1–5.
  • Zhang, M., W. Li, X. Zhao, H. Liu, R. Tao, and Q. Du. 2023. “Morphological Transformation and Spatial-Logical Aggregation for Tree Species Classification Using Hyperspectral Imagery.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2022.3233847.
  • Zhang, Y., Y. Yao, Y. Wan, W. Liu, W. Yang, Z. Zheng, and R. Xiao. 2023. “Histogram of the Orientation of the Weighted Phase Descriptor for Multi-Modal Remote Sensing Image Matching.” Isprs Journal of Photogrammetry & Remote Sensing 196, 1–15.
  • Zitová, B., and J. Flusser. 2003. “Image Registration Methods: A Survey.” Image and Vision Computing 21 (11): 977–1000. https://doi.org/10.1016/s0262-8856(03)00137-9.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.