Interactive Siamese spatial-Spectral cross-layer fusion transformer for hyperspectral image change detection

References

• Aasbjerg Nielsen, A. 2007. “The Regularized Iteratively Reweighted Mad Method for Change Detection in Multi-And Hyperspectral Data.” IEEE Transactions on Image Processing 16 (2): 463–478. https://doi.org/10.1109/TIP.2006.888195.
   PubMed Web of Science ®Google Scholar
• Behroozpour, B., P. A. M. Sandborn, M. C. Wu, and B. E. Boser. 2017. “Lidar System Architectures and Circuits.” IEEE Communications Magazine 55 (10): 135–142. https://doi.org/10.1109/MCOM.2017.1700030.
   Web of Science ®Google Scholar
• Bovolo, F., L. Bruzzone, and M. Marconcini. 2008. “A Novel Approach to Unsupervised Change Detection Based on a Semisupervised Svm and a Similarity Measure.” IEEE Transactions on Geoscience & Remote Sensing 46 (7): 2070–2082. https://doi.org/10.1109/TGRS.2008.916643.
   Web of Science ®Google Scholar
• Briottet, X., Y. Boucher, A. Dimmeler, A. Malaplate, A. Cini, H. B. Marco Diani, P. Schwering, T. Skauli, and I. Kasen. 2006. “Military Applications of Hyperspectral Imagery.” Targets and Backgrounds XII: Characterization and Representation, edited by W. R. Watkins and D. Clement, 82–89. Vol. 6239. SPIE.
   Google Scholar
• Chaudhuri, D., and A. Samal. 2008. “An Automatic Bridge Detection Technique for Multispectral Images.” IEEE Transactions on Geoscience & Remote Sensing 46 (9): 2720–2727. https://doi.org/10.1109/TGRS.2008.923631.
   Web of Science ®Google Scholar
• Chen, D., J. Zhang, Q. Guo, and L. Wang. 2023. “Hyperspectral Image Classification Based on Global Spectral Projection and Space Aggregation.” IEEE Geoscience & Remote Sensing Letters 20:1–5. https://doi.org/10.1109/LGRS.2023.3277841.
   Google Scholar
• Chen, H., Z. Qi, Z. Shi, H. Qiu, F. Lin, and S. Zhang. 2021. “Remote Sensing Image Change Detection with Transformers.” IEEE Transactions on Geoscience & Remote Sensing 60:1–18. https://doi.org/10.1109/TGRS.2020.3034752.
   Web of Science ®Google Scholar
• Chen, Z., Z. Lu, H. Gao, Y. Zhang, J. Zhao, D. Hong, and B. Zhang. 2022. “Global to Local: A Hierarchical Detection Algorithm for Hyperspectral Image Target Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2022.3225902.
   Web of Science ®Google Scholar
• Chen, Z., Y. Wang, H. Gao, Y. Ding, Q. Zhong, D. Hong, and B. Zhang. 2023. “Temporal Difference-Guided Network for Hyperspectral Image Change Detection.” International Journal of Remote Sensing 44 (19): 6033–6059. https://doi.org/10.1080/01431161.2023.2258563.
   Web of Science ®Google Scholar
• Chopra, S., R. Hadsell, and Y. LeCun. 2005. “Learning a Similarity Metric Discriminatively, with Application to Face Verification.” 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), San Diego, CA, 539–546, volume 1. IEEE.
   Google Scholar
• Coppin, P., E. Lambin, I. Jonckheere, and B. Muys. 2002. “Digital Change Detection Methods in Natural Ecosystem Monitoring: A Review.” Analysis of Multi-Temporal Remote Sensing Images 3–36.
   Google Scholar
• Deng, J. S., K. Wang, Y. H. Deng, and G. J. Qi. 2008. “Pca-Based Land-Use Change Detection and Analysis Using Multitemporal and Multisensor Satellite Data.” International Journal of Remote Sensing 29 (16): 4823–4838. https://doi.org/10.1080/01431160801950162.
   Web of Science ®Google Scholar
• Ding, J., X. Li, S. Xiang, and S. Chen. 2023. “Multi-Level Features Fused and Change Information Enhanced Neural Network for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 62:1–13. https://doi.org/10.1109/TGRS.2023.3344784.
   Web of Science ®Google Scholar
• Ding, J., X. Li, and L. Zhao. 2022. “Cdformer: A Hyperspectral Image Change Detection Method Based on Transformer Encoders.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3216878.
   Web of Science ®Google Scholar
• Dosovitskiy, A., L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, and S. Gelly. 2020. “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale.” arXiv Preprint arXiv 201011929.
   Google Scholar
• Freeman, A. 1992. “Sar Calibration: An Overview.” IEEE Transactions on Geoscience & Remote Sensing 30 (6): 1107–1121. https://doi.org/10.1109/36.193786.
   Web of Science ®Google Scholar
• Gao, H., R. Sheng, Z. Chen, H. Liu, S. Xu, and B. Zhang. 2024. “Multi-Scale Random-Shape Convolution and Adaptive Graph Convolution Fusion Network for Hyperspectral Image Classification.” IEEEZ Transactions on Geoscience and Remote Sensing 62:1–17.
   Google Scholar
• Gao, L., Z. Han, D. Hong, B. Zhang, and J. Chanussot. 2021. “Cycu-Net: Cycle-Consistency Unmixing Network by Learning Cascaded Autoencoders.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2021.3064958.
   Web of Science ®Google Scholar
• Gao, L., J. Li, K. Zheng, X. Jia, and X. Jia. 2023a. “Enhanced Autoencoders with Attention-Embedded Degradation Learning for Unsupervised Hyperspectral Image Super-Resolution.” IEEE Transactions on Geoscience & Remote Sensing 61:1–17. https://doi.org/10.1109/TGRS.2023.3300043.
   Web of Science ®Google Scholar
• Gao, L., X. Sun, X. Sun, L. Zhuang, Q. Du, and B. Zhang. 2023b. “Hyperspectral Anomaly Detection Based on Chessboard Topology.” IEEE Transactions on Geoscience & Remote Sensing 61:1–16. https://doi.org/10.1109/TGRS.2023.3249748.
   Web of Science ®Google Scholar
• Gao, L., D. Wang, L. Zhuang, X. Sun, M. Huang, and A. Plaza. 2023. “Bs3lnet: A New Blind-Spot Self-Supervised Learning Network for Hyperspectral Anomaly Detection.” IEEE Transactions on Geoscience & Remote Sensing 61:1–18. https://doi.org/10.1109/TGRS.2023.3246565.
   Google Scholar
• Gao, L., Z. Wang, L. Zhuang, H. Yu, B. Zhang, and J. Chanussot. 2021. “Using Low-Rank Representation of Abundance Maps and Nonnegative Tensor Factorization for Hyperspectral Nonlinear Unmixing.” IEEE Transactions on Geoscience & Remote Sensing 60:1–17. https://doi.org/10.1109/TGRS.2021.3065990.
   Web of Science ®Google Scholar
• Han, H., F. Zhu, B. Zhu, and H. Wu. 2023. “Target Detection of Remote Sensing Image Based on an Improved Yolov5.” IEEE Geoscience & Remote Sensing Letters 20:1–5. https://doi.org/10.1109/LGRS.2023.3327878.
   Web of Science ®Google Scholar
• Hong, D., L. Gao, N. Yokoya, J. Yao, J. Chanussot, Q. Du, and B. Zhang. 2021. “More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification.” IEEE Transactions on Geoscience & Remote Sensing 59 (5): 4340–4354. https://doi.org/10.1109/TGRS.2020.3016820.
   Web of Science ®Google Scholar
• Hong, D., Z. Han, J. Yao, L. Gao, B. Zhang, A. Plaza, and J. Chanussot. 2021. “Spectralformer: Rethinking Hyperspectral Image Classification with Transformers.” IEEE Transactions on Geoscience & Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2022.3172371.
   Google Scholar
• Hong, D., N. Yokoya, J. Chanussot, and X. Xiang Zhu. 2019. “An Augmented Linear Mixing Model to Address Spectral Variability for Hyperspectral Unmixing.” IEEE Transactions on Image Processing 28 (4): 1923–1938. https://doi.org/10.1109/TIP.2018.2878958.
   Web of Science ®Google Scholar
• Liu, S., L. Bruzzone, F. Bovolo, and P. Du. 2014. “A Novel Sequential Spectral Change Vector Analysis for Representing and Detecting Multiple Changes in Hyperspectral Images.” 2014 IEEE Geoscience and Remote Sensing Symposium, Quebec City, Canada, 4656–4659. IEEE.
   Google Scholar
• Liu, S., M. Chi, Y. Zou, A. Samat, J. Atli Benediktsson, and A. Plaza. 2017. “Oil Spill Detection via Multitemporal Optical Remote Sensing Images: A Change Detection Perspective.” IEEE Geoscience & Remote Sensing Letters 14 (3): 324–328. https://doi.org/10.1109/LGRS.2016.2639540.
   Web of Science ®Google Scholar
• Liu, S., Q. Du, X. Tong, A. Samat, L. Bruzzone, and F. Bovolo. 2017. “Multiscale Morphological Compressed Change Vector Analysis for Unsupervised Multiple Change Detection.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 10 (9): 4124–4137. https://doi.org/10.1109/JSTARS.2017.2712119.
   Web of Science ®Google Scholar
• Liu, Z., Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” Proceedings of the IEEE/CVF international conference on computer vision, 10012–10022.
   Google Scholar
• Malila, W. A. 1980. “Change Vector Analysis: An Approach for Detecting Forest Changes with Landsat.” LARS Symposia 385.
   Google Scholar
• Qu, J., S. Hou, W. Dong, Y. Li, and W. Xie. 2021. “A Multilevel Encoder–Decoder Attention Network for Change Detection in Hyperspectral Images.” IEEE Transactions on Geoscience & Remote Sensing 60:1–13. https://doi.org/10.1109/TGRS.2021.3130122.
   Web of Science ®Google Scholar
• Song, R., W. Ni, W. Cheng, and X. Wang. 2022. “Csanet: Cross-Temporal Interaction Symmetric Attention Network for Hyperspectral Image Change Detection.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3179134.
   Web of Science ®Google Scholar
• Su, Y., J. Chen, L. Gao, A. Plaza, M. Jiang, X. Xu, X. Sun, and P. Li. 2023. “Acgt-Net: Adaptive Cuckoo Refinement-Based Graph Transfer Network for Hyperspectral Image Classification.” IEEE Transactions on Geoscience & Remote Sensing 61:1–14. https://doi.org/10.1109/TGRS.2023.3307434.
   Google Scholar
• Su, Y., L. Gao, M. Jiang, A. Plaza, X. Sun, and B. Zhang. 2022. “Nsckl: Normalized Spectral Clustering with Kernel-Based Learning for Semisupervised Hyperspectral Image Classification.” IEEE Transactions on Cybernetics 53 (10): 6649–6662.
   Web of Science ®Google Scholar
• Sun, X., Y. Qu, L. Gao, X. Sun, H. Qi, B. Zhang, and T. Shen. 2020. “Target Detection Through Tree-Structured Encoding for Hyperspectral Images.” IEEE Transactions on Geoscience & Remote Sensing 59 (5): 4233–4249. https://doi.org/10.1109/TGRS.2020.3024852.
   Web of Science ®Google Scholar
• Sun, X., Y. Qu, L. Gao, X. Sun, H. Qi, B. Zhang, and T. Shen. 2021. “Ensemble-Based Information Retrieval with Mass Estimation for Hyperspectral Target Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–23. https://doi.org/10.1109/TGRS.2021.3075583.
   Web of Science ®Google Scholar
• Tewkesbury, A. P., A. J. Comber, N. J. Tate, A. Lamb, and P. F. Fisher. 2015. “A Critical Synthesis of Remotely Sensed Optical Image Change Detection Techniques.” Remote Sensing of Environment 160:1–14. https://doi.org/10.1016/j.rse.2015.01.006.
   Web of Science ®Google Scholar
• Tu, B., Z. Wang, H. Ouyang, X. Yang, J. Li, and A. Plaza. 2022. “Hyperspectral Anomaly Detection Using the Spectral–Spatial Graph.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3217329.
   Google Scholar
• Tu, B., X. Yang, W. He, J. Li, and A. Plaza. 2023. “Graph Evolution-Based Vertex Extraction for Hyperspectral Anomaly Detection.” IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2023.3303273.
   Web of Science ®Google Scholar
• Tu, B., X. Yang, X. Ou, G. Zhang, J. Li, and A. Plaza. 2021. “Ensemble Entropy Metric for Hyperspectral Anomaly Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–17. https://doi.org/10.1109/TGRS.2021.3116681.
   Google Scholar
• Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. 2017. “Attention is All You Need.” Advances in Neural Information Processing Systems 30.
   Google Scholar
• Wang, L., L. Wang, Q. Wang, and P. M. Atkinson. 2021. “Ssa-Siamnet: Spectral–Spatial-wise Attention-Based Siamese Network for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–18. https://doi.org/10.1109/TGRS.2021.3095899.
   Google Scholar
• Wang, Q., Z. Yuan, Q. Du, and X. Li. 2018. “Getnet: A General End-To-End 2-D Cnn Framework for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 57 (1): 3–13. https://doi.org/10.1109/TGRS.2018.2849692.
   Web of Science ®Google Scholar
• Wang, X., K. Zhao, X. Zhao, and S. Li. 2023. “Gtmsiam: Gated Transmitting Based Multiscale Siamese Network for Hyperspectral Image Change Detection.” IEEE Geoscience & Remote Sensing Letters 20:1–5.
   Web of Science ®Google Scholar
• Wang, Y., D. Hong, J. Sha, L. Gao, L. Liu, Y. Zhang, and X. Rong. 2022. “Spectral–Spatial–Temporal Transformers for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2022.3203075.
   Web of Science ®Google Scholar
• Wu, C., B. Du, and L. Zhang. 2013. “Slow Feature Analysis for Change Detection in Multispectral Imagery.” IEEE Transactions on Geoscience & Remote Sensing 52 (5): 2858–2874. https://doi.org/10.1109/TGRS.2013.2266673.
   Web of Science ®Google Scholar
• Yang, X., B. Tu, Q. Li, J. Li, and A. Plaza. 2023. “Graph Evolution-Based Vertex Extraction for Hyperspectral Anomaly Detection.” IEEE Transactions on Neural Networks and Learning Systems: 1–15. https://doi.org/10.1109/TNNLS.2023.3303273.
   Web of Science ®Google Scholar
• Yu, H., H. Yang, L. Gao, J. Hu, A. Plaza, and B. Zhang. 2024. “Hyperspectral Image Change Detection Based on Gated Spectral–Spatial–Temporal Attention Network with Spectral Similarity Filtering.” IEEE Transactions on Geoscience & Remote Sensing 62:1–13.
   Web of Science ®Google Scholar
• Zhan, T., B. Song, Y. Xu, M. Wan, X. Wang, G. Yang, and Z. Wu. 2021. “Sscnn-S: A Spectral-Spatial Convolution Neural Network with Siamese Architecture for Change Detection.” Remote Sensing 13 (5): 895. https://doi.org/10.3390/rs13050895.
   Web of Science ®Google Scholar
• Zhang, X., S. Tian, G. Wang, X. Tang, J. Feng, and L. Jiao. 2023. “Cast: A Cascade Spectral Aware Transformer for Hyperspectral Image Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 61:1–14. https://doi.org/10.1109/TGRS.2023.3304681.
   Google Scholar
• Zhang, Y., T. Wang, C. Zhang, S. Xu, H. Gao, and C. Li. 2024. “A Dual-Branch Siamese Spatial-Spectral Transformer Attention Network for Hyperspectral Image Change Detection.” Expert Systems with Applications 238:122125. https://doi.org/10.1016/j.eswa.2023.122125.
   Web of Science ®Google Scholar
• Zhang, Y., S. Xu, D. Hong, H. Gao, C. Zhang, M. Bi, and C. Li. 2023. “Multimodal Transformer Network for Hyperspectral and Lidar Classification.” IEEE Transactions on Geoscience & Remote Sensing 61:1–17. https://doi.org/10.1109/TGRS.2023.3283508.
   Google Scholar
• Zhang, Y., Y. Zhou, S. Xu, D. Hong, H. Gao, C. Li, Q. Zhong, and B. Zhang. 2023. “Depthwise Separable Convolutional Autoencoders for Hyperspectral Image Change Detection.” IEEE Geoscience & Remote Sensing Letters 20:1–5. https://doi.org/10.1109/LGRS.2023.3329687.
   Web of Science ®Google Scholar
• Zhu, F., J. Cui, and K. Dou. 2023. “Spatio-Temporal Hierarchical Feature Transformer for Uav Object Tracking.” Isprs Journal of Photogrammetry & Remote Sensing 204:442–452. https://doi.org/10.1016/j.isprsjprs.2023.09.016.
   Web of Science ®Google Scholar
• Zhu, F., J. Li, B. Zhu, H. Li, and G. Liu. 2023. “Uav Remote Sensing Image Stitching via Improved vgg16 Siamese Feature Extraction Network.” Expert Systems with Applications 229:120525.
   Web of Science ®Google Scholar
• Zhuang, L., M. K. Ng, L. Gao, J. Michalski, and Z. Wang. 2023. “Eigenimage2eigenimage (E2e): A Self-Supervised Deep Learning Network for Hyperspectral Image Denoising.” IEEE Transactions on Neural Networks and Learning Systems 1–15. https://doi.org/10.1109/TNNLS.2023.3293328.
   Web of Science ®Google Scholar
• Zhuang, L., M. K. Ng, L. Gao, and Z. Wang. 2024. “Eigen-Cnn: Eigenimages Plus Eigennoise Level Maps Guided Network for Hyperspectral Image Denoising.” IEEE Transactions on Geoscience & Remote Sensing 62:1–18. https://doi.org/10.1109/TGRS.2024.3379199.
   Web of Science ®Google Scholar