Cross attention is all you need: relational remote sensing change detection with transformer

References

• Addink, E. A., F. M. Van Coillie, and S. M. De Jong. 2012. “Introduction to the GEOBIA 2010 Special Issue: From Pixels to Geographic Objects in Remote Sensing Image Analysis.” International Journal of Applied Earth Observation and Geoinformation 15:1–19. https://doi.org/10.1016/j.jag.2011.12.001.
   Web of Science ®Google Scholar
• Agarap, A. F. 2018. “Deep Learning Using Rectified Linear Units (Relu).” arXiv preprint arXiv:1803.08375.
   Google Scholar
• Bandara, W. G. C., and V. M. Patel. 2022. “A Transformer-Based Siamese Network for Change Detection.” IGARSS 2022-2022 IEEE International Geoscience and Remote Sensing Symposium, July 17-22, 2022, Kuala Lumpur, Malaysia, 207–210. IEEE.
   Google Scholar
• Bayarjargal, Y., A. Karnieli, M. Bayasgalan, S. Khudulmur, C. Gandush, and C. J. Tucker. 2006. “A Comparative Study of NOAA–AVHRR Derived Drought Indices Using Change Vector Analysis.” Remote Sensing of Environment 105 (1): 9–22. https://doi.org/10.1016/j.rse.2006.06.003.
   Web of Science ®Google Scholar
• Cai, S., and D. Liu. 2013. “A Comparison of Object-Based and Contextual Pixel-Based Classifications Using High and Medium Spatial Resolution Images.” Remote Sensing Letters 4 (10): 998–1007. https://doi.org/10.1080/2150704X.2013.828180.
   Web of Science ®Google Scholar
• Cao, Y., X. Huang, and Q. Weng. 2023. “A Multi-Scale Weakly Supervised Learning Method with Adaptive Online Noise Correction for High-Resolution Change Detection of Built-Up Areas.” Remote Sensing of Environment 297:113779. https://doi.org/10.1016/j.rse.2023.113779.
   Web of Science ®Google Scholar
• Carion, N., F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko. 2020. “End-To-End Object Detection with Transformers.” Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part I 16, Glasgow, UK, 213–229. Springer International Publishing.
   Google Scholar
• Chen, C. P., J. W. Hsieh, P. Y. Chen, Y. K. Hsieh, and B. S. Wang. 2023. “SARAS-Net: Scale and Relation Aware Siamese Network for Change Detection.” Proceedings of the AAAI Conference on Artificial Intelligence 37 (12): 14187–14195. June. https://doi.org/10.1609/aaai.v37i12.26660.
   Google Scholar
• Chen, H., Z. Qi, and Z. Shi. 2021. “Remote Sensing Image Change Detection with Transformers.” IEEE Transactions on Geoscience & Remote Sensing 60:1–14. https://doi.org/10.1109/TGRS.2021.3095166.
   Web of Science ®Google Scholar
• Chen, H., and Z. Shi. 2020. “A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection.” Remote Sensing 12 (10): 1662. https://doi.org/10.3390/rs12101662.
   Web of Science ®Google Scholar
• Chen, L. C., G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs.” IEEE Transactions on Pattern Analysis & Machine Intelligence 40 (4): 834–848. https://doi.org/10.1109/TPAMI.2017.2699184.
   PubMed Web of Science ®Google Scholar
• Chen, P., B. Zhang, D. Hong, Z. Chen, X. Yang, and B. Li. 2022. “FCCDN: Feature Constraint Network for VHR Image Change Detection.” ISPRS Journal of Photogrammetry & Remote Sensing 187:101–119. https://doi.org/10.1016/j.isprsjprs.2022.02.021.
   Web of Science ®Google Scholar
• Cheng, B., I. Misra, A. G. Schwing, A. Kirillov, and R. Girdhar. 2022. “Masked-Attention Mask Transformer for Universal Image Segmentation.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, Louisiana, 1290–1299.
   Google Scholar
• Daudt, R. C., B. Le Saux, and A. Boulch. 2018. “Fully Convolutional Siamese Networks for Change Detection.” 2018 25th IEEE International Conference on Image Processing (ICIP), Athens, Greece, 4063–4067. IEEE.
   Google Scholar
• Deng, J. S., K. Wang, Y. H. Deng, and G. J. Qi. 2008. “PCA‐Based Land‐Use Change Detection and Analysis Using Multitemporal and Multisensor Satellite Data.” International Journal of Remote Sensing 29 (16): 4823–4838. https://doi.org/10.1080/01431160801950162.
   Web of Science ®Google Scholar
• Ding, Q., Z. Shao, X. Huang, and O. Altan. 2021. “DSA-Net: A Novel Deeply Supervised Attention-Guided Network for Building Change Detection in High-Resolution Remote Sensing Images.” International Journal of Applied Earth Observation and Geoinformation 105:102591. https://doi.org/10.1016/j.jag.2021.102591.
   Web of Science ®Google Scholar
• Everingham, M., S. A. Eslami, L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman. 2015. “The Pascal Visual Object Classes Challenge: A Retrospective.” International Journal of Computer Vision 111 (1): 98–136. https://doi.org/10.1007/s11263-014-0733-5.
   Web of Science ®Google Scholar
• Fang, S., K. Li, J. Shao, and Z. Li. 2021. “SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2021.3056416.
   Web of Science ®Google Scholar
• Feng, Y., J. Jiang, H. Xu, and J. Zheng. 2023. “Building Change Detection Using Cross-Temporal Feature Interaction Network.” ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 1–5. IEEE.
   Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2015. “Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition.” IEEE Transactions on Pattern Analysis & Machine Intelligence 37 (9): 1904–1916. https://doi.org/10.1109/TPAMI.2015.2389824.
   PubMed Web of Science ®Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, Nevada, 770–778.
   Google Scholar
• Howarth, P. J., and G. M. Wickware. 1981. “Procedures for Change Detection Using Landsat Digital Data.” International Journal of Remote Sensing 2 (3): 277–291. https://doi.org/10.1080/01431168108948362.
   Google Scholar
• Hussain, M., D. Chen, A. Cheng, H. Wei, and D. Stanley. 2013. “Change Detection from Remotely Sensed Images: From Pixel-Based to Object-Based Approaches.” Isprs Journal of Photogrammetry & Remote Sensing 80:91–106. https://doi.org/10.1016/j.isprsjprs.2013.03.006.
   Web of Science ®Google Scholar
• Jiang, M., X. Zhang, Y. Sun, W. Feng, Q. Gan, and Y. Ruan. 2022. “AFSNet: Attention-Guided Full-Scale Feature Aggregation Network for High-Resolution Remote Sensing Image Change Detection.” GIScience & Remote Sensing 59 (1): 1882–1900. https://doi.org/10.1080/15481603.2022.2142626.
   Web of Science ®Google Scholar
• Jin, S., and S. A. Sader. 2005. “Comparison of Time Series Tasseled Cap Wetness and the Normalized Difference Moisture Index in Detecting Forest Disturbances.” Remote Sensing of Environment 94 (3): 364–372. https://doi.org/10.1016/j.rse.2004.10.012.
   Web of Science ®Google Scholar
• Lebedev, M. A., Y. V. Vizilter, O. V. Vygolov, V. A. Knyaz, and A. Y. Rubis. 2018. “Change Detection in Remote Sensing Images using Conditional Adversarial Networks.” International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences 42 (2): 565–571. https://doi.org/10.5194/isprs-archives-XLII-2-565-2018.
   Google Scholar
• Li, X., M. He, H. Li, and H. Shen. 2021. “A Combined Loss-Based Multiscale Fully Convolutional Network for High-Resolution Remote Sensing Image Change Detection.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2021.3098774.
   Web of Science ®Google Scholar
• Li, Z., C. Tang, X. Liu, W. Zhang, J. Dou, L. Wang, and A. Y. Zomaya. 2023. “Lightweight Remote Sensing Change Detection with Progressive Feature Aggregation and Supervised Attention.” IEEE Transactions on Geoscience & Remote Sensing 61:1–12. https://doi.org/10.1109/TGRS.2023.3241436.
   Web of Science ®Google Scholar
• Lin, T. Y., P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie. 2017. “Feature Pyramid Networks for Object Detection.” Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, Hawaii, 2117–2125.
   Google Scholar
• Liu, J., W. Xuan, Y. Gan, Y. Zhan, J. Liu, and B. Du. 2022. “An End-To-End Supervised Domain Adaptation Framework for Cross-Domain Change Detection.” Pattern Recognition 132:108960. https://doi.org/10.1016/j.patcog.2022.108960.
   Web of Science ®Google Scholar
• Liu, M., Z. Chai, H. Deng, and R. Liu. 2022. “A CNN-Transformer Network with Multiscale Context Aggregation for Fine-Grained Cropland Change Detection.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 15:4297–4306. https://doi.org/10.1109/JSTARS.2022.3177235.
   Web of Science ®Google Scholar
• Liu, Z., Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, and B. Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” Proceedings of the IEEE/CVF international conference on computer vision, Montreal, BC, Canada, 10012–10022.
   Google Scholar
• Loshchilov, I., and F. Hutter. 2017. “Decoupled Weight Decay Regularization.” arXiv preprint arXiv:1711.05101.
   Google Scholar
• Milletari, F., N. Navab, and S. A. Ahmadi. 2016. “V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation.” 2016 fourth international conference on 3D vision (3DV), Standford University, California, USA, 565–571. Ieee.
   Google Scholar
• Ning, X., H. Zhang, R. Zhang, and X. Huang. 2024. “Multi-Stage Progressive Change Detection on High Resolution Remote Sensing Imagery.” Isprs Journal of Photogrammetry & Remote Sensing 207:231–244. https://doi.org/10.1016/j.isprsjprs.2023.11.023.
   Web of Science ®Google Scholar
• Paszke, A., S. Gross, S. Chintala, G. Chanan, E. Yang, Z. DeVito, and A. Lerer. 2017. “Automatic Differentiation in Pytorch.”
   Google Scholar
• Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, Munich, Germany, 234–241. Springer International Publishing.
   Google Scholar
• Russakovsky, O., J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, and L. Fei-Fei. 2015. “Imagenet Large Scale Visual Recognition Challenge.” International Journal of Computer Vision 115 (3): 211–252. https://doi.org/10.1007/s11263-015-0816-y.
   Web of Science ®Google Scholar
• Shi, N., K. Chen, and G. Zhou. 2022. “A Divided Spatial and Temporal Context Network for Remote Sensing Change Detection.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 15:4897–4908. https://doi.org/10.1109/JSTARS.2022.3176858.
   Web of Science ®Google Scholar
• Shi, Q., M. Liu, S. Li, X. Liu, F. Wang, and L. Zhang. 2021. “A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–16. https://doi.org/10.1109/TGRS.2021.3085870.
   Google Scholar
• Song, L., M. Xia, J. Jin, M. Qian, and Y. Zhang. 2021. “SUACDNet: Attentional Change Detection Network Based on Siamese U-Shaped Structure.” International Journal of Applied Earth Observation and Geoinformation 105:102597. https://doi.org/10.1016/j.jag.2021.102597.
   Web of Science ®Google Scholar
• Sun, Y., L. Lei, D. Guan, and G. Kuang. 2021. “Iterative Robust Graph for Unsupervised Change Detection of Heterogeneous Remote Sensing Images.” IEEE Transactions on Image Processing 30:6277–6291. https://doi.org/10.1109/TIP.2021.3093766.
   PubMed Web of Science ®Google Scholar
• Sun, Y., L. Lei, D. Guan, G. Kuang, and L. Liu. 2022. “Graph Signal Processing for Heterogeneous Change Detection.” IEEE Transactions on Geoscience & Remote Sensing 60:1–23. https://doi.org/10.1109/TGRS.2022.3231215.
   Web of Science ®Google Scholar
• Vaswani, A., N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, and I. Polosukhin. 2017. “Attention Is All You Need.” 2017 Conference on Neural Information Processing Systems, Dec 4 - 9, 2017, Long Beach, California, 30.
   Google Scholar
• Wang, L., J. Zhang, Q. Guo, and D. Chen. 2023. “IFTSDNet: An Interact-Feature Transformer Network with Spatial Detail Enhancement Module for Change Detection.” IEEE Geoscience and Remote Sensing Letters. https://doi.org/10.1109/LGRS.2023.3319695.
   Google Scholar
• Wu, Y., and K. He. 2018. “Group Normalization.” Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 3–19.
   Google Scholar
• Zhang, C., P. Yue, D. Tapete, L. Jiang, B. Shangguan, L. Huang, and G. Liu. 2020. “A Deeply Supervised Image Fusion Network for Change Detection in High Resolution Bi-Temporal Remote Sensing Images.” ISPRS Journal of Photogrammetry & Remote Sensing 166:183–200. https://doi.org/10.1016/j.isprsjprs.2020.06.003.
   Web of Science ®Google Scholar
• Zhao, H., J. Shi, X. Qi, X. Wang, and J. Jia. 2017. “Pyramid Scene Parsing Network.” Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, Hawaii, 2881–2890.
   Google Scholar
• Zhu, X., W. Su, L. Lu, B. Li, X. Wang, and J. Dai. 2020. “Deformable Detr: Deformable Transformers for End-To-End Object Detection.” arXiv preprint arXiv:2010.04159.
   Google Scholar