Barlow twin self-supervised pre-training for remote sensing change detection

References

• Caron, M., I. Misra, J. Mairal, P. Goyal, P. Bojanowski, and A. Joulin. 2020. “Unsupervised Learning of Visual Features by Contrasting Cluster Assignments.” Advances in Neural Information Processing Systems 33: 9912–9924.
   Google Scholar
• Chen, X., and K. He 2021. “Exploring Simple Siamese Representation Learning.” In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 15745–15753).
   Google Scholar
• Chen, T., S. Kornblith, M. Norouzi, and G. Hinton. 2020. “A Simple Framework for Contrastive Learning of Visual Representations.” arXiv:2002.05709.
   Google Scholar
• Chen, H., W. Li, S. Chen, and Z. Shi. 2022. “Semantic-Aware Dense Representation Learning for Remote Sensing Image Change Detection.” IEEE Transactions on Geoscience and Remote Sensing 60:1–18. https://doi.org/10.1109/TGRS.2022.3203769.
   Web of Science ®Google Scholar
• Chen, H., Z. Qi, and Z. Shi. 2022. “Remote Sensing Image Change Detection with Transformers.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 60:1–14. https://doi.org/10.1109/TGRS.2021.3095166.
   Google Scholar
• Chen, H., and Z. Shi. 2020. “A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection.” Remote Sensing 12 (10): 1662–1680. https://doi.org/10.3390/rs12101662.
   Web of Science ®Google Scholar
• Chen, J., Z. Yuan, J. Peng, L. Chen, H. Huang, J. Zhu, Y. Liu, and H. Li. 2020. “DASNet: Dual Attentive Fully Convolutional Siamese Networks for Change Detection in High-Resolution Satellite Images.” IEEE Journal of Selected Topics in Applied Earth Observations & Remote Sensing 14:1194–1206. https://doi.org/10.1109/JSTARS.2020.3037893.
   Web of Science ®Google Scholar
• Daudt, R., B. Le Saux, and A. Boulch 2018. “Fully Convolutional Siamese Networks for Change Detection.” In 2018 25th IEEE International Conference on Image Processing (ICIP) (pp. 4063–4067).
   Google Scholar
• Deng, J., W. Dong, R. Socher, L. Li, K. Li, and F. Li 2009. “ImageNet: A Large-Scale Hierarchical Image Database.” In 2009 IEEE Conference on Computer Vision and Pattern Recognition (pp. 248–255).
   Google Scholar
• Fang, S., K. Li, J. Shao, and Z. Li. 2022. “SNUNet-CD: A Densely Connected Siamese Network for Change Detection of VHR Images.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2021.3056416.
   Web of Science ®Google Scholar
• Feng, G., J. Dong, L. Bo, and Q. Xu. 2017. “Automatic Change Detection in Synthetic Aperture Radar Images Based on PCANet.” IEEE Geoscience & Remote Sensing Letters 13 (12): 1792–1796. https://doi.org/10.1109/LGRS.2016.2611001.
   Web of Science ®Google Scholar
• Geng, J., H. Wang, J. Fan, and X. Ma 2017. “Change Detection of SAR Images Based on Supervised Contractive Auto-Encoders and Fuzzy Clustering.” IEEE International Workshop on Remote Sensing with Intelligent Processing (RSIP), Shanghai, China.
   Google Scholar
• Gong, M., P. Zhang, T. Zhan, and Q. Miao. 2017. “Superpixel-Based Difference Representation Learning for Change Detection in Multi-Spectral Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 55 (6): 2658–2673. https://doi.org/10.1109/TGRS.2017.2650198.
   Google Scholar
• Grill, J., F. Strub, F. Altché, C. Tallec, P. Richemond, E. Buchatskaya, C. Doersch. et al. 2020. “Bootstrap Your Own Latent: A New Approach to Self-Supervised Learning. Advances in neural information processing systems 33:21271–21284.
   Google Scholar
• He, K., H. Fan, Y. Wu, S. Xie, and R. Girshick. 2019. “Momentum Contrast for Unsupervised Visual Representation Learning.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (pp. 9729–9738).
   Google Scholar
• Liu, Y., C. Pang, Z. Zhan, X. Zhang, and X. Yang. 2020. “Building Change Detection for Remote Sensing Images Using a Dual-Task Constrained Deep Siamese Convolutional Network Model.” IEEE Geoscience & Remote Sensing Letters 18 (5): 811–815. https://doi.org/10.1109/LGRS.2020.2988032.
   Web of Science ®Google Scholar
• Liu, M., Q. Shi, A. Marinoni, D. He, X. Liu, and L. Zhang. 2021. “Super-Resolution-Based Change Detection Network with Stacked Attention Module for Images with Different Resolutions.” IEEE Transactions on Geoscience and Remote Sensing 60:1–18. https://doi.org/10.1109/TGRS.2021.3091758.
   Web of Science ®Google Scholar
• Papadomanolaki, M., S. Verma, M. Vakalopoulou, S. Gupta, and K. Karantzalos 2019. “Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Data.” In IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium (pp. 214–217).
   Google Scholar
• Peng, D., Y. Zhang, and H. Guan. 2019. “End-To-End Change Detection for High Resolution Satellite Images Using Improved UNet++.” Remote Sensing 11 (11): 1382. https://doi.org/10.3390/rs11111382.
   Web of Science ®Google Scholar
• Roy, A. G., N. Navab, and C. Wachinger 2018. “Concurrent Spatial and Channel ‘Squeeze & Excitation’in Fully Convolutional Networks.” In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Granada, Spain, September 16-20, Proceedings, Part I (pp. 421–429).
   Google Scholar
• Shi, Q., M. Liu, S. Li, X. Liu, F. Wang, and L. Zhang. 2022. “A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection.” IEEE Transactions on Geoscience and Remote Sensing: A Publication of the IEEE Geoscience and Remote Sensing Society 60:1–16. https://doi.org/10.1109/TGRS.2021.3085870.
   Web of Science ®Google Scholar
• Su, L., M. Gong, P. Zhang, M. Zhang, J. Liu, and H. Yang. 2017. “Deep Learning and Mapping Based Ternary Change Detection for Information Unbalanced Images.” Pattern Recognition 66:213–228. https://doi.org/10.1016/j.patcog.2017.01.002.
   Web of Science ®Google Scholar
• Zbontar, J., L. Jing, I. Misra, Y. LeCun, and S. Deny. 2021. “Barlow Twins: Self-Supervised Learning via Redundancy Reduction.” In International Conference on Machine Learning (pp. 12310–12320). PMLR.
   Google Scholar
• Zhang, C., P. Yue, D. Tapete, L. Jiang, B. Shangguan, L. Huang, and G. Liu. 2020. “A Deeply Supervised Image Fusion Network for Change Detection in High Resolution Bi-Temporal Remote Sensing Images.” ISPRS Journal of Photogrammetry & Remote Sensing 166:183–200. https://doi.org/10.1016/j.isprsjprs.2020.06.003.
   Web of Science ®Google Scholar