149
Views
0
CrossRef citations to date
0
Altmetric
Research Article

Optimal transport-based domain adaptation for semantic segmentation of remote sensing images

, ORCID Icon, ORCID Icon &
Pages 420-450 | Received 04 Aug 2023, Accepted 15 Dec 2023, Published online: 16 Jan 2024

References

  • Ackaouy, A., N. Courty, E. Vallée, O. Commowick, C. Barillot, and F. Galassi. 2020. “Unsupervised Domain Adaptation with Optimal Transport in Multi-Site Segmentation of Multiple Sclerosis Lesions from MRI Data.” Frontiers in Computational Neuroscience 14:19. https://doi.org/10.3389/fncom.2020.00019.
  • Arjovsky, M., S. Chintala, and L. Bottou. 2017, July. “Wasserstein generative adversarial networks.” In International conference on Machine Learning, Sydney, Australia, 214–223. PMRL.
  • Benjdira, B., Y. Bazi, A. Koubaa, and K. Ouni. 2019. “Unsupervised Domain Adaptation Using Generative Adversarial Networks for Semantic Segmentation of Aerial Images.” Remote Sensing 11 (11): 1369. https://doi.org/10.3390/rs11111369.
  • Biasetton, M., U. Michieli, G. Agresti, and P. Zanuttigh. 2019. “Unsupervised domain adaptation for semantic segmentation of urban scenes.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CA, USA, 1211–1220.
  • Bonneel, N., M. Van De Panne, S. Paris, and W. Heidrich. 2011, December. “Displacement Interpolation Using Lagrangian Mass Transport.” In Proceedings of the 2011 SIGGRAPH Asia Conference, Hong Kong, China, 1–12.
  • Cai, Y., Y. Yang, Q. Zheng, Z. Shen, Y. Shang, J. Yin, and Z. Shi. 2022. “BiFdanet: Unsupervised Bidirectional Domain Adaptation for Semantic Segmentation of Remote Sensing Images.” Remote Sensing 14 (1): 190. https://doi.org/10.3390/rs14010190.
  • Chang, W. L., H. P. Wang, W. H. Peng, and W. C. Chiu. 2019. “All About Structure: Adapting Structural Information Across Domains for Boosting Semantic Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CA, USA, 1900–1909.
  • Chen, Y. C., Y. Y. Lin, M. H. Yang, and J. B. Huang. 2019. “Crdoco: Pixel-Level Domain Transfer with Cross-Domain Consistency.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CA, USA, 1791–1800.
  • Chen, L. C., G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 834–848. https://doi.org/10.1109/TPAMI.2017.2699184.
  • Chen, J. S., B. Sun, L. Wang, B. Fang, Y. Chang, Y. Li, and G. Chen. 2022. “Semi-Supervised Semantic Segmentation Framework with Pseudo Supervisions for Land-Use/land-Cover Mapping in Coastal Areas.” International Journal of Applied Earth Observation and Geoinformation 112:102881. https://doi.org/10.1016/j.jag.2022.102881.
  • Chen, J., J. Zhu, Y. Guo, G. Sun, Y. Zhang, and M. Deng. 2022. “Unsupervised Domain Adaptation for Semantic Segmentation of High-Resolution Remote Sensing Imagery Driven by Category-Certainty Attention.” IEEE Transactions on Geoscience and Remote Sensing 60:1–15. https://doi.org/10.1109/TGRS.2021.3140108.
  • Courty, N., R. Flamary, A. Habrard, and A. Rakotomamonjy. 2017. “Joint distribution optimal transportation for domain adaptation.” In Advances in Neural Information Processing Systems, CA, USA, 30.
  • Damodaran, B. B., R. Flamary, V. Seguy, and N. Courty. 2020. “An Entropic Optimal Transport Loss for Learning Deep Neural Networks Under Label Noise in Remote Sensing Images.” Computer Vision and Image Understanding 191:102863. https://doi.org/10.1016/j.cviu.2019.102863.
  • Damodaran, B. B., B. Kellenberger, R. Flamary, D. Tuia, and N. Courty. 2018. “Deepjdot: Deep Joint Distribution Optimal Transport for Unsupervised Domain Adaptation.“ In Proceedings of the European Conference on Computer Vision, Munich, Germany, 447–463. ECCV.
  • Dechesne, C., C. Mallet, A. Le Bris, and V. Gouet-Brunet. 2017. “Semantic Segmentation of Forest Stands of Pure Species Combining Airborne Lidar Data and Very High Resolution Multispectral Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 126:129–145. https://doi.org/10.1016/j.isprsjprs.2017.02.011.
  • Ferradans, S., N. Papadakis, G. Peyré, and J. F. Aujol. 2014. “Regularized Discrete Optimal Transport.” SIAM Journal on Imaging Sciences 7 (3): 1853–1882. https://doi.org/10.1137/130929886.
  • Flamary, R., N. Courty, D. Tuia, and A. Rakotomamonjy. 2016. “Optimal Transport for Domain Adaptation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 1 (1–40): 2.
  • Gao, H., J. Guo, G. Wang, and Q. Zhang. 2022. “Cross-domain correlation distillation for unsupervised domain adaptation in nighttime semantic segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Louisiana, USA, 9913–9923.
  • Gao, H., Y. Zhao, P. Guo, Z. Sun, X. Chen, and Y. Tang. 2022. “Cycle and Self-Supervised Consistency Training for Adapting Semantic Segmentation of Aerial Images.” Remote Sensing 14 (7): 1527. https://doi.org/10.3390/rs14071527.
  • Gerke, M. 2014. “Use of the Stair Vision Library within the ISPRS 2D Semantic Labeling Benchmark (Vaihingen).” https://api.semanticscholar.org/CorpusID:15615002.
  • Gonzalez, R. C., and R. E. Woods. 2006. Digital Image Processing. 653–658. 3rd ed. Upper Saddle River, NJ, USA: Pearson Education.
  • Guo, Y., X. Wang, C. Li, and S. Ying. 2023. “Domain Adaptive Semantic Segmentation by Optimal Transport.” Fundamental Research. https://doi.org/10.1016/j.fmre.2023.06.006.
  • He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE Conference on Computer Vision and Pattern recognition, Nevada, USA, 770–778.
  • Hoffman, J., E. Tzeng, T. Park, J. Y. Zhu, P. Isola, K. Saenko, A. Efros, and T. Darrell. 2018. “Cycada: Cycle-Consistent Adversarial Domain Adaptation.” In International conference on machine learning, PMLR, Stockholm, Sweden, 1989–1998.
  • Hong, D., L. Gao, N. Yokoya, J. Yao, J. Chanussot, Q. Du, and B. Zhang. 2020. “More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (5): 4340–4354. https://doi.org/10.1109/TGRS.2020.3016820.
  • Huang, H., Q. Huang, and P. Krahenbuhl. 2018. “Domain Transfer Through Deep Activation Matching.” In Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany, 590–605.
  • Jiang, Z., Y. Li, C. Yang, P. Gao, Y. Wang, Y. Tai, and C. Wang. 2022. “Prototypical contrast adaptation for domain adaptive semantic segmentation.” In European Conference on Computer Vision, 36–54. Cham: Springer Nature Switzerland.
  • Ji, S., D. Wang, and M. Luo. 2020. “Generative Adversarial Network-Based Full-Space Domain Adaptation for Land Cover Classification from Multiple-Source Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 59 (5): 3816–3828. https://doi.org/10.1109/TGRS.2020.3020804.
  • Lee, G., C. Eom, W. Lee, H. Park, and B. Ham. 2022. “Bi-Directional Contrastive Learning for Domain Adaptive Semantic Segmentation.” In European Conference on Computer Vision, 38–55. Cham: Springer Nature Switzerland.
  • Li, R., S. Li, C. He, Y. Zhang, X. Jia, and L. Zhang. 2022. “Class-Balanced Pixel-Level Self-Labeling for Domain Adaptive Semantic Segmentation.“ In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 11593–11603.
  • Liu, W., and F. Su. 2019. “Unsupervised adversarial domain adaptation network for semantic segmentation.” IEEE Geoscience and Remote Sensing Letters 17 (11): 1978–1982. https://doi.org/10.1109/LGRS.2019.2956490.
  • Li, M., Y. M. Zhai, Y. W. Luo, P. F. Ge, and C. X. Ren. 2020. “Enhanced transport distance for unsupervised domain adaptation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13936–13944.
  • Lyu, Y., G. Vosselman, G. S. Xia, A. Yilmaz, and M. Y. Yang. 2020. “UAVid: A Semantic Segmentation Dataset for UAV Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 165:108–119. https://doi.org/10.1016/j.isprsjprs.2020.05.009.
  • Marsden, R. A., A. Bartler, M. Döbler, and B. Yang. 2022. “Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentation.” In 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy, 1–8. IEEE.
  • Marsden, R. A., F. Wiewel, M. Döbler, Y. Yang, and B. Yang. 2022. “Continual Unsupervised Domain Adaptation for Semantic Segmentation Using a Class-Specific Transfer.” In 2022 International Joint Conference on Neural Networks (IJCNN), Padua, Italy, 1–8. IEEE.
  • Ma, X., X. Zhang, Z. Wang, and M. O. Pun. 2023. “Unsupervised Domain Adaptation Augmented by Mutually Boosted Attention for Semantic Segmentation of Vhr Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 61:1–15. https://doi.org/10.1109/TGRS.2023.3240982.
  • Michieli, U., M. Biasetton, G. Agresti, and P. Zanuttigh. 2020. “Adversarial Learning and Self-Teaching Techniques for Domain Adaptation in Semantic Segmentation.” IEEE Transactions on Intelligent Vehicles 5 (3): 508–518. https://doi.org/10.1109/TIV.2020.2980671.
  • Mo, Y., Y. Wu, X. Yang, F. Liu, and Y. Liao. 2022. “Review the State-Of-The-Art Technologies of Semantic Segmentation Based on Deep Learning.” Neurocomputing 493:626–646. https://doi.org/10.1016/j.neucom.2022.01.005.
  • Nguyen, T., T. Le, N. Dam, Q. H. Tran, and D. Q. Phung. 2021. “TIDOT: A Teacher Imitation Learning Approach for Domain Adaptation with Optimal Transport.” In International Joint Conferences on Artificial Intelligence (IJCAI), Montreal, Canada, 2862–2868.
  • Pan, S. J., and Q. Yang. 2009. “A Survey on Transfer Learning.” IEEE Transactions on Knowledge and Data Engineering 22 (10): 1345–1359. https://doi.org/10.1109/TKDE.2009.191.
  • Pitie, F., A. C. Kokaram, and R. Dahyot. 2005. “N-Dimensional Probability Density Function Transfer and Its Application to Color Transfer.” In Tenth IEEE International Conference on Computer Vision (ICCV’05) Volume 1, Beijing, China, 2:1434–1439. IEEE.
  • Shen, J., Y. Qu, W. Zhang, and Y. Yu. 2018, April. “Wasserstein Distance Guided Representation Learning for Domain Adaptation.” In Proceedings of the AAAI Conference on Artificial Intelligence, LA, USA, 32:4058–4065.
  • Tasar, O., S. L. Happy, Y. Tarabalka, and P. Alliez. 2020. “ColorMapgan: Unsupervised Domain Adaptation for Semantic Segmentation Using Color Mapping Generative Adversarial Networks.” IEEE Transactions on Geoscience and Remote Sensing 58 (10): 7178–7193. https://doi.org/10.1109/TGRS.2020.2980417.
  • Tsai, Y. H., W. C. Hung, S. Schulter, K. Sohn, M. H. Yang, and M. Chandraker. 2018. “Learning to Adapt Structured Output Space for Semantic Segmentation.” In Proceedings of the IEEE conference on computer vision and pattern recognition, UT, USA, 7472–7481.
  • Villani, C. 2009. Optimal Transport: Old and New. Vol. 338. Berlin: springer.
  • Wang, Z., M. Yu, Y. Wei, R. Feris, J. Xiong, W. M. Hwu, and H. Shi. 2020. “Differential Treatment for Stuff and Things: A Simple Unsupervised Domain Adaptation Method for Semantic Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual, 12635–12644.
  • Wurm, M., T. Stark, X. X. Zhu, M. Weigand, and H. Taubenböck. 2019. “Semantic Segmentation of Slums in Satellite Images Using Transfer Learning on Fully Convolutional Neural Networks.” ISPRS Journal of Photogrammetry and Remote Sensing 150:59–69. https://doi.org/10.1016/j.isprsjprs.2019.02.006.
  • Xu, Q., X. Yuan, and C. Ouyang. 2022. “Class-Aware Domain Adaptation for Semantic Segmentation of Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 60:1–17. https://doi.org/10.1109/TGRS.2020.3031926.
  • Yi, Z., H. Zhang, P. Tan, and M. Gong. 2017. “Dualgan: Unsupervised Dual Learning for Image-To-Image Translation.” In Proceedings of the IEEE international conference on computer vision, Venice, Italy, 2849–2857.
  • Zhang, Z., K. Doi, A. Iwasaki, and G. Xu. 2020. “Unsupervised Domain Adaptation of High-Resolution Aerial Images via Correlation Alignment and Self Training.” IEEE Geoscience and Remote Sensing Letters 18 (4): 746–750. https://doi.org/10.1109/LGRS.2020.2982783.
  • Zhu, J. Y., T. Park, P. Isola, and A. A. Efros. 2017. “Unpaired Image-To-Image Translation Using Cycle-Consistent Adversarial Networks.” In Proceedings of the IEEE international conference on computer vision, Venice, Italy, 2223–2232.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.