157
Views
0
CrossRef citations to date
0
Altmetric
Research Article

A boundary enhancement loss function for semantic segmentation of land cover

ORCID Icon, ORCID Icon &
Pages 3637-3659 | Received 01 Sep 2022, Accepted 01 Jun 2023, Published online: 09 Jul 2023

References

  • Aurelio, Y. S., G. M. De Almeida, C. L. de Castro, and A. P. Braga. 2019. “Learning from Imbalanced Data Sets with Weighted Cross-Entropy Function.” Neural Processing Letters 50 (2): 1937–1949. https://doi.org/10.1007/s11063-018-09977-1.
  • Badrinarayanan, V., A. Kendall, and R. Cipolla. 2017. “IEEE Transactions on Pattern Analysis and Machine Intelligence.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615.
  • Ball, J. E., D. T. Anderson, and C. S. ChanSr. 2017. “Comprehensive Survey of Deep Learning in Remote Sensing: Theories, Tools, and Challenges for the Community.” Journal of Applied Remote Sensing 11 (4): 042609. https://doi.org/10.1117/1.JRS.11.042609.
  • Benediktsson, J. A., J. A. Palmason, and J. Sveinsson. 2005. “Classification of Hyperspectral Data from Urban Areas Based on Extended Morphological Profiles.” IEEE Transactions on Geoscience and Remote Sensing 43 (3): 480–49. https://doi.org/10.1109/TGRS.2004.842478.
  • Berman, M., A. R. Triki, and M. B. Blaschko. 2018. “The Lovász-Softmax Loss: A Tractable Surrogate for the Optimization of the Intersection-Over-Union Measure in Neural Networks.“ Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,Salt Lake City, UT, USA. 4413–4421. https://doi.org/10.1109/cvpr.2018.00464
  • Boguszewski, A., D. Batorski, N. Ziemba-Jankowska, T. Dziedzic, and A. Zambrzycka. 2021. “LandCover. Ai: Dataset for Automatic Mapping of Buildings, Woodlands, Water and Roads from Aerial Imagery.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 1102–1110. https://doi.org/10.1109/cvprw53098.2021.00121.
  • Chen, L. C., G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 834–848. https://doi.org/10.1109/TPAMI.2017.2699184.
  • Chen, Z., H. Zhou, J. Lai, L. Yang, and X. Xie. 2020. “Contour-Aware Loss: Boundary-Aware Learning for Salient Object Segmentation.” IEEE Transactions on Image Processing 30:431–443. https://doi.org/10.1109/TIP.2020.3037536.
  • Fu, J., J. Liu, H. Tian, Y. Li, Y. Bao, Z. Fang, and H. Lu. 2019. “Dual Attention Network for Scene Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 3146–3154. https://doi.org/10.1109/cvpr.2019.00326.
  • Grinias, I., C. Panagiotakis, and G. Tziritas. 2016. “MRF-Based Segmentation and Unsupervised Classification for Building and Road Detection in Peri-Urban Areas of High-Resolution Satellite Images.” ISPRS Journal of Photogrammetry and Remote Sensing 122:145–166. https://doi.org/10.1016/j.isprsjprs.2016.10.010.
  • Gu, J., H. Kwon, D. Wang, W. Ye, M. Li, Y. H. Chen, and D. Z. Pan 2022. “Multi-Scale High-Resolution Vision Transformer for Semantic Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 12094–12103. https://doi.org/10.1109/cvpr52688.2022.01178.
  • He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, 770–778. https://doi.org/10.1109/cvpr.2016.90.
  • Hoekstra, M., M. Jiang, D. A. Clausi, and C. Duguay. 2020. “Lake Ice-Water Classification of RADARSAT-2 Images by Integrating IRGS Segmentation with Pixel-Based Random Forest Labeling.” Remote Sensing 12 (9): 1425. https://doi.org/10.3390/rs12091425.
  • Huang, B., B. Zhao, and Y. Song. 2018. “Urban Land-Use Mapping Using a Deep Convolutional Neural Network with High Spatial Resolution Multispectral Remote Sensing Imagery.” Remote Sensing of Environment 214:73–86. https://doi.org/10.1016/j.rse.2018.04.050.
  • Jadon, S. A. 2020. “Survey of Loss Functions for Semantic Segmentation.” In 2020 IEEE conference on computational intelligence in bioinformatics and computational biology, Via del Mar, Chile, 1–7. https://doi.org/10.1109/CIBCB48159.2020.9277638.
  • Karimi, D., and S. Salcudean. 2019. “Reducing the Hausdorff Distance in Medical Image Segmentation with Convolutional Neural Networks.” IEEE Transactions on Medical Imaging 39 (2): 499–513. https://doi.org/10.1109/TMI.2019.2930068.
  • Lamchin, M., J. Y. Lee, W. K. Lee, E. J. Lee, M. Kim, C. H. Lim, S. Kim, and S.-R. Kim. 2016. “Assessment of Land Cover Change and Desertification Using Remote Sensing Technology in a Local Region of Mongolia.” Advances in Space Research 57 (1): 64–77. https://doi.org/10.1016/j.asr.2015.10.006.
  • Li, W., J. Chen, and Z. Zhang. 2020. “Forest Ecology and Management.” Forest Ecology and Management 461:117938. https://doi.org/10.1016/j.foreco.2020.117938.
  • Lin, T. Y., P. Goyal, R. Girshick, K. He, and P. Dollár. 2017. “Focal Loss for Dense Object Detection” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA, 2980–2988. https://doi.org/10.1109/iccv.2017.324.
  • Li, W., E. W. Tramel, S. Prasad, and J. E. Fowler. 2013. “Nearest Regularized Subspace for Hyperspectral Classification.” IEEE Transactions on Geoscience & Remote Sensing 52 (1): 477–489.
  • Liu, Z., S. Cui, and Q. Yan. 2008. “Building Extraction from High Resolution Satellite Imagery Based on Multi-Scale Image Segmentation and Model Matching.” in 2008 International workshop on earth observation and remote sensing applications, Beijing, PRC, IEEE, 1–7.
  • Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Boston, MA, USA, 3431–3440. https://doi.org/10.1109/cvpr.2015.7298965.
  • Milletari, F., N. Navab, and S. A. Ahmadi. 2016. ”V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation.” In 2016 Fourth International Conference on 3D Vision (3DV), Stanford, CA, USA, . 565–571.
  • Müller, S., and D. Zaum. 2005. “Robust Building Detection in Aerial Images.” International Archives of Photogrammetry and Remote Sensing 36 (B2/W24): 143–148.
  • Pan, S., W. Zhang, W. Zhang, L. Xu, G. Fan, J. Gong, and H. Gu. 2019. “Diagnostic Model of Coronary Microvascular Disease Combined with Full Convolution Deep Network with Balanced Cross-Entropy Cost Function.” IEEE Access 7:177997–178006. https://doi.org/10.1109/ACCESS.2019.2958825.
  • Peng, J., D. Zhang, and Y. Liu. 2005. “An Improved Snake Model for Building Detection from Urban Aerial Images.” Pattern Recognition Letters 26 (5): 587–595. https://doi.org/10.1016/j.patrec.2004.09.033.
  • Risojević, V., and Z. Babić. 2013. “Unsupervised Learning of Quaternion Features for Image Classification.“ 11th International Conference on Telecommunications in Modern Satellite, Cable and Broadcasting Services (TELSIKS), Nis, Serbia, 1, 345–348. IEEE.
  • Ronneberger, O., P. Fischer, and T. B. Cham. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.“ In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, Springer International Publishing. Part III 18: 234–241.
  • Salehi, S. S. M., D. Erdogmus, and A. Gholipour 2017. “Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks.” In Machine Learning in Medical Imaging: 8th International Workshop, Quebec City, QC, Canada, Springer International Publishing, 379–387. https://doi.org/10.1007/978-3-319-67389-9_44.
  • Scott, G. J., R. A. Marcum, C. H. Davis, and T. Nivin. 2017. “Fusion of Deep Convolutional Neural Networks for Land Cover Classification of High-Resolution Imagery.” IEEE Geoscience and Remote Sensing Letters 14 (9): 1638–1642. https://doi.org/10.1109/LGRS.2017.2722988.
  • Shaker, A., W. Y. Yan, and P. LaRocque. 2019. “Automatic Land-Water Classification Using Multispectral Airborne LiDar Data for Near-Shore and River Environments.” ISPRS Journal of Photogrammetry and Remote Sensing 152:94–108. https://doi.org/10.1016/j.isprsjprs.2019.04.005.
  • Shit, S., J. C. Paetzold, A. Sekuboyina, I. Ezhov, A. Unger, A. Zhylka, and B. H. Menze. 2021. “clDice-A Novel Topology-Preserving Loss Function for Tubular Structure Segmentation.”In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA, 16560–16569. https://doi.org/10.1109/cvpr46437.2021.01629.
  • Strudel, R., R. Garcia, I. Laptev, and C. Schmid. 2021. “Segmenter: Transformer for Semantic Segmentation”. In Proceedings of the IEEE/CVF international conference on computer vision, Nashville, TN, USA, 7262–7272. https://doi.org/10.1109/iccv48922.2021.00717.
  • Takikawa, T., D. Acuna, V. Jampani, and S. Fidler. 2019. “Gated-Scnn: Gated Shape Cnns for Semantic Segmentation.” in Proceedings of the IEEE/CVF International Conference on Computer Vision, Long Beach, CA, USA, 5229–5238. https://doi.org/10.1109/iccv.2019.00533.
  • ThanhNoi, P., and M. Kappas. 2018. “Comparison of Random Forest, K-Nearest Neighbor, and Support Vector Machine Classifiers for Land Cover Classification Using Sentinel-2 Imagery.” Sensors 18 (1): 18. https://doi.org/10.3390/s18010018.
  • Tian, Z., M. Shu, P. Lyu, R. Li, C. Zhou, X. Shen, and J. Jia 2019. “Learning Shape-Aware Embedding for Scene Text Detection.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 4234–4243. https://doi.org/10.1109/cvpr.2019.00436.
  • Wang, C., Y. Wang, R. Wang, and P. Zheng. 2018. “Modeling and Evaluating Land-Use/land-Cover Change for Urban Planning and Sustainability: A Case Study of Dongying City, China.” Journal of Cleaner Production 172:1529–1534. https://doi.org/10.1016/j.jclepro.2017.10.294.
  • Wang, Y., Q. Zhou, J. Liu, J. Xiong, G. Gao, X. Wu, and L. J. Latecki. 2019. “Lednet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation.” In 2019 IEEE International Conference on Image Processing, Taipei, Taiwan, PRC, 1860–1864. https://doi.org/10.1109/icip.2019.8803154.
  • Wu, T., S. Tang, R. Zhang, J. Cao, and Y. Zhang. 2020. “Cgnet: A Light-Weight Context Guided Network for Semantic Segmentation.” IEEE Transactions on Image Processing 30:1169–1179. https://doi.org/10.1109/TIP.2020.3042065.
  • Wu, Q., R. Zhong, W. Zhao, H. Fu, and K. Song. 2017. “International Journal of Remote Sensing” International Journal of Remote Sensing 38 (23): 7176–7195. https://doi.org/10.1080/01431161.2017.1371864.
  • Xu, Y., L. Wu, Z. Xie, and Z. Chen. 2018. “Building Extraction in Very High Resolution Remote Sensing Imagery Using Deep Learning and Guided Filters.” Remote Sensing 10 (1): 144. https://doi.org/10.3390/rs10010144.
  • Yang, C., G. Wu, K. Ding, T. Shi, Q. Li, and J. Wang. 2017. “Improving Land Use/Land Cover Classification by Integrating Pixel Unmixing and Decision Tree Methods.” Remote Sensing 9 (12): 1222. https://doi.org/10.3390/rs9121222.
  • Yang, M., K. Yu, C. Zhang, Z. Li, and K. Yang. 2018. “Denseaspp for Semantic Segmentation in Street Scenes” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA, 3684–3692. https://doi.org/10.1109/cvpr.2018.00388.
  • Yuan, Y., L. Huang, J. Guo, C. Zhang, X. Chen, and J. Wang. 2021. “OCNet: Object Context for Semantic Segmentation.” International Journal of Computer Vision 129 (8): 2375–2398. https://doi.org/10.1007/s11263-021-01465-9.
  • Yu, C., J. Wang, C. Peng, C. Gao, G. Yu, and N. Sang. 2018. “Bisenet: Bilateral Segmentation Network for Real-Time Semantic Segmentation.” In Proceedings of the European conference on computer vision, Munich, Germany, 325–341. https://doi.org/10.1007/978-3-030-01261-8_20.
  • Zhang, L., X. Huang, B. Huang, and P. Li. 2006. “A Pixel Shape Index Coupled with Spectral Information for Classification of High Spatial Resolution Remotely Sensed Imagery.” IEEE Transactions on Geoscience and Remote Sensing 44 (10): 2950–2961. https://doi.org/10.1109/TGRS.2006.876704.
  • Zhang, L., L. Zhang, D. Tao, and X. Huang. 2011. “On Combining Multiple Features for Hyperspectral Remote Sensing Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 50 (3): 879–893. https://doi.org/10.1109/TGRS.2011.2162339.
  • Zhang, L., Q. Zhang, L. Zhang, D. Tao, X. Huang, and B. Du. 2015. “Ensemble Manifold Regularized Sparse Low-Rank Approximation for Multiview Feature Embedding.” Pattern Recognition 48 (10): 3102–3112. https://doi.org/10.1016/j.patcog.2014.12.016.
  • Zhao, H., J. Shi, X. Qi, X. Wang, and J. Jia. 2017. “Pyramid Scene Parsing Network.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 2881–2890. https://doi.org/10.1109/CVPR.2017.660.
  • Zheng, S., J. Lu, H. Zhao, X. Zhu, Z. Luo, Y. Wang, and L. Zhang 2021. “Rethinking Semantic Segmentation from a Sequence-To-Sequence Perspective with Transformers.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Nashville, TN, USA, 6881–6890. https://doi.org/10.1109/CVPR46437.2021.00681.
  • Zhou, L., C. Zhang, and M. Wu. 2018. “D-Linknet: Linknet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA , 182–186. https://doi.org/10.1109/CVPRW.2018.00034.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.