FSAU-Net: a network for extracting buildings from remote sensing imagery using feature self-attention

References

• Badrinarayanan, V., A. Kendall, and R. Cipolla. 2017. “Segnet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. doi:10.1109/TPAMI.2016.2644615.
   PubMed Web of Science ®Google Scholar
• Bhangale, K., P. Ingle, R. Kanase, and D. Desale2021. “Multi-View Multi-Pose Robust Face Recognition Based on VGGNet.” In International Conference on Image Processing and Capsule Networks, Cham: Springer, 414–421.
   Google Scholar
• Cao, D., H. Xing, M. S. Wong, M. P. Kwan, H. Xing, and Y. Meng. 2021. “A Stacking Ensemble Deep Learning Model for Building Extraction from Remote Sensing Images.” Remote Sensing 13 (19): 3898. doi:10.3390/rs13193898.
   Web of Science ®Google Scholar
• Chen, L. C., G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected Crfs.” IEEE Transactions on Pattern Analysis and Machine Intelligence 40 (4): 834–848. doi:10.1109/TPAMI.2017.2699184.
   PubMed Web of Science ®Google Scholar
• Chen, M., F. Tang, and J. Pan 2020. “Using Polar Grid for Building Extraction in Terrestrial Laser Scanning Data.” IGARSS 2020-2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA, 1632–1634.
   Google Scholar
• Chen, H. C., A. M. Widodo, A. Wisnujati, M. Rahaman, J. C. W. Lin, L. Chen, and C. E. Weng. 2022. “AlexNet Convolutional Neural Network for Disease Detection and Classification of Tomato Leaf.” Electronics 11 (6): 951. doi:10.3390/electronics11060951.
   Web of Science ®Google Scholar
• Chen, Y., X. Zhang, W. Chen, Y. Li, and J. Wang. 2020. “Research on Recognition of Fly Species Based on Improved RetinaNet and CBAM.” IEEE Access 8: 102907–102919. doi:10.1109/ACCESS.2020.2997466.
   Web of Science ®Google Scholar
• Futagami, T., and N. Hayasaka 2019. “Automatic Extraction of Building Regions by Using Color Clustering.” 2019 58th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE), Akita, Japan, 415–419.
   Google Scholar
• Gao, X., M. Wang, Y. Yang, and G. Li. 2018. “Building Extraction from RGB VHR Images Using Shifted Shadow Algorithm.” IEEE Access 6: 22034–22045. doi:10.1109/ACCESS.2018.2819705.
   Web of Science ®Google Scholar
• Guo, H., Q. Shi, B. Du, L. Zhang, D. Wang, and H. Ding. 2020. “Scene-Driven Multitask Parallel Attention Network for Building Extraction in High-Resolution Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 59 (5): 4287–4306. doi:10.1109/TGRS.2020.3014312.
   Web of Science ®Google Scholar
• Hao, L., Y. Zhang, and Z. Cao 2016. “Building Extraction from Stereo Aerial Images Based on Multi-Layer Line Grouping with Height Constraint.” 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, 445–448.
   Google Scholar
• He, S., and W. Jiang. 2021. “Boundary-Assisted Learning for Building Extraction from Optical Remote Sensing Imagery.” Remote Sensing 13 (4): 760. doi:10.3390/rs13040760.
   Web of Science ®Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun 2016. “Deep Residual Learning for Image Recognition.” Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA, 770–778.
   Google Scholar
• Howard, A. G., M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, and H. Adam. 2017. “Mobilenets: Efficient Convolutional Neural Networks for Mobile Vision Applications.” ArXiv Preprint ArXiv: 1704.04861.
   Google Scholar
• Hu, J., L. Shen, and G. Sun 2018. “Squeeze-And-Excitation Networks.” Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA, 7132–7141.
   Google Scholar
• Hu, L., J. Zheng, and F. Gao 2011. “A Building Extraction Method Using Shadow in High Resolution Multispectral images.” 2011 IEEE International Geoscience and Remote Sensing Symposium, Vancouver, BC, Canada, 1862–1865.
   Google Scholar
• Javaid, N. 2021. “A PLSTM, AlexNet and ESNN Based Ensemble Learning Model for Detecting Electricity Theft in Smart Grids.” IEEE Access 9: 162935–162950. doi:10.1109/ACCESS.2021.3134754.
   Web of Science ®Google Scholar
• Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2012. “Imagenet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. doi:10.1145/3065386.
   Google Scholar
• LeCun, Y., L. Bottou, Y. Bengio, and P. Haffner. 1998. “Gradient-Based Learning Applied to Document Recognition.” Proceedings of the IEEE 86 (11): 2278–2324. doi:10.1109/5.726791.
   Web of Science ®Google Scholar
• Lee, T., Y. S. Kim, and T. Kim 2013. “Automatic Building Information Extraction by Modified Volumetric Shadow Analysis from High Resolution Multispectral Data.” In 2013 IEEE International Geoscience and Remote Sensing Symposium-IGARSS, Melbourne, VIC, Australia, 3974–3977.
   Google Scholar
• Li, X., B. Du, and L. Zhang 2019. “Building Extraction from Remote Sensing Image with Privileged Information.” IGARSS 2019-2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan, 48–51.
   Google Scholar
• Li, C., L. Fu, Q. Zhu, J. Zhu, Z. Fang, Y. Xie, and Y. Gong. 2021. “Attention Enhanced U-Net for Building Extraction from Farmland Based on Google and WorldView-2 Remote Sensing Images.” Remote Sensing 13 (21): 4411. doi:10.3390/rs13214411.
   Web of Science ®Google Scholar
• Lin, K., T. Zhou, X. Gao, Z. Li, H. Duan, H. Wu, and Y. Zhao. 2022. ““Deep Convolutional Neural Networks for Construction and Demolition Waste Classification: VGGNet structures.” Cyclical Learning Rate, and Knowledge Transfer.” Journal of Environmental Management 318: 115501. doi:10.1016/j.jenvman.2022.115501.
   PubMed Web of Science ®Google Scholar
• Liu, C., X. Huang, H. Chen, J. Yang, and J. Gong 2018. “Building Area Extraction from High-Resoluton Satellite Imagery Based on Morphological Building Index.” IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, 8201–8204.
   Google Scholar
• Liu, C., S. M. Sepasgozar, Q. Zhang, and L. Ge. 2022. “A Novel Attention-Based Deep Learning Method for Post-Disaster Building Damage Classification.” Expert Systems with Applications 202: 117268. doi:10.1016/j.eswa.2022.117268.
   Web of Science ®Google Scholar
• Li, S., L. Wang, J. Li, and Y. Yao. 2021. “Image Classification Algorithm Based on Improved AlexNet.” In Journal of Physics: Conference Series 1813 (1): 012051. IOP Publishing. doi:10.1088/1742-6596/1813/1/012051.
   Google Scholar
• Long, J., E. Shelhamer, and T. Darrell 2015. “Fully Convolutional Networks for Semantic Segmentation.” Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA, 3431–3440.
   Google Scholar
• Lu, S., X. Chen, and J. Fu 2011. “Semi-Automatic Building Extraction from High Resolution Remote Sensing Imagery Based on Mathematical Morphology.” 2011 International Conference on Multimedia Technology, Hangzhou, 5080–5083.
   Google Scholar
• Maggiori, E., Y. Tarabalka, G. Charpiat, and P. Alliez 2017. “Can Semantic Labeling Methods Generalize to Any City? The Inria Aerial Image Labeling Benchmark.” IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA, 3226–3229.
   Google Scholar
• Pranoto, H., Y. Heryadi, H. L. H. S. Warnars, and W. Budiharto. 2022. “Enhanced IPCGAN-Alexnet Model for New Face Image Generating on Age Target.” Journal of King Saud University-Computer and Information Sciences 34 (9): 7236–7246. doi:10.1016/j.jksuci.2021.09.002.
   Web of Science ®Google Scholar
• Ronneberger, O., P. Fischer, and T. Brox 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” In International Conference on Medical image computing and computer-assisted intervention, Cham: Springer, 234–241.
   Google Scholar
• Shen, W., J. Zhang, and F. Yuan 2011. “A New Algorithm of Building Boundary Extraction Based on LIDAR Data.” 2011 19th International Conference on Geoinformatics, Shanghai, China, 1–4.
   Google Scholar
• Shunping, J. I., and W. E. I. Shiqing. 2019. “Convolutional Neural Network and Open Source Data Set Method for Building Extraction from Remote Sensing Images.” ActaGeodaetica Cartographica Sinica 48 (4): 448–459.
   Google Scholar
• Simonyan, K., and A. Zisserman 2013. “Very Deep Convolutional Neural Networks for Large-Scale Image Recognition.” Proceedings of the International Conference on Learning Representations, Kunming, China, 25–27.
   Google Scholar
• Singh, D., R. Maurya, A. S. Shukla, M. K. Sharma, and P. R. Gupta 2012. “Building Extraction from Very High Resolution Multispectral Images Using NDVI Based Segmentation and Morphological Operators.” 2012 Students Conference on Engineering and Systems, Allahabad, India, 1–5.
   Google Scholar
• Srinivas, M., and D. V. Shakira. 2021. “A Novel Satellite Image Segmentation Using Vggnet.” PalArch’s Journal of Archaeology of Egypt/egyptology 18 (4): 1596–1607.
   Google Scholar
• Sun, Y., C. Wang, J. Li, Z. Zhang, D. Zai, P. Huang, and C. Wen 2016. “Automated Segmentation of LiDar Point Clouds for Building Rooftop Extraction.” 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China, 1472–1475.
   Google Scholar
• Sun, K., B. Xiao, D. Liu, and J. Wang 2019. “Deep High-Resolution Representation Learning for Human Pose Estimation.” Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, USA, 5693–5703.
   Google Scholar
• Sun, K., Y. Zhao, B. Jiang, T. Cheng, B. Xiao, D. Liu, and J. Wang. 2019. “High-Resolution Representations for Labeling Pixels and Regions.” ArXiv Areprint ArXiv 1904.04514.
   Google Scholar
• Szegedy, C., W. Liu, Y. Jia, P. Sermanet, S. Reed, D. Anguelov, and A. Rabinovich 2015. “Going Deeper with Convolutions.” Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA, 1–9.
   Google Scholar
• Tian, Q., Y. Zhao, Y. Li, J. Chen, X. Chen, and K. Qin. 2021. “Multiscale Building Extraction with Refined Attention Pyramid Networks.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. doi:10.1109/LGRS.2021.3075436.
   Web of Science ®Google Scholar
• Wang, X., J. Liu, S. Zhang, Q. Deng, Z. Wang, Y. Li, and J. Fan. 2021. “Detection of Oil Spill Using SAR Imagery Based on AlexNet Model.” Computational Intelligence and Neuroscience 2021: 14. Article ID 4812979. doi:10.1155/2021/4812979.
   Web of Science ®Google Scholar
• Wang, C., K. Lu, J. Xue, and Y. Yan 2019. “Dense Attention Network for Facial Expression Recognition in the Wild.” Proceedings of the ACM Multimedia Asia, 1–6.
   Google Scholar
• Wang, Q., B. Wu, P. Zhu, P. Li, W. Zuo, and Q. Hu. 2020. “Eca-Net: Efficient Channel Attention for Deep Convolutional Neural Networks.” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 11531–11539.
   Google Scholar
• Wang, Y., X. Zeng, X. Liao, and D. Zhuang. 2022. “B-FGC-Net: A Building Extraction Network from High Resolution Remote Sensing Imagery.” Remote Sensing 14 (2): 269. doi:10.3390/rs14020269.
   Web of Science ®Google Scholar
• Wegner, J. D., and U. Soergel 2011. “A Contextual Approach to Building Extraction Combining Highre-Solution InSar and Optical Data.” 2011 IEEE International Geoscience and Remote Sensing Symposium, Vancouver, BC, Canada, 2377–2380.
   Google Scholar
• Woo, S., J. Park, J. Y. Lee, and I. S. Kweon 2018. “Cbam: Convolutional Block Attention Module.” In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 3–19.
   Google Scholar
• Xiang, S., Q. Xie, and M. Wang. 2021. “Semantic Segmentation for Remote Sensing Images Based on Adaptive Feature Selection Network.” IEEE Geoscience and Remote Sensing Letters 19: 1–5. doi:10.1109/LGRS.2021.3049125.
   Web of Science ®Google Scholar
• Yang, Z. 2021. Classification of Picture Art Style Based on VGGNET. In Journal of Physics: Conference Series 1774 (1): 012043. IOP Publishing. 10.1088/1742-6596/1774/1/012043.
   Google Scholar
• Yuan, Q., H. Z. M. Shafri, A. H. Alias, and S. J. B. Hashim. 2021. “Multiscale Semantic Feature Optimization and Fusion Network for Building Extraction Using High-Resolution Aerial Images and LiDar Data.” Remote Sensing 13 (13): 2473. doi:10.3390/rs13132473.
   Web of Science ®Google Scholar
• Zhao, C., H. Lin, Y. Yan, N. Su, and S. Tian 2021. “A Complete Building Extraction Framework for Airborne Laser Scanning Point Cloud.” 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium, 5295–5298.
   Google Scholar
• Zhao, H., J. Shi, X. Qi, X. Wang, and J. Jia 2017. “Pyramid Scene Parsing Network.” Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.pp, 2881–2890.
   Google Scholar
• Zhou, Z., M. M. R. Siddiquee, N. Tajbakhsh, and J. U. Liang. 2018. A Nested U-Net Architecture for Medical Image Segmentation. arXiv preprint arXiv:1807.10165.
   Google Scholar
• Zhou, D., G. Wang, G. He, T. Long, R. Yin, Z. Zhang, and B. Luo. 2020. “Robust Building Extraction for High Spatial Resolution Remote Sensing Images with Self-Attention Network.” Sensors 20 (24): 7241. doi:10.3390/s20247241.
   PubMed Web of Science ®Google Scholar
• Zhu, Y., B. Huang, J. Gao, E. Huang, and H. Chen. 2021. “Adaptive Polygon Generation Algorithm for Automatic Building Extraction.” IEEE Transactions on Geoscience and Remote Sensing 60: 1–14. doi:10.1109/TGRS.2021.3081582.
   Web of Science ®Google Scholar
• Zhu, Q., C. Liao, H. Hu, X. Mei, and H. Li. 2020. “MAP-Net: Multiple Attending Path Neural Network for Building Footprint Extraction from Remote Sensed Imagery.” IEEE Transactions on Geoscience and Remote Sensing 59 (7): 6169–6181. doi:10.1109/TGRS.2020.3026051.
   Web of Science ®Google Scholar