MFAGNet: multi-scale frequency attention gating network for land cover classification

References

• Al-Sumaidaee, S. A., M. A. Abdullah, R. Rafi Omar Al-Nima, S. Singh Dlay, and J. A. Chambers. 2017. “Multi-Gradient Features and Elongated Quinary Pattern Encoding for Image-Based Facial Expression Recognition.” Pattern recognition 71: 249–263. https://doi.org/10.1016/j.patcog.2017.06.007.
   Web of Science ®Google Scholar
• Ayhan, B., and C. Kwan. 2020. “Tree, Shrub, and Grass Classification Using Only RGB Images.” Remote Sensing 12 (8): 1333. https://doi.org/10.3390/rs12081333.
   Web of Science ®Google Scholar
• Badrinarayanan, V., A. Kendall, and R. Cipolla. 2017. “Segnet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (12): 2481–2495. https://doi.org/10.1109/TPAMI.2016.2644615.
   PubMed Web of Science ®Google Scholar
• Bai, L., X. Lin, Z. Ye, D. Xue, C. Yao, and M. Hui. 2022. “MsanlfNet: Semantic Segmentation Network with Multiscale Attention and Nonlocal Filters for High-Resolution Remote Sensing Images.” IEEE Geoscience & Remote Sensing Letters 19:1–5. https://doi.org/10.1109/LGRS.2022.3185641.
   Web of Science ®Google Scholar
• Bárdossy, A., and L. Samaniego. 2002. “Fuzzy Rule-Based Classification of Remotely Sensed Imagery. IEEE Transactions on Geoscience and Remote Sensing.” IEEE Transactions on Geoscience and Remote Sensing 40 (2): 362–374. https://doi.org/10.1109/36.992798.
   Web of Science ®Google Scholar
• Bergado, J. R., C. Persello, and A. Stein. 2018. “Recurrent Multiresolution Convolutional Networks for VHR Image Classification. IEEE Transactions on Geoscience and Remote Sensing.” IEEE Transactions on Geoscience and Remote Sensing 56 (11): 6361–6374. https://doi.org/10.1109/TGRS.2018.2837357.
   Web of Science ®Google Scholar
• Berlanga-Robles, C. A., and A. Ruiz-Luna. 2002. “Land Use Mapping and Change Detection in the Coastal Zone of Northwest Mexico Using Remote Sensing Techniques.” Journal of Coastal Research 18 (3): 514–522.
   Web of Science ®Google Scholar
• Bruzzone, L., and L. Carlin. 2006. “A Multilevel Context-Based System for Classification of Very High Spatial Resolution Images.” IEEE Transactions on Geoscience and Remote Sensing 44 (9): 2587–2600. https://doi.org/10.1109/TGRS.2006.875360.
   Web of Science ®Google Scholar
• Chan, J. C.-W., and D. Paelinckx. 2008. “Evaluation of Random Forest and Adaboost Tree-Based Ensemble Classification and Spectral Band Selection for Ecotope Mapping Using Airborne Hyperspectral Imagery.” Remote Sensing of Environment 112 (6): 2999–3011. https://doi.org/10.1016/j.rse.2008.02.011.
   Web of Science ®Google Scholar
• Chen, G., C. Li, W. Wei, W. Jing, M. Woźniak, T. Blažauskas, R. Damaševičius, et al. 2019. “Fully Convolutional Neural Network with Augmented Atrous Spatial Pyramid Pool and Fully Connected Fusion Path for High Resolution Remote Sensing Image Segmentation.” Applied Sciences 9 (9): 1816. https://doi.org/10.3390/app9091816.
   Google Scholar
• Chen, L.-C., G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille. 2017. “Deeplab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence.” IEEE Transactions on Pattern Analysis & Machine Intelligence 40 (4): 834–848. https://doi.org/10.1109/TPAMI.2017.2699184.
   PubMed Web of Science ®Google Scholar
• Chen, L.-C., G. Papandreou, F. Schroff, and H. Adam. 2017. “Rethinking Atrous Convolution for Semantic Image Segmentation.” ArXiv PreprintarXiv:1706.05587.
   Google Scholar
• Chen, L.-C., Y. Zhu, G. Papandreou, F. Schroff, and H. Adam. 2018. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 801–818.
   Google Scholar
• Diakogiannis, F. I., F. Waldner, P. Caccetta, and C. Wu. 2020. “ResUnet-A: A Deep Learning Framework for Semantic Segmentation of Remotely Sensed Data.” ISPRS Journal of Photogrammetry and Remote Sensing 162:94–114. https://doi.org/10.1016/j.isprsjprs.2020.01.013.
   Web of Science ®Google Scholar
• Dong, L., and J. Shan. 2013. “A Comprehensive Review of Earthquake-Induced Building Damage Detection with Remote Sensing Techniques.” ISPRS Journal of Photogrammetry and Remote Sensing 84:85–99. https://doi.org/10.1016/j.isprsjprs.2013.06.011.
   Web of Science ®Google Scholar
• Fang, L., P. Zhou, X. Liu, P. Ghamisi, and S. Chen. 2022. “Context Enhancing Representation for Semantic Segmentation in Remote Sensing Images.” IEEE Transactions on Neural Networks and Learning Systems 1–15. https://doi.org/10.1109/tnnls.2022.3201820.
   Web of Science ®Google Scholar
• Fisher, J. R., E. A. Acosta, P. J. Dennedy-Frank, T. Kroeger, T. M. Boucher, N. Pettorelli, and G. Buchanan. 2018. “Impact of Satellite Imagery Spatial Resolution on Land Use Classification Accuracy and Modeled Water Quality.” Remote Sensing in Ecology and Conservation 4 (2): 137–149. https://doi.org/10.1002/rse2.61.
   Web of Science ®Google Scholar
• Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., & Lu, H. 2019. Dual Attention Network for Scene Segmentation.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, 3146–3154.
   Google Scholar
• Ghimire, B., J. Rogan, and J. Miller. 2010. “Contextual Land-Cover Classification: Incorporating Spatial Dependence in Land-Cover Classification Models Using Random Forests and the Getis Statistic.” Remote Sensing Letters 1 (1): 45–54. https://doi.org/10.1080/01431160903252327.
   Web of Science ®Google Scholar
• Gillespie, T. W., J. Chu, E. Frankenberg, and D. Thomas. 2007. “Assessment and Prediction of Natural Hazards from Satellite Imagery.” Progress in Physical Geography: Earth and Environment 31 (5): 459–470. https://doi.org/10.1177/0309133307083296.
   Google Scholar
• Guo, Z., Q. Chen, G. Wu, Y. Xu, R. Shibasaki, and X. Shao. 2017. “Village Building Identification Based on Ensemble Convolutional Neural Networks.” Sensors 17 (11): 2487. https://doi.org/10.3390/s17112487.
   PubMed Web of Science ®Google Scholar
• Han, D., R.-C. WANG, J.-P. WU, B. ZHOU, Z. SHI, and L.-X. DING. 2007. “Quantifying Land Use Change in Zhejiang Coastal Region, China Using Multi-Temporal Landsat TM/ETM+ Images.” Pedosphere 17 (6): 712–720. https://doi.org/10.1016/S1002-0160(07)60086-1.
   Web of Science ®Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2016. Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Seattle, WA, 770–778.
   Google Scholar
• Hu, J., L. Shen, and G. Sun. 2018. “Squeeze-And-Excitation Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, 7132–7141.
   Google Scholar
• Iandola, F. N., Han, S., Moskewicz, M. W., Ashraf, K., Dally, W. J., & Keutzer, K. 2016. “SqueezeNet: AlexNet-Level Accuracy with 50x Fewer Parameters and¡ 0.5 MB Model Size.” ArXiv Preprint.arXiv:1602.07360.
   Google Scholar
• Jégou, S., M. Drozdzal, D. Vazquez, A. Romero, and Y. Bengio. 2017. “The One Hundred Layers Tiramisu: Fully Convolutional Densenets for Semantic Segmentation.” In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Honolulu, HI, 11–19.
   Google Scholar
• Kampffmeyer, M., A.-B. Salberg, and R. Jenssen. 2016. “Semantic Segmentation of Small Objects and Modeling of Uncertainty in Urban Remote Sensing Images Using Deep Convolutional Neural Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition workshops, Las Vegas, NV, 1–9.
   Google Scholar
• Krizhevsky, A., I. Sutskever, and G. E. Hinton. 2017. “Imagenet Classification with Deep Convolutional Neural Networks.” Communications of the ACM 60 (6): 84–90. https://doi.org/10.1145/3065386.
   Web of Science ®Google Scholar
• Li, Y., Song L, Chen Y, Li Z, Zhang X, Wang X and Sun J. 2020. “Learning Dynamic Routing for Semantic Segmentation.” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, United States, 8553–8562.
   Google Scholar
• Liu, X., M. Chi, Y. Zhang, and Y. Qin. 2018. “Classifying High Resolution Remote Sensing Images by Fine-Tuned VGG Deep Networks.” In IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, 7137–7140.
   Google Scholar
• Liu, Y., L. Gross, Z. Li, X. Li, X. Fan, and W. Qi. 2019. “Automatic Building Extraction on High-Resolution Remote Sensing Imagery Using Deep Convolutional Encoder-Decoder with Spatial Pyramid Pooling.” Institute of Electrical and Electronics Engineers Access 7:128774–128786. https://doi.org/10.1109/ACCESS.2019.2940527.
   Google Scholar
• Liu, P., X. Liu, M. Liu, Q. Shi, J. Yang, X. Xu, Y. Zhang, et al. 2019. “Building Footprint Extraction from High-Resolution Images via Spatial Residual Inception Convolutional Neural Network.” Remote Sensing 11 (7): 830. https://doi.org/10.3390/rs11070830.
   Web of Science ®Google Scholar
• Li, R., L. Wang, C. Zhang, C. Duan, and S. Zheng. 2022. “A2-FPN for Semantic Segmentation of Fine-Resolution Remotely Sensed Images.” International Journal of Remote Sensing 43 (3): 1131–1155. https://doi.org/10.1080/01431161.2022.2030071.
   Web of Science ®Google Scholar
• Li, R., S. Zheng, C. Zhang, C. Duan, L. Wang, and P. M. Atkinson. 2021. “ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remotely Sensed Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 181:84–98. https://doi.org/10.1016/j.isprsjprs.2021.09.005.
   Web of Science ®Google Scholar
• Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, USA, 3431–3440.
   Google Scholar
• Maggiori, E., Y. Tarabalka, G. Charpiat, and P. Alliez. 2016. “Fully Convolutional Neural Networks for Remote Sensing Image Classification.” In 2016 IEEE international geoscience and remote sensing symposium (IGARSS), Beijing, Peoples R China, 5071–5074.
   Google Scholar
• Martini, M., V. Mazzia, A. Khaliq, and M. Chiaberge. 2021. “Domain-Adversarial Training of Self-Attention-Based Networks for Land Cover Classification Using Multi-Temporal Sentinel-2 Satellite Imagery.” Remote Sensing 13 (13): 2564. https://doi.org/10.3390/rs13132564.
   Web of Science ®Google Scholar
• Mathieu, R., C. Freeman, and J. Aryal. 2007. “Mapping Private Gardens in Urban Areas Using Object-Oriented Techniques and Very High-Resolution Satellite Imagery.” Landscape and Urban Planning 81 (3): 179–192. https://doi.org/10.1016/j.landurbplan.2006.11.009.
   Web of Science ®Google Scholar
• Onim, M. S. H., A. R. B. Ehtesham, A. Anbar, A. N. Islam, and A. M. Rahman. 2020. LULC Classification by Semantic Segmentation of Satellite Images Using FastFcn.” In 2020 2nd International Conference on Advanced Information and Communication Technology (ICAICT), Electr Network, 471–475.
   Google Scholar
• Qin, Y., Kamnitsas K, Ancha S, Nanavati J, Cottrell G, Criminisi A and Nori A. 2018. “Autofocus Layer for Semantic Segmentation.” In Medical Image Computing and Computer Assisted Intervention–MICCAI 2018: 21st International Conference, Proceedings, Part III ,11 Granada, Spain, September 16-20, 2018, 603–611.
   Google Scholar
• Qin, Z., P. Zhang, F. Wu, and X. Li. 2021. “Fcanet: Frequency Channel Attention Networks.” In Proceedings of the IEEE/CVF international conference on computer vision, Electr Network, 783–792.
   Google Scholar
• Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” In Medical Image Computing and Computer- Assisted Intervention–MICCAI 2015: 18th International Conference, Proceedings, Part III 18, Munich, Germany, October 5-9, 2015, 234–241.
   Google Scholar
• Rottensteiner, F., G. Sohn, M. Gerke, and J. D. Wegner. 2014. “ISPRS Semantic Labeling Contest.” ISPRS: Leopoldshöhe, Germany 1 (4).
   Google Scholar
• Rottensteiner, F., G. Sohn, M. Gerke, J. D. Wegner, U. Breitkopf, and J. Jung. 2014. “Results of the ISPRS Benchmark on Urban Object Detection and 3D Building Reconstruction.” ISPRS Journal of Photogrammetry and Remote Sensing 93:256–271. https://doi.org/10.1016/j.isprsjprs.2013.10.004.
   Web of Science ®Google Scholar
• Sarkar, A., M. K. Biswas, B. Kartikeyan, V. Kumar, K. L. Majumder, and D. K. Pal. 2002. “A MRF Model-Based Segmentation Approach to Classification for Multispectral Imagery.” IEEE Transactions on Geoscience and Remote Sensing 40 (5): 1102–1113. https://doi.org/10.1109/TGRS.2002.1010897.
   Web of Science ®Google Scholar
• Schuegraf, P., and K. Bittner. 2019. “Automatic Building Footprint Extraction from Multi- Resolution Remote Sensing Images Using a Hybrid FCN.” ISPRS International Journal of Geo-Information 8 (4): 191. https://doi.org/10.3390/ijgi8040191.
   Web of Science ®Google Scholar
• Sesnie, S. E., P. E. Gessler, B. Finegan, and S. Thessler. 2008. “Integrating Landsat TM and SRTM-DEM Derived Variables with Decision Trees for Habitat Classification and Change Detection in Complex Neotropical Environments.” Remote Sensing of Environment 112 (5): 2145–2159. https://doi.org/10.1016/j.rse.2007.08.025.
   Web of Science ®Google Scholar
• Sherrah, J. 2016. “Fully Convolutional Networks for Dense Semantic Labelling of High- Resolution Aerial Imagery.” ArXiv Preprint.arXiv:1606.02585.
   Google Scholar
• Simonyan, K., and A. Zisserman. 2014. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” arXiv Preprint arXiv: 14091556.
   Google Scholar
• Su, Y.-C., T.-J. Liu, and K.-H. Liuy. 2022. “Multi-Scale Wavelet Frequency Channel Attention for Remote Sensing Image Segmentation.” In 2022 IEEE 14th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP), Nafplio, Greece, 1–5.
   Google Scholar
• Sun, K., B. Xiao, D. Liu, and J. Wang. 2019. “Deep High-Resolution Representation Learning for Human Pose Estimation.” In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, Long Beach, CA, 5693–5703.
   Google Scholar
• Sun, Y., and W. Zheng. 2022. “HRNet-And PSPNet-Based Multiband Semantic Segmentation of Remote Sensing Images.” Neural Computing and Applications 1–9. https://doi.org/10.1007/s00521-022-07737-w.
   PubMed Web of Science ®Google Scholar
• Szegedy, C., Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V and Rabinovich A. 2015. “Going Deeper with Convolutions.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, MA, 1–9.
   Google Scholar
• Szuster, B. W., Q. Chen, and M. Borger. 2011. “A Comparison of Classification Techniques to Support Land Cover and Land Use Analysis in Tropical Coastal Zones.” Applied Geography 31 (2): 525–532. https://doi.org/10.1016/j.apgeog.2010.11.007.
   Web of Science ®Google Scholar
• Tong, X.-Y., G.-S. Xia, Q. Lu, H. Shen, S. Li, S. You, L. Zhang, et al. 2020. “Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Models.” Remote Sensing of Environment 237:111322. https://doi.org/10.1016/j.rse.2019.111322.
   Web of Science ®Google Scholar
• Wang, X., R. Girshick, A. Gupta, and K. He. 2018. “Non-Local Neural Networks.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, 7794–7803.
   Google Scholar
• Wang, L., K. Jiang, and T. Wei. 2021. “Development of a New Inversion Method for Detecting Spatiotemporal Characteristics of Coal Mines Based on Earth Observation Technology.” International Journal of Applied Earth Observation and Geoinformation 100:102346. https://doi.org/10.1016/j.jag.2021.102346.
   Web of Science ®Google Scholar
• Wang, P., P. Yu, J. Lu, and Y. Zhang. 2022. “The Mediation Effect of Land Surface Temperature in the Relationship Between Land Use-Cover Change and Energy Consumption Under Seasonal Variations.” Journal of Cleaner Production 340:130804. https://doi.org/10.1016/j.jclepro.2022.130804.
   Web of Science ®Google Scholar
• Woo, S., J. Park, J.-Y. Lee, and I. S. Kweon. 2018. “Cbam: Convolutional Block Attention Module.” In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 3–19.
   Google Scholar
• Wu, L., L. Fang, J. Yue, B. Zhang, P. Ghamisi, and M. He. 2022. “Deep Bilateral Filtering Network for Point-Supervised Semantic Segmentation in Remote Sensing Images.” IEEE Transactions on Image Processing 31:7419–7434. https://doi.org/10.1109/TIP.2022.3222904.
   PubMed Web of Science ®Google Scholar
• Wu, H., J. Zhang, K. Huang, K. Liang, and Y. Yu. 2019. “Fastfcn: Rethinking Dilated Convolution in the Backbone for Semantic Segmentation.” ArXiv Preprint.arXiv:1903.11816.
   Google Scholar
• Yu, C., Wang J, Peng C, Gao C, Yu G, Sang N. 2018. “Bisenet: Bilateral Segmentation Network for Real-Time Semantic Segmentation.” In Proceedings of the European conference on computer vision (ECCV), Munich, Germany, 325–341.
   Google Scholar
• Zeiler, M. D., D. Krishnan, G. W. Taylor, and R. Fergus. 2010. “Deconvolutional Networks.” In 2010 IEEE Computer Society Conference on computer vision and pattern recognition, San Francisco, CA, 2528–2535.
   Google Scholar
• Zhao, H., J. Shi, X. Qi, X. Wang, and J. Jia. 2017. “Pyramid Scene Parsing Network.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, 2881–2890.
   Google Scholar
• Zheng, H., M. Gong, T. Liu, F. Jiang, T. Zhan, D. Lu, M. Zhang, et al. 2022. “HFA-Net: High Frequency Attention Siamese Network for Building Change Detection in VHR Remote Sensing Images.” Pattern Recognition 129:108717. https://doi.org/10.1016/j.patcog.2022.108717.
   Web of Science ®Google Scholar
• Zou, F., W. Xiao, W. Ji, K. He, Z. Yang, J. Song, H. Zhou, et al. 2020. “Arbitrary-Oriented Object Detection via Dense Feature Fusion and Attention Model for Remote Sensing Super-Resolution Image.” Neural Computing and Applications 32 (18): 14549–14562. https://doi.org/10.1007/s00521-020-04893-9.
   Web of Science ®Google Scholar