143
Views
0
CrossRef citations to date
0
Altmetric
Research article

Gaofen-2 satellite image-based characterization of urban villages using multiple convolutional neural networks

, , , , , & show all
Pages 7808-7826 | Received 28 Aug 2023, Accepted 19 Nov 2023, Published online: 12 Dec 2023

References

  • Abascal, A., I. Rodríguez-Carreño, S. Vanhuysse, S. Georganos, R. Sliuzas, E. Wolff, and M. Kuffer. 2022. “Identifying Degrees of Deprivation from Space Using Deep Learning and Morphological Spatial Analysis of Deprived Urban Areas.” Computers, Environment and Urban Systems 95 (July): 101820. https://doi.org/10.1016/J.COMPENVURBSYS.2022.101820.
  • Ashraf, H., A. Waris, M. Fazeel Ghafoor, S. Omer Gilani, and I. Khan Niazi. 2022. “Melanoma Segmentation Using Deep Learning with Test-Time Augmentations and Conditional Random Fields.” Scientific Reports 12 (1): 1–16. https://doi.org/10.1038/s41598-022-07885-y.
  • Bai, T., L. Wang, D. Yin, K. Sun, Y. Chen, L. Wenzhuo, and L. Deren. 2022. “Deep Learning for Change Detection in Remote Sensing: A Review.” Geo-Spatial Information Science 26 (3): 262–288. https://doi.org/10.1080/10095020.2022.2085633.
  • Blaschke, T., G. J. Hay, M. Kelly, S. Lang, P. Hofmann, E. Addink, R. Queiroz Feitosa, et al. 2014. “Geographic Object-Based Image Analysis – Towards a New Paradigm.” ISPRS Journal of Photogrammetry and Remote Sensing 87 (January): 180–191. https://doi.org/10.1016/J.ISPRSJPRS.2013.09.014.
  • Busgeeth, K., A. Brits, and J. Whisken. 2008. “Potential Application of Remote Sensing in Monitoring Informal Settlements in Developing Countries Where Complimentary Data Does Not Exist.” Africa, 4:127–149. https://researchspace.csir.co.za/dspace/handle/10204/3102.
  • Chung, H. 2009. “The Planning of ‘Villages-In-The-City’ in Shenzhen, China: The Significance of the New State-Led Approach.” International Planning Studies 14 (3): 253–273. https://doi.org/10.1080/13563470903450606.
  • Csurka, G. D. Larlus, F. Perronnin, et al. 2013. “What is a Good Evaluation Measure for Semantic Segmentation?[c]//Bmvc.” 27: 10–5244.
  • Debray, H., M. Kuffer, C. Persello, C. Klaufus, and K. Pfeffer. 2019. “Detection of Informal Graveyards in Lima Using Fully Convolutional Network with VHR Images.” 2019 Joint Urban Remote Sensing Event, JURSE 2019. May. https://doi.org/10.1109/JURSE.2019.8808983.
  • Diakogiannis, F. I., F. Waldner, P. Caccetta, and C. Wu. 2020. “ResUnet-A: A Deep Learning Framework for Semantic Segmentation of Remotely Sensed Data.” ISPRS Journal of Photogrammetry and Remote Sensing 162 (April): 94–114. https://doi.org/10.1016/J.ISPRSJPRS.2020.01.013.
  • Fisher, T., H. Gibson, Y. Liu, M. Abdar, M. Posa, G. Salimi-Khorshidi, A. Hassaine, Y. Cai, K. Rahimi, and M. Mamouei. 2022. “Uncertainty-Aware Interpretable Deep Learning for Slum Mapping and Monitoring.” Remote Sensing 14 (13): 3072. https://doi.org/10.3390/rs14133072.
  • Friesen, J., H. Taubenböck, M. Wurm, and P. F. Pelz. 2018. “The Similar Size of Slums.” Habitat International 73 (March): 79–88. https://doi.org/10.1016/J.HABITATINT.2018.02.002.
  • Ghimire, P., D. Lei, and N. Juan. 2020. “Effect of Image Fusion on Vegetation Index Quality—A Comparative Study from Gaofen-1, Gaofen-2, Gaofen-4, Landsat-8 OLI and MODIS Imagery.” Remote Sensing 12 (10): 1550. https://doi.org/10.3390/RS12101550.
  • Ghorbanzadeh, O., A. Crivellari, P. Ghamisi, H. Shahabi, and T. Blaschke. 2021. “A Comprehensive Transferability Evaluation of U-Net and ResU-Net for Landslide Detection from Sentinel-2 Data (Case Study Areas from Taiwan, China, and Japan).” Scientific Reports 11 (1): 1–20. https://doi.org/10.1038/s41598-021-94190-9.
  • Goodfellow, T.2020. “Political Informality: Deals, Trust Networks, and the Negotiation of Value in the Urban Realm[j].” The Journal of Development Studies 56 (2): 278–294.
  • Graesser, J., A. Cheriyadat, R. Raju Vatsavai, V. Chandola, J. Long, and E. Bright. 2012. “Image Based Characterization of Formal and Informal Neighborhoods in an Urban Landscape.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 5 (4): 1164–1176. https://doi.org/10.1109/JSTARS.2012.2190383.
  • Hamaguchi, R., Y. Furukawa, M. Onishi, and K. Sakurada. 2021. “Heterogeneous Grid Convolution for Adaptive, Efficient, and Controllable Computation.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 13946-13955.
  • Hao, P., S. Geertman, P. Hooimeijer, and R. Sliuzas. 2013. “Spatial Analyses of the Urban Village Development Process in Shenzhen, China.” International Journal of Urban and Regional Research 37 (6): 2177–2197. https://doi.org/10.1111/J.1468-2427.2012.01109.X.
  • Hay, G. J., and G. Castilla. 2008. “Geographic Object-Based Image Analysis (GEOBIA): A New Name for a New Discipline.” Lecture Notes in Geoinformation and Cartography 8 (9783540770572): 75–89. https://doi.org/10.1007/978-3-540-77058-9_4/COVER.
  • Hofmann, P., J. Strobl, T. Blaschke, and H. Kux. 2008. “Detecting Informal Settlements from QuickBird Data in Rio de Janeiro Using an Object-Based Approach.” Lecture Notes in Geoinformation and Cartography 8 (9783540770572): 531–553. https://doi.org/10.1007/978-3-540-77058-9_29/COVER.
  • Huang, X., H. Liu, and L. Zhang. 2015. “Spatiotemporal Detection and Analysis of Urban Villages in Mega City Regions of China Using High-Resolution Remotely Sensed Imagery.” IEEE Transactions on Geoscience and Remote Sensing 53 (7): 3639–3657. https://doi.org/10.1109/TGRS.2014.2380779.
  • Jozdani, S. E., B. Alan Johnson, and D. Chen. 2019. “Comparing Deep Neural Networks, Ensemble Classifiers, and Support Vector Machine Algorithms for Object-Based Urban Land Use/Land Cover Classification.” Remote Sensing 11 (14): 1713. https://doi.org/10.3390/RS11141713.
  • Li, Y., X. Huang, and H. Liu. 2017. “Unsupervised Deep Feature Learning for Urban Village Detection from High-Resolution Remote Sensing Images.” Photogrammetric Engineering and Remote Sensing 83 (8): 567–579. https://doi.org/10.14358/PERS.83.8.567.
  • Liu, Y., S. Shenjing, F. Wu, and C. Webster. 2010. “Urban Villages Under China’s Rapid Urbanization: Unregulated Assets and Transitional Neighbourhoods.” Habitat International 34 (2): 135–144. https://doi.org/10.1016/J.HABITATINT.2009.08.003.
  • Long, J., E. Shelhamer, and T. Darrell. 2015. “Fully Convolutional Networks for Semantic Segmentation.” Proceedings of the IEEE conference on computer vision and pattern recognition. 2015: 3431-3440.
  • Luus, F. P. S., B. P. Salmon, F. Van Den Bergh, and B. T. J. Maharaj. 2015. “Multiview Deep Learning for Land-Use Classification.” IEEE Geoscience and Remote Sensing Letters 12 (12): 2448–2452. https://doi.org/10.1109/LGRS.2015.2483680.
  • Maiya, S. R., and S. Chandra Babu. 2018. “Slum Segmentation and Change Detection: A Deep Learning Approach.” November. https://arxiv.org/abs/1811.07896v1.
  • Mast, J., C. Wei, and M. Wurm. 2020. “Mapping Urban Villages Using Fully Convolutional Neural Networks.” Remote Sensing Letters 11 (7): 630–639. https://doi.org/10.1080/2150704X.2020.1746857.
  • Maxwell, A. E., T. A. Warner, and L. A. Guillén. 2021. “Accuracy Assessment in Convolutional Neural Network-Based Deep Learning Remote Sensing Studies—Part 1: Literature Review.” Remote Sensing 13 (13): 2450. https://doi.org/10.3390/rs13132450.
  • Owen, K. K., and D. W. Wong. 2013. “An Approach to Differentiate Informal Settlements Using Spectral, Texture, Geomorphology and Road Accessibility Metrics.” Applied Geography 38 (1): 107–118. https://doi.org/10.1016/J.APGEOG.2012.11.016.
  • Pan, Z., J. Xu, Y. Guo, Y. Hu, and G. Wang. 2020. “Deep Learning Segmentation and Classification for Urban Village Using a Worldview Satellite Image Based on U-Net.” Remote Sensing 12 (10): 1574. https://doi.org/10.3390/RS12101574.
  • Persello, C., J. Dirk Wegner, R. Hansch, D. Tuia, P. Ghamisi, M. Koeva, and G. Camps-Valls. 2022. “Deep Learning and Earth Observation to Support the Sustainable Development Goals: Current Approaches, Open Challenges, and Future Opportunities.” IEEE Geoscience and Remote Sensing Magazine 10 (2): 172–200. https://doi.org/10.1109/MGRS.2021.3136100.
  • Persello, C., and A. Stein. 2017. “Deep Fully Convolutional Networks for the Detection of Informal Settlements in VHR Images.” IEEE Geoscience and Remote Sensing Letters 14 (12): 2325–2329. https://doi.org/10.1109/LGRS.2017.2763738.
  • Rastogi, K., P. Bodani, and S. A. Sharma. 2020. “Automatic Building Footprint Extraction from Very High-Resolution Imagery Using Deep Learning Techniques.” Geocarto International 37 (5): 1501–1513. https://doi.org/10.1080/10106049.2020.1778100.
  • Ronneberger, O., P. Fischer, and T. Brox. 2015. “U-Net: Convolutional Networks for Biomedical Image Segmentation.” Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 9351:234–241. https://doi.org/10.1007/978-3-319-24574-4_28/COVER.
  • Sariturk, B., D. Zafer Seker, O. Ozturk, and B. Bayram. 2022. “Performance Evaluation of Shallow and Deep CNN Architectures on Building Segmentation from High-Resolution Images.” Earth Science Informatics 15 (3): 1801–1823. https://doi.org/10.1007/s12145-022-00840-5.
  • Sivakumar, A. N., J. Li, S. Scott, E. Psota, A. J. Jhala, J. D. Luck, and Y. Shi. 2020. “Comparison of Object Detection and Patch-Based Classification Deep Learning Models on Mid- to Late-Season Weed Detection in UAV Imagery.” Remote Sensing 12 (13): 2136. https://doi.org/10.3390/RS12132136.
  • Stark, T. 2018. “Using Deep Convolutional Neural Networks for theIdentification of Informal Settlements to Improve aSustainable Development in Urban Environments.” Technische Universität München.
  • Stark, T., M. Wurm, H. Taubenbock, and X. Xiang Zhu. 2019. “Slum Mapping in Imbalanced Remote Sensing Datasets Using Transfer Learned Deep Features.” 2019 Joint Urban Remote Sensing Event, JURSE 2019. May. https://doi.org/10.1109/JURSE.2019.8808965.
  • Stark, T., M. Wurm, X. Xiang Zhu, and H. Taubenbock. 2020. “Satellite-Based Mapping of Urban Poverty with Transfer-Learned Slum Morphologies.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 13:5251–5263. https://doi.org/10.1109/JSTARS.2020.3018862.
  • Targ, S., D. Almeida, and K. Lyman Enlitic. 2016. “Resnet in Resnet: Generalizing Residual Architectures.” March. https://arxiv.org/abs/1603.08029v1.
  • Taubenböck, H., and N. J. Kraff. 2014. “The Physical Face of Slums: A Structural Comparison of Slums in Mumbai, India, Based on Remotely Sensed Data.” Journal of Housing and the Built Environment 29 (1): 15–38. https://doi.org/10.1007/s10901-013-9333-x.
  • Verma, D., A. Jana, and K. Ramamritham. 2019. “Transfer Learning Approach to Map Urban Slums Using High and Medium Resolution Satellite Imagery.” Habitat International 88 (June): 101981. https://doi.org/10.1016/J.HABITATINT.2019.04.008.
  • Wang, S., G. Cao, Y. Wang, S. Liao, Q. Wang, J. Shi, C. Li, and D. Shen. 2021. “Review and Prospect: Artificial Intelligence in Advanced Medical Imaging.” Frontiers in Radiology 1 (December): 781868. https://doi.org/10.3389/FRADI.2021.781868.
  • Wei, C., T. Blaschke, and H. Taubenböck. 2015. “Monitoring of ‘Urban Villages’ in Shenzhen, China from High-Resolution GF-1 and TerraSAR-X Data.” 9642 (October): 183–190. https://doi.org/10.1117/12.2194877.
  • Wurm, M., T. Stark, X. Xiang Zhu, M. Weigand, and H. Taubenböck. 2019. “Semantic Segmentation of Slums in Satellite Images Using Transfer Learning on Fully Convolutional Neural Networks.” ISPRS Journal of Photogrammetry and Remote Sensing 150 (April): 59–69. https://doi.org/10.1016/J.ISPRSJPRS.2019.02.006.
  • Xiao, C., J. Zhou, J. Huang, H. Zhu, X. Tong, D. Dou, and H. Xiong. 2022. “A Contextual Master-Slave Framework on Urban Region Graph for Urban Village Detection.” Technology. November. https://arxiv.org/abs/2211.14633v1.
  • Xu, Y., L. Yang, Y. Wang, M. Liu, Y. Fan, M. Lai, and E. I. C. Chang. 2017. “Gland Instance Segmentation Using Deep Multichannel Neural Networks.” IEEE Transactions on Biomedical Engineering 64 (12): 2901–2912. https://doi.org/10.1109/TBME.2017.2686418.
  • Yeh, C. H., C. Hsiang Huang, and L. Wei Kang. 2020. “Multi-Scale Deep Residual Learning-Based Single Image Haze Removal via Image Decomposition.” IEEE Transactions on Image Processing 29:3153–3167. https://doi.org/10.1109/TIP.2019.2957929.
  • Yi, Y., Z. Zhang, W. Zhang, C. Zhang, W. Li, and T. Zhao. 2019. “Semantic Segmentation of Urban Buildings from VHR Remote Sensing Imagery Using a Deep Convolutional Neural Network.” Remote Sensing 11 (15): 1774. https://doi.org/10.3390/RS11151774.
  • Yuan, W., and W. Xu. 2021. “NeighborLoss: A Loss Function Considering Spatial Correlation for Semantic Segmentation of Remote Sensing Image.” Institute of Electrical and Electronics Engineers Access 9:75641–75649. https://doi.org/10.1109/ACCESS.2021.3082076.
  • Yuan, Y. M. Xu, X. Cao, et al. 2018. “Exploring Urban-Rural Disparity of the Multiple Deprivation Index in Guangzhou City from 2000 to 2010[J].” Cities 79:1–11.
  • Zarvani, M., S. Saberi, R. Azmi, and S. Vahab Shojaedini. 2021. “Residual Learning: A New Paradigm to Improve Deep Learning-Based Segmentation of the Left Ventricle in Magnetic Resonance Imaging Cardiac Images.” Journal of Medical Signals and Sensors 11 (3): 159. https://doi.org/10.4103/JMSS.JMSS_38_20.
  • Zhang, D., A. Aoude, and M. Driscoll. 2022. “Development and Model Form Assessment of an Automatic Subject-Specific Vertebra Reconstruction Method.” Computers in Biology and Medicine 150 (November): 106158. https://doi.org/10.1016/J.COMPBIOMED.2022.106158.
  • Zhang, Z., Q. Liu, and Y. Wang. 2018. “Road Extraction by Deep Residual U-Net.” IEEE Geoscience and Remote Sensing Letters 15 (5): 749–753. https://doi.org/10.1109/LGRS.2018.2802944.
  • Zhang, Y., H. Zhang, and H. Lin. 2014. “Improving the Impervious Surface Estimation with Combined Use of Optical and SAR Remote Sensing Images.” Remote Sensing of Environment 141 (February): 155–167. https://doi.org/10.1016/J.RSE.2013.10.028.
  • Zhang, J., Y. Zheng, Q. Dekang, L. Ruiyuan, Y. Xiuwen, and L. Tianrui. 2018. “Predicting Citywide Crowd Flows Using Deep Spatio-Temporal Residual Networks.” Artificial Intelligence 259 (June): 147–166. https://doi.org/10.1016/J.ARTINT.2018.03.002.
  • Zipf, G. K. 1941. National Unity and Disunity;the Nation as a Bio-Social Organism. Bloomington Ind. http://hdl.handle.net/2027/mdp.39015057175484.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.