A deep 2D/3D Feature-Level fusion for classification of UAV multispectral imagery in urban areas

References

• Adit VV, Rubesh CV, Sanjay Bharathi S, Santhiya G, Anuradha R. 2020. A  comparison of deep learning algorithms for plant disease classification. In Advances in cybernetics, cognition, and machine learning for communication technologies 153-61. Lecture Notes in Electrical Engineering: Springer.
   Google Scholar
• Ahmed OS, Shemrock A, Chabot D, Dillon C, Williams G, Wasson R, Franklin SE. 2017. Hierarchical land cover and vegetation classification using multispectral data acquired from an unmanned aerial vehicle. Int J Remote Sens. 38 (8-10):2037–2052.
   Web of Science ®Google Scholar
• Al-Najjar HAH, Kalantar B, Pradhan B, Saeidi V, Halin AA, Ueda N, Mansor S. 2019. Land Cover Classification from fused DSM and UAV Images Using Convolutional Neural Networks. Remote Sensing. 11(12):1461 doi:10.3390/rs11121461.
   Web of Science ®Google Scholar
• Bashmal L, Bazi Y. 2018. Learning robust deep features for efficient classification of UAV imagery. Paper presented at the 2018 1st International Conference on Computer Applications & Information Security (ICCAIS).
   Google Scholar
• Clemens SR. 2012. Procedures for correcting Digital Camera Imagery Acquired by the AggieAir remote sensing platform.
   Google Scholar
• De Boer P-T, Kroese DP, Mannor S, Rubinstein RY. 2005. A tutorial on the cross-entropy method. Ann Oper Res. 134 (1):19–67.
   Web of Science ®Google Scholar
• Feng Q, Zhu D, Yang J, Li B. 2019. Multisource hyperspectral and lidar data fusion for urban land-use mapping based on a modified two-branch convolutional neural network. IJGI. 8 (1):28.
   Google Scholar
• Ge Z, Cao G, Li X, Fu P. 2020. Hyperspectral image classification method based on 2D–3D CNN and multibranch feature fusion. IEEE J Sel Top Appl Earth Observ Remote Sens. 13:5776–5788.
   Google Scholar
• Gebrehiwot A, Hashemi-Beni L, Thompson G, Kordjamshidi P, Langan TE. 1975. Deep convolutional neural network for flood extent mapping using unmanned aerial vehicles data. Biochem Pharmacol. 24 (17):1639–1641.
   Google Scholar
• Gehrke S, Beshah BT. 2016. Radiometric normalization of large airborne image data sets acquired by different sensor types. Int Arch Photogram Remote Sens Spat Inform Sci. 41:317–326.
   Google Scholar
• Gitelson A, Merzlyak MN. 1994. Spectral reflectance changes associated with autumn senescence of Aesculus hippocastanum L. and Acer platanoides L. leaves. Spectral features and relation to chlorophyll estimation. J Plant Physiol. 143 (3):286–292.
   Web of Science ®Google Scholar
• Guo L, Song J, Li X-r, Huang H, Du J-j, He Y-c, Wang C-z. 2019. Haze image classification method based on alexnet network transfer model. J Phys Conf Ser. 1176:032011.
   Google Scholar
• He N, Fang L, Li S, Plaza A, Plaza J. 2018. Remote sensing scene classification using multilayer stacked covariance pooling. IEEE Trans Geosci Remote Sens. 56 (12):6899–6910.
   Web of Science ®Google Scholar
• He K, Zhang X, Ren S, Sun J. 2016. Deep residual learning for image recognition. Paper presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
   Google Scholar
• James D, Collin A, Mury A, Costa S. 2020. Very high resolution land use and land cover mapping using pleiades-1 stereo imagery and machine learning. Int Arch Photogram Remote Sens Spat Inform Sci. 43:675–682.
   Google Scholar
• Ji S, Zhang C, Xu A, Shi Y, Duan Y. 2018. 3D convolutional neural networks for crop classification with multi-temporal remote sensing images. Remote Sens. 10 (2):75.
   Google Scholar
• Kaur T, Gandhi TK. 2020. Deep convolutional neural networks with transfer learning for automated brain image classification. Mach Vis Appl. 31(3):1–16.
   Web of Science ®Google Scholar
• Kim GH, Choi JW. 2017. Land cover classification with high spatial resolution using orthoimage and DSM based on fixed-wing UAV. J Korean Soc Surveying Geodesy Photogrammetry Cartogr. 35 (1):1–10.
   Google Scholar
• Krizhevsky A, Sutskever I, Hinton GE. 2012. Imagenet classification with deep convolutional neural networks. Paper presented at the Advances in neural information processing systems.
   Google Scholar
• Kwan C, Gribben D, Ayhan B, Li J, Bernabe S, Plaza A. 2020. An accurate vegetation and non-vegetation differentiation approach based on land cover classification. Remote Sens. 12 (23):3880.
   Google Scholar
• Längkvist M, Kiselev A, Alirezaie M, Loutfi A. 2016. Classification and segmentation of satellite orthoimagery using convolutional neural networks. Remote Sens. 8 (4):329.
   Google Scholar
• LeCun Y, Bengio Y, Hinton G. 2015. Deep learning. Nature. 521 (7553):436–444.
   PubMed Web of Science ®Google Scholar
• Li E, Xia J, Du P, Lin C, Samat A. 2017. Integrating multilayer features of convolutional neural networks for remote sensing scene classification. IEEE Trans Geosci Remote Sens. 55 (10):5653–5665.
   Web of Science ®Google Scholar
• Lindeberg T. 2012. Scale invariant feature transform.
   Google Scholar
• Liu T, Abd-Elrahman A. 2018. Deep convolutional neural network training enrichment using multi-view object-based analysis of Unmanned Aerial systems imagery for wetlands classification. ISPRS J Photogramm Remote Sens. 139:154–170.
   Web of Science ®Google Scholar
• Liu Y, Chen C, Han Z, Ding L, Liu Y. 2020. High-resolution remote sensing image retrieval based on classification-similarity networks and double fusion. IEEE J Sel Top Appl Earth Observations Remote Sensing. 13:1119–1133.
   Web of Science ®Google Scholar
• Maggiori E, Tarabalka Y, Charpiat G, Alliez P. 2017. Convolutional neural networks for large-scale remote-sensing image classification. IEEE Trans Geosci Remote Sensing. 55 (2):645–657.
   Web of Science ®Google Scholar
• Michez A, Piégay H, Lisein J, Claessens H, Lejeune P. 2016. Classification of riparian forest species and health condition using multi-temporal and hyperspatial imagery from unmanned aerial system. Environ Monit Assess. 188 (3):146.
   PubMed Web of Science ®Google Scholar
• Mnih V, Heess N, Graves A. 2014. Recurrent models of visual attention. Paper presented at the Advances in neural information processing systems.
   Google Scholar
• Nesbit PR. 2014. Uninhabited aerial vehicles and structure from motion: A fresh approach to photogrammetry. Long Beach: California State University.
   Google Scholar
• Nguyen T, Han J, Park D-C. 2013. Satellite image classification using convolutional learning. Paper presented at the AIP Conference Proceedings.
   Google Scholar
• Nissen E, Johnson KL, Fitzgerald FS, Morgan M, White J. 2014. Rapid-Response or repeat-mode topography from aerial structure from motion. Paper presented at the AGU Fall Meeting Abstracts.
   Google Scholar
• Nogueira K, Penatti OA, dos Santos JA. 2017. Towards better exploiting convolutional neural networks for remote sensing scene classification. Pattern Recognit. 61:539–556.
   Web of Science ®Google Scholar
• Phinzi K, Holb I, Szabó S. 2021. Mapping permanent gullies in an agricultural area using satellite images: efficacy of machine learning algorithms. Agronomy. 11 (2):333.
   Google Scholar
• Pibre L, Chaumont M, Subsol G, Ienco D, Derras M. 2017. How to deal with multi-source data for tree detection based on deep learning. Paper presented at the GlobalSIP: Global Conference on Signal and Information Processing.
   Google Scholar
• Chen B, Li J, and Jin Y. 2021. Deep learning for feature-level data fusion: higher resolution reconstruction of historical landsat archive. Sensors (Basel). 21 (13):167.
   Google Scholar
• Piramanayagam S, Saber E, Schwartzkopf W, Koehler FW. 2018. Supervised classification of multisensor remotely sensed images using a deep learning framework. Remote Sens. 10 (9):1429.
   Google Scholar
• Rastogi K, Bodani P, Sharma SA. 2020. Automatic building footprint extraction from very high-resolution imagery using deep learning techniques. Geocarto International. https://doi.org/10.1080/10106049.2020.1778100
   Google Scholar
• Rezaee M, Mahdianpari M, Zhang Y, Salehi B. 2018. Deep convolutional neural network for complex wetland classification using optical remote sensing imagery. IEEE J Sel Top Appl Earth Observ Remote Sens. 11 (9):3030–3039.
   Web of Science ®Google Scholar
• Rezaeian M, Amirfattahi R, Sadri S. 2014. Semantic segmentation of aerial images using fusion of color and texture features.
   Google Scholar
• Rodriguez-Galiano VF, Ghimire B, Rogan J, Chica-Olmo M, Rigol-Sanchez JP. 2012. An assessment of the effectiveness of a random forest classifier for land-cover classification. ISPRS J Photogramm Remote Sens. 67:93–104.
   Web of Science ®Google Scholar
• Rouse JW. Jr, 1972. Monitoring the vernal advancement and retrogradation (green wave effect) of natural vegetation.
   Google Scholar
• Shao Z, Cai J. 2018. Remote sensing image fusion with deep convolutional neural network. IEEE J Sel Top Appl Earth Observ Remote Sens. 11 (5):1656–1669.
   Web of Science ®Google Scholar
• Shao Z, Cai J, Fu P, Hu L, Liu T. 2019. Deep learning-based fusion of Landsat-8 and Sentinel-2 images for a harmonized surface reflectance product. Remote Sens Environ. 235:111425.
   Web of Science ®Google Scholar
• Szabó L, Burai P, Deák B, Dyke GJ, Szabó S. 2019. Assessing the efficiency of multispectral satellite and airborne hyperspectral images for land cover mapping in an aquatic environment with emphasis on the water caltrop (Trapa natans). Int J Remote Sens. 40 (13):5192–5215.
   Web of Science ®Google Scholar
• Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A. 2015. Going deeper with convolutions. Paper presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
   Google Scholar
• Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. 2016. Rethinking the inception architecture for computer vision. Paper presented at the Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.
   Google Scholar
• Tong X-Y, Xia G-S, Lu Q, Shen H, Li S, You S, Zhang L. 2020. Land-cover classification with high-resolution remote sensing images using transferable deep models. Remote Sens Environ. 237:111322.
   Web of Science ®Google Scholar
• Wijesingha J. 2016. Geometric quality assessment of multi-rotor unmanned aerial vehicle borne remote sensing products for precision agriculture Student thesis series INES.
   Google Scholar
• Xiaoqin W, Miaomiao W, Shaoqiang W, Yundong W. 2015. Extraction of vegetation information from visible unmanned aerial vehicle images. Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering 31 (5):152–159. doi:10.3969/j.issn.1002-6819.2015.05.022
   Google Scholar
• Xu Y, Du B, Zhang L. 2018. Multi-source remote sensing data classification via fully convolutional networks and post-classification processing. Paper presented at the IGARSS 2018-2018 IEEE International Geoscience and Remote Sensing Symposium.
   Google Scholar
• Xue J, Su B. 2017. Significant remote sensing vegetation indices: a review of developments and applications. J Sens. 2017:1–17.
   Web of Science ®Google Scholar
• Zhang X, Chen G, Wang W, Wang Q, Dai F. 2017. Object-based land-cover supervised classification for very-high-resolution UAV images using stacked denoising autoencoders. IEEE J Sel Top Appl Earth Observ Remote Sens. 10 (7):3373–3385.
   Web of Science ®Google Scholar
• Zhang C, Pan X, Li H, Gardiner A, Sargent I, Hare J, Atkinson PM. 2018. A hybrid MLP-CNN classifier for very fine resolution remotely sensed image classification. ISPRS J Photogramm Remote Sens. 140:133–144.
   Web of Science ®Google Scholar
• Zhang C, Sargent I, Pan X, Li H, Gardiner A, Hare J, Atkinson PM. 2019. Joint Deep Learning for land cover and land use classification. Remote Sens Environ. 221:173–187.
   Web of Science ®Google Scholar
• Zhou W, Newsam S, Li C, Shao Z. 2017. Learning low dimensional convolutional neural networks for high-resolution remote sensing image retrieval. Remote Sens. 9 (5):489.
   Google Scholar
• Zhu XX, Tuia D, Mou L, Xia G-S, Zhang L, Xu F, Fraundorfer F. 2017. Deep learning in remote sensing: a comprehensive review and list of resources. IEEE Geosci Remote Sens Mag. 5(4):8–36.
   Web of Science ®Google Scholar