898
Views
17
CrossRef citations to date
0
Altmetric
Research Article

A hierarchical object detection method in large-scale optical remote sensing satellite imagery using saliency detection and CNN

, &
Pages 2827-2847 | Received 13 Nov 2019, Accepted 29 Jul 2020, Published online: 08 Jan 2021

References

  • Achanta, R., S. Hemami, F. Estrada, and S. Süsstrunk 2009. “Frequency-tuned Salient Region Detection.” In IEEE International Conference on Computer Vision and Pattern Recognition, Florida, USA, 1597–1604.
  • Bi, F., F. Liu, and L. Gao. 2010. “A Hierarchical Salient-region Based Algorithm for Ship Detection in Remote Sensing Images.” In In Advances in Neural Network Research and Applications, Springer, Berlin, Heidelberg, 729–738.
  • Borji, A., M. M. Cheng, H. Jiang, and J. Li. 2015. “Salient Object Detection: A Benchmark.” IEEE Transactions on Image Processing 24: 5706–5722.
  • Brumby, S. P., G. Kenyon, W. Landecker, C. Rasmussen, S. Swaminarayan, and L. M. Bettencourt 2009. “Large-scale Functional Models of Visual Cortex for Remote Sensing.” In 2009 IEEE Applied Imagery Pattern Recognition Workshop, Washington, DC, USA, 1-6.
  • Brunnström, K., B. Schenkman, and B. Jacobsen. 2003. “Object Detection in Cluttered Infrared Images. Optical Engineering.” The Journal of SPIE 42 (2): 388–399.
  • Cai, Z., Q. Fan, R. S. Feris, and N. Vasconcelos 2016. “A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection.” In Proceedings of European Conference on Computer Vision, Amsterdam, Netherlands, 354–370.
  • Chen, Z., T. Zhang, and C. Ouyang. 2018. “End-to-end Airplane Detection Using Transfer Learning in Remote Sensing Images.” Remote Sensing 10 (1): 139.
  • Cheng, G., J. Han, P. Zhou, and L. Guo. 2014. “Multi-class Geospatial Object Detection and Geographic Image Classification Based on Collection of Part Detectors.” ISPRS Journal of Photogrammetry and Remote Sensing 98: 119–132.
  • Cheng, G., J. W. Han, and X. Lu. 2017. “Remote Sensing Image Scene Classification: Benchmark and State of the Art.” In Proceedings of the IEEE International Conference on Computer Vision 105 (10): 1865–1883.
  • Dalal, N., and B. Triggs 2005. “Histograms of Oriented Gradients for Human Detection.” In international Conference on computer vision and Pattern Recognition, San Diego, CA, USA, 1: 886–893.
  • Ding, J., N. Xue, Y. Long, G. S. Xia, and Q. Lu 2019. “Learning Roi Transformer for Oriented Object Detection in Aerial Images.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 2849–2858.
  • Girshick, R., J. Donahue, T. Darrell, and J. Malik 2015. “Region-based Convolutional Networks for Accurate Object Detection and Segmentation.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 38 (1):  142–158.
  • Han, J., P. Zhou, D. Zhang, G. Cheng, L. Guo, Z. Liu, S. Bu, and J. Wu. 2014. “Efficient, Simultaneous Detection of Multi-class Geospatial Targets Based on Visual Saliency Modeling and Discriminative Learning of Sparse Coding.” ISPRS Journal of Photogrammetry and Remote Sensing 89: 37–48.
  • Haralick, R. M., S. R. Sternberg, and X. Zhuang. 1987. “Image Analysis Using Mathematical Morphology.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 9(4): 532–550.
  • Harel, J., C. Koch, and P. Perona. 2007. “Graph-based Visual Saliency.” In In Advances in Neural Information Processing Systems, MIT Press, 545–552.
  • He, K., X. Zhang, S. Ren, and J. Sun 2016. “Deep Residual Learning for Image Recognition.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, NV, USA, 770–778.
  • Hosang, J., R. Benenson, and B. Schiele 2017. “Learning Non-maximum Suppression.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA,  4507–4515.
  • Itti, L., C. Koch, and E. Niebur. 1998. “A Model of Saliency-based Visual Attention for Rapid Scene Analysis.” IEEE Transactions on Pattern Analysis and Machine Intelligence, 20 (11): 1254–1259.
  • Kang, M., K. Ji, X. Leng, and Z. Lin. 2017. “Contextual Region-based Convolutional Neural Network with Multilayer Fusion for SAR Ship Detection.” Remote Sensing 9 (8): 860.
  • Kanjir, U., H. Greidanus, and K. Oštir. 2018. “Vessel Detection and Classification from Spaceborne Optical Images: A Literature Survey.” Remote Sensing of Environment 207: 1–26.
  • Li, C., C. Xu, Z. Cui, D. Wang, Z. Jie, T. Zhang, and J. Yang 2019. “Learning Object-Wise Semantic Representation for Detection in Remote Sensing Imagery.” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA, 20–27.
  • Li, Q., L. Mou, Q. Liu, Y. Wang, and X. Zhu. 2018. “HSF-Net: Multiscale Deep Feature Embedding for Ship Detection in Optical Remote Sensing Imagery.” IEEE Transactions on Geoscience and Remote Sensing,56 (12): 1–15.
  • Li, S., Z. Zhou, B. Wang, and F. Wu. 2016. “A Novel Inshore Ship Detection via Ship Head Classification and Body Boundary Determination.” IEEE Geoscience and Remote Sensing Letters 13: 1920–1924.
  • Lin, T. Y., P. Goyal, R. Girshick, K. He, and P. Dollár 2017. “Focal Loss for Dense Object Detection.” In Proceedings of the IEEE international conference on computer vision, Venice, Italy,  2980–2988.
  • Liu, Q., X. Lu, Z. He, C. Zhang, and W. Chen. 2017a. “Deep Convolutional Neural Networks for Thermal Infrared Object Tracking.” Knowledge-Based Systems 134: 189–198.
  • Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, and A. Berg 2016. “SSD: Single Shot Multibox Detector.” In European conference on computer vision, Amsterdam, Netherlands, 21–37.
  • Liu, Y., M. Cheng, X. Hu, K. Wang, and X. Bai 2017b. “Richer Convolutional Features for Edge Detection.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA, 3000–3009.
  • Ojala, T., M. Pietikäinen, and T. Mäenpää. 2002. “Multiresolution Gray-scale and Rotation Invariant Texture Classification with Local Binary Patterns.” IEEE Transactions on Pattern Analysis and Machine Intelligence 7: 971–987.
  • Otsu, N. 1979. “A Threshold Selection Method from Gray-level Histograms.” IEEE Transactions on Systems, Man, and Cybernetics 9: 62–66.
  • Pan, Z., X. Qiu, Z. Huang, and B. Lei. 2016. “Airplane Recognition in TerraSAR-X Images via Scatter Cluster Extraction and Reweighted Sparse Representation.” IEEE Geoscience and Remote Sensing Letters 14 (1): 112–116.
  • Perazzi, F., P. Krähenbühl, Y. Pritch, and A. Hornung 2012. “Saliency Filters: Contrast Based Filtering for Salient Region Detection.” In 2012 IEEE conference on computer vision and pattern recognition, Providence, RI, USA, 733–740.
  • Qi, S., J. Ma, J. Lin, Y. Li, and J. Tian. 2015. “Unsupervised Ship Detection Based on Saliency and S-HOG Descriptor from Optical Satellite Images.” IEEE Geoscience and Remote Sensing Letters 12: 1451–1455.
  • Qiu, S., G. Wen, and Y. Fan. 2017. “Occluded Object Detection in High-Resolution Remote Sensing Images Using Partial Configuration Object Model.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (5): 1909–1925.
  • Redmon, J., and A. Farhadi 2018. “Yolov3: An Incremental Improvement.” arXiv preprint arXiv. 1804.02767.
  • Redmon, J., S. Divvala, R. Girshick, and A. Farhadi 2016. “You Only Look Once: Unified, Real-time Object Detection.” In Proceedings of the IEEE conference on computer vision and pattern recognition, Boston, USA, 779–788.
  • Ren, S., K. He, R. Girshick, and J. Sun 2015. “Faster R-cnn: Towards Real-time Object Detection with Region Proposal Networks.” In Advances in neural information processing systems 91–99.
  • Simonyan, K., and A. Zisserman 2014. “Very Deep Convolutional Networks for Large-scale Image Recognition”. arXiv preprint arXiv 1409.1556.
  • Tang, J., C. Deng, G. Huang, and B. Zhao. 2014. “Compressed-domain Ship Detection on Spaceborne Optical Image Using Deep Neural Network and Extreme Learning Machine.” IEEE Transactions on Geoscience and Remote Sensing 53: 1174–1185.
  • Tao, C., Y. Tan, and H. Cai. 2010. “Airport Detection from Large IKONOS Images Using Clustered SIFT Keypoints and Region Information.” IEEE Geoscience and Remote Sensing Letters 8: 128–132.
  • Von Gioi, R. G., J. Jakubowicz, J. M. Morel, and G. Randall. 2012. “LSD: A Line Segment Detector.” Image Processing Online 2: 35–55.
  • Wang, N., B. Li, Q. Xu, and Y. Wang. 2018. “Automatic Ship Detection in Optical Remote Sensing Images Based on Anomaly Detection and SPP-PCA Net.” Remote Sensing 11 (1): 47.
  • Wang, X., S. Shen, C. Ning, F. Huang, and H. Gao. 2016. “Multi-class Remote Sensing Object Recognition Based on Discriminative Sparse Representation.” Applied Optics 55 (6): 1381–1394.
  • Weldon, T. P., W. E. Higgins, and D. Dunn. 1996. “Efficient Gabor Filter Design for Texture Segmentation.” Pattern Recognition 29: 2005–2015.
  • Wu, H., H. Zhang, J. Zhang, and F. Xu 2015. “Fast Aircraft Detection in Satellite Images Based on Convolutional Neural Networks.” In 2015 IEEE International Conference on Image Processing, Quebec, Canada, 4210–4214.
  • Xia, G. S., X. Bai, J. Ding, Z. Zhu, S. Belongie, and J. Luo 2018. “Dota: A Large-scale Dataset for Object Detection in Aerial Images.” In Proceedings of the IEEE international conference on computer vision, Salt Lake City, UT, USA, 3974–3983.
  • Xu, Y., M. Zhu, S. Li, H. Feng, S. Ma, and J. Che. 2018. “End-to-end Airport Detection in Remote Sensing Images Combining Cascade Region Proposal Networks and Multi-threshold Detection Networks.” Remote Sensing 10 (10): 1516.
  • Yang, F., Q. Xu, and B. Li. 2017. “Ship Detection from Optical Satellite Images Based on Saliency Segmentation and structure-LBP Feature.” IEEE Geoscience and Remote Sensing Letters 14: 602–606.
  • Yang, X., H. Sun, K. Fu, J. Yang, X. Sun, M. Yan, and Z. Guo. 2018. “Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks.” Remote Sensing 10 (1): 132–145. doi:10.3390/rs10010132.
  • You, Y., Z. Li, B. Ran, J. Cao, S. Lv, and F. Liu. 2019. “Broad Area Target Search System for Ship Detection via Deep Convolutional Neural Network.” Remote Sensing 11 (17): 1965.
  • Yu, Y., H. Guan, and D. Zai. 2016. “Rotation-and-scale-invariant Airplane Detection in High-resolution Satellite Images Based on deep-Hough-forests.” ISPRS Journal of Photogrammetry and Remote Sensing 112: 50–64.
  • Zeng, F., L. Cheng, N. Li, N. Xia, L. Ma, X. Zhou, and M. Li. 2019. “A Hierarchical Airport Detection Method Using Spatial Analysis and Deep Learning.” Remote Sensing 11 (19): 2204.
  • Zhang, F., B. Du, and L. Zhang. 2014. “Saliency-guided Unsupervised Feature Learning for Scene Classification.” IEEE Transactions on Geoscience and Remote Sensing 53: 2175–2184.
  • Zhang, J., S. Sclaroff, Z. Lin, X. Shen, B. Price, and R. Mech 2015. “Minimum Barrier Salient Object Detection at 80 Fps.” In Proceedings of the IEEE international conference on computer vision, Santiago, Chile, 1404–1412.
  • Zhang, L., J. Chen, and B. Qiu. 2016. “Region-of-interest Coding Based on Saliency Detection and Directional Wavelet for Remote Sensing Images.” IEEE Geoscience and Remote Sensing Letters 14: 23–27.
  • Zhang, L., and K. Yang. 2013. “Region-of-interest Extraction Based on Frequency Domain Analysis and Salient Region Detection for Remote Sensing Image.” IEEE Geoscience and Remote Sensing Letters 11 (5): 916–920.
  • Zhang, L., and Y. Zhang. 2016. “Airport Detection and Aircraft Recognition Based on Two-layer Saliency Model in High Spatial Resolution Remote-sensing Images.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10: 1511–1524.
  • Zhu, D., B. Wang, and L. Zhang. 2015. “Airport Target Detection in Remote Sensing Images: A New Method Based on Two-way Saliency.” IEEE Geoscience and Remote Sensing Letters 12: 1096–1100.
  • Zhu, M., Y. Xu, S. Ma, S. Li, H. Ma, and Y. Han. 2019. “Effective Airplane Detection in Remote Sensing Images Based on Multilayer Feature Fusion and Improved Nonmaximal Suppression Algorithm.” Remote Sensing 11: 1062–1079.
  • Zhu, X. X., D. Tuia, L. Mou, G. S. Xia, L. Zhang, F. Xu, and F. Fraundorfer 2017. “Deep Learning in Remote Sensing: A Comprehensive Review and List of Resources.” IEEE Geoscience and Remote Sensing Magazine 5: 8–36.

Reprints and Corporate Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

To request a reprint or corporate permissions for this article, please click on the relevant link below:

Academic Permissions

Please note: Selecting permissions does not provide access to the full text of the article, please see our help page How do I view content?

Obtain permissions instantly via Rightslink by clicking on the button below:

If you are unable to obtain permissions via Rightslink, please complete and submit this Permissions form. For more information, please visit our Permissions help page.