Advanced search
Publication Cover
International Journal of Remote Sensing Volume 42, 2021 - Issue 24
Submit an article Journal homepage
1,983
Views
2
CrossRef citations to date
0
Altmetric
Research Article

Dual-det : a fast detector for oriented object detection in aerial images

Qiuyu Guana Space Control and Inertial Technology Research Center, Harbin Institute of Technology, Harbin, ChinaORCID Iconhttps://orcid.org/0000-0003-0263-5600
ORCID Icon,
Zhenshen Qua Space Control and Inertial Technology Research Center, Harbin Institute of Technology, Harbin, ChinaCorrespondence[email protected]
,
Pengbo Zhaoa Space Control and Inertial Technology Research Center, Harbin Institute of Technology, Harbin, China
,
Ming Zenga Space Control and Inertial Technology Research Center, Harbin Institute of Technology, Harbin, China
&
Junyu Liub Graduate School of Informatics, Kyoto University, Kyoto, Japan
Pages 9542-9564 | Published online: 10 Dec 2021

References

  • Azimi, S. M., E. Vig, R. Bahmanyar, M. Körner, and P. Reinartz. 2019. “Towards Multi-class Object Detection in Unconstrained Remote Sensing Imagery.” In Computer Vision – ACCV 2018, edited by C. V. Jawahar, L. Hongdong, G. Mori, and K. Schindler, 150–165. Cham: Springer International Publishing.
  • Cai, Z., and N. Vasconcelos. 2018. “Cascade R-CNN: Delving Into High Quality Object Detection.” In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 6154–6162.
  • Cheng, G., P. Zhou, and J. Han. 2016. “Learning Rotation-invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images.” IEEE Transactions on Geoscience and Remote Sensing 54 (12): 7405–7415. doi:https://doi.org/10.1109/TGRS.2016.2601622.
  • Dai, J., Q. Haozhi, Y. Xiong, L. Yi, G. Zhang, H. Han, and Y. Wei. 2017. “Deformable Convolutional Networks.” In 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 764–773.
  • Dai, J., L. Yi, H. Kaiming, and J. Sun. 2016. “R-fcn: Object Detection via Region-based Fully Convolutional Networks.” In Advances in Neural Information Processing Systems, 379–387.
  • Dalal, N., and B. Triggs. 2005. “Histograms of Oriented Gradients for Human Detection.” In 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), Vol. 1, San Diego, CA, USA, 886–893
  • Deng, Z., H. Sun, S. Zhou, J. Zhao, and H. Zou. 2017. “Toward Fast and Accurate Vehicle Detection in Aerial Images Using Coupled Region-based Convolutional Neural Networks.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 10 (8): 3652–3664. doi:https://doi.org/10.1109/JSTARS.2017.2694890.
  • Ding, J., N. Xue, Y. Long, G.-S. Xia, and L. Qikai 2019. “Learning RoI Transformer for Oriented Object Detection in Aerial Images.” In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2844–2853.
  • Farhadi, A., and J. Redmon. 2018. “Yolov3: An Incremental Improvement.” In Computer Vision and Pattern Recognition, 1804–02767. Germany: Springer Berlin/ Heidelberg.
  • Girshick, R. 2015. “Fast R-CNN.” In 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile, 1440–1448.
  • Girshick, R., J. Donahue, T. Darrell, and J. Malik. 2014. “Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation.” In 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 580–587.
  • He, K., X. Zhang, S. Ren, and J. Sun. 2016. “Deep Residual Learning for Image Recognition.” In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 770–778.
  • Hong, D., L. Gao, J. Yao, B. Zhang, A. Plaza, and J. Chanussot. 2021a. “Graph Convolutional Networks for Hyperspectral Image Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (7): 5966–5978. doi:https://doi.org/10.1109/TGRS.2020.3015157.
  • Hong, D., L. Gao, N. Yokoya, J. Yao, J. Chanussot, Q. Du, and B. Zhang. 2021b. “More Diverse Means Better: Multimodal Deep Learning Meets Remote-Sensing Imagery Classification.” IEEE Transactions on Geoscience and Remote Sensing 59 (5): 4340–4354. doi:https://doi.org/10.1109/TGRS.2020.3016820.
  • Jiang, Y., X. Zhu, X. Wang, S. Yang, L. Wei, H. Wang, F. Pei, and Z. Luo. 2017. “R2cnn: Rotational Region Cnn for Orientation Robust Scene Text Detection.” In arXiv Preprint arXiv:1706.09579.
  • Kingma, D. P., and B. Jimmy. 2014. “Adam: A Method for Stochastic Optimization.” In arXiv Preprint arXiv:1412.6980.
  • Law, H., and J. Deng. 2018. “CornerNet: Detecting Objects as Paired Keypoints.” In Computer Vision – ECCV 2018, edited by V. Ferrari, M. Hebert, C. Sminchisescu, and Y. Weiss, 765–781. Cham: Springer International Publishing.
  • Liao, M., B. Shi, and X. Bai. 2018. “Textboxes++: A Single-shot Oriented Scene Text Detector.” IEEE Transactions on Image Processing 27 (8): 3676–3690. doi:https://doi.org/10.1109/TIP.2018.2825107.
  • Liao, M., Z. Zhu, B. Shi, G.-S. Xia, and X. Bai. 2018. “Rotation-Sensitive Regression for Oriented Scene Text Detection.” In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 5909–5918.
  • Lin, T.-Y., P. Dollár, R. Girshick, H. Kaiming, B. Hariharan, and S. Belongie. 2017a. “Feature Pyramid Networks for Object Detection.” In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 936–944.
  • Lin, T.-Y., P. Goyal, R. Girshick, H. Kaiming, and D. Piotr. 2017b. “Focal Loss for Dense Object Detection.” In 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 2999–3007.
  • Liu, K., and G. Mattyus. 2015. “Fast Multiclass Vehicle Detection on Aerial Images.” IEEE Geoscience and Remote Sensing Letters 12 (9): 1938–1942. doi:https://doi.org/10.1109/LGRS.2015.2439517.
  • Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, F. Cheng-Yang, and A. C. Berg. 2016a. “SSD: Single Shot MultiBox Detector.” In Computer Vision – ECCV 2016, edited by B. Leibe, J. Matas, N. Sebe, and M. Welling, 21–37. Cham: Springer International Publishing.
  • Liu, Z., H. Jingao, L. Weng, and Y. Yang. 2017. “Rotated Region Based CNN for Ship Detection.” In 2017 IEEE International Conference on Image Processing (ICIP), Beijing, China, 900–904.
  • Liu, Z., H. Wang, L. Weng, and Y. Yang. 2016b. “Ship Rotated Bounding Box Space for Ship Extraction from High-resolution Optical Satellite Images with Complex Backgrounds.” IEEE Geoscience and Remote Sensing Letters 13 (8): 1074–1078. doi:https://doi.org/10.1109/LGRS.2016.2565705.
  • Long, Y., Y. Gong, Z. Xiao, and Q. Liu. 2017. “Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 55 (5): 2486–2498. doi:https://doi.org/10.1109/TGRS.2016.2645610.
  • Ma, J., W. Shao, H. Ye, L. Wang, H. Wang, Y. Zheng, and X. Xue. 2018. “Arbitrary-oriented Scene Text Detection via Rotation Proposals.” IEEE Transactions on Multimedia 20 (11): 3111–3122. doi:https://doi.org/10.1109/TMM.2018.2818020.
  • Redmon, J., S. Divvala, R. Girshick, and A. Farhadi. 2016. “You Only Look Once: Unified, Real-Time Object Detection.” In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 779–788.
  • Redmon, J., and A. Farhadi. 2017. “YOLO9000: Better, Faster, Stronger.” In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 6517–6525.
  • Ren, S., H. Kaiming, R. Girshick, and J. Sun. 2017. “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (6): 1137–1149.
  • Tian, Z., C. Shen, H. Chen, and H. Tong 2019. “FCOS: Fully Convolutional One-Stage Object Detection.” In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 9626–9635.
  • Wang, J., W. Yang, L. Heng-Chao, H. Zhang, and G.-S. Xia. 2021. “Learning Center Probability Map for Detecting Objects in Aerial Images.” IEEE Transactions on Geoscience and Remote Sensing 59 (5): 4307–4323. doi:https://doi.org/10.1109/TGRS.2020.3010051.
  • Wei, H., Y. Zhang, Z. Chang, L. Hao, H. Wang, and X. Sun. 2020. “Oriented Objects as Pairs of Middle Lines.” ISPRS Journal of Photogrammetry and Remote Sensing 169: 268–279. doi:https://doi.org/10.1016/j.isprsjprs.2020.09.022.
  • Wu, X., D. Hong, J. Chanussot, Y. Xu, R. Tao, and Y. Wang. 2020. “Fourier-Based Rotation-Invariant Feature Boosting: An Efficient Framework for Geospatial Object Detection.” IEEE Geoscience and Remote Sensing Letters 17 (2): 302–306. doi:https://doi.org/10.1109/LGRS.2019.2919755.
  • Wu, X., D. Hong, J. Tian, J. Chanussot, L. Wei, and R. Tao. 2019a. “Orsim Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-Frequency Channel Features.” IEEE Transactions on Geoscience and Remote Sensing 57 (7): 5146–5158.
  • Wu, X., D. Hong, J. Tian, J. Chanussot, L. Wei, and R. Tao. 2019b. “Orsim Detector: A Novel Object Detection Framework in Optical Remote Sensing Imagery Using Spatial-frequency Channel Features.” IEEE Transactions on Geoscience and Remote Sensing 57 (7): 5146–5158.
  • Xia, G.-S., X. Bai, J. Ding, Z. Zhu, S. Belongie, J. Luo, M. Datcu, M. Pelillo, and L. Zhang. 2018. “DOTA: A Large-Scale Dataset for Object Detection in Aerial Images.” In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, 3974–3983.
  • Yang, X., F. Kun, H. Sun, J. Yang, Z. Guo, M. Yan, T. Zhan, and S. Xian. 2018a. “R2CNN++: Multi-dimensional Attention Based Rotation Invariant Detector with Robust Anchor Strategy.” arXiv Preprint arXiv:1811.07126 2: 7.
  • Yang, X., Q. Liu, J. Yan, and L. Ang. 2019a. “R3DET: Refined Single-stage Detector with Feature Refinement for Rotating Object.” In arXiv Preprint arXiv:1908.05612.
  • Yang, X., H. Sun, K. Fu, J. Yang, X. Sun, M. Yan, and Z. Guo. 2018b. “Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks.” Remote Sensing 10 (1): 132. doi:https://doi.org/10.3390/rs10010132.
  • Yang, X., J. Yang, J. Yan, Y. Zhang, T. Zhang, Z. Guo, X. Sun, and F. Kun 2019b. “SCRDet: Towards More Robust Detection for Small, Cluttered and Rotated Objects.” In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea (South), 8231–8240.
  • Zhang, Z., W. Guo, S. Zhu, and W. Yu. 2018. “Toward Arbitrary-oriented Ship Detection with Rotated Region Proposal and Discrimination Networks.” IEEE Geoscience and Remote Sensing Letters 15 (11): 1745–1749. doi:https://doi.org/10.1109/LGRS.2018.2856921.
  • Zhong, Z., L. Sun, and Q. Huo. 2019. “An Anchor-free Region Proposal Network for Faster R-CNN-based Text Detection Approaches.” International Journal on Document Analysis and Recognition (IJDAR) 22 (3): 315–327. doi:https://doi.org/10.1007/s10032-019-00335-y.
  • Zhou, X., D. Wang, and K. Philipp. 2019. “Objects as Points.” In arXiv Preprint arXiv:1904.07850.
  • Zhou, X., J. Zhuo, and K. Philipp. 2019. “Bottom-Up Object Detection by Grouping Extreme and Center Points.” In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 850–859.
  • Zhu, H., X. Chen, W. Dai, F. Kun, Y. Qixiang, and J. Jiao. 2015. “Orientation Robust Object Detection in Aerial Images Using Deep Convolutional Neural Network.” In 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, Canada, 3735–3739.
  • Zhu, Y., J. Du, and W. Xueqing. 2020. “Adaptive Period Embedding for Representing Oriented Objects in Aerial Images.” IEEE Transactions on Geoscience and Remote Sensing 58 (10): 7247–7257. doi:https://doi.org/10.1109/TGRS.2020.2981203.

Related research

People also read lists articles that other readers of this article have read.

Recommended articles lists articles that we recommend and is powered by our AI driven recommendation engine.

Cited by lists all citing articles based on Crossref citations.
Articles with the Crossref icon will open in a new tab.