MKLM: a multiknowledge learning module for object detection in remote sensing images

References

• Abadi, M., P. Barham, J. Chen, Z. Chen, A. Davis, J. Dean, M. Devin, et al. 2016. “Tensorflow: A System for Large-Scale Machine Learning.” 12th {USENIX} symposium on operating systems design and implementation ({OSDI} 16), Savannah, Georgia, USA, 265–283.
   Google Scholar
• Ahmad, K., K. Pogorelov, M. Riegler, O. Ostroukhova, P. Halvorsen, N. Conci, and R. Dahyot. 2019. “Automatic Detection of Passable Roads After Floods in Remote Sensed and Social Media Data.” Signal Processing: Image Communication 74: 110–118.
   Web of Science ®Google Scholar
• Azimi, S. M., E. Vig, R. Bahmanyar, M. Körner, and P. Reinartz. 2018. “Towards Multi-Class Object Detection in Unconstrained Remote Sensing Imagery.” Asian Conference on Computer Vision, Perth Western, Australia, 150–165. Springer.
   Google Scholar
• Bochkovskiy, A., C.-Y. Wang, and H.-Y. Mark Liao. 2020. “Yolov4: Optimal Speed and Accuracy of Object Detection.” arXiv preprint arXiv:2004.10934.
   Google Scholar
• Cao, L., X. Zhang, Z. Wang, and G. Ding. 2021. “Multi Angle Rotation Object Detection for Remote Sensing Image Based on Modified Feature Pyramid Networks.” International Journal of Remote Sensing 42 (14): 5253–5276. doi:https://doi.org/10.1080/01431161.2021.1910371.
   Web of Science ®Google Scholar
• Carion, N., F. Massa, G. Synnaeve, N. Usunier, A. Kirillov, and S. Zagoruyko. 2020. “End-To-End Object Detection with Transformers.” European Conference on Computer Vision, 213–229. Springer.
   Google Scholar
• Chen, K., J. Pang, J. Wang, Y. Xiong, X. Li, S. Sun, W. Feng, et al. 2019. “Hybrid Task Cascade for Instance Segmentation.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 4969–4978.
   Google Scholar
• Cheng, G., C. Lang, M. Wu, X. Xie, X. Yao, and J. Han. 2021. “Feature Enhancement Network for Object Detection in Optical Remote Sensing Images.” Journal of Remote Sensing 2021: 9805389.
   Web of Science ®Google Scholar
• Cho, K., B. Van Merriënboer, C. Gulcehre, D. Bahdanau, F. Bougares, H. Schwenk, and Y. Bengio. 2014. “Learning Phrase Representations Using Rnn Encoder-Decoder for Statistical Machine Translation.” arXiv preprint arXiv:1406.1078.
   Google Scholar
• Dai, J., Y. Li, K. He, and J. Sun. 2016. “R-Fcn: Object Detection via Region-Based Fully Convolutional Networks.” Advances in neural information processing systems, Barcelona, Spain, 379–387.
   Google Scholar
• Deng, Z., H. Sun, S. Zhou, J. Zhao, L. Lei, and H. Zou. 2018. “Multi-Scale Object Detection in Remote Sensing Imagery with Convolutional Neural Networks.” ISPRS Journal of Photogrammetry and Remote Sensing 145: 3–22. doi:https://doi.org/10.1016/j.isprsjprs.2018.04.003.
   Web of Science ®Google Scholar
• Ding, J., N. Xue, Y. Long, G.-S. Xia, and Q. Lu. 2019. “Learning Roi Transformer for Oriented Object Detection in Aerial Images.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 2844–2853.
   Google Scholar
• Dong, Z. and B. Lin. 2020. “Learning a Robust CNN-Based Rotation Insensitive Model for Ship Detection in VHR Remote Sensing Images.” International Journal of Remote Sensing 41 (9): 3614–3626. doi:https://doi.org/10.1080/01431161.2019.1706781.
   Web of Science ®Google Scholar
• Everingham, M., L. Van Gool, C. K. Williams, J. Winn, and A. Zisserman. 2010. “The Pascal Visual Object Classes (voc) Challenge.” International Journal of Computer Vision 88 (2): 303–338. doi:https://doi.org/10.1007/s11263-009-0275-4.
   Web of Science ®Google Scholar
• Han, J., J. Ding, N. Xue, and G.-S. Xia. 2021. “Redet: A Rotation-Equivariant Detector for Aerial Object Detection.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2786–2795.
   Google Scholar
• He, K., G. Gkioxari, P. Dollár, and R. Girshick. 2020. “Mask R-CNN.” IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (2): 386–397. doi:https://doi.org/10.1109/TPAMI.2018.2844175.
   PubMed Web of Science ®Google Scholar
• Hoiem, D., Y. Chodpathumwan, and Q. Dai. 2012. “Diagnosing Error in Object Detectors.” European conference on computer vision, Florence, Italy, 340–353. Springer.
   Google Scholar
• Hong, D., N. Yokoya, N. Ge, J. Chanussot, and X. Xiang Zhu. 2019. “Learnable Manifold Alignment (Lema): A Semi-Supervised Cross-Modality Learning Framework for Land Cover and Land Use Classification.” ISPRS Journal of Photogrammetry and Remote Sensing 147: 193–205. doi:https://doi.org/10.1016/j.isprsjprs.2018.10.006.
   PubMed Web of Science ®Google Scholar
• Hu, H., J. Gu, Z. Zhang, J. Dai, and Y. Wei. 2018. “Relation Networks for Object Detection.” Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, Utah, USA, 3588–3597.
   Google Scholar
• Hu, D., S. Li, J. Chen, and V. R. Kamat. 2019. “Detecting, Locating, and Characterizing Voids in Disaster Rubble for Search and Rescue.” Advanced Engineering Informatics 42: 100974. doi:https://doi.org/10.1016/j.aei.2019.100974.
   Web of Science ®Google Scholar
• Jiang, C., H. Xu, X. Liang, and L. Lin. 2018. ”Hybrid Knowledge Routed Modules for Large-Scale Object Detection.” arXiv preprint arXiv:1810.12681.
   Google Scholar
• Kamran, F., M. Shahzad, and F. Shafait. 2018. “Automated Military Vehicle Detection from Low-Altitude Aerial Images.” 2018 Digital Image Computing: Techniques and Applications (DICTA), Canberra, Australia, 1–8. IEEE.
   Google Scholar
• Law, H. and J. Deng. 2018. “Cornernet: Detecting Objects as Paired Keypoints.” Proceedings of the European conference on computer vision (ECCV), Munich,Germany, 734–750.
   Google Scholar
• Li, K., G. Wan, G. Cheng, L. Meng, and J. Han. 2020. “Object Detection in Optical Remote Sensing Images: A Survey and a New Benchmark.” ISPRS Journal of Photogrammetry and Remote Sensing 159: 296–307. doi:https://doi.org/10.1016/j.isprsjprs.2019.11.023.
   Web of Science ®Google Scholar
• Li, C., C. Xu, Z. Cui, D. Wang, Z. Jie, T. Zhang, and J. Yang. 2019. “Learning Object-Wise Semantic Representation for Detection in Remote Sensing Imagery.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Long Beach, CA, USA, 20–27.
   Google Scholar
• Liang, D., Z. Wei, D. Zhang, Q. Geng, L. Zhang, H. Sun, H. Zhou, M. Wei, and P. Gao. 2021. ”Learning Calibrated-Guidance for Object Detection in Aerial Images.” arXiv preprint arXiv:2103.11399.
   Google Scholar
• Lin, T.-Y., P. Dollár, R. Girshick, K. He, B. Hariharan, and S. Belongie. 2017. “Feature Pyramid Networks for Object Detection.” 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Hawaii, USA, 936–944.
   Google Scholar
• Lin, T.-Y., P. Goyal, R. Girshick, K. He, and P. Dollár. 2020. “Focal Loss for Dense Object Detection.” IEEE Transactions on Pattern Analysis and Machine Intelligence 42 (2): 318–327. doi:https://doi.org/10.1109/TPAMI.2018.2858826.
   PubMed Web of Science ®Google Scholar
• Lin, T.-Y., M. Maire, S. Belongie, J. Hays, P. Perona, D. Ramanan, P. Dollár, and C. Lawrence Zitnick. 2014. “Microsoft Coco: Common Objects in Context.” European conference on computer vision, Zurich, Switzerland, 740–755. Springer.
   Google Scholar
• Liu, Z., Y. Lin, Y. Cao, H. Hu, Y. Wei, Z. Zhang, S. Lin, and B. Guo. 2021. “Swin Transformer: Hierarchical Vision Transformer Using Shifted Windows.” arXiv preprint arXiv:2103.14030.
   Google Scholar
• Liu, Y., R. Wang, S. Shan, and X. Chen. 2018. “Structure Inference Net: Object Detection Using Scene-Level Context and Instance-Level Relationships.” 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, Utah, USA, 6985–6994.
   Google Scholar
• Long, Y., Y. Gong, Z. Xiao, and Q. Liu. 2017. “Accurate Object Localization in Remote Sensing Images Based on Convolutional Neural Networks.” IEEE Transactions on Geoscience and Remote Sensing 55 (5): 2486–2498. doi:https://doi.org/10.1109/TGRS.2016.2645610.
   Web of Science ®Google Scholar
• Ma, W., Q. Guo, Y. Wu, W. Zhao, X. Zhang, and L. Jiao. 2019b. “A Novel Multi-Model Decision Fusion Network for Object Detection in Remote Sensing Images.” Remote Sensing 11 (7): 737. doi:https://doi.org/10.3390/rs11070737.
   Web of Science ®Google Scholar
• Ma, L., Y. Liu, X. Zhang, Y. Ye, G. Yin, and B. Alan Johnson. 2019a. “Deep Learning in Remote Sensing Applications: A Meta-Analysis and Review.” ISPRS Journal of Photogrammetry and Remote Sensing 152: 166–177. doi:https://doi.org/10.1016/j.isprsjprs.2019.04.015.
   Web of Science ®Google Scholar
• Mishra, B., D. Garg, P. Narang, and V. Mishra. 2020. “Drone-Surveillance for Search and Rescue in Natural Disaster.” Computer Communications 156: 1–10. doi:https://doi.org/10.1016/j.comcom.2020.03.012.
   Web of Science ®Google Scholar
• Pang, J., K. Chen, J. Shi, H. Feng, W. Ouyang, and D. Lin. 2019. “Libra R-Cnn: Towards Balanced Learning for Object Detection.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 821–830.
   Google Scholar
• Redmon, J., S. Divvala, R. Girshick, and A. Farhadi. 2016. “You Only Look Once: Unified, Real-Time Object Detection.” 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, USA, 779–788.
   Google Scholar
• Ren, S., K. He, R. Girshick, and J. Sun. 2016. “Faster R-Cnn: Towards Real-Time Object Detection with Region Proposal Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (6): 1137–1149. doi:https://doi.org/10.1109/TPAMI.2016.2577031.
   PubMed Web of Science ®Google Scholar
• Sirmacek, B. and C. Unsalan. 2009. “Urban-Area and Building Detection Using Sift Keypoints and Graph Theory.” IEEE Transactions on Geoscience and Remote Sensing 47 (4): 1156–1167. doi:https://doi.org/10.1109/TGRS.2008.2008440.
   Web of Science ®Google Scholar
• Tian, Z., C. Shen, H. Chen, and T. He. 2019. “Fcos: Fully Convolutional One-Stage Object Detection.” 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea, 9626–9635.
   Google Scholar
• Wang, G., Y. Zhuang, H. Chen, X. Liu, T. Zhang, L. Li, S. Dong, and Q. Sang. 2022. “FSoD-Net: Full-Scale Object Detection from Optical Remote Sensing Imagery.“ IEEE Transactions on Geoscience and Remote Sensing 60: 1–18. doi:https://doi.org/10.1109/TGRS.2021.3064599.
   Web of Science ®Google Scholar
• Xi, Y., J. Zheng, X. He, W. Jia, H. Li, Y. Xie, M. Feng, and X. Li. 2020. “Beyond Context: Exploring Semantic Similarity for Small Object Detection in Crowded Scenes.” Pattern Recognition Letters 137: 53–60. doi:https://doi.org/10.1016/j.patrec.2019.03.009.
   Web of Science ®Google Scholar
• Xia, G.-S., X. Bai, J. Ding, Z. Zhu, S. Belongie, J. Luo, M. Datcu, M. Pelillo, and L. Zhang. 2018. “DOTA: A Large-Scale Dataset for Object Detection in Aerial Images.” Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, Utah, USA, 3974–3983.
   Google Scholar
• Xu, H., C. Jiang, X. Liang, L. Lin, and Z. Li. 2019. “Reasoning-Rcnn: Unifying Adaptive Global Reasoning into Large-Scale Object Detection.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA, 6419–6428.
   Google Scholar
• Yan, J., H. Wang, M. Yan, W. Diao, X. Sun, and H. Li. 2019. “IoU-Adaptive Deformable R-CNN: Make Full Use of IoU for Multi-Class Object Detection in Remote Sensing Imagery.” Remote Sensing 11 (3): 286. doi:https://doi.org/10.3390/rs11030286.
   Web of Science ®Google Scholar
• Yang, X., H. Sun, K. Fu, J. Yang, X. Sun, M. Yan, and Z. Guo. 2018. “Automatic Ship Detection in Remote Sensing Images from Google Earth of Complex Scenes Based on Multiscale Rotation Dense Feature Pyramid Networks.” Remote Sensing 10 (1): 132. doi:https://doi.org/10.3390/rs10010132.
   Web of Science ®Google Scholar
• Zhang, G., S. Lu, and W. Zhang. 2019. “Cad-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery.” IEEE Transactions on Geoscience and Remote Sensing 57 (12): 10015–10024. doi:https://doi.org/10.1109/TGRS.2019.2930982.
   Web of Science ®Google Scholar
• Zhao, X., J. Zhang, J. Tian, L. Zhuo, and J. Zhang. 2021. “Multiscale Object Detection in High-Resolution Remote Sensing Images via Rotation Invariant Deep Features Driven by Channel Attention.” International Journal of Remote Sensing 42 (15): 5754–5773. doi:https://doi.org/10.1080/01431161.2021.1931537.
   Web of Science ®Google Scholar
• Zhou, X., D. Wang, and P. Krähenbühl. 2019. “Objects as Points.” arXiv preprint arXiv:1904.07850.
   Google Scholar
• Zhou, X., J. Zhuo, and P. Krähenbühl. 2019. “Bottom-Up Object Detection by Grouping Extreme and Center Points.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 850–859.
   Google Scholar
• Zhu, C., F. Chen, U. Ahmed, Z. Shen, and M. Savvides. 2021. “Semantic Relation Reasoning for Shot-Stable Few-Shot Object Detection.” Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 8782–8791.
   Google Scholar