Using deep learning in an embedded system for real-time target detection based on images from an unmanned aerial vehicle: vehicle detection as a case study

References

• Amato, G., L. Ciampi, F. Falchi, and C. Gennaro. 2019. “Counting Vehicles with Deep Learning in Onboard UAV Imagery.” In 2019 IEEE Symposium on Computers and Communications (ISCC), 1–6. doi:10.1109/ISCC47284.2019.8969620.
   Google Scholar
• Ammar, A., A. Koubaa, M. Ahmed, A. Saad, and B. Benjdira. 2021. “Vehicle Detection from Aerial Images Using Deep Learning: A Comparative Study.” Electronics 10 (7): 820. doi:10.3390/electronics10070820
   Web of Science ®Google Scholar
• Ang, L. M., and K. P. Seng. 2021. “GPU-Based Embedded Intelligence Architectures and Applications.” Electronics 10 (8): 952. doi:10.3390/electronics10080952
   Web of Science ®Google Scholar
• Bai, D., Y. Sun, B. Tao, X. Tong, M. Xu, G. Jiang, B. Chen, Y. Cao, N. Sun, and Z. Li. 2021. “Improved Single Shot Multibox Detector Target Detection Method Based on Deep Feature Fusion.” Concurrency Computat Pract Exper 34 (4): 6614. doi:10.1002/cpe.6614.
   Web of Science ®Google Scholar
• Basso, M., D. Stocchero, R. Ventura Bayan Henriques, A. L. Vian, C. Bredemeier, A. A. Konzen, and E. Pignaton de Freitas. 2019. “Proposal for an Embedded System Architecture Using a GNDVI Algorithm to Support UAV-Based Agrochemical Spraying.” Sensors 19 (24): 5397. doi:10.3390/s19245397
   PubMed Web of Science ®Google Scholar
• Bochkovskiy, A., C. Y. Wang, and H. Y. M. Liao. 2020. “YOLOv4: Optimal Speed and Accuracy of Object Detection.” arXiv preprint arXiv:2004.10934. Advance online publication. doi:10.48550/arXiv.2004.10934.
   Google Scholar
• Boudjit, K., and N. Ramzan. 2022. “Human Detection Based on Deep Learning YOLO-v2 for Real-time UAV Applications.” Journal of Experimental & Theoretical Artificial Intelligence 34 (3): 527–544. doi:10.1080/0952813X.2021.1907793
   Web of Science ®Google Scholar
• Bouguettaya, A., H. Zarzour, A. Kechida, and A. M. Taberkit. 2022. “Vehicle Detection from UAV Imagery with Deep Learning: A Review.” IEEE Transactions on Neural Networks and Learning Systems 33 (11): 6047–6067. doi:10.1109/TNNLS.2021.3080276
   PubMed Web of Science ®Google Scholar
• Cheng S., J. Qin, Y. Chen and M. Li. 2022. “Moving Target Detection Technology Based on UAV Vision.” Hindawi: Wireless Communications and Mobile Computing. doi:10.1155/2022/5443237.
   Web of Science ®Google Scholar
• Fang H., M. Xia, G. Zhou, Y. Chang and L. Yan. 2021. “Infrared Small UAV Target Detection Based on Residual Image Prediction via Global and Local Dilated Residual Networks," in IEEE Geoscience and Remote Sensing Letters19: 1-5. doi: 10.1109/LGRS.2021.3085495.
   Web of Science ®Google Scholar
• Gaszczak, A., T. P. Breckon, and J. Han. 2011. “Real-time People and Vehicle Detection from UAV Imagery.” Proceedings of SPIE - The International Society for Optical Engineering 7878. doi:10.1117/12.876663.
   Google Scholar
• Girshick, R. 2015. “Fast R-CNN.” In Proceedings of the IEEE International Conference on Computer Vision, 1440–1448. Santiago, Chile: IEEE Computer Society. doi:10.1109/ICCV.2015.169.
   Google Scholar
• Girshick, R., J. Donahue, T. Darrell, and J. Malik. 2014. “Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation.” In IEEE Conference on Computer Vision and Pattern Recognition, 580–587. doi:10.48550/arXiv.1311.2524.
   Google Scholar
• Gupta, P., B. Pareek, G. Singal, and D. V. Rao. 2022. “Edge Device Based Military Vehicle Detection and Classification from UAV.” Multimedia Tools and Applications 81 (14): 19813–19834. doi:10.1007/s11042-021-11242-y
   Web of Science ®Google Scholar
• Han, W., J. Chen, L. Wang, R. Feng, F. Li, L. Wu, T. Tian, and J. Yan. 2021. “Methods for Small, Weak Object Detection in Optical High-Resolution Remote Sensing Images: A Survey of Advances and Challenges.” IEEE Geoscience and Remote Sensing Magazine 9 (4): 8–34. doi:10.1109/MGRS.2020.3041450
   Web of Science ®Google Scholar
• He, K., X. Zhang, S. Ren, and J. Sun. 2014. “Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition.” IEEE Transactions on Pattern Analysis and Machine Intelligence 37 (9): 1904–1916. doi:10.1109/TPAMI.2015.2389824
   Web of Science ®Google Scholar
• Hinas, A., J. M. Roberts, and F. Gonzalez. 2017. “Vision-Based Target Finding and Inspection of a Ground Target Using a Multirotor UAV System.” Sensors 17 (12): 2929. doi:10.3390/s17122929
   PubMed Web of Science ®Google Scholar
• Howard, A., M. Sandler, B. Chen, W. Wang, L. C. Chen, M. Tan, G. Chu, et al. 2019. “Searching for MobilenetV3.” In Proceedings of the IEEE/CVF International Conference on Computer Vision, 1314–1324. doi:10.1109/ICCV.2019.00140.
   Google Scholar
• Huang, H., T. Huang, Z. Li, S. Lyu, and T. Hong. 2022a. “Design of Citrus Fruit Detection System Based on Mobile Platform and Edge Computer Device.” Sensors 22 (1): 59. doi:10.3390/s22010059
   Web of Science ®Google Scholar
• Huang, F., S. Peng, H. Yang, H. Cao, N. Ma, and L. Ma. 2022b. “Development of a Novel and Fast XRF Instrument for Large Area Heavy Metal Detection Integrated with UAV.” Environmental Research. doi:10.1016/j.envres.2022.113841.
   Web of Science ®Google Scholar
• Ibrahim, A. W. N., P. W. Ching, G. L. G. Seet, W. S. M. Lau, and W. Czajewski. 2010. “Moving Objects Detection and Tracking Framework for UAV-Based Surveillance.” In 2010 Fourth Pacific-Rim Symposium on Image and Video Technology, 456–461. doi:10.1109/PSIVT.2010.83.
   Google Scholar
• Jiang, S., W. Jiang, and L. Wang. 2022. “Unmanned Aerial Vehicle-Based Photogrammetric 3D Mapping: A Survey of Techniques, Applications, and Challenges.” IEEE Geoscience and Remote Sensing Magazine 10 (2): 135–171. doi:10.1109/MGRS.2021.3122248
   Web of Science ®Google Scholar
• Krasner, G., and S. Pope. 1988. “A Description of the Model-View-Controller User Interface Paradigm in the Smalltalk-80 System.” Journal of Object Oriented Programming 1 (3): 26–49.
   Google Scholar
• Kyrkou, C., G. Plastiras, T. Theocharides, S. I. Venieris, and C. Bouganis. 2018. “DroNet: Efficient Convolutional Neural Network Detector for Real-time UAV Applications.” In 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE), 967–972. doi:10.23919/DATE.2018.8342149.
   Google Scholar
• Li, J., D. H. Ye, M. Kolsch, J. P. Wachs, and C. A. Bouman. 2022. “Fast and Robust UAV to UAV Detection and Tracking from Video.” IEEE Transactions on Emerging Topics in Computing 10 (3): 1519–1531. doi:10.1109/TETC.2021.3104555
   Web of Science ®Google Scholar
• Liu, W., D. Anguelov, D. Erhan, C. Szegedy, S. Reed, C. Fu, and A. C. Berg. 2016. “SSD: Single Shot Multi Box Detector.” In European Conference on Computer Vision, 21–37. Amsterdam: Springer International Publishing. doi:10.1007/978-3-319-46448-0_2.
   Google Scholar
• Liu, M., X. Wang, A. Zhou, X. Fu, Y. Ma, and C. Piao. 2020. “UAV-YOLO: Small Object Detection on Unmanned Aerial Vehicle Perspective.” Sensors 20 (8): 2388. doi:10.3390/s20082388
   PubMed Web of Science ®Google Scholar
• Liu, J., J. Xiang, Y. Jin, R. Liu, J. Yan, and L. Wang. 2021. “Boost Precision Agriculture with Unmanned Aerial Vehicle Remote Sensing and Edge Intelligence: A Survey.” Remote Sensing 13 (21): 4387. doi:10.3390/rs13214387
   Web of Science ®Google Scholar
• Loshchilov, I., and H. Frank. 2018. “Decoupled Weight Decay Regularization.” In International Conference on Learning Representations, New Orleans. doi:10.48550/arXiv.1711.05101.
   Google Scholar
• MacQueen, J. 1967. “Some Methods for Classification and Analysis of Multivariate Observations.” In 5th Berkeley Symp. Math. Statist. Probability, 281–297.
   Google Scholar
• Mademlis, I., A. Torres-González, J. Capitan, M. Montagnuoio, A. Messina, F. Negro, C. L. Barz, et al. 2022. “A Multiple-UAV Architecture for Autonomous Media Production.” Multimedia Tools and Applications, 1–30. doi:10.1007/s11042-022-13319-8.
   Web of Science ®Google Scholar
• Masouleh, M. K., and R. S. Hosseini. 2019. “Development and Evaluation of a Deep Learning Model for Real-Time Ground Vehicle Semantic Segmentation from UAV-Based Thermal Infrared Imagery.” ISPRS Journal of Photogrammetry and Remote Sensing 155: 172–186. doi:10.1016/j.isprsjprs.2019.07.009
   Web of Science ®Google Scholar
• Masouleh, M. K., and R. S. Hosseini. 2022. “2D Target/Anomaly Detection in Time Series Drone Images Using Deep Few-Shot Learning in Small Training Dataset.” In Integrating Meta-Heuristics and Machine Learning for Real-World Optimization Problems, 257–271. doi:10.1007/978-3-030-99079-4_10.
   Google Scholar
• Munawar, H. S., J. Zhang, H. Li, D. Mo, and L. Chang. 2019. “Mining Multispectral Aerial Images for Automatic Detection of Strategic Bridge Locations for Disaster Relief Missions.” Trends and Applications in Knowledge Discovery and Data Mining, 198–120. doi:10.1007/978-3-030-26142-9_17.
   Google Scholar
• Peng, X., H. Lin, and J. Dai. 2016. “Path Planning and Obstacle Avoidance for Vision Guided Quadrotor UAV Navigation.” In 2016 12th IEEE International Conference on Control and Automation (ICCA), 984–989. doi:10.1109/ICCA.2016.7505408.
   Google Scholar
• Pereira, F. C., and C. E. Pereira. 2015. “Embedded Image Processing Systems for Automatic Recognition of Cracks Using UAVs.” Ifac-PapersOnline 48 (10): 16–21. doi:10.1016/j.ifacol.2015.08.101
   Google Scholar
• Qu, Y., L. Jiang, and X. Guo. 2016. “Moving Vehicle Detection with Convolutional Networks in UAV Videos.” In 2016 2nd International Conference on Control, Automation and Robotics (ICCAR), 225–229. doi:10.1109/ICCAR.2016.7486730.
   Google Scholar
• Redmon, J., S. Divvala, R. Girshick, and A. Farhadi. 2016. “You Only Look Once: Unified, Real-Time Object Detection.” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 779–788. doi:10.1109/CVPR.2016.91.
   Google Scholar
• Redmon, J., and A. Farhadi. 2018. “YOLOv3: An Incremental Improvement.” In IEEE Conference on Computer Vision and Pattern Recognition, 89–95. doi:10.48550/arXiv.1804.02767.
   Google Scholar
• Ren, S., K. He, R. Girshick, and J. Sun. 2015. “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks.” IEEE Transactions on Pattern Analysis and Machine Intelligence 39 (6): 1137–1149. doi:10.1109/TPAMI.2016.2577031
   Web of Science ®Google Scholar
• Ren X., M. Sun, X. Zhang, L. Liu, H. Zhou and X. Ren. 2022. “An Improved Mask-RCNN Algorithm for UAV TIR Video Stream Target Detection.” International Journal of Applied Earth Observation and Geoinformation, vol. 106. doi:10.1016/j.jag.2021.102660.
   PubMed Web of Science ®Google Scholar
• Ringwald, T., L. Sommer, A. Schumann, J. Beyerer and R. Stiefelhagen. 2019. “UAV-Net: A Fast Aerial Vehicle Detector for Mobile Platforms.” 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 544–552. doi:10.1109/CVPRW.2019.00080.
   Google Scholar
• Roelofs, S., B. Landry, M. K. Jalil, A. Martin, S. Koppake, S. K. T. Tang, and M. Pavone. 2021. “Vision-based Autonomous Disinfection of High-Touch Surfaces in Indoor Environments.” In 2021 21st International Conference on Control, Automation and Systems (ICCAS), 263–270. doi:10.23919/ICCAS52745.2021.9649848.
   Google Scholar
• Sharma, V., and R. N. Mir. 2020. “A Comprehensive and Systematic Look up Into Deep Learning Based Object Detection Techniques: A Review.” Computer Science Review. doi:10.1016/j.cosrev.2020.100301.
   PubMed Web of Science ®Google Scholar
• Simonyan, K., and A. Zisserman. 2014. “Very Deep Convolutional Networks for Large-Scale Image Recognition.” arXiv preprint arXiv:1409.1556. Advance online publication. doi:10.48550/arXiv.1409.1556.
   Google Scholar
• Sommer, L., T. Schuchert, and J. Beyerer. 2019. “Comprehensive Analysis of Deep Learning-Based Vehicle Detection in Aerial Images.” IEEE Transactions on Circuits and Systems for Video Technology 29 (9): 2733–2747. doi:10.1109/TCSVT.2018.2874396
   Web of Science ®Google Scholar
• Su, H., Z. Dong, F. Yang, and Y. Lin. 2021. “Remote Sensing Vehicle Detection Based on Embedded System.” Twelfth International Conference on Signal Processing Systems. doi:10.1117/12.2588843.
   Google Scholar
• Sun, J., B. Li, Y. Jiang, and C. Wen. 2016. “A Camera-Based Target Detection and Positioning UAV System for Search and Rescue (SAR) Purposes.” Sensors 16 (11): 1778. doi:10.3390/s16111778
   PubMed Web of Science ®Google Scholar
• Yang, R., Y. Hu, Y. Yao, M. Gao, and R. Liu. 2022. “Fruit Target Detection Based on BCo-YOLOv5 Model.” Hindawi: Mobile Information Systems. doi:10.1155/2022/8457173.
   Google Scholar
• Zakria, Z., J. Deng, R. Kumar, M. S. Khokhar, J. Cai, and J. Kumar. 2022. “Multiscale and Direction Target Detecting in Remote Sensing Images via Modified YOLO-v4.” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing 15: 1039–1048. doi:10.1109/JSTARS.2022.3140776
   Web of Science ®Google Scholar
• Zhang, Y., G. Chen, and Z. Cai. 2021. “Small Target Detection Based on Squared Cross Entropy and Dense Feature Pyramid Networks.” IEEE Access 9: 55179–55190. doi:10.1109/ACCESS.2021.3070991
   Google Scholar
• Zhang, W., J. Li, and S. Qi. 2018. “Object Detection in Aerial Images Based on Cascaded CNN.” In 2018 International Conference on Sensor Networks and Signal Processing (SNSP), 434–439. doi:10.1109/SNSP.2018.00088.
   Google Scholar
• Zhang, X., Y. Zhou, and J. Luo. 2021. “Deep Learning for Processing and Analysis of Remote Sensing Big Data: A Technical Review.” Big Earth Data 15 (1): 1417–1445. doi:10.1080/20964471.2021.1964879.
   Google Scholar