Potential field hierarchical reinforcement learning approach for target search by multi-AUV in 3-D underwater environments

References

• Cai, Y., Yang, S. X., Xu, X., & Mittal, G. S. (2012). A hierarchical reinforcement learning based approach for multi-robot cooperation in unknown environments. In Proceedings of the 2011 2nd International Congress on Computer Applications and Computational Science (pp. 69–74). Springer, Berlin, Heidelberg.
   Google Scholar
• Cao, X., & Yu, A. L. (2017). Multi-AUV cooperative target search algorithm in 3-D underwater workspace. Journal of Navigation, 70(6), 1293–1311. doi: 10.1017/S0373463317000376
   Web of Science ®Google Scholar
• Cao, X., Zhu, D. Q., & Yang, S. X. (2015). Multi-AUV target searching under ocean current based on PPSO and velocity synthesis algorithm. Underwater Technology, 31(1), 31–39. doi: 10.3723/ut.33.031
   Google Scholar
• Chen, H., & Xie, L. (2009). A novel artificial potential field-based reinforcement learning for mobile robotics in ambient intelligence. International Journal of Robotics and Automation, 24(3), 245–254. doi: 10.2316/Journal.206.2009.3.206-3264
   Web of Science ®Google Scholar
• Cheng, X., Shen, J., Liu, H., & Gu, G. (2007, May). Multi-robot cooperation based on hierarchical reinforcement learning. In International Conference on Computational Science (pp. 90–97). Springer, Berlin, Heidelberg.
   Google Scholar
• Dong, R., & Geng, Z. (2016). Formation tracking control of multi-vehicle systems. Asian Journal of Control, 18(1), 350–356. doi: 10.1002/asjc.1010
   Web of Science ®Google Scholar
• Gabriely, Y., & Rimon, E. (2003). Competitive on-line coverage of grid environments by a mobile robot. Computational Geometry, 24(3), 197–224. doi: 10.1016/S0925-7721(02)00110-4
   Web of Science ®Google Scholar
• Gonzalez, E., Alvarez, O., Diaz, Y., Parra, C., & Bustacara, C. (2005, April). BSA: a complete coverage algorithm. In Robotics and Automation, 2005. ICRA 2005. Proceedings of the 2005 IEEE International Conference on (pp. 2040–2044). Barcelona, Spain, IEEE.
   Google Scholar
• Jang, J. R., Sun, C., & Mizutani, E. (1997). Neuro-fuzzy and soft computing: A computational approach to learning and machine intelligence. NY: Prentice Hall.
   Google Scholar
• Juang, C. F., & Hsu, C. H. (2009). Reinforcement ant optimized fuzzy controller for mobile-robot wall-following control. IEEE Transactions on Industrial Electronics, 56(10), 3931–3940. doi: 10.1109/TIE.2009.2017557
   Web of Science ®Google Scholar
• Lanillos, P., Gan, S. K., Besada-Portas, E., Pajares, G., & Sukkarieh, S. (2014). Multi-UAV target search using decentralized gradient-based negotiation with expected observation. Information Sciences, 282, 92–110. doi: 10.1016/j.ins.2014.05.054
   Web of Science ®Google Scholar
• Li, J., Pan, Q., & Hong, B. (2010, June). A new multi-agent reinforcement learning approach. In Information and Automation (ICIA), 2010 IEEE International Conference on (pp. 1667–1671). Harbin, China, IEEE.
   Google Scholar
• Luo, C. M., & Yang, S. X. (2008). A bioinspired neural network for real-time concurrent map building and complete coverage robot navigation in unknown environments. IEEE Transactions on Neural Networks, 19(7), 1279–1298. doi: 10.1109/TNN.2008.2000394
   Web of Science ®Google Scholar
• Millan, P., Orihuela, L., Jurado, I., & Rodriguez, F. R. (2014). Formation control autonomous underwater vehicles subject to communication delays. IEEE Transactions on Control Systems Technology, 22(2), 770–777. doi: 10.1109/TCST.2013.2262768
   Web of Science ®Google Scholar
• Paull, L., Saeedi, S., Seto, M., & Li, H. (2014). AUV navigation and localization: A review. IEEE Journal of Oceanic Engineering, 39(1), 131–149. doi: 10.1109/JOE.2013.2278891
   Web of Science ®Google Scholar
• Polycarpou, M. M., Yang, Y., & Passino, K. M. (2001). Cooperative control of distributed multi-agent systems. IEEE Control Systems Magazine, 21, 1–27.
   Google Scholar
• Rezoug, A., Tondu, B., Hamerlain, M., & Tadjine, M. (2016). RBFNN-HOMS nonsingular terminal sliding control of n-DOF robotic manipulator. Journal of Control Engineering and Applied Informatics, 18(3), 52–62.
   Google Scholar
• Shen, J., Gu, G., & Liu, H. (2006, June). Multi-agent hierarchical reinforcement learning by integrating options into maxq. In Computer and Computational Sciences, 2006. IMSCCS'06. First International Multi-Symposiums on (Vol. 1, pp. 676-682). Hangzhou, China, IEEE.
   Google Scholar
• Sun, B., Zhu, D. Q., & Yang, S. X. (2018). An optimized fuzzy control algorithm for three-dimensional AUV path planning. International Journal of Fuzzy Systems, 20(2), 597–610. doi: 10.1007/s40815-017-0403-1
   Web of Science ®Google Scholar
• Tyan, F. (2016). Analysis of general ideal proportional navigation guidance laws. Asian Journal of Control, 18(3), 899–919. doi: 10.1002/asjc.1205
   Web of Science ®Google Scholar
• Yoon, S., & Qiao, C. (2011). Cooperative search and survey using autonomous underwater vehicles (AUVs). IEEE Transactions on Parallel and Distributed Systems, 22(3), 364–379. doi: 10.1109/TPDS.2010.88
   Web of Science ®Google Scholar
• Zhu, D. Q., Hua, X., & Sun, B. (2014). A neurodynamics control strategy for real-time tracking control of autonomous underwater vehicles. Journal of Navigation, 67(1), 113–127. doi: 10.1017/S0373463313000556
   Web of Science ®Google Scholar