Deep Q-Learning-Based Mud Ring Optimization Approach for Optimal Power Flow in Islanded DC Microgrid

Abstract

Microgrid (MG) is the basic element that recreates a significant role in integrating renewable energy sources (RES). Direct current (DC) MG has advantages over alternating current (AC) for many applications. A DC-MG is connected to the islanded mode through power electronic converters, which are also an important component for RES integration. Due to environmental factors, RES will struggle to load the conditions. Branches of DC-MG have battery energy storage systems (BESSs) installed for compensating the supply–load imbalance. Even though BESS are installed, accurate maintenance is still required to maintain a balanced power flow. This work proposes an adaptive deep Q-learning (DQL) based mud ring optimization technique (DQMR) for optimal power flow in islanded DC-MG. DQL is effective for the task with discrete and low-dimensional action spaces, and mud ring algorithm (MRA) is to clear up large-scale optimization problems and power flow problems. The implementation is done through MATLAB/Simulink model. The error is minimized to 6% by this method, and the losses are also reduced. IEEE-9 bus system and IEEE-30 bus system are used in the proposed work to validate the performance.

Keywords:

• Microgrid
• energy storage system
• state of charge
• deep Q-learning
• mud ring algorithm
• IEEE 9 and 30 bus system

Disclosure Statement

The authors declare that they have no conflict of interest.

Data Availability Statement

Data sharing not applicable to this article.

Additional information

Notes on contributors

Srinivasa Acharya

Srinivasa Acharya received the B.Tech Degree in Electrical & Electronics Engineering from Aditya Institute of Technology & Management, Tekkali, Srikakulam India in 2011, M.Tech Degree in Power Electronics and Electrical drives from Aditya Institute of Technology & Management, Tekkali, Srikakulam India in 2013. Ph.D Degree in Electrical and Electronics Engineering from Annamalai University in August 2022. He is currently working as an Assistant Professor with the Department of Electrical and Electronics Engineering from Aditya Institute of Technology & Management, Tekkali, Srikakulam India. His research interests include power systems, Power Quality, Network analysis.

Praveen B. M.

Praveen B. M. has completed Ph.D in 2008 and Post Doctoral research in Indian Institute of Science, Bangalore and Ajou University - South Korea. He is working as Director – Research and Innovation Council of Srinivas University and Chief Coordinator of College of Engineering and Technology. He has received Research fund of worth 1.2 crore rupees from AICTE, DST, VGST, ISRO and BRNS. He is a recipient of Young scientist award from Department of Science and Technology - New Delhi. Best Research paper award from VGST Govt of Karnataka. He is received the Prestigious Commonwealth Professional Fellowship and worked in UK. He is also working as Visiting Professor in University of Malaya – Malaysia. He has more than 100 publications and 5 books in his credit.

D. Vijaya Kumar

D. Vijaya Kumar received his degree in B.E from GITAM University, Visakhapatnam, M.E From AU College of Engineering, Andhra University, Visakhapatnam and he received Ph.D from AU College of Engineering, Andhra University, Visakhapatnam. He had Teaching Experience of 17 years. He had published many papers in different Journals and Conferences. Presently he is working of the Dean Academics at AITAM, Tekkali. His area of interests includes Power Systems and Control Systems.