Stability and Reliability Analysis for Multiple WT Using Deep Reinforcement Learning

Abstract

Today’s Wind Turbines (WT)s are loaded with high-tech devices that help enhance energy harvest while minimizing stress on the structure. Yet, modern WT control systems have competing goals (stability and dependability) that need the use of cutting-edge control approaches capable of addressing multi-objective difficulties. This method proposes adaptive control solutions for Wind Turbines (WTs) using deep reinforcement learning (DRL) to optimize electricity production. The innovation of this study lies in the adaptation of the optimum policy of a training RL agent to derive the probabilistic feature of WT speed, which addresses the multi-objective difficulties of stability and dependability in modern WT control systems. Additionally, a reward regularization A module has been created to calculate the normalized power outputs of wind turbines (WTs) in different yaw configurations and varying environmental conditions, providing high resilience and flexibility to the proposed control system. The combination of this module with the policy gradient’s deep determinism (DDPG) method using multiple agents helps determine the ideal yaw settings for each WT in the farm. The suggested approach improves upon the standard DDPG implementation in MATLAB, contributing to the advancement of WT control strategies for efficient power production in complex networks.

Keywords:

• WT
• control
• reinforcement learning
• pitch control
• torque control

CONFLICT OF INTEREST

Conflict of Interest is not applicable in this work.

FUNDING

No funding is involved in this work.

AUTHORSHIP CONTRIBUTIONS

There is no authorship contribution.

DATA AVAILABILITY STATEMENT

Data sharing not applicable to this article as no datasets were generated or analyzed during the current study.

ETHICS APPROVAL AND CONSENT TO PARTICIPATE

No participation of humans takes place in this implementation process.

HUMAN AND ANIMAL RIGHTS

No violation of Human and Animal Rights is involved.

ACKNOWLEDGMENT

There is no acknowledgment involved in this work.

Additional information

Notes on contributors

S. M. Padmaja

S. M. Padmaja currently working as a professor at department of Electrical & Electronics Engineering, Shri Vishnu Engineering College for Women, Bhimavaram. She was awarded Ph.D. degrees in Electrical Engineering from Jawaharlal Nehru Technological University, Hyderabad in 2016. She executed two DST sponsored R&D Projects on the objectives of FPGA based PWM control of Multilevel Inverters and Real time performance analysis of Solar Module at different environmental conditions. Her research interests are power electronic applications to power systems, Renewable Energy Systems, Power quality, Flexible AC Transmission Systems, Artificial Intelligence in Electrical Engineering.

Akhilesh Kumar

Akhilesh Kumar is working as a Lecturer in the Department of Electrical Engineering, Guru Nanak Dev DSEU Rohini campus, Delhi and has about 10 years of teaching experience. He received his B.Tech degree in Electrical Engineering with distinction from WBUT and M.Tech degree in Energy from IIT Delhi. His research focuses on IoT, Robotics, Artificial Intelligence, Machine Learning, Electric Vehicles, Power System, Smart Grid, Renewable Energy with emphasis on DC Microgrid, Renewable Energy integration.

Lavanya Dhanesh

Lavanya Dhanesh is currently working as an Associate Professor / EEE dept at Panimalar Engineering college, Chennai. She received her B.E. degree in Electrical and Electronics Engineering from Bharathiyar University at 2002, completed her M.E. in Embedded System Technologies from Anna University, Chennai and her Ph.D degree in Embedded Systems at Sathyabama University, Chennai in the year 2018. She has around 20 years of teaching experience. Her research interest includes in the field of Embedded systems, Power Electronics, Electric Vehicle Technologies, Artificial Intelligence, Python Programming and Renewable Energy sources.

Vinjamuri Venkata Kamesh

Vinjamuri Venkata Kamesh is currently working as Professor of Mechanical Engineering in Aditya Engineering College(A), Surampalem. He has 22 years of teaching experience. He completed his B.E in Mechanical Engineering from Andhra University. He completed his M.Tech (CAD/CAM) and Ph.D (Machine Design) from JNTUK University, Kakinada. He completed M.B.A from Andhra University. He published 18 research articles in various reputed journals i.e., ASME, ELSEVIER, SPRINGER and International Conferences. His areas of research include Kinematics of machinery, Operations Research, Industrial Engineering, Materials and Manufacturing, Artificial Intelligence and Machine Learning.

H. Geetha

H. Geetha, is working as a Professor in the department of Mathematics at St. Joseph’s college of Engineering. She has 31 years of experience, out of which 23 years in Engineering and 8 years in arts and science. She has completed her M.Sc mathematics under Annamalai University. She got her Ph.D awarded in the year 2012, under Madras University. She has 22 International conference and Journal publications, published in scopus and web of Science. Have got one patent. Got travel grants under Tata Institute of Fundamental research for presenting the paper in the International conference at SUNNY, Buffalo, US in the year 2010. Her field of specialization in Research is Computer Mathematics.

D. Ramya

D. Ramya is working as an Assistant Professor in the department of Electrical and Electronics Engineering at Sathyabama Institute of Science and Technology, Chennai. She received her B.E. degree in Electrical and Electronics Engineering from Manonmanium Sundaranar University, Tirunelveli and her M.E degree in Power Electronics and industrial Drives from Sathyabama University, Chennai. She has published 37 research articles in Scopus, SCI and International Journals. She has more than 17 years of experience. She has published 5 patents and has 3 design patent grants. She has organised international conferences, workshops, guest lectures and webinars in her career. She is the life member of IFERP and IERP. Her major research includes control systems, electric drives.

G. G. Raja Sekhar

G. G. Raja Sekhar working as an Associate Professor in the Department of Electrical and Electronics Engineering in Koneru Lakshmaiah Education Foundation, Vaddeswaram, Andhra Pradesh and has about 22 years of teaching experience. He received his B.E degree in Electrical and Electronics Engineering from Karnatak University and M.Tech. degree in Power Systems – High Voltage Engineering from Jawaharlal Nehru Technological University, Hyderabad. He received Ph.D degree in Electrical and Electronics Engineering from Acharya Nagarjuna University, A.P. state. He has published 23 research papers in refereed international journals and 15 research papers in the proceedings of various international conferences. He has received several best paper awards for his research papers at various international conferences. He is an active member of IEEE and ISTE. His areas of research include Power systems, High Voltage Engineering Stability and control of electric power grids, Renewable energy systems and Microgrid.

Nutan Saha

Nutan Saha is presently working as Assistant Professor in the department of Electrical Engineering, Veer Surendra Sai University of Technology, Burla, Odisha, India. She has 15 years of teaching experience. She has completed her M.Tech from IIEST, Shibpur, Howrah, West Bengal, India and Ph.D from Veer Surendra Sai University of Technology, Burla, Odisha, India. Her areas of research include Power Electronic, Control & Drives, Power Quality, Electric Power System, Renewable Energy, Artificial Intelligence and Microgrid.