Sökning: onr:"swepub:oai:DiVA.org:kth-335312" >
Safe multi-agent de...
Safe multi-agent deep reinforcement learning for real-time decentralized control of inverter based renewable energy resources considering communication delay
-
- Guo, Guodong (författare)
- State Grid Economic and Technological Research Institute Co., Ltd., Beijing 102209, China
-
- Zhang, Mengfan (författare)
- KTH,Elkraftteknik
-
- Gong, Yanfeng (författare)
- School of Electrical & Electronic Engineering, North China Electric Power University, Beijing 102206, China
-
visa fler...
-
- Xu, Qianwen, 1992- (författare)
- KTH,Elkraftteknik
-
visa färre...
-
State Grid Economic and Technological Research Institute Co, Ltd., Beijing 102209, China Elkraftteknik (creator_code:org_t)
- Elsevier BV, 2023
- 2023
- Engelska.
-
Ingår i: Applied Energy. - : Elsevier BV. - 0306-2619 .- 1872-9118. ; 349
- Relaterad länk:
-
https://doi.org/10.1...
-
visa fler...
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- The increasing penetration of distributed renewable energy resources brings a great challenge for real-time voltage security of distribution grids. The paper proposes a safe multi-agent deep reinforcement learning (MADRL) algorithm for real-time control of inverter-based Volt-Var control (VVC) in distribution grids considering communication delay to minimize the network power loss, while maintaining the nodal voltages in a safe range. The multi-agent VVC is modeled as a constrained Markov game, which is solved by the MADRL algorithm. In the training stage, the safety projection is added to the combined policy to analytically solve an action correction formulation to promote more efficient and safe exploration. In the real-time decision-making stage, a state synchronization block is designed to impute the data under the latest timestamp as the input of the agents deployed in a distributed manner, to avoid instability caused by communication delay. The simulation results show that the proposed algorithm performs well in safe exploration, and also achieves better performance under communication delay.
Ämnesord
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)
Nyckelord
- Communication delay
- Decentralized control
- Distribution grids
- Inverter based renewable energy resources
- Multi-agent reinforcement learning
- Safe exploration
- Voltage control
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas