Sökning: LAR1:ltu >
A simulation enviro...
A simulation environment for training a reinforcement learning agent trading a battery storage
-
- Aaltonen, Harri (författare)
- Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University, FI-00076 Espoo, Finland
-
- Sierla, Seppo (författare)
- Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University, FI-00076 Espoo, Finland
-
- Subramanya, Rakshith (författare)
- Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University, FI-00076 Espoo, Finland
-
visa fler...
-
- Vyatkin, Valeriy (författare)
- Luleå tekniska universitet,Datavetenskap,Department of Electrical Engineering and Automation, School of Electrical Engineering, Aalto University, FI-00076 Espoo, Finland; International Research Laboratory of Computer Technologies, ITMO University, 197101 St. Petersburg, Russia
-
visa färre...
-
(creator_code:org_t)
- 2021-09-06
- 2021
- Engelska.
-
Ingår i: Energies. - : MDPI. - 1996-1073. ; 14:17
- Relaterad länk:
-
https://doi.org/10.3...
-
visa fler...
-
https://www.mdpi.com...
-
https://urn.kb.se/re...
-
https://doi.org/10.3...
-
visa färre...
Abstract
Ämnesord
Stäng
- Battery storages are an essential element of the emerging smart grid. Compared to other distributed intelligent energy resources, batteries have the advantage of being able to rapidly react to events such as renewable generation fluctuations or grid disturbances. There is a lack of research on ways to profitably exploit this ability. Any solution needs to consider rapid electrical phenomena as well as the much slower dynamics of relevant electricity markets. Reinforcement learning is a branch of artificial intelligence that has shown promise in optimizing complex problems involving uncertainty. This article applies reinforcement learning to the problem of trading batteries. The problem involves two timescales, both of which are important for profitability. Firstly, trading the battery capacity must occur on the timescale of the chosen electricity markets. Secondly, the real-time operation of the battery must ensure that no financial penalties are incurred from failing to meet the technical specification. The trading-related decisions must be done under uncertainties, such as unknown future market prices and unpredictable power grid disturbances. In this article, a simulation model of a battery system is proposed as the environment to train a reinforcement learning agent to make such decisions. The system is demonstrated with an application of the battery to Finnish primary frequency reserve markets.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Maskinteknik -- Energiteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Mechanical Engineering -- Energy Engineering (hsv//eng)
Nyckelord
- battery
- reinforcement learning
- simulation
- frequency reserve
- frequency containment reserve
- timescale
- artificial intelligence
- real-time
- electricity market
- Dependable Communication and Computation Systems
- Kommunikations- och beräkningssystem
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
-
Energies
(Sök värdpublikationen i LIBRIS)
Till lärosätets databas