onr:"swepub:oai:DiVA.org:kth-338028"
Search: onr:"swepub:oai:DiVA.org:kth-338028" > Model-Based Reinfor...
- 1 of 1
- Previous record
- Next record
- To hitlist
Model-Based Reinforcement Learning for Cavity Filter Tuning
-
- Nimara, Doumitrou Daniil (author)
- Ericsson GAIA, Sweden
-
- Malek-Mohammadi, Mohammadreza (author)
- Qualcomm, Sweden
-
- Wei, Jieqiang (author)
- Ericsson GAIA, Sweden
- show more...
- show less...
- (creator_code:org_t)
- ML Research Press, 2023
- 2023
- English.
- In: Proceedings of the 5th Annual Learning for Dynamics and Control Conference, L4DC 2023. - : ML Research Press. ; , s. 1297-1307
- Conference paper (peer-reviewed)
Abstract
Subject headings
Close
- The ongoing development of telecommunication systems like 5G has led to an increase in demand of well calibrated base transceiver station (BTS) components. A pivotal component of every BTS is cavity filters, which provide a sharp frequency characteristic to select a particular band of interest and reject the rest. Unfortunately, their characteristics in combination with manufacturing tolerances make them difficult for mass production and often lead to costly manual post-production fine tuning. To address this, numerous approaches have been proposed to automate the tuning process. One particularly promising one, that has emerged in the past few years, is to use model free reinforcement learning (MFRL); however, the agents are not sample efficient. This poses a serious bottleneck, as utilising complex simulators or training with real filters is prohibitively time demanding. This work advocates for the usage of model based reinforcement learning (MBRL) and showcases how its utilisation can significantly decrease sample complexity, while maintaining similar levels of success rate. More specifically, we propose an improvement over a state-of-the-art (SoTA) MBRL algorithm, namely the Dreamer algorithm. This improvement can serve as a template for applications in other similar, high-dimensional non-image data problems. We carry experiments on two complex filter types, and show that our novel modification on the Dreamer architecture reduces sample complexity by a factor of 4 and 10, respectively. Our findings pioneer the usage of MBRL which paves the way for utilising more precise and accurate simulators which was previously prohibitively time demanding.
Subject headings
- NATURVETENSKAP -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Computer Sciences (hsv//eng)
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Signalbehandling (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Signal Processing (hsv//eng)
Keyword
- Model Based Reinforcement Learning
- Reinforcement Learning
- Telecommunication
Publication and Content Type
- ref (subject category)
- kon (subject category)
To the university's database
- 1 of 1
- Previous record
- Next record
- To hitlist
Find more in SwePub
- By the author/editor
- Nimara, Doumitro ...
- Malek-Mohammadi, ...
- Wei, Jieqiang
- Huang, Vincent
- Ögren, Petter, 1 ...
- About the subject
-
- NATURAL SCIENCES
- NATURAL SCIENCES
- and Computer and Inf ...
- and Computer Science ...
-
- ENGINEERING AND TECHNOLOGY
- ENGINEERING AND ...
- and Electrical Engin ...
- and Signal Processin ...
- Articles in the publication
- Proceedings of t ...
- By the university
- Royal Institute of Technology
Search outside SwePub
- Extend your search to:
- Google Book Search
- Google Scholar
Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.
- Copyright © LIBRIS - National Library Systems
- LIBRIS.kb.se
