Search: onr:"swepub:oai:DiVA.org:kth-246317" >
Stochastic Optimal ...
Stochastic Optimal Control of Dynamic Queue Systems : A Probabilistic Perspective
-
- Gao, Yulong (author)
- KTH,ACCESS Linnaeus Centre
-
- Wu, Shuang (author)
- Hong Kong Univ Sci & Technol, Elect & Comp Engn, Kowloon, Clear Water Bay, Hong Kong, Peoples R China.
-
- Johansson, Karl H., 1967- (author)
- KTH,ACCESS Linnaeus Centre
-
show more...
-
- Shi, Ling (author)
- Hong Kong Univ Sci & Technol, Elect & Comp Engn, Kowloon, Clear Water Bay, Hong Kong, Peoples R China.
-
- Xie, Lihua (author)
- Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore.
-
show less...
-
(creator_code:org_t)
- IEEE, 2018
- 2018
- English.
-
In: 2018 15TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION, ROBOTICS AND VISION (ICARCV). - : IEEE. - 9781538695821 ; , s. 837-842
- Related links:
-
https://urn.kb.se/re...
-
show more...
-
https://doi.org/10.1...
-
show less...
Abstract
Subject headings
Close
- Queue overflow of a dynamic queue system gives rise to the information loss (or packet loss) in the communication buffer or the decrease of throughput in the transportation network. This paper investigates a stochastic optimal control problem for dynamic queue systems when imposing probability constraints on queue overflows. We reformulate this problem as a Markov decision process (MDP) with safety constraints. We prove that both finite-horizon and infinite-horizon stochastic optimal control for MDP with such constraints can be transformed as a linear program (LP), respectively. Feasibility conditions are provided for the finite-horizon constrained control problem. Two implementation algorithms are designed under the assumption that only the state (not the state distribution) can be observed at each time instant. Simulation results compare optimal cost and state distribution among different scenarios, and show the probability constraint satisfaction by the proposed algorithms.
Subject headings
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Reglerteknik (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Control Engineering (hsv//eng)
Publication and Content Type
- ref (subject category)
- kon (subject category)
Find in a library
To the university's database