Sökning: id:"swepub:oai:DiVA.org:uu-529407" >
Limiting Behavior o...
Limiting Behavior of Markov Chains with Eager Attractors
-
Abdulla, Parosh Aziz (författare)
-
Henda, Noomene Ben (författare)
-
Mayr, Richard (författare)
-
visa fler...
-
Sandberg, Sven (författare)
-
visa färre...
- Department of Information Technology, Uppsala University, 2006
- Engelska.
-
Serie: Technical report / Department of Information Technology, Uppsala University, 1404-3203 ; 2006-033
- Relaterad länk:
-
https://uu.diva-port... (primary) (Raw object)
-
visa fler...
-
https://urn.kb.se/re...
-
visa färre...
Abstract
Ämnesord
Stäng
- We consider discrete infinite-state Markov chains which contain an eager finite attractor. A finite attractor is a finite subset of states that is eventually reached with probability 1 from every other state, and the eagerness condition requires that the probability of avoiding the attractor in n or more steps after leaving it is exponentially bounded in n. Examples of such Markov chains are those induced by probabilistic lossy channel systems and similar systems. We show that the expected residence time (a generalization of the steady state distribution) exists for Markov chains with eager attractors and that it can be effectively approximated to arbitrary precision. Furthermore, arbitrarily close approximations of the limiting average expected reward, with respect to state-based bounded reward functions, are also computable.
Publikations- och innehållstyp
- vet (ämneskategori)
- rap (ämneskategori)