- Controlled Markov chains with non|exponential discounting and ...🔍
- Controlled Markov Set|Chains with Discounting🔍
- Markov decision processes under risk sensitivity🔍
- Discounting in Markov Chain Estimation🔍
- Controlled Markov chains with risk|sensitive criteria🔍
- 11 Stochastic Systems and Controlled Markov Chains🔍
- RECENT RESULTS IN CONTROLLED MARKOV CHAINS WITH ...🔍
- Relaxed Equilibria for Time|Inconsistent Markov Decision Processes🔍
Controlled Markov chains with non|exponential discounting and ...
Controlled Markov chains with non-exponential discounting and ...
This paper deals with a controlled Markov chain in continuous time with a non-exponential discounting and distribution-dependent cost functional. A definition ...
Controlled Markov chains with non-exponential discounting and ...
Keywords and phrases: time inconsistency, distribution dependence, controlled Markov chain. 1 Department of Statistics, Rice University, Houston, TX 77005, USA.
Controlled Markov chains with non-exponential discounting and ...
This paper deals with a controlled Markov chain in continuous time with a non-exponential discounting and distribution-dependent cost functional.
Controlled Markov Set-Chains with Discounting - jstor
the optimal control problem for the total discounted expected reward under some partial order. (For Cesaro sums for Markov set-chains, see Hartfiel [5]). Also, ...
Markov decision processes under risk sensitivity - ScienceDirect.com
In that paper, controlled Markov chains with finite state and action spaces were studied, and under appropriate communication conditions, the optimal average ...
Discounting in Markov Chain Estimation - Ethan Che
Discounting in Markov Chain Estimation ... In Poisson equation estimation, discounting can help control the tail behavior of the regeneration time. ... to the non- ...
Controlled Markov chains with risk-sensitive criteria: some (counter ...
The controlled Markov chain in that example satisfies a simultaneous Doeblin condition, an assumption that enables the vanishing discount approach in the risk- ...
11 Stochastic Systems and Controlled Markov Chains - Xiang Yin
... Markov policy g. One can show that the state process {Xg t } is then a (non-time-homogeneous) Markov chain, where the one-step MOTP at time t is Pg t ...
RECENT RESULTS IN CONTROLLED MARKOV CHAINS WITH ...
cision and Control, San Diego, CA, pp. 1115-1120,. 1997. [3] G. Avila-Godoy and E. Fern6.ndez-Gaucherand,. “Controlled. Markov chains with exponential risk ...
Relaxed Equilibria for Time-Inconsistent Markov Decision Processes
In a nutshell, non-exponential discounting causes time inconsistency: an optimal control policy an agent derives today will not be optimal ...
Markov decision process - Wikipedia
Markov decision process (MDP), also called a stochastic dynamic program or stochastic control problem, is a model for sequential decision making when ...
Controlled Markov chains with exponential risk-sensitive criteria
Abstract: This work concerns controlled Markov chains models with a countable state space, under (exponential) total and discounted risk-sensitive cost ...
In a controlled Markov set-chain with a discount factor Q, we consider the case of Q = 1 as a limiting case of j3 < 1 and find a non-discounted optimal ...
Discounted continuous-time controlled Markov chains - Project Euclid
We are interested in continuous-time, denumerable state controlled Markov chains (CMCs), with compact Borel action sets, and possibly ...
Controlled Markov set-chains with discounting | Cambridge Core
In the framework of discounted Markov decision processes, we consider the case that the transition probability varies in some given domain at each time and ...
Solutions of semi-Markov control models with recursive discount ...
The new results provided here are the existence and the approximation of optimal policies for this class of discounted Markov control model with non-stationary ...
Controlled Markov chains with risk-sensitive average cost criterion
... Markov chain with infinite state space may not have ultimately stationary optimal policies in the risk-sensitive (exponential) discounted cost case, in general.
On the value function in constrained control of Markov chains
It is known that the value function in an unconstrained Markov decision process with finitely many states and actions is a piecewise rational function in ...
Controlled Markov chains with risk-sensitive average cost criterion ...
Controlled Markov chains with risk-sensitive average cost criterion: The non-irreducible case · Conference: Decision and Control, 2001. Proceedings of the 40th ...
However, crucially, the diffusion terms of the states (x, σ) exhibiting high correlation are not controlled by the agent, and so the non-local ...