Events2Join

Risk|sensitive control of Markov decision processes


Robust Control of Markov Decision Processes with Uncertain ...

Optimal solutions to Markov decision problems may be very sensitive with respect to the state transition probabilities. In many practical problems, the ...

Markov decision processes with iterated coherent risk measures

This paper considers a Markov decision process in Borel state and action spaces with the aggregated (or say iterated) coherent risk measure to be minimised.

Risk-Aware Markov Decision Process Contingency Management ...

The proposed autonomy is modeled as a Markov decision process (MDP), whose solution is a contingency management policy that appropriately ...

Effects of stochastic interest rates in decision making under risk

Effects of stochastic interest rates in decision making under risk: A Markov decision process model for forest management ; Authors: Mo Zhou, Joseph Buongiorno.

Risk-Averse Dynamic Programming for Markov Decision Processes

Risk-Averse Dynamic Programming. Page 23. Using Dynamic Risk Measures for Markov Decision Processes. Controlled Markov process xt, t = 1,...,T,T + 1. Policy Π ...

Robust, risk-sensitive, and data-driven control of Markov Decision ...

Robust, risk-sensitive, and data-driven control of Markov Decision Processes ; dc.contributor.other, Massachusetts Institute of Technology.

Risk-sensitive average optimality in Markov decision processes

Summary: In this note attention is focused on finding policies optimizing risk-sensitive optimality criteria in Markov decision chains.

Risk probability optimization problem for finite horizon continuous ...

top This paper presents a study the risk probability optimality for finite horizon continuous-time Markov decision process with loss rate and unbounded ...

Markov Decision Processes and Dynamic Programming - YouTube

Reinforcement Learning 3: Markov Decision Processes and Dynamic Programming ; Reinforcement Learning 4: Model-Free Prediction and Control. Google ...

Risk-sensitive semi-Markov decision processes with general utilities ...

In this paper we investigate risk-sensitive semi-Markov decision processes with a Borel state space, unbounded cost rates, and general utility functions.

Robust Control of Markov Decision Processes and Connection to ...

We derive an informa- tion state process and dynamic programming equations for the robust control problem by taking their limiting form as the risk sensitive ...

Dynamic risk management with Markov decision processes

In particular, we solve various portfolio optimization problems and introduce a class of dynamic risk measures via the notion of Markov decision processes.

Bayesian Risk Markov Decision Processes - OpenReview

In this paper, we propose a new formulation, Bayesian risk Markov decision process (BR-MDP), to address parameter uncertainty in MDPs, where a ...

Markov decision processes: dynamic programming and applications

Key Words: Markov Decision processes, Stochastic control, Ergodic control, Risk-sensitive con- trol, Dynamic programming, Max-plus algebra, Value iteration ...

Q-learning for risk-sensitive control - ProQuest

We propose for risk-sensitive control of finite Markov chains a counterpart of the popular Q-learning algorithm for classical Markov decision processes. The ...

Continuous-time zero-sum games for markov decision processes ...

We consider zero-sum stochastic games for controlled continuous time Markov processes on a general state space with risk-sensitive discounted cost criteria.

Risk Aversion in Markov Decision Processes via Near-Optimal ...

Hernández-Hernandez, S. Coraluppi, and P. Fard. Risk sensitive Markov decision processes. Systems and Control in the Twenty-First Century,. 29:263 ...

Multi-model Markov decision processes - Brian Denton

(2007) Robust, risk-sensitive, and data-driven control of. Markov decision processes. Ph.D. thesis, Massachusetts Institute of. Technology ...

Risk-Averse Dynamic Programming for Markov Decision Processes

We introduce the concept of a Markov risk measure and we use it to formulate risk-averse control problems for two Markov decision models: a ...

An Introduction to Markov Decision Processes and Reinforcement ...

RLPy: https://rlpy.readthedocs.io/en/latest/ AI Gym: https://gym.openai.com/ Tutorial Paper: A Tutorial on Linear Function Approximators for ...