Tony's POMDP Papers

For significant contributions to the application of POMDP models in AI and to practical algorithms for their solution. Classic Paper Award Corecipients: Anthony ...

Learning Predictive State Representations in Dynamical Systems ...

Tony's pomdp file repository page. http://www.cs.brown.edu/research/ai/pomdp/ examples/index.html. Jaeger, H. (1998). Discrete-time, discrete-valued observ ...

1997-A Heuristic Variable Grid Solution Method for POMDPs - AAAI

In this paper, we describe a simple variable grid method that performs well on a number of test problems from. (Littman, Cassandra, & Kaelbling 1995a). Our ...

Cognitive radio auto-adaptive sensing algorithm based on POMDP

Tony's POMDP page[EB/OL]. , 2012. Related Articles 2. [1] . Cognitive radio auto-adaptive sensing algorithm based on POMDP [J]. Journal on ...

Milos Hauskrecht's Thesis Research Page - MIT

Thesis related papers, reports. M. Hauskrecht ... Tony also maintains a larger repository of POMDP examples. ... Lonnie Chrisman's shuttle problem (from Tony's page) ...

Dec-POMDP problem domains - MASPlan.org

dpomdp file format, which is an extension of Tony's POMDP file format. The file format is explained in example.dpomdp, and can be used in ...

Solving POMDPs by Searching in Policy Space - arXiv

In this paper, we consider an alternative represen tation of a policy as a finite-state controller and present two related algorithms for solving infinite.

Planning in Models that Combine Memory with Predictive ...

In 13th An- nual Conference on Uncertainty in Artificial Intelligence. (UAI–97), 54–61. Cassandra, A. 1999. Tony's pomdp page. http://www.cs.brown.edu/research/ ...

A POMDP Approximation Algorithm that Anticipates the Need to ...

This paper introduces the even-odd POMDP, an approxi- mation to POMDPs (Partially Observable Markov Decision Problems) in which the world is assumed to be ...

Finding Approximate POMDP solutions Through Belief Compression

A discussion of exactly why POMDPs are so complex is outside the scope of this paper. However, it is possible to get an intuition into the problem. For a given ...

Approximating Optimal Policies for Partially Observable Stochastic ...

For any MDP, there exists an optimal ... Many MDP and POMDP algorithms determine Q values ... the ideas contained in this paper. We are very grateful to Tony.

A Dec-POMDP Model for Congestion Avoidance and Fair Allocation ...

Final remarks and future research avenues concludes the paper. II. PROBLEM DESCRIPTION. We consider the problem of network bandwidth sharing by several video ...

Anonymity Protocol Analysis and Network Intrusion Detection

Christopher Griffin for his valuable suggestions and comments on almost all my papers. ... tainty; and DEC-POMDPs extend POMDPs to the case of decentralized ...

Improving Approximate Value Iteration Using Memories and ...

Tony's pomdp page. http://www.cs.brown.edu/research/ai/ pomdp/index.html. Izadi, M. T.; Rajwade, A. V.; and Precup, D. 2005. Using core beliefs for point ...

Improving Anytime Point-Based Value Iteration Using Principled ...

POMDPs are models of dynamical systems based on under- ... Tony's pomdp page. http://www.cs.brown.edu ... Journal of. Artificial Intelligence Research, 24:195–220, ...

Partially Observed Markov Decision Process Multiarmed - jstor

This paper considers multiarmed bandit problems involving partially observed Markov decision processes (POMDPs). We show how the Gittins index for the ...

(PDF) Using Rewards for Belief State Updates in Partially ...

Our goal in this paper is to investigate whether rewards can be used to produce a similar effect using traditional POMDP planning methods. Intuitively, in some ...

Mori-Zwanzig Approach for Belief Abstraction with Application to ...

... (POMDP) problem. While existing approaches ... Mori-Zwanzig Approach for Belief Abstraction with Application to Belief Space Planning. Mengxue Hou, Tony X.

Evolving Policies for Multi-Reward Partially Observable Markov ...

Tony's pomdp file repository page, Jan. 1999. [8] K. Deb and D. Kalyanmoy. Multi-Objective. Optimization Using Evolutionary Algorithms. Wiley, 1 edition, June ...

Untitled

Research sources: Tony's POMDP page · Journal of Artificial Intelligence Research · Latent Gold: LCA Software and resources · latentclass.com ...