Markov Decision Processes

A General Framework for Markov Decision Processes.

Algorithms.

Linear Programming Formulations for Markov DecisionProcesses.

Semi-Markov Decision Processes.

Partially Observable and Adaptive Markov Decision Processes.

Further Aspects of Markov Decision Processes.

Some Markov Decision Process Problems, Formulations and OptimalityEquations.

References.

Solutions to Exercises.

Index.