Markov Decision Processes: Discrete Stochastic Dynamic Programming

“This text is unique in bringing together so many results hitherto found only in part in other texts and papers. . . . The text is fairly self-contained, inclusive of some basic mathematical results needed, and provides a rich diet of examples, applications, and exercises. The bibliographical material at the end of each chapter is excellent, not only from a historical perspective, but because it is valuable for researchers in acquiring a good perspective of the MDP research potential.”
“. . . it is of great value to advanced-level students, researchers, and professional practitioners of this field to have now a complete volume (with more than 600 pages) devoted to this topic. . . . represents an up-to-date, unified, and rigorous treatment of theoretical and computational aspects of discrete-time Markov decision processes.”
—Journal of the American Statistical Association