Home
Journals
Archaeology International
Architecture_MPS
Europe and the World: A law review
Film Education Journal
History Education Research Journal
International Journal of Development Education and Global Learning
International Journal of Social Pedagogy
Jewish Historical Studies: A Journal of English-Speaking Jewry
Journal of Bentham Studies
London Review of Education
Radical Americas
Research for All
The Journal of the Sylvia Townsend Warner Society
The London Journal of Canadian Studies
About
About UCL Press
Who we are
Contact us
My ScienceOpen
Sign in
Register
Dashboard
Search
Home
Journals
Archaeology International
Architecture_MPS
Europe and the World: A law review
Film Education Journal
History Education Research Journal
International Journal of Development Education and Global Learning
International Journal of Social Pedagogy
Jewish Historical Studies: A Journal of English-Speaking Jewry
Journal of Bentham Studies
London Review of Education
Radical Americas
Research for All
The Journal of the Sylvia Townsend Warner Society
The London Journal of Canadian Studies
About
About UCL Press
Who we are
Contact us
My ScienceOpen
Sign in
Register
Dashboard
Search
59
views
0
references
Top references
cited by
98
Cite as...
0 reviews
Review
0
comments
Comment
0
recommends
+1
Recommend
0
collections
Add to
0
shares
Share
Twitter
Sina Weibo
Facebook
Email
2,756
similar
All similar
Record
: found
Abstract
: not found
Book
: not found
Markov Decision Processes
edited_book
Editor(s):
Martin L. Puterman
Publication date
(Print):
April 15 1994
Publisher:
John Wiley & Sons, Inc.
Read this book at
Publisher
Further versions
oa repository (via OAI-PMH doi match)
oa repository (via OAI-PMH doi match)
Powered by
Buy book
Review
Review book
Invite someone to review
Bookmark
Cite as...
There is no author summary for this book yet. Authors can add summaries to their books on ScienceOpen to make them more accessible to a non-specialist audience.
Related collections
Thermal Imaging in Social Decision Making
Author and book information
Book
ISBN (Electronic):
9780470316887
ISBN (Print):
9780471619772
Publication date (Print):
April 15 1994
DOI:
10.1002/9780470316887
SO-VID:
3fc6c445-0641-4c30-8887-1ee05b8a0b50
History
Data availability:
Comments
Comment on this book
Sign in to comment
Book chapters
pp. i
Frontmatter
pp. 1
Introduction
pp. 17
Model Formulation
pp. 33
Examples
pp. 74
Finite-Horizon Markov Decision Processes
pp. 119
Infinite-Horizon Models: Foundations
pp. 142
Discounted Markov Decision Problems
pp. 277
The Expected Total-Reward Criterion
pp. 331
Average Reward and Related Criteria
pp. 441
The Average Reward Criterion-Multichain and Communicating Models
pp. 492
Sensitive Discount Optimality
pp. 530
Continuous-Time Models
pp. 579
Afterword
pp. 581
Appendix A. Markov Chains
pp. 581
Notation
pp. 602
Appendix A. Semicontinuous Functions
pp. 605
Appendix C. Normed Linear Spaces
pp. 610
Appendix D. Linear Programming
pp. 613
Bibliography
pp. 643
Index
Similar content
2,756
Multistate Markov chain modeling for child undernutrition transitions in Ethiopia: a longitudinal data analysis, 2002–2016
Authors:
Getnet Bogale Begashaw
,
Temesgen Zewotir
,
Haile Mekonnen Fenta
Trend shifts in road traffic collisions: An application of Hidden Markov Models and Generalised Additive Models to assess the impact of the 20 mph speed limit policy in Edinburgh
Authors:
Valentin A. Popov
,
Glenna F. Nightingale
,
Andrew Williams
…
Combining Markov Random Fields and Convolutional Neural Networks for Image Synthesis
Authors:
,
See all similar
Cited by
350
Mastering Atari, Go, chess and shogi by planning with a learned model
Authors:
Julian Schrittwieser
,
Ioannis Antonoglou
,
Thomas Hubert
…
The Complexity of Decentralized Control of Markov Decision Processes
Authors:
Daniel S Bernstein
,
Robert Givan
,
Neil Immerman
…
Robust Control of Markov Decision Processes with Uncertain Transition Matrices
Authors:
Arnab Nilim
,
Laurent El Ghaoui
See all cited by