Home
Journals
Archaeology International
Architecture_MPS
Europe and the World: A law review
Film Education Journal
History Education Research Journal
International Journal of Development Education and Global Learning
International Journal of Social Pedagogy
Jewish Historical Studies: A Journal of English-Speaking Jewry
Journal of Bentham Studies
London Review of Education
Radical Americas
Research for All
The Journal of the Sylvia Townsend Warner Society
The London Journal of Canadian Studies
About
About UCL Press
Who we are
Contact us
My ScienceOpen
Sign in
Register
Dashboard
Search
Home
Journals
Archaeology International
Architecture_MPS
Europe and the World: A law review
Film Education Journal
History Education Research Journal
International Journal of Development Education and Global Learning
International Journal of Social Pedagogy
Jewish Historical Studies: A Journal of English-Speaking Jewry
Journal of Bentham Studies
London Review of Education
Radical Americas
Research for All
The Journal of the Sylvia Townsend Warner Society
The London Journal of Canadian Studies
About
About UCL Press
Who we are
Contact us
My ScienceOpen
Sign in
Register
Dashboard
Search
58
views
0
references
Top references
cited by
98
Cite as...
0 reviews
Review
0
comments
Comment
0
recommends
+1
Recommend
0
collections
Add to
0
shares
Share
Twitter
Sina Weibo
Facebook
Email
2,732
similar
All similar
Record
: found
Abstract
: not found
Book
: not found
Markov Decision Processes
edited_book
Editor(s):
Martin L. Puterman
Publication date
(Print):
April 15 1994
Publisher:
John Wiley & Sons, Inc.
Read this book at
Publisher
Further versions
oa repository (via OAI-PMH doi match)
oa repository (via OAI-PMH doi match)
Powered by
Buy book
Review
Review book
Invite someone to review
Bookmark
Cite as...
There is no author summary for this book yet. Authors can add summaries to their books on ScienceOpen to make them more accessible to a non-specialist audience.
Related collections
Special Series: Research for Policy Decision Making
Author and book information
Book
ISBN (Electronic):
9780470316887
ISBN (Print):
9780471619772
Publication date (Print):
April 15 1994
DOI:
10.1002/9780470316887
SO-VID:
3fc6c445-0641-4c30-8887-1ee05b8a0b50
History
Data availability:
Comments
Comment on this book
Sign in to comment
Book chapters
pp. i
Frontmatter
pp. 1
Introduction
pp. 17
Model Formulation
pp. 33
Examples
pp. 74
Finite-Horizon Markov Decision Processes
pp. 119
Infinite-Horizon Models: Foundations
pp. 142
Discounted Markov Decision Problems
pp. 277
The Expected Total-Reward Criterion
pp. 331
Average Reward and Related Criteria
pp. 441
The Average Reward Criterion-Multichain and Communicating Models
pp. 492
Sensitive Discount Optimality
pp. 530
Continuous-Time Models
pp. 579
Afterword
pp. 581
Appendix A. Markov Chains
pp. 581
Notation
pp. 602
Appendix A. Semicontinuous Functions
pp. 605
Appendix C. Normed Linear Spaces
pp. 610
Appendix D. Linear Programming
pp. 613
Bibliography
pp. 643
Index
Similar content
2,732
Hidden Markov modeling for single channel kinetics with filtering and correlated noise.
Authors:
F Qin
,
A. Auerbach
,
F. Sachs
Aggregated markov processes and channel gating kinetics
Authors:
DR Fredkin
,
JA RICE
Probabilistic Markov model to assess the cost-effectiveness of bronchodilator therapy in COPD patients in different countries.
Authors:
Jan Oostenbrink
,
Maureen Rutten-van Mölken
,
Brigitta Monz
…
See all similar
Cited by
350
Mastering Atari, Go, chess and shogi by planning with a learned model
Authors:
Julian Schrittwieser
,
Ioannis Antonoglou
,
Thomas Hubert
…
The Complexity of Decentralized Control of Markov Decision Processes
Authors:
Daniel S Bernstein
,
Robert Givan
,
Neil Immerman
…
Robust Control of Markov Decision Processes with Uncertain Transition Matrices
Authors:
Arnab Nilim
,
Laurent El Ghaoui
See all cited by