Computational comparison of value iteration algorithms for discounted Markov decision processes
Thomas, L. C.
MetadataShow full item record
This note describes the results of a computational comparison of value iteration algorithms suggested for solving finite state discounted Markov decision processes. Such a process visits a set of states S = (1,2,...M). In Section two we describe the schemes examined and the various bounds that can be used for stopping them. Section three concentrates on one scheme that did well in the comparison - ordinary value iteration - and looks at various methods for eliminating non-optimal actions both permanently and temporarily
NPS Report NumberNPS55-82-024
Showing items related by title, author, creator and subject.
Wright, Brian Theodore. (Monterey, California ; Naval Postgraduate School, 1971-03);This thesis presents a numerical comparison of the exact and approximate powers of the chi-square goodness-of-f it test for small numbers of classes and small sample sizes for the equiprobable null hypothesis . The ...
ABS rules versus reliability based design of bulk carriers: a comparative analysis of ship design approaches O'Sullivan, Joseph M. (2003);This paper presents a comparison of the ABS Rules approach for ship design to the recently developed LRPD Reliability Based Design approach. Three elements of the design process are used for comparison. These are the Bottom ...
Kim, Kyung Cheol (Monterey, California. Naval Postgraduate School, 2004-06);High Frequency (HF) radar backscatter instruments are being developed and tested in the marine science and defense science communities for their abilities to sense surface parameters remotely in the coastal ocean over large ...