An analysis of learning algorithms in complex stochastic environments

Download
Author
Poor, Kristopher D.
Date
2007-06Advisor
Darken, Christian
Second Reader
Norbraten, Terry
Metadata
Show full item recordAbstract
As the military continues to expand its use of intelligent agents in a variety of operational aspects, event prediction and learning algorithms are becoming more and more important. In this paper, we conduct a detailed analysis of two such algorithms: Variable Order Markov and Look-Up Table models. Each model employs different parameters for prediction, and this study attempts to determine which model is more accurate in its prediction and why. We find the models contrast in that the Variable Order Markov Model increases its average prediction probability, our primary performance measure, with increased maximum model order, while the Look-Up Table Model decreases average prediction probability with increased recency time threshold. In addition, statistical tests of results of each model indicate a consistency in each model's prediction capabilities, and most of the variation in the results could be explained by model parameters.
Collections
Related items
Showing items related by title, author, creator and subject.
-
LEARNING AND PREDICTION OF RELATIONAL TIME SERIES
Tan, Kian-Moh Terence (Monterey, California. Naval Postgraduate School, 2013-03);Prediction of events is fundamental to both human and artificial agents. The main problem with previous prediction techniques is that they cannot predict events that have never been experienced before. This dissertation ... -
How long can an atmospheric model predict?
Ivanov, Leonid M.; Chu, Peter C. (2004-06);Prediction of atmospheric phenomena needs three components: a theoretical (or numerical) model based on the natural laws (physical, chemical, or biological), a sampling set of the reality, and a tolerance level. ... -
Prediction markets as a way to manage acquisition programs
Dishmon, Joshua M. (Monterey, California. Naval Postgraduate School, 2011-06);Prediction markets generally are small-scale electronic markets that tie payoffs to measurable future events. They are similar to stock markets, where the "stocks" are outcomes or events rather than shares in a company. ...