Reinforcement learning a new approach for the cultural geography model

Download
Author
Papadopoulos, Sotirios
Date
2010-09Advisor
Darken, Christian J.
Second Reader
Alt, Jonathan
Metadata
Show full item recordAbstract
The Cultural Geography (CG) model, under development in TRAC Monterey, is an open-source agent-based social simulation, designed to offer an insight into the response of the civilian population during Irregular Warfare (IW) operations. It implements social and behavioral science theories that govern the behaviors of agents within the simulation using Bayesian belief networks. At this stage, the agents within the CG model do not select their actions at all. Instead, all their actions are hard coded into the model's scenario file. As part of an attempt to improve the model, this effort sought to enhance the functionality within the model by exploring the use of utility functions and, more specifically, the concept of reinforcement learning. This study began with the development of a learning agent prototype. After the initial testing for its functionality, the code that was developed was inserted into the main CG model. Based on specially developed scenarios, and by employing a design of experiments methodology, we created experimental runs. By applying statistical and analysis techniques, we showed that reinforcement learning works properly inside the Social Network environment and produces the desired results. This study can be used as a starting point for the research of the effects of reinforcement learning in social modeling in general.
Description
This thesis was done at the MOVES Institute
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Related items
Showing items related by title, author, creator and subject.
-
Learning from Noisy and Delayed Rewards The Value of Reinforcement Learning to Defense Modeling and Simulation
Alt, Jonathan K. (Monterey, California. Naval Postgraduate School, 2012-09);Modeling and simulation of military operations requires human behavior models capable of learning from experi-ence in complex environments where feedback on action quality is noisy and delayed. This research examines the ... -
Representative trust in cognitive social simulations
Pollock, Shawnoah (Monterey, California. Naval Postgraduate School, 2011-09);Trust plays a critical role in communications, strength of relationships, and information processing at the individual and group levels. Cognitive social simulations show promise in providing an experimental platform for ... -
Representing Trust in cognitive social simulations
Pollock, Shawn S.; Alt, Jonathan K.; Darken, Christian J. (2011);Trust plays a critical role in communications, strength of relationships, and information processing at the individual and group level. Cognitive social simulations show promise in providing an experimental platform for ...