A Methodology to Assess UrbanSim Scenarios

dc.contributor.advisorSullivan, Joseph
dc.contributor.authorVogt, Brian D.
dc.contributor.departmentModeling, Virtual Environments, and Simulation (MOVES)
dc.contributor.secondreaderAlt, Jonathan
dc.dateSep-12
dc.date.accessioned2012-11-14T00:03:09Z
dc.date.available2012-11-14T00:03:09Z
dc.date.issued2012-09
dc.descriptionThis thesis was performed at the MOVES Institute
dc.description.abstractTurn-based strategy games and simulations are vital tools for military education, training, and readiness. In an era of increasingly constrained resources and expanding demand for training solutions, the need for validated, effective solutions will increase. Appropriate performance feedback is an important component of any training solution. Current methods for designing and testing the performance feedback provided in turn-based simulation are limited to well-structured problems and do not adequately address ill-structured problems that better replicate problems facing military leaders in todays complex operating environment. This thesis develops and explores new methods for assessing the feedback mechanisms of turn-based strategy games. Using UrbanSim, a game for training strategic approaches to COIN operations as an exemplar, this thesis developed and explored two unique methods for evaluating the reward structure of the UrbanSim scenarios. The first method evaluates different student strategies using a batch-run method. The second method uses a reinforcement-learning algorithm to explore the decision space. These scenario evaluation methodologies are shown to be able to provide insights about a games performance feedback mechanism that was not previously available. These methodologies can be used for formative evaluation during game scenario development. Additionally, these evaluation methodologies are generalizable to other training and education games that focus on ill-structured problems and decision-making at discrete intervals.en_US
dc.description.distributionstatementApproved for public release; distribution is unlimited.
dc.description.serviceMajor, United States Armyen_US
dc.description.urihttp://archive.org/details/amethodologytoas1094517472
dc.identifier.urihttps://hdl.handle.net/10945/17472
dc.publisherMonterey, California. Naval Postgraduate Schoolen_US
dc.subject.authorUrbanSimen_US
dc.subject.authorGames for Trainingen_US
dc.subject.authorReinforcement-learningen_US
dc.subject.authorPerformance Feedback Assessmenten_US
dc.titleA Methodology to Assess UrbanSim Scenariosen_US
dc.typeThesisen_US
dspace.entity.typePublication
etd.thesisdegree.disciplineModeling, Virtual Environments, and Simulation Institute (MOVES)en_US
etd.thesisdegree.levelMastersen_US
etd.thesisdegree.nameMaster of Science in Modeling, Virtual Environments, and Simulation (MOVES)en_US
Files