DEVELOPING COMBAT BEHAVIOR THROUGH REINFORCEMENT LEARNING

Download
Author
Boron, Jonathan A.
Date
2020-06Advisor
Darken, Christian J.
Second Reader
Alt, Jonathan K.
Metadata
Show full item recordAbstract
The application of reinforcement learning in recent academic and commercial research projects has produced robust systems capable of performing at or above human performance levels. The objective of this thesis was to determine whether agents trained through reinforcement learning were capable of achieving optimal performance in small combat scenarios. In a set of computational experiments, training was conducted in a simple aggregate-level, constructive simulation capable of implementing both deterministic and stochastic combat models, and neural network performance was validated against the tactical principles of mass and economy of force. Overall, neural networks were able to learn the ideal behaviors, with the combat model and reinforcement learning algorithm having the most significant impact on performance. Moreover, in scenarios where massing was the best tactic, the training duration and learning rate were determined to be the most important training hyper-parameters. However, when economy of force was ideal, the discount factor was the only hyper-parameter that had a significant effect. In summary, this thesis concluded that reinforcement learning offers a promising means to develop intelligent behavior in combat simulations, which could be applied to training or analytical domains. It is recommended that future research examine larger and more complex training scenarios in order to fully understand the capabilities and limitations of reinforcement learning.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Related items
Showing items related by title, author, creator and subject.
-
Learning from Noisy and Delayed Rewards The Value of Reinforcement Learning to Defense Modeling and Simulation
Alt, Jonathan K. (Monterey, California. Naval Postgraduate School, 2012-09);Modeling and simulation of military operations requires human behavior models capable of learning from experi-ence in complex environments where feedback on action quality is noisy and delayed. This research examines the ... -
USING CONVOLUTION NEURAL NETWORKS TO DEVELOP ROBUST COMBAT BEHAVIORS THROUGH REINFORCEMENT LEARNING
Cannon, Christopher T.; Goericke, Stefan (Monterey, CA; Naval Postgraduate School, 2021-06);The success of reinforcement learning (RL), as shown with video games such as StarCraft and DOTA 2 achieving above-human performance levels, begs questions about the future role of the technology in military constructive ... -
A Methodology to Assess UrbanSim Scenarios
Vogt, Brian D. (Monterey, California. Naval Postgraduate School, 2012-09);Turn-based strategy games and simulations are vital tools for military education, training, and readiness. In an era of increasingly constrained resources and expanding demand for training solutions, the need for validated, ...