Optimal Control of Uncertain Systems Using Sample Average Approximations
Royset, Johannes O.
MetadataShow full item record
In this paper, we introduce the uncertain optimal control problem of determining a control that minimizes the expectation of an objective functional for a system with parameter uncertainty in both dynamics and objective. We present a computational framework for the numerical solution of this problem, wherein an independently drawn random sample is taken from the space of uncertain parameters, and the expectation in the objective functional is approximated by a sample average. The result is a sequence of approximating standard optimal control problems that can be solved using existing techniques. To analyze the performance of this computational framework, we develop necessary conditions for both the original and approximate problems and show that the approximation based on sample averages is consistent in the sense of Polak [Optimization: Algorithms and Consistent Approximations, Springer, New York, 1997]. This property guarantees that accumulation points of a sequence of global minimizers (stationary points) of the approximate problem are global minimizers (stationary points) of the original problem. We show that the uncertain optimal control problem can further be approximated in a consistent manner by a sequence of nonlinear programs under mild regularity assumptions. In numerical examples, we demonstrate that the framework enables the solution of optimal search and optimal ensemble control problems.
The article of record as published may be found at http://dx.doi.org/10.1137/140983161
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Royset, Johannes O.; Phelps, Chris; Gong, Qi (IEEE, 2013-12);This paper focuses on an optimal control problem in which the objective is to minimize the expectation of a cost functional with stochastic parameters. The inclusion of the stochastic parameters in the objective raises ...
Phelps, Chris; Gong, Qi; Royset, Johannes O.; Walton, Claire; Kaminer, Isaac (Elsevier, 2014);This paper focuses on a non-standard constrained nonlinear optimal control problem in which the objective functional involves an integration over a space of stochastic parameters as well as an integration over the time ...
Phelps, Chris; Gong, Qi; Royset, Johannes O.; Kaminer, Isaac (IEEE, 2012-12-10);This paper focuses on the problem of optimizing the trajectories of multiple searchers attempting to detect a non-evading moving target whose motion is conditionally deterministic. This problem is a parameter-distributed ...