Constrained maximum likelihood estimators for densities
Royset, Johannes O.
Wets, Roger J.-B.
MetadataShow full item record
We propose a framework for nonparametric maximum likelihood estimation of densities in situations where the sample is supplemented by information and assumptions about shape, support, continuity, slope, location of modes, density values, and other conditions that, individually or in combination, restrict the family of densities under consideration. We establish existence of estimators and their cluster points, strong consistency under mild assumptions, and robustness in the presence of model misspecification. The results are achieved by means of viewing densities as elements of spaces of semicontinuous functions with the hypo-distance metric. This metric emerges as natural and convenient when considering broad classes of side conditions. It also has the exceptional property that convergence of densities in this metric implies convergence of modes, near-modes, height of modes, and high-likelihood events. Thus, we automatically achieve strong consistency of a rich class of plug-in estimators for modes and related quantities. Relying on almost sure epi-convergence of criterion functions, we avoid the strong assumptions associated with uniform laws of large numbers and instead leverage a less demanding law, for which we provide a new proof. Specific examples illustrate the framework including an estimator simultaneously subject to bounds on density values and its (sub)gradients, restriction to concavity, penalization that encourages lower modes, and imprecise information about the expected value.
Showing items related by title, author, creator and subject.
Royset, Johannes O.; Szechtman, Roberto (2012-12);The sample average approximation approach to solving stochastic programs induces a sampling error, caused by replacing an expectation by a sample average, as well as an optimization error due to approximating the solution ...
Royset, Johannes O.; Wets, Roger J-B (2015-06-10);This article discusses univariate density estimation in situations when the sample (hard information) is supplemented by “soft” information about the random phenomenon. These situations arise broadly in operations research ...
Ben-Yakov, Uzi (Monterey, California. Naval Postgraduate School, 1979-12);Self adaptive filters adjust their parameters to perform an almost optimal filtering operation without apriori knowledge of the input signal statistics . Two approaches to the design of efficient self adaptive discrete ...