Constrained maximum likelihood estimators for densities
Royset, Johannes O.
Wets, Roger J.-B.
MetadataShow full item record
We propose a framework for nonparametric maximum likelihood estimation of densities in situations where the sample is supplemented by information and assumptions about shape, support, continuity, slope, location of modes, density values, and other conditions that, individually or in combination, restrict the family of densities under consideration. We establish existence of estimators and their cluster points, strong consistency under mild assumptions, and robustness in the presence of model misspecification. The results are achieved by means of viewing densities as elements of spaces of semicontinuous functions with the hypo-distance metric. This metric emerges as natural and convenient when considering broad classes of side conditions. It also has the exceptional property that convergence of densities in this metric implies convergence of modes, near-modes, height of modes, and high-likelihood events. Thus, we automatically achieve strong consistency of a rich class of plug-in estimators for modes and related quantities. Relying on almost sure epi-convergence of criterion functions, we avoid the strong assumptions associated with uniform laws of large numbers and instead leverage a less demanding law, for which we provide a new proof. Specific examples illustrate the framework including an estimator simultaneously subject to bounds on density values and its (sub)gradients, restriction to concavity, penalization that encourages lower modes, and imprecise information about the expected value.
RightsThis publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Showing items related by title, author, creator and subject.
Bassett, Robert; Sharpnack, James (ArXiv, 2018-12);In this paper we introduce a method for nonparametric density estimation on infrastructure networks. We define fused density estimators as solutions to a total variation regularized maximum-likelihood density estimation ...
Royset, Johannes O.; Szechtman, Roberto (2012-12);The sample average approximation approach to solving stochastic programs induces a sampling error, caused by replacing an expectation by a sample average, as well as an optimization error due to approximating the solution ...
Royset, Johannes O.; Wets, Roger J-B (ArXiv, 2019);We propose a unified framework for establishing existence of nonparametic M-estimators, computing the corresponding estimates, and proving their strong consistency when the class of functions is exceptionally rich. In ...