EconBase
← All papers

Adaptive Bayesian Estimation of Mixed Discrete-Continuous Distributions under Smoothness and Sparsity

Andriy Norets, Justinas Pelenis

arXiv 19 Jun 2018 · Mathematics — Statistics Theory · publishedEconometrica (2022) · 4 citations (OpenAlex)

arXiv:1806.07484 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We consider nonparametric estimation of a mixed discrete-continuous distribution under anisotropic smoothness conditions and possibly increasing number of support points for the discrete part of the distribution. For these settings, we derive lower bounds on the estimation rates in the total variation distance. Next, we consider a nonparametric mixture of normals model that uses continuous latent variables for the discrete part of the observations. We show that the posterior in this model contracts at rates that are equal to the derived lower bounds up to a log factor. Thus, Bayesian mixture of normals models can be used for optimal adaptive estimation of mixed discrete-continuous distributions.

Citation extraction

36
references
71
in-text mentions
36
distinct cited
4
self-citations
9,295
main-text words

appendix boundary found by appendix_titled_section at “Appendix” · 48% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Ibragimov, I. A. and R. Z. Hasminskii (1984) More on the estimation of distribution densities0.92843100%
2Shen, W., S. T. Tokdar, and S. Ghosal (2013) Adaptive Bayesian multivariate density estimation with Dirichlet mixtures0.88316469%
3Tsybakov, A. B (2008) Introduction to Nonparametric Estimation (Springer Series in Statistics)0.7374275%
4Hall, P. and D. M. Titterington (1987) On Smoothing Sparse Multinomial Data0.64441100%
5Efromovich, S (2011) Nonparametric estimation of the anisotropic probability density of mixed variables0.58531100%
6Norets, A. and D. Pati (2017) Adaptive Bayesian Estimation of Conditional Densities self0.5114225%
7Ghosal, S. and A. W. van der Vaart (2001) Entropies and rates of convergence for maximum likelihood and Bayes estimation for mixtures of normal densities0.5113233%
8Ghosal, S. and A. van der Vaart (2007) Posterior convergence rates of Dirichlet mixtures at smooth densities0.5113233%
9Ghosal, S., J. K. Ghosh, and A. W. v. d. Vaart (2000) Convergence Rates of Posterior Distributions0.5112250%
10Norets, A. and J. Pelenis (2012) Bayesian modeling of joint and conditional distributions self0.51121100%

Showing the top 10 of 36 scored citations.