EconBase
← All papers

Concentration inequalities of MLE and robust MLE

Xiaowei Yang, Xinqiao Liu, Haoyu Wei

arXiv 17 Oct 2022 · Mathematics — Statistics Theory · publishedCommunication in Statistics-Theory and Methods (2023) · 2 citations (OpenAlex)

arXiv:2210.09398 · PDF · DOI · OpenAlex · Extracted main text

Abstract

The Maximum Likelihood Estimator (MLE) serves an important role in statistics and machine learning. In this article, for i.i.d. variables, we obtain constant-specified and sharp concentration inequalities and oracle inequalities for the MLE only under exponential moment conditions. Furthermore, in a robust setting, the sub-Gaussian type oracle inequalities of the log-truncated maximum likelihood estimator are derived under the second-moment condition.

Citation extraction

17
references
31
in-text mentions
17
distinct cited
1
self-citations
7,781
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Miao, Y (2010) Concentration inequality of maximum likelihood estimator0.87472100%
2Maurer, A. and Pontil, M (2021) Concentration inequalities under sub-gaussian and sub-exponential conditions0.87462100%
3Catoni, O (2012) Challenging the empirical mean and empirical variance: a deviation study0.64422100%
4Mardia, K., Southworth, H., and Taylor, C (1999) On bias in maximum likelihood estimators0.64422100%
5Lerasle, M (2019) Lecture notes: Selected topics on robust statistical learning theory0.51121100%
6Weinberg, G. V (2017) Noncoherent radar detection in correlated pareto distributed clutter0.40511100%
7Arnold, B. C (2014) Pareto distribution0.40511100%
8Buldygin, V. V. and Kozachenko, I. V (2000) Metric characterization of random variables and random processes, volume 1880.40511100%
9Cramér, H (1946) Mathematical Methods of Statistics0.40511100%
10Huber, P. J (1964) Robust estimation of a location parameter0.40511100%

Showing the top 10 of 17 scored citations.