EconBase
← All papers

Bayesian penalized empirical likelihood and Markov Chain Monte Carlo sampling

Jinyuan Chang, Cheng Yong Tang, Yuanzheng Zhu

arXiv 23 Dec 2024 · Statistics — Methodology · publishedJournal of the Royal Statistical Society Series B (Statistical Methodology) (2025)

arXiv:2412.17354 · PDF · DOI · OpenAlex · Extracted main text

Abstract

In this study, we introduce a novel methodological framework called Bayesian Penalized Empirical Likelihood (BPEL), designed to address the computational challenges inherent in empirical likelihood (EL) approaches. Our approach has two primary objectives: (i) to enhance the inherent flexibility of EL in accommodating diverse model conditions, and (ii) to facilitate the use of well-established Markov Chain Monte Carlo (MCMC) sampling schemes as a convenient alternative to the complex optimization typically required for statistical inference using EL. To achieve the first objective, we propose a penalized approach that regularizes the Lagrange multipliers, significantly reducing the dimensionality of the problem while accommodating a comprehensive set of model conditions. For the second objective, our study designs and thoroughly investigates two popular sampling schemes within the BPEL context. We demonstrate that the BPEL framework is highly flexible and efficient, enhancing the adaptability and practicality of EL methods. Our study highlights the practical advantages of using sampling techniques over traditional optimization methods for EL problems, showing rapid convergence to the global optima of posterior distributions and ensuring the effective resolution of complex statistical inference challenges.

Citation extraction

52
references
88
in-text mentions
52
distinct cited
10
self-citations
53,946
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Shi, Z (2016) Econometric estimation with high-dimensional moment equalities1.00084100%
2Mengersen, K. L., Pudlo, P., & Robert, C. P (2013) Bayesian computation via empirical likelihood0.84333100%
3Cornuet, J.-M., Marin, J.-M., Mira, A., & Robert, C. P (2012) Adaptive multiple importance sampling0.73732100%
4Chaussé, P (2017) Generalized empirical likelihood for a continuum of moment conditions0.73732100%
5Hsu, D., Kakade, S. M., & Zhang, T (2012) A tail inequality for quadratic forms of subgaussian random vectors0.73732100%
6Jing, B. Y., Shao, Q. M., & Wang, Q (2003) Self-normalized cramer-type large deviations for independent random variables0.73732100%
7Ma, Y.-A., Chen, Y., Jin, C., Flammarion, N., & Jordan, M. I (2019) Sampling can be faster than optimization0.73732100%
8Chang, J., Tang, C. Y., & Wu, T (2018) A new scope of penalized empirical likelihood with high-dimensional estimating equations self0.69361100%
9Chang, J., Chen, S. X., & Chen, X (2015) High dimensional generalized empirical likelihood for moment restrictions with dependent data self0.64422100%
10Chang, J., Tang, C. Y., & Wu, T (2018) A new scope of penalized empirical likelihood with high-dimensional estimating equations self0.64422100%

Showing the top 10 of 52 scored citations.