EconBase
← All papers

Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors

Victor Chernozhukov, Denis Chetverikov, Kengo Kato

arXiv 31 Dec 2012 · Mathematics — Statistics Theory · publishedThe Annals of Statistics (2013) · 341 citations (OpenAlex)

arXiv:1212.6906 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We derive a Gaussian approximation result for the maximum of a sum of high-dimensional random vectors. Specifically, we establish conditions under which the distribution of the maximum is approximated by that of the maximum of a sum of the Gaussian random vectors with the same covariance matrices as the original vectors. This result applies when the dimension of random vectors ($p$) is large compared to the sample size ($n$); in fact, $p$ can be much larger than $n$, without restricting correlations of the coordinates of these vectors. We also show that the distribution of the maximum of a sum of the random vectors with unknown covariance matrices can be consistently estimated by the distribution of the maximum of a sum of the conditional Gaussian random vectors obtained by multiplying the original vectors with i.i.d. Gaussian multipliers. This is the Gaussian multiplier (or wild) bootstrap procedure. Here too, $p$ can be large or even much larger than $n$. These distributional approximations, either Gaussian or conditional Gaussian, yield a high-quality approximation to the distribution of the original maximum, often with approximation error decreasing polynomially in the sample size, and hence are of interest in many applications. We demonstrate how our Gaussian approximations and the multiplier bootstrap can be used for modern high-dimensional estimation, multiple hypothesis testing, and adaptive specification testing. All these results contain nonasymptotic bounds on approximation errors.

Citation extraction

62
references
138
in-text mentions
62
distinct cited
7
self-citations
11,420
main-text words

appendix boundary found by appendix_command · 35% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Candès, E.J. and Tao, T (2007) The Dantzig selector: statistical estimation when $p$ is much larger than $n$1.00053100%
2Chernozhukov, V., Chetverikov, D., and Kato, K (2013) Gaussian approximations and multiplier bootstrap for maxima of sums of high-dimensional random vectors self0.93511682%
3Bickel, P., Ritov, Y. and Tsybakov, A (2009) Simultaneous analysis of Lasso and Dantzig selector0.87472100%
4Romano, J., and Wolf, M (2005) Exact and approximate stepdown methods for multiple hypothesis testing0.87452100%
5Talagrand, M (2003) Spin Glasses: A Challenge for Mathematicians0.8434375%
6Chatterjee, S (2005) An error bound in the Sudakov-Fernique inequality0.7373367%
7Chernozhukov, V., Chetverikov, D. and Kato, K (2012) Gaussian approximation of suprema of empirical processes self0.7373367%
8Chernozhukov, V., Chetverikov, D. and Kato, K (2012) Comparison and anti-concentration bounds for maxima of Gaussian random vectors self0.7218638%
9Dudley, R.M (1999) Uniform Central Limit Theorems0.6443267%
10Arlot, S., Blanchard, G. and Roquain, E (2010) Some non-asymptotic results on resampling in high dimension II: multiple tests0.64422100%

Showing the top 10 of 62 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1A Heteroskedasticity-Robust Overidentifying Restriction Test with High-Dimensional Covariates1.000103
2An Identification-and Dimensionality-Robust Test for Instrumental Variables Models1.00074
3Valid Simultaneous Inference in High-Dimensional Settings (with the HDM Package for R)1.00063
4Quantile Graphical Models: Prediction and Conditional Independence with Applications to Systemic Risk1.00053
5Bootstrap Consistency for Quadratic Forms of Sample Averages with Increasing Dimension0.95074
6High-Dimensional Econometrics and Regularized GMM0.874122
7Improved Central Limit Theorem and Bootstrap Approximations in High Dimensions0.83075
8Bootstrapping $_p$-Statistics in High Dimensions0.737105
9A Powerful Bootstrap Test of Independence in High Dimensions0.73743
10The Factor-Lasso and K-Step Bootstrap Approach for Inference in High-Dimensional Economic Applications0.73732