EconBase
← All papers

Sparsified Simultaneous Confidence Intervals for High-Dimensional Linear Models

Xiaorui Zhu, Yichen Qin, Peng Wang

arXiv 14 Jul 2023 · Statistics — Methodology · publishedMetrika (2024) · 1 citations (OpenAlex)

arXiv:2307.07574 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Statistical inference of the high-dimensional regression coefficients is challenging because the uncertainty introduced by the model selection procedure is hard to account for. A critical question remains unsettled; that is, is it possible and how to embed the inference of the model into the simultaneous inference of the coefficients? To this end, we propose a notion of simultaneous confidence intervals called the sparsified simultaneous confidence intervals. Our intervals are sparse in the sense that some of the intervals' upper and lower bounds are shrunken to zero (i.e., $[0,0]$), indicating the unimportance of the corresponding covariates. These covariates should be excluded from the final model. The rest of the intervals, either containing zero (e.g., $[-1,1]$ or $[0,1]$) or not containing zero (e.g., $[2,3]$), indicate the plausible and significant covariates, respectively. The proposed method can be coupled with various selection procedures, making it ideal for comparing their uncertainty. For the proposed method, we establish desirable asymptotic properties, develop intuitive graphical tools for visualization, and justify its superior performance through simulation and real data analysis.

Citation extraction

57
references
116
in-text mentions
57
distinct cited
4
self-citations
9,773
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Yang Liu and Peng Wang (1988) Selection by partitioning the solution paths self1.00083100%
2Xianyang Zhang and Guang Cheng (2016) Simultaneous Inference for High-Dimensional Linear Models1.00083100%
3Yiyun Zhang, Runze Li, and Chih-Ling Tsai (2010) Regularization parameter selections via generalized information criterion0.73732100%
4Huai-Kuang Tsai, Henry Horng-Shing Lu, and Wen-Hsiung Li (2005) Statistical methods for identifying yeast cell cycle transcription factors0.693131100%
5N. Banerjee (2003) Identifying cooperativity among transcription factors controlling the cell cycle in yeast0.693101100%
6Lifeng Wang, Guang Chen, and Hongzhe Li (2007) Group SCAD regression analysis for microarray time course gene expression data0.69381100%
7Mu Yue, Jialiang Li, and Ming-Yen Cheng (2019) Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients0.64441100%
8A. Chatterjee and S. N. Lahiri (2011) Bootstrapping Lasso Estimators0.64422100%
9Ruben Dezeure, Peter Bühlmann, and Cun-Hui Zhang (2017) High-dimensional simultaneous inference with the bootstrap0.64422100%
10Jianqing Fan and Runze Li (2001) Variable selection via nonconcave penalized likelihood and its oracle properties0.64422100%

Showing the top 10 of 57 scored citations.