EconBase
← All papers

Variable Selection in High Dimensional Linear Regressions with Parameter Instability

Alexander Chudik, M. Hashem Pesaran, Mahrad Sharifvaghefi

arXiv 24 Dec 2023 · Econometrics · publishedJournal of Econometrics (2024) · 2 citations (OpenAlex)

arXiv:2312.15494 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper considers the problem of variable selection allowing for parameter instability. It distinguishes between signal and pseudo-signal variables that are correlated with the target variable, and noise variables that are not, and investigate the asymptotic properties of the One Covariate at a Time Multiple Testing (OCMT) method proposed by Chudik et al. (2018) under parameter insatiability. It is established that OCMT continues to asymptotically select an approximating model that includes all the signals and none of the noise variables. Properties of post selection regressions are also investigated, and in-sample fit of the selected regression is shown to have the oracle property. The theoretical results support the use of unweighted observations at the selection stage of OCMT, whilst applying down-weighting of observations only at the forecasting stage. Monte Carlo and empirical applications show that OCMT without down-weighting at the selection stage yields smaller mean squared forecast errors compared to Lasso, Adaptive Lasso, and boosting.

Citation extraction

46
references
81
in-text mentions
46
distinct cited
8
self-citations
37,713
main-text words

appendix boundary found by appendix_titled_section at “Supplementary lemmas” · 63% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chudik, A., G. Kapetanios, and M. H. Pesaran (2018) A one covariate at a time, multiple testing approach to variable selection in high-dimensional linear regression models self1.00096100%
2Lahiri, S. N (2021) Necessary and sufficient conditions for variable selection consistency of the lasso in high dimensions1.00063100%
3Sharifvaghefi, M (2023) Variable selection in linear regressions with many highly correlated covariates self0.8434375%
4Pesaran, M. H., A. Pick, and M. Pranovich (2013) Optimal forecasts in the presence of structural breaks self0.84333100%
5Zhao, P. and B. Yu (2006) On model selection consistency of Lasso0.84333100%
6Lütkepohl, H (1996) Handbook of Matrices0.81142100%
7Bühlmann, P (2006) Boosting for high-dimensional linear models0.6443267%
8Kapetanios, G. and F. Zikes (2018) Time-varying Lasso0.64422100%
9Meinshausen, N. and P. Bühlmann (2006) High-dimensional graphs and variable selection with the lasso0.64422100%
10Pesaran, M. H. and A. Timmermann (2007) Selection of estimation window in the presence of breaks self0.64422100%

Showing the top 10 of 46 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1High-dimensional forecasting with known knowns and known unknowns0.73732