EconBase
← All papers

Regression Model Selection Under General Conditions

Amaze Lusompa

arXiv 16 Oct 2025 · Mathematics — Statistics Theory

arXiv:2510.14822 · PDF · Extracted main text

Abstract

Model selection criteria are one of the most important tools in statistics. Proofs showing a model selection criterion is asymptotically optimal are tailored to the type of model (linear regression, quantile regression, penalized regression, etc.), the estimation method (linear smoothers, maximum likelihood, generalized method of moments, etc.), the type of data (i.i.d., dependent, high dimensional, etc.), and the type of model selection criterion. Moreover, assumptions are often restrictive and unrealistic making it a slow and winding process for researchers to determine if a model selection criterion is selecting an optimal model. This paper provides general proofs showing asymptotic optimality for a wide range of model selection criteria under general conditions. This paper not only asymptotically justifies model selection criteria for most situations, but it also unifies and extends a range of previously disparate results.

Citation extraction

65
references
96
in-text mentions
65
distinct cited
0
self-citations
9,287
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Shao, J (1997) An asymptotic theory for linear model selection1.00053100%
2Li, K.-C (1987) Asymptotic optimality for cp, cl, cross-validation,and generalized cross-validation: Discrete index set0.81142100%
3Hansen, B. E. and J. Racine (2012) Jackknife model averaging0.73732100%
4Sin, C.-Y. and H. White (1996) Information criteria for selecting possibly misspecified parametric models0.64441100%
5Burman, P., E. Chow, and D. Nolan (1994) A cross-validatory method for dependent data0.64422100%
6Claeskens, G (2016) Statistical model choice0.64422100%
7Clark, T. E. and M. W. McCracken (2009) Improving forecast accuracy by combining recursive and rolling forecasts0.64422100%
8Ding, J., V. Tarokh, and Y. Yang (2018) Model selection techniques–-an overview0.64422100%
9Lütkepohl, H (2005) New Introduction to Multiple Time Series Analysis0.64422100%
10Rossi, B (2021) Forecasting in the presence of instabilities: How we know whether models predict well and how to improve them0.64422100%

Showing the top 10 of 65 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1A Note on the Finite Sample Bias in Time Series Cross-Validation0.40511