EconBase
← All papers

Performance of Empirical Risk Minimization For Principal Component Regression

Christian Brownlees, Guðmundur Stefán Guðmundsson, Yaping Wang

arXiv 5 Sep 2024 · Econometrics

arXiv:2409.03606 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper establishes bounds on the predictive performance of empirical risk minimization for principal component regression. Our analysis is nonparametric, in the sense that the relation between the prediction target and the predictors is not specified. In particular, we do not rely on the assumption that the prediction target is generated by a factor model. In our analysis we consider the cases in which the largest eigenvalues of the covariance matrix of the predictors grow linearly in the number of predictors (strong signal regime) or sublinearly (weak signal regime). The main result of this paper shows that empirical risk minimization for principal component regression is consistent for prediction and, under appropriate conditions, it achieves near-optimal performance in both the strong and weak signal regimes.

Citation extraction

45
references
78
in-text mentions
45
distinct cited
2
self-citations
5,816
main-text words

appendix boundary found by appendix_command · 33% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Bai, J. and Ng, S (2002) Determining the Number of Factors in Approximate Factor Models1.00063100%
2Fan, J., Liao, Y., and Mincheva, M (2011) High Dimensional Covariance Matrix Estimation in Approximate Factor Models1.00053100%
3Brownlees, C. and Gumundsson, G. S (2025) Performance of empirical risk minimization for linear regression with dependent data self0.9507486%
4Bai, J. and Ng, S (2023) Approximate factor models with weaker loadings0.73732100%
5Fan, J., Liao, Y., and Mincheva, M (2013) Large covariance estimation by thresholding principal orthogonal complements0.73732100%
6Bai, J (2003) Inferential theory for factor models of large dimensions0.64422100%
7Jiang, W. and Tanner, M. A (2010) Risk minimization for time series binary choice with variable selection0.64422100%
8Lecué, G. and Mendelson, S (2016) Performance of empirical risk minimization in linear aggregation0.64422100%
9Lecué, G. and Mendelson, S (2018) Regularization and the small-ball method i: Sparse recovery0.64422100%
10Mendelson, S (2018) Learning without concentration for general loss functions0.64422100%

Showing the top 10 of 45 scored citations.