EconBase
← All papers

The Virtue of Sparsity in Complexity

Nima Afsharhajari, Jonathan Yu-Meng Li

arXiv 18 Apr 2026 · Finance — General

arXiv:2604.17166 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Sparsity or complexity? In modern high-dimensional asset pricing, these are often viewed as competing principles: richer feature spaces appear to favor complexity, while economic intuition has long favored parsimony. We show that this tension is misplaced. We distinguish capacity sparsity-the dimensionality of the candidate feature space-from factor sparsity-the parsimonious structure of priced risks-and argue that the two are complements: expanding capacity enables the discovery of factor sparsity. Revisiting the benchmark empirical design of Didisheim et al. (2025) and pushing it to higher complexity regimes, we show that nonlinear feature expansions combined with basis pursuit yield portfolios whose out-of-sample performance dominates ridgeless benchmarks beyond a critical complexity threshold. The evidence shows that the gains from complexity arise not from retaining more factors, but from enlarging the space from which a sparse structure of priced risks can be identified. The virtue of complexity in asset pricing operates through factor sparsity.

Citation extraction

21
references
42
in-text mentions
21
distinct cited
0
self-citations
7,453
main-text words

appendix boundary found by appendix_command · 90% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Didisheim, Antoine and Ke, Shikun Barry and Kelly, Bryan T. and Mala… (2025) APT or “AIPT”? The Surprising Dominance of Large Factor Models1.000154100%
2Kelly, Bryan T. and Malamud, Semyon and Zhou, Kangying (2024) The Virtue of Complexity in Return Prediction0.73732100%
3Gu, Shihao and Kelly, Bryan T. and Xiu, Dacheng (2020) Empirical Asset Pricing via Machine Learning0.64422100%
4Jensen, Theis Ingerslev and Kelly, Bryan T. and Pedersen, Lasse Heje (2023) Is There a Replication Crisis in Finance?0.64422100%
5Wilson, Andrew Gordon (2025) Deep Learning is Not So Mysterious or Different0.64422100%
6Kelly, Bryan T. and Malamud, Semyon (2025) Understanding The Virtue of Complexity0.51121100%
7Kozak, Serhiy and Nagel, Stefan and Santosh, Shrihari (2020) Shrinking the Cross-Section0.51121100%
8Bartlett, Peter L. and Long, Philip M. and Lugosi, Gabor and Tsigler… (2020) Benign Overfitting in Linear Regression0.40511100%
9Chen, Luyang and Pelger, Markus and Zhu, Jason (2024) Deep Learning in Asset Pricing0.40511100%
10Chen, Andrew Y. and Zimmermann, Tom (2022) Open Source Cross-Sectional Asset Pricing0.40511100%

Showing the top 10 of 21 scored citations.