EconBase
← All papers

Extending the Scope of Inference About Predictive Ability to Machine Learning Methods

Juan Carlos Escanciano, Ricardo Parra

arXiv 20 Feb 2024 · Econometrics · publishedJournal of Business and Economic Statistics (2025) · 1 citations (OpenAlex)

arXiv:2402.12838 · PDF · DOI · OpenAlex · Extracted main text

Abstract

The use of machine learning methods for predictive purposes has increased dramatically over the past two decades, but uncertainty quantification for predictive comparisons remains elusive. This paper addresses this gap by extending the classic inference theory for predictive ability in time series to modern machine learners, such as the Lasso or Deep Learning. We investigate under which conditions such extensions are possible. For standard out-of-sample asymptotic inference to be valid with machine learning, two key properties must hold: (I) a zero-mean condition for the score of the prediction loss function and (ii) a "fast rate" of convergence for the machine learner. Absent any of these conditions, the estimation risk may be unbounded, and inferences invalid and very sensitive to sample splitting. For accurate inferences, we recommend an 80%-20% training-test splitting rule. We illustrate the wide applicability of our results with three applications: high-dimensional time series regressions with the Lasso, Deep learning for binary outcomes, and a new out-of-sample test for the Martingale Difference Hypothesis (MDH). The theoretical results are supported by extensive Monte Carlo simulations and an empirical application evaluating the MDH of some major exchange rates at daily and higher frequencies.

Citation extraction

28
references
56
in-text mentions
28
distinct cited
5
self-citations
11,141
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1West, K. D (1996) Asymptotic inference about predictive ability1.00073100%
2Diebold, F. X. and R. Mariano (1995) Comparing predictive accuracy1.00053100%
3Andrews, D. W (1994) Asymptotics for semiparametric econometric models via stochastic equicontinuity0.84333100%
4Gneiting, T (2011) Making and evaluating point forecasts0.73732100%
5Kengne, W. and M. Wade (2024) Deep learning from strongly mixing observations: Sparse-penalized regularization and minimax optimality0.73732100%
6Wong, K. C., Z. Li, and A. Tewari (2020) Lasso guarantees for $ $-mixing heavy-tailed time series0.73732100%
7Clark, T. E. and K. D. West (2006) Using out-of-sample mean squared prediction errors to test the martingale difference hypothesis0.69361100%
8Escanciano, J. C. and I. N. Lobato (2009) An automatic portmanteau test for serial correlation self0.64441100%
9Escanciano, J. C. and I. N. Lobato (2009) Testing the martingale hypothesis self0.51121100%
10Greenshtein, E. and Y. Ritov (2004) Persistence in high-dimensional linear predictor selection and the virtue of overparametrization0.51121100%

Showing the top 10 of 28 scored citations.