EconBase
← All papers

A Note on the Finite Sample Bias in Time Series Cross-Validation

Amaze Lusompa

arXiv 5 Dec 2025 · Statistics — Methodology

arXiv:2512.05900 · PDF · DOI · OpenAlex · Extracted main text

Abstract

It is well known that model selection via cross validation can be biased for time series models. However, many researchers have argued that this bias does not apply when using cross-validation with vector autoregressions (VAR) or with time series models whose errors follow a martingale-like structure. I show that even under these circumstances, performing cross-validation on time series data will still generate bias in general.

Citation extraction

23
references
46
in-text mentions
23
distinct cited
1
self-citations
2,732
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Christoph Bergmeir and Rob J. Hyndman and Bonsoo Koo (2018) A note on the validity of cross-validation for evaluating autoregressive time series prediction1.00083100%
2P. Burman and D. Nolan (1992) DATA-DEPENDENT ESTIMATION OF PREDICTION FUNCTIONS1.00073100%
3Jean Opsomer and Yuedong Wang and Yuhong Yang (2001) Nonparametric Regression with Correlated Errors1.00053100%
4N. S. Altman (1990) Kernel Smoothing of Data With Correlated Errors0.73732100%
5Jeffrey D. Hart (1991) Kernel Regression Estimation With Time Series Errors0.73732100%
6Sylvain Arlot and Alain Celisse (2010) A survey of cross-validation procedures for model selection0.64422100%
7Prabir Burman and Edmond Chow and Deborah Nolan (1994) A Cross-Validatory Method for Dependent Data0.64422100%
8Stanislav Anatolyev (2005) GMM, GEL, Serial Correlation, and Asymptotic Bias0.40511100%
9Yong Bao and Aman Ullah (2007) The second-order bias and mean squared error of estimators in time-series models0.40511100%
10Peter J. Brockwell and Richard A. Davis (1991) Time Series: Theory and Methods0.40511100%

Showing the top 10 of 23 scored citations.