EconBase
← All papers

Tests for Forecast Instability and Forecast Failure under a Continuous Record Asymptotic Framework

Alessandro Casini

arXiv 29 Mar 2018 · Econometrics · 9 citations (OpenAlex)

arXiv:1803.10883 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We develop a novel continuous-time asymptotic framework for inference on whether the predictive ability of a given forecast model remains stable over time. We formally define forecast instability from the economic forecaster's perspective and highlight that the time duration of the instability bears no relationship with stable period. Our approach is applicable in forecasting environment involving low-frequency as well as high-frequency macroeconomic and financial variables. As the sampling interval between observations shrinks to zero the sequence of forecast losses is approximated by a continuous-time stochastic process (i.e., an Ito semimartingale) possessing certain pathwise properties. We build an hypotheses testing problem based on the local properties of the continuous-time limit counterpart of the sequence of losses. The null distribution follows an extreme value distribution. While controlling the statistical size well, our class of test statistics feature uniform power over the location of the forecast failure in the sample. The test statistics are designed to have power against general form of insatiability and are robust to common forms of non-stationarity such as heteroskedasticty and serial correlation. The gains in power are substantial relative to extant methods, especially when the instability is short-lasting and when occurs toward the tail of the sample.

Citation extraction

80
references
179
in-text mentions
80
distinct cited
1
self-citations
20,602
main-text words

appendix boundary found by appendix_command · 33% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Andrews (1993) Tests for Parameter Instability and Structural Change with Unknown Change-Point1.00053100%
2Li, Todorov, and Tauchen (2017) Adaptive Estimation of Continuous-Time Regression Models Using High-Frequency Data0.92844100%
3Casini and Perron (2017) Continuous Record Asymptotics for Structural Change Models0.89911373%
4Barndorff-Nielsen and Shephard (2004) Econometric Analysis of Realised Covariation: High Frequency Based Covariance, Regression and Correlation in Financial Economics0.84333100%
5Casini and Perron (2017) Structural Changes in Time Series0.84333100%
6Li and Xiu (2016) Generalized Method of Integrated Moments for High-Frequency Data0.84333100%
7Perron and Yamamoto (2018) Testing for Changes in Forecast Performance0.84333100%
8Bibinger, Jirak, and Vetter (2017) Nonparametric Change-Point Analysis of Volatility0.7374350%
9Gilchrist and Zakrajsek (2012) Credit Spreads and Business Cycle Fluctuations0.73732100%
10Wu and Zhao (2007) Inference of Trends in Time Series0.70914436%

Showing the top 10 of 80 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Continuous Record Laplace-based Inference about the Break Date in Structural Change Models0.64422
2Simultaneous Bandwidths Determination for DK-HAC Estimators and Long-Run Variance Estimation in Nonparametric Settings0.64422
3Theory of Low Frequency Contamination from Nonstationarity and Misspecification: Consequences for HAR Inference0.51121
4Prewhitened Long-Run Variance Estimation Robust to Nonstationarity0.51121
5Generalized Laplace Inference in Multiple Change-Points Models0.40511
6Continuous Record Asymptotics for Change-Point Models0.40511
7Theory of Evolutionary Spectra for Heteroskedasticity and Autocorrelation Robust Inference in Possibly Misspecified and Nonstationary Models0.40511
8Change-Point Analysis of Time Series with Evolutionary Spectra0.40511