EconBase
← All papers

Testing Quantile Forecast Optimality

Jack Fosten, Daniel Gutknecht, Marc-Oliver Pohle

arXiv 6 Feb 2023 · Econometrics · publishedJournal of Business and Economic Statistics (2024) · 2 citations (OpenAlex)

arXiv:2302.02747 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Quantile forecasts made across multiple horizons have become an important output of many financial institutions, central banks and international organisations. This paper proposes misspecification tests for such quantile forecasts that assess optimality over a set of multiple forecast horizons and/or quantiles. The tests build on multiple Mincer-Zarnowitz quantile regressions cast in a moment equality framework. Our main test is for the null hypothesis of autocalibration, a concept which assesses optimality with respect to the information contained in the forecasts themselves. We provide an extension that allows to test for optimality with respect to larger information sets and a multivariate extension. Importantly, our tests do not just inform about general violations of optimality, but may also provide useful insights into specific forms of sub-optimality. A simulation study investigates the finite sample performance of our tests, and two empirical applications to financial returns and U.S. macroeconomic series illustrate that our tests can yield interesting insights into quantile forecast sub-optimality and its causes.

Citation extraction

63
references
108
in-text mentions
63
distinct cited
2
self-citations
11,988
main-text words

appendix boundary found by appendix_command · 48% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Adrian, T., N. Boyarchenko, and D. Giannone (2019) Vulnerable growth0.87452100%
2Gaglianone, W. P., L. R. Lima, O. Linton, and D. R. Smith (2011) Evaluating Value-at-Risk Models via Quantile Regression0.8434375%
3Christoffersen, P. F (1998) Evaluating interval forecasts0.8434375%
4Engle, R. F. and S. Manganelli (2004) CAViaR: Conditional autoregressive value at risk by regression quantiles0.7373367%
5Manzan, S (2015) Forecasting the distribution of economic variables in a data-rich environment0.73732100%
6Patton, A. and A. Timmermann (2012) Forecast rationality tests based on multi-horizon bounds0.6443267%
7Corradi, V., J. Fosten, and D. Gutknecht (2023) Conditional Quantile Coverage: an Application to Growth-at-Risk0.64422100%
8Tsyplakov, A (2013) Evaluation of probabilistic forecasts: proper scoring rules and moments0.64422100%
9Gneiting, T. and R. Ranjan (2013) Combining predictive distributions0.64422100%
10Pascual, L., J. Romo, and E. Ruiz (2006) Bootstrap prediction for returns and volatilities in GARCH models0.64422100%

Showing the top 10 of 63 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Statistical Inference for Score Decompositions0.40511