EconBase
← All papers

Kullback-Leibler-based characterizations of score-driven updates

Ramon de Punder, Timo Dimitriadis, Rutger-Jan Lange

arXiv 5 Aug 2024 · Mathematics — Statistics Theory · 1 citations (OpenAlex)

arXiv:2408.02391 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Score-driven models have been applied in some 400 published articles over the last decade. Much of this literature cites the optimality result in Blasques et al. (2015), which, roughly, states that sufficiently small score-driven updates are unique in locally reducing the Kullback-Leibler divergence relative to the true density for every observation. This is at odds with other well-known optimality results; the Kalman filter, for example, is optimal in a mean-squared-error sense, but occasionally moves away from the true state. We show that score-driven updates are, similarly, not guaranteed to improve the localized Kullback-Leibler divergence at every observation. The seemingly stronger result in Blasques et al. (2015) is due to their use of an improper (localized) scoring rule. Even as a guaranteed improvement for every observation is unattainable, we prove that sufficiently small score-driven updates are unique in reducing the Kullback-Leibler divergence relative to the true density in expectation. This positive, albeit weaker, result justifies the continued use of score-driven models and places their information-theoretic properties on solid footing.

Citation extraction

33
references
156
in-text mentions
37
distinct cited
1
self-citations
15,582
main-text words

appendix boundary found by appendix_command · 42% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Creal, D., S. J. Koopman, A. Lucas, and M. Zamojski (2024) Observation-driven filtering of time-varying parameters using moment conditions0.95624688%
2Gorgi, P., C. S. Lauria, and A. Luati (2024) On the optimality of score-driven models0.95531787%
3Creal, D., S. J. Koopman, and A. Lucas (2013) Generalized autoregressive score models with applications0.87452100%
4Gasperoni, F., A. Luati, L. Paci, and E. D’Innocenzo (2023) Score-driven modeling of spatio-temporal data0.81142100%
5Blasques, F., S. J. Koopman, and A. Lucas (2015) Information-theoretic optimality of observation-driven time series models for continuous responses0.77428646%
6Diks, C., V. Panchenko, and D. J. van Dijk (2011) Likelihood-based scoring rules for comparing density forecasts in tails0.7375340%
7Lange, R.-J., B. van Os, and D. J. van Dijk (2025) Implicit score-driven filters for time-varying parameter models self0.7375340%
8Gneiting, T. and R. Ranjan (2011) Comparing density forecasts using threshold- and quantile-weighted scoring rules0.7373367%
9D’Innocenzo, E., A. Lucas, B. Schwaab, and X. Zhang (2024) Modeling extreme events: Time-varying extreme tail shape0.73732100%
10Harvey, A. C. and A. Luati (2014) Filtering with heavy tails0.73732100%

Showing the top 10 of 37 scored citations.