EconBase
← All papers

Forecasting with Neuro-Dynamic Programming

Pedro Afonso Fernandes

arXiv 4 Apr 2024 · Econometrics

arXiv:2404.03737 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Economic forecasting is concerned with the estimation of some variable like gross domestic product (GDP) in the next period given a set of variables that describes the current situation or state of the economy, including industrial production, retail trade turnover or economic confidence. Neuro-dynamic programming (NDP) provides tools to deal with forecasting and other sequential problems with such high-dimensional states spaces. Whereas conventional forecasting methods penalises the difference (or loss) between predicted and actual outcomes, NDP favours the difference between temporally successive predictions, following an interactive and trial-and-error approach. Past data provides a guidance to train the models, but in a different way from ordinary least squares (OLS) and other supervised learning methods, signalling the adjustment costs between sequential states. We found that it is possible to train a GDP forecasting model with data concerned with other countries that performs better than models trained with past data from the tested country (Portugal). In addition, we found that non-linear architectures to approximate the value function of a sequential problem, namely, neural networks can perform better than a simple linear architecture, lowering the out-of-sample mean absolute forecast error (MAE) by 32% from an OLS model.

Citation extraction

30
references
55
in-text mentions
30
distinct cited
0
self-citations
4,175
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1D. P. Bertsekas and J. N. Tsitsiklis (1996) Neuro-Dynamic Programming1.00083100%
2D. P. Bertsekas (2011) Approximate Dynamic Programming (online chapter)1.00053100%
3L. Ljungqvist and T. J. Sargent (2018) Recursive Macroeconomic Theory0.92843100%
4R. E. Bellman and S. E. Dreyfus (1962) Applied Dynamic Programming0.84333100%
5R. S. Sutton and A. G. Barto (2018) Reinforcement Learning: An Introduction0.84333100%
6C. Szepesvári (2010) Algorithms for Reinforcement Learning0.73732100%
7R. E. Lucas and E. C. Prescott (1971) Investment under Uncertainty0.64422100%
8S. Mannor, D. Simester, P. Sun, and J. N. Tsitsiklis (2007) Bias and Variance Approximation in Value Function Estimates0.64422100%
9D. Silver, T. Hubert, J. Schrittwieser, I. Antonoglou, M. Lai, A. Gu… Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithm0.64422100%
10R. S. Sutton (1988) Learning to predict by the methods of temporal differences0.64422100%

Showing the top 10 of 30 scored citations.