EconBase
← All papers

Forecasting Across Time Series Databases using Recurrent Neural Networks on Groups of Similar Series: A Clustering Approach

Kasun Bandara, Christoph Bergmeir, Slawek Smyl

arXiv 9 Oct 2017 · Machine Learning · publishedExpert Systems with Applications (2019) · 29 citations (OpenAlex)

arXiv:1710.03222 · PDF · DOI · OpenAlex · Extracted main text

Abstract

With the advent of Big Data, nowadays in many applications databases containing large quantities of similar time series are available. Forecasting time series in these domains with traditional univariate forecasting procedures leaves great potentials for producing accurate forecasts untapped. Recurrent neural networks (RNNs), and in particular Long Short-Term Memory (LSTM) networks, have proven recently that they are able to outperform state-of-the-art univariate time series forecasting methods in this context when trained across all available time series. However, if the time series database is heterogeneous, accuracy may degenerate, so that on the way towards fully automatic forecasting methods in this space, a notion of similarity between the time series needs to be built into the methods. To this end, we present a prediction model that can be used with different types of RNN models on subgroups of similar time series, which are identified by time series clustering techniques. We assess our proposed methodology using LSTM networks, a widely popular RNN variant. Our method achieves competitive results on benchmarking datasets under competition evaluation procedures. In particular, in terms of mean sMAPE accuracy, it consistently outperforms the baseline LSTM model and outperforms all other methods on the CIF2016 forecasting competition dataset.

Citation extraction

87
references
129
in-text mentions
87
distinct cited
4
self-citations
12,546
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Hyndman, R. J., Wang, E., Laptev, N., Nov (2015) b1.00053100%
2Crone, S. F., Hibon, M., Nikolopoulos, K (2011) Advances in forecasting with neural networks? empirical evidence from the NN3 competition on time series prediction0.87452100%
3Hornik, K., Jan (1991) Approximation capabilities of multilayer feedforward networks0.84333100%
4Zhang, G., Patuwo, B. E., Hu, M. Y (1998) Forecasting with artificial neural networks:: The state of the art0.81142100%
5Ben Taieb, S., Bontempi, G., Atiya, A., Sorjamaa, A (2011) A review and comparison of strategies for multi-step ahead time series forecasting based on the NN5 forecasting competition0.73732100%
6Rahman, M. M., Islam, M. M., Murase, K., Yao, X (2016) Layered ensemble architecture for time series forecasting0.73732100%
7St epni cka, M., Burda, M (2016) Computational intelligence in forecasting (CIF) 2016 time series forecasting competition0.73732100%
8Wallace, C. S., Dowe, D. L., Jan (2000) MML clustering of multi-state, poisson, von mises circular and gaussian distributions0.73732100%
9Yan, W (2012) Toward automatic time-series forecasting using neural networks0.73732100%
10Zimmermann, H.-G., Tietz, C., Grothmann, R (2012) Forecasting with recurrent neural networks: 12 tricks0.73732100%

Showing the top 10 of 87 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Coresets for Time Series Clustering0.40511
2Global Neural Networks and The Data Scaling Effect in Financial Time Series Forecasting0.40511
3CATS: Clustering-Aggregated and Time Series for Business Customer Purchase Intention Prediction0.40511
4Multi-Agent Reinforcement Learning for Dynamic Pricing in Supply Chains: Benchmarking Strategic Agent Behaviours under Realistically Simulated Market Conditions0.40511