EconBase
← All papers

Boosting High Dimensional Predictive Regressions with Time Varying Parameters

Kashif Yousuf, Serena Ng

arXiv 7 Oct 2019 · Econometrics · publishedJournal of Econometrics (2020) · 6 citations (OpenAlex)

arXiv:1910.03109 · PDF · DOI · OpenAlex · Extracted main text

Abstract

High dimensional predictive regressions are useful in wide range of applications. However, the theory is mainly developed assuming that the model is stationary with time invariant parameters. This is at odds with the prevalent evidence for parameter instability in economic time series, but theories for parameter instability are mainly developed for models with a small number of covariates. In this paper, we present two $L_2$ boosting algorithms for estimating high dimensional models in which the coefficients are modeled as functions evolving smoothly over time and the predictors are locally stationary. The first method uses componentwise local constant estimators as base learner, while the second relies on componentwise local linear estimators. We establish consistency of both methods, and address the practical issues of choosing the bandwidth for the base learners and the number of boosting iterations. In an extensive application to macroeconomic forecasting with many potential predictors, we find that the benefits to modeling time variation are substantial and they increase with the forecast horizon. Furthermore, the timing of the benefits suggests that the Great Moderation is associated with substantial instability in the conditional mean of various economic series.

Citation extraction

92
references
158
in-text mentions
92
distinct cited
6
self-citations
15,146
main-text words

appendix boundary found by appendix_titled_section at “Appendix: Proofs” · 59% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Cai, Z (2007) Trending time-varying coefficient time series models with serially correlated errors1.00064100%
2Stock, J. H. and Watson, M. W (1996) Evidence on structural instability in macroeconomic time series relations1.00053100%
3Robinson, P. M (1989) Nonparametric estimation of time-varying parameters0.92843100%
4Dahlhaus, R., Richter, S., and Wu, W. B (2018) Towards a general theory for non-linear locally stationary processes0.8749367%
5Lutz, R. W. and Bühlmann, P (2006) Boosting for high-multivariate responses in high-dimensional linear regression0.81142100%
6Buhlmann, P (2006) Boosting for high-dimensional linear models0.73710540%
7Ding, X., Qiu, Z., Chen, X., et al (2017) Sparse transition matrix estimation for high-dimensional and locally stationary vector autoregressive models0.73732100%
8Friedman, J. H (2001) Greedy function approximation: a gradient boosting machine0.73732100%
9Stock, J. H. and Watson, M (2009) Forecasting in dynamic factor models subject to structural instability0.73732100%
10Wu, W. B (2005) Nonlinear system theory: Another look at dependence0.6444250%

Showing the top 10 of 92 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1How is Machine Learning Useful for Macroeconomic Forecasting?0.40511
2The boosted HP filter is more general than you might think0.40511
3On LASSO for High Dimensional Predictive Regression0.40511
4High Dimensional Time Series Regression Models: Applications to Statistical Learning Methods0.40511
5Variable Selection in High Dimensional Linear Regressions with Parameter Instability0.40511