EconBase
← All papers

Bayesian Shrinkage in High-Dimensional VAR Models: A Comparative Study

Harrison Katz, Robert E. Weiss

arXiv 7 Apr 2025 · Statistics — Methodology

arXiv:2504.05489 · PDF · Extracted main text

Abstract

High-dimensional vector autoregressive (VAR) models offer a versatile framework for multivariate time series analysis, yet face critical challenges from over-parameterization and uncertain lag order. In this paper, we systematically compare three Bayesian shrinkage priors (horseshoe, lasso, and normal) and two frequentist regularization approaches (ridge and nonparametric shrinkage) under three carefully crafted simulation scenarios. These scenarios encompass (i) overfitting in a low-dimensional setting, (ii) sparse high-dimensional processes, and (iii) a combined scenario where both large dimension and overfitting complicate inference. We evaluate each method in quality of parameter estimation (root mean squared error, coverage, and interval length) and out-of-sample forecasting (one-step-ahead forecast RMSE). Our findings show that local-global Bayesian methods, particularly the horseshoe, dominate in maintaining accurate coverage and minimizing parameter error, even when the model is heavily over-parameterized. Frequentist ridge often yields competitive point forecasts but underestimates uncertainty, leading to sub-nominal coverage. A real-data application using macroeconomic variables from Canada illustrates how these methods perform in practice, reinforcing the advantages of local-global priors in stabilizing inference when dimension or lag order is inflated.

Citation extraction

53
references
59
in-text mentions
53
distinct cited
2
self-citations
6,618
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Carvalho, Carlos M and Polson, Nicholas G and Scott, James G (2010) The Horseshoe Estimator for Sparse Signals0.64422100%
2Trevor Park and George Casella (2008) The Bayesian Lasso0.64422100%
3Makalic, Enes and Schmidt, Daniel F (2016) A Simple Sampler for the Horseshoe Estimator0.64422100%
4Huber, Florian and Koop, Gary (2023) Subspace Shrinkage in Conjugate Bayesian Vector Autoregressions0.51121100%
5Zhou, Xiaodan and Chan, Joshua CC (2023) Factor-augmented high-dimensional VARs with structured priors: New perspectives for macroeconomic forecasting0.51121100%
6Stock, James H and Watson, Mark W (2002) Macroeconomic Forecasting Using Diffusion Indexes0.51121100%
7Aprigliano, Valentina (2020) A large Bayesian VAR with a block-specific shrinkage: A forecasting application for Italian industrial production0.40511100%
8Bańbura, Marta and Giannone, Domenico and Lenza, Michele (2010) Large Bayesian vector auto regressions0.40511100%
9Barigozzi, Matteo and Cho, Haeran and Owens, Dom (2024) FNETS: Factor-Adjusted Network Estimation and Forecasting for High-Dimensional Time Series0.40511100%
10Basu, Sumanta and Shojaie, Ali and Michailidis, George (2019) Low Dimensional Representations for High Dimensional Vector Autoregressions with Structured Penalties0.40511100%

Showing the top 10 of 53 scored citations.