Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.
Structural Analysis of Vector Autoregressive Models
abstractThis set of lecture notes discuss key concepts for the Structural Analysis of Vector Autoregressive models for the teaching of a course on Applied Macroeconometrics with Advanced Topics.
small\begin{spacing}{0.9}
\end{spacing}
Introduction
This set of lecture notes are meant to discuss fundamental concepts on the mechanisms of structural vector autoregressive models with many economic theory driven examples which are drawn from several seminal studies presented in the existing literature. The particular perspective we follow permits to present several mathematical and theoretical concepts in an informal way while discussing important concepts by presenting how some long-standing problems in the applied macroeconometrics literature have been tackled. Moreover, our discussion of selected studies from the literature in the form of examples that present key aspects in the identification and estimation of SVAR models, main theoretical econometric concepts such as matrix representations and asymptotic theory convergence results; are motivated from a research-based pedagogical approach that encourages the reader to seek a comprehensive understanding of these concepts while fostering further discussions on current state-of-the art methodological approaches and debates in the literature. Note that a full treatment of these topics are presented in the "Time Series Analysis" book of hamilton1994time. Additional material can be found in the books of gourieroux1997time, lutkepohl2005new and kilian2017structural.
More specifically, stock2001vector describe the key job tasks of applied macro-econometricians, which shall also serve as the main learning objectives motivating the preparation of this set of lecture notes. There are summarized as below:
itemize• To be able to describe/summarize and infer about the presence of stochastic trends, cointegration dynamics, unit root behaviour as well as structural breaks in macroeconomic time series.
• To be able to recover the structure of the macroeconomy based on data and theoretical-driven questions using structural analysis (i.e., identification of structural shocks) as well as impulse response analysis and construction of related test statistics and confidence intervals.
• To be able to make forecasts on key macroeconomic variables based on appropriate forecasting schemes and formulations of VAR and SVAR models.
• To be able to advise macroeconomic policy-makers (e.g., using counterfactual analysis and related methods).
Vector Autoregressive models are a popular econometric tool for estimating the dynamic interaction between the variables included in the system. Moreover, several test statistics are constructed using VAR models such that: Wald tests for Granger Causality, impulse response functions (IRFs) and forecast error variance decomposition (FEVDs). Therefore, inference on these statistics is typically based on either on first-order asymptotic approximations or on bootstrap methods. However, the deviation from i.i.d innovations as in the case of conditional heteroscedasticity, invalidates a number of standard inference procedures such that the application of these methods may lead to conclusions that are not in line with the true underlying dynamics. Consequently, in many VAR applications there is need for inference methods that are valid when innovations are only serially correlated but not independent. Nevertheless, the VAR representation of the economy is suitable for estimation/testing as well as forecasting purposes but is not adequate for policy analysis which is the purpose of this course (thus, our interest in SVARs).
The Identification Problem
Roughly speaking, the identification problem of structural parameters in linear simultaneous equations models are closely related\footnote{The notion of coefficient restrictions was originally extended to show the equivalence relationship between identifiability and instrumental variables estimation, that is, the restrictions required for identification give rise to instrumental variables required for estimation.}. Seminal papers discussing the identification problem include among others sargan1983identification and dufour2003identification. According to hausman1983identification, necessary and sufficient conditions for identification with linear coefficient and covariance restrictions are developed in a limited information context. In particular, imposing covariance restrictions facilitate identification iff they imply that a set of endogenous variables is predetermined in the equation of interest - which generalizes the notion of recursiveness for structural learning and causal recovery. Under full information, covariance restrictions imply that residuals from other equations are predetermined in a particular equation, and, under certain conditions, can facilitate system identification. This implies that in the general case, FIML first order conditions show that if a system of equations is identifiable as a whole, covariance restrictions cause residuals to behave as instruments.
Furthermore, imposing exclusion restrictions and the normalization $\beta_{ii} = 1$, then the classical structural econometric specification for the simultaneous equation model $\boldsymbol{Y} \boldsymbol{B}^{\prime} + \boldsymbol{Z} \boldsymbol{\Gamma}^{\prime} = \boldsymbol{U}$, where the vector $\boldsymbol{y}_i$, for $i \in \left\{ 1,..., G \right\}$, includes $G$ jointly dependent random variables. A key result for system identification purposes is the fact that the relative triangularity of equations $(i,j)$ is precisely equivalent to a zero in the $(i,j)-$th position of $\boldsymbol{B}^{-1}$, denoted as $\boldsymbol{B}^{-1}_{ij}$. As a result, equations $(i,j)$ are relatively recursive if and only if there are no paths by which a shock to $\boldsymbol{u}_j$ can be transmitted to $\boldsymbol{y}_i$.
lemmaZero restrictions on $( \boldsymbol{B}, \boldsymbol{\Sigma}_1 )$ are sufficient for identification if and only if they induced the equivalence relation:
\begin{align}
\boldsymbol{\Psi} \boldsymbol{B}^{-1} \boldsymbol{\Sigma}_1^{\prime} = \boldsymbol{0}
\end{align}
for some selection matrix $\boldsymbol{\Psi}$.
corollaryIf $\boldsymbol{y}_i$ is predetermined in the first equation, then every endogenous variable in the $i-$th structural equation $( \boldsymbol{y}_j )$ for which $\sigma_{j1} = 0$ is predetermined in the first structural equation.
remarkNotice that in the case of a diagonal disturbance covariance matrix, an endogenous variable is predetermined in the first equation implying a special structure. In particular, if $\boldsymbol{y}_i$ is predetermined in the first equation, every endogenous variable in the $i-$th equation is also predetermined in the first equation. Consequently, every endogenous variable in their respective equations is predetermined in the first equation. In other words, in the case of a diagonal variance matrix $\boldsymbol{\Sigma}$, a relatively recursive situation is one in which a set of endogeneous variables determines itself independently from the first equation variable, and thus all elements of the set are predetermined in the first equation.
Next, we consider the equivalence between instrumental variables and covariance restrictions.
lemma[Rank]
The parameters of the first structural equation are identifiable if and only if the 2SLS estimator is well-defined, using $\boldsymbol{W}$ as the matrix of instruments.
proofIn particular, asymptotically we have that
\begin{align}
\underset{ T \to \infty }{ \mathsf{plim} } \frac{1}{T} \boldsymbol{W}^{\prime} \boldsymbol{V}_1 =
\begin{bmatrix}
\underset{ T \to \infty }{ \mathsf{plim} } \frac{1}{T} \boldsymbol{\Psi} \boldsymbol{Y}^{\prime} \boldsymbol{V}_1
\\
\underset{ T \to \infty }{ \mathsf{plim} } \frac{1}{T} \boldsymbol{Z}^{\prime} \boldsymbol{V}_1
\end{bmatrix}
=
\begin{bmatrix}
\boldsymbol{\Psi} \boldsymbol{\Omega}_1
\\
\boldsymbol{0}
\end{bmatrix}
\end{align}
where $\boldsymbol{V}_1$ is the reduced form disturbance corresponding to $\boldsymbol{Y}_1$. This implies that,
\begin{align}
\boldsymbol{Y}_1 = \boldsymbol{Z}_1 \boldsymbol{\Pi}_{11}^{\prime} + \boldsymbol{Z}_2 \boldsymbol{\Pi}_{12}^{\prime} + \boldsymbol{V}_1.
\end{align}
Notice that rank conditions for identification are commonly used as identifying conditions for static and dynamic factor models as well as cointegrating regression models (e.g., VECM forms).
A well-known problem to the literature of structural VAR models is that imposing the assumption of Gaussian errors renders non-identifiable structural parameters due to the nonlinearities and complex dependence structure of the system. Additional identifying restrictions are needed to ensure robust identification and estimation of SVARs. Based on these concerns, the framework of lanne2017identification shows that in practice the Gaussian case is an exception in that a SVAR model whose error vector consists of independent non-Gaussian components is, without any additional restrictions, identified and leads to essentially unique responses. The identification scheme employs the non-Gaussianity of structural shocks while an MLE estimator for the parameters of the non-Gaussian SVAR model is consistent and asymptotically normally distributed. Moreover, the scheme allows to impose additional identifying restrictions which can be formulated into testable hypotheses. Further extensions of the non-Gaussian identification strategy includes cases such as when the system includes only strictly positive components (see, nyberg2022structural), cases when a GMM estimation approach is employed (see, lanne2021gmm and keweloh2021generalized) as well as specific cases when structural shocks are leptokurtic (e.g. see lanne2023identifying) or heavy-tailed (e.g., see anttonen2023statistically).
Furthermore, while the reduced-form VAR model can be seen as a convenient description of the joint dynamics of a number of time series that facilitates forecasting, the SVAR model is more appropriate for answering economic questions of theoretical and practical interest. The main tools in analyzing the dynamics in SVAR models are the impulse response function and the forecast error variance decomposition. Moreover, usually when fitting a SVAR model, the joint distribution of the error terms is almost always (either explicitly or implicitly) assumed to follow a multivariate Gaussian distribution which might render the system non-identifiable especially under the presence of non-linearities, higher-order dynamics and heavy-tails. The positive news is that the joint distribution of the reduced-form errors is fully determined by their covariances only but this which implies that the structural errors of the system cannot be identified unless we impose additional linear restrictions (see, lanne2017identification). However the use of suitable orthogonal transformations or even permutations (due to being exchangeable random variables), can be shown to induce observationally equivalent SVAR processes.
Furthermore, we discuss some key identification strategies in the following sections. Generally, speaking understanding all the available tools in our disposal is important when considering relevant empirical and theoretical driven questions in relation to the impact of structural shocks on economic outcomes. Therefore, in this set of lecture notes we present some key concepts and recent developments in the literature with focus on the implementation of econometric and statistical tools for the identification and estimation of structural vector autoregressive models, (SVAR). In particular, we discuss several different approaches that are commonly employed for the structural identification of these interdependent systems in relation to economic phenomena such as business cycle fluctuations and macroeconomic conditions in order to obtain policy recommendations. On the other hand, exogenous variation to macroeconomic conditions such as the adverse effect of climate change across interconnected economies requires novel econometric methods to ensure robust identification and estimation\footnote{In particular, the omission of such an important component as the climate when considering the structural analysis of time series models could lead to non-causality, leading to inaccurate model estimates and forecasts (see, lutkepohl1982non). Further properties on Noncausal vector AR processes are presented by davis2020noncausal.} (e.g., see pesaran2000structural).
The stability of cointegrated VAR processes can be assessed with respect to the long-run relations as well as with respect to the short-run parameters. Usually the long-run equilibrium relations are based on economic theory and so we expect them to be relatively more stable after a perturbation of structural shocks (such as a change in the monetary policy framework), than the short-run coefficients which are data-driven. Consider for example the study of the transmission of monetrary policy shocks to macroeconomic variables using structural cointegrated VAR models. Roughly speaking the identification of SVAR models is achieved by imposing restrictions on the covariance matrix of the residuals of a reduced-form VAR to provide an economic interpretation of shocks while a structural cointegrated VAR model is identified by imposing restrictions on the cointegrating space. Consequently, based on a structural identification scheme of the covariance matrix then metrics such as impulse-responses, variance-decompositions and historical decompositions can be constructed.
In particular, rubio2010structural verifies the identification for linear Gaussian models by checking whether two parameter points are observetionally equivalent iff they have the same reduced-form representation. Moreover, a global identification can be verified by checking whether the model is identified at different points in the parameter space prior to the estimation step. On the other hand, a well-know fact in the literature of nonstationary autoregressive models, asymptotic distribution discontinuities arise in the case when the parameter is at the boundaries of the parameter space.
definitionConsider a $\mathsf{SVAR(p)}$ process with restrictions imposed by $R$. Then, the $\mathsf{SVAR(p)}$ is exactly identified $\textit{iff}$, for almost any reduced-form parameter point $( \boldsymbol{B}, \boldsymbol{\Sigma} )$, there exists a unique structural parameter point $( \boldsymbol{A}_0, \boldsymbol{A}_{+} ) \in \mathbb{R}$ such that $g ( \boldsymbol{A}_0, \boldsymbol{A}_{+} ) = ( \boldsymbol{B}, \boldsymbol{\Sigma} )$.
Following rubio2010structural
align[align omitted — 237 chars of source]
Generally, it is well-known that identification in parametric models implies that a specific model structure is identifiable if there is no other structure which is observationally equivalent (see, also sargent1976observational). For instance, the identification scheme proposed by lanne2017identification requires the construction of observationally equivalent SVAR processes when comparing two $MA(\infty)$ representations of the model. In conjecture with conventional rank conditions that ensure the valid identification of SVAR models under non-Gaussianity the identification of structural parameters can be extended into more complex model configurations regardless of the presence of nonlinear or nonstationary dynamics.
More specifically, the main intuition of the identification methodology of rubio2010structural, is to establish general rank conditions for global identification of identified and exactly identified models. Moreover, bognanni2018class highlights that the key conceptual properties which ensure SVAR tractability include: $\textit{(i)}$ observational equivalence of points $( \boldsymbol{A}, \boldsymbol{F} )$ and $( \boldsymbol{A Q}, \boldsymbol{F Q} )$ for $\boldsymbol{Q} \in \mathcal{O}_n$ in the structural model, and $\textit{(ii)}$ the ability to reparametrize the structural model from $( \boldsymbol{A}, \boldsymbol{F} )$ to $( \boldsymbol{B}, \boldsymbol{H}, \boldsymbol{Q} )$ and separate identifiable elements $( \boldsymbol{B}, \boldsymbol{H} )$ and non-identifiable elements $\boldsymbol{Q}$. Thus, the above definitions imply the existence of a unique mapping of reduced-form parameters which is invariant to scaling and reordering.
Another issue discussed by forni2014sufficient is the presence of sufficient information to ensure that the conditions of existence and uniqueness are ensure for identification purposes. Specifically forni2014sufficient present necessary and sufficient conditions under which a VAR contains sufficient information to estimate the structural shocks. Based on this theoretical result the authors propose a test statistic for detecting information deficiency and a procedure to amend a deficient VAR model. A relevant example is the bivariate VAR with unemployment and labour productivity which is found to be informentionally deficient. The building block of this framework is a representation of the economy where $q$ mutually orthogonal structural shocks affect macro variables through square-summable impulse-response functions (see, also kocikecki2018global, kocikecki2023solution).
assumption[MA representation]
The $n-$dimensional vector $x_t$ of stationary series satisfies
\begin{align}
\boldsymbol{x}_t = \boldsymbol{F}(L) \boldsymbol{u}_t, \ \ \ \boldsymbol{F}(L) := \sum_{j=0}^{ \infty } \boldsymbol{F}_j L^j,
\end{align}
where $\boldsymbol{u}_t$ is a $q-$dimensional white noise vector of structural macroeconomic shocks and $\boldsymbol{F}(L)$ is an $( n \times q)$ matrix of square-summable linear filters in the non-negative powers of the lag operator $L$. The above formulation also corresponds o the steady-state equilibrium of a DSGE model.
assumption[Information Set]
We shall say that the information set $\mathcal{X}_t^{*}$ is given by the closed linear space spanned by present and past values of the variables in $x^{*}_t$, where
\begin{align}
\boldsymbol{x}_t^{*} = \boldsymbol{x}_t + \boldsymbol{\xi}_t \equiv \boldsymbol{F}(L) \boldsymbol{u}_t + \boldsymbol{\xi}_t,
\end{align}
In practice the number of observable variables $n$ is very large, so that the econometrician needs to reduce it in order to estimate a VAR. The VAR information set is then spanned by an $s-$dimensional sub-vector of $\boldsymbol{x}_t^{*}$, or, more generally, an $s-$dimensional linear combination of $\boldsymbol{x}_t^{*}$, say $\boldsymbol{z}_t^{*} = \boldsymbol{C} \boldsymbol{x}_t^{*}$.
Linear Vector Autoregressions
exampleConsider the model $\boldsymbol{y}_t = \boldsymbol{A} \boldsymbol{y}_{t-1} + \boldsymbol{e}_t$, which implies that (see, lai1982least)
\begin{align}
\boldsymbol{y}_t &= \boldsymbol{A}^n \boldsymbol{y}_0 + \sum_{j=1}^n \boldsymbol{A}^{n-j} \boldsymbol{e}_j, \ \ \ t = 1,...,n.
\\
\boldsymbol{A} &=
\begin{pmatrix}
\alpha_1 & \hdots & \alpha_{k-1} & \alpha_k
\\
& \boldsymbol{I}_{ k-1} & & \boldsymbol{0}
\end{pmatrix}
\end{align}
which is equivalent to the matrix coefficient of a $\mathsf{VAR}(1)$ process. Moreover, expressing the matrix $\boldsymbol{A}$ into its Jordan form we obtain $\boldsymbol{A} = \boldsymbol{C} \boldsymbol{D} \boldsymbol{C}^{-1}$, where $\boldsymbol{D} = \mathsf{diag} \left\{ \boldsymbol{D}_1,..., \boldsymbol{D}_q \right\}$
\begin{align}
\boldsymbol{D}_j =
\begin{pmatrix}
z_j & 1 & 0 & \hdots & 0
\\
0 & z_j & 1 & \hdots & 0
\\
\vdots & \vdots & \ddots & \ddots & 0
\\
0 & 0 & \hdots & \hdots & z_j
\end{pmatrix}_{ ( m_j \times m_j ) }
\end{align}
with $z_j$ being the root of $\varphi (z)$ with multiplicity $m_j$ and $\boldsymbol{C}$ a nonsingular matrix. Moreover, let $M = \mathsf{max}_{j} m_j$, then it holds that
\begin{align}
\left\lVert \boldsymbol{A}^n \right\rVert = \left\lVert \boldsymbol{C} \boldsymbol{D}^n \boldsymbol{C}^{-1} \right\rVert \leq \left\lVert \boldsymbol{C} \right\rVert \left\lVert \boldsymbol{C}^{-1} \right\rVert \sum_{j=1}^q \left\lVert \boldsymbol{D}_j^n \right\rVert = \mathcal{O} ( n^{M-1} ).
\end{align}
In particular, when the roots of the characteristic polynomial lie strictly inside the unit circle, then with the independent white noise $\boldsymbol{e}_t$, the system is stable. Moreover, by allowing the roots of the characteristic polynomial to lie on the unit circle, we can formulate unstable but non-explosive systems related to the ARIMA models. Notice the analysis of time series regression models includes unit-roots and partially nonstationary (cointegrated) models.
Cointegration and Vector Autoregressive Processes
Integration Order
An important property of $I(1)$ variables is that there can be linear combinations of these variables that are $I(0)$. If this is so then these variables are said to be cointegrated. Notice that econometric cointegration analysis can be used to overcome difficulties associated with stochastic trends in time series and applied to test whether there exist combinations of non-stationary series that are themselfs stationary.
definitionSuppose that $y_t$ is $I(1)$. Then $y_t$ is cointegrated if there exists an $N \times r$ matrix $\beta$, of full column rank and where $0 < r < N$, such that the $r$ linear combinations, $\beta^{\prime} y_t = u_t$, are $I(0)$. We say that the dimension $r$ is the cointegration rank and the columns of $\beta$ are the cointegrating vectors.
itemize• Testing for cointegrating relations that economic theory predicts should exist, implies that the null hypothesis of noncointegration is not rejected. However, under the presence of breaks there is a need for implementing tests of the null hypothesis of non-cointegration, against alternatives allowing cointegrating relations subject to breaks.
• Relevant asymptotic theory results on the efficient estimation of the parameter path in unstable time series models can be found in the study of muller2010efficient. Further issues include the use of exogenous regressors (e.g., see pesaran2000structural) in VECM representations.
Cointegrated Vector Autoregressive Models
A VAR has several equivalent representations that are valuable for understanding the interactions between exogeneity, cointegration and economic policy analysis. To start, the levels form of the $s-$th order Gaussian VAR for $x$ is
align[align omitted — 131 chars of source]
where $K$ is an $N \times N_0$ matrix of coefficients of the $N_0$ deterministic variables $q_t$. Suppose that we have a vector $Y_t = \left[ y_{1t}, y_{2t},..., y_{nt} \right]^{\prime}$ that does not satisfy the conditions for stationarity. One way to achieve stationarity might be to model $\Delta y_t$, rather than $y_t$ itself. However, differencing can discard important information about the equilibrium relationships between the variables. This is because another way to achieve stationarity can be through linear combinations of the levels of the variables. Thus, if such linear combinations exist then we have cointegration and the variables are said to be cointegrated. The notion of Cointegration has some important implications: (i) It implies a set of dynamic long-run equilibria between the variables, (ii) Estimates of the cointegrating relationships are super-consistent, they converge at rate $T$ rather than $\sqrt{T}$, and (iii) Modelling cointegrated variables allows for separate short-run and long-run dynamic responses. Further details on Vector Autoregression and Cointegration can be found in the corresponding Chapter of watson1994vector.
exampleLet $\boldsymbol{x}_t$ be an $I(1)$ vector of $n$ components, each with possibly deterministic trend in mean. Suppose that the system can be written as a finite-order vector autoregression:
\begin{align}
\boldsymbol{x}_t = \boldsymbol{\mu} + \boldsymbol{\pi}_1 \boldsymbol{x}_{t-1} + \boldsymbol{\pi}_2 \boldsymbol{x}_{t-2} + ... + \boldsymbol{\pi}_k \boldsymbol{x}_{t-k} + \boldsymbol{\varepsilon}_t, \ \ \ t = 1,..., T
\end{align}
Then, the model can be re-written in error-correction form as below
\begin{align*}
\Delta \boldsymbol{x}_t
=
\boldsymbol{\mu} + \boldsymbol{\Gamma}_1 \Delta \boldsymbol{x}_{t-1} + \boldsymbol{\Gamma}_2 \Delta \boldsymbol{x}_{t-2} + ... + \boldsymbol{\Gamma}_{k-1} \Delta \boldsymbol{x}_{t-k+1} + \boldsymbol{\pi} \boldsymbol{x}_{t-k} + \boldsymbol{\varepsilon}_t
\equiv
\boldsymbol{\mu} + \sum_{i=1}^{k-1} \boldsymbol{\Gamma}_i (1 - L) L^i \boldsymbol{x}_i + \boldsymbol{\pi} \boldsymbol{x}_{t-k} + \boldsymbol{\varepsilon}_t
\end{align*}
Therefore, we get the following system equation representation $\boldsymbol{\pi} (L) \boldsymbol{x}_t = \boldsymbol{\mu} + \boldsymbol{\varepsilon}_t$, $t = 1,...,T$, where $
\boldsymbol{\pi} (L) = (1 - L) \boldsymbol{I}_n - \sum_{i=1}^{k-1} \boldsymbol{\Gamma}_i (1-L) L^i - \boldsymbol{\pi} L^k,$ and $
\boldsymbol{\Gamma}_i = - \boldsymbol{I}_n + \boldsymbol{\pi}_1 + \boldsymbol{\pi}_2 + ... + \boldsymbol{\pi}_i$, for $i = 1,...,k$.
remarkWithin a cointegrated analysis context, it has been proved to be advantageous for both theoretical and practical purposes to separate the long-run behaviour of the system from the more transient dynamics by using the error correction form of the model which is useful when measuring the impact of structural shocks to economic outcomes such as monetary policy, fiscal policy and macro aggregates. Thus when employing vector autoregressions to model the comovements of macroeconomic aggregates time series stationarity is assumed (e.g., by using a first-difference transformations). Moreover, cointegration dynamics can be correctly specified using a Cointegrated VAR representation. Our main interest is the structural analysis of VAR models under time series stationarity as we explain below.
exampleConsider the following data generating process as below
\begin{align}
\Delta X_t = \alpha \beta^{\prime} X_{t-1} + \sum_{i=1}^{k-1} \Gamma_i \Delta X_{t-i} + \varepsilon_t, \ \ \ for \ t = 1,...,T,
\end{align}
where $\left\{ \varepsilon_t \right\}$ is i.i.d with mean zero and full-rank covariance matrix $\Omega$, and where the initial values $X_{1-k},..., X_0$ are fixed. We are interested in the null hypothesis $H_0: \beta = \beta_0$. Thus, when $\beta$ is a known $(p \times r)$ matrix of full column rank $\beta_0$, the subspace spanned by $\beta$ and $\beta_0$ are identical.
example[Wage formation with Cointegrated VAR, see petursson2001wage]
A Gaussian VAR$(k)$ model is used can be rewritten in the usual error correction form in terms of stationary variables
\begin{align}
\Delta x_t = \sum_{j=1}^{ k-1} \Gamma_j \Delta x_{t-j} + \alpha \beta^{\top} x_{t-1} + \Phi \Delta + \varepsilon_t, \ \ \ t = 1,..., T
\end{align}
Using the cointegrated VAR model we can characterize the cointegrating relations based on a model of wage bargaining between trade unions and firms. Thus the economic theory implies that: (i) the marginal productivity condition for labour (downward sloping demand curve of firms product), and (ii) real wage relation derived from the bargaining between trade unions and firms over wage. In other words, two stationary combinations of the non-stationary data exist and that these can be identified based on the prior knowledge of these two economic relations. The associated imposed parameter restrictions are not rejected by the data and simplified analysis is achieved via the partial VAR formulation which corresponds to the conditional system for $\Delta x_{1t}$ given the past and $\Delta x_{2t}$.
remarkLet $\alpha$ and $\beta$ be defined as below
$
\beta =
\begin{pmatrix}
I_r & 0
\\
- \beta_2 & I_{k-r}
\end{pmatrix}
\ \ \ \text{and}
\ \ \
\alpha =
\begin{pmatrix}
\alpha_{11} & \alpha_{12}
\\
0 & \alpha_{2}
\end{pmatrix}
$, then the cointegration matrix becomes as below
\begin{align}
\Pi = \beta \alpha
\begin{pmatrix}
\alpha_{11} & \alpha_{12}
\\
- \beta_2 \alpha_{11} & - \beta_2 \alpha_{12} + \alpha_{22}
\end{pmatrix},
\end{align}
where all the above parameter coefficients are unrestricted. Moreover, according to kleibergen1994shape the behaviour of the likelihood is due to the nonidentifiedness of certain parameters, which occurs when the model is a difference stationary one. In other words, flat priors are informative in cointegration models because difference stationary models are infinitely favoured.
exampleImposing long-run restrictions is a commonly used approach for the identification of structural shocks. However, usually identification assumptions for cointegrating vectors can be complicated, however following the approach of zha1999block, which applies block recursive assumptions to the structural VECM with long-run restrictions. The block recursive system (see, also keweloh2023monetary) is well developed in structural VAR and VECM models with short-run restrictions but not so developed in the structural VECM with long-run restrictions (see, hecq2000permanent).
Consider the structural VAR model as below
\begin{align*}
B(L) x_t = \mu + u_t, \ \ B(L) = B_0 - \sum_{j=1}^p B_j L^j
\end{align*}
where $u_t$ is a vector of structural disturbances and $x_t$ is an $n-$dimensional parameter of interest. Moreover, consider the structural Wold representation $\Delta x_t = \delta + \Gamma(L) u_t$. Then the corresponding reduced-form of the model is expressed as below
\begin{align*}
\Delta x_t = \delta + C(L) \varepsilon_t, \ \ \ \varepsilon_t = \Gamma_0 u_t \ \ where \ \ \Gamma (L) = \left( \Gamma_0 + \sum_{j=1}^{\infty} \Gamma_j L^j \right) \ and \ C(L) = \Gamma (L) \Gamma_0^{-1}.
\end{align*}
Suppose that $x_t$ is a vector of cointegrated time series where $u_t$ is an $( n \times 1)$ vector of serially uncorrelated structural disturbances with a mean zero and a covariance matrix $\Sigma_{u}$ and $\varepsilon_t$ is an $( n \times 1)$ vector of serially uncorrelated linear forecast errors with a mean of zero and a covariance matrix $\Sigma_{\varepsilon}$.
In addition, assume that all variables are cointegrated such that there is a reduced number of common stochastic trends $( k = n - r)$ and a number of transitory components $r$. Moreover, these common trends are assumed to be generated by permanent shocks such that the vector of error terms $u_t$ is decomposed into $u_t \equiv ( u_{kt}^{\prime}, u_{rt}^{\prime} )^{\prime}$, where $u_{kt}$ is a $k-$dimensional vector of permanent shocks and $u_{rt}$ is an $r-$dimensional vector of transitory shocks.
\begin{itemize}
• Empirical evidence: The authors investigate the effects of contractionary shock to the monetary policy on economic variables in a seven-variable VECM with long-run restrictions. In particular, the permanent shocks include a shock that affects the long-run level of real exchange rates (a real-exchange-rate shock) and a US monetary policy shock that affects the long-run level of US prices. Thus a Japanese monetary policy shock can be considered as a transitory shock since the model does not include the Japanese price, while it can be considered as a permanent shock it it affects the long-run level of Japanese interest rates.
• Theoretical Evidence: When the monetary policy and exchange rates are simultaneously determined contemporaneously, then the recursive ordering assumptions are not satisfied. On the other hand, identification with long-run restrictions does not suffer from this simultaneity problem because no zero restrictions are imposed on the structural parameter $B_0$.
\end{itemize}
example[The causal effects of fiscal policy shocks, see caldara2017analytics]
More recently attention has been paid in the role of fiscal policy for stabilizing business cycles. Since empirical studies have not reached a consensus about the effects of fiscal policy on macroeconomic variables to assess the effects of fiscal policy the SVAR methodology is commonly used (see also boiciuc2015effects). The structural analysis of VARs allows to estimate the effects of fiscal policy shocks on economic activity.
Consider the structural representation of a VAR model is given by
\begin{align}
A_0 x_t = A(L) x_{t-1} + B \varepsilon_t
\end{align}
\begin{itemize}
• $A_0$ is the matrix of contemporaneous influence between the variables,
• $x_t$ is a vector of the endogenous macroeconomic variables such as government expenditures, real output, inflation, tax revenues and short-term interest rates.
• $A(L)$ is an $( n \times n)$ matrix of lag-length $L$, representing impulse-response functions of the shocks to the elements of $x_t$, and $B$ is an $( n \times n )$ matrix that captures the linear relations between the structural shocks and those in the reduced form.
\end{itemize}
To estimate the SVAR the reduced form is given by $x_t = C(L) x_{t-1} + u_t$ where $u_t = A_0^{-1} B \varepsilon_t$. The relation between structural shocks and reduced form shocks is $A_0 u_t = B \varepsilon_t$.
Recall that a $\mathsf{SVAR}(p)$ model with the following representation
\begin{align*}
y_t = \mu + A_1 y_{t-1} + A_2 y_{t-2} + ... + A_p y_{t-p} + \varepsilon_t
\end{align*}
can be written as $y_t = \big( I_n \otimes x_t^{\prime} \big) \beta + \varepsilon_t$, where $I_n$ is the identity matrix and $\beta = \mathsf{vec} \left( [ \mu, A_1, A_2,..., A_p ]^{\prime} \right)$.
exampleConsider the study of bilgili2012impact who attempts to reveal explicitly whether or not biomass consumption can mitigate carbon dioxide $( CO_2 )$ emissions. In other words, in order to correctly capture the underline features in the data (and produce unbiased and efficient estimators), a cointegrating regression specification with regime shifts (structural breaks) are essential to understand the long-run equilibrium of $CO_2$ emissions with biomass consumption as well as fossil fuel consumption. Their main findings include the presence of a statistical positive impact of fuel's consumption and a statistical negative impact of biomass consumption on $CO_2$ emissions. A climate-economic related event is a change in the policy of a Country's Energy Authority by the introduction of a policy act to introduce measures for diminishing $CO_2$ emissions (e.g., an increase in biomass consumption). In particular, this can be detected in the data by identifying (dating) the presence of a regime shift using the cointegration model with structural breaks. Furthermore, a statistical negative impact on $CO_2$ emissions (or equivalently a statistical positive impact in $CO_2$ emissions reductions), might be expected to increase/decrease through possible government incentives for research and development on biomass plants (assuming that the magnitudes of other parameters, such as population growth and growth in demand for energy, will not increase beyond the expectations) (see, also phillips2020econometric).
example[see, moon2002minimum]
Suppose that $\phi = 1$ and $\mu = 0$. Define with $y_{1,t} = C_t$ and $\boldsymbol{y}_{2t} = [ W_t, I_t ]$. According to the permanent-income model all three variables are integrated of order one $I(1)$ which implies the following cointegration regression model
\begin{align}
\begin{bmatrix}
y_{1,t}
\\
\boldsymbol{y}_{2t}
\end{bmatrix}
=
\begin{bmatrix}
\boldsymbol{A}^{\prime}
\\
\boldsymbol{I}_2
\end{bmatrix}
\boldsymbol{y}_{2t-1} + \boldsymbol{u}_t,
\end{align}
In particular, the distribution theory of estimators of the unrestricted cointegration vector $\boldsymbol{A}$ is well-developed in the literature which typically have a $T-$convergence rate. Moreover, the MLE and FM-OLS estimators of phillips1991optimal and phillips1990statistical respectively have a mixed-Gaussian limit distribution with a random covariance matrix. In addition, several studies concerning the estimation of the restricted cointegration vectors are also presented in the literature. In particular, saikkonen1995problems extends the analysis for the estimation of cointegration vectors with linear restrictions to the case in which the restriction function is nonlinear and twice differentiable. More precisely, he provides stochastic equicontinuity conditions to make the conventional Taylor approximation approach valid. Even if the income process is stationary such that $0 \leq \phi < 1$ and $\mu > 0$, both consumption and wealth are $I(1)$ processes under the optimal consumption choice. Therefore, the optimal decision rule creates restrictions between parameters that are associated with long-run relationships and parameters that control the short-run dynamics (see, also blanchard1988dynamic). Define with $
y_{1,t} = C_t$, $\boldsymbol{y}_{2,t} = [ \Delta W_t, I_t ]^{\prime}$, $x_{1,t} = W_{t-1}$, $\boldsymbol{x}_{2,t} = [ 1, I_{t-1} ]^{\prime}$, $\boldsymbol{y}_t = [ y_{1,t}$, $\boldsymbol{y}_{2,t} ]^{\prime}$, $\boldsymbol{x}_t = [ x_{1,t}, \boldsymbol{x}_{2,t} ]^{\prime}$.
Thus, the consumption model is nested in the following general specification
\begin{align}
\begin{bmatrix}
y_{1,t}
\\
\boldsymbol{y}_{2t}
\end{bmatrix}
=
\begin{bmatrix}
\boldsymbol{A}_{11}^{\prime} & \boldsymbol{A}_{21}^{\prime}
\\
0 & \boldsymbol{A}_{22}^{\prime}
\end{bmatrix}
\begin{bmatrix}
x_{1,t}
\\
\boldsymbol{x}_{2,t}
\end{bmatrix} +
\begin{bmatrix}
u_{1,t}
\\
\boldsymbol{u}_{2,t}
\end{bmatrix},
\end{align}
Define with $a_{ij} = \mathsf{vec} ( A_{ij} )$. Then the unrestricted parameter vector $a = [ a_{11}^{\prime}, a_{21}^{\prime}, a_{22}^{\prime} ]^{\prime}$ and $b = [ r, \mu, \phi ]^{\prime}$ is composed of the structural parameters. Assume that the partial sum process of $\Delta W_t$ converges to a vector Brownian motion such that
\begin{align}
\frac{1}{ \sqrt{T} } \sum_{t=1}^{ \floor{Tr} } \Delta W_t \Rightarrow \boldsymbol{B}(r) \equiv BM (\boldsymbol{\Omega}),
\end{align}
where $\boldsymbol{\Omega}$ is the long-run covariance matrix of $\Delta W_t$ defined by\footnote{Related asymptotic theory with examples can be found in katsouris2023limit who present unit-root dynamics and weak convergence arguments to a suitable topological space. Moreover, asymptotic theory results for a cointegrating predictive regression model with near units roots when modelling the term structure of interest rates is presented by lanne2000near. Notice that moon2002minimum show the consistency of the estimator using a Skorohod representation of the weakly converging objective function and derive the limit distribution of the MD estimator for smooth restriction functions. }
\begin{align}
\boldsymbol{\Omega} := \underset{ T \to \infty }{ \mathsf{lim} }\ \frac{1}{T} \mathbb{E} \left[ \left( \sum_{t=1}^T \Delta W_t \right) \left( \sum_{t=1}^T \Delta W_t \right)^{\prime} \right].
\end{align}
example[A simple climate-economic system, see pretis2021exogeneity]
Climate and economic variables are observed over time and space. Denote with $y_t = \big( y_{1t}^{\prime}, y_{2t}^{\prime} )$ denotes the relevant climate and socio-economic variables. Denote with $Y_j^i = ( y_i,..., y_j )$ for $i \leq j$, such that $Y_T^1 = (y_1,..., y_T)$. Then, the model of interest can be characterized as
\begin{align}
f_Y \left( Y_T^1 | Y_0, \theta \right) = \prod_{t=1}^T f_y \big( y_t | Y_{t-1}, \theta \big), \ \ \ \theta \in \Theta \subset \mathbb{R}^{n},
\end{align}
where $f_y \big( y_t | Y_{t-1}, \theta \big)$ denoting the sequentially-conditioned, joint-density for $y_t$, with $( n \times 1 )$ parameter vector $\theta$ lying in parameter space $\Theta$. A vector autoregression process within a cointegration framework due to the fact that economic and climate time-series are pre-dominantly non-stationary time series due to the presence of stochastic trends and structural breaks. Therefore, climate-economic systems can be well-approximated by cointegrated econometric models, although in addition we are interested to measure the weather shocks into the macro-economy (see, pretis2020econometric, pretis2021exogeneity).
exampleConsider the Energy Balance System studied by pretis2020econometric (see, also carrion2021statistical and bruns2020multicointegration), such that the law of motion is captured by the following system of differential equations
\begin{align}
C_m \frac{ d T_m }{ dt } &= - \lambda T_m + F - \gamma ( T_m - T_d )
\\
C_d \frac{ d T_d }{ dt } &= \gamma ( T_m - T_d )
\end{align}
The feedback parameter $\lambda$ is of particular interest as it determines the equilibrium response of surface temperatures $T_m$ to a change in the forcing $F$ (e.g., from increased $CO_2$ concentrations). Furthermore, focusing on a cointegration analysis which allows to examine whether there exists a combinations of time-series that are themselves stationary, it can be shown that the system of differential equations of the two-component EBM is equivalent to a cointegrated systen with restrictions on the parameters. Thus, a climate-economic system is formulated as a cointegrated vector-autoregression, where the regressand is decomposed into two variables, that is, $y_t = (e_t, c_t)$, such that $e_t$ represents a univariate economic variable and $c_t$ represents a univariate climate variable.
\begin{align}
y_t &= \sum_{j=1}^s A_j y_{t-j} + \mu + \varepsilon_t, \ \ \ \varepsilon_t \sim \mathcal{N} \left( 0, \Sigma \right)
\\
\Delta y_t &= \alpha \beta^{\prime} y_{t-1} + \Gamma \Delta y_{t-1} + \mu + \varepsilon_t,
\end{align}
where $y_t = ( e_t, c_t )^{\prime}, \varepsilon_t = ( \varepsilon_{e,t}, \varepsilon_{c,t} )$ and $\Delta y_t = y_t - y_{t-1}$. Thus, the full system can be written as
\begin{align}
\begin{bmatrix}
\Delta e_t
\\
\Delta c_t
\end{bmatrix}
=
\begin{bmatrix}
\alpha_1
\\
\alpha_2
\end{bmatrix}
\begin{bmatrix}
\beta_1 & \beta_2
\end{bmatrix}
\begin{bmatrix}
e_{t-1}
\\
c_{t-1}
\end{bmatrix}
+
\begin{bmatrix}
\Gamma_{11} & \Gamma_{12}
\\
\Gamma_{21} & \Gamma_{22}
\end{bmatrix}
\begin{bmatrix}
\Delta e_{t-1}
\\
\Delta c_{t-1}
\end{bmatrix}
+
\begin{bmatrix}
\mu_e
\\
\mu_c
\end{bmatrix}
+
\begin{bmatrix}
\varepsilon_{e,t}
\\
\varepsilon_{c,t}
\end{bmatrix}
\end{align}
A relevant discussion on the interaction between unit roots and exogeneity can be found in hendry1994interactions (see, also engle1983exogeneity).
Therefore, the above economic and climate variables approximate the full climate-economic system with the links between climate and the economy given by both the short-run parameters $\Gamma$ and the equilibrium relationship $h_t$ given by the cointegrating vector $\beta^{\prime} y_t$ such that:
\begin{align}
h_t =
\begin{bmatrix}
\beta_1 & \beta_2
\end{bmatrix}
\begin{bmatrix}
e_{t}
\\
c_{t}
\end{bmatrix}
=
\begin{bmatrix}
\beta_1 e_{t} & \beta_2 c_{t}
\end{bmatrix}.
\end{align}
The cointegrating relation is an equilibrium one, and does not necessarily reflect purely a climate-impact function, but rather an equilibrium between the two series, to which each series adjusts. The statistical properties of the two-stage least squares estimator under cointegration can be found in hsiao1997statistical.
Cointegration and Dynamic Inference from ADLM
Consider a general autoregressive distributed lag ARDL (p,q) model where a series, $y_t$, is a function of a constant term, $\boldsymbol{\alpha}_0$, past values of itself stretching back $p$periods, contemporaneous and lagged values of an independent variable, $x_t$, of lag order $q$, and indepenendent, identically distributed error term:
align[align omitted — 169 chars of source]
exampleA commonly used model is the ARDL (1,1) model given by
\begin{align}
y_t = \boldsymbol{\alpha}_0 + \boldsymbol{\alpha}_1 y_{t-1} + \boldsymbol{\beta}_0 x_t + \boldsymbol{\beta}_1 x_{t-1} + \boldsymbol{\epsilon}_t,
\end{align}
The contemporaneous effect of $x_t$ on $y_t$ is given by $\boldsymbol{\beta}_0$. Moreover, the magnitude of $\boldsymbol{\alpha}_1$ informs us about the memory property of $y_t$. Assuming that $0 < \alpha_1 < 1$, larger values indicate that movements in $y_t$ take longer to dissipate. The long-run effect (or long-run multiplier) is the total effect that a change in $x_t$ has on $y_t$. A simple model that incorporates such dynamic effects, is the distributed lag model.
example[see, baumeister2021advances]
\
The authors consider the special case of models in which only the effects of a single structural shock are identified and develop a new closed-form equation that could be used to estimate consistently the parameters of that structural equation by combining knowledge of the effects of the structural shock with the observed covariance matrix of the reduced-form residuals. Notice that exact prior information regarding the distributional assumptions of the structural model or the true ordering of variables is typically referred to as $\textit{identifying assumptions}$ (see, discussion in fry2011sign on sign restrictions).
In particular, consider a three-variable VAR system which is identified using a recursive structure (Cholesky Decomposition). Then, in this three-variable VAR system the order of variables matter for consistently estimating the structural parameters. Specifically, when the demand equation is ordered last in the system, then identifying assumptions imply that the parameters of the demand equation can be estimated by an OLS regression of price on current quantity, income and lagged values of the variables.
Consider a demand equation system in which $q_t$ is a measure of the quantity of oil purchased, $p_t$ is a measure of the real price of oil, and $y_t$ is a measure of the real income such that
\begin{align}
q_t = \delta y_t + \beta p_t + b^{\prime}_d x_{t-1} + u_t^d.
\end{align}
Moreover, the demand structural system describes the behaviour of oil producers and the determinants of income such that (the order matters)
\begin{align}
q_t &= \delta y_t + \alpha p_t + b^{\prime}_s x_{t-1} + u_t^s \Rightarrow q_t - \delta y_t - \alpha p_t = b^{\prime}_s x_{t-1} + u_t^s
\\
y_t &= \epsilon q_t + \beta p_t + \textbf{b}^{\prime}_y \textbf{x}_{t-1} + u_t^y \Rightarrow - \epsilon q_t + y_t - \beta p_t = \textbf{b}^{\prime}_s \textbf{x}_{t-1} + u_t^s
\\
q_t &= \zeta y_t + \gamma p_t + \textbf{b}^{\prime}_d \textbf{x}_{t-1} + u_t^d \Rightarrow q_t - \zeta y_t - \gamma p_t = \textbf{b}^{\prime}_s \textbf{x}_{t-1} + u_t^s
\end{align}
where $\textbf{x}_{t-1} := \big( 1, \textbf{y}^{\prime}_{t-1}, \textbf{y}^{\prime}_{t-2},...., \textbf{y}^{\prime}_{t-p} \big)^{\prime}$ is a vector consisting of a constant term and $p$ lags of each of the three variables with $\textbf{y}_t = ( q_t, y_t, p_t )^{\prime}$.
\begin{itemize}
• $\alpha$ is the short-run price elasticity of oil supply,
• $u_t^s$ is a structural shock to oil production,
• $\beta$ is the contemporaneous effect of oil prices on economic activity.
\end{itemize}
Then, the structural model can be written in the following form:
\begin{align*}
\textbf{A} \textbf{y}_t &= \textbf{B} \textbf{x}_{t-1} + \textbf{u}_t,
\\
\underbrace{
\begin{bmatrix}
1 & - \delta & - \alpha
\\
- \epsilon & 1 & - \beta
\\
1 & - \zeta & - \gamma
\end{bmatrix}
}_{ \textbf{A} }
\begin{bmatrix}
q_t
\\
y_t
\\
p_t
\end{bmatrix}
&=
\begin{bmatrix}
\textbf{b}^{\prime}_s
\\
\textbf{b}^{\prime}_y
\\
\textbf{b}^{\prime}_d
\end{bmatrix}
\textbf{x}_{t-1}
+
\begin{bmatrix}
u_t^s
\\
u_t^y
\\
u_t^d
\end{bmatrix}.
\end{align*}
We assume that these structural shocks have mean zero and are serially uncorrelated as well as uncorrelated with each other such that
\begin{align*}
\mathbb{E} \big[ \textbf{u}_t \textbf{u}_t^{\prime} \big] =
\begin{cases}
\textbf{D}, & \ \text{for} \ t = s,
\\
0, & \ \text{for} \ t \neq s.
\end{cases}
\end{align*}
where $\textbf{D}$ is a diagonal covariance matrix. Then, by pre-multiplying the structural VAR representation with the matrix $\textbf{A}^{-1}$, we obtain the corresponding reduced-form VAR equation which has the following dynamic structural model form $
\textbf{y}_t = \Pi \textbf{x}_t + \epsilon_t, \ \ \ \mathbb{E} \left( \epsilon_t \epsilon_t^{\prime} \right) = \Omega$. Therefore the above reduced form specification can be expressed as below
\begin{align*}
\textbf{y}_t = \Pi \textbf{x}_t + \epsilon_t \equiv \textbf{c} + \Phi_1 \textbf{y}_{t-1} + \Phi_2 \textbf{y}_{t-2} + ... + \Phi_m \textbf{y}_{t-m} + \epsilon_t.
\end{align*}
Then, the above reduced-form can be employed to construct impulse-response functions $\Psi_s = \partial \textbf{y}_{ t+s} / \partial \epsilon_t^{\prime}$.
\begin{align*}
\hat{\Psi}_s = \hat{\Phi}_1 \hat{\Psi}_{s-1} + \hat{\Phi}_2 \hat{\Psi}_{s-2} + ... + \hat{\Phi}_m \hat{\Psi}_{s-m}, \ \ \ \text{for} \ \ \ s = 1,2,3,...
\end{align*}
starting from $\hat{\Phi}_0 = \textbf{I}_n$ and $\hat{\Psi}_s = 0$ for $s < 0$.
remarkFollowing kilian2017structural we assume that the short-run income and price elasticities of supply as well as the contemporaneous coefficient relating oil prices to economic activity are all zero, although such conditions might need to be revisited especially within a climate-economy equilibrium setting without resorting to non-equilibrium dynamic states. Nevertheless, using the Cholesky factorization\footnote{Using a Cholesky decomposition is a standard approach in the literature and several studies employ such techniques although alternative parametrizations are of particular interest within a unified framework.} of $\Omega_{MLE}$ we can obtain the estimated effects on $\textbf{y}_{t+s}$ of a one-standard-deviation increase in one of the structural shocks at date $t$ (see, also hamilton1994time).
definitionA VAR process of order $p$, $VAR(p)$, is a multivariate process $\boldsymbol{y}_t$ specified as follows
\begin{align}
\boldsymbol{y}_t = \boldsymbol{\eta} + \sum_{j=1}^p \boldsymbol{A}_j \boldsymbol{y}_{t-j} + \boldsymbol{\varepsilon}_t, \ \ \ \boldsymbol{\varepsilon}_t \sim WN_{(n)}
\end{align}
where $\boldsymbol{\eta}$ and $\boldsymbol{A}_1, \boldsymbol{A}_2,..., \boldsymbol{A}_p$, are a constant vector and constant matrices, respectively.
remarkSuch a process can be rewritten in operator form as below
\begin{align}
\boldsymbol{A}(L) \boldsymbol{y}_t = \boldsymbol{\eta} + \boldsymbol{\varepsilon}_t, \ \ \ \boldsymbol{A}(L) = \boldsymbol{I}_n - \sum_{j=1}^p \boldsymbol{A}_j L^j
\end{align}
which is considered to be a stationary process provided all roots of $\mathsf{det} \left[ \boldsymbol{A}(z) \right] = 0$, lie outside the unit circle. Then, the process admits a causal VMA$(\infty)$ respresentation such that
\begin{align}
\boldsymbol{y}_t = \boldsymbol{\omega} + \sum_{k = 0}^{\infty} \boldsymbol{C}_k \boldsymbol{\varepsilon}_{t-k}.
\end{align}
Although in Section (ref) we consider suitable formulations of cointegrated VAR models and their applications from related economic studies, one needs to revise the concepts presented in Chapter 10 of hamilton1994time on Covariance-Stationary processes before proceeding to the material of Section (ref)
Open Problems Various open problems remain in the literature such as the use of the cross-section as a mechanism for beliefs elicitation and identification of structural shocks. Related studies from the finance literature where the cross-section is used for improving the predictability of portfolio returns include among others chinco2019sparse, freyberger2020dissecting and kyle2023beliefs, but in the case of modelling macroeconomic fundamentals using cross-sectional information is still a growing literature. Relevant studies in this direction include forni2017dynamic, kong2019weak, yamamoto2023cross and hannadige2023forecasting among others.
Vector Autoregressions: Prediction and Granger Causality
Stability Conditions in VAR$(p)$ Model
exampleConsider that $\boldsymbol{y}_t \sim \mathsf{VAR} (p)$ is defined recursively such that
\begin{align}
\boldsymbol{y}_t = \boldsymbol{A}_1 \boldsymbol{y}_{t-1} + ... + \boldsymbol{A}_p \boldsymbol{y}_{t-p} + \boldsymbol{\varepsilon}_t, \ \ \ t = 1,...,n
\end{align}
where $\boldsymbol{y}_t \in \mathbb{R}^d$ is a $d-$dimensional vector. Then, the above $\mathsf{VAR} (p)$ process can be expressed as a $\mathsf{VAR} (1)$ process using a companion matrix as below
\begin{align}
\begin{bmatrix}
\boldsymbol{y}_t
\\
\boldsymbol{y}_{t-1}
\\
\vdots
\\
\boldsymbol{y}_{t - p + 1 }
\end{bmatrix}
=
\begin{bmatrix}
\boldsymbol{A}_1 & \boldsymbol{A}_2 & \boldsymbol{A}_3 & \hdots & \boldsymbol{A}_p
\\
\boldsymbol{I}_d & \boldsymbol{0} & \boldsymbol{0} & \hdots & \boldsymbol{0}
\\
\boldsymbol{0} & \boldsymbol{I}_d & \boldsymbol{0} & \hdots & \boldsymbol{0}
\\
\vdots & \vdots & \ddots & \hdots & \vdots
\\
\boldsymbol{0} & \boldsymbol{0} & \vdots & \boldsymbol{I}_d & \boldsymbol{0}
\end{bmatrix}
\begin{bmatrix}
\boldsymbol{y}_{t-1}
\\
\boldsymbol{y}_{t-2}
\\
\vdots
\\
\boldsymbol{y}_{t - p }
\end{bmatrix}
+
\begin{bmatrix}
\boldsymbol{\varepsilon}_t
\\
\boldsymbol{0}
\\
\boldsymbol{0}
\\
\vdots
\\
\boldsymbol{0}
\end{bmatrix}
\end{align}
such that $\boldsymbol{Y}_t = \boldsymbol{\mathcal{\mathcal{A}}} \boldsymbol{Y}_{t-1} + \boldsymbol{U}_t$, which implies that a unique solution can be determined using
\begin{align}
\boldsymbol{Y}_t = \boldsymbol{\mathcal{\mathcal{A}}}^t \boldsymbol{Y}_{0} + \sum_{j=1}^t \boldsymbol{\mathcal{\mathcal{A}}}^{t-j} \boldsymbol{U}_j.
\end{align}
assumption(a) any non-zero eigenvalue $\lambda$ of $\mathcal{\mathcal{A}}$ satisfies the following stability condition
\begin{align}
\mathsf{det} \left( \boldsymbol{I}_d - \sum_{j=1}^p \frac{1}{ \lambda^j } \boldsymbol{ \mathcal{A} }_j \right) = 0.
\end{align}
(b) The spectral radius of the companion matrix $\boldsymbol{ \mathcal{A} }$ is smaller than 1, $\rho ( \boldsymbol{ \mathcal{A} } ) < 1$.
lemmaConsider the homoscedastic $\mathsf{VAR}(p)$ process defined in (ref), where the roots of the characteristic polynomial satisfy the conditions of Assumption (ref).
\begin{itemize}
• Consider the process $\boldsymbol{y}_t \sim \mathsf{VAR} (p)$, and suppose that the spectral radius of the companion matrix $\boldsymbol{\mathcal{A} }$ satisfies $\rho( \boldsymbol{\mathcal{A} } ) < 1$. Then, since $\boldsymbol{Y}_0 = \sum_{j=0}^{ \infty } \boldsymbol{\mathcal{A} }^j \boldsymbol{U}_{t-j}$ almost surely then under the covariance stationarity assumption it holds that $\boldsymbol{\Gamma}_y (j) = \mathbb{E} \big[ \boldsymbol{Y}_t \boldsymbol{Y}_{t-j}^{\prime} \big]$.
• An equivalent expression for the $\mathsf{VAR} (p)$ process using the lag operator is as below
\begin{align}
\left( \boldsymbol{I}_d - \boldsymbol{A}_1 L - \boldsymbol{A}_2 L^2 - ... - \boldsymbol{A}_p L^p \right) \boldsymbol{y}_t = \boldsymbol{\varepsilon}_t.
\end{align}
Then the characteristic polynomial of the $\mathsf{VAR} (p)$ process is written as
\begin{align}
\boldsymbol{\Phi} (z) := \left( \boldsymbol{I}_d - \boldsymbol{A}_1 z - \boldsymbol{A}_2 z^2 - ... - \boldsymbol{A}_p z^p \right) , \ \ \ for some \ \ z \in \mathbb{C}.
\end{align}
Consequently, the following are equivalent: $\textit{(i)}$ $\boldsymbol{y}_t$ is a stable process; $\textit{(ii)}$ $\rho( \boldsymbol{\mathcal{A}} ) < 1$; $\textit{(iii)}$ all the roots of the characteristic polynomial $\mathsf{det} \left\{ \boldsymbol{\Phi} (z) \right\} = 0$ lie outside the unit circle $\left\{ z \in \mathbb{C} : |z| < 1 \right\}$ such that $\mathsf{det} \left\{ \boldsymbol{\Phi} (z) \right\} = 0$ iff |z| > 1.
\end{itemize}
• Hence, based on the results given in (i) and (ii) above, the $\mathsf{VAR} (p)$ process admits a linear process representation such that
\begin{align}
\boldsymbol{y}_t = \sum_{j=0}^{ \infty} \boldsymbol{C}_j \boldsymbol{\varepsilon}_{t-j}, \ \ almost surely, \ \ \ with \ \ \boldsymbol{\varepsilon}_{t} \overset{i.i.d}{\sim} ( \boldsymbol{0}, \boldsymbol{\Sigma}_{\varepsilon}),
\end{align}
for a sequence of $\left\{ \boldsymbol{C}_j \right\}_{ j \geq 0 }$ satisfying the summability condition $\sum_{ j = 0}^{ \infty } \left\lVert \boldsymbol{C}_j \right\rVert < \infty$.
Relation between Dynamic Structural Models and Vector Autoregressions
Consider that these interelated equations can be written in the following form:
align[align omitted — 214 chars of source]
Therefore, by pre-multiplying the above dependent variable with $\boldsymbol{B}_0$ we can obtain a VAR representation given by the following expression:
align[align omitted — 214 chars of source]
In other words, we can view the above representation as a special case of the Dynamic Structural system equation since we eliminate the interelations of the dependent variable to a reduced form of a VAR.
exampleLet $\boldsymbol{z}_t = \begin{pmatrix}
z_{1t} \\ z_{2t}
\end{pmatrix}$ be an $n-$dimensional vector stochastic process, where $z_{1t}$ is an $( n_1 \times 1 )$ and $z_{2t}$ is an $( n_2 \times 1 )$ such that $n = n_1 + n_2$. Assume a linear dynamic model (see, lastrapes2005estimating)
\begin{align}
\boldsymbol{A}_0 \boldsymbol{z}_t = \boldsymbol{A}_1 \boldsymbol{z}_{t-1} + ... + \boldsymbol{A}_p \boldsymbol{z}_{t-p} + \boldsymbol{u}_t,
\end{align}
where $\boldsymbol{u}_t = \begin{pmatrix}
u_{1t} & u_{2t}
\end{pmatrix}^{\prime}$ is a white noise vector process normalized such that $\mathbb{E} [ \boldsymbol{u}_t \boldsymbol{u}_t^{\prime} ] = \boldsymbol{I}$, which implies that the reduced-form errors have a diagonal variance-covariance matrix equal to the identify matrix. Moreover, the reduced form of this structural model is formulated as below
\begin{align*}
\boldsymbol{z}_t
&=
\boldsymbol{A}_0^{-1} \boldsymbol{A}_1 \boldsymbol{z}_{t-1} + ... + \boldsymbol{A}_0^{-1} \boldsymbol{A}_p \boldsymbol{z}_{t-p} + \boldsymbol{A}_0^{-1} \boldsymbol{u}_t
\\
\boldsymbol{z}_t
&=
\boldsymbol{B}_1 \boldsymbol{z}_{t-1} + ... + \boldsymbol{B}_p \boldsymbol{z}_{t-p} + \boldsymbol{\varepsilon}_t.
\end{align*}
such that the structural errors have a variance-covariance matrix $\mathbb{E} \left( \boldsymbol{\varepsilon}_t \boldsymbol{\varepsilon}_t^{\prime} \right) = \boldsymbol{\Omega}$. Therefore, the MA representation of the structural model is
\begin{align}
z_t = \big( \boldsymbol{A}_0 - \boldsymbol{A}_1 L - ... - \boldsymbol{A}_p L^p \big) \boldsymbol{u}_t \equiv \big( \boldsymbol{D}_0 + \boldsymbol{D}_1 L + \boldsymbol{D}_2 L^2 + ... \big) \boldsymbol{u}_t = \boldsymbol{D} (L) \boldsymbol{u}_t.
\end{align}
Similarly, the reduced form MA has the following representation
\begin{align}
z_t = \big( \boldsymbol{I} - \boldsymbol{B}_1 L - ... - \boldsymbol{B}_p L^p \big) \boldsymbol{\epsilon}_t \equiv \big( \boldsymbol{I} + \boldsymbol{C}_1 L + \boldsymbol{C}_2 L^2 + ... \big) \boldsymbol{u}_t = \boldsymbol{C} (L) \boldsymbol{\epsilon}_t.
\end{align}
In other words, the parameters of interest are the structural dynamic multiplies or impulse response functions such that $\frac{ \partial z_{t+k} }{ \partial u_t } = D_k$. The common practice in the applied macroeconometrics literature is to obtain estimates for $\boldsymbol{B} (L)$ and $\boldsymbol{\Omega}$ and then impose suitable restrictions on the underline structure to identify the model parameters.
remarkNotice that while reduced-form parameters $A_j$ for $j = 1,..., p$ and the covariance matrix of residuals $\Sigma_u$ can be estimated consistently, the structural parameters collected in the matrix $B$ are not identified without further theoretical or statistical assumptions. One possible solution is to restrict the matrix $B$ to be a lower-triangular imposing a recursive causal structure among the model variables.
Main Assumptions
Consider an $n-$dimensional covariance stationary zero-mean vector stochastic process $\boldsymbol{x}_t$ of observable variables, driven by $q-$dimensional unobservable vector process $u_t$ of structural shocks.
align[align omitted — 68 chars of source]
where $\boldsymbol{C} (L) = \displaystyle \sum_{j=0}^{\infty} C_j L^j$ is an one-sided polynomial in the lag operator $L$ in infinite order. These shocks are orthogonal white noises such that $u_t \sim ( 0, \boldsymbol{\Sigma}_u )$, where $\boldsymbol{\Sigma}_u$ is diagonal. Furthermore, notice that a VAR model based on a subset of the variables implies a different $MA(\infty)$ representation than its counterpart based on the joint distribution. We begin by considering various examples regarding the identification and estimation of SVAR models using properties of structural shocks.
definition[Fundamentalness in Systems]
Given a covariance stationary vector process $x_t$, the representation $\boldsymbol{x}_t = \boldsymbol{C} (L) \boldsymbol{u}_t$ is fundemental if
\begin{itemize}
• $\boldsymbol{u}_t$ is a white noise vector,
• $\boldsymbol{C} (L)$ has no poles of modules less or equal than unity, i.e., no poles inside the unit disc.
• $\mathsf{det} [ \boldsymbol{C}(z) ]$ has no roots of modules less than unity, i.e., all its roots are outise the unit disc
\begin{align}
\boldsymbol{C}(z) \neq 0, \ \ \ \forall \ z \in \mathbb{C} \ \ s.t \ |z| < 1.
\end{align}
\end{itemize}
If the roots of $\mathsf{det} [ \boldsymbol{C}(z) ]$ are outside the unit disc, we have invertability in the past, that is, the inverse representation depends only on non-negative powers of $L$, and we have fundamentalness. If at least one of the roots of $\mathsf{det} [ \boldsymbol{C}(z) ]$ is inside the unit disc, then invertability and non-fundementalness holds.
example[Partially nonstationary multivariate autoregressive AR(p)] Consider the partially nonstationary multivariate autoregressive AR(p) given by
\begin{align}
\boldsymbol{\Phi} (L) \boldsymbol{Y}_t \equiv \left( \boldsymbol{I}_m - \sum_{j=1}^p \boldsymbol{\Phi}_j L^j \right) \boldsymbol{Y}_t = \boldsymbol{\epsilon}_t
\end{align}
where $\left\{ \boldsymbol{Y}_t \right\}$ is an $m-$dimensional process and for $\boldsymbol{\epsilon}_t$ it holds that $\mathbb{E} ( \boldsymbol{\epsilon}_t ) = 0$ and $\mathsf{cov} ( \boldsymbol{\epsilon}_t ) = \boldsymbol{\Omega}$. Moreover, it is assumed that $\mathsf{det} \big[ \boldsymbol{\Phi} (L) \big] = 0$ has $d < m$ unit roots and the remaining roots are outside the unit circle and that $\mathsf{rank} \big[ \Phi (1) \big] = r$, where $r = (m-d) > 0$ (see, samuelson1941conditions and dickey1986unit). Therefore, each component of the first difference $W_t = ( Y_t - Y_{t-1} )$ is assumed to be stationary.
Then the model has the following error-correction form below
\begin{align}
\boldsymbol{\Phi}^{*} (L) (1-L) \boldsymbol{Y}_t = \boldsymbol{C} \boldsymbol{Y}_{t-1} + \boldsymbol{\varepsilon}_t,
\ \ \ \
\Delta \boldsymbol{Y}_t = \boldsymbol{C} \boldsymbol{Y}_{t-1} + \sum_{j=1}^{p-1} \boldsymbol{\Phi}^{*} \Delta \boldsymbol{Y}_{t-j} + \boldsymbol{\varepsilon}_t
\end{align}
where the matrix coefficients are defined as below
\begin{align}
\boldsymbol{\Phi}^{*} (L) = \left( \boldsymbol{I}_m - \sum_{j=1}^{p-1} \boldsymbol{\Phi}_j^{*} L^j \right), \ \ \ \boldsymbol{\Phi}_j^{*} = - \sum_{k=j+1}^p \boldsymbol{\Phi}_k, \ \ \ \boldsymbol{C} = - \boldsymbol{\Phi} (1).
\end{align}
Moreover, the Jordan Canonical form of $\sum_{j=1}^p \boldsymbol{\Phi}_j$ is given by
\begin{align}
\boldsymbol{P}^{-1} \left( \sum_{j=1}^p \boldsymbol{\Phi}_j \right) \boldsymbol{P} = \mathsf{diag} \big( \boldsymbol{I}_d, \boldsymbol{\Lambda}_r \big)
\end{align}
One can define with $\boldsymbol{Z}_t = [ \boldsymbol{Z}_{1t}^{\prime}, \boldsymbol{Z}_{2t}^{\prime} ] = \boldsymbol{Q} \boldsymbol{Y}_t$, where $\boldsymbol{Z}_{1t} = \boldsymbol{Q}_1^{\prime} \boldsymbol{Y}_t$ and $\boldsymbol{Z}_{2t} = \boldsymbol{Q}_2^{\prime} \boldsymbol{Y}_t$.
The identification of structural vector autoregressions is a crucial step before proceeding with constructing test statistics and forecasts (see Section (ref)). A suitable approach found in the literature, is the method of recursive identification\footnote{The theoretical analysis of recursive identification methods is given by soderstrom1978theoretical and chen2010new } (see, chen2014recursive) which implies exact identification of the structural parameter $B_0^{-1}$ (e.g., see kim2000exchange). Moreover, the presence of stochastic singularity are crucial on whether a system is identified or unidentifiable. Based on these considerations komunjer2011dynamic employ restrictions implied by observational equivalence to establish conditions for avoiding the presence of stochastic singularity. To ensure that these structural econometric models can be still partially identified (see, also phillips1989partially) regardless of the possible presence of stochastic singularity, then the econometrician can exploit the existence and uniqueness of local identification of DSGE models based on the corresponding linearized solution. Lastly, given the prominent role of expectations in news aspects such as the information flow and anticipated shocks can affect the identification of structural shocks (e.g., optimal inter-temporal decisions discount future tax obligations, see leeper2013fiscal and mertens2013dynamic).
Weak Exogeneity in $I(2)$ VAR Systems
The notion of weak exogeneity is important when considering the structural analysis of cointegrating regression models. Under the assumption of weak exogeneity estimation of the cointegration parameters in conditional models is accordingly influenced. In particular, for the VAR model allowing for $I(1)$ variables under the assumption of Gaussian errors implies the use of a cointegrated VAR specification which is suitable for modelling long-run equilibrium dynamics for multivariate time series. Within this stream of literature one is interested to analyze the conditions under which a subset of equations is weakly exogenous with respect to the cointegration parameters (see, paruolo1997asymptotic, paruolo2000asymptotic, paruolo1999weak, dolado1992note and pesaran2000structural). Moreover, tchatoka2013finite propose unified exogeneity test statistics and examine the pivotality property under strict exogeneity (see, also white2014granger) and characterize the finite-sample distributions of the statistics under $H_0$, including when identification is weak and the errors are possibly non-Gaussian. Assume that the vectors $\boldsymbol{U}_t = [ \boldsymbol{u}_t, \boldsymbol{V}_t ]^{\prime}$ for $t = 1,..., T$, have the same nonsingular covariance matrix defined below
align[align omitted — 268 chars of source]
where $\boldsymbol{\Sigma}_V$ has dimension $G$ (see, also khalaf2014identification). Then, the covariance matrix of the reduced-form disturbances $\boldsymbol{W}_t = [ \boldsymbol{v}_t, \boldsymbol{V}_t^{\prime} ]^{\prime} = [ \boldsymbol{u} + \boldsymbol{V} \boldsymbol{\beta}, \boldsymbol{V} ]$ takes the following form
align[align omitted — 450 chars of source]
where $\boldsymbol{\Omega}$ is positive definite matrix. The exogeneity hypothesis can be expressed as $\mathcal{H}_0: \boldsymbol{\delta} = \boldsymbol{0}$.
exampleSuppose that $\boldsymbol{W}_t = \boldsymbol{J} \bar{ \boldsymbol{W} }_t$, for $t = 1,..., T$, and suppose that $\bar{ \boldsymbol{W} }_t \overset{ \textit{i.i.d} }{ \sim } \mathcal{N} \left( \boldsymbol{0}, \boldsymbol{I}_{G+1} \right)$. Then, it holds that $\boldsymbol{\Omega} = \mathbb{E} \left[ \boldsymbol{W}_t \boldsymbol{W}_t \right] = \boldsymbol{J} \boldsymbol{J}^{\prime}$. Moreover, since $\boldsymbol{J}$ is upper triangular, then its inverse $\boldsymbol{J}^{-1}$ is also upper triangular. Let $\boldsymbol{P} = \left( \boldsymbol{J}^{-1} \right)^{\prime}$. Since $\boldsymbol{P}$ is a $( G \times 1) \times ( G \times 1)$ lower triangular matrix then we can orthogonalize the matrix $\boldsymbol{J} \boldsymbol{J}^{\prime}$ such that
\begin{align}
\boldsymbol{P}^{\prime} \boldsymbol{J} \boldsymbol{J}^{\prime} \boldsymbol{P} = \boldsymbol{I}_{G+1}, \ \ \ \left( \boldsymbol{J} \boldsymbol{J}^{\prime} \right)^{-1} = \boldsymbol{P} \boldsymbol{P}^{\prime}.
\end{align}
The matrix $\boldsymbol{P}$ is the Cholesky factor of $\boldsymbol{\Omega}^{-1}$, so $\boldsymbol{P}$ is the unique lower triangular matrix.
\begin{align}
\boldsymbol{P} =
\begin{bmatrix}
P_{11} & 0
\\
P_{21} & P_{22}
\end{bmatrix}
\end{align}
Thus, an appropriate $\boldsymbol{P}$ matrix is obtained by taking
\begin{align}
P_{11} &:= \left( \sigma_u^2 - \boldsymbol{\delta}^{\prime} \boldsymbol{\Sigma}_V^{-1} \boldsymbol{\delta} \right)^{-1/2} \equiv \sigma_{\varepsilon}.
\\
P_{21} &:= - \left( \boldsymbol{\beta} + \boldsymbol{\Sigma}_V^{-1} \boldsymbol{\delta} \right) \left( \sigma_u^2 - \boldsymbol{\delta}^{\prime} \boldsymbol{\Sigma}_V^{-1} \boldsymbol{\delta} \right)^{-1/2} \equiv - ( \beta + \alpha ) \sigma^{-1}_{\varepsilon}.
\end{align}
Local Projections
assumption[Wold representation]
\
Suppose that $\varepsilon_t$ represents an innovation sequence which is strictly stationary and ergodic such that $\mathbb{E} ( \varepsilon_t | \mathcal{F}_{t-1} ) = 0$ almost surely, where $\mathcal{F}_{t-1} = \sigma ( \varepsilon_{t-1}, \varepsilon_{t-2},... )$. Then, $y_t$ satisfy a Wold representation if it can be expressed as $y_t = \sum_{j=0}^{\infty} \Phi_j u_{t-j}$ or $y_t = \Phi (L) u_t$.
Application: Measuring the Impact of Fiscal Policy
This example is based on the study of mertens2010measuring who consider the consequences of anticipation effects for VAR-based estimates of the impact of government spending shocks. We consider a bivariate time series representation of a vector consisting of control variables $z_t$, and government spending $\mathsf{g}_t$. We assume transitory government spending shocks, such that $\mu_{ \mathsf{g} } (L)$ is a stable polynomial. The identification is facilitated by assuming that information can arrive with any anticipation horizon between 1 and $q$ periods. Thus, the vector of observables $\boldsymbol{v}_t = [ \mathsf{g}_t, z_t ]^{\prime}$ is formulated as below
align[align omitted — 594 chars of source]
Substituting to the steady-state equilibrium solution of the system, the MA representation is
align*[align* omitted — 170 chars of source]
exampleConsider that the vector $\boldsymbol{y}_t = [ GOV_t, GDP_t, CON_t ]$, where all three macroeconomic variables are in real terms and in logarithms. Then, the VECM is given by the following expression
\begin{align}
\Delta \boldsymbol{y}_t = \boldsymbol{\Pi} \boldsymbol{y}_{t-1} + \boldsymbol{C} (L) \boldsymbol{y}_{t-1} + \boldsymbol{D} \varepsilon_t,
\end{align}
where $\boldsymbol{D} = \boldsymbol{Y} (0) \boldsymbol{\Sigma}_{e} \boldsymbol{B} (0)$ and $\boldsymbol{\varepsilon}_t \boldsymbol{B}(L)^{-1} \boldsymbol{e}_t$, where $\boldsymbol{e}_t$ contains the structural shocks of interest. Notice that despite the presence of permanent fiscal shocks, the variables in $\boldsymbol{y}_t$ cointegrate since the investment-output ratio is unaffected by the level of government spending in the long-run. Moreover, the unanticipated government spending shock is allowed to affect the level of government spending immediately, while the anticipated government spending shock is assumed not to affect government spending within one quarter. However, the two shocks are restricted to have the same long run impact on the level of government spending (see, mertens2010measuring). Overall, the estimation procedure aims to uncover the response to an anticipated fiscal shock. On the other hand, when the anticipation rate is high which implies that the anticipated shocks are relatively important, then biased estimates for the unanticipated shock are obtained in small samples. Further examples can be found in mertens2013dynamic.
Two popular methods to estimate impulse responses when a shock has already been identified include: local projections and distributed lag models. In particular, one can show that the dynamic response from a VAR with the shock embedded as an endogenous variable is equivalent to that of a VAR with the shock included as an exogenous variable only when that shock has no serial correlation (e.g., see plagborg2021local, olea2021inference). The result follows because a VAR with a shock as an exogenous variable (VAR-X) can be seen as a multivariate generalization of a DLM. A comparison of these cases can be found in alloza2020dynamic. Moreover, lusompa2023local propose an efficient estimation method for Local projections when residuals are autocorrelated. Lastly, the simultaneous impact of monetary and fiscal policy is discussed by bruneau2003monetary while the relation of fiscal policy and persistent inflation is studied by bianchi2023fiscal.
example[see, alloza2020dynamic]
Consider the following data generating mechanism:
\begin{align}
y_t &= \rho y_{t-1} + \delta_0 x_t + \delta_1 x_{t-1} + u_t,
\\
x_t &= \gamma x_{t-1} + v_t.
\end{align}
Then, the process can be formulated as a SVAR of the form $\boldsymbol{A}_0 \boldsymbol{Y}_t = \boldsymbol{B} \boldsymbol{Y}_{t-1}$ such that
\begin{align}
\begin{bmatrix}
1 & 0
\\
- \delta_0 & 1
\end{bmatrix}
\begin{bmatrix}
x_t
\\
y_t
\end{bmatrix}
=
\begin{bmatrix}
\gamma & 0
\\
\delta_1 & \rho
\end{bmatrix}
\begin{bmatrix}
x_{t-1}
\\
y_{t-1}
\end{bmatrix}
+
\begin{bmatrix}
\varepsilon_t^x
\\
\varepsilon_t^y
\end{bmatrix}
\end{align}
Consider the following econometric specification
\begin{align}
\boldsymbol{y}_t &= \boldsymbol{\mu} + \sum_{j=1}^p \boldsymbol{A}_j \boldsymbol{y}_{t-j} + \boldsymbol{B} \boldsymbol{\varepsilon}_t
\\
\boldsymbol{z}_t &= \boldsymbol{\mu}_z + \boldsymbol{\Gamma} \boldsymbol{\varepsilon}_t + \boldsymbol{\Sigma}^{1/2} \boldsymbol{\eta}_t
\end{align}
Without further restrictions, the augmented SVAR model is only identified up to orthogonal rotations of the form $\boldsymbol{B} = \tilde{\boldsymbol{B}} \boldsymbol{Q}$. According to alloza2020dynamic the presence of serial correlation can be thought as cross-sectional persistence as in the case of narrative shocks, which are usually serially correlated. This aspect can directly affect the identification and estimation of their dynamic effects. In particular, when estimating the dynamic response of some variable to a serially correlated shock, some part of the persistence may be spillover on the impulse response function. We discuss the use of a suitable parametrization for modelling persistence in macroeconomic data in Section (ref).
Estimation Method
Recently, it has been shown that the method of local projections has advantages in drawing inference of impulse responses, especially with respect to uniform validity (e.g., see inoue2020uniform). We demonstrate an example of the estimation method from the framework of xu2023local. The VAR$(p)$ model is of the form $y_t = A_1 y_{t-1} + ... + A_p y_{t-p} + u_t$, $t = 1,...,n$, where $u_t$ is serially uncorrelated shock.
To measure the responses of the first endogenous variable $y_{1t}$ to shocks after $h$ propagation periods, where $h \geq 1$, the LP method runs the regression below (see, xu2023local).
align[align omitted — 326 chars of source]
Alternative, we can estimate the following system of equations
align[align omitted — 320 chars of source]
Notice that by definition it holds that $\theta_{1,p} (h) = 0$. Recall that for a matrix $x$, we denote its Frobenius norm, such that $|x| = [ \mathsf{trace} ( x^{\prime} x ) ]^{1/2}$. Suppose that $\left\{ \widehat{u}_t(h): t = p^{*},..., n - h \right\}$ are OLS residuals of the $\mathsf{VAR} ( p^{*} - 1 )$ regression, using the data $\left\{ y_t: t = p^{*},..., n - h \right\}$. In addition, related distributional assumptions for the error term of the model can be imposed.
The OLS estimator is given by
align[align omitted — 220 chars of source]
Notice that these local projection estimates correspond to an in-sample estimates for the VAR$(p)$ model based on $p$ lags. On the other hand, if we are interested to obtain out-of-sample forecast sequences then we need to implement a forecasting scheme such as a moving window which is used to obtain pseudo-out-of-sample forecasts. The window size should be larger than the number of lags to have good statistical properties for the forecast sequences. Relevant applications of local projections include the construction of impulse response functions.
Impulse Response Functions
A major advantage of modelling interdependent systems such as Structural Vector Autoregressions is that these system representations can be used to construct impulse response functions and forecast error variance decompositions, which are useful for investigating the dynamics within the system as well as the statistical properties of econometric specifications for forecasting purposes (see, baillie2013estimation). Thus, reduced-form impulse responses allows us to find the response of one variable to an impulse in another variable. Usually impulse response functions can be constructed based on the stable VAR$(p)$ process. An alternative method for estimating impulse response functions has been proposed in the literature, using the method of local projections as in jorda2005estimation, barnichon2019impulse, gorodnichenko2020forecast, montiel2021local and plagborg2021local. In addition, the use of exogenous instrumentation as an identification strategy of forecast errors is examined by olea2021inference and plagborg2022instrumental. The construction of robust confidence intervals for IV-based local projections is studied by noh2017impulse, gafarov2018delta, ganics2021confidence and koo2022impulse among others.
Asymptotic Results for VAR Processes with Known Order
Suppose that $\boldsymbol{\beta}$ is an $( n \times 1)$ vector of parameters and $\hat{\boldsymbol{\beta}}$ is an estimator such that
align[align omitted — 162 chars of source]
Moreover, let $\big( g_1 ( \boldsymbol{\beta}),..., g_m ( \boldsymbol{\beta}) \big)^{\prime}$ be a continuously differentiable function with values in $m-$dimensional Euclidean space and $\displaystyle \frac{ \partial g_i }{ \partial \boldsymbol{\beta}^{\prime} } = \frac{ \partial g_i }{ \partial \beta_j }$, for $i \in \left\{ 1,..., m \right\}$. Then, it holds that (see, lutkepohl1990asymptotic)
align[align omitted — 297 chars of source]
remarkNotice that if the VAR$(p)$ process is $y_t$ is (covariance) stationary with
\begin{align}
\mathsf{det} \big( \boldsymbol{I}_K - \boldsymbol{A}_1 z - ... - \boldsymbol{A}_p z^p \big) \neq 0, \ \ \ for \ \ |z| \leq 1,
\end{align}
and the $u_t$ are independent, identically distributed (i.i.d) with bounded forth moments. This implies that the usual OLS estimators have asymptotic covariance matrix given by
\begin{align}
\boldsymbol{\Sigma}_{a} = \Gamma^{-1} \otimes \boldsymbol{\Sigma}_u,
\ \ \
\boldsymbol{\Gamma}
=
\mathbb{E} \left\{ \big[ \boldsymbol{y}_t \ \boldsymbol{y}_{t-1} \ ... \ \boldsymbol{y}_{t-p+1} \big]^{\prime} \otimes \big[ \boldsymbol{y}_t \ \boldsymbol{y}_{t-1} \ ... \ \boldsymbol{y}_{t-p+1} \big] \right\}
\end{align}
In addition, if $\boldsymbol{y}_t$ is Gaussian, then $\hat{\boldsymbol{\alpha}}$ and $\hat{\boldsymbol{\sigma}}$ are asymptotically independent. Interval forecasts based on predictive distributions are studied by chatfield1993calculating while the reliability of local projection estimators of impulse response functions is examined by kilian2011reliable. The asymptotic distributions of IRFs and FEVD for VARs are established by lutkepohl1990asymptotic (see, also lanne2016generalized).
remarkRegarding the construction of Impulse Response Functions and FVED, it can be shown that Impulse Responses that are obtained from unrestricted VARs with roots near unity have long period estimated impulse responses that are inconsistent. Moreover, FEVD are also inconsistent in unrestricted VAR models with near unit roots. The inconsistency problem of IRFs from nonstationary SVAR models is discussed by phillips1998impulse (see, also lutkepohl1997impulse). Specifically, the OLS estimation approach of phillips1998impulse shows that in nonstationary VAR models with some roots at or near unity the estimated impulse response matrices are inconsistent at long horizons and tend to random matrices rather than the true impulse responses. In this stream of literature another issue is the consistent estimation of the number of cointegrating relations in a system of equations (e.g., see, barigozzi2021large and barigozzi2022testing).
exampleConsider the VECM process below
\begin{align}
\Delta y_t = \alpha \beta^{\prime} y_{t-1} + \Gamma_1 \Delta y_{t-1} + ... + \Delta y_{t-p+1} + u_t, \ \ t = 1,2,...
\end{align}
The residuals of $u_t$ are the one-step ahead forecast errors associated with the VECM representation. However, tracing the marginal effects of a change in one component of $u_t$ through the system may not reflect the actual responses of the variables since in practice an isolated change in a single component of $u_t$ is likely to occur if the component is correlated with the other components.
remarkIdentifying restrictions are imposed in
order to identify the transitory and permanent shocks in the system. For example, castelnuovo2010monetary present impulse response analysis evidence that the VAR model is robust to two different identification strategies based on zero restrictions and the sign restrictions when evaluating the response of prices on monetary policy shocks. Additional to an impulse response analysis as a mechanism for studying the impact of structural shocks, the VAR framework is often used for forecasting based on suitable forecasting schemes (e.g., see, ng1990recursive, bhansali2002multi and mariano2002testing). Two commonly used forecasting approaches:
\begin{itemize}
• Direct Multiperiod Forecasting (e.g., see kang2003multi, greenaway2013multistep, greenaway2020multistep).
• Iterated Multiperiod Forecasting (e.g., see marcellino2006comparison).
\end{itemize}
example[Constructing Iterated Multistep Forecasts]
\begin{align}
y_{t+h} = y_t + \beta^{\prime} X_{t} + \varepsilon_t
\end{align}
Suppose that the we have an auxiliary equation for the $X_t$ such that $
X_t = A X_{t-1} + u_t$. Then, estimating the vector autoregression for the regressors by OLS we obtain an estimate $\hat{A}$ and thus a forecast of $X_{t+j}$ is $\hat{A}_j X_t$ and a forecast of the quantity $\left( y_{t+h} - y_t \right)$ is given by $\sum_{j=0}^{ h-1 } \hat{A}_j X_t$. Moreover, an example, of constructing one-step ahead forecasted values based on information from the cros-section is presented by katsouris2021forecast. An interesting extension would be to use such cross-sectional shrinkage approach within the aforementioned econometric environment.
Forecast Error Variance Decomposition
Generally, the Forecast Error Variance Decomposition gives the proportional contribution of each of the structural shocks to the forecast error variance of each variable at different horizons. Recall that the $h-$period forecast error of $y_t$ is given by
align[align omitted — 154 chars of source]
Hence, the $h-$period ahead forecast error of the $j-$th component of $y_t$ is given by
align*[align* omitted — 191 chars of source]
Moreover, the variance of the $h-$period forecast error of the $j-$th component of $y_t$ is given by
align*[align* omitted — 204 chars of source]
which holds since $\Sigma_w = I_K$. Notice that the sum of the terms $\left\{ \theta_{jk,0}^2 + ... + \theta_{jk,h-1}^2 \right\}$, is thus the $k-$th shock to the forecast error variance of the $h-$period forecast of the $j-$th variable. Then, we have that
align[align omitted — 179 chars of source]
As an example of application of the above metrics see kilian2009impact (and kilian2009not) who consider the effects of three structural shocks (oil supply shock, aggregate demand shock, and oil-specific demand shock), in the US stock market. Another useful metric is the construction of historical decompositions which facilitate the quantification of the contribution of a given structural shock to the historically observed fluctuations in the variables included in the SVAR model. In particular, one might be interested to find to what extent the fiscal policy shock explains recessionary conditions (e.g., see cevik2023s) during uncertain times (e.g., see bloom2009impact). This is useful because we can concentrate on explaining a historical event which we know a priori might have induced a structural change to the macroeconomic system, instead of using for example the average contribution of the fiscal policy shock to the business cycle fluctuations as given by the FEVD (see, kilian2014quantifying).
Suppose that $y_t$ is weakly stationary, and we have observations from 1 to $t$, such that for any $t \in \mathbb{N}$
align*[align* omitted — 93 chars of source]
The MA coefficients $\Theta_s$ converge to zero the further to the past, so $\hat{y}_t = \sum_{s=0}^{t-1} \Theta_s w_{t-s}$ approximates $y_t$.
Identification of Structural Vector Autoregression Models
While theory-based identification through sign restrictions guarantees economic interpretation of the identified shocks (e.g., see antolin2018narrative and mavroeidis2021identification), data-based identification offers diagnostic tools for testing the otherwise just identifying structural model specifications, while remain silent about the economic interpretation of the resulting structural shocks.
Identification using Short-run and Long-run Restrictions
example[Partially Identified SVARs]
Consider the dynamic structural models of the following form (see, baumeister2015sign)
\begin{align}
\boldsymbol{A} \boldsymbol{y}_t = \boldsymbol{B} \boldsymbol{x}_{t-1} + \boldsymbol{u}_t,
\end{align}
where $\boldsymbol{y}_t$ is an $( n \times 1)$ vector of observed variables and $\boldsymbol{u}_t$ is an $( n \times 1)$ vector of structural disturbances assumed to be independent and identically distributed $\mathcal{N} ( 0, \boldsymbol{D} )$ and mutually uncorrelated. Then, the reduced VAR associated with the structural model is given by
\begin{align}
\boldsymbol{y}_t = \boldsymbol{\Phi} \boldsymbol{x}_{t-1} + \boldsymbol{\varepsilon}_t, \ \ \ where \ \ \ \boldsymbol{\Phi} = \boldsymbol{A}^{-1} \boldsymbol{B},
\ \ \ \ and \ \ \ \
\boldsymbol{\varepsilon}_t = \boldsymbol{A}^{-1} \boldsymbol{u}_t, \ \ \ \mathbb{E} \big[ \boldsymbol{\varepsilon}_t \boldsymbol{\varepsilon}_t^{\prime} \big] = \boldsymbol{\Omega} = \boldsymbol{A}^{-1} \boldsymbol{D} \left( \boldsymbol{A}^{-1} \right)^{\prime}
\end{align}
where $\boldsymbol{x}_{t - 1}^{\prime} = \big( \boldsymbol{y}_{t-1}^{\prime}, \boldsymbol{y}_{t-2}^{\prime},..., \boldsymbol{y}_{t-m}^{\prime}, \boldsymbol{1} \big)^{\prime}$ is a $( k \times 1 )$ vector with $k = mn + 1$ containing a constant and $m$ lags of $\boldsymbol{y}$. Then, the MLE estimates of the reduced-form parameters are given by
\begin{align}
\widehat{\boldsymbol{\Phi}}_T
=
\left( \sum_{t=1}^T \boldsymbol{y}_t \boldsymbol{x}_{t - 1}^{\prime} \right) \left( \sum_{t=1}^T \boldsymbol{x}_{t - 1} \boldsymbol{x}_{t - 1}^{\prime} \right)^{-1}
\ \ \ \ and \ \ \ \
\hat{\boldsymbol{\Omega}}_T
=
\frac{1}{T} \sum_{t=1}^T \hat{\varepsilon}_t \hat{\varepsilon}_t^{\prime},
\end{align}
with $\hat{\varepsilon}_t = \boldsymbol{y}_{t} - \hat{\boldsymbol{\Phi}}_T \boldsymbol{x}_{t - 1}$. Moreover,
baumeister2019structural examines aspects related to the structural analysis of Vector Autoregressive models with incomplete identification based on the Bayesian approach rather than the classical frequentest approach.
Generally to uniquely identify the structural parameter in a SVAR model implies of having $K(K-1)/2$ restrictions. In addition when rank conditions hold, then the model is assumed to be exactly identified (e.g., see rubio2005markov).
example[Identification using Stability Restrictions]
According to magnusson2014identification, often identification depends on the distributional assumptions imposed on $x_t$. Suppose that $x_t$ is a policy variable determined according to an underline stochastic process such that
\begin{align}
x_t = \rho x_{t-1} + (1 - \rho ) \phi y_t + \eta_t
\end{align}
Furthermore, under a deterministic rational expectations equilibrium, the dynamics of $y_t$ and $x_t$ are as $
y_t = \beta x_{t-1} + u_{yt}$ and $
x_t = \varphi x_{t-1} + u_{xt}$, where $u_{yt}$ and $u_{xt}$ are innovation sequences. Moreover, vlaar2004asymptotic consider the asymptotic distribution of impulse responses in SVARs with long-run restrictions (see, also mittnik1993asymptotic).
\paragraph{Recursive Identification} Usually recursive identification with $\boldsymbol{B}_0^{-1}$ being a lower diagonal matrix was particularly popular in the earlier SVAR literature which implies exact identification. In particular, when $B_0^{-1}$ is lower triangular, so it is the matrix $B_0$ and thus the SVAR is recursive.
exampleConsider the following trivariate recursive $\mathsf{SVAR}(1)$ model as below
\begin{align*}
\begin{bmatrix}
b_{11,0} & 0 & 0
\\
b_{12,0} & b_{22,0} & 0
\\
b_{31,0} & b_{32,0} & b_{33,0}
\end{bmatrix}
\begin{bmatrix}
y_{1t}
\\
y_{2t}
\\
y_{3t}
\end{bmatrix}
=
\begin{bmatrix}
b_{11,1} & b_{11,2} & b_{13,1}
\\
b_{21,1} & b_{22,1} & b_{23,1}
\\
b_{31,1} & b_{32,1} & b_{33,1}
\end{bmatrix}
\begin{bmatrix}
y_{1,t-1}
\\
y_{2,t-1}
\\
y_{3,t-1}
\end{bmatrix}
+
\begin{bmatrix}
\eta_{1t}
\\
\eta_{2t}
\\
\eta_{3t}
\end{bmatrix}
\end{align*}
Therefore, we have that
\begin{align}
y_t = \sum_{i=0}^{\infty} \Phi_i B_0^{-1} \eta_{t-i}
\equiv
\sum_{i=0}^{\infty} \Theta_i \eta_{t-i} =
\underbrace{ \begin{bmatrix}
\theta_{11,0} & 0 & 0
\\
\theta_{21,0} & \theta_{22,0} & 0
\\
\theta_{31,0} & \theta_{32,0} & \theta_{33,0}
\end{bmatrix} }_{\Theta_0 }
\underbrace{
\begin{bmatrix}
\eta_{1t}
\\
\eta_{2t}
\\
\eta_{3t}
\end{bmatrix} }_{ \eta_t } + \Theta_1 \eta_{t-1} + ...
\end{align}
A relevant study considers the identification of monetary policy shocks using a trivariate SVAR(1) model where $y_t = ( x_t, \Delta p_t, \pi_t )^{\prime}$. However, a drawback of the recursive identification approach is that a different ordering of the variables can yields a different SVAR model with different identified structural shocks (i.e., does not produce uniquely identified structural shocks). On the other hand, it can be easily estimated since it involves estimating the reduced-form model using OLS or MLE, computing the covariance matrix and the computing the lower-triangular Cholesky decomposition.
\paragraph{Non-Recursive Models}
A non-recursively identified SVAR model resembles a traditional system of simultaneous equation models. The associated identifying restrictions practically generate moment conditions that can be used to estimate the SVAR model. Furthermore, using such moment conditions one can employ suitably imposed rank conditions as a mechanism for identification (e.g., see blanchard2003empirical). Although exact identification is not directly a testable hypothesis, we can employ the $J-$test for over identifying restrictions.
itemize• Provided that the order condition is satisfied, the rank condition for identification can be checked by assessing sequentially whether each of the equations can be estimated by the instrumental variables regression, using the variables excluded from each equation as instruments.
• Once an equation has been verified as being identified, then the corresponding structural shock is identified and thus it can be used as instrument since the shocks are uncorrelated.
The GMM estimator is obtained by
align[align omitted — 268 chars of source]
Dynamic Structural Factor Models with Overidentifying Restrictions
As an example of formal statistical testing for overidentifying restrictions we present the framework proposed by han2018estimation who develops a new estimator for the impulse response functions (IRFs) in structural factor models with a fixed number of over-identifying restrictions (see, also Chapter 12 in dhrymes2013mathematics). The proposed identification scheme nests the conventional just-identified recursive scheme as a special case. The first step before formulating the test statistic is to present the identification of structural shocks in the structural factor models setting (see, also koistinen2022estimation).
Consider the following structural factor model for $t = 1,...,T$ such that $\boldsymbol{X}_t = \boldsymbol{\Lambda} \boldsymbol{F}_t + \boldsymbol{e}_t$,
align[align omitted — 189 chars of source]
where $\boldsymbol{X}_t = \big[ X_{1t},..., X_{nt} \big]^{\top}$ is an $n-$dimensional vector, $\boldsymbol{F}_t$ is an $r-$dimensional static factor, $\boldsymbol{\Lambda}$ is an $( n \times r )$ factor loading matrix and $e_t = \big[ e_{1t},...., e_{nt} \big]^{\top}$ is an $n-$dimensional idiosyncratic error term. Moreover, $\boldsymbol{G}$ is an $( r \times q )$ matrix of rank $q$, $\boldsymbol{\eta}_t$ is the $q-$dimensional reduced-form shock and $\boldsymbol{\zeta}_t$ is the $q-$dimensional structural shock. We also have that $\mathbb{E} ( \boldsymbol{\eta}_t \boldsymbol{\eta}_t^{\top} ) = \boldsymbol{I}_q$ and $\boldsymbol{A}$ is a $q \times q$ nonsingular matrix. Setting $q \leq r$, then the proposed framework allows to to obtain dynamic factors. Furthermore, by assuming the stationarity of $\boldsymbol{F}_t$, we have that
align[align omitted — 208 chars of source]
where $\boldsymbol{\Psi}_j$ is the coefficient matrix in the vector moving average representation. Moreover, denote with $\boldsymbol{\mathcal{F}}_t = \big[ \boldsymbol{F}_{t-1}^{\top},..., \boldsymbol{F}_{t-p}^{\top} \big]^{\top}$ and $\boldsymbol{\Phi} = \big[ \boldsymbol{\Phi}_1,..., \boldsymbol{\Phi}_p \big]$. Rearranging equations gives
align[align omitted — 248 chars of source]
where $\boldsymbol{\Pi} = \boldsymbol{\Lambda} \boldsymbol{\Phi}$, $\boldsymbol{\Theta} = \boldsymbol{\Lambda} \boldsymbol{G}$ and $\boldsymbol{\Gamma} = \boldsymbol{\Theta} \boldsymbol{A}$. In other words, for the $i-$th cross-section, the factor model can be represented as $\underline{X}_i = F \lambda_i + \underline{e}_i$, where $\underline{X}_i = [ X_{i1},..., X_{iT} ]^{\top}$ and $F = [ F_1,..., F_T ]^{\top}$ and $\underline{e}_i = [ e_{i1},..., e_{iT} ]^{\top}$. Furthermore, let $\hat{F}_t$ denote the standard PCA estimator for $F_t$, such that $\frac{1}{T} \sum_{t=1}^T \hat{F}_t \hat{F}^{\top}_t = \boldsymbol{I}_r$.
remarkSuppose that the $F_t$ and $e_t$ are uncorrelated, then $
\boldsymbol{\Sigma} = \boldsymbol{\Lambda} \boldsymbol{\Lambda}^{\prime} + \boldsymbol{\Psi}$, where $\boldsymbol{\Sigma} = Var ( \boldsymbol{y}_t )$. By taking the variance of the static factor model we obtain the above expression for the variance, but we also need to impose necessary and sufficient conditions for the identification. Even if $\boldsymbol{\Lambda} \boldsymbol{\Lambda}^{\prime}$ is identified, $\boldsymbol{\Lambda}$ is only identified up to an $( r \times r )$ rotation. Suitable conditions under which $\boldsymbol{\Lambda}$ can be identified imply resolving the rotational indeterminacy (local identification). The factor loading $\boldsymbol{\Lambda}$ is locally identified at $\boldsymbol{\Lambda}^{*}$ if in a small open neighborhood of $\boldsymbol{\Lambda}^{*}$, then $\boldsymbol{\Lambda}^{*}$ is the only matrix that satisfies all the identifying constraints
(see, bai2014identification). According to han2015tests, the existing literature has not addressed the overidentification problem in FAVAR models. Unlike the conventional structural VAR analysis where the number of restrictions for identifying structural shocks, the FAVAR models tend to involve a large number of identifying restrictions.
Identification via Conditional Heteroscedasticity
The presence of structural change in a sample can be exploited as an identification mechanism within a structural system context, especially when the heteroscedasticity of structural variances across the two regimes is exploited (see, hodoshima1988estimation, choi2002structural, lanne2008identifying as well as bacchiocchi2011new). In other words, the presence of heteroscedasticity in the error terms $\varepsilon_t$ of the system can be employed for identifiability purposes. Although, the conditional heteroscedastiticy approach often requires to use a pre-testing procedure before estimating the model as in meitz2021testing, lutkepohl2021testing, bertsche2022identification and guay2021identification; we follow the study of bruggemann2016inference who proposed a framework for the identification of SVARs with conditional heteroscedasticity of unknown form.
Let $( u_t, t \in \mathbb{Z} )$ be a $K-$dimensional white noise sequence defined on a probability space $( \Omega, \mathcal{F}, \mathbb{P} )$, such that each $u_t = \left( u_{1t},..., u_{2t} \right)^{\prime}$ is assumed to be measurable with respect to $\mathcal{F}_t$, where $( \mathcal{F}_t )$ is a sequence of increasing $\sigma-$fields of $\mathcal{F}$. Suppose that we observe a data sample $( y_{-p+1},..., y_0, y_1,..., y_T )$ of sample size $T$ plus $p$ pre-sample values from the following DGP for the $K-$dimensional time series $y_t = \left( y_{1t},..., y_{Kt} \right)^{\prime}$ such that
align[align omitted — 87 chars of source]
where $A(L) = I_k - A_1 L - A_2 L^2 - ... - A_p L^p, \ \ \ A_p \neq 0$.
Consider a $K-$dimensional time series such that $y_t = \left( y_{1t},..., y_{Kt} \right)$ where
align[align omitted — 86 chars of source]
or $A(L) y_t = \mu + u_t$, in compact representation. Denote with $\boldsymbol{y} = \mathsf{vec} \left( y_1,..., y_T \right)$ to be $(KT \times 1)$ vector. Moreover, the parameter $\boldsymbol{\beta}$ is estimated by $
\widehat{\boldsymbol{\beta}} = \mathsf{vec} \left( \widehat{A}_1,..., \widehat{A}_p \right)$, via the multivariate OLS estimator
align[align omitted — 174 chars of source]
Assume that the process $\boldsymbol{y}_t$ is stable, then it has a vector moving-average representation (VMA) s.t.
align[align omitted — 91 chars of source]
where $\Phi_j, j \in \mathbb{N}$, is a sequence of (exponentially fast decaying) $( K \times K)$ coefficient matrices with
align[align omitted — 139 chars of source]
Notice that the standard estimator of $\boldsymbol{\Sigma}_u$ is given by $
\boldsymbol{\Sigma}_u = \frac{1}{T} \sum_{t=1}^T \widehat{u}_t \widehat{u}_t^{\prime}$, where $\hat{u}_t = y_t - \widehat{A}_1 y_{t-1} - ... - \widehat{A}_p y_{t-p}$ are the residuals obtained from the estimated VAR(p) model.
Moreover, we set $\boldsymbol{\sigma} = \mathsf{vech} ( \boldsymbol{\Sigma}_u )$ and $\widehat{\boldsymbol{\sigma}} = \mathsf{vech} ( \widehat{\boldsymbol{\Sigma}}_u )$. The $\mathsf{vech}$-operator is defined to stack column wise the elements on and below the main diagonal of the matrix. A particular useful way to consider the development of the asymptotic theory is to obtain the joint limiting distribution using an unconditional central limit theorem as below
align[align omitted — 224 chars of source]
such that the covariance matrix is partitioned as below
align[align omitted — 164 chars of source]
with the following analytical forms
align[align omitted — 812 chars of source]
remarkNotice that we can also write the following expression
\begin{align}
V^{(2,2)} = \mathsf{Var} ( \boldsymbol{u}_t^2 ) + \sum_{h = - \infty}^{\infty} \mathsf{Cov} \left( \boldsymbol{u}_t^2, \boldsymbol{u}_{t-h}^2 \right)
\end{align}
such that $\boldsymbol{u}_t^2 = \mathsf{vech} ( u_t u_t^{\prime} )$. Hence, $V^{(2,2)}$ has a long-run variance representation in terms of $\boldsymbol{u}_t^2$ that captures the (linear) dependence structure in the underline stochastic sequence. In addition if the errors are i.i.d then we have that
$V^{(2,2)} = \mathsf{Var} ( \boldsymbol{u}_t^2 ) = L_K \tau_{0,0,0} L_K^{\prime} - \boldsymbol{\sigma} \boldsymbol{\sigma}^{\prime}$.
Next, we focus on the residual-based moving block bootstrap resampling method. Various studies in the literature have demonstrated that block bootstrap methods are suitable for capturing dependencies in time series data. Specifically, we are interested in applying the moving block bootstrap technique for the residuals obtained from a fitter VAR$(p)$ model to approximate the limiting distribution of
align[align omitted — 199 chars of source]
itemize• Fit a VAR$(p)$ model to the data to get $\widehat{A}_1,...., \widehat{A}_p$, and compute the residuals $\widehat{u}_t = y_t - \widehat{A}_1 y_{t-1} - \widehat{A}_p y_{t-p}$, for $t = 1,..., T$.
• Choose a block length $\ell < T$ and let $T = \floor{ T / \ell }$ be the number of blocks needed such that $\ell N \geq T$. Moreover, define $( K \times \ell )-$dimensional blocks such that
\begin{align}
B_{i, \ell} = \left( \widehat{u}_{i+1},..., \widehat{u}_{i+\ell} \right), \ \ \ i \in \left\{ 0,..., T - \ell \right\}
\end{align}
such that $i_0,..., i_{N-1}$ be i.i.d random variables uniformly distributed on the set $\left\{ 0,1,..., T - \ell \right\}$. Moreover, we lay blocks $B_{i_0, \ell},..., B_{i_{N-1}, \ell}$ end-to-end together and discard the last $N \ell - T$ values to get bootstrap residuals $\widehat{u}_t^{*},..., \widehat{u}_T^{*}$.
• Centering this sequence of residuals $\widehat{u}_t^{*},..., \widehat{u}_T^{*}$ based on the following rule
\begin{align*}
u_{j \ell + s}
= \widehat{u}_{j \ell + s} - \mathbb{E}^{*} \left[ \widehat{u}_{j \ell + s} \right]
=
\widehat{u}^{*}_{j \ell + s} - \frac{1}{T - \ell + 1} \sum_{r=0}^{T-\ell} \widehat{u}_{s+r}
\end{align*}
for $s \in \left\{ 1,..., \ell \right\}$ and $j \in \left\{ 0,1,2,..., N - 1 \right\}$ and unconditional mean, $\mathbb{E}^{*} ( u_t^{*} ) = 0$, for all $t = 1,..., T$.
• Set bootstrap pre-sample values $y_{-p+1}^{*},..., y_{0}^{*}$ equal to zero and generate the bootstrap sample $y_1^{*},..., y_T^{*}$ according to the following
\begin{align}
y_t^{*} = \widehat{A}_1 y^{*}_{t-1} + ... + \widehat{A}_p y^{*}_{t-p} + u_t^{*}.
\end{align}
• Compute the bootstrap estimator
\begin{align}
\widehat{\boldsymbol{\beta}}^{*} = \mathsf{vec} \left( \widehat{A}_1 ,..., \widehat{A}_p \right)
=
\left( \left( \boldsymbol{Z}^{*} \boldsymbol{Z}^{* \prime} \right)^{-1} \boldsymbol{Z}^{*} \otimes \boldsymbol{I}_K \right) \boldsymbol{y}^{*}
\end{align}
Moreover, we define the bootstrap analogue of $\boldsymbol{\Sigma}_u$ such that
\begin{align}
\boldsymbol{\Sigma}_u^{*} = \frac{1}{T} \sum_{t=1}^T \widehat{u}_t^{*} \widehat{u}_t^{* \prime}
\end{align}
where $\widehat{u}_t^{*} = y_t^{*} - \widehat{A}_1^{*} y_{t-1}^{*} - ... - \widehat{A}_p^{*} y_{t-p}^{*}$ are the bootstrap residuals obtained from the VAR$(p)$ fit. We set $\widehat{\boldsymbol{\sigma}}^{*} = \mathsf{vech} ( \widehat{\boldsymbol{\Sigma}}_u^{*} )$.
theorem[Residual-based MBB Consistency, bruggemann2016inference] Under regularity conditions and if $\ell^3 / T \to \infty$ as $T \to \infty$, it holds that
\begin{align}
\underset{ x \in \mathbb{R}^{ \tilde{K} } }{ \mathsf{sup} } \left| \mathbb{P}^{*} \bigg( \sqrt{T} \left( ( \widehat{\boldsymbol{\beta}}^{*} - \widehat{\boldsymbol{\beta}} )^{\prime}, ( \widehat{\boldsymbol{\sigma}}^{*} - \widehat{\boldsymbol{\sigma}} )^{\prime} \right)^{\prime} \leq x \bigg)
-
\mathbb{P} \bigg( \sqrt{T} \left( ( \widehat{\boldsymbol{\beta}} - \widehat{\boldsymbol{\beta}} )^{\prime}, ( \widehat{\boldsymbol{\sigma}} - \widehat{\boldsymbol{\sigma}} )^{\prime} \right)^{\prime} \leq x \bigg) \right| \to 0
\end{align}
in probability, where $\mathbb{P}^{*}$ denotes the probability measure induced by the residual-based MBB.
Identification via Non-Gaussianity of Structural Shocks
exampleConsider a standard $d-$dimensional VAR$(p)$ process given by (see, petrova2022asymptotically)
\begin{align}
\boldsymbol{Y}_t = \mu_0 + \sum_{i=1}^p B_{0,1} \boldsymbol{Y}_{t-1} + \boldsymbol{\varepsilon}_{t} \equiv \mu_0 + \boldsymbol{B}_0 \odot \boldsymbol{\mathcal{Y}}_{t-1} + \boldsymbol{\varepsilon}_{t}, \ \ \ \boldsymbol{\varepsilon}_{t} \sim ( 0, \Omega_0 ).
\end{align}
where $\boldsymbol{B}_0 = \big[ B_{0,1},..., B_{0,p} \big]$ and $\boldsymbol{\mathcal{Y}}_{t-1} = \big[ \boldsymbol{Y}_{t-1}^{\top},..., \boldsymbol{Y}_{t-p}^{\top} \big]^{\top}$ is an $dp \times 1$ vector containing the lags of the vector $\boldsymbol{Y}_t$ and $\odot$ denotes the inner product between two vectors of the same dimension. Denote with $\mathcal{F}_t = \sigma \big( \boldsymbol{\varepsilon}_{t},..., \boldsymbol{\varepsilon}_{1} \big)$ the natural filtration of the innovation sequence and with $\mathbb{E}_{ \mathcal{F}_t }$ the conditional expectation operator. Recall that covariance stationarity of $\boldsymbol{Y}_t$ yields a vector $MA(\infty)$ representation of the form $\boldsymbol{Y}_t = \sum_{j=- \infty}^{+\infty} \Phi_j \boldsymbol{\varepsilon}_{t-j}$.
\begin{assumption}[see, petrova2022asymptotically]
Suppose that the following conditions hold:
\begin{itemize}
• The VAR process is stable, so that all roots of the polynomial
\begin{align}
\psi(z) = \mathsf{det} \left( \boldsymbol{I}_d - \sum_{j=1}^p z^j \boldsymbol{B}_{0,i} \right), \ lie outside the unit circle.
\end{align}
• The error process $( \boldsymbol{\varepsilon}_{t}, \mathcal{F}_t )_{ t \geq 1}$ has the following properties:
\begin{itemize}
• is a martingale difference sequence satisfying $\mathbb{E}_{ \mathcal{F}_{t-1} } [ \boldsymbol{\varepsilon}_{t} \boldsymbol{\varepsilon}_{t}^{\top} ] = \boldsymbol{\Omega}_0$ for all $t$.
• has time-invariant third and fourth conditional moments such that
\begin{align}
\mathbb{E}_{ \mathcal{F}_{t-1} } \left[ \boldsymbol{\varepsilon}_{t} \odot \mathsf{vech} \left( \boldsymbol{\varepsilon}_{t} \boldsymbol{\varepsilon}_{t}^{\top} \right) \right] = \boldsymbol{\mathcal{S}} \ \ \ \mathbb{E}_{ \mathcal{F}_{t-1} } \left[ \mathsf{vech} \left( \boldsymbol{\varepsilon}_{t} \boldsymbol{\varepsilon}_{t}^{\top} \right) \odot \mathsf{vech} \left( \boldsymbol{\varepsilon}_{t} \boldsymbol{\varepsilon}_{t}^{\top} \right) \right] = \boldsymbol{\mathcal{K}}, \ \forall \ t.
\end{align}
\end{itemize}
\end{itemize}
\end{assumption}
Based on the conditions above (stability condition of the system), a suitable estimation method is the quasi-maximum likelihood method which is robust to distributional misspecifications.
The QML estimators of the model parameters $\boldsymbol{B}_{0,\mu} = [ \mu, \boldsymbol{B}_0 ]$ are given as below:
\begin{align}
\widehat{\boldsymbol{B}}_{0,\mu} = \left( \sum_{t=1}^T \boldsymbol{X}_{t-1} \boldsymbol{X}_{t-1}^{\top} \right)^{-1} \left( \sum_{t=1}^T \boldsymbol{Y}_{t-1} \boldsymbol{X}_{t-1}^{\top} \right), \ \ \ \hat{\Omega}_T = \frac{1}{T} \sum_{t=1}^T \boldsymbol{\varepsilon}_{t} \boldsymbol{\varepsilon}_{t}^{\top},
\end{align}
where $\boldsymbol{\varepsilon}_{t} = \boldsymbol{Y}_t - \widehat{\boldsymbol{B}}_{0,\mu} \boldsymbol{X}_{t-1}$. Estimating the VAR model without an intercept after demeaning leads to the same QML estimators for $\widehat{\boldsymbol{B}}_{0,\mu}$ and $\boldsymbol{\varepsilon}_{t}$, which is a simple consequence of the Frisch-Waugh-Lovell theorem. Moreover, the asymptotic theory analysis can be developed using the
Hessian matrix, denoted with $\mathcal{H}$, such that
\begin{align}
\mathcal{H} ( \boldsymbol{Y}_t; \theta ) = \frac{ \partial^2 \ell ( \boldsymbol{Y}_t; \theta ) }{ \partial \theta \partial \theta^{\prime}}.
\end{align}
remarkThe result of distributional misspecification\footnote{ petrova2022asymptotically mentions that inaccurately imposing Gaussian distributional assumptions in standard multivariate time series models does not affect inference on the autoregressive coefficients but distorts both classical and Bayesian inference on the volatility matrix whenever the true error distribution has excess kurtosis relative to the multivariate normal density. } is that Bayesian methods leads to asymptotically invalid posterior inference for the intercept and the volatility matrix and, consequently, invalid posterior credible sets for quantities such as impulse responses, variance decompositions and density forecasts. Therefore, a Bayesian procedure which delivers asymptotically correct posterior credible sets regardless of distributional assumptions is desirable for constructing the posterior distribution of quantities such as impulse response functions. (see, petrova2022asymptotically).
Generally, exploiting the presence of non-Gaussianity especially in a multivariate system which is more likely to include non-linearities and complex dependencies of unknown forms between variables is an identification method which uniquely determines the structural parameter. However, identification up to signed-permutations reduces the identified set and thus to achieve point identification it is necessary to have a mechanism for selecting a specific permutation as in lanne2017identification (see, also hallin2015r). Recently, chan2023large propose a fast algorithm for identifying the exact permutation scheme based on multiple sign and ranking restrictions.
example[see, lanne2017identification]
Consider the structural VAR (SVAR) model as below
\begin{align}
\boldsymbol{y}_t = \boldsymbol{\mu} + \boldsymbol{A}_1 y_{t-1} + ... + \boldsymbol{A}_p \boldsymbol{y}_{t-p} + \boldsymbol{B} \boldsymbol{\varepsilon}_t,
\end{align}
where $\boldsymbol{y}_t$ is the $d-$dimensional time series of interest, $\boldsymbol{\mu}$, $( d \times 1 )$ is an intercept term such that $\left\{ \boldsymbol{A}_1,..., \boldsymbol{A}_p \right\}$ and $\boldsymbol{B}$ are the $(d \times d)$ parameter matrices with $\boldsymbol{B}$ non-singular, and $\boldsymbol{\varepsilon}_t$ is an $( d \times 1)$ temporally uncorrelated strictly stationary error term with zero mean and finite positive definite covariance matrix. Furthermore, since we consider stationary (or stable) time series, we assume
\begin{align}
\mathsf{det} ( \boldsymbol{A} ) \overset{ \mathsf{def} }{=} \big( \boldsymbol{I}_n - \boldsymbol{A}_1 z - ... - \boldsymbol{A}_p z^p \big) \neq 0, \ \ |z| \leq 1
\end{align}
If we left multiply by the inverse of $\boldsymbol{B}$ we obtain an alternative formulation of the SVAR model such that $
\boldsymbol{A}_0 \boldsymbol{y}_t = \boldsymbol{\mu}^{\star} + \boldsymbol{A}_1^{\star} \boldsymbol{y}_{t-1} + ... + \boldsymbol{A}_p^{\star} \boldsymbol{y}_{t-p} + \boldsymbol{\varepsilon}_t$, where we have that $\boldsymbol{A}_0 = \boldsymbol{B}^{-1}$, $ \boldsymbol{\mu}^{\star} = \boldsymbol{B}^{-1} \boldsymbol{\mu}$, $\boldsymbol{A}_j^{\star} = \boldsymbol{B}^{-1} \boldsymbol{A}_j, \ j \in \left\{ 1,..., p \right\}$. Consider the moving average representation of the model as below:
\begin{align}
\boldsymbol{y}_t = \boldsymbol{\nu} + \sum_{j=0}^{\infty} \boldsymbol{\Psi}_j \boldsymbol{B} \boldsymbol{\varepsilon}_{t-j}, \ \ \boldsymbol{\Psi}_0 = \boldsymbol{I}_n,
\end{align}
where $\boldsymbol{\nu} = \boldsymbol{A}(1)^{-1} \boldsymbol{\mu}$ is the expectation of $\boldsymbol{y}_t$ and the matrices $\boldsymbol{\Psi}_j$, for $j \in \left\{ 0,1,..., \right\}$ are determined by the power series $\boldsymbol{\Psi} (z) = \boldsymbol{A}(1)^{-1} \equiv \sum_{j=0}^{ \infty } \Psi_j z^j$. An appropriate identification is needed to make the two factors in the product $\boldsymbol{B} \boldsymbol{\varepsilon}_t$, and hence the impulse responses $\boldsymbol{\Psi}_j \boldsymbol{B}$, unique. The uniqueness property of the identification scheme is determined only up to a linear transformation of the parameter matrices. The reduced form residuals are assumed to be a linear combination of $d$ independent unobserved variables, that is, the structural shocks. Thus, the identification implies the consistent estimation of structural shocks given the reduced-form error terms (a nonprametric approach is proposed by braun2023importance).
Assume that the matrix $\boldsymbol{B} \equiv \boldsymbol{S} \boldsymbol{C}$ where $\boldsymbol{C} \in \mathbb{R}^{d \times d}$ is orthogonal and $\boldsymbol{S} \in \mathbb{R}^{d \times d}$ is such that $\boldsymbol{\Sigma}_u = \boldsymbol{S} \boldsymbol{S}^{\prime}$. Thus, given a large number of time series observations $\left\{ \boldsymbol{u}_t \right\}_{t=1,...,n}$, then the statistical problem is to consistently estimate the matrix product $\boldsymbol{S} \boldsymbol{C}$ and determine the distribution of the structural shocks $\boldsymbol{\varepsilon}_t$. Since, the matrix $\boldsymbol{S}$ can be directly estimated by matching from the covariance matrix $\boldsymbol{\Sigma}_u$, using the Cholesky decomposition, then the identification problem of the structural parameter matrix, boils down to the consistent estimation of the orthogonal matrix $\boldsymbol{C} \in \mathbb{R}^{d \times d}$. When structural shocks $\boldsymbol{\epsilon}_t$ are assumed to be Gaussian, one can only identify the space of the mixed signals without separating the individual components. The only way to ensure consistent identification is by assuming that structural shocks are non-Gaussian and then proceeding by consistently estimating the orthogonal matrix $\boldsymbol{C}$. To consistently estimate the individual components of the structural shocks we assume joint non-Gaussianity and that the orthogonal matrix $\boldsymbol{C}$ is consistently estimated. The main intuition of exploiting the non-Gaussianity of structural shocks as an identification mechanism as in lanne2017identification can be seen via the concept of time-reversibility (see, findley1986uniqueness, tong2005time, chan2006note and lawrance1991directionality\footnote{Professor Tony Lawrance is an Emeritus Professor at the Department of Statistics, University of Warwick, UK.}) in time series analysis. The notion of time-series reversibility was proposed by economists and financial engineers to address the asymmetry property of business cycles. The presence of asymmetric signals can induce enough skewness to reject the null hypothesis of time-reversibility. Business cycle asymmetry can be tested with respect to whether macroeconomic fluctuations are time irreversible and can also be exploited for identification purposes as in virolainen2020structural (see, nyberg2023risk).
theorem[Uniqueness result]
Suppose that $x_t$ is a non-Gaussian, strictly stationary, zero mean time series whose $r-$th moment $\mathbb{E}( x_t^r )$ are finite for all $r = 1,2,...$. Suppose also that the spectral density of $x_t$ is positive almost everywhere. Then, $x_t$ can have at most one mean square convergent representation $x_t = \sum_{j = - \infty}^{ \infty } c_j \eta_{t-j}$, in which $\eta_t$ is a sequence of i.i.d distributed zero mean random variables with finite moments, ignoring changes of scale and shifts in the time origin of the series $\eta_t$ (see, chan2006note).
example[chan2006note]
Consider the univariate non-Gaussian linear process representation
\begin{align}
X_t = \sum_{j=-\infty}^{\infty} A^{\prime}_j \varepsilon^{\prime}_{t-j}, \ \ \ t \in \mathbb{N}
\end{align}
There exists an integer $m$ and a matrix $B$ such that, for all $t$, (i) $A_t \equiv A_{m - t} B$ and (ii) $B \varepsilon_t$ is distributionally equivalent to $\varepsilon_t$. This uniqueness of a non-Gaussian process implies that, if $X$ admits representation (ref) and $Y_t = \sum_{j=-\infty}^{\infty} A^{\prime}_j \varepsilon^{\prime}_{t-j}$, then $Y$ is distributionally equivalent to $X$ if and only if the previous conditions hold, with the equality concerning the innovations interpreted as equivalence in distribution.
\paragraph{Proof of Proposition 1 in lanne2017identification}
Suppose that the following two conditions hold:
itemize• The error process $\boldsymbol{\varepsilon}_t = \big( \varepsilon_{1,t},..., \varepsilon_{d,t} \big)$ is a sequence of i.i.d random vectors with each component $\varepsilon_{i,t}$, for $i = \left\{ 1,..., n \right\}$, having zero mean and finite positive variance $\sigma_i^2$.
• The components of $\boldsymbol{\varepsilon}_t = \big( \varepsilon_{1,t},..., \varepsilon_{d,t} \big)$ are (mutually) independent and at most one of them has a Gaussian marginal distribution.
A key step is to demonstrate the existence and uniqueness of an equivalent SVAR representation. In particular, one needs to show that the structural shocks of the original model can be determined as a function of the structural shocks of the observetionally equivalent SVAR process multiplied by an unknown permutation matrix $\boldsymbol{M}$ such that $
\boldsymbol{\varepsilon}_t = \boldsymbol{M} \boldsymbol{\varepsilon}_t^{*}, \ \ \ \boldsymbol{M} = \boldsymbol{B}^{-1} \boldsymbol{B}^{*}$. To ensure a valid identification scheme, we need to examine the properties of the elements of this permutation matrix.
Thus, we assume that at most one column of $\boldsymbol{M}$ may contain more than one nonzero element (see, Lemma A.1 in lanne2017identification and kagan1973characterization\footnote{For the interested reader, the property is due to the theory of locally compact abelian groups which implies that any finitely generated group can be expressed as a direct product of cyclic groups. As a result, the duality result allows to construct a distributional equivalent topological space using properties from non-Gaussian topological spaces. Specifically, any compact Hausdorff abelian group can be completely described by the purely algebraic properties of its dual group. Corollary 3 in morris1979duality defines the observetionally equivalent class of topologically isomorphic groups. These theorems remain agnostic regarding the exact properties model estimators are assumed to have ex-ante to the imposed specification, which implies that using a non-Gaussian distributional assumption is sufficient.} Suppose say that the $k-$th column of $\boldsymbol{M}$ has at least two nonzero elements, $m_{i k}$ and $m_{jk}$ such that $i \neq j$. Then, it holds that
align[align omitted — 270 chars of source]
where the random variable $\varepsilon_{k,t}^{*}$ is assumed to be Gaussian with positive variance. Moreover, for all $\ell \in \left\{ 1,..., n; \ell \neq k \right\}$, it must hold that $m_{ik} m_{j \ell} = 0$ because only the $k-$th element of $\boldsymbol{M}$ could have more than one nonzero element. Notice that the purpose of the identification scheme is to distinguish or identify the structural shocks. Due to the independence assumption of the error terms and by the fact that each row of $M$ has exactly one non-zero element, then we can conclude that there exist a permutation matrix $\boldsymbol{P}$ and a diagonal matrix $\boldsymbol{D} = \mathsf{diag} \left\{ d_1,..., d_n \right\}$ with non-zero diagonal elements such that $\boldsymbol{M} = \boldsymbol{D} \boldsymbol{P}$. Rearranging terms implies that $
\boldsymbol{\varepsilon}_t = \boldsymbol{B}^{-1} \boldsymbol{B}^{*} \boldsymbol{\varepsilon}_t^{*}$ and to have observational equivalence it should hold that
align[align omitted — 330 chars of source]
since $\boldsymbol{D}$ is a diagonal matrix then $\boldsymbol{D}^{-1}$ is also a diagonal matrix and $\boldsymbol{P} \boldsymbol{P}^{\prime} = \boldsymbol{I}$ where $\boldsymbol{P}$ represents a permutation matrix within the same equivalence class.
Proposition 1 in lanne2017identification characterizes a class of observationally equivalent SVAR processes that differ only with respect to the ordering and scaling of the structural shocks in the vector $\varepsilon_t$. A (rescaled) error vector of these set of permuted structural shocks, consists of exactly the same elements, whose ordering varies and thus these SVAR processes induces asymptotically equivalently impulse responses functions. Thus, the invariance transformation property allows to identify structural shocks using an observationally equivalent class of SVAR processes based on mutual independence.
Testing for Independence of Structural Shocks
The independence property of structural shocks $\varepsilon_t$ can serve to uniquely identify the structural parameter $B$ it at most one component of $\varepsilon_t$ is Gaussian. Moreover, in non-Gaussian frameworks, one has to consider the entire dependence structure to implement a robust structural analysis. Moreover, although the original identification scheme of lanne2017identification is based on the assumption of at least one Gaussian shock for full identification, the particular result is extended by maxand2020identification who show that the same identification scheme is valid in the case of multiple Gaussian structural shocks while the remaining structural shocks are non-Gaussian. In addition some further studies as in crucil2023monetary and bruns2023testing consider the case of non-Gaussian proxy SVARs. In particular, crucil2023monetary extending the approach of schlaak2023monetary employs an instrumental regression to estimate the structural shock of interest while staying agnostic for the remaining structural shocks.
Testing for the independence of the identified structural shocks obtained from orderings (e.g., a set of permutations of all shocks) of the VAR residuals is an important validation step for the underline assumptions. When a suitable test statistic of independence for the identified shocks doesn't find evidence against the hypothesis of independence then this is an indication that using a non-Gaussian MLE approach should render valid model estimates. Motivated from the presence of such non-Gaussian and heavy-tailed error terms in SVAR models davis2023time study the role of uncertainty in economic fluctuations. Specifically, disaster shocks are shown to have short term economic impact arising mostly from feedback dynamics. In particular, the authors show that the coefficient estimate on the infinite variance regressor would be consistent but not asymptotically normal. As a result, the coefficients of impulse response functions whether there are computed from the VAR or by local projections are likely not to be asymptotically normally distributed. A possible drawback of the particular identification scheme is that exploiting the non-Gaussianity property precludes cases of non-identification. Recently, there is a growing interest in testing not only the distributional assumptions of structural shocks but also indirectly testing the absence of non-identification. In particular, drautzburg2023refining mentiones that criteria such as an inverted GMM test statistic based on co-dependence of higher moments, can be employed to rule out incorrect identification schemes when the data are non-Gaussian. When the data are Gaussian, there is no co-dependence of higher moments and the estimator becomes close to the plug-in estimator in moon2012bayesian (see, also granziera2018inference). Thus, the approach of drautzburg2023refining exploits independence for identification, but does so allowing for weak identification, which indeed remains valid in the Gaussian limit where there is complete lack of identification. Further issues related to identification via non-Gaussianity is the modelling of climate-economic systems which is relevant to the structural analysis of climate shocks to macroeconomic variables.
remarkUnder the assumption of non-Gaussianity, the fact that $\boldsymbol{\varepsilon}_t$ are white noise does not imply that they are serially independent. This is an important aspect of a non-Gaussian VAR model because even if $Corr ( \varepsilon_{it}, \varepsilon_{it+1} ) = 0$ for $i = 1,..., l$, it is still in principle possible that $\varepsilon_{it+1}$ is statistically dependent on $\varepsilon_{it}$. Thus, in this latter case $\varepsilon_{it+1}$ would not be an actual innovation term, since it can be predicted by $y_t$ (see, moneta2013causal).
Identification via External Instruments
exampleFollowing the framework proposed by mittnik1993asymptotic, let $\boldsymbol{\theta}$ be the parameter vector that collects the coefficients of the original SVAR representation.
\begin{itemize}
• Suppose we have the model $
\boldsymbol{A}(L) \boldsymbol{y}_t = \boldsymbol{B}(L) \boldsymbol{\varepsilon}_t$, with $\boldsymbol{\alpha} := \mathsf{vec} \left( \boldsymbol{A}_0,..., \boldsymbol{A}_p \right)$, $\boldsymbol{\beta} := \mathsf{vec} \left( \boldsymbol{B}_0,..., \boldsymbol{B}_p \right)$ and $\boldsymbol{r} := \mathsf{vec} ( \boldsymbol{R} )$, then $\boldsymbol{\theta} = \left( \boldsymbol{\alpha}^{\prime}, \boldsymbol{\beta}^{\prime}, \boldsymbol{r}^{\prime} \right)^{\prime}$. Moreover, let $\boldsymbol{\phi}$ denote the vector of parameters which are estimated, that is, the structural parameters of the system.
• Under the assumption that sufficient restrictions have been imposed to identify $\boldsymbol{\phi}$, we say that these identifying restrictions induce a mapping from $\boldsymbol{\phi} \mapsto \boldsymbol{\theta}$ such that the linear map satisfies $\boldsymbol{\theta} = F( \boldsymbol{\phi} )$. Let $\hat{\boldsymbol{\phi}}$ denote an estimate of $\boldsymbol{\phi}$. Then, under stationarity, invertibility and appropriate regularity conditions on the linear map $F(\cdot)$, $\hat{\boldsymbol{\phi}}$ will be normally distributed such that $\sqrt{T} \left( \hat{\boldsymbol{\phi}} - \boldsymbol{\phi}_0 \right) \overset{d}{\to} \mathcal{N} \left( \boldsymbol{0}, \boldsymbol{\Xi} \right)$.
\end{itemize}
Overall, SVARs are used in the applied macroeconometrics literature to estimate the dynamic causal effects of structural shocks. Parameters in these models have traditionally been point-identified using zero or long-run restrictions. A commonly used approach in empirical macroeconometrics research is to construct time series that capture exogenous changes affecting the macroeconomy. The dynamic effects of these time series can be often estimated using distributed lag regressions. However, these variables are correlated with a particular structural shock and uncorrelated with other structural shocks (e.g., target versus non-target structural shocks). In particular, external instruments impose second moment restrictions that identify SVAR shocks and associated impulse response coefficients.
A major known issue of SVAR-IV models is the weak identification problem which appears in the case that instruments are only weakly correlated with the variable of interest. Specifically, building on the IV regression literature, stock2021inference proposed weak-instrument robust inference methods for impulse response coefficients. Their framework demonstrates how an external instrument can be used to identify the structural shock of interest, its impulse response coefficients, historical effect on the variables in the VAR and contribution to forecast error variances. A relevant identification scheme combines sign restrictions with external instruments is proposed by braun2023identification.
remarkRecall that the invertability property implies that structural shocks can be recovered from current and past (but not future) values of the observed macro variables. On the other hand, it is likely that external shock measures are contaminated by substantial measurement errors, causing attenuation bias. In other words, external instruments can be employed as an informative tool regarding shock importance. For example, an unrestricted linear MA model using IV can be employed to construct related statistics. In such settings a key identifying assumption is the availability of external instruments that are correlated with the shock of interest but are otherwise dynamically uncorrelated with all other macro variables (see, plagborg2022instrumental). Identification of SVAR models with external instruments is also studied by olea2021inference. Lastly, a framework for identifying SVARs with weak proxies is proposed by angelini2024identification.
Identification via Sign-Restrictions and Set-Identified SVARs
Several studies consider the set-identification of SVAR models based on a combination of economic theory and data-driven approaches such as sign restrictions. The key idea behind sign restrictions is to characterise a shock through imposing restrictions on the responses of some variables, while remaining agnostic about others. In particular, inoue2013inference, inoue2016joint study the construction of confidence sets for set-identified parameters. Moreover, giacomini2021robust and giacomini2022robust consider robust inference in Proxy-SVARs with external instruments. Sign restrictions usually imply partial identification (see, dufour2005projection). Additionally, it has several drawbacks including the fact that different structural shocks in the model might be characterized by the same set of sign restrictions. Nevertheless, to illustrate the implementation of the particular identification scheme we follow the framework proposed by gafarov2018delta who contribute to the literature of set-identified SVARs by proposing a novel delta-method interval for the coefficients of the IRF.
Consider the $n-$dimensional SVAR with $p-$lags such that $\boldsymbol{Y}_t = \boldsymbol{A}_1 \boldsymbol{Y}_{t-1} + ... + \boldsymbol{A}_p \boldsymbol{Y}_{t-p} + \boldsymbol{B} \boldsymbol{\varepsilon}_t$.
Then, the object of interest is the $k-$th period ahead structural impulse response function of variable $i$ to a particular shock $j$ such that $
\lambda_{k,i,j} (A,B) \equiv e_i^{\prime} \boldsymbol{C}_k (A) \boldsymbol{B}_j$,
where $\boldsymbol{B}_j \equiv \boldsymbol{B} \boldsymbol{e}_j$ and $e_i$ and $e_j$ denote the $i-$th and $j-$th column of $\boldsymbol{I}_n$. A second object of interest is the vector of reduced-form VAR parameters
align[align omitted — 290 chars of source]
Overall, a common practice in empirical macroeconomics literature is to set equality and inequality restrictions to set-identify the structural IRFs. Specifically, an example of an equality restriction in a monetary VAR is that prices do not react contemporaneously to monetary policy shocks. An example of an inequality restriction is that contractionary monetary policy shock cannot increase prices. Let $\mathcal{R} (\mu) \subset \mathbb{R}^n$ be the set of values of $\boldsymbol{B}_j$ that satisfy the inequality and equality restrictions such that
align[align omitted — 221 chars of source]
where $Z(\mu)$ is a matrix of dimension $( n \times m_z )$ that collects the equality restrictions specified by the researcher and $S(\mu)$ is a matrix of dimension $( n \times m_s )$ that collects the inequality restrictions.
corollary[Directional Differentiability, see gafarov2018delta]
Consider the auxiliary function $\nu_{k,i,j} \left( \mu; r (\mu) \right)$, such that $\nu_{k,i,j} \left( \mu; r (\mu) \right) \neq 0$, then the function $\nu_{k,i,j} \left( \mu; r (\mu) \right)$ is differentiable with respect to $\big( \mathsf{vec}(\boldsymbol{A})^{\prime}, \boldsymbol{\Sigma})^{\prime} \big)^{\prime}$ with derivative given by
\begin{align}
\frac{ \partial \nu_{k,i,j} \left( \mu; r (\mu) \right) }{ \partial \mathsf{vec} (\boldsymbol{A}) }
&=
\frac{ \partial \left( C_k ( \boldsymbol{A}) \right) }{ \partial \mathsf{vec} (\boldsymbol{A}) } \big( x^{*} \left( \mu ; r(\mu) \right) \otimes e_i \big)
-
\sum_{k=1}^{\ell} w_k^* \frac{ \partial ( r_k(\mu) ) }{ \partial \mathsf{vec} (\boldsymbol{A}) } x^{*} \left( \mu ; r(\mu) \right)
\\
\frac{ \partial \nu_{k,i,j} \left( \mu; r (\mu) \right) }{ \partial \mathsf{vec} (\boldsymbol{\Sigma}) }
&=
\lambda^{*} \Sigma^{-1} x^{*} \left( \mu ; r(\mu) \right) \otimes \boldsymbol{\Sigma}^{-1} x^{*} \left( \mu ; r(\mu) \right)
-
\sum_{k=1}^{\ell} w_k^* \frac{ \partial ( r_k(\mu) ) }{ \partial \mathsf{vec} (\boldsymbol{\Sigma}) } x^{*} \left( \mu ; r(\mu) \right).
\end{align}
theorem[see, gafarov2018delta]
Consider a delta-method interval of the following form \begin{align}
CS_T (1-\alpha) \equiv \left[ \nu_{k,i,j}(\widehat{\boldsymbol{\theta}}_T) - z_{1 - \alpha / 2} \frac{ \widehat{\sigma}_{(k,i,j)} }{\sqrt{T}}, \nu_{k,i,j}(\widehat{\boldsymbol{\theta}}_T) + z_{1 - \alpha / 2} \frac{ \widehat{\sigma}_{(k,i,j)} }{\sqrt{T}} \right]
\end{align}
where $\widehat{\boldsymbol{\theta}}_T \equiv \left( \mathsf{vec}( \widehat{\boldsymbol{A}}_T ), \mathsf{vec}( \widehat{\boldsymbol{\Sigma}}_T ) \right)$ is the OLS estimator such that
\begin{align}
\widehat{\boldsymbol{A}}_T \equiv \left( \frac{1}{T} \sum_{t=1}^T \boldsymbol{Y}_t \boldsymbol{X}_t^{\prime}\right) \left( \frac{1}{T} \sum_{t=1}^T \boldsymbol{X}_t \boldsymbol{X}_t^{\prime} \right)^{-1} , \ \ \ \widehat{\boldsymbol{\Sigma}}_T \equiv \frac{1}{ T - np - 1} \sum_{t=1}^T \widehat{\boldsymbol{\eta}}_t \widehat{\boldsymbol{\eta}}_t^{\prime}, \ \ \ \widehat{\boldsymbol{\eta}}_t \equiv \boldsymbol{Y}_t - \widehat{\boldsymbol{A}}_T \boldsymbol{X}_t
\end{align}
Therefore, gafarov2018delta suggested to exploit the specific form of the directional derivative in the SVAR framework via the following expression
align[align omitted — 307 chars of source]
\paragraph{Evaluating the posterior of sign-identified VAR Models}
Consider the $d-$variate reduced-form VAR$(p)$ model such that (see, inoue2013inference)
align[align omitted — 75 chars of source]
for $t = 1,...,T$, where $e_t \overset{ \textit{i.i.d} }{ \sim } \mathcal{N} ( 0_{n \times 1}, \Sigma )$ and $\Sigma$ is positive definite. We write the above econometric model such that
align[align omitted — 24 chars of source]
where $Y = \big[ y_1 \ y_2 \ ... \ y_T \big]^{\prime}_{ T \times k }$, $X = \left[ X_1 \ X_2 \ ... \ X_T \right]$, $X_t = [ 1 \ y_{t-1}^{\prime} \ ... \ y_{t-1}^{\prime} ]$ and $B = [ c \ B_1 \ B_2 \ ... \ B_p ]^{\prime}$. Moreover, we follow the conventional approach of specifying a normal-inverse Wishart prior distribution for the reduced-form VAR parameters.
align[align omitted — 183 chars of source]
where $N_0$ is an $np \times np$ positive definite matrix, $S_0$ is an $n \times n$ covariance matrix and $\nu_0 > 0$.
remarkA common situation in SVARs for monetary policy evaluation is that the model is only partially identified when the identifying policy variable cannot be identified by other available structural shocks. If we are concerned with a subset of impulse response functions only, what matters for constructing the posterior mode is not the joint impulse response distribution, but the marginalized distribution obtained by integrated out responses to shocks that are not identified. Since using tools from Bayesian econometrics is beyond the scope of this course, from the classical point-identification perspective carriero2023blended proposed a blended approach which aims to sharpen identification.
Identification in Proxy SVARs under Possible Nonstationarity
Suppose that $\left\{ Y_t: t = -p+1,...,T \right\}$
be a $( d \times 1 )$ vector of observed variables that follows a SVAR process $
\boldsymbol{Y}_t = \boldsymbol{\mu} + \sum_{j=1}^p \boldsymbol{A}_j \boldsymbol{Y}_{t-j} + \boldsymbol{u}_t, \ \ \ \boldsymbol{u}_t = \boldsymbol{B} \boldsymbol{\varepsilon}_t$, where $\boldsymbol{u}_t$ is the reduced-form error terms and $\boldsymbol{A}_j$ are $( d \times d)$ coefficient matrices for $j \in \left\{ 1,..., p \right\}$. Therefore, to study the IRFs with respect to the structural shocks $\varepsilon_{it}$, we study the estimation of the $i-$th column of the structural parameter $B$ denoted by $\boldsymbol{B} = ( \boldsymbol{b}_1,..., \boldsymbol{b}_d )^{\prime}$ with external instruments $\big\{ \boldsymbol{Z}_{t} = ( z_{1t},..., z_{kt} )^{\prime} \in \mathbb{R}^k : t = 1,..., T \big\}$.
exampleLet $z_t$ denote an external instrument for a structural shock of interest $\varepsilon_{kt}, k \in \left\{ 1,..., K \right\}$. Based on conventional assumptions from the instrumental variable estimation literature, the potential instruments must satisfy the following conditions:
\begin{itemize}
• $z_t$ is relevant for the underlying structural shock $\varepsilon_{kt}$ such that $\mathbb{E} \left( \varepsilon_{kt} z_t \right) = \phi \neq 0$.
• $z_t$ is exogenous from other structural shocks in the system such that $\mathbb{E} \left( \varepsilon_{jt} z_t \right) = 0, \forall \ j \in \left\{ 1,..., K \right\} \backslash \left\{ k \right\}$.
\end{itemize}
Then, based on the above two conditions it follows that up to scale $\phi$, the population covariance between the instrument and VAR residuals obtains the $k-$th column of $B$, denote by $B_k$ such that
\begin{align*}
\mathbb{E} \left( u_t z_t \right) = B_k \mathbb{E} \left( \varepsilon_{kt} z_t \right) = \phi B_k.
\end{align*}
Thus, the link between the structural shock and reduced form-error provides the condition to ensure the instrument validity and instrument relevance. These econometric specifications are also particularly important for the identification of technology shocks as in feve2010identification and pagan2008econometric (see, also lovcha2021identifying). However, according to cheng2022instrumental long-run restrictions can lead to the problem of weak identification due to sensitivity to low-frequency correlations between variables. Furthermore, due to the fact that $y_t$ often includes components which are integrated and cointegrated it is important to develop a robust identification methodology for Proxy SVAR models which is robust to weak identification and possibly nonstationary regressors.
example[Nearly nonstationary SVAR, see gospodinov2010inference]
Suppose that we have a bivariate vector autoregressive process denoted with $\tilde{\boldsymbol{y}}_t = ( y_{1t}, y_{2t} )$ such that
\begin{align}
\boldsymbol{\Psi} (L) = ( \boldsymbol{I} - \boldsymbol{\Phi} L ) \tilde{\boldsymbol{y}}_t = \boldsymbol{u}_t
\end{align}
where the matrix $\boldsymbol{\Phi}$ contains the largest roots of the system and $\boldsymbol{\Psi} (L) = \left( \boldsymbol{I} - \sum_{i=1}^p \boldsymbol{\Psi}_i L^i \right)$ and where $\widetilde{\boldsymbol{A}} (L) = \boldsymbol{\Psi} (L) ( \boldsymbol{I} - \boldsymbol{\Phi} L )$. Consider the reduced form VAR model $
\tilde{\boldsymbol{y}}_t = \boldsymbol{A}_1 \tilde{\boldsymbol{y}}_{t-1} + ... + \boldsymbol{A}_{p+1} \tilde{\boldsymbol{y}}_{t-p-1} + \boldsymbol{u}_t$. Pre-multiplying both sides by the matrix $\boldsymbol{B}_0 = \begin{bmatrix}
1 & - b_{21}^{(0)}
\\
- b_{21}^{(0)} & 1
\end{bmatrix}$, yields the structural VAR model $\boldsymbol{B} (L) \boldsymbol{y}_t = \boldsymbol{\varepsilon}_t$, where $\boldsymbol{B} (L) = \boldsymbol{B}_0 \boldsymbol{A} (L)$ and $\boldsymbol{\varepsilon}_t = \boldsymbol{B}_0 \boldsymbol{u}_t$ denote the structural shocks with are assumed to be orthogonal with variances $\sigma_1^2$ and $\sigma_2^2$. Thus, writing the reduced model in the DF form \begin{align}
\boldsymbol{y}_t = \boldsymbol{A}^{\star}(1) \boldsymbol{y}_{t-1} + \sum_{j=1}^p \boldsymbol{A}^{\star \star}_j \Delta \boldsymbol{y}_{t-j} + \boldsymbol{u}_t,
\end{align}
such that $\boldsymbol{A}^{\star} (L) = L^{-1} \left( \boldsymbol{I} - \widetilde{\boldsymbol{A}} (L) \right)$, $\boldsymbol{A}^{\star} (1) = \boldsymbol{I} + \frac{1}{T} \boldsymbol{\Psi} (1) \boldsymbol{C}$ and $\boldsymbol{A}_i^{\star \star} = - \sum_{j = i + 1}^{p} \boldsymbol{A}_j^{\star}$. This implies that,
\begin{align}
\begin{bmatrix}
\Delta y_{1t}
\\
\Delta y_{2t}
\end{bmatrix}
=
\begin{bmatrix}
\psi_{12}(1) & 0
\\
0 & \psi_{12}(1)
\end{bmatrix}
\begin{bmatrix}
\frac{c}{T} y_{2t}
\\
\frac{c}{T} y_{2t}
\end{bmatrix}
+
\begin{bmatrix}
\sum_{j=1}^p a_{j,11}^{\star} & \sum_{j=1}^p a_{j,12}^{\star}
\\
\sum_{j=1}^p a_{j,21}^{\star} & \sum_{j=1}^p a_{j,22}^{\star}
\end{bmatrix}
\begin{bmatrix}
\Delta y_{1t-j}
\\
\Delta y_{2t-j}
\end{bmatrix}
+
\begin{bmatrix}
u_{1t}
\\
u_{2t}
\end{bmatrix}
.
\end{align}
Notice that for this example following gospodinov2010inference, the author considers a bivariate system of equations and propose an overidentifying restriction which using the VECM representation of the model reduces to the assumption that $b_{12}$ is known and is equal to zero. The relationship between the endogenous variable and the instrument is given by the second equation of the reduced VAR model as
\begin{align}
\Delta \tilde{y}_{2t} = \psi_{22}(1) \frac{c}{T} y_{2t-1} + u_{2,t}, \ \ \ t = 1,...,n, \end{align}
Moreover, based on the long-run restrictions and the model assumptions, it can be proved
\begin{align}
\left( \hat{b}_{12}^{(0)} - b_{12}^{(0)} \right) \Rightarrow \frac{ \sigma_1 }{ \omega_2 } \frac{ \rho \int_0^1 J_c(s) dV_2 (s) + \sqrt{1 - \rho^2} \int_0^1 J_c(s) dV_1(s) }{ c \int_0^1 J_c(s)^2 ds + \int_0^1 J_c(s) dV_2 (s)}.
\end{align}
Long-run restrictions are a popular identification method of SVAR models since the seminal contribution of blanchard1988dynamic, which are commonly used to investigate the hours debate\footnote{In particular, the hours debate is concerned with the short-run effect of a technology shock on hours initiated by gali1999technology and christiano2003happens. Using a bivariate SVAR framework $Y_{1t}$ corresponds to log productivity and $Y_{2t}$ corresponds to log hours. Further studies which investigate the impact of technology shocks to business cycles include francis2005technology, feve2009response and chaudourne2014understanding. For example, feve2009response impose a long-run identifying restriction which implies that the composite non-technology shock has no long-run effect on labor productivity. This means that the upper triangular element of $\boldsymbol{A}(L)$ in the long-run must be zero, that is $A_{12} = 0$, so to uncover this restriction from the estimated VAR$(p)$ model, the matrix $\boldsymbol{A}(1)$ is obtained by the Choleski decomposition of $\boldsymbol{C}(1) \boldsymbol{\Sigma} \boldsymbol{C}(1)$.} of gali1999technology as well as the impact of technology shocks on productivity and output (see, also chari2008structural).
exampleFollowing chaudourne2014understanding, consider a nearly stationary persistent process, which is obtained using the local-to-unity parametrization as in phillips1987towards who consider nearly unit-root process to investigate the asymptotic power of the unit-root tests under a sequence of local alternatives. Therefore, since we are interested to model a highly persistent process which is asymptotically stationary, we consider a sequence of local alternatives such that the process is locally nonstationary but asymptotically stationary and persistent.
\begin{align}
\big( 1 - \rho L \big) \Delta x_t = u_t - \left( 1 - \frac{c}{ \sqrt{n} } \right) u_{t-1}, \ \ t = 1,..., n.
\end{align}
Notice that as $n \to \infty$ and for a high value of $\rho$, this process becomes a stationary persistent process whereas, in a finite sample, the process is characterized by a unit root.
Thus, this process is locally nonstationary but asymptotically stationary and persistent. Such a process appears to be particulary well suited to characterize the dynamics of hours worked because it implies a unit root in a finite sample but is asymptotically stationary and persistent. This is typically the case for per capita hours worked which are included in SVARs. Consider a bivariate representation where $\boldsymbol{X}_t := ( \Delta X_{1t}, X_{2t} )$ for $t = 1,..., n$, such that the variable $X_{1t}$ contains an exact unit root and $X_{2t}$ is a highly persistent variable. Notice that both variables in the vector $X_t$ are asymptotically second order stationary and they admit asymptotically the following Wold representation
\begin{align}
\boldsymbol{X}_t = \boldsymbol{C}(L) \boldsymbol{\varepsilon}_t, \ \ \ \ \boldsymbol{C}(L) = \sum_{j=0}^{\infty} \boldsymbol{C}_j \boldsymbol{\varepsilon}_{t-j},
\end{align}
Consider a Structural Moving Average representation for $\boldsymbol{X}_t$ such that
\begin{align}
\boldsymbol{X}_t = \boldsymbol{A}(L) \boldsymbol{\eta}_t, \ \ \ \ \boldsymbol{A}(L) = \sum_{j=0}^{\infty} \boldsymbol{A}_j,
\end{align}
where $\boldsymbol{\eta}_t = \big( \eta_{1t}, \eta_{2t} \big)^{\prime}$ is the vector of orthogonal shocks with $\mathbb{E} \left( \boldsymbol{\eta}_t \boldsymbol{\eta}_t^{\prime} \right) = \boldsymbol{\Omega}$ a diagonal matrix.
A common identification assumption is that $\boldsymbol{\Omega} = \boldsymbol{I}_2$ which implies that the variance of the structural shocks is normalized to one. Then, we have that the error terms $\boldsymbol{\varepsilon}_t$ from the reduced form are related to the structural error terms $\boldsymbol{\eta}_t$ as follows: $\boldsymbol{\varepsilon}_t = \boldsymbol{A}_0 \boldsymbol{\eta}_t$ which implies that $\boldsymbol{\Sigma} = \boldsymbol{A}_0 \boldsymbol{A}_0^{\prime}$. Therefore, the identification scheme, should ensure the unique identification of the structural parameter $\boldsymbol{A}_0$ and we focus to the case of long-run restrictions as proposed by blanchard1988dynamic. Specifically, we use the long-run variance-covariance matrix of the reduced form and the structural form which are related by $\boldsymbol{C}(1) \boldsymbol{\Sigma} \boldsymbol{C}(1)^{\prime} = \boldsymbol{A}(1) \boldsymbol{A}(1)^{\prime}$ and $\boldsymbol{A}_0 = \boldsymbol{C}(1)^{-1} \boldsymbol{A}(1)$. Typically a lower triangular structure is imposed to the long-run impact matrix $\boldsymbol{A}(1)$ which can be easily obtained using a Choleski decomposition of the long-run covariance matrix $\boldsymbol{C}(1) \boldsymbol{\Sigma} \boldsymbol{C}(1)^{\prime}$. In other words, in the case where two variables are included in $\boldsymbol{X}_t$, the first structural shock is the only one shock that can have a permanent effect on the first variable.
Consider for example, a finite sample of size $T$ observations a structural characterization of the highly persistent variable $\boldsymbol{X}_{2t}$ as a nearly stationary persistent process such that
\begin{align}
\Delta X_{2t}
&=
a_{21}(L) \Delta \eta_{1t} + a_{22}(L) \left( 1 - \left( 1 - \frac{c}{ \sqrt{T} } \right) L \right) \eta_{2t}
\nonumber
\\
&\equiv
a_{21}(L) \Delta \eta_{1t} + \tilde{a}_{22}(L) \eta_{2t}
\end{align}
where $\tilde{a}_{22}(L) = a_{22}(L)\left( 1 - \left( 1 - \frac{c}{ \sqrt{T} } \right) L \right)$. Moreover, using the Beveridge-Nelson decomposition, the above model can be rewritten as below
\begin{align}
\Delta X_{2t}
=
\underbrace{ a_{21}(L) \Delta \eta_{1t} }_{ permanent shock } + \underbrace{ \tilde{a}_{22,T}(1) \eta_{2t} + \tilde{a}^{*}_{22,T}(L) \Delta \eta_{2t} }_{ transitory shock }
\end{align}
such that $\tilde{a}_{22,T}(1) = a_{22,T}(1) c / \sqrt{T}$ and $\tilde{a}^{*}_{22,T}(L) (1 - L) = \tilde{a}^{*}_{22,T}(L) - \tilde{a}^{*}_{22,T}(1)$.
Putting everything together, it implies that the SMA bivariate representation contains a difference stationary process $\Delta X_{1t}$ and a highly persistent process such that
\begin{align}
\begin{bmatrix}
\Delta X_{1t}
\\
\Delta X_{2t}
\end{bmatrix}
=
\begin{bmatrix}
a_{11}(L) & \tilde{a}_{12}(L)
\\
a_{21}(L) (1- L) & \tilde{a}_{22,T}(L)
\end{bmatrix}
\begin{bmatrix}
\eta_{1t}
\\
\eta_{2t}
\end{bmatrix}.
\end{align}
\paragraph{Estimation and inference}
We now consider estimation and inference with the proposed specifications of the SVAR model. The reduced-form moving average representation is retrieved by performing a finite order $\mathsf{VAR}$ on the data. Suppose that the structural moving average representation can be characterized or approximated in a small sample by a finite VAR of order $p$. Consider the reduced form $\mathsf{VAR}(p)$:
\begin{align}
\boldsymbol{D}(L) \boldsymbol{X}_t
=
\boldsymbol{\varepsilon}_t, \ \ \ \boldsymbol{D}(L) =
\boldsymbol{I} - \sum_{i=1}^p \boldsymbol{D}_i \boldsymbol{L}^i
=
\begin{bmatrix}
1 - \sum_{i=1}^p d_{11}^{(i)} L^i & - \sum_{i=1}^p d_{12}^{(i)} L^i
\\
- \sum_{i=1}^p d_{12}^{(i)} L^i & 1 - \sum_{i=1}^p d_{22}^{(i)} L^i
\end{bmatrix}
\end{align}
By multiplying both sides by a matrix of the form $\boldsymbol{B}_0 = \begin{pmatrix}
1 & \textcolor{red}{ - b_{12}^{(0)} }
\\
\textcolor{red}{ - b_{21}^{(0)} } & 1
\end{pmatrix} = \boldsymbol{A}_0^{-1}$, we obtain the VAR as a function of the structural shocks such that $\boldsymbol{B} (L) \boldsymbol{X}_t = \boldsymbol{\eta}_t$ with $\boldsymbol{B} (L) = \boldsymbol{B}_0 \boldsymbol{D}(L)$.
\begin{align*}
&\begin{bmatrix}
1 & \textcolor{red}{ - b_{12}^{(0)} }
\\
\textcolor{red}{ - b_{21}^{(0)} } & 1
\end{bmatrix}
\begin{bmatrix}
1 - \sum_{i=1}^p d_{11}^{(i)} L^i & - \sum_{i=1}^p d_{12}^{(i)} L^i
\\
- \sum_{i=1}^p d_{12}^{(i)} L^i & 1 - \sum_{i=1}^p d_{22}^{(i)} L^i
\end{bmatrix}
\\
&=
\begin{bmatrix}
\left( 1 - \sum_{i=1}^p d_{11}^{(i)} L^i \right) + \textcolor{red}{ b_{12}^{(0)} } \sum_{i=1}^p d_{12}^{(i)} L^i & - \sum_{i=1}^p d_{12}^{(i)} L^i \textcolor{red}{ - b_{12}^{(0)} } \left( 1 - \sum_{i=1}^p d_{22}^{(i)} L^i \right)
\\
\textcolor{red}{ - b_{21}^{(0)} } \left( 1 - \sum_{i=1}^p d_{11}^{(i)} L^i \right) - \sum_{i=1}^p d_{12}^{(i)} L^i & \textcolor{red}{ b_{21}^{(0)} } \sum_{i=1}^p d_{11}^{(i)} L^i + \left( 1 - \sum_{i=1}^p d_{22}^{(i)} L^i \right)
\end{bmatrix}.
\end{align*}
Equivalently, we have that
\begin{align}
\begin{bmatrix}
\left( 1 - \sum_{i=1}^p d_{11}^{(i)} L^i \right) + \textcolor{red}{ b_{12}^{(0)} } \sum_{i=1}^p d_{12}^{(i)} L^i & - \sum_{i=1}^p d_{12}^{(i)} L^i \textcolor{red}{ - b_{12}^{(0)} } \left( 1 - \sum_{i=1}^p d_{22}^{(i)} L^i \right)
\\
\textcolor{red}{ - b_{21}^{(0)} } \left( 1 - \sum_{i=1}^p d_{11}^{(i)} L^i \right) - \sum_{i=1}^p d_{12}^{(i)} L^i & \textcolor{red}{ b_{21}^{(0)} } \sum_{i=1}^p d_{11}^{(i)} L^i + \left( 1 - \sum_{i=1}^p d_{22}^{(i)} L^i \right)
\end{bmatrix}
\begin{bmatrix}
\Delta X_{1t}
\\
X_{2t}
\end{bmatrix}
=
\begin{bmatrix}
\eta_{1t}
\\
\eta_{2t}
\end{bmatrix}
\end{align}
Specifically, the first variable in this bivariate system is expressed as below
\begin{align}
\Delta X_{1t}
=
\left( \sum_{i=1}^p d_{11}^{(i)} L^i - b_{12}^{(0)} \sum_{i=1}^p d_{21}^{(i)} L^i \right) \Delta X_{1t}
+
\left( \sum_{i=1}^p d_{12}^{(i)} L^i + b_{12}^{(0)} \left[ 1 - \sum_{i=1}^p d_{22}^{(i)} L^i \right] \right) X_{2t} + \eta_{1t}.
\end{align}
Moreover, imposing the structural long-run impact matrix $\boldsymbol{A}(1)$ to be lower triangular implies that $\boldsymbol{B}_0 \boldsymbol{D}(1)$ is also lower triangular by $\boldsymbol{A}(1) = \boldsymbol{D}(1)^{-1} \boldsymbol{A}_0$. The long-run multiplier of the variable $\boldsymbol{X}_{2t}$ on $\Delta \boldsymbol{X}_{1t}$ is then zero. Imposing this constraint yields that
\begin{align*}
\Delta X_{1t}
&=
\left( \sum_{i=1}^p d_{11}^{(i)} L^i - b_{12}^{(0)} \sum_{i=1}^p d_{21}^{(i)} L^i \right) \Delta X_{1t}
+
b_{12}^{(0)} \Delta X_{2t}
+
\sum_{i=1}^{p-1} \tilde{b}_{12}^{(i)} L^i \Delta X_{2t} + \eta_{1t}
\\
&=
b_{11}(L) \Delta X_{1t-1} + b_{12}^{(0)} \Delta X_{2t} + \tilde{b}_{12} (L) \Delta X_{2t-1} + \eta_{1t}.
\end{align*}
where the element $b_{12}^{(0)} = - d_{12}(1) / \left( 1 - d_{22}(1) \right)$.
\paragraph{IV Estimation}
The IV estimator of $b_{12}^{(0)}$ with $X_{2t-1}$ as instrument is given by the following expression
\begin{align*}
b_{12}^{(0)}
=
\left( \frac{1}{T} \sum_{t=1}^T X_{2t-1} \Delta \tilde{X}_{2t} \right)^{-1} \left( \frac{1}{T} \sum_{t=1}^T X_{2t-1} \Delta \tilde{X}_{1t} \right)
=
\left( \frac{1}{T} \sum_{t=1}^T X_{2t-1} \Delta \tilde{X}_{2t} \right)^{-1} \left( \frac{1}{T} \sum_{t=1}^T X_{2t-1} \left[ b_{12}^{(0)} \Delta \tilde{X}_{2t} + \eta_{1t} \right] \right)
\end{align*}
which implies that
\begin{align}
\widehat{b}_{12}^{(0)} - b_{12}^{(0)} = \left( \frac{1}{T} \sum_{t=1}^T X_{2t-1} \Delta \tilde{X}_{2t} \right)^{-1} \left( \frac{1}{T} \sum_{t=1}^T X_{2t-1} \eta_{1t} \right) + o_p(1).
\end{align}
We consider the estimation of the structural parameter $b_{21}^{(0)}$. Since $\eta_{1t}$ and $\eta_{2t}$ are orthogonal, the residuals $\widehat{\eta}_{1t} = \Delta \tilde{X}_{1t} - \widehat{b}_{12}^{(0)} \Delta \tilde{X}_{2t}$ can be used as instrument for the endogenous variable $\Delta \tilde{X}_{1t}$. Thus, it holds that $\widehat{\eta}_{1t} - \eta_{1t} = \left( \widehat{b}_{12}^{(0)} - b_{12}^{(0)} \right) \Delta \tilde{X}_{2t}$. Moreover, we shall define with $z_t = \left( \widehat{\eta}_{1t}, X_{2t-1} \right)^{\prime}$ and $x_t = \left( \Delta \tilde{X}_{1t}, \tilde{X}_{2t-1} \right)^{\prime}$. Then, the IV estimator of $b_{12}^{(0)}$ is given by
\begin{align}
\widehat{\beta} = \left( \frac{1}{T} \sum_{t=1}^T z_t x_t^{\prime} \right)^{-1} \left( \frac{1}{T} \sum_{t=1}^T z_t \Delta X_{2t}^{\prime} \right).
\end{align}
\paragraph{Impulse Response Function Analysis}
Consider the following $\mathsf{VAR}(1)$ model as below
\begin{align}
\Delta X_{1t} &= \textcolor{red}{ b_{12}^{(0)} } \Delta X_{2t} + \eta_{1t}
\\
X_{2t} &= \textcolor{red}{ b_{21}^{(0)} } \Delta X_{1t} + \textcolor{red}{ b_{22} } X_{2t-1} + \eta_{2t}
\end{align}
Notice that the highly persistent variable represents hours worked. Generally, it can be proved that estimated impulse responses from LSVAR and SDVAR models are biased in a finite sample if the measure of productivity is contaminated by low frequency movements in hours. Moreover, although these estimators are asymptotically consistent they display a nonstandard limiting distribution.
example[SVAR reduced-form representation, cheng2022instrumental] Suppose that we have a vector of macroeconomic variables $\boldsymbol{Y}^{*}_t$ such that $\boldsymbol{Y}^{*}_t := \boldsymbol{\mu} + \boldsymbol{Y}_t$. Consider the SVAR model formulation
\begin{align}
\underbrace{ \boldsymbol{Y}^{*}_t }_{ (k \times 1) } =
\boldsymbol{\delta} + \sum_{j=1}^p \boldsymbol{\Phi}_j \boldsymbol{Y}^{*}_{t-j} + \boldsymbol{u}_t, \ \ \ \boldsymbol{u}_t = \boldsymbol{B} \boldsymbol{\varepsilon}_t, \ \ \ t = -p + 1,..., T.
\end{align}
Thus, by taking the demeaned vector of regressors $\boldsymbol{Y} = \left( \boldsymbol{Y}_t^{*} - \boldsymbol{\mu} \right)$ we proceed by considering the following reduced-form representation. In other words, we allow the SVAR process to consist of a set of near-unit root and cointegrated variables.
Specifically, cheng2022instrumental employ the reduced-form:
\begin{align}
\boldsymbol{Y}_{1t} &= \left( \boldsymbol{I}_{k_1} + \frac{ \boldsymbol{C} }{ n } \right) \boldsymbol{Y}_{1,t-1} + \boldsymbol{u}_{1t}, \ \boldsymbol{u}_{1t}\in \mathbb{R}^{k_1},
\\
\boldsymbol{Y}_{2t} &= \boldsymbol{\Pi} \boldsymbol{Y}_{1t} + \boldsymbol{u}_{2t}, \ \boldsymbol{u}_{2t} \in \mathbb{R}^{k_2},
\\
\boldsymbol{Y}_{3t} &= \boldsymbol{u}_{3t}, \ \boldsymbol{u}_{3t} \in \mathbb{R}^{k_3}
\end{align}
where it holds that $\boldsymbol{\Psi} (L) \boldsymbol{u}_t = \boldsymbol{e}_t$ such that $\boldsymbol{u}_t = \big( \boldsymbol{u}_{1t}^{\prime}, \boldsymbol{u}_{2t}^{\prime}, \boldsymbol{u}_{3t}^{\prime} \big)^{\prime}$ and $\boldsymbol{e}_t = \big( \boldsymbol{e}_{1t}^{\prime}, \boldsymbol{e}_{2t}^{\prime}, \boldsymbol{e}_{3t}^{\prime} \big)^{\prime}$ such that
\begin{align}
\boldsymbol{\Psi} (L) = \boldsymbol{I}_k - \boldsymbol{\Psi}_1 (L) - ... - \boldsymbol{\Psi}_{p-1} (L) L^{p-1},
\end{align}
is a $(p-1)th-$order lag polynomial and $k = k_1 + k_2 + k_3$ is the number of regressors. Based on the data generating process and SVAR process defined above, we assume that $\boldsymbol{Z}_t$ follows a linear process $
\boldsymbol{Z}_t = \mu_Z + \boldsymbol{\Xi} (L) \boldsymbol{v}_t,
$.
assumptionSuppose that the following conditions hold:
\begin{itemize}
• The roots of $\Psi (L)$ has all roots outside the unit circle.
• $\boldsymbol{\Xi}_0 = \boldsymbol{I}_K$, where $\boldsymbol{\Xi} (1)$ has full rank, where $\displaystyle \sum_{ j = 0}^{ \infty } j^2 \left\lVert \boldsymbol{\Xi}_j \right\rVert^2 < \infty$.
• Suppose that $\bar{\boldsymbol{e}}_t = [ \boldsymbol{e}_t^{\prime}, \boldsymbol{v}_t^{\prime} ]^{\prime}$ is an $\textit{i.i.d} ( r + k ) \times 1$ vector with mean zero, $\mathbb{E} \big[ \bar{\boldsymbol{e}}_t \bar{\boldsymbol{e}}_t^{\prime} \big] = \boldsymbol{\Sigma}$ is positive definite, fourth moments of $\bar{e}_t$ are finite, and $\boldsymbol{e}_t$ is homoscedastic conditional on $\boldsymbol{v}_t$.
\end{itemize}
Then, it can be shown that the DGP can be reformulated as below
align[align omitted — 889 chars of source]
Denote with $\boldsymbol{X}_t = \big[ \left( \boldsymbol{Y}^{*}_{1,t-1} - \boldsymbol{\mu}_1 \right)^{\prime}, \boldsymbol{1}, \boldsymbol{D}_t^{\prime} \big]^{\prime}$, then the original SVAR process (which includes a model intercept) and the above reformulation based on the demeaned original series has an one-to-one transformation. Moreover, this equivalent representation implies that the least-squares residual $\hat{\boldsymbol{u}}_t$ from the VAR process is numerically equivalent to that obtained from regressing $\Delta \boldsymbol{Y}_t$ on $\boldsymbol{X}_t$. Therefore, we shall use the conventional SVAR representation for practical estimation purposes such as to obtain the OLS residuals of the model whereas we use the above reformulation for the asymptotic theory analysis of the corresponding model estimator under the presence of both near-unit and cointegrated regressors.
Next, for the near unit root regressors we denote with $\boldsymbol{J}_c (s)$ an $( k_1 \times 1 )$ vector OU process such that it satisfies the following stochastic differential equation $d \boldsymbol{J}_c (s) = \boldsymbol{C} \boldsymbol{J}_c (s) + d \boldsymbol{B}_u (s)$. Denote with $\boldsymbol{\mathcal{D}}_n$ the diagonal matrix $
\boldsymbol{\mathcal{D}}_n =
bmatrix[bmatrix omitted — 115 chars of source]
$.
Moreover, it holds that
align*[align* omitted — 1,404 chars of source]
which converges into the following stochastic matrix
align*[align* omitted — 564 chars of source]
Therefore, the following converges results holds
align[align omitted — 384 chars of source]
\paragraph{Proof of VEC Representation}
align*[align* omitted — 219 chars of source]
Our goal is to demonstrate that the data generating process with three equations representing the case of both near unit roots and cointegrated regressors, is equivalent to the original SVAR formulation.
align*[align* omitted — 415 chars of source]
where the above regressors correspond to their demeaned counterparts. In other words we start by rewritting the regressors specific represenation to the equivalent general SVAR process.
align[align omitted — 980 chars of source]
Recall that we have that $\boldsymbol{u}_t := \boldsymbol{P} \boldsymbol{e}_t$ which implies by the change of basis rule
align*[align* omitted — 623 chars of source]
Thus in matrix notation we have that $\Delta \boldsymbol{Y}^{*}_t = \boldsymbol{M} \left( \boldsymbol{Y}^{*}_{t-1} - \boldsymbol{\mu} \right) + \boldsymbol{P} \boldsymbol{\Psi} (L)^{-1} \boldsymbol{e}_t$. Multiplying both sides by $\boldsymbol{P} \boldsymbol{\Psi} (L) \boldsymbol{P}^{-1}$, we obtain
align[align omitted — 264 chars of source]
remarkIn summary, cheng2022instrumental show that that in the presence of stationary regressors, cointegration relationships, or more than one lag variables in the VAR system, the estimation error from the nonstationary component is asymptotically negligible. Specifically, the authors prove that the asymptotic variance of the IRF only depends on the stationary component, but a consistent covariance matrix estimator is available even without knowing which series are stationary. Although the approach of cheng2022instrumental shows that for a proxy SVAR standard asymptotic normal inference remains valid under a general form of nonstationarity in the VAR system, their theoretical result is not uniform over the entire parameter space of the roots of the autoregressive model as in the spirit of mikusheva2007uniform. A relevant framework that demonstrates the robustness of SVAR identification and estimation to the presence of unit root and cointegration dynamics is proposed by chevillon2020robust.
Identification with Occasionally Binding Constraints
At the Zero Lower Bound (e.g., see eggertsson2014can and aruoba2022svars) the ability of policy makers to react to macroeconomic shocks is limited and therefore the response of the economy to shocks will change when the policy instrument hits the ZLB. Thus, according to mavroeidis2021identification since the difference in the behaviour of the macroeconomic variables across the ZLB and non-ZLB regimes is only due to the impact of monetary policy, the switch across regimes provides information about the causal effects of policy. Therefore, the ZLB identifies the causal effect of policy during the unconstrained regime. However, if monetary policy remains partially effective during the ZLB regime, for example, through the use of unconventional policy instruments, then the difference in the behaviour of the economy across regimes will depend on the difference in the effectiveness of conventional and unconventional policies. In this case, we obtain only partial identification of the causal effects of monetary policy, but we can still get information bounds on the relative efficiency of unconventional policy.
From the econometric perspective a major challenge when the restriction mechanism involves OBCs is that it generates censoring of one of the dependent variables. Specifically, once the censoring mechanism is triggered then one can allows for some of the coefficients for the remaining variables to change. According to aruoba2022svars the specification of a dynamic multivariate model with censoring and regime-dependent coefficients faces two challenges: parsimony and the existence of a unique reduced form. These models distinguish between a shadow rate, $y_{1t}^{*}$, and the actual interest rate $y_{1,t} = \mathsf{max} \left\{ y_{1t}^{*}, c \right\}$ by defining the endogenous variable $s_t = \boldsymbol{1} \left\{ y_{1,t} > c \right\}$. This implies that the regime-dependency of the coefficients is equivalent to capturing nonlinearities in decision rules that arise in DSGE models with occasionally-binding constraints. Moreover, duffy2022cointegration mentions that in an autoregressive model, an occasionally binding constraint naturally give rise to nonlinearity in the form of links between unit roots and stochastic trends. A prototypical model from the VECM literature is
align[align omitted — 202 chars of source]
On Causal Discovery and Identification
Causal ordering provides a mechanism for causal effect justification in identification and estimation of SVARs. In particular, moneta2011causal studies statistical methodologies for causal inference in SVAR models while other authors propose a graph-theoretic method for causal analysis in vector autoregressions which allows to select the causal (contemporaneous) order of a SVAR model. Thus, a key role to the theory of causal discovery plays the framework for recursive causal models proposed by kiiveri1984recursive. The recursive causal modelling approach utilizes the notion of conditional independence (pioneered by wright1934method and wold1960generalization), for system identification purposes. Moreover, swanson1997impulse discuss the estimation of impulse response functions based on a causal approach to residual orthogonalization in vector autoregressions and propose a search algorithm as statistical mechanism for non-recursive structural models while hausman1983identification discuss the use of IV regression as an identification mechanism for systems of simultaneous equations
In this direction, silva2017learning examine structural learning using instrumental variables under the non-Gaussianity assumption. Their IV causal discovery method provides a set of potential causal effects, from which a unique causal discovery is attainable if at least two instrumental variables (under the same conditioning set) are present in the true underline graph. Moreover, to facilitate computational flexibility this methodology focuses on completeness, that is, on the characterization of relation as causals when instrumental variables satisfy the given Graphical criteria, rather than the identification of all causal effects induced from faithfulness assumptions. A graphical approach to estimating high-dimensional VAR models is presented by fragetta2011effects and bertsche2023directed.
exampleConsider the standard linear structural VAR model as below
\begin{align}
\boldsymbol{y}_t = \sum_{j=1}^p \boldsymbol{A}_j \boldsymbol{y}_{t-j} + \boldsymbol{A}_0 \boldsymbol{\varepsilon}_t, \ \ \ \boldsymbol{u}_t = \boldsymbol{A}_0 \boldsymbol{\varepsilon}_t
\end{align}
We shall demonstrate the above ideas with based on the SVAR process by considering the independence properties of structural shocks. These are summarized as below:
\begin{itemize}
• If $\left( \varepsilon_{t,1},..., \varepsilon_{t,K} \right)$ are mutually independent and non-Gaussian then the error equation is an ICA model and the matrix $\boldsymbol{A}_0$ can be identified up to a post-multiplication of a generalized permutation matrix (see, eriksson2004identifiability, gourieroux2017statistical and lanne2017identification).
• If for any permutation matrix $\boldsymbol{P}$, the matrix $\boldsymbol{P} \boldsymbol{A}_0^{-1} \boldsymbol{P}^{\top}$ is lower triangular, then the matrix $\boldsymbol{A}_0^{-1}$ is uniquely determined.This is a property that holds for the structural parameter $\boldsymbol{A}_0^{-1}$.
• The recursiveness property of $\boldsymbol{A}_0^{-1}$, implies that a recursive causal structure on the contemporaneous variables of the structural VAR model hold: if the assumption is true, one can re-order the variables entering in $\boldsymbol{y}_t$ in a "Word Causal Chain" (see, wold1960generalization), so that each variable $y_{t,i}$ causes $y_{t,j}$ and no variable $y_{t,j}$ causes $y_{t,i}$ for $i < j$ (lower triangular elements) where $i, j \in \left\{ 1,..., K \right\}$.
• Since the structural parameter $\boldsymbol{A}_0^{-1}$ is a triangular matrix, a convenient way to represent the error vector $\boldsymbol{u}_t$ is with a directed acyclic graph (DAG) (see, discussion in moneta2013causal).
\end{itemize}
Suppose that $\boldsymbol{P} \boldsymbol{A}_0^{-1} \boldsymbol{P}^{\top}$ is lower triangular, without loss of generality, with $\boldsymbol{P} = \boldsymbol{I}$ and $K = 3$. Then, we have the following system of structural equations between the innovation terms:
\begin{align*}
u_{t,1} &= \varepsilon_{t,1}
\\
u_{t,2} &= \alpha \varepsilon_{t,1} + \varepsilon_{t,2}
\\
u_{t,3} &= \beta \varepsilon_{t,1} + \gamma \varepsilon_{t,2} + \varepsilon_{t,2}
\end{align*}
In other words, when the true DAG is known, then we are able to add zero restrictions (just-identifying or over-identifying) on the structural parameter $\boldsymbol{A}_0^{-1}$ and recover the independent shocks $\varepsilon_t$ (see, cordoni2023identification). Thus, knowing the causal structure is key for identification in structural econometric models. Notice that the ICA approach works well in the setting of identifying structural shocks because it preserve the causal ordering and causality of variables.
exampleConsider the formulation of the multivariate time series model with respect to contemporaneous and lagged coefficients
\begin{align}
\boldsymbol{y}_t = \boldsymbol{B} \boldsymbol{y}_t + \boldsymbol{\Gamma}_1 \boldsymbol{y}_{t-1} + ... + \boldsymbol{\Gamma}_p \boldsymbol{y}_{t-p} + \boldsymbol{\varepsilon}_t
\end{align}
The structural parameter $\boldsymbol{B}$ has a zero diagonal by definition and $\boldsymbol{\varepsilon}_t$ is a $( k \times 1)$ vector of error terms. The model can be equivalently expressed in the standard SVAR form
\begin{align}
\boldsymbol{\Gamma}_0 \boldsymbol{y}_t = \boldsymbol{\Gamma}_1 \boldsymbol{y}_{t-1} + ... + \boldsymbol{\Gamma}_p \boldsymbol{y}_{t-p} + \boldsymbol{\varepsilon}_t
\end{align}
where $\boldsymbol{\Gamma}_0 = ( \boldsymbol{I} - \boldsymbol{B} )$. Moreover, in the standard SVAR model it is assumed that the covariance matrix $\boldsymbol{\Sigma}_{\varepsilon} = \mathbb{E} \left( \boldsymbol{\varepsilon}_t \boldsymbol{\varepsilon}_t^{\prime} \right)$. However, since the variables $( y_{1t},..., y_{kt} )$ are endogenous, these models cannot be directly estimated without biases. We can thus derive the reduced-form VAR model as below
\begin{align}
\boldsymbol{y}_t &= \boldsymbol{\Gamma}_0^{-1} \boldsymbol{\Gamma}_1 \boldsymbol{y}_{t-1} + ... + \boldsymbol{\Gamma}_0^{-1} \boldsymbol{\Gamma}_p \boldsymbol{y}_{t-p} + \boldsymbol{\varepsilon}_t
\\
\boldsymbol{y}_t &= \boldsymbol{A}_1 \boldsymbol{y}_{t-1} + ... + \boldsymbol{A}_p \boldsymbol{y}_{t-p} + \boldsymbol{u}_t
\end{align}
where $\boldsymbol{u}_t$ is a vector of zero-mean white noise processes with covariance matrix such that $\boldsymbol{\Sigma}_u = \mathbb{E} \left( \boldsymbol{u}_t \boldsymbol{u}_t^{\prime} \right)$, which in general will not be diagonal. Although the VAR parameters can be easily directly estimated from the observed data, this is not sufficient to recover the parameters of the SVAR equation, whose number is larger than the number of parameters in the VAR equation. In other words, the reduced-form VAR model is only adequate for estimation and forecasting purposes and not sufficient for policy analysis (see, moneta2013causal).
Consider the Wold Moving Average (MA) representation of the VAR model such that
\begin{align}
\boldsymbol{y}_t
=
\sum_{j=0}^{\infty} \boldsymbol{\Phi}_j \boldsymbol{u}_{t-j}
=
\sum_{j=0}^{\infty} \boldsymbol{\Phi}_j \boldsymbol{\Gamma}_0^{-1} \boldsymbol{\Gamma}_0 \boldsymbol{u}_{t-j}
=
\sum_{j=0}^{\infty} \boldsymbol{\Psi}_j \boldsymbol{\varepsilon}_{t-j}.
\end{align}
where the $\boldsymbol{\Phi}_j$ for $j = 0,1,2,...$ are the MA coefficient matrices and $\boldsymbol{\Psi}_j$ for $j = 0,1,2,...$ represent the impulse responses of the elements of $\boldsymbol{y}_t$ to the shocks of $\boldsymbol{\varepsilon}_{t-j}$ for $j = 0,1,2,...$
\begin{align}
\boldsymbol{\Phi}_0 = \boldsymbol{I}, \ \ \ \boldsymbol{\Phi}_i = \sum_{j=1}^i \boldsymbol{A}_j \boldsymbol{\Phi}_{i-j}, \ \ \ \boldsymbol{\Psi}_0 = \boldsymbol{\Gamma}_0^{-1}, \ \ \ \boldsymbol{\Psi}_i = \sum_{j=1}^i \boldsymbol{A}_j \boldsymbol{\Psi}_{i-j}.
\end{align}
where $\boldsymbol{A}_j = 0$ for $j > p$. Therefore, we can see that the impulse response coefficients $\boldsymbol{\Psi}_j$ can be obtained from the reduced-form VAR parameters $\boldsymbol{A}_j$ only if we know the SVAR coefficient matrix $\boldsymbol{\Gamma}_0 = (\boldsymbol{I} - \boldsymbol{B})$.
Since the impulse responses are crucial for policy analysis, it is clear that we need to recover the SVAR representation for this purpose. The problem is that any invertible unit-diagonal matrix $\boldsymbol{\Gamma}_0$ is compatible with the coefficient matrices we obtain by estimating the VAR reduced form. In other words, we shall find the correct $\boldsymbol{\Gamma}_0$ which produces the right transformation $\boldsymbol{\Gamma}_0 \boldsymbol{u}_t = \boldsymbol{\varepsilon}_t$ of the VAR error terms $\boldsymbol{u}_t$. The equivalence between covariance restrictions and IV was first discussed by hausman1983identification.
example[Impulse Response Functions]
The impulse response functions are calculated considering the system in levels. Specifically, the forecast error of the $h-$step forecast of $Y_t$ is given by
\begin{align}
\big( Y_{t+h} - Y_t (h) \big) = u_{t+h} + \Phi_1 u_{t+h-1} + ... + \Phi_{h-1} u_{t+1}.
\end{align}
Notice that the $\Phi_i$ are obtained from the $A_i$ recursively by the following expression
\begin{align}
\Phi_i = \sum_{j=1}^i \Phi_{i-j} A_j, \ \ \ i = 1,2,...
\end{align}
with $\Phi_0 = I_k$. Since $v_t = ( I - B_0 ) u_t$, then the forecast-error of the $h-$step ahead forecast of $Y_t$ is
\begin{align}
\big( Y_{t+h} - Y_t (h) \big) = \Theta_0 v_{t+h} + \Theta_1 v_{t+h-1} + ... + \Theta_{h-1} v_{t+1}.
\end{align}
where $\Theta_i = \Phi_i ( I - B_0 )^{-1}$. Notice that the element $(j,k)$ of $\Theta_i$ represents the response of the variable $y_j$ to a unit shock in the variable $y_k$, $i$ periods ago.
example[Uncertainty Shocks]
A growing steam of literature considers the identification of uncertainty shocks especially in relation to financial uncertainty and macroeconomic conditions. Since the work of bloom2009impact (see, also jurado2015measuring and baker2016measuring) a vast literature studies on the role of uncertainty shocks for macroeconomic fluctuations. In particular, measuring uncertainty is important for correctly measuring the impact it has on macroeconomic variables through structural analysis (e.g., see trung2019spillover). We can show that the identification procedure proposed in the study of forni2023macroeconomic is equivalent to the Proxy-SVAR methodology (see also carriero2023macro).
\begin{proof}
We can show that the OLS estimates are identical to those in the study of \textcolor{blue}{Mertens and Ravn (2013)} if the number of lags of $y_t$ included in the regression of the exogenous instruments $z_t$ is equal to the number of lags of the VAR for $y_t$. Since $A(L) y_t = \mu + \varepsilon_t$
\begin{align}
y_t = \mu - A_1 y_{t-1} - ... - A_p y_{t-p} + \varepsilon_t.
\end{align}
Suppose that $k < p$ such that $k \in \left\{ 1,..., p \right\}$, then using the stack vectors forms we obtain
\begin{align}
Y_k =
\begin{pmatrix}
y_{p+1- k}^{\prime}
\\
y_{p+2- k}^{\prime}
\\
\hdots
\\
y_{n - k}^{\prime}
\end{pmatrix}, \ \ \
X = \big( 1 \ Y_1 \ ... Y_p \big), \ \ \
\mathcal{E} =
\begin{pmatrix}
\varepsilon_{p+1- k}^{\prime}
\\
\varepsilon_{p+2- k}^{\prime}
\\
\hdots
\\
\varepsilon_{n - k}^{\prime}
\end{pmatrix}
\end{align}
Moreover, let $Y = Y_0$. Hence, the VAR equation can be written as $Y = X A + \mathcal{E}$ (proof to be completed).
\end{proof}
Further studies which consider the identification of SVARs under the presence of policy uncertainties include mumtaz2018policy (see, also ramey2011identifying).
Identifying Aggregate Fluctuations
A particular stream of literature focuses on the identifying aggregated fluctuations through sectoral and firm-specific dynamics. Specifically, gabaix2011granular proposed a framework for investigating the granular origins of aggregate fluctuations. In addition, gabaix2023granular illustrate when the market is sufficiently concentrated, then one can use the collection of idiosyncratic shocks to individual micro units, at each time period, as an instrument for endogenous aggregate variables. Moreover, a full-information approach to Granular Instrumental variables is proposed by baumeister2023full while a framework for heterogeneity-robust granular instruments is presented by qian2023heterogeneity. Lastly, banafti2022inferential establish inferential theory for GIVs in high dimensional settings.
Granular Instrumental Variables
exampleSuppose we are willing to assume that the shock to country $j'$s demand consist of a global demand shock $f_{ct}$ that affects all consumers across economies in the same way and a purely idiosyncratic shock $\eta_{cjt}$. In other words, the GIV approach provides a systematic way of constructing instruments from suitably weighted idiosyncratic shocks (using observational datasets) and use them as instruments for aggregate endogenous variables. Then, the framework of banafti2022inferential aims to generalize the method of granular instrumental variable.
\begin{align}
d_t = \phi^d p_t + \varepsilon_t, \ \
y_{it} = \phi^s p_t + \boldsymbol{\lambda}_i^{\prime} \boldsymbol{\eta}_t + u_{it}
\end{align}
The global market clearing condition is given by $y_{St} = d_t$, where $y_{St} := \boldsymbol{S}^{\prime} \boldsymbol{y}_{\cdot t} = \sum_{i=1}^N S_i y_{it}$, where $\boldsymbol{S}$ is the $( N \times 1)$ vector of shares that are normalized such that $\sum_{i=1}^N S_i = 1$.
Feasible Granular Instrumental Variables
Consider the following panel simultaneous equations model with factor error structure
align[align omitted — 228 chars of source]
Asymptotic distribution for structural parameters in factor augmented regressions in time series and panel models is already well-developed in the literature. When both $N$ and $T$ are large, then it can be shown that the sampling error from estimating the high dimensional precision matrix, the factors, as well as the instrument is negligible in the asymptotic distribution of the structural parameters. Moreover, in the case of supply elasticity, the estimator will additionally depend on the estimated (potentially high dimensional) precision matrix. Therefore, the contribution of banafti2022inferential to the GIV literature focuses around relaxing the homogenous loadings assumption which is overly restrictive and propose constructing an estimate of the instrument using PCA or iterative OLS-PCA methods.
Extensions
Extension 1: VARMA Representation
Suppose that the $k-$dimensional process $\left\{ \boldsymbol{Y}_t: t \in \mathbb{Z}\right\}$ has the following VARMA representation
align[align omitted — 105 chars of source]
where $\left\{ \varepsilon_t \right\}$ is the innovation process, a sequence of independent and identically distributed random variables with zero-mean and an invertible covariance matrix $\Sigma$ (see, also gourieroux2020identification).
The following representation also holds
align[align omitted — 172 chars of source]
theorem[see, melard2006exact]
Let $\Phi (1)$ be a $(k \times k)$ matrix such that $\mathsf{rank} \left\{ \Phi (1) \right\} = (k - d ) = r$, where $0 < d < k$. Let $P_1$ be any $( k \times d )$ matrix such that $\Phi (1) P_1 = 0$ and $P_2$ be any $( k \times r)$ matrix such that $P = [ P_1 , P_2 ]$ is invertible and the columns of $P_2$ are orthogonal to those of $P_1$. Let $P^{-1} \equiv Q = \big[ Q_1^{\prime}, Q_2^{\prime} \big]^{\prime}$ stands for the inverse of $P$, with $Q_1$ and $Q_2$ having $d$ and $r$ rows, respectively then the matrices $P_1 Q_1$ and $P_2 Q_2$ are uniquely determined. The singular value decomposition of $\Phi (1)$ can be written as $\boldsymbol{\Phi} (1) = \boldsymbol{U} \boldsymbol{D} \boldsymbol{V}^{\prime}$, where $\boldsymbol{U}$ and $\boldsymbol{V}$ are $( k \times k)$ orthogonal matrices.
(Sketch Proof)
itemize• The null space of $\Phi (1)$, that is, the set of vectors $x$ such that $\Phi (1) x = 0$, is the space generated by the columns of the matrix $G = [ v_{r+1},..., v_k ]$. Now let $P_1$ and $P_1^{*}$ by any $( k \times d )$ matrices such that $\Phi (1) P_1 = 0$ and $\Phi^{*} (1) P_1 = 0$.
• Since $P_1$ and $P_1^{*}$ are full rank matrices, there exist full rank $( d \times d)$ matrices $\alpha$ and $\alpha^{*}$ such that $P_1 = G \alpha$ and $P_1^{*} = G \alpha^{*}$. Hence, we have that $P_1^{*} = P_1 \alpha^{-1} \alpha^{*}$.
• Similarly, it can be proved that $P_2^{*} = P_2 \beta^{-1} \alpha^{*}$. Then, using the inverse matrix representations, it can be proved that $P_1^{*} Q_1^{*} = P_1 Q_1$ and $P_2^{*} Q_2^{*} = P_2 Q_2$, which demonstrates that indeed the matrices $P_1 Q_1$ and $P_2 Q_2$ are uniquely defined (see, melard2006exact).
\paragraph{Forecasting in VARMA models}
Modelling and forecasting a large set of macroeconomic variables can be done using VARMA representations. However, to ensure a robust estimation, the identification of uniquely parametrized VARMA models requires imposing restrictions on the parameter space to ensure that the model is uniquely identified (see, dias2018estimation).
align[align omitted — 331 chars of source]
Define the lag polynomials such that
align*[align* omitted — 106 chars of source]
We shall say that the model is unique if there is only one pair of stable and invertible polynomials $A(L)$ and $B(L)$, respectively which satisfies the canonical MA representation (see, also poskitt2006identification)
align*[align* omitted — 96 chars of source]
assumptionConsider the $\mathsf{VARMA}( p_1, q_1 )$ model defined by the stochastic difference equations
\begin{align}
\left( \boldsymbol{I}_k - \sum_{j=1}^{p_1} A_j L^j \right) X_t = \left( \boldsymbol{I}_k + \sum_{j=1}^{p_1} B_j L^j \right) \varepsilon_t
\end{align}
Moreover, suppose that all solutions of
\begin{align*}
\mathsf{det} \left( \boldsymbol{I}_k - \sum_{j=1}^{p_0} A_j z^j \right) = 0,
\ \ \
\mathsf{det} \left( \boldsymbol{I}_k + \sum_{j=1}^{q_0} B_j z^j \right) = 0, \ \ for some \ \ z \in \mathbb{Z},
\end{align*}
lie outside the unit ball in $\mathbb{C}$, then (ref) is a stable solution (see, hallin2004rank).
remarkNotice that in contrast to the reduced form VAR models, setting $A_0 = B_0 = I_k$ is not a sufficient condition (only ensures existence) to ensure a unique VARMA representation. The uniqueness of the $\mathsf{VARMA}(p,q)$ representation is guaranteed by imposing restrictions on the pair of stable and invertible polynomials $A(L)$ and $B(L)$ (see, also deistler1983properties).
remarkA second important aspect to emphasize is that the framework proposed by hallin2004rank presents with a mathematical rigorous way the construction of an optimal-rank test statistic for testing the adequacy of the lag orders of a VARMA model. Generally, any test statistics associated with any parameter vectors from SVAR processes, should have power functions with suitable properties (such as the monotonicity property) to detect departures from the null hypothesis. Notice that optimal-rank based tests remain valid under arbitrary elliptically symmetric innovation densities, including those with infinite variance and heavy-tails. In particular, the authors show that these optimal-rank based tests are uniformly more powerful than those based on cross-covariances. Moreover, based on the classical LAN result it allows to derive testing procedures that are locally and asymptotically optimal under a given innovation density $f$, based on a non-Gaussian form of cross-covariances.
Suppose that our aim is to construct a statistic for testing the null hypothesis $\boldsymbol{\theta} = \boldsymbol{\theta}_0$ against the alternative $\boldsymbol{\theta} \neq \boldsymbol{\theta}_0$. Choosing $p_0 < p_1$ and $q_0 < q_1$ allows one to test the adequency of the specified VARMA coefficients in $\boldsymbol{\theta}_0$, while contemplating the possibility of possibly higher-order VARMA models.
Therefore, this null hypothesis is thus invariant under the group of affine transformation $\boldsymbol{\varepsilon}_t \mapsto \boldsymbol{M} \boldsymbol{\varepsilon}_t$ if and only if $\boldsymbol{M} \boldsymbol{A}_i \boldsymbol{M}^{-1} = \boldsymbol{A}_i$ for all $i = 1,...p_0$ and $\boldsymbol{M} \boldsymbol{B}_j \boldsymbol{M}^{-1} = \boldsymbol{B}_j$ for all $j = 1,..., q_0$, that is, iff each $\boldsymbol{A}_i$ and each $\boldsymbol{B}_j$ commutes with any invertible matrix $\boldsymbol{M}$, which holds true iff they are proportional to the $( k \times k )$ identify matrix (see, hallin2004rank).
Write $\mathcal{H}^{(n)} ( \boldsymbol{\theta}_0, \boldsymbol{\Sigma}, f )$ for the hypothesis under which an observation $\boldsymbol{X}^{(n)} := \big( \boldsymbol{X}_1^{(n)},..., \boldsymbol{X}_n^{(n)} \big)^{\prime}$ is generated by the $\mathsf{VARMA}(p_0, q_0)$ model with parameter value $\boldsymbol{\theta}_0$ satisfying Assumption A and innovation process satisfying Assumption B. Our objective is to test $\mathcal{H}^{(n)} ( \boldsymbol{\theta}_0 ) := \bigcup_{\boldsymbol{\Sigma} } \bigcup_{ f } \mathcal{H}^{(n)} ( \boldsymbol{\theta}_0, \boldsymbol{\Sigma}, f )$ against $\bigcup_{ \boldsymbol{\theta} \neq \boldsymbol{\theta}_0 } \mathcal{H}^{(n)} ( \boldsymbol{\theta} )$. Consequently, $\boldsymbol{\Sigma}$ and $f$ play the role of nuisance parameters; note that the unions, in the definition of $\mathcal{H}^{(n)} ( \boldsymbol{\theta}_0 )$, are taken over all possible values of $\boldsymbol{\Sigma}$ and $f$.
Let $\boldsymbol{A}(L)$ and $\boldsymbol{B}(L)$ be such that $\boldsymbol{A}_i = \boldsymbol{0}$ for $i = p_0 + 1,..., p_1$, and $\boldsymbol{B}_i = \boldsymbol{0}$ for $i = q_0 + 1,..., q_1$, and consider the sequences of linear difference operators
align[align omitted — 296 chars of source]
where the vector
align[align omitted — 342 chars of source]
is such that $\mathsf{sup}_n ( \boldsymbol{\uptau}^{(n)} )^{\prime} \boldsymbol{\uptau}^{(n)} < \infty$. These operators define a sequence of VARMA models such that
align[align omitted — 135 chars of source]
hence, the sequence of local alternatives $\mathcal{H}^{(n)} \left( \boldsymbol{\theta}_0 + n^{-1/2} \boldsymbol{\uptau}^{(n)}, \boldsymbol{\Sigma}, f \right)$.
\paragraph{Testing for Invertibility}
A key assumption for valid identification, estimation and forecasting with VARMA models (see, gourieroux2020identification, sims2012news and lutkepohl2002forecasting), is the invertability of underline polynomial representations. In particular, chen2017testing propose a test for invertability or fundamentalness of structural vector autoregressive moving average models generated by non-Gaussian independent and identically distributed structural shocks. Moreover, it can be proved that in these models under certain regularity conditions the Wold innovations are a martingale difference sequence if and only if the structural shocks are fundamental. Thus, the particular representation provides a mechanism for testing the presence of invertability. In other words, chen2017testing convert the statistical problem of polynomial invertability of VARMA processes into a statistical testing problem for the martingale difference sequence property of the Wold innovations. An MLE approach for non-invertible ARMA models is studied by meitz2013maximum. Further issues on identification and estimation of non-invertible SVARMA models are presented by funovits2020identifiability.
Extension 2: Non-Linear Dynamic System
A more challenging task is the econometric identification in nonlinear systems. In addition, for a non-linear dynamic system excited by a non-Gaussian disturbances, the system equation governing the probability distribution of the system response contains an infinite number of terms which makes identification and estimation considerable complex. Therefore, a pertrubation scheme is proposed to obtain an approximate solution to the system, thereby the effects of excitation non-Gaussianity can be evaluated (see, cai1992response, grigoriu1995linear and sengupta1989efficient).
Consider the unit-root VAR model, $\boldsymbol{A} (z) \boldsymbol{y}_t = \boldsymbol{\varepsilon}_t$, which crucially depends on $\boldsymbol{A} (z)^{-1} (L)$, thus we address the issue of of the inversion of $\boldsymbol{A} (z)$ around a pole $z = z_0$. Denote with
align[align omitted — 99 chars of source]
be a matrix polynomial of order $n$ and degree $K$ and $z_0$ such that $\mathsf{deg} \big[ \boldsymbol{A} (z) \big] = 0$. Therefore,
align[align omitted — 94 chars of source]
Then, an analytical expression for the matrix function $\boldsymbol{A} (z)^{-1}$ is given by
align[align omitted — 179 chars of source]
where $m$ is the order of the pole and the first term above represents the principal part while $\boldsymbol{M}(z) = \sum_{ j = 0 }^{ + \infty } \boldsymbol{N}^{j} ( z - z_0 )^j$, represents the regular part. Using the fact that $\boldsymbol{A} (z) \boldsymbol{A} (z)^{-1} = \boldsymbol{I}_n$
align[align omitted — 462 chars of source]
Notice that the Unit-Root VAR model is a linear non-homogeneous difference-equation system in matrix form whose solution can be formally written as below
align[align omitted — 108 chars of source]
where the first term is a particular solution of the non-homogeneous equation and the second is the so-called complementary solution. However, both depend on the operator $\boldsymbol{A}^{-1} (L)$, and thus on the matrix $\boldsymbol{A}^{-1} (z)$ since the algebras of the polynomial functions of the lag operator $L$ and of the complex variable $z$ are isomorphic. These expressions are useful when deriving statistical tests for invertability.
Extension 3: Automatic Inference for Finite Order VARs
Selecting lag length is useful when $p$ is unknown, which can directly impact the estimation of the effects of structural shocks. Notice that we only discuss lag selection procedures for stationary settings\footnote{A relevant framework for model selection in explosive time series regressions is presented by tao2020model. }. Roughly speaking the selection of the optimal lag length is achieved via the use of information criteria such as the AIC, SIC and HQC (e.g., see ivanov2005practitioner and choi2012model).
In this section, we focus on the framework proposed by kuersteiner2005automatic who consider automatic inference for infinite order vector autoregressions. In particular, infinite order dynamics in cointegration models has been examined by several studies. Specifically, $y_t$ has an infinite order VAR representation
align[align omitted — 108 chars of source]
where $\mu = C(1)^{-1} \mu_y$ and $C(L)^{-1} = \xi (L)$ such that $\xi (L) = \displaystyle \left( I - \sum_{j=1}^{\infty} \xi_j L^j \right)$. Therefore, the approximate model with VAR coefficient matrices $\left\{ \xi_{1,p},..., \xi_{p,p} \right\}$ has the following formulation
align[align omitted — 85 chars of source]
where $\Sigma_{v,p} = \mathbb{E} \big[ v_{t,p} v_{t,p}^{\prime} \big]$ the mean squared prediction error of the approximating model. Moreover, it can be shown that the parameters $( \xi_{1,p},..., \xi_{p,p} )$ are root$-n$ consistent and asymptotically normal for $\xi (p) = ( \xi_1,..., \xi_p )$ under the condition that the lag order $p$ does not increase too quickly, that is, $p$ is chosen such that $p^3 / n \to 0$.
Consider the sequential testing procedure proposed by ng2001lag, then a Wald test for the null hypothesis that the coefficients of the last lag $p$ are jointly zero, is expressed by
align[align omitted — 198 chars of source]
definitionThe general-to-specific procedure proposed by ng2001lag is based on:
\begin{itemize}
• $\hat{p}_n = p$ if, at significance level $\alpha \in (0,1)$, $\mathcal{W} (p,p)$ is the first statistic in the sequence $\mathcal{W} (j,j)$ such that $\left\{ j = p_{\mathsf{max}},..., 1 \right\}$, which is significantly different than zero or
• $\hat{p}_n = 0$ if, $\mathcal{W} (j,j)$ is not significantly different from zero for all $\left\{ j = p_{\mathsf{max}},..., 1 \right\}$, where $p_{\mathsf{max}}$ is such that $p_{\mathsf{max}} / n \to 0$ and $n^{1/2} \sum_{j= p_{\mathsf{max}} + 1}^{\infty} \left\lVert \xi_j \right\rVert \to 0$ as $n \to \infty$.
\end{itemize}
lemmaLet $Y_t = \big( y_t^{\prime} - \mu_y^{\prime}, y_{t-1}^{\prime} - \mu_y^{\prime},..., y_{t-p+1}^{\prime} - \mu_y^{\prime} \big)^{\prime}$, and let
\begin{align}
\Gamma_{1,p} = \frac{1}{ (n - p) } \sum_{t=1}^{n-1} Y_{t,p} ( y_{t+1} - \mu_y )^{\prime}
\ \ \ \
\Gamma_{p} = \frac{1}{ (n - p) } \sum_{t=p}^{n-1} Y_{t,p} Y_{t,p}^{\prime}
\end{align}
Denote with $\xi ( \hat{p}_n )^{\prime} = \Gamma_{ 1, \hat{p}_n }^{\prime} \Gamma_{\hat{p}_n }^{\prime}$ such that $\xi ( \hat{p}_n )$ is given by Definition (ref) above, then it holds that
\begin{align}
\left\lVert \hat{\xi} ( \hat{p}_n ) - \xi^o ( \hat{p}_n ) \right\rVert = o_p( n^{ - 1/2} ).
\end{align}
proofChoose $\delta$ such that $0 < \delta < \frac{1}{3}$, and pick a sequence $p_{\mathsf{min} }^{*}$ such that
\begin{align*}
p_{ \mathsf{max} } \geq \textcolor{blue}{ p^{*}_{\mathsf{min}} } \ \ \ and \ \ \ ( p_{ \mathsf{max} } - \textcolor{blue}{ p^{*}_{\mathsf{min}} } ) \to \infty,
\end{align*}
where $n^{1/2} \sum_{j= \textcolor{blue}{ p^{*}_{\mathsf{min}} } + 1}^{\infty} \left\lVert \xi_j \right\rVert \to 0$. Define with
\begin{align}
p_{ \mathsf{min} } = \mathsf{max} \left\{ \textcolor{blue}{ p^{*}_{\mathsf{min}} }, p_{\mathsf{max}} - \left( n^{1/2} \sum_{ j = \textcolor{blue}{ p^{*}_{\mathsf{min}} } + 1 }^{\infty} \left\lVert \xi_j \right\rVert \right)^{-1 } \right\}.
\end{align}
Moreover, since $p_{ \mathsf{min} } \leq p_{ \mathsf{max} }$, and by changing sign of the expression above it follows that
\begin{align}
\mathsf{min} \left\{ p_{\mathsf{max}} - \textcolor{blue}{ p^{*}_{\mathsf{min}} }, \left( n^{1/2} \sum_{ j = \textcolor{blue}{ p^{*}_{\mathsf{min}} } + 1 }^{\infty} \left\lVert \xi_j \right\rVert \right)^{-1 } \right\}
=
p_{\mathsf{max}} - p_{\mathsf{min}} \leq \left( n^{1/2} \sum_{ j = \textcolor{blue}{ p^{*}_{\mathsf{min}} } + 1 }^{\infty} \left\lVert \xi_j \right\rVert^{-1} \right)
\end{align}
such that $\left( p_{\mathsf{max}} - p_{\mathsf{min}} \right) \to \infty$ and $\left( p_{\mathsf{max}} - p_{\mathsf{min}} \right) = \mathcal{O}_p ( n^{\delta} )$. Furthermore, we have that
\begin{align*}
\left( \hat{\Gamma}_{ 1, \hat{p}_n } - \Gamma^o_{ 1, \hat{p}_n } \right)
&=
\frac{1}{ \left( n - \hat{p}_n \right) } \sum_{ t = \hat{p}_n }^{ (n - 1) } Y_{t, \hat{p}_n } \left( \mu_y - \bar{y} \right)^{\prime}
+
\big( \boldsymbol{1}_{ \hat{p}_n } \otimes ( \mu_y - \bar{y} ) \big) \frac{1}{ \left( n - \hat{p}_n \right) } \sum_{ t = \hat{p}_n }^{ (n - 1) } ( y_{t+1} - \mu_y )^{\prime}
\\
&+
\frac{ ( n - 1 - \hat{p}_n ) }{ ( n - \hat{p} ) } \big( \boldsymbol{1}_{ \hat{p}_n } \otimes ( \mu_y - \bar{y} ) \big) ( y_{t} - \mu_y )^{\prime}.
\end{align*}
Therefore, we can prove that
\begin{align*}
\mathbb{E} \underset{ p \in P_n }{ \mathsf{max} } \left\lVert \frac{1}{(n - p)} \sum_{t = p}^{ (n-1)} \big( y_{t+1} - \mu_y \big) \right\rVert^2
&\leq
\sum_{ p = p_{\mathsf{min} } }^{ p_{ \mathsf{max} } } \frac{1}{ ( n - p )^2 } \sum_{ t,s = p }^{(n-1)} \mathsf{trace} \left\{ \mathbb{E} \big[ \big( y_{t+1} - \mu_y \big) \big( y_{t+1} - \mu_y \big)^{\prime} \big] \right\}
\\
&\leq
\mathcal{O}_p ( n^{\delta} ) \frac{1}{ ( n - p_{\mathsf{max} } )^2 } \sum_{ t,s = p_{ \mathsf{min} } }^{(n-1)} \left| \mathsf{trace} \left\{ \mathbb{E} \big[ \big( y_{t+1} - \mu_y \big) \big( y_{t+1} - \mu_y \big)^{\prime} \big] \right\} \right|
\\
&= \mathcal{O}_p ( n^{ -1 + \delta } ).
\end{align*}
Extension 4: Locally Trimmed OLS Procedure for VARs
A particular methodology which has been proposed in the literature to deal with the problem of outliers when estimating vector autoregression models, is the least-trimmed squares procedure. In particular, agullo2008multivariate proposed a multivariate least-trimmed squares estimator and prove Fisher-consistency under the assumption of elliptically symmetric error distributions. Moreover, cavaliere2009robust consider robust methods for estimation and unit root testing in autoregressions with infrequent outliers whose number, size, and location can be random and unknown\footnote{In particular, the authors show that standard inferene based on ordinary least squares estimation of an augmented Dickey-Fuller (ADF) regression may not be reliable, because (a) clusters of outliers may lead to inconsistent estimation of the autoregressive parameters, and (b) large outliers induce a jump component in the asymptotic distribution of UR test statistics.}.
Let $\left\{ y_t | t \in \mathbb{Z} \right\}$ be a $d-$dimensional stationary time series. The vector autoregressive model of order $p$, denoted by VAR$(p)$, is given by the following expression
align[align omitted — 127 chars of source]
with $y_t$ a $d-$dimensional vector, the intercept parameter $\mathcal{B}_0$ a vector in $\mathbb{R}^d$ and the slope parameters $\left\{ \mathcal{B}_1, ...., \mathcal{B}_p \right\}$ are matrices in $\mathbb{R}^{d \times d}$. Throughout the paper, $B^{\prime}$ will stand for the transpose of the matrix $B$. Moreover, the $d-$dimensional error terms $\epsilon_t$ are assumed to be independently and identically distributed with a density function of the form
align[align omitted — 122 chars of source]
with $\Sigma$ a positive definite matrix, called the scatter matrix, and $g$ a positive function. If the second moment of $\epsilon_t$ exists, $\Sigma$ will be proportional to the covariance matrix of the error terms. Existence of a second moment, will not be required for the robust estimator. We focus on the unrestricted VAR$(p)$ model, where no restrictions are put on the parameters $\left\{ \mathcal{B}_1, ...., \mathcal{B}_p \right\}$. Suppose that the multivariate time series $y_t$ is observed for $t=1,...,T$. Then, the vector autoregression model has the following multivariate regression representation
align[align omitted — 56 chars of source]
for $t \in \left\{ p+1,..., T \right\}$ with $x_t = \left( 1, y_{t-1}^{\prime}, ..., y_{t-p}^{\prime} \right)^{\prime} \in \mathbb{R}^q$, where $q = pd + 1$. Moreover, the matrix $\mathcal{B} = \left( \mathcal{B}_1, ...., \mathcal{B}_p \right)^{\prime} \in \mathbb{R}^{q \times d}$ contains all the unknown matrices of coefficients. In matrix notation, we have that $X = \left( x_{p+1},...,x_{T} \right)^{\prime} \in \mathbb{R}^{ n \times q}$ is the matrix of regressors and $Y = \left( y_{p+1},..., y_{T} \right)^{\prime}$ is the matrix of predictants, where $n = T - p$ is the sample size after excluding the estimation for the lag components of the model. The classical least squares estimator for the regression parameter $\mathcal{B}$ is estimated by
align[align omitted — 115 chars of source]
and the scatter matrix $\Sigma$ is estimated by the following expression
align[align omitted — 196 chars of source]
remarkOutliers can affect parameter estimates, model specification and forecasts based on the selected model. Therefore, a careful examination of the nature of outliers is necessary to ensure robust statistical inference. Moreover, outliers can be of different nature, the most well known types being additive outliers and innovational outliers. More specifically, for the vector autoregressive model $y_t$ is an additive outlier if only its own value has been affected by contamination. On the other hand, an outlier is said to be innovational if the error term $\epsilon_t$ is contaminated. Innovational outliers will therefore have an effect on the next observations as well, due to the dynamic structure of the series. Additive outliers have an isolated effect on the time series, but they still may seriously affect the parameter estimates.
remarkNotice that for the Residual Autocovariance (RA) estimators are considered to be affine equivariant version of the estimators of li1989robust. The particular estimators are considered to be resistant to outliers and therefore we can consider employing them for in the case of constructing a robust estimator to outliers for the Vector Autoregressive Model. For this purpose, we use the Multivariate Least Trimmed Squares (MLTS) estimator proposed by agullo2008multivariate. The specific estimator is defined by minimizing a trimmed sum of squared Machalanobis distances, and can be computed by a fast algorithm. Moreover, the procedure also provides a natural estimator for the scatter matrix of the residuals, which can then be used for model selection criteria.
\paragraph{The Multivariate Least Trimmed Squares Estimator}
The unknown parameters of the VAR$(p)$ will be estimated via the multivariate regression model. To allow for the robust estimation of the model under the presence of outliers the Multivariate Least Trimmed Squares (MLTS) estimator is employed, which is based on the idea of the Minimum Covariance Determinant estimator. The way that the MLTS estimator works is that it selects the subset of $h$ observations which minimize the determinant of the covariance matrix of residuals based on a least squares fit from the particular subsample.
Consider the dataset $Z = \left\{ \left( x_t, y_t \right), t = p+1,..., T \right\} \subset \mathbb{R}^{d+q}$. We denote with $\mathcal{H}$ the collection of all subsets of size $h$, such that:
align[align omitted — 121 chars of source]
Then, for any subset $H \in \mathcal{H}$, we denote with $\widehat{\mathcal{B}}_{\text{OLS}}$ the classical least squares estimator based on the observations of the particular subset given by the following expression
align[align omitted — 124 chars of source]
where $X_H$ and $Y_H$ are submatrices of $X$ and $Y$ respectively, consisting of the rows of $X$ and $Y$ that corresponds to the subsample $H$.
Then, the corresponding scatter matrix estimator computed from this subset is constructed as below
align[align omitted — 202 chars of source]
The MLTS estimator is now defined as below
align[align omitted — 301 chars of source]
Moreover, the associated estimator of the scatter matrix of the error terms is given by
align[align omitted — 126 chars of source]
where $c_{\alpha}$ is the correction factor to obtain consistent estimation of $\Sigma$ for the error distribution of the model, and $\alpha$ the trimming proportion for the MLTS estimator, that is, $\alpha \approx \left( 1 - \frac{h}{n} \right)$. In the case of multivariate error terms it has been shown that $
c_{\alpha} = (1 - \alpha ) \big/ F_{ \chi^2_{d+2} \left( q_{\alpha} \right)}$,
where $F_{\chi^2_{d+2}}$ is the cumulative distribution function of a $\chi^2$ distribution with $q$ degrees of freedom, and $q_{\alpha} = \chi^2_{q, 1 - \alpha}$ is the upper $\alpha$ quantile of this distribution.
Equivalent characterizations of the MLTS estimator are given by agullo2008multivariate. The particular study shows that any $\widetilde{\mathcal{B}} \in \mathbb{R}^{d \times q}$ minimizing the sum of the $h$ smallest squared Mahlanobis distance of its residuals, subject to the condition that $\text{det} \left[ \Sigma \right] = 1$ is a solution of (ref). More formally,
align[align omitted — 218 chars of source]
where $d_{1:n} \left( \mathcal{B}, \Sigma \right),...,d_{n:n} \left( \mathcal{B}, \Sigma \right)$ is the ordered sequence of the residual Mahalanobis distances is
align[align omitted — 174 chars of source]
for some $\mathcal{B} \in \mathbb{R}^{d \times q}$. Notice that the MLTS estimator minimizes the sum of the $h$ smallest squared distances of its residuals, and is therefore the multivariate extension of the Least Trimmed Squares (LTS) estimator of rousseeuw1984least. The particular MLTS estimator has been found to have low efficiency so the literature has proposed the reweighted version of the estimator to improve the performance of the MLTS estimator. Therefore, since the efficiency of the MLTS estimator is quite low, the re-weighted version of the particular estimator is employed to improve the performance of the MLTS.
The Reweighted Multivariate Least Trimmed Squares (RMLTS) estimates are defined as
align[align omitted — 358 chars of source]
and $q_{\delta} = \chi^2_{q, 1 - \delta}$.
Since outliers tend to have large residuals with respect to the initial robust MLTS estimator, then it implies a large residual Mahalanobis distance $d_j^2 \left( \mathcal{ \widehat{ \mathcal{B}} }_{\text{MLTS}}, \widehat{\Sigma}_{\text{MLTS}} \right)$. If the later is above the critical value $q_{\delta}$, then the observation is flagged as an outlier. The final RMLTS is then based on those observations not having been detected as outliers. For instance, one can set $\delta = 0.01$ and take as trimming proportion for the initial MLTS estimator $\alpha = 25 \%$.
\paragraph{Determining the autoregressive order}
To select the order $p$ of a vector autoregressive model, information criteria are computed for several values of $p$ and an optimal order is selected by minimizing the criterion. Most information criteria are in terms of the value of the log likelihood $\ell_k$ of the VAR$(p)$ model. Using the model assumption for the distribution of the error terms, we obtain that
align[align omitted — 160 chars of source]
with $n = T - k$. When error terms are multivariate normal the above leads to the following expression
align[align omitted — 200 chars of source]
The log likelihood will depend on the autoregressive order via the estimate of the covariance matrix of the residuals. In particular, for the classical least squares estimator we have that
align[align omitted — 141 chars of source]
where $\widehat{\epsilon}^{\prime}_t (k)$ are the residuals corresponding to the VAR$(p)$ model. Using trace properties, the last term of the log-likelihood function corresponds to $(n - p) p / 2$ for the OLS estimator. In order to prevent that outliers might affect the optimal selection of the information criteria, we estimate $\Sigma$ by the RMLTS estimator given by the following expression:
align[align omitted — 161 chars of source]
with $J(k)$ as above and $m(k)$ the number of elements in $J(k)$. In this case, the last term of the log-likelihood function equals now $\left( m(k) - p \right) p \big/ \left( 2 c_{\delta} \right)$.
\paragraph{Open Problems} Some possible extensions of the particular approach is to propose a framework which employes the LTS method that accounts for outliers in multivariate time series models, specifically to the setting of structural vector autoregressions.
Extension 5: Time-Varying VAR Models
The identification and estimation of time-varying VAR models is useful when modelling dynamically macroeconomic events such as monetary policy regimes (see, primiceri2005time, koop2013large) and chan2016large as well as time-varying instrumental variable estimation as in kapetanios2019large, petrova2019quasi and giraitis2021time. A relevant setting is the framework of factor augmented SVAR models (e.g., see eickmeier2015classical).
Financial Connectedness
The study of network topology and financial connectedness is used for modelling systemic risk, spillover effects and financial contagion using the VAR framework (see, discussion in katsouris2023limit). Estimating systemic risk measures implies identifying shocks which are transmitted via system-wide connectedness. In particular, diebold2014network, diebold2012better proposed a framework for modelling the network topology via the forecast error variance decomposition (FEVD) of an estimated VAR process, as a transformation method that summarizes connectedness between a set of institutions. Thus this approach allows to construct measures of directional connectedness which are analogous to bilateral imports and exports for each of a set of $N$ countries. Recent implementations are presented by barigozzi2017network, barunik2018measuring, demirer2018estimating, korobilis2018measuring, geraci2018measuring, rehman2018precious, yoon2019network, barigozzi2021time, laborda2021volatility, mensi2023time and barunik2024persistence.
Consider, an $N$ dimensional covariance-stationary series $\boldsymbol{Y_t}=(y_{1,t},...,y_{N,t})$, which is generated from a VAR$(p)$ process for $t=1,...,T$. Then, based on the Wold decomposition theorem we have that
align*[align* omitted — 166 chars of source]
such that $|\Phi(z)|$ lie outside the unit-circle, then the VAR process has the MA($\infty$) representation expressed as $\boldsymbol{Y_t}= \boldsymbol{\Theta(L)}\boldsymbol{\epsilon_t}$, where $\boldsymbol{\Theta(L)}$ is an $(N x N)$ matrix of infinite lag polynomials and $\boldsymbol{\epsilon}_t$ is considered to be a white-noise generated by the covariance matrix $\boldsymbol{\Sigma}$. Therefore, the $H-$step generalized variance decomposition\footnote{See also, lanne2016generalized who employ a GFEV decomposition for linear and nonlinear multivariate models. Moreover, katsouris2023estimating develops methods for the identification and estimation of financial networks.} matrix D$^{gH}$ = $[d_{ij}^{gH}]$ is given by
align[align omitted — 226 chars of source]
where $e_j$ are selection matrices e.g., $e_j=(0,...1,...0)^{'}$, $\boldsymbol{\Theta}_h$ is the coefficient matrix evaluated at the $h$-lagged shock vector and $\sigma_{ij}$ is the $j$th diagonal element of $\boldsymbol{\Sigma}$. Modelling the asymmetric responses of the economy to monetary policy shocks over the business cycle due to the impact of the monetary transmission mechanism (e.g., see eickmeier2015classical, morley2012asymmetric and veldkamp2005slow), requires to employ specifications which allow for time-varying effects (see, paul2020time).
Dynamic Causal Effects
The two main types of identification presented so far in the literature consists of point-identification and set-identification. Specifically, point-identified SVARs are interpreted as achieving identification through internal instruments. Consequently, in these models, structural shocks are the interventions of interest, and thus the goal is to estimate the dynamic causal effect of these shocks on macroeconomic outcomes. In contrast, modern microeconometric identification stategies rely heavily on external sources of variation that provide quasi-experiemnts to identify causal effects. Such external variation might be found, for example, in firm-specific characteristics that introduce as-if randomness in the variable of interest (the treatment). The use of such external instruments in microeconometrics has proven highly productive and has yielded compelling estimates of causal effects. Therefore, the use of external instruments has opened a new and rapidly growing research avenue in macroeconometrics, in which credible identification is obtained using as-if random variation in the shock of interest that is distinct from - external to - the macroeconomic shocks hitting the economy (stock2018identification).
Identification and Estimation of Causal Effects
Causal Effects and IV Regression
Following the paper of stock2018identification, a starting point for formulating the theory on identification and estimation of dynamic causal effects in macroeconomics, is that the expected difference in outcomes between the treatment and control groups in a randomized experiment with a binary treatment is the average treatment effect. Roughly speaking, if a binary treatment $X$ is randomly assigned, then all other determinants of $Y$ are independent of $X$, which implies that the (average) treatment effect is
align[align omitted — 83 chars of source]
In the linear model $Y = \alpha + \beta X + u$, where $\beta$ is the treatment effect, random assignment implies that $\mathbb{E} \left( u | X \right) = 0$ so that the population regression coefficient is the treatment effect. When randomization is conditional on covariates $W$, then the treatment effect for an individual with covariates $W = w$ is estimated by the outcome of a random experiment on a group of subjects with the same value of $W$,
align[align omitted — 98 chars of source]
exampleUsually the path of observed macroeconomic variables arising from current and past shocks and measurement error are collected into the $( m \times 1 )$, $\varepsilon_t$ error vector $\varepsilon_t$. Therefore, the $( n \times 1 )$ vector of macroeconomic variables $Y_t$ can be written in terms of current and past innovation terms
\begin{align}
Y_t = \Theta (L) \varepsilon_t,
\end{align}
where $\Theta (L) = \Theta_0 + \Theta_1 L + \Theta_2 L^2 + ...$, where $\Theta_h$ is an $( n \times m )$ matrix of coefficients.
Then the variance matrix of the error terms $\boldsymbol{\Sigma} = \mathbb{E} [ \boldsymbol{\epsilon}_t \boldsymbol{\epsilon}_t ]$ is assumed to be positive-definite to ensure the existence of a non ill-conditioned covariance matrix. Moreover these disturbance terms (shocks) are assumed to be mutually uncorrelated. The expression $Y_t = \Theta (L) \varepsilon_t$, corresponds to the structural moving average representation of $Y_t$. Specifically, the coefficients of $\Theta (L)$ are the structural impulse response functions, which are the dynamic causal effects of the shocks (see, also bacchiocchi2018gimme).
Under the null of invertability, the following SVAR representation applies:
\begin{align}
\boldsymbol{A} (L) \boldsymbol{Y}_t = \boldsymbol{\Theta} (L) \boldsymbol{\varepsilon}_t,
\end{align}
Therefore, under invertability, the structural moving average is $\boldsymbol{Y}_t = \boldsymbol{C}(L) \boldsymbol{\Theta}_0 \boldsymbol{\varepsilon}_t$, where $\boldsymbol{C}(L) = \boldsymbol{A} (L)^{-1}$, such that $\boldsymbol{\Theta} (L) = \boldsymbol{C}(L) \boldsymbol{\Theta}_0$. The null and alternative hypotheses are then
\begin{align}
H_0: \boldsymbol{C}_h \boldsymbol{\Theta}_{0,1} = \boldsymbol{\Theta}_{h,1} \ \ \ against \ \ \ H_1: \boldsymbol{C}_h \boldsymbol{\Theta}_{0,1} \neq \boldsymbol{\Theta}_{h,1}, \ \ for some \ h.
\end{align}
Recall that the SVAR can be also written in state-space form as below:
\begin{align}
\boldsymbol{Y}_t &= \boldsymbol{\mathcal{B}} \boldsymbol{X}_t
\\
\boldsymbol{X}_t &= \boldsymbol{A} \boldsymbol{X}_{t-1} + \boldsymbol{G} \boldsymbol{\varepsilon}_t,
\end{align}
where $\boldsymbol{X}_t = \big( \boldsymbol{Y}_t^{\top}, \boldsymbol{Y}_{t-1}^{\top},...., \boldsymbol{Y}_{t-p+1}^{\top} \big)^{\top}$, such that $\boldsymbol{A}$ is the companion matrix and $\boldsymbol{\mathcal{B}} = \big( \boldsymbol{I}_n \ \boldsymbol{0} \cdots \boldsymbol{0} \big)$ is a selection matrix. Then, the local projection regression equation is written as below:
\begin{align}
\boldsymbol{Y}_{t+h} = \boldsymbol{\Theta}_{h,1} \boldsymbol{Y}_{1,t} + \boldsymbol{\Gamma}_h \boldsymbol{W}_t + \boldsymbol{u}_{t+h},
\end{align}
\begin{remark}
The study of stock2018identification verifies important insights regarding the identification of dynamic causal effects. In particular, under the assumption of Gaussian errors, every invertible model has multiple observationally equivalent non-invertible representations, which imply that to identify a unique representation some external information regarding the system is required. If we assume that the structural shocks are independent and non-Gaussian then using information from higher-order restrictions the causal structure of the system can be identified. In practice, external instruments can be employed to estimate dynamic causal effects directly without using an indirect VAR identification step.
\end{remark}
\subsubsection{Causal Effects Identification with SVARs}
example[Causal effects of Lockdown Policies on Health and Macro Outcomes]
\
We follow the framework proposed by arias2023causal who consider the causal impact of pandemic-induced lockdowns and other nonpharmaceutical policy interventions (NPIs), on health and macroeconomic outcomes. To do this, identification assumptions are needed to access causality. During the first step the authors use the Bayesian approach to estimate an epidiomiological model with time variation in the parameters controlling an infectious disease's dynamics.
In particular, time variation in the parameters of the model allows to: $\textit{(i)}$ capture changes in the behaviour of individuals as they respond to public health conditions and $\textit{(ii)}$ to include shifts in the transmission and clinical outcomes of the pandemic.
We write our SVAR model such that
\begin{align}
\boldsymbol{y}_t^{\prime} \otimes \boldsymbol{A}_0 = \boldsymbol{x}_t^{\prime} \otimes \boldsymbol{A}_{+} + \varepsilon_t^{\prime}, \ \ 1 \leq t \leq T
\end{align}
\begin{itemize}
• $\boldsymbol{y}_t$ is an $( n \times 1)$ vector of endogenous variables, $\boldsymbol{x}_t^{\prime} = \big[ \boldsymbol{y}_t^{\prime}, ..., \boldsymbol{y}_{t-p}^{\prime}, \boldsymbol{z}_t, \boldsymbol{1} \big]$, where $\boldsymbol{z}_t$ is a $( z \times 1 )$ vector of exogenous variables, and $\boldsymbol{\varepsilon}_t$ is an $( n \times 1)$ vector of structural shocks.
• Model parameters: $\boldsymbol{A}_0$ is an $(n \times n)$ invertible matrix of parameters, and $\boldsymbol{A}_{+}$ is an $(np + z + 1) \times n$ matrix of parameters such that $p$ is the lag length and $T$ is the sample size.
\end{itemize}
In addition, we assume that the vector $\boldsymbol{\varepsilon}_t$, conditional on past information and the initial conditions $\boldsymbol{y}_0,..., \boldsymbol{y}_{1-p}$, is Gaussian with mean zero and covariance matrix $\boldsymbol{I}_n$. Without loss of generality, we assume that the first equation of the SVAR characterizes the policy rule. This implies that
\begin{align}
\boldsymbol{y}_t^{\prime} \boldsymbol{\alpha}_{0,1} = \boldsymbol{x}_t^{\prime} \boldsymbol{\alpha}_{+,1} + \boldsymbol{\varepsilon}_{1t}, \ \ 1 \leq t \leq T
\end{align}
is the policy equation such that
\begin{itemize}
• $\boldsymbol{\varepsilon}_{1t}$ denotes the first entry of the vector $\boldsymbol{\varepsilon}_{t}$.
• $\boldsymbol{\alpha}_{+,1}$ denotes the first column of $\boldsymbol{A}_{+}$ for $\ell \in \left\{ 0,..., p \right\}$ and $\alpha_{s,ij}$ denotes the $(i,j)$ entry of $\boldsymbol{A}_{s}$, where $s \in \left\{ 0, + \right\}$, and describes the systematic component of the policy rule.
\end{itemize}
Restricting the systematic component of the policy rule is equivalent to restricting $\alpha_{s,ij}$ and identifying a policy shock that we call the stringency shock. Recall that the dynamic causal effect of a unit intervention in $\varepsilon_{j,t} \in \varepsilon_{t}$ on $z_{t+h}$ is given by $\big( \mathbb{E} [ z_{t+h} | \varepsilon_{j,t} = 1; \varepsilon_{t-1}, .... ] - \mathbb{E} [ z_{t+h} | \varepsilon_{j,t} = 0; \varepsilon_{t-1}, .... ] \big)$. Then, the structural impulse response functions can be derived by $\partial z_{t+h} / \partial \varepsilon_{j,t}$ for $h = 0,1,2,...$.
example[ECB monetary policy and bank default risk, see soenen2022ecb]
\
In this example, the primary focus is the impact of ECB monetary policy on bank risk. There is an ongoing debate on the effect of accommodative monetary policy on bank risk taking and financial stability in general. Specifically, one concern relates to the potential increase in risk taking and the possible under-pricing of risk. The relevant question is whether or not monetary policy causes excessive risk taking by banks, since this could hamper financial stability which can be reflected in higher bank CDS spreads. Next, regarding the choice of the variable of interest: we cannot use the policy rate because of the zero lower bound constraint and, similarly, we cannot use the ECB balance sheet because some important monetary policy measures did not affect the balance sheet.
Therefore, when assessing the causal impact of monetary policy, we decide to employ a structural VAR because incorporating a broad set of financial market indicators allows us not only to identify actual ECB monetary policy decisions, but also to capture anticipation effects and instances in which financial markets judge that monetary policy actions were insufficient, given the prevailing market conditions. In other words, we can estimate a time series of exogeneous monetary policy shocks by modelling a set of relevant financial market variables in a structural VAR model which is given by the following econometric specification:
\begin{align}
\boldsymbol{y}_t = \boldsymbol{A}_1 \boldsymbol{y}_{t-1} + ... + \boldsymbol{A}_p \boldsymbol{y}_{t-p} + \boldsymbol{R} \boldsymbol{v}_t,
\end{align}
where $\boldsymbol{y}_t$ is an $n-$dimensional vector of endogenous variables, $\boldsymbol{v}_t$ is an $n-$dimensional vector of orthogonal structural innovations with mean zero and $\left\{ \boldsymbol{A}_1,..., \boldsymbol{A}_p \right\}$ and $\boldsymbol{R}$ are $(n \times n)$ time-invariant parameter matrices. The reduced-form residuals corresponding to this structural model are given by $\boldsymbol{\varepsilon}_t = \boldsymbol{R} \boldsymbol{v}_t$.
remarkA macroeconomic puzzle relevant to the optimal economic policy decision-making with respect to macro-prudential restructuring and debt collection is the aspect of the tax policy conducted over the Business Cycle. In particular, it is well known that government spending has typically been procyclical in developing economics but exhibit acyclical or countercyclical behaviour in industrial economies. Moreover, an interesting avenue of further research is the counterfactual distribution of the cyclical behaviour of tax rates, as opposed to tax revenues which are endogenous to the business cycle and hence cannot shed light on the cyclicality of tax policy (see, vegh2015tax).
Therefore the identification and estimation of dynamic treatment effects allows to investigate the VAT behaviour of firms in relation to imposed by the government tax rates. The intuition goes as follows. Governmental taxation is the pillar of fiscal policy and decisions on the optimal tax policy are usually taken in relation to their effectiveness on various macroeconomic outcomes, such as output fluctuations as well as structural changes in agent's behaviour over the business cycle (aggregate fluctuations). From the econometrics perspective to facilitate inference requires to derive the asymptotic behaviour of the dynamic treatment effect estimator across a panel of economics which have undergone a period of fiscal adaption to new tax policies. In other words, one would be interested to obtain the asymptotic behaviour of these estimators based on the trajectory of the control against the experimental groups in relation to a common taxation policy as well as to obtain counterfactual outcomes when a control group has adapted an updated fiscal policy across the business cycle. In this direction, we are interested to incorporate tax policy variables such as taxation revenues which are often considered as policy outcomes. Furthermore, due to the fact that these variables might be positive correlated during the business cycle, suitable instrumental variables that can ensure consistent model estimation and inference procedures can be employed. In particular, vegh2015tax use the VAT rates across economic during the business cycle as a valid instrumental variable. Moreover, the authors use a novel tax database which combines both corporate and personal income tax rates as well as data on value-added taxes. A relevant study which discusses the effects of global tax reform is presented by gomez2023measuring.
Counterfactual Analysis
Causal Effect Inference with Time Series Data
In particular, the parameter of interest is the ATE $:= \mathbb{E} \left[ Y_1 - Y_0 \right]$. Moreover, the Conditional Average Treatment Effect (CATE) defined by
align[align omitted — 68 chars of source]
captures how the average treatment effect changes across sub-populations with covariate value $X = x$. Furthermore, under the unconfoundness assumption $\tau(x)$ can be nonparametrically identified by
align[align omitted — 111 chars of source]
assumptionSuppose that the following conditions hold
\begin{itemize}
• $\big( Y(1), Y(0) \big) \ \textit{independent} \ D | X$.
• $X$ has a compact support $\mathsf{Supp}(X)$ and there exists $c > 0$ such that $c < \Pi (x) < 1 - c$ for all $x \in \mathsf{Supp}(X)$.
\end{itemize}
remarkNotice that the above assumptions are fairly standard in the causal inference literature and we assume that they hold throughout the remaining of the paper unless otherwise states. In particular, Assumption 1 (i), corresponds to the unconfoundedness condition while Assumption 1 (ii) corresponds to the common support condition for the set of covariates in the model.
Consider the $k-$step ahead forecast of $Y_t$ given the information available up to time $t^{*}$ which is given by the following expression
align[align omitted — 234 chars of source]
Notice that by definition, $Y_{ t^{*} + k } (0)$ is the potential outcome expected at time $t^{*} + k$ in case the intervention does not occur. Therefore, an estimator of the point causal effect can be defined as
align*[align* omitted — 251 chars of source]
Potential Outcome Framework
Let $D \in \left\{ 0, 1 \right\}$ be a binary treatment indicator and $Y_d$ be the potential outcomes for $d = 0,1$ in the status quo environment (see, also hsu2022counterfactual). In particular, $Y_1$ is the outcome if an individual is exogenously assigned to the treatement $(D = 1)$ and $Y_0$ is the outcome in the absence of treatement $( D = 0)$. Then, the actual observed outcome is
align[align omitted — 35 chars of source]
We observe a $d-$dimensional vector of pretreatment covariates $X = \left( X_1,..., X_k \right)$ in the status quo environment and $X^{\star} = \left( X^{\star}_1,..., X^{\star}_k \right)$ in the counterfactual environment which is of the same dimension as the set of covariates $X$.
itemize• $X$ and $X^{\star}$ are statistically independent
• $X^{\star}$ is a deterministic transformation of $X$, such that $X^{\star} = \pi (X)$ for some known function $\pi$.
The corresponding treatment indicator, outcome, and potential outcomes in the counterfactual environment are denoted as $D^{*}, Y^{*}$ and $Y_d^{*}$ for $d = 0,1$, respectively with
align[align omitted — 75 chars of source]
However, notice that since the treatment has not been implemented in the counterfactual environment yet, neither $D^{*}$ nor $Y^{*}$ is observed in our model (see, hsu2022counterfactual). We adopt the former approach such that a closed-form solution exists
align[align omitted — 189 chars of source]
where $\widehat{ \mathbb{E}} \left( Y_d | X = X_j^{*} \right)$ is the Nadaraya-Watson estimator such that
align[align omitted — 274 chars of source]
The asymptotic properties for $\widehat{\delta}^{*}$ can be derived under weaker regularity conditions stated below. Furthermore based on regularity conditions it can be proved that
align[align omitted — 140 chars of source]
Therefore, compared to the semiparametric efficiency bound of the ATE estimator we have that
align[align omitted — 220 chars of source]
Time Series Experiments and Causal Effects
Estimating Contemporaneous Effect of Treatment
Time series causal effects are defined as a comparison between the potential outcomes at a fixed point in time. Thus, the primary object of interest is the temporal average of these causal effects. Therefore, the only source of randomness in our formulation is the randomization of the treatment. Once we begin the experiment, the randomization reveals a particular outcome path; however, this does not change the set of potential outcomes, and therefore, does not alter what we would have observed had we administered a different treatment. Thus, in this sense, we are treating the potential outcomes as predetermined, and the only source of randomness comes from which path we observe.
definition[General Causal Effects] For paths $w_{1:t}$ and $w_{1:t}^{\prime}$, the $t-$th causal effect is given by
\begin{align}
\tau ( w_{1:t}, w_{1:t}^{\prime} ) = \mathbb{E} \big[ Y_{it} ( w_{1:t} ) - Y_{it} ( w_{1:t}^{\prime} ) \big].
\end{align}
Then, the temporal average treatment effect of the paths $w_{1:T}$ and $w_{1:T}^{\prime}$ is
align[align omitted — 125 chars of source]
Moreover, we define the potential outcomes just intervening on treatment the last $j$ periods as
align[align omitted — 80 chars of source]
In other words, this "marginal" potential outcome represents the potential or counterfactual level of regime A in country $i$, if we let welfare spending run its natural course up to $t-j-1$ and just set the last $j$ lags of spending to $x_{t-j:t}$. Thus, we can define an important quantity of interest, that is, the contemporaneous effect of treatment (CET) of $X_{it}$ on $Y_{it}$ such that:
align*[align* omitted — 176 chars of source]
Furthermore, following bojinov2019time specifically in longitudinal studies and survey studies with a follow-up wave of cross-sectional datasets, we are particularly interested to investigate the treatment effect of survey participants as well as their membership in certain endogenously generated groups. This implies that we are modelling the presence of time-varying exposure to dynamic causal estimands. Therefore, to construct a feasible structural econometric framework we consider the treatment and potential outcome path with time-varying effects. At each time step, $t = 1,...,T$, we assume that each individual (sampling unit), is exposed to either treatment, $W_t = 1$, or control, $W_t = 0$, and then we measure the corresponding outcome variable of interest.
Although we focus on binary treatments, our results can be generalized to multiple treatments as well. Thus, the random "treatment path" is given by
$W_{1:t} = \big( W_1,..., W_t \big)$. As a result, the potential path for the treatment path $w_{1:t}$ can corresponds to the following sequence
align[align omitted — 93 chars of source]
Null Hypothesis of Temporal Causal Effects
Following the framework proposed by bojinov2019time, to access whether the treatment has a statistically significant effect, we consider the sharp null of no temporal causal effects
align[align omitted — 133 chars of source]
In particular, this will null hypothesis will be tested against a portmanteu alternative. Thus, invoking the sharp null hypothesis implies that $Y_t ( w_{1:t}^{\text{obs}} ) = Y_t ( w_{1:t}^{\prime} )$ for all $w_{1:t}^{\prime}$. Moreover, the particular formulation of the null hypothesis means "the null of no temporal causality at lag $p \geq 0$ of the treatment on the outcome" holds, such that $H_{0,p}: \tau_{t,p} = 0$, for all $t = 1,2,...,T$.
In the case where $p = 0$, then $\widehat{\tau}_{t,0}$ estimation error can be written as below
align[align omitted — 189 chars of source]
and under the sharp null hypothesis we obtain that
align[align omitted — 199 chars of source]
In particular, whenever $p_t(1) = p_t(0)$ the estimator of the upper bound to the variance for the contemporaneous causal effect, is equal to the variance under the sharp null of no treatment effect. Then, the $p$ lagged error variance $Var^R \big( u_{t-p,p} | \mathcal{F}_{T, t-p-1} \big)$ equals to
align[align omitted — 171 chars of source]
We begin by rewriting the within-unit matching estimator as below
align[align omitted — 322 chars of source]
Consider the conditional independence property which implies that $\big\{ Y_{it}(1), Y_{it}(0) \big\} \perp \boldsymbol{X}_i | \boldsymbol{U}_i$. By the law of iterated expectations this implies that
align[align omitted — 159 chars of source]
for $x = 0,1$.
Bias-Reduced Doubly Robust Estimation
According to vermeulen2015bias the proposed approach may more generally lend itself better to small-sample inference. For instance, suppose that interest lies in the marginal causal effect $\tau = \mathbb{E} [ Y(1) - Y(0) ]$. Because the proposed estimation strategy does not require acknowledging the uncertainty of the estimated nuisance parameters (up to first order), we foresee that it may potentially lend itself better to randomization inference. How such randomization inference could be accomplished and how it performs in small to large samples is indeed relevant questions for further investigation.
Marginal Treatment Effects
Consider $\textit{i.i.d}$ data $\left\{ \boldsymbol{Z}_i = \left( Y_i, A_i, \boldsymbol{X}_i \right), i = 1,..., n \right\}$, where $Y_i$ is the outcome of interest, $A_i$ is a dichotomous treatment taking values zero and one and $\boldsymbol{X}_i$ is a sufficient set of covariates to control for confounding of the treatment effect, in the sence that $Y( a ) \perp A| \boldsymbol{X}$ for $a \in \left\{ 0, 1\right\}$. Specifically, $Y(a)$ denotes the counterfactual outcome for treatment level $a \in \left\{ 0, 1\right\}$, which is linked to the observed data through the consistency assumption (i.e., $Y(a) = Y$ iff $A=a$).
assumption[Covariates-Treatment Independence] Let $X_{j,t}$ be a vector of covariates that are predictive of the outcome of unit $j$, for all $t \in \left\{ t^{*}+1,..., T \right\}$ such covariates are not affected by the intervention, such that, $X_{j,t}(1) = X_{j,t}(0)$.
definitionLet $t^{*}$ be the time of the intervention and define with $k \in \left\{ 1,..., K \right\}$ such that $t^{*} + K = T$. For any $k$, the point, cumulative and temporal average causal effects on unit $j$ at time $t^{*} + k$ are defined, respectively, such that
\begin{align}
\tau_{j, t^{*} + k} (1;0) &= Y_{j, t^{*} + k}(1) - Y_{j, t^{*} + k}(0)
\\
\Delta_{j, t^{*} + k} (1;0) &= \sum_{h=1}^k \tau_{j, t^{*} + k} (1;0)
\end{align}
assumption[Selection on observables]
The following conditional independence assumption ensures that model selection is conditioned on observables (see, also angrist2011causal)
\begin{align}
Y_{t,1}(d), Y_{t,2}(d),..., \perp D_t | z_t, \ \ \ for all \ \ d \ and \ \ \psi \in \Psi_t.
\end{align}
Notice that the selection on observables assumption says that policies are independent of potential outcomes after appropriate conditioning. Moreover, the conditioning set includes the unknown error vector of the model, $\varepsilon_t$, such that $Y_{t,1}(d), Y_{t,2}(d),..., \perp \varepsilon_t | z_t$. This is because, conditional on the set of instruments $z_t$, randomness in $D_t$ is due exclusively due to randomness induced from the unknown $\varepsilon_t$ vector. Therefore, in order to convert the above assumption into a testable hypothesis which has an identifiable parameter space, we consider the sharp null hypothesis such that $Y_{t,j} ( d^{\prime} ) = Y_{t,j} (d) = Y_{t+j}$.
Then, if we substitute the observed with the potential outcomes we obtain the following testable conditional independence assumption:
align[align omitted — 55 chars of source]
Notice that $D_t$ is not necessarily a binary treatment status but can be a set of different taxation policies which implies that we have a continuum of treatment status.
definition[Granger noncausality]
Under suitable regularity conditions it holds that
\begin{align}
Y_{t+1} \perp D_t, \bar{D}_{t+1} | \bar{Y}_t.
\end{align}
The following theorem of Sims and Granger causality holds.
theoremLet $\chi_t$ be a stochastic process defined on a probability space $\big( \Omega, \mathcal{F}, \mathbb{P} \big)$, assuming that conditional probability measures $\mathbb{P} \big( Y_{t+1} , D_t | z_t \big)$ are well defined for all $t$ expect possibly on a set of measure zero.
remarkA relevant example is presented by menchetti2023combining who consider estimating the effect of policy interventions in observational time series settings in the absence of untreated units, by combining counterfactual outcomes and ARIMA models for prediction purposes. Specifically, when
focusing on observational time series data, commonly used methodologies for policy evaluation within the Rubin Causal Model (RCM) framework include Differences-in-Differences (DiD) and synthetic control methods. However, a main drawback of these two approaches is that they require the presence of controls that did not experience the treatment, and therefore finding untreated units is a challenging task menchetti2023combining. Moreover, the particular method is not guaranteed to reveal relevant causal effects especially due to the presence of unobserved factors. For example, if our main goal is to estimate the causal effect of a new intervention policy such as due to the adoption of new tax rates, as well as its indirect impact on a common fiscal policy across similar economies (e.g., VAT policy), then a causal time series modelling approach can be employed to obtain the causal estimands of interest. However, one may find that these causal effects have no negative or positive impact on the spending trajectory of similar economies that did not adopt new fiscal policies, suggesting that unobserved factors may drive spending decision making more than taxation policy. Other relevant counterfactual frameworks can be constructed (see, kilian2011does), around issues from the international finance literature such as the modelling sovereign default risk (e.g., see hatchondo2016debt).
The Augmented Synthetic Control Method
The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit in panel data settings (see, ben2021augmented). In other words is a weighted average of control units that balances the treated units pre-treatment outcomes and other covariates as closely as possible. We define the treated potential outcome as $Y_{it} = Y_{it} (0) + \tau_{it}$, where the treatment effects $\tau_{it}$ are fixed parameters. Since the first unit is treated, the key estimand of interest is
align[align omitted — 56 chars of source]
Then, the observed outcomes are as below
align[align omitted — 167 chars of source]
remarkNotice that pre-treatment outcomes serve as covariates in SCM, we use $X_{it}$, for $t \leq T_0$, to represent pre-treatment outcomes.
itemize• We are interested on a potential outcome system as a foundational framework for analyzing dynamic causal effects on outcomes in observational time series settings. We consider settings in which there is a single unit observed over time. At each time period $t \geq 1$, the unit receives a vector of assignments $W_t$, and an associated vector of outcomes $Y_t$ are generated. The outcomes are causally related to the assignments through a potential outcome process, which is a stochastic process that describes what would be observed along counterfactual assignment paths.
• A dynamic causal effect is generally defined as the comparison of the potential outcome process along different assignment paths at a fixed point in time.
assumption[Assignment and Potential Outcome]
The assignment process $\left\{ W_t \right\}_{ t \geq 1}$ satisfies
\begin{align}
W_t \in \mathcal{W} := \times_{k=1}^{ d_w } \mathcal{W}_k
\end{align}
The potential outcome process, is for any deterministic sequence $\left\{ w_s \right\}_{ s \geq 1 }$ with $w_s \in \mathcal{W}$ for all $s \geq 1$, $\big\{ Y_t \big( \left\{ w_s \right\}_{ s \geq 1} \big) \big\}_{ t \geq 1}$, where the time$-t$ potential outcomes satisfies $Y_t \big( \left\{ w_s \right\}_{ s \geq 1} \big) \in \mathcal{Y} \subset \mathbb{R}^{ d_y }$.
remarkThe simplest case is when the assignment is scalar and binary $\mathcal{W} = \left\{ 0, 1 \right\}$, in which case $W_t = 1$ corresponds to "treatment" and $W_t = 0$ is "control". Moreover, the potential outcome $Y_t \big( \left\{ w_s \right\}_{ s \geq 1} \big)$ may depend on future assignments $\left\{ w_s \right\}_{ s \geq t + 1}$. The next assumption considers the dependence structure we allow in the proposed econometric framework, restricting the potential outcome to only depend on past and contemporaneous assignments.
assumption[Non-anticipating Potential Outcomes]
For each $t \geq 1$, and all deterministic $\left\{ w_t \right\}_{t \geq 1}$ and $\left\{ w_t^{\prime} \right\}_{t \geq 1}$ with $w_t, w_t^{\prime} \in \mathcal{W}$,
\begin{align}
Y_t \big( w_{1:t}, \left\{ w_s \right\}_{ s \geq t + 1} \big) = Y_t \big( w_{1:t}, \left\{ w_s^{\prime} \right\}_{ s \geq t + 1} \big) \ almost surely.
\end{align}
remarkThe above assumption is a stochastic process analogue of non-interference. Furthermore, it still allows for rich dependence on past and contemporaneous assignments. Under Assumption 2, we drop references to the future assignmnets in the potential outcome process and write
\begin{align}
\big\{ Y_t \big( \left\{ w_s \right\}_{ s \geq 1} \big) \big\}_{t \geq 1} = \big\{ Y_t \big( w_{1:t} \big) \big\}_{t \geq 1}
\end{align}
Then, the set $\big\{ Y_t \big( w_{1:t} \big): w_{1:t} \in \mathcal{W}^t \big\}$ collects all the potential outcomes at time $t$.
assumption[Output]
The output is $\left\{ W_t, Y_t \right\}_{ t \geq 1} = \left\{ W_t, Y_t \big( W_{1:t} \big)_{ t \geq 1} \right\}$. The $\left\{ Y_t \right\}_{ t \geq 1}$ is called the outcome process.
Furthermore, we assume that the assignmemnt process is sequentially probabilistic, meaning that any assignment vector may be realized with positive probability at time $t$ given the history of the observable stochastic process up to time $t-1$. Let $\left\{ \mathcal{F}_t \right\}_{ t \geq 1}$ denote the natural filtration generated by the realized $\left\{ w_t, y_t \right\}_{ t \geq 1}$.
assumption[Sequentially probabilistic assignment process]
The assignment process satisfies $0 < \mathbb{P} \big( W_t = w \big| \mathcal{F}_{t-1} \big) < 1$ with probability one for all $w \in \mathcal{W}$. Moreover, the probabilities are determined by a filtered probability space of $\big\{ W_t, \big\{ Y_t ( w_{1:t} ), w_{1:t} \in \mathcal{W}^t \big\} \big\}_{t \geq 1}$.
definitionFor $t \geq 1$, $h \geq 0$ and any fixed $w, w^{\prime} \in \mathcal{W}$, the time$-t$, $h-$period ahead:
\begin{itemize}
• $Y_{t+h}( w ) - Y_{t+h}( w^{\prime} )$ (impulse causal effect).
• $\mathbb{E} \big[ Y_{t+h}( w ) - Y_{t+h}( w^{\prime} ) \big| \mathcal{F}_{t-1} \big]$ (impulse causal effect).
$\mathbb{E} \big[ Y_{t+h}( w ) - Y_{t+h}( w^{\prime} ) \big]$ (impulse causal effect).
\end{itemize}
remarkVarious further applications of the aforementioned frameworks can be considered starting with the pioneered work of aigner1988optimal who consider the optimal experimental design for error correction models, the econometric framework of de2020two which corresponds to the two-way fixed effects estimators with heterogeneous treatment effects as well as the novel framework of lewis2020double which corresponds to a time series setting based on machine learning and statistical learning techniques. However, we consider all aforementioned settings as more advanced topics and beyond the scope of our current discussion.
Panel Data Regression for Dynamic Causal Effects
Panel Experiments and Dynamic Causal Effects
Following the framework proposed by bojinov2021panel we consider a design-based framework which provides a generalization of the finite population literature in cross-sectional causal inference and time series experiments to panel experiments.
definitionFor $p < T$ and $\boldsymbol{w}, \tilde{\boldsymbol{w}} \in \mathcal{W}^{p+1}$,
\begin{itemize}
• the time$-t$ lag$-p$ average dynamic causal effect is
\begin{align}
\bar{\tau}_{ . t } ( \boldsymbol{w} , \tilde{\boldsymbol{w}} ; p ) := \frac{1}{N} \sum_{i=1}^N \tau_{i,t} ( \boldsymbol{w} , \tilde{\boldsymbol{w}} ; p ).
\end{align}
• the unit$-i$ lag$-p$ average dynamic causal effect is
\begin{align}
\bar{\tau}_{ i . } ( \boldsymbol{w} , \tilde{\boldsymbol{w}} ; p ) := \frac{1}{T-p} \sum_{t=p+1}^T \tau_{i,t} ( \boldsymbol{w} , \tilde{\boldsymbol{w}} ; p ).
\end{align}
• the total lag$-p$ average dynamic causal effect is
\begin{align}
\tau ( \boldsymbol{w} , \tilde{\boldsymbol{w}} ; p ) := \frac{1}{N(T-p)} \sum_{t=p+1}^T \sum_{i=1}^N \tau_{i,t} ( \boldsymbol{w} , \tilde{\boldsymbol{w}} ; p ).
\end{align}
\end{itemize}
exampleSuppose that we aim to generate the potential outcomes for the panel experiment using an autoregressive model formulated as below
\begin{align}
Y_{i,t} = \phi_{i,t,1} Y_{i,t-1} ( w_{i,1:t-1} ) + ... + \phi_{i,t,t-1} Y_{i,1} ( w_{i,1} ) + \beta_{i,t,0} w_{i,t} + ... + \beta_{i,t,t-1} w_{i,1} + \epsilon_{i,t}, \ \ \ \forall \ t > 1.
\end{align}
In a more compact form the above specification can be written as $Y_{i,1} ( w_{i,1} ) = \beta_{i,1,0} w_{i,1} + \epsilon_{i,1}$, where
\begin{align}
\phi_{i,t,s} =
\begin{cases}
\phi, & for \ s = 1
\\
0, & for \ s > 1.
\end{cases}
\ \ \ \ and \ \ \ \
\beta_{i,t,s}
\begin{cases}
\beta, & for \ s = 0
\\
0, & for \ s > 0.
\end{cases}
\end{align}
Within a simulation setting we can vary the choice of $\phi$, which governs the persistence of the process, and $\beta$, which governs the size of the contemporaneous causal effects. Varying degrees of persistence in conjecture with the size of contemporaneous causal effects might cause size distortions for values close to the boundary of the parameter space. A robust method that accommodates for these the presence of these features in the aforementioned econometric environment is an interesting avenue for further research. In addition, we can vary the probability of treatment $p_{i,t-p} (w) = p(w)$ as well as the distribution of the errors $\epsilon_{i,t}$, which can be either sampled from a standard normal or a Cauchy distribution.
Identifying Dynamic Causal Effects with Panel Data: Applications
example[see, goes2016institutions]
Consider the following panel SVAR(1) model defined as below
\begin{align}
\boldsymbol{B} \boldsymbol{y}_{i,t} = \boldsymbol{f}_i + \boldsymbol{A} (L) \boldsymbol{y}_{i,t-1} + \boldsymbol{e}_{i,t}, \ \ \ i \in \left\{ 1,..., N \right\}, \ \ t \in \left\{ 1,..., T \right\}
\end{align}
where $y_{i,t} \equiv [ c_{i,t}, k_{i,t} ]^{\prime}$ is a bi-dimensional vector of stacked endogenous variables, such that $c_{i,t}$ is the log of GDP per capita and $k_{i,t}$ is the proxy for institutional quality, $\boldsymbol{f}_i$ is a diagonal matrix of time-invariant individual-specific intercepts. Moreover, $\boldsymbol{A} (L) = \sum_{j=0}^p \boldsymbol{A}_j L^j$ is a polynomial of lagged coefficients, $\boldsymbol{A}_j$ is a matrix of coefficients, and $\boldsymbol{e}_{i,t}$ is a vector of stacked residuals, and $\boldsymbol{B}$ is a matrix of contemporaneous coefficients. However, since $\boldsymbol{f}_i$ is correlated to the error terms, estimation through OLS leads to biased coefficients. As proposed by baltagi2008econometric, a strategy to obtain consistent parameters and eliminate individual fixed-effects when $N$ is large and $T$ is fixed, is to apply first-differencing and use lagged instruments. We consider the GMM/IV technique using a system of $m=2$ equations. Each equation in the system has the first difference of an endogenous variable on the left hand side, $p$ lagged first differences of all $m$ endogenous variables on the right hand side, and no constant.
\begin{align}
\Delta y_{1,i,t} &= \sum_{j=1}^p \textcolor{blue}{\gamma_{11}^j} \Delta y_{1,i,t-j} + ... + \sum_{j=1}^p \textcolor{blue}{\gamma_{1m}^j } \Delta y_{m,i,t-j} + e_{1,i,t}
\\
\nonumber
\vdots \ \ &= \ \ \vdots
\\
\Delta y_{m,i,t} &= \sum_{j=1}^p \textcolor{blue}{ \gamma_{m1}^j } \Delta y_{1,i,t-j} + ... + \sum_{j=1}^p \textcolor{blue}{ \gamma_{mm}^j } \Delta y_{m,i,t-j} + e_{m,i,t}
\end{align}
Moreover, the model has an equivalent vector moving average $(VMA)$ representation which implies that the Panel SVAR model can be formulated as follows
\begin{align}
\boldsymbol{B} \boldsymbol{y}_{i,t} = \boldsymbol{\Phi}(L) \boldsymbol{e}_{i,t}, \ \ \ \boldsymbol{\Phi} (L) := \sum_{j=0}^{ \infty } \boldsymbol{\Phi}_j L^j \equiv \sum_{j=0}^{ \infty } \boldsymbol{A}_1^j L^j
\end{align}
is a polynomial of reduced-form responses to stochastic innovations and $\boldsymbol{\Phi}_0 = \boldsymbol{A}_1^0 \equiv \boldsymbol{I}_m$.
Thus, to recover the $\boldsymbol{B}$ matrix and ensure robust identification, we first retrieve the variance-covariance matrix $\boldsymbol{\Sigma}_e = \mathbb{E} \left[ \boldsymbol{e}_{i,t} \boldsymbol{e}_{i,t}^{\prime} \right]$. Since, it holds that $\boldsymbol{B}^{-1} \boldsymbol{e}_{i,t} = \boldsymbol{u}_{i,t}$, then $\boldsymbol{\Sigma}_e = \mathbb{E} \left[ \boldsymbol{B} \boldsymbol{u}_{i,t} \boldsymbol{u}_{i,t}^{\prime} \boldsymbol{B}^{\prime} \right]$.
The structural shocks of the model are assumed to be uncorrelated, such that, $\boldsymbol{u}_{i,t} \boldsymbol{u}_{i,t}^{\prime} = \boldsymbol{I}_m$, we identify the matrix $\boldsymbol{B}$ by decomposing the variance-covariance matrix into two triangular matrices.
Therefore, to identify the model we impose one restriction in order to orthogonalize the contemporaneous responses.
In particular, using the Cholesky ordering, and based on the variables of interest, institutional quality is set to have no contemporaneous effect on GDP per capita while the latter is allowed to contemporaneously impact the former. Overall, the study of goes2016institutions investigates the relation between institutions and economic growth using a structural panel VAR(1) model. Next, we focus on the approach to recover the IRs from the coefficient matrices.
Specifically, we take the following VMA representation of the Panel SVAR such that
\begin{align}
\boldsymbol{B} \boldsymbol{M} (L) = \boldsymbol{e}_{i,t}.
\end{align}
exampleWe briefly discuss the econometric specification proposed by huber2023bayesian which is suitable for dealing with cross-country heterogeneity in panel VARs using finite mixture models. Specifically, a global econometric identification and estimation model (see, also feldkircher2020factor) is
\begin{align}
\boldsymbol{y}_{it} = \boldsymbol{\beta}_i + \boldsymbol{A}_{i1} \boldsymbol{y}_{it-1} + ... + \boldsymbol{A}_{ip} \boldsymbol{y}_{it-p} + \boldsymbol{B}_{i1} \boldsymbol{y}_{-it-1} + ... + \boldsymbol{B}_{ip} \boldsymbol{y}_{-it-p} + \boldsymbol{\varepsilon}_{it}.
\end{align}
Under the Gaussian "state-of-the-world" one can impose Gaussian assumptions regarding the error covariances across countries. Thus, we can stack the country-specific errors $\boldsymbol{\varepsilon}_{it}$ in a $K-$dimensional vector $\boldsymbol{\varepsilon}_{t} = \left( \boldsymbol{\varepsilon}_{1t}^{\prime},..., \boldsymbol{\varepsilon}_{Nt}^{\prime} \right)^{\prime}$ and assume that $\boldsymbol{\varepsilon}_t \sim \mathcal{N} \big( \boldsymbol{0}, \boldsymbol{\Sigma}_t \big)$, where $\boldsymbol{\Sigma}_t$ is a $( K \times K )$ dimensional covariance matrix. Furthermore, according to huber2023bayesian, there are three important dimensions of model uncertainty which have been identified in the literature as summarized below:
\begin{itemize}
• The first source of model uncertainty is concerned with modelling contemporaneous relations across the shocks in the system \textcolor{blue}{(static interdependancies)}.
• The second source of model uncertainty focuses on the question whether coefficients associated with lagged domestic variables are homogeneous across countries \textcolor{blue}{(homogeneity restrictions)}. In particular, if such domestic coefficients are similar, then the so-called homogeneity restrictions might be imposed, effectively introducing the same set of coefficients for various countries and thus reducing the number of free parameters.
• The third source of model uncertainty deals with the question whether to allow for lagged dependencies between countries \textcolor{blue}{(dynamic interdependencies)}. Therefore, if we are interested to capture the international effects of climate shocks in globalized markets then capturing cross-country interdependencies on the macroeconomic level is crucial.
• From the empirical contribution perspective one can focus on how climate shocks impact country-specific macroeconomic fundamentals. Then the empirical analysis of the novel framework proposed by demonstrate that climate shocks are have a substantial impact on short-term interest rates and inflation, which is the primary conventional tool and target variable of central banks, and to a lesser degree on output and exchange rates (see, huber2023bayesian).
\end{itemize}
example[Macro-finance Application] A causal effect question of interest from the macro-finance literature is the linkage between financial crises and economic contraction (see, huber2018disentangling, romer2017new and baron2021banking). In particular, mei2023implicit employ a local projection panel data estimator with fixed effects to study the link between financial distress and economic conditions deterioration. Thus, an econometric issue of interest is to overcome the so-called Nickell bias when considering classical FE estimators. Consider an $h-$period ahead panel LP model
\begin{align}
y_{i,t+h} = \mu_i^{(h)} + \beta^{(h)} x_{i,t} + \varepsilon_{i,t+h}^{(h)}, \ \ for \ t = 1,...., n-h, \ \ h = 0,1,...,H.
\end{align}
Advanced Topics
Testing for Unstable Root in Structural ECMs
We follow the framework proposed by boswijk1994testing. Consider the single-equation error correction model of a time series $\left\{ y_t \right\}$ conditional upon the $( k \times 1 )$ vector time series $\left\{ z_t \right\}$, for $t \in \left\{ 1,... T \right\}$ as
align[align omitted — 198 chars of source]
where $\left\{ v_t \right\}$ is an innovation process relative to $\left\{ z_t, y_{t-j}, z_{t-j}, j = 1,2,... \right\}$ with positive variance $\omega^2$. Notice that $\theta$ and $\beta_j$ are $( k \times 1)$ parameter vectors such that $j \in \left\{ 1,..., p-1 \right\}$, such that $\theta$ defines the long-run equilibrium relation $y = \theta^{\prime} z$, the deviations from which lead to a correction of $y_t$ by a proportion of $\lambda$, the adjustment or error correction coefficient.
The conditional model is said to be stable if all roots of the characteristic equation
align[align omitted — 125 chars of source]
are outside the unit circle. In other words, stability of the model implies that the disequilibrium error $\left( y_t - \theta^{\prime} z_t \right)$ is a stationary process, even though $z_t$ and $y_t$ are integrated of order one and hence nonstationary. Specifically, if the model is stable, then $x_t = ( y_t, z_t^{\prime} )^{\prime}$ is cointegrated with cointegrating vector $( 1, - \theta )^{\prime}$. Thus, the purpose of this exercise is to develop a class of tests for the null hypothesis that the characteristic equation has a unit root, so that the model is unstable, against the alternative hypothesis of stability. Furthermore, the single-equation conditional model can be seen as a special case if a structural error correction model. This is a system of Error Correction Equations for a $( g \times 1 )$ vector of time series $\left\{ y_t \right\}$ conditional upon $\left\{ z_t \right\}$ such that (see, boswijk1994testing):
align[align omitted — 368 chars of source]
where $\left\{ \boldsymbol{v}_t \right\}$ is an innovation process with a positive-definite covariance matrix $\boldsymbol{\Omega}$ such that the above expression corresponds to a parametrization of a conditional model of $y_t$ given $z_t$ (if $\boldsymbol{\Gamma}_0 \neq \boldsymbol{I}_g)$. Next we consider the identification of these matrix parameters. In particular, the above model implies $g$ cointegrating relationships $\boldsymbol{\Gamma} \boldsymbol{y} + \boldsymbol{B} \boldsymbol{z} = \boldsymbol{0}$, provided that it is stable, such that the characteristic equation is expressed as below
align[align omitted — 201 chars of source]
has all roots outside the unit circle.
In other words, unless the parameters are restricted in some way, the structural model is not identified. Specifically, we identify the long-run relations by imposing restrictions of the usual form such that
align[align omitted — 172 chars of source]
where $\boldsymbol{\Gamma}_i$ and $\boldsymbol{B}_i$ denote the $i-$th row of $\boldsymbol{\Gamma}$ and $\boldsymbol{B}$, respectively, and where $\boldsymbol{R}_i$ is a known matrix of approximate order. Thus, the rank condition for identification of the $i-$th long-run relation
align[align omitted — 126 chars of source]
Then, the remaining parameters are identified by the normalization $\boldsymbol{\Gamma}_{0,ii} = 1$, and the restriction that $\boldsymbol{\Lambda} = \mathsf{diag} \big( \lambda_1,..., \lambda_g \big)$, that is, where $\boldsymbol{\Lambda}$ is a diagonal matrix. In practice, this means that only the disequilibrium error of the $i-$th long-run relation appears in the $i-$th structural error correction equation which means that the $i-$th equation is (over)-identified if the $i-$th long-run equation is.
remarkThe reason for restricting the error correction matrix $\boldsymbol{\Lambda}$ to be diagonal is twofold. Firstly, it allows for an interpretation of these separate equations as representing economic behaviour of a group of agents, whose target consists in a particular long-run relationship, such as a money demand relation or a consumption function. Furthermore, notice that the possibility that all endogenous variables are affected by each disequilibrium error is not excluded. However, this is considered to be a property of the reduced form of the system rather than the structural form. Moreover, imposing a symmetric matrix $\boldsymbol{\Lambda} = \mathsf{diag} \big( \lambda_1,..., \lambda_g \big)$, facilitates the implementation and interpretation of a test for instability. Notice that we assume that the number of stable relationships is equal to the number of cointegrating relationships.
Consequently, under this null hypothesis, there is no error correction in the $i-$th equation, which suggests that the $i-$th row of the system $\boldsymbol{\Gamma} y + \boldsymbol{B} \boldsymbol{z} = 0$ is not a cointegrating relationship. Specifically, let $z_t$ be generated by the following expression:
align[align omitted — 295 chars of source]
Assumption 1, can be interpreted as a form of exogeneity condition, because it states that the cointegration properties of the conditional model carry over to the full VAR system. Understanding well these concepts are essential especially if one is interested to apply advanced identification techniques in SVARs such as the Markov switching regime (see, lanne2002threshold and lanne2010structural) as well as identification in Gaussian Mixture Vector Autoregressive Models (see, kalliovirta2016gaussian and meitz2023mixture). In particular, kalliovirta2016gaussian develop a framework for Gaussian mixture vector autoregression which is a nonlinear vector autoregression and is designed for analyzing time series that exhibit regime-switching dynamics\footnote{The property of long memory and regime switching is examined in the study of diebold2001long while a regime switching panel data regression model is proposed by cheng2019regime. For a forecasting application see nyberg2018forecasting.} (see, kalliovirta2015gaussian and virolainen2020structural). Next, we consider another example motivated from the structural break literature specifically in the context of cointegrated models (see, also hansen2002testing).
Testing Cointegration Rank when some Cointegrating Directions are Changing
Consider the following VECM of order $p$ with a structural break such that
align*[align* omitted — 512 chars of source]
Then, the date of the break is characterized by the fraction $\lambda_0$ of the sample size $n$ such that $k_0 = \floor{\lambda_0}$, where $\lambda_0 \in [ \underline{\lambda}, \bar{\lambda} ]$ and $0 < \underline{\lambda} < \bar{\lambda} < 1$. Moreover, the VECM is assumed to satisfy the stability condition over the two regimes as given by the Assumption below.
assumptionThe roots of the characteristic polynomials of the $\mathsf{VECM}(1)$
\begin{align}
\mathsf{det} \left[ ( 1 - z ) \boldsymbol{I}_n - \alpha_i \beta_i^{\prime} z - \sum_{j=1}^p \Gamma_j ( 1 - z ) z^j \right], \ \ i = 0,1,
\end{align}
satisfy $z = 1$ or $| z | > 1$.
assumptionSuppose that $\left\{ \varepsilon_t \right\}$ is a vector martingale difference sequence with respect to $\mathcal{F}_{t-1}$ such that the variance-covariance matrix $\boldsymbol{\Sigma}_{\varepsilon} = \mathbb{E} [ \varepsilon_t \varepsilon_t^{\prime} | \mathcal{F}_{t-1} ]$, for $t = 1,2,...$.
remarkFollowing andrade2005testing, we emphasize that the assumption above does not allow for a shift in the innovation covariance matrix $\Sigma_{\varepsilon}$ across the two regimes. This would split the model into two separate ones if the short-term coefficient matrices were also shifting with the break and would thus require a separate analysis over the two sub-samples. Similarly we do not allow for a different number of cointegration relationships across the two two regimes. In particular, we consider the following cases:
\begin{itemize}
• The break (structural change) does not affect the loading factors. In this case their estimation requires an identification constraint. In other words, $\alpha_0$ and $\alpha_1$ span the same vector space and thus a natural identification scheme for the two regimes is given by $\alpha^{\prime} \Sigma_{\varepsilon} \alpha = I_r$.
• The break affects the cointegration vectors and the loading factors. This implies that the spaces spanned by $\alpha_0$ and $\alpha_1$ differ across the two regimes.
\end{itemize}
theorem[andrade2005testing]
Consider the model defined by the first expression with $\alpha_0 = \alpha_1 = \alpha$ and Assumption 2. Under $H_0$, when $T \to \infty$ it holds that
\begin{align*}
\xi_T ( \lambda_0 ) &\overset{d}{\to} \frac{1}{\lambda_0} \mathsf{trace} \left\{ \left( \int_0^{ \lambda_0 } d \boldsymbol{W}_0 \boldsymbol{G}_0^{\prime} \right) \left( \int_0^{ \lambda_0 } \boldsymbol{G}_0 \boldsymbol{G}_0^{\prime} du \right)^{-1} \left( \int_0^{ \lambda_0 } \boldsymbol{G}_0 d\boldsymbol{W}_0^{\prime} \right) \right\}
\\
&+
\frac{1}{ \left( 1 - \lambda_0 \right)} \mathsf{trace} \left\{ \left( \int_{ \lambda_0 }^1 d\boldsymbol{W}_0 \boldsymbol{G}_1^{\prime} \right) \left( \int_{ \lambda_0 }^1 \boldsymbol{G}_1 \boldsymbol{G}_1^{\prime} du \right)^{-1} \left( \int_{ \lambda_0 }^1 \boldsymbol{G}_1 d\boldsymbol{W}_0^{\prime} \right) \right\}
\end{align*}
Empirical Likelihood Estimation Approach
exampleConsider the following constant coefficient autoregressive model with time-varying variances as below:
\begin{align}
Y_t &= \beta_0 + \beta_1 Y_{t-1} + \beta_2 Y_{t-2} + ... + \beta_p Y_{t-p} + u_t,
\\
Y_t &= \boldsymbol{X}^{\top}_{t-1} \boldsymbol{\beta}_o + u_t, \ u_t = \sigma_t \varepsilon_t, \ t = 1,...,T,
\end{align}
where the vector of covariates is denoted by $\boldsymbol{X}_t = \big( 1, Y_{t-1},..., Y_{t-p} \big)^{\top} \in \mathbb{R}^{ p + 1}$ and the true model parameter of interest is denoted by $\boldsymbol{\beta}_o = \big( \beta_0, \beta_1,..., \beta_p \big)^{\top} \in \mathbb{R}^{ p + 1}$, where the lag order is finite and known.
Based on the aforementioned assumptions the estimation of the unknown parameter vector $\boldsymbol{\beta}_o$ based on the OLS estimator $\hat{\boldsymbol{\beta}}$ is given by
align[align omitted — 330 chars of source]
where $\boldsymbol{\Lambda} = \boldsymbol{\Omega}_1^{-1} \boldsymbol{\Omega}_2 \boldsymbol{\Omega}_1^{-1}$, are defined as $(p+1) \times (p+1)$ matrices.
To construct an empirical likelihood function, the estimation equations are defined as below:
align[align omitted — 144 chars of source]
for a generic parameter $\boldsymbol{b} \in \mathbb{R}^{p+1}$. By using the Lagrange multipliers method, we have that $\hat{\boldsymbol{\lambda}} = \hat{\boldsymbol{\lambda}} ( \boldsymbol{b} ) \in \mathbb{R}^{p+1}$ is the solution of the following set of equations:
align[align omitted — 189 chars of source]
Then, the corresponding empirical log-likelihood ratio is given by
align[align omitted — 164 chars of source]
and it holds that $\ell ( \boldsymbol{\beta}_0 ) \overset{d}{\to} \chi_p^2$, as $T \to \infty$.
High Dimensional Generalized Empirical Likelihood Estimation
In this section, we discuss relevant aspects to the empirical likelihood estimation for high dimensional dependent data, which is applicable to time series regression models (see, chang2015high). Further frameworks related to identification and estimation of high-dimensional time series with SVAR models are proposed by krampe2023structural, zhang2023statistical and adamek2022local. In particular, denote with $\boldsymbol{\theta} = ( \theta_1,..., \theta_p )^{\prime}$ be a $p-$dimensional parameter taking values in a parameter space $\Theta$. Consider a sequence of $r-$dimensional estimating equation such that
align[align omitted — 158 chars of source]
for some $r \geq p$, Then, the model information regarding the data and the data parameter is summarized by moment restrictions below:
align[align omitted — 97 chars of source]
where $\theta_0 \in \Theta$ is the true parameter. Furthermore, in order to preserve the dependence structure among the underlying data, we employ the blocking technique. Let $M$ and $L$ be two integers denoting the block length and separation between adjacent blocks, respectively. Then, the total number of blocks is
align[align omitted — 51 chars of source]
Then, the EL estimator $\boldsymbol{\theta}_o$ is $\widehat{\boldsymbol{\theta}}_{EL} = \mathsf{arg max}_{ \theta in \Theta } \ \mathsf{log} \ \mathcal{L} ( \boldsymbol{\theta} )$. Consequently, the maximization problem can be carried out more efficiently by solving the corresponding dual problem, which implies that $\widehat{\boldsymbol{\theta}}_{EL}$ can be obtained as below:
align[align omitted — 314 chars of source]
align[align omitted — 189 chars of source]
for any $\boldsymbol{\theta} \in Q$ and $\mathcal{N}$ an open interval containing zero.
example[Time Series Regression]
Consider a structural model $s-$dimensional time series $Y_t$ which involve unknown parameter $\boldsymbol{\theta} \in \mathbb{R}^p$ of interest as well as time innovations with unknown distributional form. Thus, suppose we have that
\begin{align}
h \big( Y_t,..., Y_{t-m}; \boldsymbol{\theta}_0 \big) = \boldsymbol{\varepsilon}_t \in \mathbb{R}^r
\end{align}
where $m \geq 1$ is some constant. In particular, for conventional vector autoregressive models such that
\begin{align}
Y_t = \boldsymbol{A}_1 Y_{t-1} + ... + \boldsymbol{A}_m Y_{t-m} + \eta_t,
\end{align}
Notice that these set of model parameters $\left\{ \boldsymbol{A}_1 ,..., \boldsymbol{A}_m \right\}$ correspond to coefficient matrices and are usually estimated based on some maximum likelihood approach (usually the MLS under Gaussianity) and according to the distributional assumptions of the model. Moreover, suppose that $\eta_t$ is the white noise series such that
\begin{align}
h \big( Y_t,..., Y_{t-m}; \boldsymbol{\theta}_0 \big)
=
\big( Y_t - \boldsymbol{A}_1 Y_{t-1} - ... - \boldsymbol{A}_m Y_{t-m} \big) \otimes \big( Y_t^{\top},...., Y_{t-m}^{\top} \big)^{\top}.
\end{align}
High dimensional time series analysis, requires to assume that the dimensionality of $Y_t$ is large in relation to sample size, that is, $s \to \infty$ as $n \to \infty$. Within a high-dimensional environment, the number of estimating equation and unknown parameters are both $s^2 m$. On the other hand, if we replace $\big( Y_t^{\top},...., Y_{t-m}^{\top} \big)^{\top}$ by $\big( Y_t^{\top},...., Y_{t-m - \ell}^{\top} \big)^{\top}$ for some fixed $\ell \geq 1$, then the model will be over-identified. This phenomenon of over-parametrization in such models is well-known to the literature. Thus, to implement a consistent estimation approach, the sparsity assumption allows to employ a penalized estimation methodology.
High Dimensional VARs with Common factors
We follow the framework proposed by miao2023high who study high-dimensional vector autoregressions (VARs) augmented with common factors that allow for strong cross-sectional dependence. This approach allows to incorporate in a unified framework a convinient mechanism for accommodating the interconnectedness and temporal co-variability that are often present in large dimensional systems.
Consider the $N-$dimensional vector-valued time series $\left\{ Y_t \right\} = \left\{ \left( y_{1t},..., y_{NT} \right)^{\prime} \right\}$, the high-dimensional VAR model of order $p$ with CFs given by
align[align omitted — 168 chars of source]
where $\boldsymbol{A}_1^0,..., \boldsymbol{A}_p^0$ are the $( N \times N )$ transition matrices and $\boldsymbol{u}_t$ is an $N-$dimensional vector of unobserved idiosyncratic errors. Moreover, the analytical framework allows for both the number of cross-sectional units $N$ and the number of time periods $T$ to pass to infinity. The lag length is also allowed to (slowly) grow to infinity with $(N,T)$. Estimation then is a natural high-dimensional problem.
Then, the $N-$dimensional VAR$(p)$ process $\left\{ Y_t \right\}$ can be rewritten in a companion form as an $Np-$dimensional VAR$(1)$ process with common factors such that:
align[align omitted — 821 chars of source]
As a result, the reverse characteristic polynomial of $Y_t$ can be written as below:
align[align omitted — 64 chars of source]
In the low-dimensional framework, the process is stationary if $\mathcal{A}(z)$ has no roots in and on the complex unit circle, or equivalently the largest modules of the eigenvalues of $\boldsymbol{\Phi}$ is less than 1. Therefore, to achieve identification, we shall study the Gram or signal matrix $\boldsymbol{S}_X = \boldsymbol{X}^{\prime} \boldsymbol{X}/ T$ and its population counterpart $\Sigma_X = \mathbb{E} \left( \boldsymbol{X}^{\prime}_t \boldsymbol{X}_t \right)$. In other words, one can study the deviation bounds for the Gram matrix, under the Gaussianity assumption and boundedness of the spectral density function.
In order to ensure that the matrix $\Sigma_X$ is well-behaved, we write $\boldsymbol{X}_{t+1}$ as a moving average process of infinite order MA$( \infty )$ such that
align[align omitted — 254 chars of source]
Eigenvalue Analysis:
itemize• First, consider $X_{t+1}^{(f)} = \sum_{j=0}^{\infty} \boldsymbol{\Phi}^j \boldsymbol{F}_{t-j}$, the component due to the common factors. The covariance matrix of $\boldsymbol{F}_{t}$ is a high-dimensional matrix with rank $R^0$ and explosive non-zero eigenvalues. In other words, even if the largest modules of the eigenvalues of $\boldsymbol{\Phi}$ is smaller than 1, the variances of the entries of $X_{t+1}^{(f)}$ are not assumed to be uniformly bounded.
• Consider $y_{it}^{(f)}$, which is the $i-$th entry of $X_{t+1}^{(f)}$. Let $e_{j,M}$ be the $j-$th column of $I_M$. Noting that $y_{it}^{(f)} = \big( e_{1,p} \otimes e_{i,N} \big)^{\prime} X_{t+1}^{(f)}$, we can write $y_{it}^{(f)}$ as the MA$(\infty)$ process given below:
\begin{align}
y_{it}^{(f)} = \sum_{j=0}^{\infty} \big( e_{1,p} \otimes e_{i,N} \big)^{\prime} \Phi^j \big( e_{1,p} \otimes e_{i,N} \big) f_{t-j}^0 \equiv \sum_{j=0}^{\infty} \alpha_{iN}^{(f)} (j) f_{t-j}^0,
\end{align}
in which $f_t^0$ are allowed to be serially correlated.
assumption[miao2023high]
Consider that the following conditions hold:
\begin{itemize}
• Let $u_t = C^{(u)} \varepsilon_t^{(u)}$, where $\varepsilon_t^{(u)} = \big( \varepsilon_{1,t}^{(u)},..., \varepsilon_{m,t}^{(u)} \big)^{\prime}$ such that $\varepsilon_{i,t}^{(u)}$ are $\textit{i.i.d}$ random variables across $(i,t)$ with mean zero and variance 1.
• $\left\{ f_t^0 \right\}$ follows a strictly stationary linear process given as below:
\begin{align}
f_t^0 - \mu_f = \sum_{j=0}^{\infty} C_j^{(f)} \epsilon^{(f)}_{t-j},
\end{align}
\end{itemize}
Fast Algorithm for Detection of Breaks in Large VAR models
Currently in the literature there are two approaches in terms of the identification of break-points. Firstly, there is a so-called "top down" procedure, in the sense that one tests all the data to determine if there is at least one change-point and iterates the procedure in the intervals immediately to the "left" and "right" of the most recently detected change-point. However, the particular methodology has certain weaknesses compared to a number of other thresholding procedures. A second approach is the so-called "bottom up" procedure motivated by the observation in the presence of multiple change-points or to mitigate the effects of inadequately controlled drift in the "baseline" mean value, it may be useful to compare a candidate change-point at $j$ to an appropriate "local" background $(j,k)$, where $i < j < k$. Similar approaches are the Wild Binary Segmentation (WBS) methodology which uses a random set of possible backgrounds and an apparently determined threshold (see, fang2020segmentation).
Illustrative Examples
exampleSuppose we are interested in testing whether there is a change in the covariance matrix of the stationary multivariate time series $\left\{ \boldsymbol{Y}_{n1},..., \boldsymbol{Y}_{n1} \right\}$. Then, this implies that
\begin{align}
\boldsymbol{Y}_{ni} := \boldsymbol{Y}_{n1}^{(0)} \boldsymbol{1} \left\{ i \leq k \right\} + \boldsymbol{Y}_{n1}^{(1)} \boldsymbol{1} \left\{ i > k \right\}, \ \ \ 1 \leq i \leq n,
\end{align}
for some change-point in the interval $1 \leq k \leq n$, where $\boldsymbol{Y}_{n1}^{(0)}$ denotes the stationary time series before and change-point and $\boldsymbol{Y}_{n1}^{(1)}$ denotes the stationary time series after the change-point. Therefore, we assume that it induces a change to the structure of the covariance matrix which implies the following expressions
\begin{align}
\boldsymbol{\Sigma}_n^{(0)} := \mathsf{Var} \left( Y_{n,1}^{(0)} \right) \ \ \ and \ \ \ \boldsymbol{\Sigma}_n^{(1)} := \mathsf{Var} \left( Y_{n, k+1}^{(1)} \right)
\end{align}
Denote with $\boldsymbol{\Sigma}_n( [j] ) := \mathsf{Var} \left( \boldsymbol{Y}_{nj} \right)$, $1 \leq j \leq n$. Testing the change-point problem at a single location
\begin{align}
H_0: \boldsymbol{\Sigma}_n( [j] ) \equiv \boldsymbol{\Sigma}_n^{(0)} \ \ \ \forall \ j = 1,...,n \ \ \ and \ \ \ H_1: \exists \ k \in \left\{ 2,..., n \right\}: \boldsymbol{\Sigma}_n( [k] ) \neq \boldsymbol{\Sigma}_n^{(0)},
\end{align}
which tests the null hypothesis of stability of the covariance structure against the alternative hypothesis of a change. An equivalent formulation of the statistical testing problem under consideration is given as
\begin{align}
H_0: k = n \ \ \ against \ \ \ H_1: k < n.
\end{align}
The proposed change-point detection test statistics are based are based on the partial sums of the stationary multivariate time series such that $\boldsymbol{S}_{nk} = \sum_{i \leq k} \boldsymbol{Y}_{ni} \boldsymbol{Y}_{ni}^{\prime}, \ \ \ k \geq 1$. Under the assumption that the true change-point $k$ is proportional to the sample size, $k = \floor{ \lambda n }$, where $0 < r < \lambda < 1$, the unknown break-point can be consistently estimated using the following estimator
\begin{align}
\hat{k}_n := \underset{ n_0 \leq k \leq n }{ \mathsf{arg max} } \ \frac{1}{n} \left| \boldsymbol{v}_n^{\prime} \left( \boldsymbol{S}_{nk} - \frac{k}{n} \boldsymbol{S}_{nn} \right) \boldsymbol{w}_n \right|
\end{align}
The formulation of the test statistic presented in the above example, implies that is the (smallest) time index $k \geq n_0 := \floor{nr}$, for some small $r > 0$, at which the maximum in the definition of the test statistic $C_n$ is attained. On the other hand, in order to robustify these CUSUM-type test statistics for detecting changes not only in the middle of the sample, the following statistic is proposed
align[align omitted — 333 chars of source]
which considers the maximal deviation from the average of the cumulated sums, the maximum being taken over all possible subsamples $\boldsymbol{Y}_{ n \ell}, i \leq \ell \leq j$, for $1 \leq i < j \leq n$. To be more precise, the particular algorithm implies that each subsample induces a corresponding CUSUM statistic and then the maximal test statistic is taken over all these subsamples. Therefore, it can be proved
align[align omitted — 147 chars of source]
Further studies related to testing for structural breaks in covariance structures include kao2018testing. In particular, $\widehat{\boldsymbol{\Sigma}}$ be the sample covariance matrix such that $\widehat{\boldsymbol{\Sigma}} = \frac{1}{T} \sum_{t=1}^T y_t y_t^{\prime}$. Then, for a given $\uptau \in [0,1]$, we define a point in time $\floor{ T \uptau }$, and we use the subscripts $\uptau$ and $1 - \uptau$ to denote quantities calculated using the subsamples $t = 1,..., \floor{ T \uptau }$ and $t = \floor{ T \uptau } + 1,...,T$, respectively. In particular, we consider the sequence of partial sample estimators
align[align omitted — 310 chars of source]
We denote with $w_t = \mathsf{vec} \big( y_t y_t^{\prime} \big)$ and $\bar{w}_t = \mathsf{vec} \big( y_t y_t^{\prime} - \boldsymbol{\Sigma} \big)$.
Main Asymptotic theory results
assumptionLet $\mathsf{sup}_t \mathbb{E} \left\lVert y_t \right\rVert^{2r} < \infty$ for some $r > 2$. Then, we define with
\begin{align}
V_{ \Sigma, T} = \frac{1}{T} \mathbb{E} \left[ \left( \sum_{t=1}^T \bar{w}_t \right) \left( \sum_{t=1}^T \bar{w}_t \right)^{\prime} \right]
\end{align}
theoremUnder Assumption (ref), as $T \to \infty$
\begin{align}
\frac{1}{\sqrt{T}} \sum_{t=1}^{ \floor{T \uptau} } \bar{w}_t \to \big[ V_{ \Sigma } \big]^{1/2} W_{n^2} (\uptau),
\end{align}
uniformly in $\uptau$. Redefining $\bar{w}_t$ in a richer probability space, under Assumptions 1, there exists a $\delta > 0$ such that $
\sum_{t=1}^{ \floor{T \uptau} } \bar{w}_t = \sum_{t=1}^{ \floor{T \uptau} } X_t + O_{a.s} \left( \floor{T \uptau}^{\frac{1}{2} - \delta} \right)$, uniformly in $\uptau$, where $X_t$ is a zero mean, $i.i.d$ Gaussian sequence with $\mathbb{E} \left( X_t X_t^{\prime} \right) = V_{\Sigma}$. Next, we focus on the estimation of $\boldsymbol{V}_{\Sigma}$.
In particular, if no serial dependence is present, a possible choice is the full sample estimator
align[align omitted — 243 chars of source]
Alternatively, one could use the sequence of partial sample estimators such that
align*[align* omitted — 475 chars of source]
Furthermore, to accommodate for the case in which $\Psi_{\ell} \equiv \mathbb{E} \big( \bar{w}_t \bar{w}_{t- \ell} \big) \neq 0$ for some $\ell$, we propose a weighted sum-of-covariance estimator with bandwidth $m$, such that
align[align omitted — 422 chars of source]
Alternatively, we can employ the following matrix
align[align omitted — 663 chars of source]
A similar expression holds for $\widehat{\Psi}_{\ell, 1 - \uptau}$. Furthermore, denote with
align[align omitted — 316 chars of source]
where $\Omega_T$ is positive definite uniformly in $T$, and $\Omega_T \to \Omega$ with $\left\lVert\Omega\right\rVert < \infty$.
theoremUnder the null hypothesis of no structural break in $\Sigma$ then, if Assumption (ref) holds, as $T \to \infty$, there exists a $\delta_o > 0$ such that
\begin{align}
\underset{ 1 \leq \floor{T \uptau } \leq T }{ \mathsf{sup} } \left\lVert \hat{\boldsymbol{V}}_{\Sigma, \uptau} - \boldsymbol{V}_{\Sigma} \right\rVert = o_p \left( \frac{1}{ T^{ \delta_o } } \right).
\end{align}
remarkaue2009break consider the detection of structural breaks in the covariance structure of multivariate time series under the assumption of stationarity and ergodicity. Their approach identifies breaks in the unconditional mean of a $p-$dimensional multivariate time series. Moreover, lee2023change propose a change point test for structural vector autoregressive models via independent component analysis. The test statistic is constructed based on the fitted residuals and the CUSUM functional.
Furthermore, a growing literature develops methodologies for testing structural breaks in factor models as in breitung2011testing, baltagi2021estimating and bai2024likelihood among others (see, also bai1998estimating). Regarding the literature relevant to structural break testing around the Vector Autoregressive framework of interest there are two main approaches. On the one hand, the approach of safikhani2022fast implies a fast and scalable algorithm for detection of structural breaks in large VAR models. The particular modelling environment corresponds to a piecewise linear Vector Autoregression model. Thus, testing for structural breaks takes the form of a time-varying VAR model and therefore in practise the statistical problem of interest is to test for the presence of time-varying vector autoregressive matrix coefficients across the blocks. Moreover, since the model is parametrized in a form of a large VAR model with a corresponding companion matrix, then the focus is on the fast and accurate break detection algorithm with respect to the dimensionality of the model. On the other hand, gourieroux2020identification proposed an econometric framework for identification and estimation of the structural vector autoregressive model where the main focus is how the distributional assumptions on the shocks affect the identification procedure. In practice, based on the non-Gaussianity assumption of the structural shocks the model is identifiable and the estimation of model parameters is achieved via the use of the likelihood function. Therefore, testing for structural breaks in such a setting could be implemented using an appropriate specification which captures time-variation.
Large VAR Models: Model Formulation
For the remaining of this section, we follow the framework proposed by safikhani2022fast. Their procedure is found to be scalable to big high-dimensional time series datasets with a computational complexity that can achieve $O ( \sqrt{n} )$, where $n$ is the length of the time series (sample size), compared to an exhaustive procedure that requires $O(n)$ steps.
Suppose that there exist $m_0$ break points $0 < t_1 < ... t_{m_0} < T$, with $t_0 = 0$ and $t_{ m_0 + 1 } = T$ where $j \in \left\{ 1,..., m_0 + 1\right\}$. Notice that if there are no break points, then $m_0 = 0$ and so $( t_0 = 1, t_1 = T )$ which corresponds to the full sample period.
Thus, we can assume that $m_0 \geq 1$, which implies that $( t_0 = 1, t_2 = T )$ and so $j = \left\{ 1, 2 \right\}$. In other words, for $t_{j-1} \leq t < t_j$ (e.g., $t_0 \leq t < t_1$, i.e., $t = 1,..., T$) we have the following model:
align[align omitted — 103 chars of source]
Since in the case that $m_0 = 1$ then $j \in \left\{ 1,2\right\}$ then we have a two-regime model estimation:
align[align omitted — 519 chars of source]
There is a single break-point and we fit a different VAR model before the break, i.e. $M_0$ pre-break based on the observations up to the unknown break-point, and a we fit $M_1$ post-break based on the observations from the unknown break-point and onward until the end of the full sample (see, safikhani2022fast).
itemize• In each segment we estimate the VAR process. Let $\boldsymbol{y}_t$ be a $p-$dimensional vector of observations at time $t$ and $\boldsymbol{\Phi}_{(\ell, j)}$ be an $( p \times p )$ sparse coefficient matrix corresponding to the $\ell-$th lag of a VAR process of order $q$ during the $j-$th stationary segment, and $\varepsilon_t$ is a white-noise process with zero mean and variance matrix $\boldsymbol{\Sigma}_j$.
• In each segment $[ t_{j-1}, t_j )$, all model parameters are assumed to be fixed. However, the auto-regressive (AR) parameters $\boldsymbol{\Phi}_{( \ell, j)}$ will change values across segments, while the error covariance across all segments is assumed to be $\boldsymbol{\Sigma}_j = \sigma^2 \boldsymbol{I}$.
Based on the aforementioned setting proposed by safikhani2022fast, the unknown parameters in each segment are: the number of break-points $m_0$, their locations $t_j, j = 1,..., m_0$, the VAR parameters $\boldsymbol{\Phi}_{(q, j)}$ together with the covariance matrix. Therefore, according to , the statistical problem is then to detect the break points $t_j$, in a computational efficient manner that is also scalable for very large values of $T$. Additionally, we are also interested to estimate accurately the VAR parameters $\boldsymbol{\Phi}_{( \ell, j)}$, under a high-dimensional environment $( p >> T )$.
A Block Segmentation Scheme Based Algorithm
The main idea of the BSS is to partition the time points into blocks of size $b_n$ and fix the VAR parameters within each block. To this end, define a sequence of time points $q = r_0 < r_1 < ... < r_{ k_n } = T + 1$ which play the role of the end points for the blocks. In other words, the total number of blocks is calculated as:
align[align omitted — 135 chars of source]
where $k_n$ is the total number of blocks based on the (effective) sample size and $b_n$ is the length size of each block which is kept fixed across all blocks. Notice that throughout, the dimensions of the vector $\boldsymbol{y}_t$ remains fixed having $p$ elements as well as the (effective) sample size being $n$.
The theoretical results presented in safikhani2022fast deal with the high-dimensional case such that the sparsity levels $d_{ k_j }$ increase with the sample size, $T$. Specifically, we define with $p \equiv p(n)$ and $m_0 \equiv m_0 (n)$ and $d_{ k_j } \equiv d_{ k_j } (n)$, where $n = T - q + 1$. In other words, $n$ is the effective sample size or the length of the time series for estimation of model parameters purposes, since the number of lags used for constructing additional regressors affects the sample size (see, safikhani2022fast).
The minimum distance between two consecutive break points is denoted by
align[align omitted — 94 chars of source]
Let $\boldsymbol{\mathcal{Y}} \in \mathbb{R}^{ n \times p}$ and $\boldsymbol{\mathcal{X}} \in \mathbb{R}^{ n \times k_n p q }$ and $\boldsymbol{\theta} \in \mathbb{R}^{k_n p q \times p }$ and $\boldsymbol{E} \in \mathbb{R}^{ n \times p }$. In other words, based on this parametrization, $\theta_i \neq 0$ for $i \geq 2$ implies a change in the VAR coefficients. Therefore, for $j \in \left\{ 1,..., m_0 \right\}$, the structural break points $t_j$ can be estimated as block-end time point $r_{i-1}$, where $i \geq 2$ and $\theta_i \neq 0$.
Then, the model is formulated as below
align[align omitted — 284 chars of source]
where $\pi_b = k_n p^2 q$ and $\boldsymbol{\Theta} = \mathsf{vec} ( \boldsymbol{\theta} ) \in \mathbb{R}^{ \pi_b \times 1 }$. The initial estimate of the parameter $\boldsymbol{\Theta}$ is obtained:
align[align omitted — 384 chars of source]
Notice that the above high dimensional problem (convexity is preserved) uses fused lasso penalty with two $\ell_1$ penalties controlling the number of break points and the sparsity of the VAR model.
Denote the set of indices of blocks with nonzero jumps and corresponding estimated change points obtained from solving the high-dimensional problem as below:
align[align omitted — 330 chars of source]
The total number of estimated change points in this step corresponds to the cardinality of the set $\mathcal{A}_n$, where $\hat{m} = \left| \mathcal{A}_n \right|$. Moreover, the block size $b_n$ acts as a tuning parameter that regulates the number of model parameters to be estimated. In addition to this, the algorithm applies a local screening step. Since the set $\mathcal{A}_n$ of candidate change points tends to overestimates their numbers, a screening step to eliminate redundant break points is required. According to safikhani2022fast, the main idea goes is to estimate the VAR parameters locally on the left and right side of each selected break point in the first step and compare them to one VAR parameter estimated from combining the left and right of the selected break point as one large stationary segment. Now, if the selected break point is close to a true break point, the sum of squared errors calculated assuming stationarity around the true break point will be much larger compared to the sum of squared errors calculated from two separate VAR parameter estimates on the right and left of the selected break point. Therefore, we can get consistent estimates of the number of break points by minimizing a localized information criterion (LIC) comprising of the sum of squared errors and a penalty term on the number of break points.
Next, we describe the localized screening step in more details. Recall that $\mathcal{A}
= \left\{ \hat{t}_1, \hat{t}_2,..., \hat{t}_{ \hat{m} } \right\}$ is the set of candidate break points selected in the first step. Then, for each subset $A \subset \mathcal{A}_n$, we define the following local VAR parameter estimates for some $\widehat{t}_i \in A$ such that
align[align omitted — 351 chars of source]
where $a_n$ corresponds to the neighbourhood size in which the VAR parameters are estimated. The procedure of safikhani2022fast, can be directly implemented for identifying and dating the presence of multiple break-points in multivariate time series. In contrast to the literature of SVAR models, the assumption is that the model parameters are identifiable but a possible parameter instability could exist.
Consistency of the BSS Estimator
To establish the consistency properties of the BSS-based estimator relevant regularity conditions are required which we briefly present below.
assumption[see, safikhani2022fast]
For each $j \in \left\{ 1,2,..., m_0 + 1 \right\}$, the process
\begin{align}
\boldsymbol{y}_{(j),t} = \boldsymbol{\Phi}_{ (1,j) } \boldsymbol{y}_{(j),t-1} + ... + \boldsymbol{\Phi}_{ (q,j) } \boldsymbol{y}_{(j),t-q} + \boldsymbol{\Sigma}_j^{1/2} \boldsymbol{\varepsilon}_t
\end{align}
is a stationary Gaussian time series. Denote the covariance matrices with
\begin{align}
\boldsymbol{\Gamma}_{(j)}(h) = \mathsf{Cov} \left( \boldsymbol{y}_{(j),t}, \boldsymbol{y}_{(j),t+h} \right) , \ \ for \ \ t, h \in \mathbb{Z}.
\end{align}
assumption[see, safikhani2022fast]
The matrices $\boldsymbol{\Phi}_{ (1,j) }$ are sparse such that for all $k \in \left\{ 1,... p \right\}$ and $j \in \left\{ 1,..., m_0 \right\}$, $d_{ k_j } << p$, that is, $d_{ k_j } / p = o(1)$. There exists a positive constant $M_{ \Phi } > 0$ such that
\begin{align}
\underset{ 1 \leq j \leq m_0 + 1 }{ \mathsf{max} } \left\lVert \boldsymbol{\Phi}_{ (\cdot,j) } \right\rVert_{ \infty } \leq M_{ \Phi }
\end{align}
exampleConsider the CUSUM series of $y_{\ell t}$ over a generic segment $[ s, e ]$ for some $1 \leq s < e < T$,
\begin{align}
\mathcal{Y}_{s,b,e}^{\ell} = \frac{1}{ \sigma_{\ell} } \sqrt{ \frac{( b - s + 1 ) ( e - b ) }{ e - s + 1} } \left( \frac{1}{b-s+1} \sum_{t=s}^b y_{\ell t} - \frac{1}{e - b} \sum_{t=b+1}^{e} y_{\ell t} \right),
\end{align}
for $b = s,..., e-1$, where $\sigma_{\ell}$ denotes a scaling constant for treating all rows of the sequence $y_{\ell t}$ such that $1 \leq \ell \leq N$ on equal footing. Notice that if $\epsilon_{\ell t}$ were $\textit{i.i.d}$ Gaussian random variables, the maximum likelihood estimator of the change-point location for $\big\{ y_{\ell t}, s \leq t \leq e \big\}$ would coincide with $\underset{ b \in [ s, e) }{ \mathsf{arg \max} } \left| \mathcal{Y}_{s,b,e}^{\ell} \right|$. Moreover, $\mathcal{D}_{s, n e} (m)$ takes the contrast between the $m$ largest CUSUM values $\left| \mathcal{Y}_{s,b,e}^{\ell} \right|, 1 \leq \ell \leq m$ and the rest at each $b$, and thus partitions the coordinates into the $m$ that are the most likely to contain a change-point and those which are not in a point-wise manner. Then, the test statistic is derived by maximizing the two-dimensional array of DC statistics over both time and cross-sectional indices as
\begin{align}
\mathcal{T}_{s,e} = \underset{ b \in [s, e) }{ \mathsf{max} } \underset{ 1 \leq m \leq N }{ \mathsf{max} } \mathcal{D}_{s, n e} (m).
\end{align}
Therefore, the presence of multiple break-points implies that there are multiple regimes within the full sample, where the corresponding time series sequences appear to have structural breaks.
theorem[fang2020segmentation]
Let $( X_1,..., X_m )$ be an independent sequence of normally distributed random variables with mean $\mu$ and variance 1. Then for $\mathcal{Z}_{i,j,k}$ we have for $b \to \infty$ and $m \approx b^2$,
\begin{align}
\mathbb{P} \left( \underset{ 0 \leq i < j < k \leq m }{ \mathsf{max} } \left| \mathcal{Z}_{i,j,k} \right| \geq b \right).
\end{align}
Sieve Bootstrap for Functional Vector Autoregressions
According to paparoditis2018sieve, bootstrap procedures for Hilbert space-valued time series proposed so far in the literature, are mainly attempts to adapt, to the infinite dimensional functional framework, of bootstrap methods that have been developed for the finite dimensional time series case. Specifically, paparoditis2018sieve shows, that under quite general assumptions, the stochastic process of Fourier coefficients obeys a so-called vector autoregressive representation and this representation plays a key role in developing a bootstrap procedure for the functional time series at hand. To capture the essential driving functional parts of the underlying infinite dimensional process, the first $m$ functional principal components are used and the corresponding $m-$dimensional time series of Fourier coefficients is bootstrapped using a $p$th order vector autoregression fitted to the vector time series of sample Fourier coefficients. In this way, a $m-$dimensional pseudo-time series of Fourier coefficients is generated which imitates the temporal dependence structure of the vector time series of sample Fourier coefficients. Thus, using the truncated Karhunen-Loeve expansion, these pseudo-coefficients are then transformed to functional bootstrap replicates of the main driving, principal components, of the observed functional time series.
The bootstrap procedure
The main building block of the procedure proposed by paparoditis2018sieve is to generate pseudo-replicates $X_1^{*},...,X_n^{*}$ of the functional time series at hand by first bootstrapping the $m-$dimensional time series of Fourier coefficients $\xi_t = ( \xi_{1,t}, \xi_{2,t},..., \xi_{m,t} )$, $t =1,2,...n$, corresponding to the first $m$ principal components. This $m-$dimensional time series of Fourier coefficients is bootstrapped using the autoregressive representation $\xi_t$. Then, the generated $m-$dimensional pseudo-time series of Fourier coefficients is then transformed to functional principal pseudo-components by means of truncated Karhunen-Loeve expansion $\sum_{j=1}^n \xi_{j,t} v_j$. Adding to this, an appropriately resampled functional noise leads to the functional pseudo-time series $X_1^{*}, X_2^{*} ,..., X_n^{*}$. However, since the $\xi_t'$s are not observed, we work with the time series of estimates scores. The functional sieve bootstrap algorithm of paparoditis2018sieve is:
itemize• Select a number $m = m(n)$ of functional principal components and an autoregressive order $p = p(n)$, both finite and depending on $n$
• Let
\begin{align}
\widehat{ \boldsymbol{\xi}} = \left( \widehat{\xi}_{j,t} = \langle X_t, \widehat{v}_j \rangle, j = 1,...,m \right)^{\top}, \ \ \ t =1,...,n,
\end{align}
be the $m-$dimensional series of estimated Fourier coefficients, where we denote with $\widehat{v}_j$, $j = 1,...,m$ the estimated eigenfunctions corresponding to the estimated eigenvalues $\widehat{\lambda}_1 > \widehat{\lambda}_2 > ... > \widehat{\lambda}_m$ of the sample covariance operator
\begin{align}
\widehat{C}_0 = n^{-1} \sum_{t=1}^n \left( X_t - \bar{X}_n \right) \otimes \left( X_t - \bar{X}_n \right), \ \ \ \bar{X}_n = n^{-1} \sum_{t=1}^n X_t.
\end{align}
• Let $\widehat{X}_{t,m} = \sum_{j=1}^m \widehat{\xi}_{j,t} \widehat{v}_j$ and define the functional residuals $\widehat{U}_{t,m} = X_t - \widehat{X}_{t,m}$ and define the functional residuals $\widehat{U}_{t,m} = X_t - \widehat{X}_{t,m}$, $t=1,...,n$.
• Fit a $p$th order vector autoregressive process to the $m-$dimensional time series $\widehat{\xi}_t$, $t = 1,...,n$, denote by $\widehat{A}_{j,p} (m)$, $j = 1,...,p$, the estimates of the autoregressive matrices and by $\widehat{e}_{t,p}$ the residuals,
\begin{align}
\widehat{e}_{t,p} = \widehat{\xi}_t - \sum_{j=1}^p \widehat{A}_{j,p} (m) \widehat{\xi}_{t-j}, \ \ \ t = p+1,p+2,...,n.
\end{align}
We focus on the following Yule-Walker estimators for $\widehat{A}_{j,p} (m)$, $j = 1,...,p$.
• Generate a $m-$dimensional pseudo time series of scores $\xi^{*}_t = \left( \xi^{*}_{1,t},...,\xi^{*}_{m,t} \right)$, $t =1,2,...,n$,
using
\begin{align}
\xi^{*}_t = \sum_{j=1}^p \widehat{A}_{j,p}(m) \xi^{*}_{t-j} + e^{*}_t,
\end{align}
where $e^{*}_t$, $t=1,...,n$ are i.i.d random vectors having as distribution the empirical distribution of the centered residual vectors $\widetilde{e}_{t,p} = \widehat{e}_{t,p} - \bar{\widehat{e}}_{n,t}$, for $t = p + 1, p+2,...,n$ and $\bar{\widehat{e}} = (n - p)^{-1} \sum_{t=p+1}^n \widehat{e}_{t,p}$.
• Generate a pseudo-functional time series $X_1^{*},...,X_n^{*}$ ,where
\begin{align}
\xi^{*}_t = \sum_{j=1}^m \xi_{j,t}^{*} \widehat{v}_j + U_t^{*}, \ \ \ t=1,...,n.
\end{align}
and $U_1^{*},...,U_n^{*}$ are i.i.d random functions obtained by choosing with replacement from the set of centered functional residuals $\widehat{U}_{t,m} - \bar{\widehat{U}}_{t}$ and $\bar{\widehat{U}}_{t} = n^{-1} \sum_{t=1}^n \widehat{U}_{t,m}$, for $t=1,...,n$.
remarkNotice that $X_1^{*},...,X_n^{*}$ are functional pseudo-random variables and the the autoregressive representation of the vector time series of Fourier coefficients is solely used as a toll to bootstrap the $m$ main functional principal components of the functional time series. In fact, it is this autoregressive representation which allows the generation of the pseudo-time series of Fourier coefficients $\xi^{*}_1,...,\xi^{*}_n$ in Step 4 and Step 5 in a way that imitates the dependence structure of the sample Fourier coefficients $\xi_1,...,\xi_n$. These pseudo-Fourier coefficients are transformed to bootstrapped main principal components by means of the truncated and estimated Karhunen-Loeve expansion which together with the additive functional noise $U_t^{*}$, lead to the new functional pseudo-observations $X_1^{*},...,X_n^{*}$ (see, paparoditis2018sieve).
Furthermore, an important issue for bootstrap-based inference methods is to investigate the validity of the functional sieve bootstrap applied in order to approximate the distribution of some statistic $T_n = T \left( X_1,...,X_n \right)$ of interest, when the bootstrap analogue $T_n^{*} = T \left( X_1^{*},...,X_n^{*} \right)$ is used. Notice that establishing validity of a bootstrap procedure for time series heavily depends on two issues. On the dependence structure of the underlying process which affects the distribution of the statistic of interest and on the capability of the bootstrap procedure used to mimic appropriately this dependence structure.
Recall the definition given by paparoditis2018sieve such that
align[align omitted — 89 chars of source]
and observe that $\xi^{*}_t = \sum_{l=0}^{\infty} \widehat{\Psi}_{l,p}(m) e^{*}_{t-l}$, where $\widehat{\Psi}_{0,p}(m) = I_m$ and the power series
align[align omitted — 159 chars of source]
converges for $|z| \leq 1$. Thus, following paparoditis2018sieve we can decompose each sequence as below
align[align omitted — 375 chars of source]
where for each $t \in \mathbb{Z}, \left\{ e_{s,t}^{*} , s \in \mathbb{Z} \right\}$ is an independent copy of $\left\{ e_{s}^{*} , s \in \mathbb{Z} \right\}$. Notice that,
align[align omitted — 171 chars of source]
By Minskowski's inequality, we have that
align[align omitted — 426 chars of source]
Thus, evaluating the first expectation term, we obtain that using $\left\lVertA\right\rVert_F^2 = tr \left( A A^{\top} \right)$ and the submultiplicative property of the Frobenius matrix norm, that
align*[align* omitted — 402 chars of source]
where $\widehat{\Sigma}_{e,p}(m) = \widehat{\Sigma}_{e,p}^{1 / 2}(m) \widehat{\Sigma}_{e,p}^{1 / 2}(m)$. An identical expression appears for the second expectation term on the right-hand side of (ref). Applying Minkowski's inequality again, we get by the exponential decay of $\left\lVert \widehat{\Psi}_{l,p} (m) \right\rVert_F$, such that the following probability bound holds (see, paparoditis2018sieve)
align*[align* omitted — 420 chars of source]
Conclusion
There are various statistical identification procedures for SVAR models such as imposing sign-restrictions, short-run restrictions, long-run restrictions, identification by higher-order moments as well as identification by conditional heteroscedasticity and changes in volatility (e.g., see, lanne2008identifying, lanne2008statistical. More precisely, by exploiting the heteroscedasticity of the errors $\varepsilon_t$, then the identification of the structural parameters of the system can be achieved. In particular, lanne2010structural assume Markov switching and a smooth transition in the covariance matrix of the error term $\varepsilon_t$ of the model. Specifically, the structural analysis of VARs in this case is based on the Markov regime switching property to identify shocks, which holds due to the fact that the reduced form error covariance matrix varies across states. Furthermore, a different stream of literature considers identification in SVAR models by assuming that the error terms are non-Gaussian and mutually independent (e.g., see lanne2017identification and gourieroux2020identification). For example, lanne2010structural assume that the errors of the model are independent over time with a distribution that is a mixture of two Gaussian distributions with zero means and diagonal covariance matrices, one of which is an identify matrix and the other one has positive diagonal elements, which for identifiability have to be distinct. Roughly speaking there are specific systems where the use of the non-Gaussianity property is a more suitable identification strategy of structural shocks of the SVAR system which we leave for discussion in a follow-up paper.
In this note we have reviewed key statistical properties of VAR processes, cointegrated VAR processes and SVAR processes as well as suitable identification strategies for the structural parameters of these structural econometric specifications (see, also mumtaz2018vars). Moreover, we have discusses several empirical-driven applications from the applied macroeconometrics literature and we studied the proposed identification and estimation methods employed to those cases. Then, motivated from the literature of dynamic causal effects (see, mertens2013dynamic, stock2018identification and budnik2023identifying), we have motivated the main statistical and econometric tools for identification of structural econometric models, commonly used for counterfactual analysis purposes, and then presented some examples of time series regression models, both important for understanding suitable techniques for policy-making evaluation in macroeconometrics. We leave any further presentation of other relevant topics for further research discussions. Lastly, some advanced topics were also presented such as break testing for unstable roots in structural error correction models, estimation techniques for the optimal lag order, the estimation of a high dimensional VAR model as well as a fast algorithmic procedure presented in the literature for detecting structural breaks in large VAR models.
In the Appendix of this set of lecture notes we present an example of the maximum likelihood estimation for $\alpha-$stable autoregressive processes (see, andrews2009maximum) as well as the main asymptotic theory results for inference for the VEC(1) model from guo2023inference.