Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
79,075 characters · 14 sections · 65 citation commands
Time Series Estimation of the Dynamic Effects of Disaster-Type Shocks
JEL Classification: C21, C22\\ Keywords: Heavy-tails, independent component analysis, distance covariance
\setcounter{page}{0} \thispagestyle{empty} \baselineskip=18.0pt
The novel coronavirus (covid-19) outbreak has drawn attention to the modeling of rare events such as pandemics and natural disasters. How do we estimate the dynamic effects of disaster type shocks on economic variables? How do we estimate the dynamic effects of economic shocks when the data are contaminated by rare events that do not have economic origins? Should measures of disasters be modeled as exogenous? A difficulty in predicting the occurrence of disasters and designing polices to mitigate their impact is that there are few such data points even over a long span. After all, the CDC has only documented four influenza pandemics in the U.S. with deaths in excess of 100,000 over a 120 year period starting in 1900.\footnote{These are the Spanish flu in 1918 (675,000 US deaths), the H2N2 virus in 1957-58 (116,000 US deaths), H3N2 virus in 1968 (100,000 US deaths), the H1N1 virus in 2009 (12,500 US deaths). Source \url{https://www.cdc.gov/flu/pandemic-resources/basics/past-pandemics.html}.} For natural disasters, the 12,000 deaths from the Galveston hurricane of 1900 remains a record, with the 1200 deaths from Katrina coming in a distant second in terms of casualties. Worldwide, only seven earthquakes since 1500 were larger than 9 in magnitude,\footnote{Source: \url{https://en.wikipedia.org/wiki/Lists_of_earthquakes#Largest_earthquakes_by_magnitude}.} and September 11 was the only terror attack on U.S. soil with more than 300 deaths, let alone 3000. Nonetheless, when a rare disaster strikes, it strikes in a ferocious manner as covid-19 reminds us. Though these events have been intensely studied on a case by case basis, it is also of interest to study these events over a long time span.\footnote{For a review of methodologies used, see bds:19.} We apply standard time series methodology to analyze the dynamic effects of rare events by modeling these events as being driven by heavy-tailed shocks.
To fix ideas, consider Figure (ref) which plots the real cost of 258 natural disasters over the period 1980:1-2019:12, augmented to include 9/11.\footnote{The series combines data from the National Oceanic and Atmospheric Administriation and the Insurance Information Institute as explained in lmn3-PP:21.} The series is dominated by a few events with Hurricane Katrina in August 2005 being the largest, accounting for 9.2% of total cost. This is followed by the four weeks in the summer of 2017 when Hurricane Harvey contributed 7% in August, while Hurricanes Irma and Maria in September created a combined cost of 8%. These are followed by 9/11 in 2001 and superstorm Sandy in October 2012, each contributing to about 5% of total costs. Another measure of the cost of disasters is the number of lives lost. This series, while not plotted to conserve space, has spikes that are even more extreme. Over the same time period, 49% of disaster-related deaths can be attributed to Hurricanes Maria/Irma, 9/11, and Hurricane Katrina, with the heat wave of 1980 coming in fourth. Both series have features of a heavy-tailed process, and we will subsequently use sample kurtosis as evidence of tail heaviness.
Heavy-tailed data pack a lot of information in a few observations. Because of its large variability, the dynamic effects of disaster shocks should in principle be consistently estimable. Indeed, if all variables in a multivariate system have heavy tails, we show below that the least squares estimator will converge at a fast rate of $(\frac{T}{\ln T})^{1/\alpha}$ where $\alpha$ is the index of the heavy-tailed shock and $T$ is the sample size. Though the distribution theory is a bit nonstandard, the regression framework is the same as the standard case when all variables have light tails. But while many macroeconomic time series have excess kurtosis, they do not fit the characterization of heavy tails. For example, unemployment and industrial production have kurtosis of less than 10, while the disaster series shown in Figure (ref) has kurtosis in excess of 70, and the estimated tail index of approximately one suggests a distribution with infinite variance and possibly infinite mean.\footnote{The method often used to estimate the tail index is due to hill:75.} beare-toda:20 analyzed covid-19 cases across US counties and finds that the right tail of the distribution has a Pareto exponent close to one. This motivates a new multivariate framework in which finite and infinite variance shocks co-exist in such a way that the economic variables can be affected by heavy-tailed shocks but not dominated by them.
Our point of departure is that the $n$ primitive shocks $u=(u_1,\ldots,u_n)$ are assumed to be mutually independent, a condition stronger than the commonly used assumption of mutual orthogonality that is no longer meaningful when one of the shocks has infinite variance. We develop a HL (`heavy-light') framework in which the coefficient estimates on the infinite variance regressors are consistent at a rate of $T^{1/\alpha}$, still faster than the usual rate of $\sqrt{T}$. We then show that the disaster shock series can be identified by the magnitude of its kurtosis and the sign of its impact effect. For estimation, we perform an independent components analysis (ICA) based on distance covariance of the pre-whitened data, an approach first suggested in matteson-tsay:17 for finite variance data. davisfernandes2021 recently showed that the procedure remains valid when a shock has infinite variance provided its mean is finite.
Prewhitening by singular value decomposition is often used to remove correlations prior to ICA estimation to focus on the higher order signals. For SVAR applications, prewhitening by Choleski decomposition is more natural since it is already used to identify mutually uncorrelated shocks with a recursive structure. We show that even though the variance of the shocks may not exist, Choleski decomposition of the sample covariance remains valid. Furthermore, we show that ICA will still recover the shocks in spite of sampling uncertainty in the VAR residuals. To assess the restrictions imposed on the SVAR, we apply a permutation-based procedure to the distance covariance statistic as a test for independence that is robust to infinite variance data. It complements other SVAR specification tests made possible by the independence assumption, as discussed below.
The rest of the paper is structured as follows. Section 2 summarizes the key properties of heavy-tailed linear processes and discusses the implications for VAR estimation. Section 3 presents the HL framework. Consistency and limiting behavior of the least squares estimator for parameters in a VAR are shown. Identification, estimation via distance covariance, and implementation of an independence test are then discussed. Section 4 uses simulations and three applications to assess the properties of the proposed procedure. The appendix contains background material on distance covariance as well as proofs of the main results in Section 3.
Disaster events are rare and heavy tails can be a useful characterization of their probabilistic structure. Well known heavy-tailed distributions include the Student-$t$, $F$, Fr\'echet, as well as infinite variance stable and Pareto distributions.
Let $F(x)=P(Z\le x)$ for $x\in\mathbb R$ be the distribution of an IID sequence of random variables $\{Z_t,t=0,\pm 1,\pm2, \ldots\}$. Then $F$ has Pareto-like tails with tail index $\alpha>0$ if
where $C$ is a finite and positive constant and $\frac{\mathbb P(Z>x)}{\mathbb P(|Z|>x)}\rightarrow p\in[0,1]$ as $x\rightarrow\infty$. Examples include the Cauchy and Pareto distributions. The Gaussian distribution has `thin' tails that decay faster than an exponential and is not included in this class. The results that follow can be extended to a more general condition on $F$ called regular variation in which (ref) is replaced by
The normalizing constants in such an extension become less explicit so we stick to the Pareto-like tail assumption for tractability.
Let $d_{1T}=\inf \{ x:\mathbb P(|Z_1|>x)\le \frac{1}{T}\}$ be the $(1-\frac{1}{T})$-th quantile of $F$ and $d_{2T}=\text{inf}\{ x:\mathbb P(|Z_0Z_1|>x)\le T^{-1}\}$ be the corresponding quantile for the joint distribution of the product $Z_0Z_1$. Distributions with Pareto-like tails have $d_{1T}=T^{1/\alpha}C^{1/\alpha}$. Since $1-F(d_{1T})=1/T$ for continuous $F$, ((ref)) implies
for all $x>0$. Similarly $T \mathbb P(|Z_0Z_1|>d_{2T} x)\rightarrow x^{-\alpha}$ (see {davis-resnick:86}). The population moments of $Z_t$ satisfying ((ref)) are only defined up to order $\alpha$ since \[
\] It is possible for the population variance to exist but the population kurtosis to be undefined. But even if the population moments do not exist, the sample moments can still have well defined limits. If $Z_t$ has a Pareto-like tails with index $\alpha\in (1,2)$, $Z_t^2$ also has Pareto-like tails with index $\alpha/2$, and it holds that
where $\bar Z=\frac1T\sum_{t=1}^TZ_t$ is the sample mean, and for $h> 0$, $S_{\alpha}, S_{\alpha/2,0}, S_{\alpha,h}$ are stable random variables with exponents, $\alpha,\alpha/2$, and $\alpha$ respectively. Their joint distributions can be found in davis-resnick:86.
To gain a sense of the tail properties of the data under investigation, we will make use of the fact that if $Z_t$ is an IID Pareto sequence with tail index $\alpha=1$, then the sample kurtosis $\kappa_4$ has the property (see cohen2020heavy) that
The limit of kurtosis, scaled by the sample size, is a random variable between zero and one so the maximum kurtosis that can be observed asymptotically is $T$. Tabulating the distribution for $T=500$ and $T=1000$ with $\alpha=1$, we see that the quantiles roughly double with $T$. Based on simulations, the values of these quantiles are an upper bound for $\alpha\in (1,2)$.
As a point of reference, the disaster series shown in Figure (ref) has $T=480$ and kurtosis of around 70, which is in the lower 10-th percentile.\footnote{The distribution of $S_\alpha$ can be approximated by simulating $j=1,\ldots J$ times $s_{j,\alpha}=\sum_{m=1}^M (\sum_{j=1}^m e_j)^{-1/\alpha}$ where $\{e_j\}$ is drawn from the exponential distribution.} The number of deaths series mentioned in the Introduction has kurtosis of 147 and is in the 30-th percentile. In contrast, the kurtosis a typical of macro economic time series is under 10, hence the theory for heavy tails would be inappropriate. A multivariate system of time series with different tail properties thus necessitates a different setup.
There is a large literature on robust and quantile estimation of the parameters in a linear model to guard against extreme values which explicitly down-weights outliers. blattberg-sargent:71 and kadiyala:72 show that the least squares estimator is unbiased when the error in the regression model is drawn from a general symmetric stable Paretian distribution, but it is not the best linear unbiased estimator. In the Cauchy case when $\alpha=1$, the best linear unbiased estimator is $y_\tau/x_\tau$ where $x_\tau=\max_j X_j$.\footnote{Best here means in terms of minimizing dispersion.} A different viewpoint, also the one taken in this paper, is that the extreme values are of interest.\footnote{See, for example, two special issues on heavy-tailed data, heavytails-joe:13 and heavytails-joe:14.} Under this assumption and fixed regressors, mikosch-devries:13 provide a finite sample analysis of the tail probabilities of the single equation CAPM estimates to understand why they vary significantly across reported studies. We are interested in estimating dynamic causal effects in a multivariate setting when the regressors are stochastic, and one of the primitive shocks has heavy tails.
Consider $n$ mean zero variables $Y_t=(Y_{t1},\ldots, Y_{tn})^\prime$ represented by a VAR(p):
where $A(z) =I_n-A_1 z -\ldots -A_p z^p$ is the matrix-valued AR polynomial. Provided that det$A(z)\ne 0$ for all $z\in \mathbb C$ such that $|z|\le 1$, $A(z)^{-1}$ exists, the moving-average representation of the model is $ Y_t= \Phi(L) e_t $ where $L$ is the lag operator, and $\Phi(L)=A(L)^{-1}$ with $\Phi_0=I_n$.
The standard OLS estimator $\hat A$ of $A$ is characterized by (see (ref) and (ref))
These errors $e_t$ are mapped to a $n\times 1$ vector of primitive shocks $u_t=(u_{t1},\ldots, u_{tn})^\prime$ via a (time invariant) matrix $B$:
where $u_t$ is usually assumed to be mean zero, mutually and serially uncorrelated and with $\Sigma_u=\mathbb E[u_tu_t^\prime]$ being a diagonal matrix. See, for example, stock-watson:macrohandbook2 and kilian-lutkepohl:book. The reduced form errors $e_t$ are usually assumed to have `light tails' which is possible only if $u_t$ has light tails. A model that satisfies these standard assumptions will be referred to as the LL (light-light) hereafter. Under regularity conditions for least squares estimation, $\hat A$ is $\sqrt{T}$ consistent and asymptotically normal.
The modeling issues that arise when one of the primitive shocks in a SVAR has infinite variance are best understood in the $p=1$ and $n=2$ case. Consider first a HH (heavy-heavy) model in which both shocks have heavy tails.
By restricting attention to $0<\alpha<2$, we only consider processes with infinite variance. Even though $X_t$ is not covariance stationary (since $\mathbb E|X_t|^2=\infty$), part (i) states that the process $X_t$ exists and is strictly stationary. The stated results for the sample covariance and sample autocorrelation are due to davis-resnick:86 and also hold when $X_t$ is centered for $\alpha\in (1,2)$. Note that the convergence of $\hat \rho(h)$ is faster than the $\sqrt{T}$ rate obtained for finite innovation variance.
For VAR estimation, Lemma (ref) can be used to show that
It then follows from continuous mapping that the least squares estimator is super consistent:
Though the analysis is straightforward, this setup is unappealing for macroeconomic data because if $u_{t1}$ and $u_{t2}$ both have infinite variance, $Y_{t1}$ and $Y_{t2}$ must also have infinite variance. But a typical economic time series does not resemble the series shown in Figure (ref). Not only is the disaster series much less persistent, its kurtosis (over 70) is an order of magnitude larger than for variables like output growth, inflation, and interest rates.
Our goal is a model in which (i) a heavy tailed shock $u_{t1}$ co-exists with light tailed shocks $u_{ti},\,i=2,\ldots,n$, and (ii) $Y_{ti}$ is influenced by the current and past values of $u_{t1}$ but not dominated by them in a sense to be made precise. We consider the HL (heavy-light) model derived from the SVAR$(p)$
where for each $h=1,\ldots, p$, $A_h$ is a $n\times n$ matrix with $(i,j)$-th entry denoted $[A_{ij}^{(h)}]$, the coefficient of variable $j$ at lag $h$ in equation $i$. The entries $[B_{ij}]$ of the $n\times n$ matrix $B$ are similarly defined. \paragraph{Assumption HL}
The primitive shocks $u_{ti}$ are assumed to be independent across $i$ and $t$ but does not preclude time varying second moments, though it is stronger than mutual orthogonality of $u_{t}$ typically assumed in SVAR modeling. Assumption HL (i) restricts attention to processes with tail index $1<\alpha<2$ and thus excludes Cauchy shocks. The assumption that the thin tailed shocks $u_{ti}\,,i=2,\ldots n$ have unit variance is without loss of generality, but it is important that their variances are finite. Since the variations of $u_{t1}$ will dominate those of $u_{ti}\,,i\ge2$ when both are present, $Y_{t1}$ will have heavy tails and exhibit the large spikes originating from $u_{t1}$.
Assumption HL(ii) is motivated by the fact that $Y_{ti}$ cannot have finite variance unless $B_{i1}=0$ and $A_{i1}^{(h)}=0$ for all $h$. But the dynamic effects of $u_{t1}$ on $Y_{t+h,i}$ would then be zero at all lags by assumption, rendering the empirical exercise meaningless. Thus, the $Y_{ti}$ equation is modified to dampen the influence of $u_{t1}$ on $Y_{ti}$ at rate $\theta$ given in (ref), so that $T^{-1/2} \sum_{t=1}^T u_{t1}/T^\theta=T^{-1/\alpha} \sum_{t=1}^T u_{t1}$ has a limit.\footnote{A similar effect can be achieved by replacing the heavy-tailed shock by its truncated version $\frac{u_{t1}}{T^\theta}1_{|u_{t1}|\le MT^{1/\alpha}}$ for some constant $M$. This was the approach taken by amsler-schmidt:12.} Localizing $A_{i1,T}^{(h)}$ and $B_{i1,T}$ to zero is an asymptotic device to obtain this limit, but note that $A^h_{i1,T}$ and $B_{i1,T}$ are not time varying. Under assumption HL(ii), $Y_{t,T}$ is a triangular array that depends on $T$. To simplify notation, the explicit dependence on $T$ is suppressed.
A heavy-tailed linear time series must have a heavy-tailed shock as its primary source of variation, but it need not be exogenous. In our model, exogeneity would require that $A_{1j}=B_{1j}=0,\,j=2,\ldots,n$, in which case, any feedback from $Y_{ti}$, $i\ge2$ to $Y_{t1}$ would be disabled. But such a model would not shed light on how macroeconomic outcomes might mitigate or amplify the effects of disasters. Assumption HL allows $A^{(h)}_{1j}$ and $B_{1j},\,j=2,\ldots n$ to be free parameters to be estimated.
Specializing to the $n=2$ and $p=1$ case with $Eu_{t1}^2=\infty$ and $Eu_{t2}^2<\infty$ we show in the Appendix that the following holds under Assumption HL
where the limits have a stable distribution with index $\alpha$ and $\alpha/2$, respectively. Thus the sample first and second moments of $Y_{t2}$ have (random and possibly constant) limits even though one of its shocks has infinite variance. The implications for least squares estimation of the HL model can be summarized as follows.
The convergence rate for $\hat A_{11}$ is $\min(\frac{T}{\log T}^{1/\alpha},T^{1/2})$, which is $\sqrt{T}$. This is slower than the rate for $\hat A_{11}$ in the HH model because one of the infinite variance regressors in the HH model is replaced by one that has finite variance. The convergence rate for $\hat A_{12}$ can be written as $\sqrt{T} T^{-\theta}$ which is slower than the $\sqrt{T}$ rate for $\hat A_{12}$ in the LL model because the variations in this equation are dominated by those from lags of $Y_{t1}$, hampering identification of $A_{12}$. Now the convergence rate for $\hat A_{21}$ can be written as $\sqrt{T}T^\theta$ which is faster than the $\sqrt{T}$ rate obtained for $\hat A_{21}$ in the LL model. This implies that $\hat a_{21}=T^\theta \hat A_{21}$ is $\sqrt{T}$ consistent. Hence in the HL model, the local parameter $a_{21}$ is consistently estimable. In each case, the limit distribution is non-standard and not pivotal, so that construction of asymptotically correct confidence intervals is intractable.
Since VAR estimates are obtained from least squares regressions on an equation by equation basis, Proposition (ref) sheds light on the more general setting when a regressor has infinite variance, but the dependent variable has finite variance. Though such a regression would be `imbalanced' in the standard setup, the coefficients on the heavy-tailed variable is being scaled down to accommodate the heavy-tailed shock in our HL setup. The coefficient estimate on the infinite variance regressor would be consistent but not asymptotically normal. By implication, the impulse response coefficients whether computed from the VAR or by local projections would likely not be asymptotically normal.
The structural moving-average representation of the model is
where $\Psi(L)=A(L)^{-1}B$ and $\Psi_0=B$. The effects of $u_{t1}$ on $Y_{t+h,2}$ are given by the first column of $\Psi_h$ which depends on $A$ and $B$. Hence to estimate the dynamic causal effects of $u_{t1}$, we need to be able to consistently estimate $B$ when $u_{1t}$ has infinite variance.
The relationship between the vector of primitive shocks $u$ and error terms is
where $u_t=(u_{t1},\ldots,u_{tn})'$ is an $n$-vector consisting of independent random variables with mean zero and $B$ is an $n\times n$ matrix with inverse $W$. As is well known, $B$ is not uniquely identified from the second moments of $e_t$ alone even when $e_t$ has finite variance because $BQ'Qu_t$ has the same covariance structure as $Bu_t$ for any orthonormal matrix $Q$.
{\bf Proof.} The proof of this result follows directly from Skitovich-Darmois theorem as described in the proof of Theorem 10 in comon:94. Since $\hat u=\hat W B u=:Gu$, the components of $\hat u_i$ can be written as $$ \hat u_i=\sum_{k=1}^n G_{i,k}u_k. $$ The independence of the $\hat u_i$ and $\hat u_j$ components implies that $G_{i,1}G_{j,1}=0$ for $i\ne j$. That is, the first column of $G$ contains at most one nonzero value. A similar conclusion holds for all the columns of $G$. Hence $G$ is product of a permutation matrix $P$ times a diagonal matrix $\Lambda=\text{diag}\{\lambda_1,\ldots,\lambda_n\}$, i.e., $G=P\Lambda$. In other words, $\hat W W^{-1}=P\Lambda$ or $\hat W=P\Lambda W$ as was to be shown. It follows by the form of $G$ that the components of $\hat u$ must be mutually independent. $\Box$
Independence of $u$ narrows the class of observational equivalent models to those characterized by permutations of rows and changes of scale/sign. As discussed in gmr:17, scale changes are responsible for failure of local identification, a problem that can be dealt with by normalizing the shocks so that $\Lambda$ is an identity matrix. Failure of global identification arising from permutation and sign changes require additional assumptions. It is only when the restrictions are correctly imposed that $P$ is also an identity matrix, in which case, $\hat W=W$.
We also need to impose restrictions on $W$ to identify a component of $u$ as a disaster shock. Our problem is non-standard because the shock of interest has a heavy tail, but this distinctive feature actually helps identification. We reorder the components by their tail-heaviness, and take the disaster shock to be the first component, which is also the one with the largest kurtosis. In practice, the variables in the estimated $u$ will be ordered by sample kurtosis. As seen in (ref), this ordering is consistent with ordering the components of $\hat u$ by tail-heaviness.
Independent components analysis (ICA) is widely used to identify a linear mixture of non-Gaussian signals. Whereas PCA uses the sample covariance to find uncorrelated signals, ICA typically uses properties of the random vector that go beyond second moment properties in order to separate the independent signals.\footnote{The two will give similar results when the higher-order statistics add little information. For a recent review, see hyvarinen:13.} In the ICA literature, $B$ is known as the {\it mixing} matrix and $W$ the {\it unmixing} matrix. ICA has been applied to finite variance SVARs in which global identification is achieved by imposing additional restrictions such as lower triangularity of $B$.\footnote{ See, for example, moneta-el:13, hzsh:10, gmr:17, maxand:19, lanne-meitz-saikkonen:17.}
There exist many ICA estimators for identifying the source process, which in our case corresponds to the primitive shocks $u$. Some procedures evaluate negative entropy (also known as negentropy) and take as solution the $W$ that maximizes non-Gaussianity of $We_t$, while others maximize an approximate likelihood using, for example, log-concave densities. The popular fast ICA algorithm of hyvarinen-book is a fixed-point algorithm for pseudo maximum-likelihood estimation. A different class of procedures take as the starting point that if the signals are mutually independent at any given $t$, their joint density, if it exists, factorizes into the product of their marginals. This suggests to evaluate the distance between the joint density and the product of the marginals.\footnote{See, for example, bach-jordan:01 and eriksson-koivunen:03, and hyvaninen-oja:00 for an overview of the methods used in signal processing. Statistical procedures include chen-bickel:06, hastie-tibshirani:03, hastie-tibshirani:03, samworth-yuan:12, gmr:17.} {chen-bickel:06 form a distance measure between the joint characteristic function and the product of the marginal characteristic functions to estimate the unmixing matrix. The advantage of this procedure is that it does rely on existence of joint densities or moments. In case the vector has finite second moments, they obtain a convergence rate of $1/\sqrt{T}$ for this nonparametric estimate of $W$, the same as the one obtained in gmr:17 for parametric estimation. matteson-tsay:17 use a {\em distance covariance} approach to extract the independent sources under the assumption that they have finite variances, which is similar in spirit to the method of chen-bickel:06.
We will also use the distance covariance approach because as shown in the companion paper davisfernandes2021, it is also valid when one component of $u$ has infinite variance. The distance covariance between two random vectors $X$ and $Y$ of dimensions $m$ and $n$, respectively, is
where $w(s,t)>0$ is a weight function and $\varphi_Z(t) = E [\exp^{i (t,Z)}],\, t\in{\mathbb R}^d \,$ denotes the characteristic function for any random vector $Z\in{\mathbb R}^d$. The most commonly used weight function, which we will also adopt here, is
where $\beta\in (0,2)$, $c_{m,\beta}=\frac{2\pi{m/2}\Gamma(1-\beta/2)}{\beta2^\beta\Gamma((\beta+m)/2)}$ (see szekely-rizzo-bakirov:07). The integral in (ref) is then finite provided $E|X|^\beta +E|Y|^\beta<\infty$. Under this moment assumption, one sees immediately that $X$ and $Y$ are independent if and only if ${\mathcal I}(X,Y;w)=0$ since in this case the joint characteristic function factors into the product of the respective marginal characteristic functions, $\varphi_{X,Y}(s,t)=\varphi_X(s)\,\varphi_Y(t)$ for all $(s,t)\in {\mathbb R}^{m+n}$. Based on data $(X_1,Y_1)\,\ldots,(X_T,Y_T)$ from $(X,Y)$, the general distance covariance in (ref) can be estimated by replacing the characteristic functions with their empirical counterparts $\hat\varphi_{X,Y}, \hat\varphi_{X}$ and $\hat\varphi_{X,Y}$, where e.g., $\hat\varphi_{X,Y}(s,t)=\frac{1}{T} \sum_{j=1}^T \exp\{i(s,X_j)+i(t,Y_j)\}$. Then
Using the $w$ given in (ref) and assuming $E|X|^\beta|Y|^\beta<\infty$, there is an explicit formula for $\hat{\mathcal I}$ (see (ref)) that avoids direct computation of the associated integral. Additional background on distance covariance can be found in the Appendix.
Now the components of say a random vector $S=(S_1,\ldots,S_n)'$ are independent if and only if ${\mathcal I}(S_k,S_{k+1:n},w) =0$ for $k=1,\ldots, n-1,$ where $S_{k+1:n}=(S_{k+1},\ldots,S_n)'$. matteson-tsay:17 observe that the independence condition is equivalent to ${\mathcal I}_{MT}=0$, where
with weight function given by (ref). Based on a sample $e_t=(e_{t1},\ldots,e_{tn})',\,t=1,\ldots,T$, an estimate of the unmixing matrix $W$ is found by minimizing the objective function,
subject to $W\in\Omega$ and where $\hat{\mathcal I}$ is the empirical estimate of $\mathcal I$ using $S_t=We_t,~t=1,\ldots,T$. matteson-tsay:17 show that procedure produces a consistent estimate of $W$ when the variance of the $S_t$ is finite. The proof is based on rewriting $\mathcal I(\cdot)$ in terms of $V$ statistics and presumes that terms of the form $E|XY|$ are finite.
In our case of infinite variance, $\mathcal I(X,Y)$ is finite even if $E|XY|=\infty$. One only needs that $E|X|+E|Y|<\infty$. More recently, it is shown in davisfernandes2021 that consistency of $\hat W$ based on the sample distance covariance also holds in the infinite variance case. This result justifies the use of the objective function $\hat{\mathcal I}_{MT}(W)$ for estimating the unmixing matrix in the finite mean but infinite variance case. In case the mean is infinite, one can choose a $\beta<1$ in the weight function to ensure that the moment condition $E|e_t|^\beta<\infty$ is met.
In most ICA estimation procedures, the first step is typically to prewhiten the output. In effect, prewhitening removes second moment correlations prior to estimating the independent components. In the context of a SVAR with finite variance, suppose we have the observations $e_1,\ldots,e_T$, from the model $e_t=Bu_t$. Denote the sample covariance matrix of the $e_t$'s by $\hat \Sigma_e^{-1/2}$, from which it's prewhitened values are given by $\widetilde e_t=\hat \Sigma_e^{-1/2}e_t$, where the inverse square root matrix is, for example, computed from the singular value decomposition (SVD) of the sample covariance matrix. Then one can restrict candidate unmixing matrices $W$ to have the form $W=O\hat \Sigma_e^{-1/2}$, where $O$ is an orthogonal matrix. In particular, one could optimize the function in (ref), e.g.,
where the minimization is over all $O\in \mathcal{O}(n)$, the space of $n$-dimensional orthogonal matrices. This produces an estimate of the unmixing matrix given by $\hat O\hat\Sigma_e^{-1/2}$ that is a consistent estimate of $W_0$ after suitable rescaling and row permutation as noted in Remark (ref). The optimization over orthogonal matrices reduces the number of unknowns from $n^2$ to $n(n-1)/2$. The fact that this prewhitening step actually works in the infinite variance case follows directly from Theorem 3.2 in davisfernandes2021 (see also chen-bickel:06), which we record in the following proposition.
Although we have used the SVD version of $\hat \Sigma_e^{-1/2}$ in Proposition (ref), we could also use the Choleski analogue, which is often an attractive alternative. This is especially true for SVARs since it is already widely used to identify a lower triangular structure of $B$. Though the population covariance matrix of $e_t$ does not exist in the infinite variance case, a decomposition of the sample covariance matrix is possible. The following result gives the decomposition for the $n=2$ case.
The proof of the lemma is given Section (ref) of the Appendix. The prewhitened variables $e^c_t$ remain a function of $u_{t1}$ and $u_{t2}$ which we seek to identify. Observe that if $B$ were lower triangular, $e^c_{t1}$ will only depend on $u_{t1}$ since $e_{t1}=B_{11} u_{t1}+B_{12}u_{t2}$. But note that Choleski decomposition is used here only as a prewhitening device and not as a way to achieve identification. If the ordering is incorrect, ICA will undo the ordering to find the $u$ satisfying the additional identification restrictions.
In practice, of course, we do not observe the residuals $e_t$ directly but rather the estimated versions $\hat e_t=(\hat e_{t1},\ldots,\hat e_{tn})^T, \,t=1,\ldots,T$. Limit distributions of the distance covariance function based on the residuals can be slightly different when applied to the $\hat e_t$ than the actual residuals (see davis2018applications). Interestingly, in the heavy-tailed case, the limit theory for the distance covariance based on estimated and actual residuals is the same. In the context of consistency in the estimation of the unmixing matrix, the same procedure can be carried out as above using estimated residuals $\hat e_t=e_t+(A-\hat A)Y_{t-1}$.
The proof is given in the appendix. The idea is that the sample residuals can be represented by an ICA model with noise, i.e., $\hat e_t=Bu_t+v_t$ where the noise is the sampling error $v_t=(A-\hat A(T))Y_{t-1}$. It is then shown that the difference between $\hat \Sigma_e^{-1}$ (from noiseless model) and $\hat \Sigma^{-1}_{\hat e}$ (from noisy model) converges to zero in probability and thus has asymptotically negligible effects on the objective function that estimates $W$. Applying Theorem 3.3 in davisfernandes2021 for ICA with noise gives the stated result.
The dynamic properties of a SVAR are determined by restrictions imposed on the model and generally difficult to test. But if $u_t$ is independent, then by Lemma (ref), the identifying restrictions are testable. lanne-meitz-saikkonen:17 suggest a procedure to first verify identifiability of the model, and then parametrically specify $u$ (with finite variance) so that after maximum likelihood estimation, the restrictions can be validated using classical Wald and Likelihood ratio tests. QQ-plots of the identified shocks provide an additional check for non-normality. herwatz:19 applies a non-parametric test for independence to ascertain whether demand shocks have no long run effects using bootstrap critical values. amengual-fiorentini-sentana use the influence functions of a discrete mixture-normal likelihood to test the second, third, and fourth cross-moments while explicitly accounting for sampling uncertainty in $\hat e$.
We also test independence of $\hat u$, but independence of $\hat e$ is also of interest because if the components of $e_t=Bu_t$ were already independent, then by Lemma (ref), $B$ would be diagonal and no further analysis on the structure of $W$ would be required. A independence test of $\hat e$ is thus informative about its unrestricted structure. In contrast, independence of $\hat u$ is informative about the structure implied by identifying restrictions. If $\hat u_t$ should fail an independence test, there would be no point in further analyzing the impulse responses.
As reviewed in josse-holmes:16, many independence tests are available, and if one suspects that the data have features such as heteroskedasticity that are inconsistent with independence, tests that target those features should have more power, as in mopm:22. But we need a test that is also consistent when one component of $u_t$ has heavy tails. That is, the test should reject with probability tending to one as $T\rightarrow\infty$ for any $\hat W\ne W $ modulo permutations and scale/sign changes, irrespective of the tail properties of the data to be tested. A test using the empirical version of the aggregated distance covariance ${\mathcal I}_{MT}$ defined in (ref) can in principle be used. Even though $T\hat{\mathcal I}_{MT}$ has a limit distribution under the null hypothesis of independent components, the limit distribution is generally intractable. Hence direct use of the limit distribution for calculating cutoff values for the test statistic is infeasible.
However, as pointed out in matteson-tsay:17, one can use a test by calculating the test statistic $\hat {\mathcal I}_{MT}$ for random permutations of the data. A permutation-based test for independence is founded on the idea that if there is dependence in the components, then the value of $\hat{\mathcal I}_{MT}$ should be larger than the corresponding statistics based on random permutations of the components, in which the dependence among the components has been severed by the permutation. The test is known to control Type I error and also robust to the possibility of heavy tails. Precisely, if $S_1,\ldots,S_T$ is an iid sample of random vectors of dimension $n$, then the permutation procedure is implemented via the following steps. For $b=1,\ldots NP$,
The test is distribution free under the null hypothesis. The $p$ value of the test is constructed as \[ p(NP)= \frac{(k+1)}{(NP+1)}\] where $k$ is the number of $\hat{\mathcal I}^{(b)}_{MT}$'s from the $NP$ permuted samples that exceed $\hat {\mathcal I}_{MT}$. The test is implemented in the R-package steadyICA with a default $NP$ value of 199.
We reject independence of the components in $S$ if the $p-$value is less than a prescribed nominal size. In principle, the null hypothesis of independence can be rejected because $u_t$ is not independent, or because the identifying restrictions are incorrect, or both. But under the maintained assumption that the components of $u$ are mutually independent, the test provides a validation of the (overidentified or exactly identified) restrictions on $B$ (or $W$).
The dynamic effects of a disaster shock can be analyzed as follows. Step 1 estimates the coefficients of a VAR model using least squares. Step 2 prewhitens the VAR residuals. Step 3 applies ICA to obtain independent components and associates the component with the largest kurtosis as the disaster shock. Step 4 estimates the impulse response functions. Their dynamic effects after $h$ periods defined by $\Psi(L) =(I-A_1L-\ldots A_PL^p)^{-1}B$ can be computed once consistent estimates of $A$ and $B$ are available. We are primarily interested in the effects of $u_{t1}$ on $Y_{t+h}$ and can also estimate the first column of $\Psi^{(h)}$ by projecting the response variable of interest on $\hat u_1$ on other controls as in jorda-05. However, it should be noted that the coefficient estimates from the local projection regressions will have non-standard properties in view of Proposition (ref).
To illustrate the effectiveness of this methodology, simulations are performed with $(T,n)=(400,3)$ for four SVAR(1) models based on two specifications of $B$ and two sets of primitive shocks, holding the $A$ matrix fixed throughout at \[ A=
. \]
\paragraph{The $B$ matrix} In model 1 (labeled NLT), the $B$ matrix is Not Lower Triangular. In model 2 (labeled LT), $B$ is Lower Triangular. \[ B_{init}(NLT)=
\quad\quad B_{init}(LT)=
\] From a given $B_{\text{init}}$ that is either NLT or LT, its inverse yields a non-normalized $W_{\text{init}}$ from which a normalized $W$ is formed by imposing the constraint that each row sums to one. Then $B=W^{-1}$ is used to simulate data and subsequently estimated. \paragraph{Innovations $u$} The first innovation specification (denoted HL) has one heavy-tailed shock while in the second specification (denoted LL), all three shocks have light tails. In both cases, the shocks are ordered such that $u_1$ has the largest kurtosis and $u_3$ has the smallest.
\[ HL:
\quad\quad LL:
.\]
\paragraph{Prewritening:} Let $e^{0}=(e_{1},e_{2},e_{3})$ and $e^1=(e_{2},e_{3},e_{1})$ denote two assumed orderings with estimated covariances $\widehat{\text{cov}}(e^0)$ and $\widehat{\text{cov}}(e^1)$ based on samples from each vector, respectively.
Table (ref) reports the Type I errors of the independence test described in Section (ref), calculated as the mean occurrence of $p$-values less than 0.1 in 1000 replications. The results in the top left panel assume that $e_t$ is observed. Regardless of the specification for $u_t$ and $B$, the Type I errors associated with $u_t$ or $u^2_t$ are close to the size of the test. However, since the components of $u_t$ are non-Gaussian by construction, the test always rejects independence of $e^0_t$. Recall that $\widetilde e^0_t$ are constructed from a Choleski decomposition of the sample covariance matrix for $e^0_t$. Independence of $\widetilde e^0_t$ is always rejected when data are generated from Model NLT but is almost never rejected for model LT because $W$ is lower triangular in model LT. The prewhitened data $\widetilde e^1_t$, $\widetilde e^2_t$ and $\widetilde e^3_t$ are based on $\hat W$ matrices that differ from $W$ and hence the test also rejects independence. The top right panel shows that the permutation test does not reject independence of the signals $\hat u(\widetilde e)$ recovered by ICA except in Model LT-HL when the test rejects with probability 0.145 in the Monte-Carlo, which is slightly oversized.
The above results assume that $e^0$ is observed. Next, we replace $e^0$ with residuals from estimation of a VAR with one lag. ICA is then applied to the estimated residuals after prewhitening. Panel B of Table (ref) shows that the rejection probabilities of the permutation test are not affected by having to estimate $A$ and $B$ by least squares. As in the case when $e$ is observed, the permutation test cannot reject independence of the primitive shocks identified by ICA except in the LT-HL case when the rejection probability is 0.139.
A metric for comparing matrices is Amari distance which, for two $p\times p$ matrices $A_0$ and $A$ with $r_{ij}=[A_0 A^{-1}]_{ij}$, is defined in bach-jordan:01 as \[ d(A_0,A)=\frac{1}{2p}\sum_{i=1}^p \bigg(\frac{\sum_{j=1}^p |r_{ij}|}{\max_j |r_{ij||}}-1 \bigg)+ \frac{1}{2p}\sum_{j=1}^p \bigg(\frac{\sum_{i=1}^p |r_{ij}|}{\max_i |r_{ij||}}-1 \bigg). \] Though ICA studies usually report the Amari distance for the unmixing matrix $W$, the matrix $B$ is of more interest in SVAR since it is gives impact response of the shocks. We compare the absolute value of two matrices to ensure that differences are not due to a sign flip that is difficult to control in simulations. Panel C of Table (ref) shows that all prewhitening methods give similar Amari distances except in Model LT-HL when using $\hat e_0$ gives noticeably smaller errors.
The results suggest that the method of prewhitening matters, but only in the LT-HL case, and there are two possible explanations. One is that in the LT-HL case the true $B$ (hence $W$) is lower triangular, and when this structure is accompanied by a heavy-tailed shock, much can be learned from a kurtosis ordering of the VAR residuals. Prewhitening without using this information is inefficient. The second explanation is that as seen from Panel B, independence of $e^0$ cannot be rejected. This suggests that it is desirable to use prewhitened data that are as close to independent as possible for ICA estimation. Comparing the $p$ value of the permutation test applied to different sets of prewhitened data can be useful in this regard.
The results thus favor prewhitening the VAR residuals by Choleski decomposition ordered by kurtosis. A closer look finds that the $A$ and $B$ matrices are precisely estimated using $\hat e_0$ as prewhitened data. Even without imposing a lower triangular structure, the pattern is recovered precisely whether or not the innovations have heavy tails. The difference compared to Choleski decomposition is that ICA lets the data speak as to whether the upper triangular entries of $B$ are zero. If the lower triangular structure is true, $Y_1$ is exogenous and one can alternatively estimate the the dynamic causal effects from a regression of $Y_2$ on $Y_1$ and lags of $Y_1, Y_2, Y_3$.
We consider three applications. The first aims to show that the validity of ordering used in Choleski can be tested, as suggested by Lemma (ref). The second application estimates an HL model to shed light on the dynamic effects of a disaster shock. In the third, HL regressions are used to purge the variations due to covid-19 from the data.
Economic theory is inconclusive as to whether episodes of heightened uncertainty during economic downturns arise because of exogenous increases in uncertainty, or if they are the consequence of endogenous responses to other economic shocks. SVARs have been estimated using a variety of identification strategies using different measures of uncertainty and over different samples. But testing the validity of these restrictions has been difficult as these models are often exactly identified, i.e., the number of unique entries in the covariance matrix for $e_t$ equals the number of free parameters in $B$. An independence test provides a way to test these restrictions.
We take industrial production (IP) as indicator of real activity and consider six different measures of uncertainty used in lmn1. These are JLN macro uncertainty (UM), real economic uncertainty (UR), financial uncertainty (UF), policy uncertainty (EPU), news-based uncertainty (EPN), and stock market volatility (VIX). This leads to estimation of six three-variable SVARs, each using six lags, over the sample 1960:7-2015:4. Table (ref) shows that the data used in the six systems have different statistical properties. However, there is little evidence that the systems considered have heavy tails.
We test independence of the identified shocks obtained from different orderings of the VAR residuals. Recall that the $p$ value indicates the Type 1 error in rejecting the assumed lower triangular structure. The $p$ values reported in Table (ref) indicate strong evidence against independence of the shocks constructed from Models 2,4,5 regardless of ordering. There is some support for independence when financial uncertainty is ordered first in Models 1 and 6, while the strongest evidence for independence is provided by Model 1 using the ordering (ip,uf,um), a configuration that would not be obvious based on economic reasoning.
As Lemma (ref) indicates, independence is necessary but not sufficient for model identification. Nonetheless, testing independence of $\hat u$ provides a way to rule out incorrect restrictions. The finding that independence of shocks from multiple orderings cannot be rejected suggests that the restrictions imposed by the Choleski orderings are not enough to uniquely identify $u$. This lends support to using restrictions beyond the ordering of variables to help identification.
The second example considers a SVAR in the cost of disasters series (CD) shown in Figure (ref), unemployment claims (Claims), and JLN uncertainty (UM) for the sample 1980:1-2019:12. To make the scale of the variables comparable, the CD series (originally in billions of dollars) is divided by 1000; the claims series is divided by 1000 so that it is in millions; the UM series is multiplied by 1000 and remains unit free. Each series is passed through the filter proposed in mueller-watson:17 to remove the low frequency variations in the mean. This is equivalent to adding a set of cosine predictors in the VAR. The residuals from estimating a VAR with six lags are mean zero with standard deviation (13.617, 14.276, 8.783) and kurtosis (69.122, 5.338, 5.232) respectively. The permutation test cannot reject the null hypothesis of independence of the shocks obtained by Choleski decomposition for orderings (1,2,3), (2,1,3), and (1,3,2). However, irrespective of the ordering of $\hat e$, the ICA shocks always pass the independence test. Furthermore, the shocks identified by the different orderings have very similar kurtosis.
The ICA estimates obtained with $\hat e_0$ as prewhitened data are:
According to Proposition (ref), $\hat A$ is consistent, though the entries have different convergence rates. Since the estimates have non-standard distribution, we use (*) to indicate that zero is outside the (10, 90) percentiles of the bootstrap distribution. The matrix $A_1$ gives the lag one response to a disaster shock. The estimates indicate that response of CD and UM are both non-zero. The $A_{13}$ estimate suggests that the costly disaster series is not strictly exogenous. The matrix $\hat A(1)=\sum_{j=1}^p \hat A_j$ summarizes the cumulative effects of the shocks over six periods. The (1,1)-th diagonal entry of $\hat A(1)$ indicates that the disaster shock has a short half-life. The $B$ matrix gives the instantaneous effect of the disaster shock. The unconstrained ICA estimate is quite close to the one implied by Choleski decomposition with a (1,2,3) ordering. Taking sampling uncertainty into account, ICA supports a $B$ matrix that is more sparse than the lower triangular structure imposed by Choleski decomposition. Note also that the HL model is based on the premise that the effects of an infinite variance shock on a finite variance variable are small. Rows two and three of the first column of $B$ and $A_{k}$ are small relative to the own effect recorded in the (1,1)-th entry of the respective matrices. The estimates are consistent with the HL structure.
The three shocks recovered by ICA have kurtosis $(69.34, 5.39, 5.03)$. The density of $\hat u_1$ in Figure (ref) shows that the shock has a heavy right tail. We estimate the impulse response functions by (i) iterating $A^hB$ as implied by the VAR, (ii) local projections using $\hat u$ obtained from ICA as shocks, and (iii) dynamic responses as implied by Choleski decomposition. These are labeled var, lp, and chol in Table (ref). To provide some idea of precision of the estimated impulse responses, we report standard errors for the lp estimates as well 95% bootstrap confidence intervals using the vars package in R as rough guides. But note that our estimates $\hat A$ have non-standard distributions and results about bootstrap inference with heavy-tailed variables have only been considered in the univariate setting, see, for example, davis1997bootstrapping and wan-davis:22. Each local projections regression is of the HL type and hence inference is also non-standard. The standard errors should be interpreted with this caveat in mind.
The CD series has short memory and the effects of its own shock die out after one month. The shock induces a tightly estimated increase in uncertainty for three months and an increase in unemployment claims of two months. As a point of reference, an unemployment claims shock has an impact effect of 14.556 on itself, and an uncertainty shock has an impact effect of 8.898 on itself. The effects of a disaster shock on these economic variables are small, but they do exist. This reinforces the motivation of the HL model that infinite variance shocks can affect variables with finite variances.
It can be argued that the infinite variance nature of $u_{t1}$ makes the unit variance property of shocks identified by ICA unappealing. But it is easy to calibrate the shock to yield exactly a one percent change to the variable of interest\footnote{ The 'unit effect normalization' considered in stock-watson:macrohandbook2 can be used we transform the ICA estimates $\hat u_{t1} =\hat u_{t1,ica} \hat B_{11,ica}, $ $\hat B_{ii} = 1$, and $ \hat B_{j1}= \hat B_{j1,ica}/\hat B_{11,ica}$ for $ j>1$. } without changing the shape of the impulse response function. With this data, the unit effect is associated with a shock of size 13.881, which is slightly larger than Katrina shock in 2005, which was of magnitude 11.56.
covid-19 has been costly in health, social, and economic dimensions, but it has also created new challenges for data analysis. One problem discussed in ng-covid:21 is that covid-19 is pervasive and persistent, and the principal components of economic data will be now spanned by common economic variations and covid-19. To isolate the economic factors, a suggestion was made to project each economic variable on covid indicators such as positivity rate, hospitalization, and deaths, then use the panel of `de-covid' data to estimate the economic factors.
covid-19 also has implications for VAR estimation. Consider a two variable VAR in log payroll-employment (PAYEMS) and log consumption of durables (CD). The top panel of Figure (ref) shows the response to a positive employment shock from a VAR estimated over the pre-covid sample of 1960:1-2020:2, while the second panel extends the sample to 2020:12. Adding ten months of post-covid data completely changed the shape of the impulse response functions. lenza-primiceri:20 recognize that the covid-induced spikes in the data will distort VAR estimation and suggest to use Pareto priors for innovation variances to capture these spikes. Others such as ccmm:21 model covid-19 as outliers.
Instead of specifying changes to the probability distribution of existing shocks, an alternative is to assume as in ng-covid:21 that there is an additional `virus' shock, say, $v$ in the post-covid sample. There are then two ways to proceed. The first is to de-covid all variables used in the VAR which would entail running $n(p+1)$ decovid regressions. By Frish-Waugh arguments, this is the same as adding covid indicators as exogenous variables to each equation. Note that these are not the same as running a VAR on $n$ de-covid variables, which would only entail $n$ decovid regressions. Results using the log changes in positive cases as $v$ are shown in the third panel of Figure (ref).\footnote{The covid data are taken from \url{https://covidtracking.com/data/download}.} The dynamic responses are very similar to the ones in the top panel estimated on the pre-covid sample.
Removing the covid variations from the data before VAR estimation suppresses feedback from the economic variables to $v$ which could be restrictive. An alternative approach is to include a $v$ indicator in the VAR directly and order it first, resulting in a HL model with $(n+1)$ variables. In this case, interest is not in the dynamic effects of an infinite variance shock; but to isolate the economic variations so that the dynamic effects of economic shocks can be estimated in spite of the presence of covid-19. The results for the three variable VAR in the bottom panel of Figure (ref) are again similar to the two step approach in the third panel. Whichever way we choose to control for covid variations, the exercise involves regressions with a finite variance variable on the left hand side and a heavy-tailed variable on the right hand side, and Proposition (ref) is relevant to the interpretation of the estimates.
This paper provides a VAR framework that accommodates disaster-type events. The framework can be used to study the effects of disaster type shocks, as well as the effects of finite variance shocks in the presence of large rare events. Under the maintained assumption that the primitive shocks are independent, a disaster-type shock can be uniquely identified from the tail behavior and sign of the components estimated by ICA. An independence test for validity of the identifying restriction is also proposed. The test is valid even for exactly identified models and is of interest in its own right. The focus here is developing the HL framework and consistent estimation. Inference when the data have heavy tails remains an area for future research.
\baselineskip=12.0pt