EconBase
← Back to paper

Fully Modified Least Squares Cointegrating Parameter Estimation in Multicointegrated Systems

Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.

58,937 characters · 8 sections · 0 citation commands

Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.

minipage.49 flushleft https://doi.org/10.1016/j.jeconom.2021.07.002 flushleft minipage minipage.49 flushright Journal of Econometrics, accepted manuscript. flushright minipage Fully Modified Least Squares Cointegrating Parameter Estimation in Multicointegrated Systems

abstract\setstretch{0.95} Multicointegration is traditionally defined as a particular long run relationship among variables in a parametric vector autoregressive model that introduces additional cointegrating links between these variables and partial sums of the equilibrium errors. This paper departs from the parametric model, using a semiparametric formulation that reveals the explicit role that singularity of the long run conditional covariance matrix plays in determining multicointegration. The semiparametric framework has the advantage that short run dynamics do not need to be modeled and estimation by standard techniques such as fully modified least squares (FM-OLS) on the original $I\left( 1\right) $ system is straightforward. The paper derives FM-OLS limit theory in the multicointegrated setting, showing how faster rates of convergence are achieved in the direction of singularity and that the limit distribution depends on the distribution of the conditional one-sided long run covariance estimator used in FM-OLS estimation. Wald tests of restrictions on the regression coefficients have nonstandard limit theory which depends on nuisance parameters in general. The usual tests are shown to be conservative when the restrictions are isolated to the directions of singularity and, under certain conditions, are invariant to singularity otherwise. Simulations show that approximations derived in the paper work well in finite samples. The findings are illustrated empirically in an analysis of fiscal sustainability of the US government over the post-war period. Keywords: Cointegration, Multicointegration, Fully modified regression, Singular long run variance matrix, Degenerate Wald test, Fiscal sustainability. JEL Codes: C12, C13, C22

Introduction

Many economic time series are non-stationary and contain stochastic trends, which are naturally modeled using cointegration. For example, two $I(1)$ variables $y_t$ and $x_t$ are cointegrated if for some $A$, $u_{0t}=y_t-Ax_t$ is $I(0)$. Granger and Lee (1990) call multicointegration a situation when the cumulative error $U_{0t}=\sum_{s=1}^t u_{0s}$ is cointegrated with $x_t$ or $y_t$. They analyze a case where $(y_t,x_t,u_{0t})$ are production, sales and inventory investment, $A=1$ and $U_{0t}$ is the level of inventories. Inventory stock $U_{0t}$ may then be cointegrated with production via an adjustment mechanism that captures firm decision making on inventory investment, as well as satisfying an identity arising from the aggregation of the defining relationship $y_t=x_t+u_{0t}$.

It is important to take into account the presence of multicointegration in a cointegrated system: on one hand it can invalidate usual procedures of estimation and testing in cointegrated systems by affecting asymptotic properties; and on the other it may lead to advantages in improved forecasting performance. Multicointegration has so far been analyzed only in a VAR framework\footnote{ It is of course possible to write stationary VARs in moving average form and vice versa under invertibility conditions. There is now a large literature describing such explicit representations for cointegrated time series. For a general approach based of Laurent series representations, see Franchi and Paruolo (2019) and the references therein.} and naturally involves implicit restrictions on the model induced by the extra layer of cointegration. Engsted and Johansen (1999), for example, show that if the process is generated by a VAR model for $I(k)$ variables, multicointegration may occur if $k=2$ but not if $k=1$. Likelihood-based estimators of cointegration parameters in $I(2)$ VAR multicointegrated systems have mixed normal limit distributions and likelihood ratio statistics for hypothesis testing about the parameters generally have asymptotic $\chi^2$ null distributions under conditions of correct specification, as shown for example in Johansen (1997, 2006), Boswijk (2000, 2010), and Paruolo (2000). Berenguer-Rico and Carrion-i-Silvestre (2011) provide an application of this approach that examines government debt sustainability.

In contrast to these studies, the present paper studies $I(1)$ cointegrated models that are possibly multicointegrated in a semiparametric framework with specific focus on the use of fully modified least squares (FM-OLS) estimation. In related work, the authors (Phillips and Kheifets, 2019) explore the concept of multicointegration in a general $I(1)$ triangular cointegrated system with weakly dependent errors, showing how multicointegration emerges naturally from singularity of the long run covariance matrix. This formulation gives an explicit mechanism generating multicointegration as a property of a general triangular $I(1)$ system, as opposed to imposing multicointegration subsequently on a parametric system like a VAR. The contrast lies in the capacity of a general I(1) triangular system to implicitly involve the effects of multicointegration without changing or restricting the cointegrating coefficients. The implicit effects propagate from the nonparametric treatment of the equation errors and are therefore typically unknown to the investigator. This property is one of the primary motivations of our study. A second motivation is to show that FM-OLS estimation of the cointegration coefficients has some useful robustness properties to the possible unknown presence of multicointegration.

More specifically, the present paper contributes by developing asymptotic theory for FM-OLS estimation and testing in cointegrating relationships that involve multicointegration in a semiparametric setting. The analysis of triangular cointegrated systems under singularity that is developed is of some independent interest. The results show that cointegrated system estimation may proceed under certain conditions in a general $I(1)$ cointegrated system in the presence (and without prior knowledge) of multicointegration.

To define multicointegration for weakly dependent data, we take the triangular representation of a linear cointegrating relationship. In the cointegrating regression model

align[align omitted — 92 chars of source]

$A$ is a $m_0\times m_x$ cointegrating coefficient matrix, $x_t$ is initialized at $t=0$ by $x_0 =O_p(1)$, and the combined error vector $u_t = (u'_{0t}, u'_{xt})'$ follows the linear process

align[align omitted — 167 chars of source]

for some $\nu>2$, finite fourth order cumulants of $\eta_t$, and where $m = m_0 +m_x$. It is common in the literature to consider such time series with an additional assumption $|D(1)|\ne 0$ (e.g. Phillips, 1995) that assures nonsingularity of the long run variance matrix of $u_t$, which we relax here.

Let $\Gamma_{u,u}(h)=\mathop{{}\mathbb{E}}\nolimits u_{t+h} u'_{t}$. The linear operator $D(L)$, the long run covariance matrix $\Omega=\sum_{h=-\infty}^{\infty}\Gamma_{u,u}(h)= D (1) D (1)'=\sum_{k=0}^{\infty}\sum_{j=0}^{\infty}D_j D'_k$ of $u_t$ and one-sided long run covariance matrix $\Gamma^{+}=\sum_{h=0}^{\infty}\Gamma_{u,u}(h)= \sum_{k=0}^{\infty}\sum_{j=0}^{k}D_j D'_k$ of $u_t$ are partitioned conformably with $u_t$ as

equation*[equation* omitted — 334 chars of source]

where $\Omega_{xx} > 0$ is positive definite so that $x_t$ is a full rank $I(1)$ regressor vector, as commonly assumed in triangular systems such (ref) and (ref) following Phillips(1991)\footnote{The case where the regressors $x_t$ are themselves cointegrated is considered in Phillips (1995) but is not considered in this paper.}. The conditional long run covariance matrix, defined as the Schur complement of the block $\Omega_{xx}$, is $\Omega_{00.x}=\Omega_{00}-\Omega_{0x}\Omega^{-1}_{xx}\Omega_{x0}$ and is positive (semi-) definite if and only if $\Omega$ is positive (semi-) definite (by virtue of the Guttman rank additivity formula). In this paper we consider a situation when the long run variance matrix is singular, or, equivalently, when the conditional long run covariance matrix is singular. It corresponds to a case where partial sums of $y_t$ and $x_t$ are cointegrated with an $I(0)$ error in some unknown direction, i.e. when there is a multicointegration in the spirit of Granger and Lee (1990), but is semiparametric in the sense that the short run dynamics are left unspecified. We therefore introduce the following definition.

DefinitionThe process generated by a triangular cointegrating system is called multicointegrated if its long run error covariance matrix is singular.

The advantage of this framework is that it provides the explicit origin from which the multicointegrating relationship arises in an $I(1)$ system. Thus, if we take partial sums of the augmented regression form (Phillips, 1991)

equation[equation omitted — 64 chars of source]

where $F=\Omega_{0x}\Omega_{xx}^{-1}$ is the long run regression coefficient of $u_{0t}$ on $x_t$ and $u_{0.x,t}=u_{0t}-\Omega_{0x}\Omega_{xx}^{-1}u_{xt}$, giving (using capitals with time index $t$ for partial sums)

equation[equation omitted — 60 chars of source]

It becomes clear that in the direction of singularity of $\Omega_{00.x}$ we have an exact long run relationship that links the time series $Y_t$, $X_t$, and $x_t$ and this relationship is prescribed in terms of the coefficients $A$, $F$ and the singular direction of $\Omega_{00.x}$, which is estimable. In earlier work on multicointegration, the hypothesis about multicointegration is imposed a priori, directly and explicitly as in Granger and Lee (1990) or through rank conditions in VAR analyses. What our approach does is: (i) show that multicointegration may exist in a triangular $I(1)$ system such as (ref); (ii) reveal the leading and intuitively simple role that the singularity of the long run conditional error covariance matrix $\Omega_{00.x}$ plays in giving rise to multicointegration, a feature of the model that may be unknown to the investigator; (iii) allow for both cointegration and multicointegration within the same specification; and (iv) use a nonparametric formulation to provide a general setting for the analysis, for the form of the cointegrating and multicointegrating coefficients, and for practical work.

In a VAR framework Engsted and Johansen (1999) show that multicointegration, as defined in Granger and Lee (1990) of a linear $I(1)$ process\footnote{ The summability condition in the specification (ref) imposes a restriction on $C(z)$. This is because the matrix moving average power series $D(z)$ of a linear process generated by (ref)-(ref) does not have poles at $z=1$, which implies that, when the system is written in the form $\left(y'_t,x'_t\right)'=\left(1-L\right)^{-1}C(L)\eta_t$, it must be that $\xi_1 C(1)=0$, where $\xi_1=(I_{m_0}, -A)$. Indeed, the upper block of $D(z)$ of such a system satisfies $(D_{00}(z), D_{0x}(z)) = \xi_1 (1-z)^{-1}C(z)=(1-z)^{-1}\xi_1 C(z)$ and does not have poles at $z=1$ if and only if $\xi_1 C(1)=0$. We thank a referee for this clarifying observation and suggestions to improve the statement and the proof of Proposition (ref).} $\left(y'_t,x'_t\right)'=\left(1-L\right)^{-1}C(L)\eta_t$ where the roots of $|C(z)|=0$ satisfy $|z|> 1$ or $z=1$, occurs when $z=1$ is a root\footnote{The order $m$ of zeros of $C(z)$ at $z=1$ or, equivalently, the order of poles of $C(z)^{-1}$ at $z=1$, is not restricted to $m=1$ and is unknown. A unified treatment of the different representations of cointegrated systems for known $m$ is given in a recent paper by Franchi and Paruolo (2019).}, so that $C(1)=\xi\epsilon'$ has reduced rank and $\xi'_{\perp}\dot C(1)\epsilon_{\perp}$ is singular (explicit forms of the matrices $\{\xi,\epsilon\}$ and their orthogonal complements $\{\xi_{\perp}, \epsilon_{\perp}\}$ are given in the proof of the Proposition 1). This is the case when $\Omega$ is singular or more specifically in the present context when $\Omega_{00.x}$ is singular, as shown below.

propA linear process $\left(y'_t,x'_t\right)'$ generated by (ref)-(ref) with $\Omega_{xx}>0$ is multicointegrated, i.e., $\Omega$ is singular, if and only if it satisfies the multicointegration condition of Engsted and Johansen (1999). The rank of the multicointegrating relation equals $m-rank(\Omega)=m_0-rank(\Omega_{0.xx})$.

In what follows data matrices are denoted by upper case letters without indexes, e.g., $Y'=[y_1,\ldots,y_T]$. The OLS estimator $\widehat A= Y'X \left(X'X\right)^{-1}$ is consistent at the rate at least $O(T)$. The FM-OLS estimator (Phillips and Hansen 1990) has the form $\widehat A^{+}=\left(\widehat Y^{+'}X-T\widehat\Delta^{+}_{0x}\right) \left(X'X\right)^{-1}$ and employs corrections for endogeneity in the regressor $x_t$, leading to the transformed dependent variable $\widehat y^{+}_t=y_t-\widehat\Omega_{0x}\widehat\Omega_{xx}^{-1}(x_t-x_{t-1})$ and a bias correction term involving $\widehat\Delta^{+}_{0x} =\widehat\Delta_{0x} -\widehat\Omega_{0x}\widehat\Omega_{xx}^{-1}\widehat\Delta_{xx}$, which is constructed in the usual way using consistent nonparametric estimators of submatrices of the long run and one sided long run quantities $\Omega$ and $\Gamma^{+}$. Compared with OLS, the FM-OLS estimator removes asymptotic bias and increases efficiency by correcting both the long run serial correlation in $u_t$ and endogeneity in $x_t$ caused by the long run correlation between $u_{0t}$ and $u_{xt}$. The properties of FM-OLS in general regressions as well as VARs are studied in Phillips (1995). Here we advance the analysis by allowing for the possibility of a singular conditional long run variance matrix $\Omega_{00.x}$. When $\Omega_{00.x}$ is singular, i.e. when modified $y_t$ is cointegrated and in some direction the errors in the cointegrating equation are $I(-1)$, the limit theory of the FM-OLS estimator is degenerate at the usual $O(T)$ rate and the faster convergence rate affects both estimation and inference.

The paper makes the following contributions. First, we derive the new rates of convergence and limit distribution of the FM-OLS estimator in the case of a null conditional long run variance matrix. The new rate exceeds $O(T)$ and depends on the bandwidth used in estimating the long run covariance matrix quantities that are employed in making corrections for endogeneity and serial correlation in FM-OLS. The resulting limit distribution is no longer mixed normal and depends on nuisance parameters. Similar properties hold in the direction of singularity in the case of a singular long run variance matrix. Second, under certain conditions, the limit distribution of Wald statistics for testing restrictions on the cointegrating space and cointegrating parameters is $\chi^2$ and is invariant to the presence of singularity. Third, we show that when those restrictions fail, the Wald test is conservative. Monte Carlo simulations reveal that the empirical level of the test can be far below the nominal $1\%$, $5\%$ and $10\%$ levels in singular and near singular cases.

As an application of our methods we analyze fiscal sustainability of the US government over the period 1947-2019 by testing the null hypothesis that the cointegration relationship between government revenue and expenditure has the parametric form $(1,-1)$. Multicointegration between government revenue and expenditure naturally arises if bounds are imposed on deviations of debt from revenue. We reject the null hypothesis and, as our theoretical results show, this conclusion is not affected by the presence of multicointegration. The finding is important for practical purposes, as a separate treatment of the multicointegration case is not necessary (cf., Quintos, 1995, and Berenguer-Rico and Carrion-i-Silvestre, 2011).

The paper is organized as follows. In Section 2 we derive the rates of convergence of elements of $\widehat A^{+}$ and establish its limit distribution. After some preliminary observations we begin our discussion with the null case where $\Omega_{00.x}=0$, then move on to a case of a general singular matrix. The implications of singularity for hypothesis testing are discussed in Section 3. The finite sample properties of the FM-OLS and Wald test statistics are explored in Section 4. The application to government fiscal sustainability is considered in Section 5. Section 6 concludes. Proofs are given in the Appendix.

Fully Modified OLS

Under the stated conditions the functional law $T^{-1/2}\sum_{t=1}^{[T\cdot]}u_t\to_d B(\cdot)\equiv BM(\Omega)$ holds for partial sums of $u_t$ (e.g., Phillips and Solo, 1992). Define the partition $B=(B'_0,B'_x)'$ into the first $m_0$ and the final $m_x$ subvectors of the Brownian motion, conformably with $u_t$. Introducing the matrices

equation*[equation* omitted — 249 chars of source]

and the Brownian motion $B_{0.x}=\mathcal{L}_{0.\Omega}B$, we have

equation*[equation* omitted — 312 chars of source]

where $B_{0.x}\equiv BM\left(\Omega_{00.x}\right)$ is orthogonal to $B_x$. Note that $\Omega_{00.x}$ is the long run variance of $u_{0.x,t}=\mathcal{L}_{0.\Omega}u_{t}=D_{0.x}(L)\eta_t$, where $D_{0.x}(L)=\mathcal{L}_{0.\Omega}D(L)$. It is well known that the OLS estimator of $A$ in (ref) is $O(T)$ consistent with a limit distribution that depends on the nuisance parameters $\Omega$ and $\Gamma^{+}$, viz.,

align[align omitted — 375 chars of source]

The last two terms of (ref) are the endogeneity and serial correlation biases that FM-OLS seeks to remove.

Suppose $\Omega$ and $\Gamma^{+}$ are estimated in the usual way (e.g., Priestley 1981; Hannan, 1970) as

align*[align* omitted — 190 chars of source]

where $w(\cdot)$ is a kernel function, $K$ is a bandwidth parameter and the sample covariances are $\widehat\Gamma_{\widehat u,\widehat u}(j)=T^{-1}\sum_{1\le t,t+j\le T}\widehat u_{t+j} \widehat u'_{t}, \ \ \widehat u_{t}=(\widehat u'_{0t}, u'_{xt})'$, where $\widehat u_{0t}=y_t-\widehat A x_t$. Similar to Phillips (1995), we consider the following kernels and bandwidth rates.

assumptiontwo{K}{Kernel Condition} For given $k\in(0,1)$, the bandwidth parameter $K$ has the rate $K\sim c_T T^k$ as $T\to\infty$, where $c_T$ is slowly varying at infinity, i.e.\ $c_{xT}/c_{T}\to 1$ for $x>0$ and $T\to\infty$. The kernel function $w(\cdot):\mathop{\mathbb R}\nolimits\to[-1,1]$ is a twice continuously differentiable even function with \begin{enumerate} • $w(0)=1, w'(0)=0, w''(0)\ne 0$, and • $w(x)=0, |x|\ge 1$, with $\lim_{|x|\to 1}w(x)/(1-|x|)^2=const$. \end{enumerate}

Parzen and Tukey--Hanning kernels satisfy Assumption K. The Bartlett--Priestley or quadratic spectral kernels do not satisfy Assumption K but to use them in the following development these kernels need to satisfy

enumerate$w(x)=O(x^{-2})$, as $|x|\to \infty$

and (a) with support $(-\infty, \infty)$. Under Assumption K, with $0<k<1$, and any consistent estimator $\widehat A$ we have $\widehat\Gamma\to_p\Gamma,\ \widehat\Omega\to_p\Omega,\ \widehat\Delta\to_p\Gamma^{+}.$

propUnder Assumption K with $0<k<1$, \begin{align*} T\left(\widehat A^{+} - A\right)\to_d \left(\int_0^1 d B_{0.x} B'_x\right) \left(\int_0^1 B_x B'_x\right)^{-1}. \end{align*}

For the nonsingular case this result appears in Corollary 4.3 in Phillips (1995). The proof reveals that singularity does not alter the above convergence but makes the limit distribution degenerate. If $\Omega_{00.x}$ has full rank, the rate of convergence of the FM-OLS estimator is determined by the rates of weak convergence of the sample covariances and the rate of nonparametric estimation of $\Omega$ and $\Gamma^{+}$ does not play any role. We will show that in case $\Omega_{00.x}$ is singular, the rate of convergence of the FM-OLS estimator along the null direction of $\Omega_{00.x}$ increases by $\delta(T)$, where

align*[align* omitted — 162 chars of source]

The fastest rate of convergence of FM-OLS in the null direction is $T^{3/2}$ when bandwidth expansion rate is $k\in[1/4,1/2]$.

For example, in the case where $\Omega_{00.x}=0$, we have $T\left(\widehat A^{+} - A\right)\to_p 0$ and the precise rate of convergence of the FM-OLS estimator depends on the bandwidth parameter expansion rate $k$ in kernel estimation of the nonparametric components. Parameter dependencies may then be present in the resulting asymptotic theory, arising from first order terms in the limit behavior of the long run covariances that influence the asymptotics in this degenerate case. In particular, when $\Omega_{00.x}=0$ the component $D_{0.x}(1)=0$ in the Beveridge-Nelson decomposition of $u_{0.x,t}$. In this case, $u_{0.x,t}=D_{0.x}(1)\eta_t+\widetilde D_{0.x}(L)\eta_{t-1}-\widetilde D_{0.x}(L)\eta_t$ reduces to a first difference $u_{0.x,t}=-(e_t-e_{t-1})$, which is $I(-1)$\footnote{The fact that $u_{0.x,t}$ is $I(-1)$ includes the possibility that in some or all directions $u_{0.x,t}$ may be $I(-d)$, $d>1$, but that possibility does not affect the convergence properties of the FM-OLS estimator as the next proposition shows.} with $e_t=\widetilde D_{0.x}(L)\eta_t=\sum_{j=0}^{\infty}\widetilde D_{0.x,j}\eta_{t-j}$, with $\widetilde D_{0.x,j}=\mathcal{L}_{0,\Omega}\sum_{t=j+1}^{\infty}D_t$, and $e_t$ has long run variance matrix $\Omega_{ee}=\widetilde D_{0.x}(1)\widetilde D_{0.x}(1)'$.

The next proposition establishes convergence properties of FM-OLS for such time series. It is particularly useful for the case of a single cointegration relationship with $m_0=1$ (e.g., Phillips and Loretan, 1991), because singularity implies that the conditional long run variance is zero. This reduction makes explicit the effect of singularity on the convergence rates and serves as the basis of a general result.

propSuppose $\Omega_{00.x}=0$. Under Assumption K with $0<k<1$, \begin{align*} \delta(T)\left(\widehat A^{+} - A\right)=O_p(1). \end{align*}

As the proof of Proposition (ref) reveals, the limit distribution of the restandardized estimation error $\delta(T)(\widehat A^{+} - A)$ depends on nuisance parameters associated with the nonparametric estimation of the long run covariance matrices. For kernel estimators, the limit depends on the covariance structure of the errors, on the bandwidth growth rate, and on the second derivative of the kernel function. For illustration, consider the case when the bandwidth $K$ grows slower than $T^{1/4}$, which includes the typical optimal bandwidth rate $T^{1/5}$ for long run variance estimation. Under these conditions, we have the following limit theory.

propSuppose $\Omega_{00.x}=0$. Under Assumption K with $k<1/4$, \begin{align*} T^{1+2k}\left(\widehat A^{+} - A\right)\to_d w”(0) \left(\Phi_0 +\Phi_{-\infty}\Omega^{-1}_{xx}\int_0^1 d B_x B'_x \right) \left(\int_0^1 B_x B'_x\right)^{-1}, \end{align*} where $\Phi_h=\sum_{j=h}^{\infty}\left(j+1/2\right)\mathop{{}\mathbb{E}}\nolimits e_{t+j} u'_{xt}$.

Unlike the corresponding limit theory in the nonsingular case (Phillips, 1995; Phillips and Hansen, 1990; Phillips, 2014), the limit distribution of FM-OLS now depends on the covariance structure of the errors $u_{xt}$ and $e_{t}$ and on the second derivative of the kernel function.

Next, consider a general case of singular $\Omega_{00.x}$ with rank $r<m_0$, so that $\Omega$ has rank $r+m_x$. To isolate nondegenerate directions decompose $\Omega_{00.x}=RR'$, where $R$ is an $m_0 \times r$ matrix of rank $r$. Then $R'R$ has full rank, $R'u_{0.x,t}$ has full rank long run variance matrix and Proposition (ref) applies in this direction. In the orthogonal direction\footnote{By the usual eigenvalue decomposition for symmetric matrices there is a set of orthonormal eigenvectors $\{q_i\}_{i=1}^m$ of $\Omega_{00.x}$, stacked as an orthogonal matrix $C$ and real eigenvalues $\lambda_i$ in decreasing order on diagonal matrix $\Lambda$, such that $\Omega_{00.x}=C\Lambda C'=\sum_{i=1}^{r}\lambda q_i q_i'$. In this notation, $C\Lambda^{1/2}=(R,0)$ and $R_{\perp}$ spans the space of eigenvectors corresponding to zero eigenvalues.} $R_{\perp}$, $R'_{\perp}u_{0.x,t}=-(e_t-e_{t-1})$ is $I(-1)$ \footnote{This representation allows for $R'_{\perp}u_{0.x,t}$ being $I(-d)$ with $d>1$ in some directions.}, where $e_t=R'_{\perp}\widetilde D_{0,x}(L)\eta_t$ has long run variance $\Omega_{ee}=R'_{\perp}\widetilde D_{0,x}(1)\widetilde D_{0,x}(1)'R_{\perp}$ and Proposition (ref) applies, showing that elements in this direction $R'_{\perp}A$ are estimated at a faster rate than $O(T)$.

We now state our first main result.

theoremSuppose $\Omega_{00.x}=RR'$, where $R$ is an $m_0 \times r$ matrix with $rank(R)=r<m_0$. Then under Assumption K \begin{align*} T \left(\widehat A^{+} - A\right)\to_d \left(\int_0^1 d B_{0.x} B'_x\right) \left(\int_0^1 B_x B'_x\right)^{-1}, \end{align*} which is degenerate mixed normal. The limit distribution is not degenerate and has full rank in direction $R$ with \begin{align*} T R'\left(\widehat A^{+} - A\right)\to_d \left(\int_0^1 d B_{f.x} B'_x\right) \left(\int_0^1 B_x B'_x\right)^{-1}, \end{align*} where $B_{f.x}\equiv BM\left(\Omega_{ff.x}\right)$ and $\Omega_{ff.x}=R'RR'R$ is the full rank $r \times r$ conditional long run variance matrix of $R'U_{0.x}$. In the direction $R_{\perp}$ orthogonal to $R$ the convergence of $\widehat A^{+}$ is at the faster rate $O(\delta(T))$ and $\delta(T) R'_{\perp}\left(\widehat A^{+} - A\right)=O_p(1).$

The FM-OLS estimator of a singular triangular system with multicointegration therefore has the following properties: (i) FM-OLS is consistent; (ii) the limit distribution is degenerate in the original coordinates; and (iii) rates of convergence are $O(T)$ in nondegenerate directions and $O(\delta(T))$ in degenerate directions. In the degenerate direction the limit distribution is of the type shown in Proposition (ref). Singularity of the limit distribution means that care is needed when undertaking inference and these matters are considered in the next section. The situation is in some ways analogous to that of causality testing in cointegrated VAR regressions, as analyzed in Toda and Phillips (1993), and cointegrating regressions with cointegrated regressors, as analyzed in Phillips (1995). In the present case, it is necessary to analyze the directions of singularity of the long run covariance structure and the behavior of the estimates in these directions.

Testing

We consider the following hypothesis involving functions $\phi\in C_q^1(-\infty,\infty)$, the space of $q$ dimensional continuously differentiable functions $\mathcal{H}_0:\; \phi(vec(A))=0,$ where $vec\left(\cdot\right)$ is row vectorization. Suppose $\Omega_{00.x}=RR'$, where $R$ is an $m_0 \times r$ matrix of $rank(R)=r<m_0$, so that $R'R$ is $r \times r$ nonsingular. Then under Assumption K

align*[align* omitted — 215 chars of source]

The limit distribution is mixed normal ($\mathcal{MN}$) and standard inference methods can be applied. The usual Wald statistic for testing $\mathcal{H}_0$ is

align*[align* omitted — 229 chars of source]

where $\widehat a^{+}=vec\left(\widehat A^{+}\right)$, $\Phi(a)=\partial \phi(a)/\partial a'$ and $a=vec\left(A\right)$ is row vectorization. Suppose that the following rank condition holds

align[align omitted — 154 chars of source]

Under Assumption K, $W\to_d\chi^2_q$. So, under the rank condition (ref), the limit distribution of the Wald statistics is invariant to the presence of singularity.

Violation of the rank condition

Consider the linear hypothesis

align*[align* omitted — 44 chars of source]

with restriction $q\times m_0 m_x$ matrix $Q=R_1\otimes R_2$ of rank $q=q_1q_2$ and component matrices $R_1$, $m_0 \times q_1$, of rank $q_1$ and $R_2$, $m_0 \times q_2$, of rank $q_2$. Then $\mathcal{H}_0$ has a tensor form with matrix representation $\mathcal{H}_0:\; R_1 A R_2=R_3, \; \textrm{with} \; vec\ R_3=r_0$, and

align*[align* omitted — 159 chars of source]

If the rank of $ R_1\Omega_{00.x}R'_1=R_1 RR' R'_1$ is $\tilde q_1<q_1$, then the rank condition (ref) fails as $\tilde q_1 q_2< q_1 q_2=q$. This is the case where some of the restrictions isolate directions in which FM-OLS is hyperconsistent with rate exceeding $O(T)$. The distribution of the Wald test statistic is then nonstandard and depends on nuisance parameters. In general, failure of estimator mixed normality in the direction of faster convergence produces a non chi-squared limit in the Wald statistic as the faster convergence of the estimator is balanced in the Wald statistic weighting. A related phenomenon arises in Toda and Phillips (1993), who describe situations where Wald tests of Granger causality in cointegrated VAR systems do not follow asymptotically chi-squared distributions. For another example, see Phillips (2016), where singularity in the signal matrix leads to nonstandard inference.

To illustrate the consequences of singularity consider testing $\mathcal{H}_0: A=A^0.$ Then $Q=I_{m_0 m_x}, r_0=vec(A^0), R_1=I_{m_0}, R_2=I_{m_x}, R_3=A^0$ and their ranks are $q=m_0 m_x$, $q_1=m_0$ and $q_2=m_x$. The Wald test statistic then simplifies to

align*[align* omitted — 299 chars of source]

The notational change to $W_I$ emphasizes that the following analysis only considers the full dimensional restriction structures above. The rank of $\Omega_{00.x} \otimes \int_0^1 B_x B'_x$ equals the rank of the conditional long run variance times $m_x$, i.e. the null hypothesis restrictions isolate `all directions' and the rank condition is satisfied if and only if the conditional long run variance matrix is nonsingular. If the conditional long run variance is nonsingular, the rank condition holds and $W_I\to \chi^2_{q}$.

Singularity alters the rate of convergence and the limit of $\widehat\Omega_{00.x}$, which is used in the construction of the Wald test statistics. We proceed to derive the rate of convergence for this quantity. As the proof of the following proposition reveals, the rate of convergence is $T^{2k}$ if $k<1/3$ and $T^{1-k}$ if $k\ge 1/3$. As in the case of FM-OLS estimation, the limit distribution of $\widehat\Omega_{00.x}$ depends on nuisance parameters and on the implementation of the nonparametric estimates of the long run covariance matrices. As an illustration, consider a case when the bandwidth $K$ grows slower than $T^{1/3}$, which includes the usual optimal bandwidth rate $T^{1/5}$ for long run variance estimation.

propSuppose $\Omega_{00.x}=0$ and Assumption K holds with $0<k<1/3$.Then \begin{enumerate}[(a)] • $ T^{2k}\widehat\Omega_{00.x} \to_p -w''(0)\Omega_{ee}. $ • If $\Omega_{ee}$ is nonsingular, then $W_I=O_p(T^{-2k})$ if $k\in(0,1/4]$ and $W_I=O_p(T^{2k-1})$ if $k\in(1/4,1/3)$. \end{enumerate}

Nonsingularity of $\Omega_{ee}$ means that there is no further level of cointegration (system (ref) is singular of first order, see Park 1992) and guarantees that the limit in Part (a) is nondegenerate, so that the rate of convergence of $\widehat\Omega_{00.x}$ is sharp. In the more general case where $\Omega_{00.x}$ is positive semi-definite but not a null matrix we have the following result.

theoremSuppose $\Omega_{00.x}=RR'$, where $R$ is an $m_0 \times r$ matrix with $rank(R)=r<m_0$, $\Omega_{ee}$ is nonsingular, and Assumption K holds with $0<k<1/3$, then under the null $W_I\to_d \chi^2_{r m_x}$.

The proof of the above result reveals that the limit distribution of the Wald test statistic involves the sum of two major components. The first component arises from the limit in the nonsingular direction, which is $\chi^2_{r m_x}$, and the second involves the limit in the direction where the conditional long run variance matrix is zero, which is nonstandard, depends on nuisance parameters and decays at the speed established in Proposition (ref) above. Therefore, for $k<1/3$ the $\chi^2_{r m_x}$ limit distribution of the $W_I$ statistic has thinner tails than the distribution of $\chi^2_{m_0 m_x}$, so that tests based on the usual degrees of freedom are asymptotically conservative.

Finite sample performance

The following analysis of finite sample performance is based on $10,000$ simulations with different sample sizes.\footnote{Statistical computing in this paper uses R version 3.4.4.} The long run variances are estimated using the Parzen kernel

equation*[equation* omitted — 168 chars of source]

and bandwidth is set to $K=T^{1/4}$, if not specified otherwise. The data generating process (DGP) has the form (ref) with scalar cointegrating coefficient $A=2$ and with a combined error vector $u_t = (u_{0t}, u'_{xt})'$ that follows the linear process

equation*[equation* omitted — 109 chars of source]

We consider estimation of $A$ and hypothesis testing for the null $\mathcal{H}_0:\ A=2$. We look at two classes of bivariate ($m=2$) DGPs.

enumerate[DGP1] • For parameter choices $p\in \{0.0, -0.1, \ldots, -1.0\}$ define \begin{equation*} D_1=\left[ \begin{array}{cc} p & 0 \\ 0 & 0 \end{array} \right], \quad\Sigma=I_2. \end{equation*} • For parameter choices $p\in \{0.8, 5.2\}$ define \begin{equation*} D_1=\left[ \begin{array}{cc} 0.3 & 0.4 \\ p & 0.6 \end{array} \right], \quad \Sigma=\left[ \begin{array}{cc} 1 & 0.5 \\ 0.5 & 1 \end{array} \right]. \end{equation*}
figure[figure omitted — 683 chars of source]
figure[figure omitted — 677 chars of source]

The finite sample performance for DGP1 is shown in Figure 1 and Table 1; results for DGP2 are given in Figure 2 and Table 2.

Discussion of results for DGP1.

When $p=-1$ we have $\Omega_{00.x}=0$ and a singular system. The limit theory generalizes results on estimation and testing to this case. With matrix $D_1$ diagonal, the errors $u_{0t}$ and $u_{xt}$ are independent and the effect of singularity in the long run variance can be studied separately from the effect of long run dependence. When $p=0$, the long run variance is the identity $I_2$ and the conditional long run variance is $1$, giving a standard nonsingular case. For values of $p$ between $0$ and $-1$ the system is still in the nonsingular case but in finite samples for smaller values of $p$ the limit theory for the singular case may lead to better approximations than the nonsingular case and simulations help to guide this assessment.

In Figure (ref), Panel (a), the densities of the bias $\widehat A^{+}-A$ are shown for sample size $T=50$. We compare the densities in the singular case ($p=-1$) with two nonsingular cases ($p=0$ and $p=-0.5$). The figure shows that the bias in the singular case is much smaller than the bias in the nonsingular cases. A more pronounced effect is observed for $T=100$ in Panel (c) confirming the higher convergence rates established for FM-OLS under singularity.

We use the $t$-statistic $t_{\widehat A^{+}}=(\widehat A^{+}-A^0)/\{\widehat\Omega_{00.x}/\sum_{t=1}^T x_t^2\}^{1/2}$ for testing the hypothesis $\mathcal{H}_0:\, A=2$. In Figure (ref), Panel (b) the densities of the $t$-statistic are shown for sample size $T=50$. We compare the densities in the singular case ($p=-1$) with two nonsingular cases ($p=0$ and $p=-0.5$). Theory predicts that in nonsingular cases the test statistics is asymptotically standard normal, whose density is also plotted. This approximation is quite accurate for $p=0$. However, the density of the test statistic for $p=-0.5$ has thinner tails, so that the test based on standard normal approximation is conservative as our theory predicts for singular case. Results for the sample size $T=100$ are plotted in Panel (d), and it is evident that the test statistic for $p=-0.5$ still has thin tails.

table[table omitted — 2,914 chars of source]
table[table omitted — 2,245 chars of source]

Further simulation results are in Table (ref). We vary sample sizes from $50$ to $100$ and the bandwidth is set to $K=T^{1/4}$. The bias is zero up to the 3d digit in all cases. When the sample size increases from $T=50$ to $T=100$ the precision of the FM-OLS measured by the standard deviation of the bias term increases by $0.0175/0.0055=3.18$ in the singular case and by $0.0502/0.0242=2.07$ in nonsingular case $p=0$ corroborating the hyperconsistency of FM-OLS in the singular case and superconsistency in nonsingular case. When we compare FM-OLS with OLS, the former is more precise in the singular and near-singular cases, while in the nonsingular case both estimators are comparable as removing second order bias effects that do not exist under DGP1 in OLS does not give an advantage to FM-OLS.

Interestingly, the rejection rates show that for $T=50$ the test is conservative in all cases except $p=0$ and $p=-0.1$. Even when the sample size is raised to the high level $T=10,000$ (unreported here) the test is still conservative for values of $p=0.5$ and below. Thus, the phenomenon described in this paper extends far beyond the pure singular case.

Discussion of results for DGP2.

Since Phillips and Loretan (1991) numerous simulation studies have considered this DGP with different degrees of endogeneity, by varying values for $p$ between $-0.8$ and $0.8$. We consider $p=5.2$, for which $\Omega_{00.x}=0$ and compare these results to the nearest nonsingular case with $p=0.8$.

In Figure (ref) we again observe thinner tails in the bias and $t$-statistic densities in the singular case compared to the nonsingular case, as well as thinner tails in the density of the $t$-statistic compared to the standard normal density already for $T=50$. Unlike the situation with DGP1, second order biases are evident due to long run covariance between $e_t$ and $u_{xt}$ as predicted by theory and indicated in the proofs in the Appendix.

Table (ref) confirms the above findings and allows analysis of the effect of bandwidth choice. Unlike previous simulations, the bandwidth is here fixed for $K$ to a range between $3$ and $10$. This range includes many typical rules for bandwidth choice for the sample sizes considered. We see that test statistics for the singular case control size even for bandwidth choices for which the nonsingular case results in over-rejection ($T=50$, $K=10$). In all other cases singularity in the model results in a conservative test for all bandwidth choices under consideration.

Evaluating Fiscal Sustainability

Soaring government debt in many countries calls for better economic understanding of fiscal sustainability for which improved methods of econometric analysis may be helpful given the presence of nonstationarity and endogeneities in the relevant data. Econometric analysis of sustainability has a long tradition, going back to early work by Hamilton and Flavin (1986) who suggested to test stationarity of the discounted debt. Hakkio and Rush (1991), Huag (1991), Trehan and Walsh (1991), and Quintos (1995) were among the first to test cointegration between revenues and expenditures. Quintos (1995) calls sustainability `strong' when revenues and expenditures cointegrate with the explicit coefficients $(1,-1)$ and tests the later using FM-OLS based $t$-statistics. A recent discussion of other approaches to evaluate fiscal sustainability is given in the chapter by D'Erasmo, Mendoza and Zhang (2016) in the Handbook of Macroeconomics.

Two remarks concerning the cointegration approach are relevant to our following analysis. First, cointegration between revenues and expenditures is only a sufficient condition for an intertemporal budget constraint (IBC) to hold and there are many other data generating processes consistent with IBC. This means that rejecting cointegration does not imply that IBC does not hold. Following Bohn (2007), consider

align*[align* omitted — 104 chars of source]

where $B_t$ is government debt, $R_t$ is government revenue, $r_t$ is the interest rate, which is assumed to be stationary with mean $r>0$, $G_t$ is government expenditure, $G^0_t$ is government expenditure excluding interest on debt, and $G^a_t=G^0_t+(r_t-r)B_{t-1}$ is adjusted expenditure. These variables can be defined in nominal or real terms, possibly deflated by GDP or population. For example, Quintos (1995) constructed real variables by deflating nominal variables by the GNP price deflator and by population. BI implies

align*[align* omitted — 128 chars of source]

which together with

align*[align* omitted — 156 chars of source]

where the limit is in the mean square sense, implies

align*[align* omitted — 163 chars of source]

IBC holds when the debt matches the expected present discounted value of the future surplus, a desirable requirement for sustainability. Bohn (2007) shows that if $B_t\sim I(m)$ for some finite $m\ge 0$, then $B_t$ satisfies TC and IBC holds. Therefore, the Quintos (1995) concept of strong sustainability, defined as $B_t\sim I(1)$, while intuitively appealing, is one of many possibilities of data generating processes satisfying IBC.

Second, there are economic considerations that restrict the DGP, besides IBC. For example, fiscal sustainability may involve bounds or restrictions on the deficit $\Delta B_t$ that can be formulated as $\Delta B_t\sim I(0)$, which corresponds to strong sustainability by Quintos (1995), and $G_t - R_t\sim I(0)$ if $G_t, R_t\sim I(1)$. Furthermore, there could be bounds on deviations of debt from revenue, that can be formulated as cointegration between $B_t$ and $R_t$. In that case $G_t$ and $R_t$ are multicointegrated and the conditions for the asymptotic result in Phillips and Hansen (1990) employed in Quintos (1995) are not met. To allow for multicointegration, Berenguer-Rico and Carrion-i-Silvestre (2011) model the revenue-expenditure relationship in an $I(2)$ VAR system, as suggested by Haldrup (1994) and Engsted et al (1997). The results of the present paper show that it is not necessary to work in an $I(2)$ system and it is possible to go beyond a VAR specification. In particular: (i) multicointegration can be allowed directly in the $I(1)$ system considered in Equation (6) in Quintos (1995); (ii) multicointegration invalidates the normal approximation of the test statistics $t^{+}$ used in Section 3.1.2 in Quintos (1995); and (iii) multicointegration does not alter the conclusion that the null hypothesis of cointegration between $G_t$ and $R_t$ with coefficient $(1,-1)$ is rejected. We explore these points and provide revised estimates and tests based on an updated dataset.

The data are provided by the US Bureau of Economic Analysis and retrieved from FRED, Federal Reserve Bank of St. Louis on November 17, 2019. We consider two series: $x_t = $ Government Current Expenditures (GEXPND), inclusive of interest payments, and $y_t = $ Government Current Receipts (GRECPT). Both series are in billions of dollars, seasonally adjusted annual rate, at quarterly frequency from 1947:Q1 to 2019:Q1, $T=291$ observations.

figure[figure omitted — 544 chars of source]

The series are plotted in Figure (ref)(a). We see that the series start to diverge in the mid 1990s and even more so after year 2000. We estimate the equation $y_t=A x_t +u_{0t}$ and test the null hypothesis of strong sustainability, viz., $\mathcal{H}_0:\ A=1$. FM-OLS estimation of the full sample gives $\widehat A^{+} = 0.83$ with standard error $0.01$ and $t$-statistic $(0.83-1)/0.01=-17$, rejecting the null hypothesis. The result is similar if we include the constant and for bandwidth $T^{1/5}$ in place of $3T^{1/5}$.

The divergence of the series in mid 1990s in Figure (ref)(a) may signify a structural break in the relationship. In fact, several studies (e.g. Berenguer-Rico and Carrion-i-Silvestre, 2011) found a break in the 4th quarter of 1996, which could be attributed to the 1997 Clinton tax cut. The study of the properties of the FM-OLS under multicointegration in the presence of structural breaks we leave for future research. But we do estimate the model for the period from 1947:Q1 to 1996:Q4 ($T=200$) finding that $\widehat A^{+} = 0.87$ with standard error $0.005$ and $t$-statistic $(0.87-1)/0.005=-26$, so the cointegrating coefficient is closer to but still statistically different from $(1,-1)$.

From the Campbell--Shiller work on log-linearization of present value identities we may expect that linear time series models provide better approximations in logarithms of the time series, which has the further advantage of stabilizing variances. The series in logs are plotted in Figure (ref)(b). We also plot the first differences in levels and in logs in Figure (ref). The first differences of logs (Figure (ref)(d)) show less heteroskedasticity than first differences in levels (Figure (ref)(c)) so our theory results seem better suited for specification in logs\footnote{We thank a referee for this suggestion.}. FM-OLS estimation of the full sample in logs gives $\widehat A^{+} = 0.98$ with standard error $0.002$ and $t$-statistic $(0.98-1)/0.002=-10$, rejecting the null hypothesis. The value of the $t$-statistic is similar for the period from 1947:Q1 to 1996:Q4.

We also estimate the cointegration relationship between real revenue and expenditure constructed using the GDP deflator. We take the same data series\footnote{Available at the Journal of Applied Econometrics Data Archive, http://qed.econ.queensu.ca/jae/2011-v26.2/} as in Berenguer-Rico and Carrion-i-Silvestre (2011), but instead of looking at $I(2)$ systems (which means working with $\sum_{j=0}^t R_j$, $\sum_{j=0}^t G_j$ and $G_t$) we again run FM-OLS $R_t$ on $G_t$ and obtain $\widehat A^{+} = 0.92$ with standard error $0.01$ and $t$-statistic $(0.92-1)/0.01=-8$, rejecting the null hypothesis that revenue and expenditure are cointegrated with coefficient $(1,-1)$.

Conclusion

In a semiparametric triangular representation of $I(1)$ cointegrated time series the presence of multicointegration results in a singular long run error variance matrix which has decisive effects on standard methods of estimation and inference in such models. The consequences are higher rates of convergence and non pivotal limit theory in certain directions for estimators such as FM-OLS. Notwithstanding these effects, we show that FM-OLS Wald tests are invariant to singularity under well defined rank conditions and, when those conditions fail, the tests are conservative in certain cases. In particular, simulation experiments show that in such situations the test rejection rates under the null hypothesis are far below nominal levels based on standard asymptotics in singular and near singular cases. We illustrate our methods by analyzing the fiscal sustainability of the US government, testing the hypothesis that government revenue and expenditure are strongly cointegrated with coefficient $(1,-1)$, where multicointegration naturally arises if bounds are imposed on deviations of debt from revenue.

The results obtained here motivate the development of new robust approaches to estimating cointegrating relationships that allow for the possible presence of multicointegration and that are pivotal in the presence of the singularity it produces. This is an ongoing area of research by the authors.

Acknowledgments

This paper has origins in a 2011 Yale Take Home Examination. For various and non-overlapping parts of this research Kheifets acknowledges support from the Russian Science Foundation under project 20-78-10113 (Monte Carlo simulations and the fiscal sustainability evaluation) and the Spanish Ministerio de Ciencia, Innovacion y Universidades under Grant ECO2017-86009-P (econometric theory). Phillips acknowledges support from the National Science Foundation under Grant SES 18-50860 and a Kelly Fellowship at the University of Auckland. This research was supported in part through computational resources of HPC facilities at HSE University.