Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
96,845 characters · 14 sections · 121 citation commands
The Local Projection Residual Bootstrap for AR(1) Models
KEYWORDS: Bootstrap, Local Projection, Uniform Inference, Asymptotic Refinements.
\thispagestyle{empty}
\setcounter{page}{1} \onehalfspacing
This paper contributes to a growing literature on confidence interval construction for impulse response coefficients based on the local projection (LP) approach (Jorda2005). In this literature, the LP approach estimates an impulse response coefficient as one of the slope coefficients in a linear regression of a future outcome on current or lag-augmented covariates (ramey2016macroeconomic; NakamuraSteinsson2018; MO-PM2020). Recent theoretical results exist for the asymptotic validity of the confidence intervals constructed around the LP estimator, which hold over a large class of vector autoregressive models (xu2022). Since these confidence intervals have small-sample coverage distortions (e.g., coverage probability is lower than expected), their bootstrap versions are recommended for practical use. However, theoretical results for these bootstrap versions are unknown, even for the AR(1) model. This paper proposes a different bootstrap method to construct LP confidence intervals with theoretical guarantees for a class of AR(1) models that allow for a unit root, conditional heteroskedasticity of unknown form, and martingale difference shocks.
We propose an LP-residual bootstrap method to construct confidence intervals for impulse response coefficients of AR(1) models. Our bootstrap method is based on the LP approach and involves a residual bootstrap procedure applied specifically to AR(1) models.\footnote{Section (ref) presents the LP-residual bootstrap for VAR(p) models, but its theoretical properties are unknown and left for future research; see Remarks (ref) and (ref) for further discussion. Appendix (ref) reports a Monte Carlo simulation for the LP-residual bootstrap for vector autoregressive models.} Our bootstrap confidence intervals are centered at the LP estimator and use heteroskedasticity-consistent (HC) standard errors and a bootstrap critical value. Section (ref) presents the details.
We rely on the asymptotic distribution theory initially developed in MO-PM2020 and generalized in xu2022. In their framework, a root $R_n(h)$ based on the LP approach can be defined for a given horizon $h$ and a sample size $n$. Here, by a root we refer to a real-valued function depending on the data and an impulse response coefficient. Their results guarantee the root $R_n(h)$ is asymptotically distributed as a standard normal distribution for a class of VAR models that allow for multiple unit roots and conditional heteroskedasticity of unknown form\textcolor{black}{, and even at intermediate horizons, i.e., horizons $h$ that are allowed to grow with $n$, e.g., $h = h_n \propto n^{\zeta}$, $\zeta \in [0,1)$}. As a result, the root $R_n(h)$ can be used to construct a confidence interval $C_n(h, 1-\alpha)$ for an impulse response coefficient using a normal critical value (quantile of the asymptotic distribution). Furthermore, $C_n(h, 1-\alpha)$ has asymptotic coverage equal to the nominal level $1-\alpha$ uniformly over the parameter space (VAR model coefficients) and \textcolor{black}{a wide range of} intermediate horizons (e.g., \textcolor{black}{uniform over $h \le h_n$, where $h_n$ is any fixed sequence such that $h_n = o(n)$}). Nevertheless, Monte Carlo simulations report \textcolor{black}{that} $C_n(h, 1-\alpha)$ has a lower coverage probability than expected.
We propose the LP-residual bootstrap method to approximate the distribution of the root $R_n(h)$ as an alternative to the asymptotic distribution. We use our approximation to calculate bootstrap-based critical values; see Section (ref) for the step-by-step procedure. Specifically, we construct a confidence interval $C_n^*(h,1-\alpha)$ for an impulse response coefficient using the root $R_n(h)$ and a bootstrap critical value; see Section (ref) for details.
Our first result proves the uniform consistency of the LP-residual bootstrap. More concretely, we demonstrate in Section (ref) that the distribution of the root $R_n(h)$ can be approximated by its bootstrap version uniformly over the parameter space (e.g., $\rho \in [-1,1]$) and \textcolor{black}{a wide range of} intermediate horizons (e.g., \textcolor{black}{uniform over $h \le h_n$, where $h_n$ is any fixed sequence such that $h_n = o(n)$}). Our result applies to a large class of AR(1) models that allow for a unit root, conditional heteroskedasticity of unknown form as in gonccalves2004bootstrapping, which includes ARCH and GARCH shocks, and a sequence of shocks that satisfy the martingale difference assumption. To obtain this result, we prove the root $R_n(h)$ is asymptotically distributed as a standard normal distribution for sequences of AR(1) models with i.i.d. shocks (Theorem (ref)). In particular, we prove that a high-level assumption (Assumption 3 in MO-PM2020corrigendum and Assumption 4 in xu2022) necessary for the theoretical properties of $C_n(h,1-\alpha)$ can be verified for sequences of AR(1) models with i.i.d. shocks (Proposition (ref)).
Our first result implies that the LP-residual bootstrap method provides asymptotically valid confidence intervals over a large class of AR(1) models that allow for a unit root, conditional heteroskedasticity of unknown form (e.g., GARCH shocks), and martingale difference shocks. Moreover, our confidence interval $C_n^*(h,1-\alpha)$ has an asymptotic coverage equal to the nominal level $1-\alpha$ uniformly over $\rho \in [-1,1]$ and \textcolor{black}{a wide range of} intermediate horizons.
Our second set of results shows that the LP-residual bootstrap provides asymptotic refinements to the confidence intervals on a more restricted class of AR(1) models (e.g., \textcolor{black}{$|\rho|\le 1-a$, where $a \in (0,1)$,} \textcolor{black}{and} i.i.d. shocks \textcolor{black}{with} positive continuous density), that is, the size of the error in coverage probability (ECP) of $C_n^*(h,1-\alpha)$ is $o(n^{-1})$, whereas the size of the ECP of $C_n(h,1-\alpha)$ is $O(n^{-1})$. More concretely, Theorem (ref) shows the ECP of $C_n^*(h,1-\alpha)$ is $o(n^{-(1+\epsilon)})$ for some $\epsilon \in (0,1/2)$. To obtain these results, we derive Edgeworth expansions for the distribution of the root $R_n(h)$ and its bootstrap version for a fixed $h$ and \textcolor{black}{$|\rho| \le 1-a$, where $a \in (0,1)$; that is, the Edgeworth expansions are obtained for stationary AR(1) models and fixed horizons}. An informal discussion to calculate the size of the ECP using Edgeworth expansions appears in Section (ref), while the formal results are established in Section (ref).
Other bootstrap methods to construct confidence intervals for the impulse response coefficients have been considered and recommended based on simulation studies in the growing literature on LP inference. MO-PM2020 use a wild bootstrap procedure to generate new samples and compute critical values, but the theoretical results for their bootstrap method are unknown. KilianKim2011 present a simulation study including a block-bootstrap method to construct confidence intervals based on the LP approach, but the theory of their block-bootstrap method is unknown; see Remarks (ref) and (ref) for alternative block-bootstrap procedures with theoretical guarantees. Recently, lusompa2021local proposes a block wild bootstrap method for confidence interval construction that is point-wise valid for a class of stationary data-generating processes; however, his bootstrap method is not applicable for an AR(1) model with a unit root. In contrast, we present a bootstrap method based on the LP approach with theoretical guarantees for a class of AR(1) models that allow for a unit root, conditional heteroskedasticity of unknown form, and martingale difference shocks.
More broadly, we contribute to the literature on confidence interval construction for impulse response coefficients. For short horizons (fixed $h$), the problem of confidence interval construction has been studied by andrews1993exactly, hansen1999grid, inoue2002bootstrapping, Jorda2005, Mikusheva2007,mikusheva2015second, among others. For long horizons ($\textcolor{black}{h} \textcolor{black}{=} h_n \textcolor{black}{\propto} (1-b)n$, $b \in (0,1)$), the problem of confidence interval construction was \textcolor{black}{discussed} and revised by \textcolor{black}{phillips1998impulse}, gospodinov2004asymptotic, pesavento2006small, and Mikusheva2012 since the \textcolor{black}{standard} methods for short horizons \textcolor{black}{may} produce invalid confidence intervals when the data-generating process allows for unit roots. Recently, the problem of confidence interval construction for intermediate horizons ($h_n = o\left(n\right)$) was addressed in MO-PM2020 and xu2022, which was a case not covered in the literature. In this paper, we propose bootstrap confidence intervals that are asymptotically valid at short and intermediate horizons.
\textcolor{black}{ We also contribute to the literature on uniform inference in autoregressive models, where the confidence intervals for impulse response coefficients are uniformly valid, that is, they have an asymptotic coverage equal to the nominal level uniformly over the parameter space (e.g., uniformly over $ \rho \in [-1,1]$ for the AR(1) model). Mikusheva2007,Mikusheva2012 shows that the grid bootstrap proposed by hansen1999grid provides confidence sets that are uniformly valid for the impulse responses when the sequence of shocks is a martingale difference sequence with constant conditional variance. However, it is unknown if the grid bootstrap is uniformly valid for AR(1) models with GARCH shocks; we report simulations for the grid bootstrap in Section (ref) and Online Supplemental Appendix (ref). InoueKillian2020 show that confidence intervals based on a lag-augmented autoregressive method are uniformly valid for impulse response coefficients when the sequence of shocks is i.i.d. It is unknown if their results hold for martingale difference shocks. MO-PM2020 and xu2022 show that confidence intervals based on (lag-augmented) local projections are uniformly valid for impulse response coefficients; nevertheless, Monte Carlo simulations report lower coverage probability than expected. In contrast, our bootstrap method produces confidence intervals that are uniformly valid for a larger class of martingale difference shocks with conditional heteroskedasticity of unknown form (allowing for GARCH shocks). }
The remainder of the paper is organized as follows. In Section (ref), we describe the setup and previous results. In Section (ref), we introduce our bootstrap confidence interval and the LP-residual bootstrap. In Sections (ref) and (ref), we study the theoretical properties of the LP-residual bootstrap: uniform consistency and asymptotic refinements. In Section (ref), we investigate the numerical performance of the LP-residual bootstrap using a small simulation study. In Section (ref), we describe how to implement the LP-residual bootstrap for VAR models. Finally, in Section (ref), we present concluding remarks. All the proofs are presented in Appendices (ref) and (ref), and \textcolor{black}{Online} Supplemental Appendices (ref) and (ref). Additional simulation results appear in \textcolor{black}{Online} Supplemental Appendix (ref).
Consider an AR(1) model,
Denote the impulse response coefficient at horizon $h \in \mathbf{N}$ by
An estimator for $\beta(\rho,h)$ based on the LP approach is obtained as the slope coefficient of $y_t$ in the linear regression of $y_{t+h}$ on $y_t$ and $y_{t-1}$,
where $(\hat{\beta}_n(h),~\hat{\gamma}_n(h))$ and $\{\hat{\xi}_t(h): 1 \le t \le n-h\}$ are the coefficient vector and residuals of the linear regression (ref), respectively. This lag-augmented LP approach was developed in MO-PM2020, where they give conditions under which the coefficient $\hat{\beta}_n(h)$ consistently estimates $\beta(\rho,h)$. Equation (ref) is a lag-augmented LP regression since the coefficient on $y_{t-1}$ is known to be zero under (ref); see Remark (ref) for additional details on this LP approach.
Let $\hat{s}_n(h)$ be the heteroskedasticity-consistent (HC) standard error of $\hat{\beta}_n(h)$ in the lag-augmented LP regression (ref), which can be computed as follows
where $\hat{u}_t(h) \equiv y_t- \hat{\rho}_n(h) y_{t-1}$ and
For a given $h \in \textbf{N}$, we consider the following real-valued root for the parameter $\beta(\rho,h)$:
where $\beta(\rho,h)$ is as in (ref), $\hat{\beta}_n(h)$ is computed as in (ref), and $\hat{s}_n(h)$ is as in (ref). We denote the distribution of the root $R_n(h)$ by
where $x \in \mathbf{R}$, $h \in \textbf{N}$, $P$ is the distribution of the shocks $\{u_t: t \ge 1 \}$, $\rho \in \textbf{R}$, and $P_{\rho}$ denote the probability distribution of the sequence $\{y_t: t \ge 1\}$, which is defined jointly by the distribution $P$ and the parameter $\rho$ in (ref).
Let $c_n(h,1-\alpha)$ be the $1-\alpha$ quantile of $|R_n(h)|$ under the distribution $P_{\rho}$,
Ideally, we would use the root $R_n(h)$ and the critical value $c_n(h,1-\alpha)$ to construct confidence sets for $\beta(\rho,h)$ with a coverage probability of 1-$\alpha$. That is collecting all the parameters $\beta(\rho,h)$ such that $|R_n(h)| \le c_n(h,1-\alpha)$, which is equivalent to defining the next confidence interval
However, the critical value $c_n(h,1-\alpha)$ is unknown since the distribution of the root is unknown in general. As a result, the confidence interval $\tilde{C}_n(h,1-\alpha) $ is infeasible. For this reason, it is common to approximate the distribution of the root $R_n(h)$ relying on asymptotic distribution theory or bootstrap methods to approximate the infeasible $c_n(h,1-\alpha)$.
The asymptotic distribution theory developed in MO-PM2020 and xu2022 implies that the distribution $J_n(x,h,P,\rho)$ converges to the standard normal distribution $\Phi(x)$ whenever certain assumptions on the distribution of the shocks $P$ hold. Moreover, this convergence is uniform over the values of $\rho \in [-1,1]$ and \textcolor{black}{a wide range of} intermediate horizons, that is
where \textcolor{black}{$h_n$ is any fixed sequence such that} $h_n \le n$ and $h_n = o\left(n\right)$. Assumptions (ref) and (ref) in Section (ref) are sufficient conditions on the distribution $P$ to obtain (ref) due to Theorem 2 in xu2022.
The confidence interval for $\beta(\rho,h)$ based on asymptotic distribution theory is defined as
where $z_{1-\alpha/2} \equiv \Phi^{-1}(1-\alpha/2)$ is the $1-\alpha/2$ quantile of the standard normal distribution. The result in (ref) implies that \textcolor{black}{the} confidence interval $C_n(h,1-\alpha)$ is uniformly asymptotically valid in the sense that its asymptotic coverage probability is equal to the nominal level $1-\alpha$ uniformly over $\rho$ and \textcolor{black}{a wide range of intermediate horizons} $h$,
where \textcolor{black}{$h_n$ is any fixed sequence such that} $h_n \le n$ and $h_n = o\left(n\right)$. Three features of $C_n(h,1-\alpha)$ deserve further discussion. First, it is simpler to compute than \textcolor{black}{the} available alternatives in the sense that it does not require any tuning parameter. It is common to use heteroskedasticity- and autocorrelation-robust (HAR) standard errors for inference whenever we have dependent data. The major complication of HAR standard errors is the choice of the (truncation) tuning parameter; see lazarus2018har. In contrast, the HC standard errors $\hat{s}_n(h)$ defined in (ref) are simple to compute and sufficient for inference under certain conditions on the distribution $P$; see Remark (ref) for further explanation. Second, the uniform asymptotic validity of the confidence interval $C_n(h,1-\alpha)$ avoids pre-testing procedures about the nature of the data-generating process ($|\rho|<1$ vs $\rho=1$) that can distort inference; see Mikusheva2007. In particular, inference using $C_n(h,1-\alpha)$ holds regardless of the value of $\rho \in [-1,1]$. Third, the confidence interval $C_n(h,1-\alpha)$ has theoretical guarantees at intermediate horizons (e.g., \textcolor{black}{$h=h_n \propto n^{\zeta}$, $\zeta \in (0,1)$}). This is an important feature for inference on impulse response coefficients at intermediate horizons. Other methods to construct confidence intervals that work at short horizons ($h$ fixed) may have problems at long and intermediate horizons; see \textcolor{black}{phillips1998impulse}, gospodinov2004asymptotic, pesavento2006small, Mikusheva2012, and MO-PM2020 for additional discussion.
This paper proposes an LP-residual bootstrap for confidence interval construction. Our confidence interval for the impulse response coefficient $\beta(\rho,h)$ is defined as
where $\hat{\beta}_n(h)$ is an estimator for $\beta(\rho,h)$ defined in (ref), $\hat{s}_n(h)$ is its heteroskedasticity-consistent (HC) standard error defined in (ref), and $c_n^*(h, 1-\alpha)$ is a bootstrap critical value defined in (ref).
Let $Y^{(n)} \equiv \{y_t : 1 \le t \le n\}$ be data generated by (ref). Let $c_n^*(h, 1-\alpha)$ be the bootstrap critical value involving the following steps:
We named this procedure the LP-residual bootstrap due to steps 2 and 3. Step 2 generates bootstrap samples based on the estimated model and a residual bootstrap procedure. Step 3 computes the bootstrap version of the root based on the lag-augmented LP regression. To our knowledge, this bootstrap procedure is new; see Remark (ref) and (ref) for other bootstrap procedures involving roots based on LP estimators.
We use the bootstrap critical value $c_n^{*}(h, 1-\alpha)$ in the construction of the confidence interval defined in (ref). The explicit formula in (ref) has two implications. First, the bootstrap critical value $c_n^{*}(h, 1-\alpha)$ depends on the data, the sample size $n$, and the horizon $h$. Second, we can compute $c_n^{*}(h, 1-\alpha)$ with perfect accuracy whenever we use the exact empirical distribution of the centered residuals defined in (ref). However, the computation of an exact distribution can be computationally demanding; therefore, it is common to approximate it using Monte Carlo procedures as we describe in Remark (ref), which has a theoretical justification due to the Glivenko–Cantelli theorem.
We show the uniform consistency of the LP-residual bootstrap (Theorem (ref)) and that our proposed bootstrap confidence interval $C_n^*(h,1-\alpha)$ defined in (ref) is uniformly asymptotically valid (Theorem (ref)). In what follows, we first present and discuss the assumptions, and we then establish the results.
The following assumption imposes restrictions on the distributions of the shocks $P$. These assumptions are based on the general framework developed by xu2022 that generalized the work of MO-PM2020.
Part (i) of Assumption (ref) assumes the shocks are a martingale difference sequence. This assumption allows for uncorrelated dependent shocks and implies that the shock $u_t$ is uncorrelated with $y_{t-1}$. Part (ii) in Assumption (ref) includes a large class of conditional heteroskedastic autoregressive models (e.g., ARCH and GARCH shocks), and it has been common in the literature; for instance, gonccalves2004bootstrapping use a similar assumption (Assumption A') to prove the asymptotic consistency of the wild bootstrap for autoregressive processes. Moreover, this assumption implies that the process $\{ \xi_t(\rho,h) u_t : 1 \le t \le n-h \}$ is serially uncorrelated, where $\xi_t(\rho,h) \equiv \sum_{\ell=1}^{h} \rho^{h-\ell} u_{t+\ell}$, which is important for the use of HC standard errors as we discussed in Remark (ref). Part (iii) and (iv) of Assumption (ref) are mild regularity conditions on the distribution of the shocks $P$ to establish uniform bounds of approximation errors, which can be relaxed if stronger assumptions are imposed over the serial dependence of the shocks; see Assumption (ref) in Appendix (ref).
The next assumption is a high-level assumption and imposes additional restrictions on the distributions of the shocks $P$.
This assumption implies that the estimator $\hat{\rho}_n(h)$ defined in (ref) is well-behaved in the sense that its denominator after scaled by the factor $g(\rho,n-h)$ converges to a strictly positive limit. As a result, we can replace the residual $\hat{u}_t(h) \equiv y_t - \hat{\rho}_n(h)y_{t-1}$ by the shock $u_t$, which implies the second and third implication discussed in Remark (ref). We show in Proposition (ref) that Assumption (ref) can be verified if the shocks are i.i.d. and satisfied mild regularity conditions (Assumption (ref)). In Appendix C of MO-PM2020, this assumption is verified for AR(1) models whenever a contiguity condition holds.
Assumptions (ref) and (ref) guarantee that the distribution $J_n(\cdot,h,P,\rho)$ defined in (ref) can be approximated by the standard normal distribution $\Phi(\cdot)$ uniformly on $\rho \in [-1,1]$ and \textcolor{black}{a wide range of horizons} $h$ as in (ref). Let $\hat{P}_n$ be the empirical distribution of the centered residuals defined in (ref) and let $\hat{\rho}_n$ be the estimator of $\rho$ defined in (ref). Using this notation $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ is the distribution of the bootstrap root $R_{b,n}^*(h)$ defined in (ref) conditional on the data $Y^{(n)}$. The next theorem shows that the distribution $J_n(\cdot,h,P,\rho)$ can be approximated by the bootstrap distribution $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ uniformly on $\rho \in [-1,1]$ and \textcolor{black}{a wide range of} intermediate horizons (e.g., \textcolor{black}{uniform over $h \le h_n$, where $h_n$ is any fixed sequence such that $h_n = o(n)$}), i.e., the LP-residual bootstrap is uniformly consistent.
Theorem (ref) shows that the LP-residual bootstrap is uniformly consistent, i.e., the bootstrap distribution $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ approximates the distribution $J_n(\cdot,h,P,\rho)$ uniformly over the parameter space ($\rho \in [-1,1]$) and \textcolor{black}{a wide range of} intermediate horizons ($h \le h_n)$. Two features of this uniform approximation result deserve further discussion. First, uniform consistency of bootstrap methods over the parameter spaces of autoregressive models is not just a technical detail but a crucial property to guarantee reliable inference methods; see Mikusheva2007. Otherwise, it is possible to obtain for any sample size $n$ a parameter $\rho_n$ such that the distance between the distributions $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ and $J_n(\cdot,h,P,\rho)$ is far from zero. Second, the uniform approximation over the horizons is necessary for inference purposes at intermediate horizons. Other valid methods for a fixed $h$ do not necessarily work for $h$ growing with the sample size.
The proof of Theorem (ref) is presented in Appendix (ref). It has two main ideas. First, we show that the approximation result presented in (ref) also holds for sequences of AR(1) models with i.i.d. shocks (Theorem (ref)),
where $\mathbf{P}_{n,0}$ denotes the set of all distributions that satisfy Assumption (ref) in Appendix (ref), $h_n$ is as in Theorem (ref), $J_n(\cdot,h,P,\rho)$ is as in (ref) and $\Phi(\cdot)$ is the standard normal distribution. Assumption (ref) imposes stronger restrictions on the dependence of the shocks (i.i.d.) and some mild regularity conditions. The formal result is presented in Appendix (ref) as Theorem (ref). Second, we show that Assumptions (ref) and (ref) imply the existence of a sequence of events $E_n$ with probability approaching 1 such that the empirical distributions $\hat{P}_n $ conditional on the event $E_n$ verify Assumption (ref). In other words, we show that $\hat{P}_n \in \mathbf{P}_{n,0}$ holds with a probability approaching 1. The construction of the events $E_n$ relies on Lemma (ref) in Appendix (ref). We use the previous two ideas to approximate the distribution $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ by the standard normal distribution $\Phi(\cdot)$ conditional on the event $E_n$. Finally, we conclude that the distributions $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ and $J_n(\cdot,h,P,\rho)$ are asymptotically close since both have the same asymptotic limit.
The next result shows that the confidence interval $C_n^*(h,1-\alpha)$ defined in (ref) is uniformly asymptotically valid in the sense that its asymptotic coverage probability is equal to $1-\alpha$ uniformly over $\rho$ and \textcolor{black}{a wide range of horizons} $h$.
Theorem (ref) provides the theoretical justification to conduct inference on the impulse response coefficient $\beta(\rho,h)$ using our bootstrap confidence interval $C_n^*(h,1-\alpha)$. Note that the only difference with respect to the confidence interval $C_n(h,1-\alpha)$ defined in (ref) is the critical value, which was equal to $z_{1-\alpha/2}$. The critical value $z_{1-\alpha/2}$ was the same for different sample sizes $n$ and horizons $h$. Instead, we now use a critical value $c_n^*(h,1-\alpha)$ that depends on the data, the sample size, and the horizon. We evaluate the difference in coverage probability between the confidence intervals $C_n(h,1-\alpha)$ and $C_n^*(h,1-\alpha)$ using simulations in Section (ref). The simulation results provide evidence that the coverage probability of our proposed confidence interval $C_n^*(h,1-\alpha)$ is closer to $1-\alpha$ than that of $C_n(h,1-\alpha)$.
The proof of Theorem (ref) is presented in Appendix (ref). It only relies on the uniform consistency of the bootstrap procedure. We next sketch the main arguments of the proof. We first note that (ref) is equivalent to $$ \sup_{|\rho|\le 1} ~ \sup_{h \le h_n} \left| P_{\rho} \left( |R_n(h)| \le c_n^*(h,1-\alpha) \right) - (1-\alpha) \right| \to 0 \quad \text{as} \quad n \to \infty~. $$ We then use that the bootstrap critical value $c_n^*(h,1-\alpha)$ is included in $[z_{1-\alpha/2 -\epsilon},~z_{1-\alpha/2 +\epsilon}]$ with a probability approaching 1 for arbitrary $\epsilon>0$; see Lemma (ref) in Appendix (ref). This result is possible because the root $R_n(h)$ is asymptotically normal and the LP-residual bootstrap is uniformly consistent. Third, we can conclude using algebra manipulation and the asymptotic normality of the root $R_n(h)$ that $$ \limsup_{n \to \infty} \sup_{|\rho|\le 1} \sup_{h \le h_n} \left| P_{\rho} \left( |R_n(h)| \le c_n^*(h,1-\alpha) \right) - (1-\alpha) \right| \le 2\epsilon ~,$$ which implies (ref) since $\epsilon>0$ was arbitrary.
\textcolor{black}{This section will impose conditions on the data-generating process that further restrict the class of AR(1) models relative to that considered in Section (ref), ruling out local-to-unity and unit-root models. These conditions are explicit in Theorems (ref) and (ref), where we calculate the sizes of the error in coverage probability (ECP) for the confidence intervals $C_n(h,1-\alpha)$ and $C_n^*(h,1-\alpha)$ defined in (ref) and (ref), respectively. The results of these theorems show that the LP-residual bootstrap can provide asymptotic refinements for confidence intervals, that is, the ECP of $C_n^{*}(h,1-\alpha)$ is $o(n^{-1})$, whereas the ECP of $C_n(h,1-\alpha)$ is $O(n^{-1})$.}
\textcolor{black}{Section (ref) first provides an informal discussion of the elements and challenges involved in obtaining asymptotic refinements for confidence intervals with the LP-residual bootstrap. Section (ref) then formalizes the discussion by giving conditions on the data-generating process (Assumption (ref) and $\rho \in [-1+a, 1-a] $ for a given $a \in (0,1)$) that are sufficient to establish these asymptotic refinements (Theorems (ref) and (ref)).}
\textcolor{black}{This section gives an informal exposition on how a bootstrap method can provide asymptotic refinements for confidence intervals when the root is asymptotically pivotal, i.e., the asymptotic distribution of the root does not depend on any unknown parameters.} The explanation below is not new; see hall1996bootstrap, Horowitz2001,Horowitz2019, and lahiri2003resampling. It has the purpose of introducing the main elements and challenges that arise to obtain asymptotic refinements \textcolor{black}{in the context of dependent data generated from an AR(1) model. It also describes the approach considered in this paper; see Remark (ref) for alternative methods. }
\textcolor{black}{Main elements: For the sake of exposition, suppose the root $R_n(h)$ has an Edgeworth expansion up to an error of size $o(n^{-1})$, that is, the distribution of the root $R_n(h)$ has an asymptotic expansion,
where $q_j(x,h,P,\rho)$ are polynomials in $x \in \textbf{R}$ such that (i) their coefficients are continuous function of moments of $P$ and $\rho$ and (ii) $q_j(x,h,P,\rho) = (-1)^{j+1} q_j(-x,h,P,\rho)$ for $j=1,2$. Similarly, suppose the bootstrap root $R_n^*(h)$ has an Edgeworth expansion,
where $J_n(x,h,\cdot,\cdot)$ is as in (ref), $\hat{P}_n$ is the empirical distribution of the centered residuals defined in (ref), and $\hat{\rho}_n$ is the estimator of $\rho$ defined in (ref).}
\textcolor{black}{ The approximations in (ref) and (ref) are commonly used to show that the bootstrap methods provide more accurate approximations than the asymptotic distribution theory; see Hall1992TheBA for a textbook reference for the case of i.i.d. data. We next sketch an informal calculation of the sizes of the ECP of the confidence intervals $C_n(h,1-\alpha)$ and $C_n^{*}(h,1-\alpha)$.}
\textcolor{black}{The coverage probability of $C_n(h,1-\alpha)$ is equal to $P_{\rho} \left( |R_n(h)| \le z_{1-\alpha/2} \right)$ by the definitions of $C_n(h,1-\alpha)$ and $R_n(h)$ in (ref) and (ref), respectively. Note that (ref) and the properties of $q_j(\cdot,h,P,\rho)$ imply that for any $x>0$, we have
Taking $x = z_{1-\alpha/2}$, we conclude the size of the ECP of $C_n(h,1-\alpha)$ is $O(n^{-1})$.}
\textcolor{black}{Similarly, the coverage probability of $C_n^*(h,1-\alpha)$ is equal to $P_{\rho} \left( |R_n(h)| \le c_n^*(h,1-\alpha) \right)$ by the definitions in (ref) and (ref). Now, we will argue that
where $c_n(h,1-\alpha)$ is as in (ref). This is sufficient to conclude that the size of the ECP of $C_n^*(h,1-\alpha)$ is $o(n^{-1})$ since $P_{\rho} \left( |R_n(h)| \le c_n(h,1-\alpha)\right) = 1-\alpha$ by definition. Using the properties of $q_j(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ and (ref), we obtain
where the last equality uses $q_2(x,h,\hat{P}_n,\hat{\rho}_n) = q_2(x,h,P,\rho) + o_p\left(1\right) $. Note that (ref) and (ref) looks similar. Taking $x = c_n(h,1-\alpha)$ in (ref) and $x = c_n^*(h,1-\alpha)$ in (ref), it can be conclude that $c_n^*(h,1-\alpha) = c_n(h,1-\alpha) + o_p\left(n^{-1}\right)$, which will imply (ref). }
\textcolor{black}{ The informal explanation presented above suggests that the LP-residual bootstrap can provide asymptotic refinements when there exist valid Edgeworth expansions as in (ref)-(ref). We present in Section (ref) conditions (Assumption (ref) and $\rho \in [-1+a, 1-a] $, where $a \in (0,1)$) under which the previous informal discussion can be formalized. }
\textcolor{black}{ The challenges: Edgeworth expansions as in (ref)-(ref) are not always available or valid in the context of AR(1) models. For instance, in the case of the local-to-unity and unit-root models, the Edgeworth expansion for the least-squares estimate of the AR(1) model defined in (ref) is no longer valid; see phillips2023estimation. In this case, alternative asymptotic approximations were developed to prove asymptotic refinements of the bootstrap, e.g., park2003bootstrap,park2006bootstrap and mikusheva2015second. To our knowledge, there are no available theoretical results about valid Edgeworth expansions for the root $R_n(h)$ defined in (ref) that can be applied directly.}
\textcolor{black}{ Nevertheless, for stationary AR(1) models (when $\rho \in [-1+a,1-a]$, $a \in (0,1)$), asymptotically valid Edgeworth expansions were obtained; see phillips1977approximations, phillips1977general, bose1988, among others. Therefore, we will restrict our analysis to stationary AR(1) models to obtain valid Edgeworth expansions for the root $R_n(h)$ and its bootstrap version $R_n^*(h)$ when $\rho \in [-1+a,1-a]$, $a \in (0,1)$, and $h$ is fixed.}
This section presents conditions under which the LP-residual bootstrap provides asymptotic refinements to the confidence interval. Under these conditions, we calculate the sizes of the ECP for $C_n(h,1-\alpha)$ and $C_n^*(h,1-\alpha)$ in Theorems (ref) and (ref), respectively.
The following assumption imposes stronger conditions on the distribution of the shocks $P$ than the ones presented in Assumption (ref). We use this assumption \textcolor{black}{and $\rho \in [-1+a, 1-a]$ for some $a \in (0,1)$} to formalize the informal explanation about asymptotic refinements presented in Section (ref).
Part (i) of Assumption (ref) imposes stronger conditions over the serial dependence of the shocks. This assumption is common for theoretical analysis of the asymptotic refinement of the bootstrap method in autoregressive models. An incomplete list of previous research that uses this assumption includes bose1988, park2003bootstrap,park2006bootstrap, and mikusheva2015second. Parts (ii) and (iii) of Assumption (ref) are sufficient technical conditions on the distribution of the shocks $P$ to establish the existence of the Edgeworth expansions presented in (ref)-(ref). Part (ii) implies that the distribution $J_n(\cdot,h,P,\rho)$ defined in (ref) is continuous and guarantees that a data-dependent version of the Cram\'er condition holds, which is a common condition to guarantee the existence of Edgeworth expansions; see Remark (ref) for further discussion. Part (iii) implies that any sufficiently large number of moments exist and are uniformly bounded by a function of the constant $c_u$, which is important to guarantee the Edgeworth expansion for the bootstrap distribution $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$. Although this condition is strong, it is not atypical in the literature of the asymptotic refinement of the bootstrap method with dependent data; for instance, hall1996bootstrap and inoue2006bootstrapping assume the existence of 33rd and 36th moments, respectively, while andrews2002higher assumes that all the \textcolor{black}{moments exist}.
We rely on Assumption (ref), the approach and results presented in bhattacharya1978validity and bhattacharya1987some, and the general framework developed by GotzeHipp1983 to prove the existence of Edgeworth expansions with dependent data. The framework of GotzeHipp1983 requires weakly dependent data and verifying stronger regularity conditions than the ones needed in the case of i.i.d. data; see Hall1992TheBA and lahiri2003resampling for textbook references. Therefore, we restrict our analysis to data-generating processes with weak dependence (e.g., $|\rho| \le 1-a$ for some $a \in (0,1)$) in a similar way to previous research on asymptotic refinements involving dependent data that includes bose1988, hall1996bootstrap, lahiri1996edgeworth, andrews2002higher, andrews2004block, and inoue2006bootstrapping. It is an open question whether there exist Edgeworth expansions as in (ref)-(ref) for the case \textcolor{black}{of local-to-unity or unit-root models}. See Remark (ref) for further discussion on alternative methods and available results.
The ECP of $C_n(h,1-\alpha)$ has a similar size as the one derived in our informal explanation in Section (ref). Similar sizes of the ECP were obtained for symmetrical confidence intervals in the i.i.d. data case; see Hall1992TheBA and Horowitz2001, Horowitz2019.
The proof of Theorem (ref) is presented in Appendix (ref). It uses two main ideas developed previously in the literature. First, we approximate the distribution $J_n(\cdot,h,P,\rho)$ by another distribution $\Tilde{J}_n(\cdot,h,P,\rho)$ up to an error of size $O\left(n^{-1-\epsilon}\right)$ for a fixed $\epsilon \in (0,1/2)$; similar approach has been used in hall1996bootstrap and andrews2002higher, andrews2004block. Second, we use that the distribution $\Tilde{J}_n(\cdot,h,P,\rho)$ admits an Edgeworth expansion up to an error of size $O\left(n^{-3/2}\right)$ based on the results of bhattacharya1978validity and GotzeHipp1983,gotze1994asymptotic; see Theorem (ref) in Appendix (ref). These two ideas guarantee the existence of the Edgeworth expansion presented in (ref). We then conclude the proof by standard derivations similar to the one derived in our informal explanation presented in Section (ref).
The next theorem shows that the LP-residual bootstrap provides asymptotic refinements to the confidence intervals. In other words, the size of the ECP of our bootstrap confidence interval defined in (ref) for $\beta(\rho,h)$ is $o(n^{-1})$.
Theorem (ref) presents the size of the ECP of the confidence interval $C_n^*(h,1-\alpha)$ in (ref). This is similar to the one derived in our informal explanation in Section (ref), but it is typically larger than those obtained for the ECP of symmetrical confidence intervals using bootstrap methods in the i.i.d. data case; see Hall1992TheBA and Horowitz2001, Horowitz2019.
The proof of Theorem (ref) is presented in Appendix (ref). It relies on two claims: the existence of the Edgeworth expansion for the distribution $J_n(\cdot,h,P,\rho)$ and the existence of constants $C_1$ and $C_2$ such that $P_{\rho}(|\Delta_n| > C_1 n^{-(1+\epsilon)} ) \le C_2 n^{-(1+\epsilon)} $, where $\Delta_n = c_n^*(h,1-\alpha)-c_n(h,1-\alpha)$, and $c_n(h,1-\alpha)$ and $c_n^*(h,1-\alpha)$ are defined in (ref) and (ref), respectively. We next sketch the proof based on those two claims. We can derive
where the last equality follows from the existence of the Edgeworth expansion for the distribution $J_n(\cdot,h,P,\rho)$ (our first claim), which implies $$ P_{\rho} \left( |R_n(h)| \le c_n(h,1-\alpha) + O\left( n^{-(1+\epsilon)} \right) \right) = 1-\alpha + O\left( n^{-(1+\epsilon)} \right)~.$$ Note that the first claim follows from Theorem (ref). To prove our second claim, we first show that there is an event $E_n$ such that (i) $J_n(\cdot,h,\hat{P}_n,\hat{\rho}_n)$ has an Edgeworth expansion as in (ref) conditional on $E_n$ and (ii) the probability of the complement of $E_n$ is equal to $O\left(n^{-(1+\epsilon)}\right)$ for any $\epsilon \in (0,1/2)$; see Lemma (ref) in Appendix (ref). We then follow standard arguments in the literature to prove this claim. Finally, note that $O(n^{-(1+\epsilon)})$ for any $\epsilon \in (0,1/2)$ is equivalent to $o(n^{-(1+\epsilon)})$ for any $\epsilon \in (0,1/2)$, which is the error stated in Theorem (ref).
We examine the finite sample performance of $C_n^*(h,1-\alpha)$ defined in (ref) using different data-generating processes. We consider a sample size $n = 95$, which is the median sample size based on 71 papers that have utilized the LP approach; see herbst2024bias. Additionally, we examine other confidence intervals presented in the paper.
We use four designs for the distribution of the shocks $\{u_t:1 \le t \le n\}$ and two values for the parameter $\rho \in \{0.95, 1\}$ in our Monte Carlo simulation. The shocks are defined according to the GARCH(1,1) model:
where the distribution of $v_t$ and the parameter vector $(\omega_0,\omega_1,\omega_2)$ are specified as follows:
We consider nine different confidence intervals for each design and each value of $\rho$. All our confidence intervals use the HC standard errors $\hat{s}_n(h)$ defined in (ref). Additionally, we consider alternative HC standard errors $\hat{s}_{j,n}(h)$ defined as
for $j=2,3$, where $\hat{\xi}_{2,t}(h)^2 = \hat{\xi}_{t}(h)^2/(1-\mathbb{P}_{h,tt})$ and $\hat{\xi}_{3,t}(h)^2 = \hat{\xi}_{t}(h)^2/(1-\mathbb{P}_{h,tt})^2$. We use the projection matrix $\mathbb{P}_h = \mathbb{X}_h (\mathbb{X}_h'\mathbb{X}_h)^{-1}\mathbb{X}_h'$, where $\mathbb{X}_h$ is a matrix with row elements equal to $(\hat{u}_t(h),~ y_{t-1})$ for $t=1,\ldots,n-h$. The confidence intervals that we use are listed below\textcolor{black}{.}
In all the designs, the shocks have zero mean and variance one. Designs 1-2 verify Assumption (ref) presented in Section (ref). Design 1 also verifies Assumption (ref) due to Proposition (ref) in Appendix (ref). Assumption (ref) can be tedious to verify in general since it involves computing a probability for all the parameters $\rho$ in the parameter space and taking their infimum. In contrast, designs 3-4 do not verify all the parts of Assumption (ref). Design 3 considers shocks without a fourth moment, i.e., it does not verify part (iv) of Assumption (ref), which was a regularity condition. Design 4 considers a distribution of the shocks (GARCH errors with asymmetric $v$ and nonzero skewness) that lie outside the class of conditional heteroskedastic processes that we consider in this paper, i.e., it does not verify part (ii) of Assumption (ref). As we discussed in Remark (ref), part (ii) of Assumption (ref) was a sufficient condition for the validity of the HC standard errors $\hat{s}_n(h)$ in the construction of confidence intervals.
Tables (ref) and (ref) report the coverage probabilities (in %) of our simulations. Columns are labeled as the confidence intervals we specified in Section (ref). For all the designs on the distribution of the shock and values of $\rho$, we use 5000 simulations to generate data with a sample size $n = 95$ based on the AR(1) model (ref). In each simulation, we compute the nine confidence intervals described above for horizons $h \in \{1,6,12,18\}$. The confidence intervals have a nominal level equal to $1-\alpha = 90\%$. The bootstrap critical values are computed using $B=1000$ as described in Remark (ref). We summarize our findings from the simulations below.
Five features of Table (ref) deserve discussion. First, it shows that our recommended confidence interval RB has a coverage probability closer to 90% than the confidence intervals AA, $\text{AA}_{hc2}$, and $\text{AA}_{hc3}$ for all the designs 1-2, values of $\rho$, and horizons $h$, with some few exceptions. The lowest coverage probability of RB, AA, \textbf{$\text{AA}_{hc2}$}, and \textbf{$\text{AA}_{hc3}$} are $85\%$, $77\%$, $78\%$, and $79\%$, respectively, and occur when $\rho=1$ and horizon $h=18$. Second, \textbf{RB} and \textbf{$\text{RB}_{hc3}$} have better performance than \textbf{$\text{RB}_{per-t}$}, especially when $\rho = 1$ and the horizon is a significant fraction of the sample size ($h \in \{12,18\}$). Third, \textbf{WB} and \textbf{$\text{WB}_{per-t}$} have larger coverage probability than \textbf{RB} for all the designs 1-2, values of $\rho$, and horizons $h$, with some few exceptions. The larger coverage of \textbf{WB} and \textbf{$\text{WB}_{per-t}$} is associated with a larger median length of their confidence intervals, as we reported in Table (ref) in \textcolor{black}{Online Supplemental} Appendix (ref). Fourth, \textbf{$\text{AA}_{hc3}$} presents a coverage probability closer to $90\%$ and larger than \textbf{AA} and \textbf{$\text{AA}_{hc2}$} for all the designs 1-2, values of $\rho$, and horizons $h$. This finding suggests that using $\hat{s}_{3,n}(h)$ instead of $\hat{s}_n(h)$ can improve the coverage probability of the confidence interval; however, confidence intervals based on bootstrap methods (e.g., \textbf{RB} and \textbf{$\text{WB}_{per-t}$}) report coverage probability closer to $90\%$. Fifth, \textbf{$\text{GB}_{LR}$} has a coverage probability close to 90% on design 1 (i.i.d. shocks), while it has some distortions on design 2 that are larger on $\rho = 0.95$. As we mentioned in Remark (ref), it is unknown if the grid bootstrap is valid for design 2. The coverage probability of \textbf{$\text{GB}_{LR}$} is constant across horizons because the LR statistic is invariant to monotonic transformations; see Section 4.3 and footnote 6 on Mikusheva2012 for more details.
Table (ref) presents results for designs 3-4. Our findings for design 3 are qualitatively similar to Table (ref), which was discussed above. This suggests that failing part (iv) of Assumption (ref) (a regularity condition) does not have a major effect on the coverage probability of the confidence intervals that we considered. In contrast, design 4 shows that some of our qualitative findings can change if we fail to verify part (ii) of Assumption (ref). This result is consistent with existing theory since this assumption was a sufficient condition for the validity of confidence intervals that use HC standard errors $\hat{s}_n(h)$; see Remark (ref). In particular, $\text{RB}_{per-t}$ has a coverage probability closer to $90\%$ and larger than RB and $\text{RB}_{hc3}$. The small sample size ($n=95$) does not explain the findings for design 4. We obtain similar results for a sample size $n=240$ in Table (ref) in \textcolor{black}{Online Supplemental} Appendix (ref).
Finally, Table (ref) in \textcolor{black}{Online Supplemental} Appendix (ref) reports the statistical power of the confidence intervals specified in Section (ref). Here, we refer by statistical power to the coverage probabilities (in %) of (size-adjusted) confidence intervals for parameters different than the true one. In this sense, a low coverage probability of a confidence interval is desirable. We find all the confidence intervals have coverage probability around $80\%$ on horizon $h=1$ and designs 1, 2, and 3, which suggests they have statistical power at $h=1$. We also notice that $\text{RB}_{per-t}$, $\text{WB}_{per-t}$ and $\text{GB}_{LR}$ have a coverage probability strictly lower than $90\%$ for horizon $h=6$ and designs 1, 2, and 3. Moreover, they have a lower coverage \textcolor{black}{probability} than all the other confidence intervals. Finally, all the confidence intervals have coverage \textcolor{black}{probability} above $90\%$ on design 4, with the exception of $\text{GB}_{LR}$ for horizon $h=1$.
This section describes the LP-residual bootstrap method to construct confidence intervals for a scalar function of impulse responses of VAR(p) models, where $p$ denotes the number of lags. More concretely, we propose the confidence interval in (ref) for $\nu' \beta_{h,i}$, where $\beta_{h,i} \in \mathbf{R}^k$ is the vector containing all the impulse response coefficients of the reduced-form shocks in the variable $i$ at $h$ periods in the future. Here, $\nu \in \mathbf{R}^k\setminus \{ 0 \}$ is a user-specified vector, e.g., $\nu = e_j$ (the j-th unit vector) implies $\nu' \beta_{h,i}$ is the impact of the $j$-th reduced-form shock in the variable $i$ at $h$ periods in the future.
The confidence interval for $\nu' \beta_{h,i}$ is defined as
where $\hat{\beta}_{i,n}(h)$, $\hat{s}_{i,n}(h,\nu)$, and $c_n^*(h,1-\alpha)$ are defined in (ref), (ref), and (ref), respectively.
Let $\{y_t \in \mathbf{R}^k: 1 \le t \le n\}$ be the available time-series data. Suppose the data have been demeaned. Denote $X_t = (y_{t-1}',\ldots,y_{t-p}')'$ for all $t=p+1,\ldots, n$. Let $\hat{\beta}_{i,n}(h)$ be obtained from an OLS regression between $y_{i,t+h}$ and $(y_t',X_t')$,
Let $ \hat{s}_{i,n}(h,\nu)$ be the standard error for $\nu'\hat{\beta}_{i,n}(h)$ defined by
where $$ \hat{u}_t(h) = y_t - \hat{A}(h) X_t~, \quad \hat{A}(h) = \left( \sum_{t=p+1}^{n-h} y_t X_t' \right) \left( \sum_{t=p+1}^{n-h} X_t X_t' \right)^{-1} $$ and $$ \hat{\Sigma}(h) = \frac{1}{n-h-p} \sum_{t=p+1}^{n-h} \hat{u}_t(h) \hat{u}_t(h)'~ \textcolor{black}{.}$$ Finally, let $c_n^*(h, 1-\alpha)$ be the bootstrap critical value involving the following steps:
The theoretical properties of the bootstrap confidence interval defined in (ref) are unknown for general VAR models. However, Monte Carlo simulations presented in \textcolor{black}{Online Supplemental} Appendix (ref) suggest that confidence intervals based on the LP-residual bootstrap perform better in terms of coverage probability than those based on first-order asymptotic theory. Remarks (ref) and (ref) provide further discussion on how to extend some of the results presented in this paper to general VAR models.
This paper contributes to a growing literature on confidence interval construction for impulse response coefficients based on the local projection approach. Specifically, we propose the LP-residual bootstrap method to construct confidence intervals for the impulse response coefficients of AR(1) models at intermediate horizons. We prove two theoretical properties of this method: uniform consistency and asymptotic refinements. For a large class of AR(1) models that allow for a unit root, conditional heteroskedasticity of unknown form, and martingale difference shocks, we show that the proposed confidence interval $C_n^*(h,1-\alpha)$ defined in (ref) has an asymptotic coverage probability equal to its nominal level $1-\alpha$ uniformly over the parameter space (e.g., $\rho \in [-1,1]$) and \textcolor{black}{a wide range of} intermediate horizons. For a restricted class of AR(1) models (e.g., $|\rho|\le \textcolor{black}{1-a}$ \textcolor{black}{where $a \in (0,1)$} and i.i.d. shocks with positive continuous density), we demonstrate that the error in coverage probability of $C_n^*(h,1-\alpha)$ has size $o(n^{-1})$, that is, the LP-residual bootstrap provides asymptotic refinements to the confidence intervals.
This paper considered the AR(1) model as the first step in understanding the theoretical properties of the LP-residual bootstrap. Three possible directions exist for future research. First, the uniform consistency of the LP-residual bootstrap method is an open question for the general vector auto-regressive (VAR) model. This bootstrap method is described in Section (ref). Second, the asymptotic refinement property of this method is unknown for the unit-root model ($\rho=1$) or general VAR models. Third, future work is needed to prove the uniform consistency of the LP-wild bootstrap discussed in Remark (ref).