EconBase
← Back to paper

Panel Data Analysis with Heterogeneous Dynamics

Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.

116,178 characters · 21 sections · 88 citation commands

Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.

Panel Data Analysis with Heterogeneous Dynamics

abstractThis paper proposes a model-free approach to analyze panel data with heterogeneous dynamic structures across observational units. We first compute the sample mean, autocovariances, and autocorrelations for each unit, and then estimate the parameters of interest based on their empirical distributions. We then investigate the asymptotic properties of our estimators using double asymptotics and propose split-panel jackknife bias correction and inference based on the cross-sectional bootstrap. We illustrate the usefulness of our procedures by studying the deviation dynamics of the law of one price. Monte Carlo simulations confirm that the proposed bias correction is effective and yields valid inference in small samples. Keywords: Panel data, heterogeneity, functional central limit theorem, jackknife, bootstrap. JEL Classification: C13, C14, C23.

Introduction

Understanding the dynamics of a potentially heterogeneous variable is an important research consideration in economics. For instance, some researchers have investigated the price deviation of the law of one price (LOP) using panel data analyses, and a recent finding by CruciniShintaniTsuruga15 indicates that time-series persistence and volatility measures for the LOP deviation are heterogeneous across US cities and goods. Other examples include income (e.g., BrowningEjrnesAlvarez10) and productivity (e.g., HsiehKlenow09 and GandhiNavarroRivers16) dynamics, for which there is a considerable body of research.\footnote{For example, several researchers have pointed out the heterogeneous dynamics of the income process. These include MeghirPistaferri04 and Hospido2012, which both suggest the importance of heterogeneity in income process volatility, and BotosaruSasaki2018, which develops a nonparametric procedure to estimate the volatility function in the permanent--transitory model of income dynamics.}

We propose easy-to-implement procedures for analyzing the heterogeneous dynamic structure of panel data, $\{\{y_{it}\}_{t=1}^T\}_{i=1}^N$, without assuming any specific model.\footnote{The proposed procedures are readily available via an { R} package from the authors' websites. } To this end, we investigate the cross-sectional distributional properties of the mean, autocovariances, and autocorrelations of $y_{it}$ with heterogeneous units. Our model-free approach is especially useful when empirical researchers are reluctant to assume specific models for heterogeneity given the threat of problems with misspecification. Despite the voluminous literature on dynamic panel data analyses, many studies assume specific models for the dynamics (such as autoregressive (AR) models) and homogeneity in the dynamics, allowing heterogeneity only in the mean of the process.\footnote{ See Arellano03b and Baltagi08 for excellent reviews of the existing studies on dynamic panel data analyses. } While several other studies also consider either heterogeneous dynamics or model-free analyses, we are unaware of any specific study that proposes panel data analysis for heterogeneous dynamics without specifying a particular model.

The distributional properties of the heterogeneous mean, autocovariances, and autocorrelations provide various pieces of information and are perhaps the most basic descriptive statistics for dynamics. Indeed, a typical first step in analyzing time-series data is to examine these properties. As we demonstrate in this study, the distributions of the heterogeneous mean, autocovariances, and autocorrelations can also be useful descriptive statistics for understanding heterogeneous dynamics in panel data. For example, it would be interesting to examine the degree of heterogeneity of the LOP deviations across items such as goods and services. In this case, the mean and variance of the heterogeneous means measure the amount and dispersion of the long-run LOP deviations across items. We can also examine the correlation of the heterogeneous means and autocorrelations that shows whether the magnitudes of the long-run LOP deviations relate to the speed of price adjustment toward the long-run LOP deviations. Moreover, our analysis provides the entire distribution of heterogeneity for the long-run LOP deviations or the adjustment speed. This entire distribution could be useful to investigate, for example, whether goods and services possess different dynamics.

We derive the asymptotic properties of the empirical distributions of the estimated means, autocovariances, and autocorrelations based on double asymptotics, under which both the number of cross-sectional observations, $N$, and the length of the time series, $T$, tend to infinity. By using empirical process theory (e.g., vanderVaartWellner96) and the inversion theorem for characteristic functions (e.g., gil1951note and wendel1961non), we show that the empirical distributions converge weakly to Gaussian processes under a condition for the relative magnitudes of $N$ and $T$ that is slightly “stronger” than $N^3 / T^4 \to 0$. The proof is challenging because our empirical distributions are biased estimators and depend on both $N$ and $T$, so that we cannot directly apply standard empirical process techniques. We show that the estimation error in the estimated mean, autocovariances, and autocorrelations for each unit biases the empirical distributions whose convergence rates depend on $T$. We also derive the asymptotic distributions of the estimators for other distributional properties (e.g., the quantile function) using the functional delta method.

When we can write the parameter of interest as the expected value of a smooth function of the heterogeneous mean and/or autocovariances, we derive the exact order of the bias. This class of parameters includes the mean, variance, and other moments (such as correlations) of the heterogeneous mean, autocovariances, and/or autocorrelations. Importantly, we can analytically evaluate the bias, and find it has two sources. The first is the incidental parameter problem originally discussed in NeymanScott48. The second arises when the smooth function is nonlinear. We show the asymptotic distribution of the estimator under the condition $N / T ^2 \to 0$ under which both biases are negligible. As $T$ is often small compared with $N$ in microeconometric applications, we propose to reduce the biases using DhaeneJochmans15's (DhaeneJochmans15) split-panel jackknife. The jackknife bias-corrected estimator is asymptotically unbiased under a weaker condition on the relative magnitudes of $N$ and $T$ and does not inflate the asymptotic variance.

We propose to use the cross-sectional bootstrapping (e.g., GoncalvesKaffo14) to test hypotheses and construct confidence intervals. The bootstrap distribution is asymptotically equivalent to the distribution of the estimator, but fails to capture the bias. We thus recommend the bootstrap based on the jackknife bias-corrected estimator because this would not suffer from large bias.

As an empirical illustration, we examine the speed of price adjustment toward the long-run LOP deviation using a panel data set of various items for different US cities. We find statistically significant evidence that long-run LOP deviations in the item--city pairs with more persistent dynamics tend to be small and suffer from relatively large shocks. We also find formal statistical evidence that the distribution of the LOP adjustment speed for goods differs from that for services.

We also conduct Monte Carlo simulations. They demonstrate noticeable performances of the bootstrap inference based on the jackknife bias-corrected estimation in small samples.

\paragraph{Paper organization} Section (ref) reviews the studies related to this paper, Section (ref) explains the setting, and Section (ref) introduces the procedures. In Section (ref), we derive the asymptotics of the distribution estimators, while Section (ref) considers the asymptotics for estimating the expected value of a smooth function. Section (ref) presents Kolmogorov--Smirnov (KS)-type tests based on the distribution estimators and Sections (ref) and (ref) develop the application and simulations. Section (ref) concludes and Appendix (ref) contains the technical proofs. The supplementary appendix provides remarks on higher-order bias correction, a test for parametric specifications, other extensions, and several mathematical proofs, applications for income and productivity, and additional Monte Carlo simulations.

Related studies

This paper most closely relates to the literature on heterogeneous panel AR models, which capture the heterogeneity in the dynamics by allowing for unit-specific AR coefficients. PesaranSmith95, HsiaoPesaranTahmiscioglu99, PesaranShinSmith99, PhillipsMoon99, and Pesaran06 provide such analyses. The mean group estimator in PesaranSmith95 is identical to our estimator (without bias correction) for the mean of the heterogeneous first-order autocorrelation if their AR(1) model does not contain exogenous covariates. HsiaoPesaranTahmiscioglu99 show that the mean group estimator is asymptotically unbiased under $N/T^2\to 0$, which is the condition we obtain without the bias correction. Building on this literature, we aim to estimate the entire distributions of the unit-specific heterogeneous mean, autocovariances, and autocorrelations without model specifications.

Researchers have developed econometric methods for investigating features of heterogeneity other than the mean. For example, Hospido2015 investigated the variances of individual and job effects that additively affect the income process. As another example, BotosaruSasaki2018 estimated the volatility function in a permanent--transitory model of income dynamics. However, these studies assume some models and have different motivations from ours.

Elsewhere, MavroeidisSasakiWelch15 identify and estimate the distribution of the AR coefficients in heterogeneous panel AR models. The advantage of their approach is that $T$ can be fixed. While we impose $T \to \infty$, our method is much simpler to implement. By contrast, the estimation method in MavroeidisSasakiWelch15 requires the maximization of a kernel-weighting function written as an integration over multiple variables.

The theoretical results for our distribution estimation relate to JochmansWeidner2018 who consider estimating the distribution of a true quantity based on a noisy measurement (e.g., an estimated quantity). They derive the formula for the bias of their empirical distribution estimator under the assumption that their observations exhibit Gaussian errors.\footnote{An inspection of their proof leads us to surmise that their results may hold more generally as long as we assume that the distribution of the standardized quantity is homogeneous (that is, the estimated quantities satisfy a location--scale assumption). In our setting, heterogeneity can appear in more general ways and this generality is important because we are interested in heterogeneous dynamics. Indeed, we suspect that it is very difficult, if not impossible, to arrive at a setting in which all means, autocovariances, and autocorrelations exhibit heterogeneity and satisfy a location--scale assumption simultaneously.} In contrast, the present paper does not specify parametric distributions for our observations, at the cost of not showing the exact formula for the bias of the distribution estimator. Our results and theirs are thus complementary and thereby represent individual contributions.

In a similar motivation to us, OkuiYanagi2018 develop nonparametric kernel-smoothing estimation based on the estimated means, autocovariances, and autocorrelations for cross-sectional units in panel data. There are several theoretical differences between the two papers, and they develop different proof techniques and obtain different results (see Remark (ref) for details). Moreover, an important practical issue also arises in the kernel estimation as the cross-sectional bootstrap is not suitable for the kernel estimation. This issue comes from the well-known result that the bootstrap cannot capture kernel-smoothing bias, so that they propose an alternative valid inference.

Several studies propose model-free methods to investigate panel data dynamics. For example, using long panel data, Okui10a, Okui11, Okui14 estimates autocovariances, and LeeOkuiShintani13 consider infinite-order panel AR models. Because we can represent a stationary time series with an infinite-order AR process under mild conditions, their approach is essentially model-free. However, these studies assume homogeneous dynamics.

While not directly connected, this study also relates to the recent literature on random coefficients or nonparametric panel data models with nonadditive unobserved heterogeneity.\footnote{There are also studies, such as ChernozhukovFernandezValLuo2018, that aim to investigate the heterogeneity caused by observable covariates. However, these methods do not use the panel feature of the data and are distinct from the literature to which the present paper belongs.} For example, ArellanoBonhomme12 consider linear random coefficients models for panel data and discuss the identification and estimation of the distribution of random coefficients using deconvolution techniques. Chamberlain92 and GrahamPowell12 consider a model similar to that of ArellanoBonhomme12, but focus on the means of random coefficients. FernandezValLee13 examine moment restriction models with random coefficients using the generalized method of moments estimation. Their analysis of the smooth function of unit-specific effects closely relates to our analysis of the smooth function of means and autocovariances, at least in terms of technique. Finally, Evdokimov09 and Freyberger17 consider nonparametric panel regression models with unit-specific and interactive fixed effects, respectively, entering the unspecified structural function, but they do not infer heterogeneous dynamic structures.

Settings

We observe panel data $\{\{y_{it}\}_{t=1}^{T}\}_{i=1}^{N}$ where $y_{it}$ is a scalar random variable, $i$ a cross-sectional unit, and $t$ a time period. We assume that $\{y_{it}\}_{t=1}^T$ is independent across units. We assume that the law of $\{y_{it}\}_{t=1}^T$ is stationary over time, but its dynamic structure may be heterogeneous. Specifically, we consider the following data-generating process (DGP) to model the heterogeneous dynamic structure, in a spirit similar to GalvaoKato14. The unobserved unit-specific effect $\alpha_i$ is independently drawn from a distribution common to all units. We then draw the time series $\{y_{it}\}_{t=1}^T $ for unit $i$ from some distribution $\mathcal{L}(\{y_{it}\}_{t=1}^T; \alpha_i)$ that may depend on $\alpha_i$. The dynamic structure of $y_{it}$ can be heterogeneous because the realized value of $\alpha_i$ can vary across units. For example, in an application of the LOP deviations, $\alpha_i$ might represent unobservable permanent trade costs specific to item $i$. Note that $\alpha_i$ is an abstract parameter used to model heterogeneity in the dynamics across units and does not directly appear in the actual implementation of the procedure. For notational simplicity, we denote “$\cdot | \alpha_{i}$” by “$\cdot | i$”; that is, “conditional on $\alpha_{i}$” becomes “conditional on $i$” below.

To infer the properties of heterogeneity in a model-free manner, we aim to develop statistical tools to analyze the cross-sectional distributions of the heterogeneous means, autocovariances, and autocorrelations of $y_{it}$. The mean for unit $i$ is $\mu_{i} \coloneqq E(y_{it}|i)$. Note that $\mu_i$ is a random variable whose realization differs across units. Because we assume stationarity, $\mu_{i}$ is constant over time. Let $\gamma_{k,i} \coloneqq E((y_{it} - \mu_i) (y_{i,t-k} - \mu_i)|i)$ and $\rho_{k,i} \coloneqq \gamma_{k, i} / \gamma_{0, i}$ be the $k$-th conditional autocovariance and autocorrelation of $y_{it}$ given $\alpha_{i}$, respectively. Note that $\gamma_{0,i}$ is the variance for unit $i$. To understand the possibly heterogeneous dynamics, we estimate the quantities that characterize the distributions of $\mu_i$, $\gamma_{k,i}$, and $\rho_{k,i}$. Below, we often use the notation $\xi_i$ to represent one of $\mu_i$, $\gamma_{k,i}$, and $\rho_{k,i}$.

We consider cases in which both $N$ and $T$ are large. For example, in our empirical illustration for the LOP deviations, we use panel data where $(N,T) = (2248, 72)$. A large $N$ allows us to estimate consistently the cross-sectional distributions of $\mu_i$, $\gamma_{k,i}$, and $\rho_{k,i}$. We require a large $T$ to identify and estimate $\mu_i$, $\gamma_{k,i}$, and $\rho_{k,i}$ based on the time series for each unit.

Our setting is very general and includes many situations.

exampleThe panel AR(1) model with heterogeneous coefficients, as in PesaranSmith95 and others, is a special case of our setting. This model is $y_{it} = c_i + \phi_i y_{i,t-1} + u_{it}$, where $c_i$ and $\phi_i$ are the unit-specific parameters, and $u_{it}$ follows a strong white noise process with variance $\sigma^2$. In this case, $\alpha_i = (c_i, \phi_i)$, $\mu_i = c_i / (1- \phi_i)$, $\gamma_{k,i} = \sigma^2 \phi_i^k/ (1- \phi_i^2)$, and $\rho_{k,i}=\phi_i^k$.
exampleOur setting also includes cases in which the true DGP follows some nonlinear process. Suppose that $y_{it}$ is generated by $y_{it} = m(\alpha_{i}, u_{it})$, where $m$ is some function and $u_{it}$ is stationary over time and independent across units. In this case, $\mu_i = E( m(\alpha_{i}, \epsilon_{it}) | \alpha_i )$ and $\gamma_{k, i}$ and $\rho_{k,i}$ are the $k$-th-order autocovariance and autocorrelation of $w_{it} = y_{it} - \mu_i$ given $\alpha_i$, respectively.

We focus on estimating the heterogeneous mean, autocovariance, and autocorrelation structure and do not aim to recover the underlying structural form of the DGP. We understand that addressing several important economic questions requires knowledge of the structural function of the dynamics. Nonetheless, the distributions of the heterogeneous means, autocovariances, and autocorrelations can be estimated relatively easily without imposing strong assumptions and can provide valuable information, even if our ultimate goal is to identify the structural form. For example, if our procedure reveals a positive correlation between the time-series variance and the time-series persistence for the LOP deviations, the structural form on the LOP deviations should be specified so as to allow for such correlation.

Procedures

In this section, we present the statistical procedures to estimate the distributional characteristics of the heterogeneous mean, autocovariances, and autocorrelations.

We first estimate the mean $\mu_i$, autocovariances $\gamma_{k, i}$, and autocorrelations $\rho_{k,i}$ using the sample analogs $\hat \mu_i \coloneqq \bar y_i \coloneqq T^{-1} \sum_{t=1}^{T}y_{it}$, $\hat \gamma_{k,i} \coloneqq (T-k)^{-1} \sum_{t=k+1}^T (y_{it} - \bar y_i) (y_{i,t-k} - \bar y_{i})$, and $\hat \rho_{k,i} \coloneqq \hat \gamma_{k,i} / \hat \gamma_{0,i}$. We write $\hat \xi_i = \hat \mu_i$, $\hat \gamma_{k,i}$, or $\hat \rho_{k,i}$ as the corresponding estimator of $\xi_i = \mu_i$, $\gamma_{k,i}$, or $\rho_{k,i}$, respectively.

We then compute the empirical distribution of $\{ \hat \xi_i\}_{i=1}^N$:

align[align omitted — 127 chars of source]

where $\mathbf{1} (\cdot)$ is the indicator function and $a \in \mathbb{R}$. This empirical cumulative distribution function (CDF) is interesting in its own right because it is an estimator of the cross-sectional CDF of $\xi_i$, say $F_0^{\xi} (a) \coloneqq \Pr (\xi_i \le a)$.

We can estimate other distributional quantities or test some hypotheses based on the empirical distribution of $\hat \xi_i$. For example, we can consider estimating the $\tau$-th quantile $q_{\tau}^{\xi} \coloneqq \inf \{ a \in \mathbb{R} : F_0^{\xi} (a) \ge \tau \}$ by the empirical quantile $\hat q_{\tau}^{\hat \xi} \coloneqq \inf \{ a \in \mathbb{R} : \mathbb{F}_N^{\hat \xi} (a) \ge \tau \}$. We can also test the difference in the heterogeneous dynamic structures across distinct groups and parametric specifications for the heterogeneous means, autocovariances, or autocorrelations based on the empirical distribution. We develop such tests based on KS-type statistics in Section (ref) and the supplementary appendix.

We can also estimate a function of moments of the heterogeneous mean and autocovariances straightforwardly. Let $S \coloneqq h(E( g(\theta_i) ) )$ be the parameter of interest, where $\theta_i$ is an $l \times 1$ vector whose elements belong to a subset of $(\mu_i, \gamma_{0,i}, \gamma_{1,i},\dots)$, and $g: \mathbb{R}^l \to \mathbb{R}^m$ and $h: \mathbb{R}^m \to \mathbb{R}^n$ are vector-valued functions. We can estimate $S$ by the sample analog:

align[align omitted — 103 chars of source]

where $\hat \theta_i$ is the estimator corresponding to $\theta_i$. For example, we can estimate the correlation between the mean and variance using the sample correlation of $\hat \mu_i$ and $\hat \gamma_{0, i}$. Note that we do not need to consider a function of autocorrelations separately given the autocorrelations are functions of the autocovariances. Section (ref) investigates the asymptotics for $\hat S$ when $g$ and $h$ are smooth, and we analytically evaluate the bias of order $O(1/T)$ in $\hat S$.

DhaeneJochmans15's (DhaeneJochmans15) split-panel jackknife can reduce the bias in $\hat S$ if $g$ and $h$ are smooth. For example, the half-panel jackknife (HPJ) bias correction can delete the bias of order $O(1/T)$. Suppose that $T$ is even.\footnote{If $T$ is odd, we define $\bar S = (\hat S^{(1,1)} + \hat S^{(2,1)} + \hat S^{(1,2)} + \hat S^{(2,2)} )/4$ as in DhaeneJochmans15, where $\hat S^{(1,1)}$, $\hat S^{(2,1)}$, $\hat S^{(1,2)}$, and $\hat S^{(2,2)}$ are the estimators of $S$ computed using $\{\{ y_{it} \}_{t=1}^{\lceil T/2 \rceil}\}_{i=1}^{N}$, $\{\{ y_{it} \}_{t=\lceil T/2 \rceil+1}^{T}\}_{i=1}^{N}$, $\{\{ y_{it} \}_{t=1}^{\lfloor T/2 \rfloor}\}_{i=1}^{N}$, and $\{\{ y_{it} \}_{t=\lfloor T/2 \rfloor +1}^{T}\}_{i=1}^{N}$, respectively. Here, $\lceil \cdot \rceil$ and $\lfloor \cdot \rfloor$ are the ceiling and floor functions, respectively. We note that the asymptotic properties of the HPJ estimator for odd $T$ are the same as those for even $T$. } We divide the panel data into two subpanels: $\{ \{ y_{it}\}_{t=1}^{T/2}\}_{i=1}^N$ and $\{ \{ y_{it}\}_{t=T/2 +1}^{T}\}_{i=1}^N$. Let $\hat S^{(1)}$ and $\hat S^{(2)}$ be the estimators of $S$ computed using $\{\{ y_{it} \}_{t=1}^{T/2}\}_{i=1}^{N}$ and $\{\{ y_{it} \}_{t=T/2+1}^{T}\}_{i=1}^{N}$, respectively. Let $\bar S \coloneqq (\hat S^{(1)} + \hat S^{(2)} )/2$. The HPJ bias-corrected estimator of $S$ is

align[align omitted — 101 chars of source]

The HPJ estimates the bias in $\hat S$ by $\bar S - \hat S$, and $\hat S^H$ does not show bias of order $O(1/T)$.

We may also consider a higher-order jackknife bias correction to eliminate the bias of an order higher than $O(1/T)$, as discussed in DhaeneJochmans15. In particular, we consider the third-order jackknife (TOJ) in the empirical application and simulations. However, we must modify the formula in DhaeneJochmans15 for TOJ to correct higher-order biases in our setting. See the supplementary appendix for the details of this modification. Our Monte Carlo results below indicate that TOJ can be more successful than HPJ when higher-order biases are severe. However, in some cases, TOJ eliminates biases at the cost of deteriorating precision of estimation. Hence, we recommend adopting both HPJ and TOJ in practical situations.

For statistical inference of parameter $S$, we suggest using the cross-sectional bootstrap to approximate the distribution of the bias-corrected estimator. Here, we present the algorithm for the HPJ estimator. The cross-sectional bootstrap regards each time series as the unit of observation and approximates the distribution of statistics under the empirical distribution of ($\hat \theta_i, \hat \theta_i^{(1)}, \hat \theta_i^{(2)}$), where $\hat \theta_i^{(1)}$ and $\hat \theta_i^{(2)}$ denote the estimates of $\theta_i$ from the first and second subpanels, respectively. The algorithm is:

enumerate• Randomly draw $(\hat \theta_1^*, \hat \theta_1^{*(1)}, \hat \theta_1^{*(2)}), \dots, (\hat \theta_N^*, \hat \theta_N^{*(1)}, \hat \theta_N^{*(2)})$ from $\{ (\hat \theta_i, \hat \theta_i^{(1)}, \hat \theta_i^{(2)})\}_{i=1}^N$ with replacement.\footnote{If bootstrap is used to approximate the distribution of $\hat S-S$ not $\hat S^H-S$, then we just need to resample from $\{ \hat \theta_1,\dots, \hat \theta_N \}$. If inference is based on the TOJ estimator, estimates of $\theta_i $ from other subpanels are also required.} • Compute the statistics of interest, say $\vartheta$, using $(\hat \theta_1^*, \hat \theta_1^{*(1)}, \hat \theta_1^{*(2)}), \dots, ( \hat \theta_N^*, \hat \theta_N^{*(1)}, \hat \theta_N^{*(2)})$ • Repeat 1 and 2 $B$ times. Let $\vartheta^* (b)$ be the statistics of interest computed in the $b$-th bootstrap. • Compute the quantities of interest using the empirical distribution of $\{ \vartheta^* (b) \}_{b=1}^B$.

For example, suppose that we are interested in constructing a 95% confidence interval for a scalar parameter $S$. We obtain the bootstrap approximation of the distribution of $\vartheta = \hat S^H - S$. Let $\hat S^{H*} (b)$ be the HPJ estimate of $S$ obtained with the $b$-th bootstrap sample. We then compute the 2.5% and 97.5% quantiles, denoted as $q^*_{0.025}$ and $q^*_{0.975}$, respectively, of the empirical distribution of $\{ \vartheta^* (b) \}_{b=1}^B$ with $\vartheta^* (b) = \hat S^{H*}(b) - \hat S^{H}$. The bootstrap 95% confidence interval for $S$ is $[ \hat S^H - q^*_{0.975}, \hat S^H - q^*_{0.025}]$.

Asymptotic analysis for the distribution estimators

This section presents the asymptotic properties of the distribution estimator in (ref). We first show the uniform consistency of the empirical distribution and then derive the functional central limit theorem (functional CLT). We also show that the functional delta method can apply in this case. All analyses presented below are under double asymptotics ($N, T \to \infty$).\footnote{More precisely, we consider the case in which $T=T(N)$, where $T(N)$ is increasing in $N$ and $T(N) \to \infty$ as $N \to \infty$, but the exact form of the function $T(N)$ is left unspecified, except the condition imposed in each theorem. Note that analyses under sequential asymptotics where $N \to \infty$ after $T \to \infty$ ignore estimation errors in $\hat \mu_i$, $\hat \gamma_{k,i}$, and $\hat \rho_{k,i}$, and they fail to capture the bias. We do not consider the sequential asymptotics where $T \to \infty$ after $N \to \infty$. }

While our setting is fully nonparametric as introduced in Section (ref), the following representation is useful for our theoretical analysis. Let $w_{it} \coloneqq y_{it} - E(y_{it}|i) = y_{it} - \mu_i$. By construction, $y_{it} = \mu_{i} + w_{it}$ and $E(w_{it}|i)=0$ for any $i$ and $t$. Note also that $\gamma_{k,i} = E(w_{it} w_{i,t-k}|i)$.

Assumptions

Because we use empirical process techniques, it is convenient to rewrite the empirical distributions as empirical processes indexed by a class of indicator functions. Let $\mathbb{P}_{N}^{\hat \xi} \coloneqq N^{-1} \sum_{i=1}^{N} \delta_{\hat \xi_i}$ be the empirical measure of $\hat \xi_i = \hat \mu_i$, $\hat \gamma_{k,i}$, or $\hat \rho_{k,i}$, where $\delta_{\hat \xi_i}$ is the probability distribution degenerated at $\hat \xi_i$. Let $\mathcal{F} \coloneqq \{ \mathbf{1}_{(-\infty, a]} : a \in \mathbb{R} \}$ be the class of indicator functions where $\mathbf{1}_{(-\infty,a]} (x) \coloneqq \mathbf{1} ( x \le a )$. We denote the probability measure of $\xi_i$ as $P_0^{\xi}$. In this notation, the empirical distribution function $\mathbb{F}^{\hat \xi}_{N}$ in (ref) is an empirical process indexed by $\mathcal{F}$, and $\mathbb{P}_N^{\hat \xi} f = \mathbb{F}_N^{\hat \xi} (a)$ for $f = \mathbf{1}_{(-\infty, a]}$. Similarly, $P_0^{\xi} f = F_0^{\xi}(a) = \Pr(\xi_i \leq a)$ for $f = \mathbf{1}_{(-\infty, a]}$. We often use shorthand notations such as $\mathbb{P}_N = \mathbb{P}_N^{\hat \xi}$, $\mathbb{F}_N = \mathbb{F}^{\hat \xi}_N$, $P_0 = P_0^{\xi}$, and $F_0 = F_0^{\xi}$ by omitting the superscripts $\hat \xi$ and $\xi$.

Throughout the study, we assume the following summarizes the conditions in Section (ref).

assumptionThe sample space of $\alpha_i$ is some Polish space and $y_{it} \in \mathbb{R}$ is a scalar real random variable. $\{(\{y_{it}\}_{t=1}^T, \alpha_i)\}_{i=1}^N$ is independently and identically distributed (i.i.d.) across $i$.

We stress that the i.i.d. assumption does not restrict the heterogeneous dynamics.

The following assumptions depend on natural numbers $r_m$ and $r_d$, which will be specified in the theorems that use this assumption. For a strictly stationary stochastic process $\{X_t\}_{t=1}^\infty$, define $\alpha$-mixing coefficients as $\alpha (m) = \sup_{A \in \mathcal{M}_1^k, B\in \mathcal{M}_{k+m}^{\infty}} |\Pr (A\cap B) - \Pr(A) \Pr(B) |$, where $\mathcal{M}_a^b$ denotes the $\sigma$-algebra generated by $X_j$ for $a \leq j \leq b$, and call the process $\alpha$-mixing if $\alpha (m) \to 0$ as $m\to \infty$.

assumptionFor each $i$, $\{y_{it}\}_{t=1}^{\infty}$ is strictly stationary and $\alpha$-mixing given $\alpha_i$, with mixing coefficients $\{\alpha (m|i)\}_{m=0}^\infty$. There exists a natural number $r_m$ and a sequence $\{ \alpha (m) \}_{m=0}^\infty$ such that for any $i$ and $m$, $\alpha (m|i) \le \alpha (m)$ and $\sum_{m=0}^{\infty} (m+1)^{r_m/2-1} \alpha(m) ^{\delta / (r_m+\delta)} < \infty$ for some $\delta>0$.
assumptionThere exists a natural number $r_d$ such that $E|w_{it}|^{r_d+\delta} < \infty$ for some $\delta > 0$.

Assumptions (ref) and (ref) are mild regularity conditions on the process of $y_{it}$. Assumption (ref) is a mixing condition depending on $r_m$ and restricts the degree of persistence of $y_{it}$ across time. It also imposes stationarity on $\{y_{it}\}_{t=1}^{\infty}$, which in particular implies that the initial values are generated from the stationary distribution. Note that a large $T$ could also guarantee that such an initial value condition (see, e.g., Section 4.3.2 in Hsiao2014) is negligible in our analysis. Nonetheless, we impose this condition to simplify the analysis. Assumption (ref) requires that $w_{it}$ has some moment higher than the $r_d$-th order. These assumptions are satisfied, for example, when $y_{it}$ follows a heterogeneous stationary panel ARMA model with Gaussian innovations.

We also introduce Assumptions (ref), (ref), and (ref) for the uniform consistency and functional CLTs of the empirical distributions $\mathbb{F}_N^{\hat \mu}$, $\mathbb{F}_N^{\hat \gamma_k}$, and $\mathbb{F}_N^{\hat \rho_k}$, respectively. Condition a) in each assumption is introduced for the uniform consistency, and the remaining conditions are required for the functional CLTs. We define $\bar w_i \coloneqq T^{-1} \sum_{t=1}^T w_{it}$.

assumptiona) The random variable $\mu_i$ is continuously distributed. b) The CDF of $\mu_i$ is thrice boundedly differentiable. c) The CDF of $\hat \mu_i$ is thrice boundedly differentiable uniformly over $T$. d) There exists some fixed $M < \infty$ such that $E[(\bar w_i)^2 | \mu_i = \cdot ] \le M / T$.
assumptiona) The random variable $\gamma_{k,i}$ is continuously distributed. b) The CDF of $\gamma_{k,i}$ is thrice boundedly differentiable. c) The CDF of $\hat \gamma_{k,i}$ is thrice boundedly differentiable uniformly over $T$. d) There exists some fixed $M < \infty$ such that $E[(\bar w_i)^2 | \gamma_{k,i} = \cdot] \le M/T$ and $E[(\hat \gamma_{k,i} - \gamma_{k,i})^2 | \gamma_{k,i} = \cdot] \le M / T$.
assumptiona) The random variable $\rho_{k,i}$ is continuously distributed. b) The CDF of $\rho_{k,i}$ is thrice boundedly differentiable. c) The CDF of $\hat \rho_{k,i}$ is thrice boundedly differentiable uniformly over $T$. d) There exists some fixed $M < \infty$ such that $E[(\bar w_i)^2 | \rho_{k,i} = \cdot] \le M/T$, $E[(\hat \gamma_{k,i} - \gamma_{k,i})^2 | \rho_{k,i} = \cdot] \le M/T$, and $E[(\hat \gamma_{0,i} - \gamma_{0,i})^2 | \rho_{k,i} = \cdot] \le M/T$. e) There exist some fixed $\varepsilon > 0$ and $M < \infty$ such that $\hat \gamma_{0,i} > \varepsilon$, $\gamma_{0,i} > \varepsilon$, $|\hat \gamma_{k,i}| < M$, and $|\gamma_{k,i}| < M$ almost surely.

Assumption (ref) states that $\mu_i$ and $\hat \mu_i $ are continuous random variables. This assumption is restrictive in the sense that it does not allow a discrete distribution of $\mu_i$ or no heterogeneity in the mean (i.e., $\mu_i$ is homogeneous such that $\mu_i = \mu$ for some constant $\mu$ for any $i$).\footnote{Discrete heterogeneity is considered in, for example, BonhommeManresa15 and SuShiPhillips14 for linear panel data analyses.} \footnote{We might consider testing homogeneity in a formal manner by extending the testing procedures in pesaran2008testing to our model-free context. The construction of test statistics and the derivation of their asymptotic distributions for such extensions are nontrivial tasks, and this topic is left for future work.} The uniform consistency and functional CLT could not hold without the continuity of $\mu_i$. The assumption also imposes restrictions on the distribution of the noise $\bar w_{i}$. These assumptions are satisfied when data are generated by Gaussian ARMA processes with continuously distributed parameters. That said, we may be able to relax the continuity of $\hat \mu_i$ (the estimated version of $\mu_i$) in condition c), but this requires different proofs to evaluate the order of the bias for the functional CLT. Assumption (ref) also restricts the order of the conditional moment of $\bar w_i$. Note that Lemma (ref) shows that the order of $E(\bar w_i^2)$ is $1/T$ and this assumption states that the same order holds for the conditional counterpart. Assumptions (ref) and (ref) are similar to Assumption (ref), except Assumption (ref).e restricts variances $\gamma_{0, i}$ and $\hat \gamma_{0,i}$ that are bounded away from zero and autocovariances $\gamma_{k,i}$ and $\hat \gamma_{k,i}$ that are bounded. We need these additional conditions to examine the empirical distribution for $\hat \rho_{k,i}$.

Uniform consistency

The following theorem establishes the uniform consistency of the distribution estimator.

theoremSuppose that Assumptions (ref), (ref), (ref), and (ref).a hold for $r_m = 2$ and $r_d = 2$ if $\hat \xi_i = \hat \mu_i$ and $\xi_i = \mu_i$; that Assumptions (ref), (ref), (ref), and (ref).a hold for $r_m = 4$ and $r_d = 4$ if $\hat \xi_i = \hat \gamma_{k,i}$ and $\xi_i = \gamma_{k,i}$; and that Assumptions (ref), (ref), (ref), and (ref).a hold for $r_m = 4$ and $r_d = 4$ if $\hat \xi_i = \hat \rho_{k,i}$ and $\xi_i = \rho_{k,i}$. When $N,T \to \infty$, the class $\mathcal{F}$ is $P_0$-Glivenko--Cantelli in the sense that $\sup_{f \in \mathcal{F}} | \mathbb{P}_N f - P_{0} f | \stackrel{as}{\longrightarrow} 0$ where $\stackrel{as}{\longrightarrow}$ signifies the almost sure convergence.

Note that Theorem (ref) cannot be directly shown by the usual Glivenko--Cantelli theorem (e.g., Theorem 19.1 in vanderVaart98) because the true distribution of $\hat \xi_i$ changes as $T$ increases. Nonetheless, our proof follows similar steps to those of the usual Glivenko--Cantelli theorem.

Functional central limit theorem

We present the functional CLTs for the empirical distributions of $\hat \mu_i$, $\hat \gamma_{k,i}$, and $\hat \rho_{k,i}$. We aim to derive the asymptotic law of $\sqrt{N}(\mathbb{P}_{N} f - P_{0} f)$ where $f \in \mathcal{F}$. We can also obtain the asymptotic distribution of other quantities via the functional delta method based on this result.

The functional CLT for $\mathbb{P}_N$ holds under a similar set of assumptions for the uniform consistency, but we need all of the conditions in Assumption (ref), (ref), or (ref) to evaluate the order of the bias. We also require a condition on the relative magnitudes of $N$ and $T$ asymptotically to eliminate the bias. Let $\ell^{\infty}(\mathcal{F})$ be the collection of all bounded real functions on $\mathcal{F}$.

theoremSuppose that Assumptions (ref), (ref), (ref), and (ref) hold for $r_m = 4$ and $r_d = 4$ if $\hat \xi_i = \hat \mu_i$ and $\xi_i = \mu_i$; that Assumptions (ref), (ref), (ref), and (ref) hold for $r_m = 8$ and $r_d = 8$ if $\hat \xi_i = \hat \gamma_{k,i}$ and $\xi_i = \gamma_{k,i}$; and that Assumptions (ref), (ref), (ref), and (ref) hold for $r_m = 8$ and $r_d = 8$ if $\hat \xi_i = \hat \rho_{k,i}$ and $\xi_i = \rho_{k,i}$. When $N,T \to \infty$ with $N^{3+\epsilon}/T^4 \to 0$ for some $\epsilon \in (0, 1/3)$, we have \begin{align*} \sqrt{N}(\mathbb{P}_N - P_0) \leadsto \mathbb{G}_{P_0} \qquad in \quad \ell^{\infty}(\mathcal{F}), \end{align*} where $\leadsto$ signifies weak convergence, $\mathbb{G}_{P_0}$ is a Gaussian process with zero mean and covariance function $E(\mathbb{G}_{P_0}(f_{i})\mathbb{G}_{P_0}(f_j))=F_0(a_i \wedge a_j) - F_0(a_i) F_0(a_j)$ with $f_i = \mathbf{1}_{(-\infty, a_i]}$ and $f_{j} = \mathbf{1}_{(-\infty, a_j]}$ for $a_i, a_j \in \mathbb{R}$ and $a_i \wedge a_j$ is the minimum of $a_i$ and $a_j$.

The asymptotic law of the empirical process is Gaussian, which is identical to the limiting distribution for the empirical process constructed using the true $\xi_i = \mu_i$, $\gamma_{k,i}$, or $\rho_{k,i}$. However, this result requires that $N^{3+\epsilon}/T^4 \to 0$ for some $\epsilon$ such that $0 < \epsilon < 1/3$, which allows us to ignore the estimation error in $\hat \xi_i = \hat \mu_i$, $\hat \gamma_{k,i}$, or $\hat \rho_{k,i}$ asymptotically. Note that the condition, $N^{3+\epsilon}/T^4 \to 0$, is almost equivalent to $N^3 / T^4 \to 0$ because we can select an arbitrarily small $\epsilon > 0$.

We provide a brief summary of the proof and explain why we require the condition $N^{3+\epsilon}/T^4 \to 0$. The key to understanding the mechanism behind the requirement that $N^{3+\epsilon}/T^4 \to 0$ is to recognize that $E (\mathbb{P}_N f) \neq P_0 f$. That is, $\mathbb{P}_N f$ is not an unbiased estimator for $P_0 f$. As a result, we cannot directly apply the existing results for the empirical process to derive the asymptotic distribution. Let $P_T = P_T^{\hat \xi}$ be the (true) probability measure of $\hat \xi_i = \hat \mu_i$, $\hat \gamma_{k,i}$, or $\hat \rho_{k,i}$. Note that $P_T$ depends on $T$ and $P_T \neq P_0$, and observe that $E(\mathbb{P}_N f) = P_T f$. Let $\mathbb{G}_{N, P_T} \coloneqq \sqrt{N}(\mathbb{P}_N - P_T)$. We observe that

align[align omitted — 139 chars of source]

For $\mathbb{G}_{N,P_T}$ in (ref), we can directly apply the uniform CLT for the empirical process based on triangular arrays (vanderVaartWellner96) and obtain $\mathbb{G}_{N, P_T} \leadsto \mathbb{G}_{P_0}$ in $\ell^{\infty}(\mathcal{F})$ as $N \to \infty$. This part of the proof is standard.

We require the condition $N^{3+\epsilon}/T^4 \to 0$ to eliminate the effect of the bias term $\sqrt{N}(P_T f - P_0 f )$ in (ref). In the proof of the theorem, we show that

align*[align* omitted — 131 chars of source]

for any $0 < \epsilon < 1/3$. The result is based on the evaluation that the difference between $P_T$ and $P_0$ is of order $O(1 / T^{2/(3+\epsilon)})$. This order is obtained by evaluating the characteristic functions of $\hat \xi_i$ and $\xi_i$, and applying the inversion theorem (gil1951note and wendel1961non). We note that the condition, $0 < \epsilon < 1/3$, is used to ensure the integrability of integrals for the inversion theorem (see the proof for details). As a result, we can establish the weak convergence under the condition $N^{3+\epsilon}/T^4 \to 0$ for a sufficiently small $0 < \epsilon < 1/3$.

remarkWhen we additionally assume that $\hat \xi_i$ exhibits a Gaussian error, we can derive the exact bias that is of order $O(1/T)$ and show the same limiting law as in Theorem (ref) under the weaker condition on the relative magnitudes that $N / T^2 \to 0$. In this case, we can also validate the HPJ bias correction for the distribution estimator. The proof utilizing the Gaussian assumption (and a location--scale assumption) can be found in JochmansWeidner2018 in a general setting for noisy measurement, and we do not explore such a proof here. However, we stress that our proof for Theorem (ref) is distinct from theirs because we do not assume Gaussianity nor any parametric specification for $\hat \xi_i$ and $\xi_i$ and it requires a quite different proof technique.

Functional delta method

We can derive the asymptotic distribution of an estimator that is a function of the empirical distribution using the functional delta method. Suppose that we are interested in the asymptotics of $\phi(\mathbb{P}_{N})$ for a functional $\phi:D(\mathcal{F}) \to \mathbb{R}$ where $D(\mathcal{F})$ is the collection of all c\`adl\`ag real functions of $\mathcal{F}$. For example, the $\tau$-th quantile $\phi (P_0) = q_{\tau} = F_0^{-1}(\tau) = \inf\{a \in \mathbb{R} : F_0 (a) \geq \tau \}$ for $\tau \in (0,1)$ may be estimated by the empirical quantile of $\hat \xi_i$: $\phi(\mathbb{P}_{N}) = \hat q_{\tau}= \mathbb{F}_N^{-1} (\tau) = \inf\{a \in \mathbb{R} : \mathbb{F}_N (a) \geq \tau \}$. More generally, we can estimate the quantile process $F_0^{-1}$ using the empirical quantile process $\mathbb{F}_N^{-1}$.

The derivation of the asymptotic distribution of $\phi(\mathbb{P}_{N})$ is a direct application of the functional delta method (e.g., vanderVaartWellner96) and Theorem (ref). We summarize this result in the following corollary.\footnote{In Corollary (ref), we can change the Hadamard differentiability of $\phi:D(\mathcal{F}) \subset \ell^{\infty}(\mathcal{F}) \to \mathbb{E}$ to the Hadamard differentiability of $\phi: \ell^{\infty}(\mathcal{F}) \subset D(\mathbb{\bar R}) \to \mathbb{R}$ tangentially to a set of continuous functions in $D(\mathbb{\bar R})$, where $D(\mathbb{\bar R})$ is the Banach space of all c\`adl\`ag functions $z:\mathbb{\bar {R}} \to \mathbb{R}$ on $\mathbb{\bar R}$ equipped with the uniform norm. See Lemma 3.9.20 and Example 3.9.21 in vanderVaartWellner96 for details. }

corollarySuppose that the assumptions in Theorem (ref) hold. Suppose that $\phi:D(\mathcal{F}) \subset \ell^{\infty}(\mathcal{F}) \to \mathbb{E}$ is Hadamard differentiable at $P_0$ with the derivative $\phi'_{P_0}$ where $\mathbb{E}$ is a normed linear space. When $N,T \to \infty$ with $N^{3+\epsilon}/T^4 \to 0$ for some $\epsilon \in (0, 1/3)$, we have $\sqrt{N} ( \phi(\mathbb{P}_N) - \phi(P_{0}) ) \leadsto \phi'_{P_{0}}(\mathbb{G}_{P_{0}})$.

As an example, we can use this result to derive the asymptotic distribution of $\hat q_{\tau}$. The form $\phi'_{P_0}$ for $\hat q_{\tau}$ is available in Example 20.5 in vanderVaart98 and indicates that $\sqrt{N} (\hat q_{\tau} - q_{\tau}) \leadsto \mathcal{N} ( 0, \tau (1-\tau) / (f (q_\tau))^2)$ where $\mathcal{N}(\mu, \sigma^2)$ is the normal distribution with mean $\mu$ and variance $\sigma^2$ and $f = f^{\xi}$ is the density function of $\xi_i$. We can also derive the asymptotic law of the empirical quantile process $\mathbb{F}_N^{-1}$. If $f$ is continuous and positive in the interval $[F_0^{-1}(p) - \varepsilon, F_0^{-1}(q) + \varepsilon]$ for some $0 < p < q < 1$ and $\varepsilon > 0$, then Corollary (ref) means that

align*[align* omitted — 209 chars of source]

This process is known to be Gaussian with zero mean and a known covariance function (e.g., Example 3.9.24 in vanderVaartWellner96).

Function of the expected value of a smooth function of the heterogeneous mean and/or autocovariances

In this section, we consider the estimation of a function of the expected value of a smooth function of the heterogeneous mean and/or autocovariances. We also develop the asymptotic justifications of the HPJ bias correction and the cross-sectional bootstrap inference.

Asymptotic results

We derive the asymptotic properties of $\hat S = h(N^{-1} \sum_{i=1}^{N} g( \hat \theta_i ))$ in (ref) as the estimator of $S = h(E(g(\theta_i)))$. Define $G \coloneqq E(g(\theta_i))$ and $\hat G \coloneqq N^{-1} \sum_{i=1}^N g(\hat \theta_i)$ such that $S = h(G)$ and $\hat S = h(\hat G)$.

We make the following assumptions to develop the asymptotic properties of $\hat S$.

assumptionThe function $h: \mathbb{R}^m \to \mathbb{R}^n$ is continuous in a neighborhood of $G$.
assumptionThe function $h: \mathbb{R}^m \to \mathbb{R}^n$ is continuously differentiable in a neighborhood of $G$. The matrix of the first derivatives $\nabla h(G)\coloneqq (\nabla h_1(G)^\top, \nabla h_2(G)^\top, \dots, \nabla h_n(G)^\top)^\top$ is of full row rank.
assumptionThe function $g=(g_1,g_2,\dots,g_m):\mathcal{O} \to \mathbb{R}^m$ is twice-continuously differentiable where $\mathcal{O} \subset \mathbb{R}^{l}$ is a convex open subset. The covariance matrix $\Gamma \coloneqq E[(g(\theta_i) - E(g(\theta_i)))(g(\theta_i) - E(g(\theta_i)))^\top]$ exists and is nonsingular. For any $p=1,2,\dots,m$, the elements of the Hessian matrix of $g_p$ are bounded functions. For any $p=1,2,\dots,m$, the function $g_p$ satisfies $E[((\partial/ \partial z_{j}) g_p(z)|_{z=\theta_i})^4] < \infty$ for any $j=1,2,\dots,m$.

These assumptions impose conditions on the smoothness of $h$ and $g$ and the existence of moments. Assumption (ref) applies to the continuous mapping theorem for the proof of consistency. Assumption (ref) is stronger than Assumption (ref) and is used for the application of the delta method to derive the asymptotic distribution. Assumption (ref) states that the function $g$ is sufficiently smooth. This assumption is satisfied when the parameter of interest is the mean (i.e., $g(a) = a$) or the $p$-th order moment (i.e., $g(a) =a ^p$), for example. However, this assumption is not satisfied when estimating the CDF (i.e., $g(a) = \mathbf{1} (a \leq c)$ for some $c\in\mathbb{R}$) or quantiles. The existence of the first derivative is crucial for analyzing the asymptotic property of $\hat S$. The second derivative is useful for evaluating the order of the asymptotic bias. Assumption (ref) also guarantees that the asymptotic variance exists, which rules out homogeneous dynamics, i.e., it excludes the case where $\theta_i = \theta$ for constant $\theta$ for any $i$ (see the supplementary appendix for the asymptotic results for homogeneous dynamics).

The following theorem demonstrates the asymptotic properties of $\hat S$.

theoremLet $r^* = 4$ if $\theta_i = \mu_i$ such that $S =h( E(g(\mu_i)))$ for some $h$ and $g$, and $r^*=8$ if $\theta_i$ contains $\gamma_{k,i}$ for some $k$. Suppose that Assumptions (ref), (ref), (ref), (ref), and (ref) hold for $r_m=4$ and $r_d=r^*$. When $N,T \to \infty$, it holds that $\hat S \stackrel{p}{\longrightarrow} S$. Moreover, suppose that Assumption (ref) also holds. When $N, T \to \infty$ with $N/T^2 \to 0$, it holds that \begin{align*} \sqrt{N} (\hat S - S) \leadsto \mathcal{N} \left(0, \nabla h(G) \Gamma (\nabla h(G))^\top \right). \end{align*}

The estimator $\hat S$ is consistent when both $N$ and $T$ tend to infinity and is asymptotically normal with mean zero when $N/T^2 \to 0$. Importantly, in contrast to the discussion in Section (ref), the distribution of $\theta_i$ need not be continuous and can be discrete as long as it is not degenerate (homogeneous). The remarkable result is that the asymptotically unbiased estimation holds under $N/T^2 \to 0$. This condition is weaker than that for $\mathbb{P}_N$, which is $N^{3 + \epsilon}/ T^{4} \to 0$ for some $0 < \epsilon < 1/3$. This result comes from the smoothness of $g$ and the fact that $\hat \theta_i$ is first-order unbiased for $\theta_i$. FernandezValLee13 also observe similar asymptotic results for estimators of smooth functions of heterogeneous quantities in a different context.

To obtain a better understanding of the results in the theorem, we first consider the case in which $\theta_i = \mu_i$ such that $l=1$, $h$ is an identity function such that $n=1$, and $g$ is a scalar function such that $m=1$. Denote our parameter of interest as $G^{\mu} \coloneqq E(g(\mu_i))$ and let $\hat G^{\hat \mu} \coloneqq N^{-1}\sum_{i=1}^N g(\hat \mu_i)$. By Taylor's theorem and $\hat \mu_i = \mu_i + \bar w_i$, we observe the following expansion:

align[align omitted — 293 chars of source]

where $\tilde{\mu}_i$ is between $\mu_i$ and $\hat \mu_i$. The second term in (ref) has a mean of zero and is of order $O_{p}(1/\sqrt{T})$. The fact that it has a mean of zero is the key reason that a milder condition, $N/T^2 \to 0$, is sufficient for the asymptotically unbiased estimation of $G^{\mu}$. The third term corresponds to the bias caused by the nonlinearity of $g$. When $g$ is linear, this term does not appear and the parameter can be estimated without any restriction on the relative magnitudes of $N$ and $T$. The nonlinearity bias is of order $O_{p}(\sqrt{N}/T)$. We use the condition $N/T^2 \to 0$ to eliminate the effect of this bias.

When our parameter of interest involves $\gamma_{k,i}$ for some $k$, we encounter an additional source of bias. Let us consider the case in which $\theta_i = \gamma_{k,i}$ for some $k$ such that $l=1$, $h$ is an identity function such that $n=1$, and $g$ is a scalar function such that $m=1$. We denote our parameter of interest as $G^{\gamma_{k}} \coloneqq E(g(\gamma_{k,i}))$ and let $\hat G^{\hat \gamma_k} \coloneqq N^{-1}\sum_{i=1}^N g(\hat \gamma_{k,i})$. We can expand $\hat \gamma_{k,i}$ as follows:

align*[align* omitted — 163 chars of source]

Note that the second term has a mean of zero, although it is of order $O_p(1/\sqrt{T})$. The third term $(\bar w_i)^2$ is the estimation error in $\bar y_i$ ($=\hat \mu_i$) and is of order $O_p(1/T)$, and causes the incidental parameter bias NeymanScott48,Nickell1981. By Taylor's theorem and the expansion of $\hat \gamma_{k, i}$, we have

align[align omitted — 578 chars of source]

where $\tilde \gamma_{k,i}$ is between $\hat \gamma_{k,i}$ and $\gamma_{k,i}$. In contrast to $\hat G^{\hat \mu}$, this $\hat G^{\hat \gamma_k}$ has an incidental parameter bias corresponding to the first term in (ref). This bias is of order $O_{p}(\sqrt{N}/T)$ and does not appear in the expansion of $\hat G^{\hat \mu}$. This term makes the condition $N/T^2\to 0$ necessary, even when $g$ is linear. The other terms are similar to those in the expansion of $\hat G^{\hat \mu}$. The term on the right-hand side of (ref) yields the asymptotic normality of $\hat G^{\hat \gamma_k}$. The term in (ref) has a mean of zero and is of order $O_{p}(1/\sqrt{T})$. The second term in (ref) is the nonlinearity bias term that also appears in $\hat G^{\hat \mu}$, which is also of order $O_{p}(\sqrt{N}/T)$.

remarkThe analysis here is not applicable to kernel-smoothing estimation, and asymptotic analyses for kernel-smoothing estimators require different proof techniques. To see this, we consider the kernel estimator for the density of $\mu_i$, say $(Nh)^{-1} \sum_{i=1}^N K((x - \hat \mu_i) / h)$, where $K$ is a kernel function and $h \to 0$ is bandwidth. The summand $K((x - \cdot) / h)$ depends on the bandwidth $h$, which shrinks to zero as the sample size increases, so that the shape of the summand changes depending on the sample size, unlike the summand $g(\cdot)$ here. As a result, the kernel estimation requires much more careful investigations for nonlinearity bias terms. OkuiYanagi2018 formally demonstrate this issue for the kernel density and CDF estimation and find that their relative magnitude conditions of $N$ and $T$ differ from the condition $N / T^2 \to 0$ here and vary in the number of nonlinearity bias terms that can be evaluated.

Split-panel jackknife bias correction

We provide a theoretical justification for the HPJ bias-corrected estimator in (ref), which we base on the bias-correction method proposed by DhaeneJochmans15. We make the following additional assumptions to study the HPJ estimator of $S$.

assumptionThe function $g=(g_1,g_2,\dots,g_m):\mathcal{O} \to \mathbb{R}^m$ is thrice differentiable. The covariance matrix $\Gamma = E[(g(\theta_i) - E(g(\theta_i)))(g(\theta_i) - E(g(\theta_i)))^\top]$ exists and is nonsingular. For any $p=1,2,\dots,m$, the function $g_p$ satisfies $E[((\partial/ \partial z_{j}) g_p(z)|_{z=\theta_i})^4] < \infty$ for any $j=1,2,\dots,m$, and $E[((\partial^2 / \partial z_{j_1} \partial z_{j_2})g_p(z)|_{z=\theta_i})^4]<\infty$ for any $j_1, j_2 =1,2,\dots,m$. All third-order derivatives of $g$ are bounded.

Assumption (ref) requires that $g$ is thrice differentiable, contrary to Assumption (ref) and imposes stronger moment conditions. We require this condition to conduct a higher-order expansion of $\hat S$.

The following theorem shows the asymptotic normality of the HPJ estimator.

theoremLet $r^* = 8$ if $\theta_i = \mu_i$ such that $S = h( E(g(\mu_i)))$ for some $h$ and $g$, and $r^*=16$ if $\theta_i$ contains $\gamma_{k,i}$ for some $k$. Suppose that Assumptions (ref), (ref), (ref), (ref), and (ref) are satisfied for $r_m = 8$ and $r_d =r^*$. When $N,T\to \infty$ with $N/T^2 \to \nu$ for some $\nu \in [0,\infty)$, it holds that \begin{align*} \sqrt{N} (\hat S^H - S) \leadsto \mathcal{N} \left(0, \nabla h(G) \Gamma (\nabla h(G))^\top \right). \end{align*}

The HPJ estimator is asymptotically unbiased, even when $N/T^2 \to 0$ is not satisfied. Moreover, this bias correction does not inflate the asymptotic variance. The reason why the HPJ works is the same as DhaeneJochmans15, and the detail can be found in the proof of Theorem (ref).

Cross-sectional bootstrap

In this section, we present the justification for the use of the cross-sectional bootstrap introduced in Section (ref). The first theorem concerns $\hat S$ and the second theorem discusses the case where $\hat S^H$. We also provide a theorem for distribution function estimators.

We require several additional assumptions. The following assumption is required for Lyapunov's conditions for $\hat G^*$, which is the estimator of $G$ obtained with the bootstrap sample. Note that $\hat S^*= h(\hat G^*) = h(N^{-1} \sum_{i=1}^N g(\hat \theta_i^*))$ where $\hat \theta_i^*$ is the estimator of $\theta_i$ based on the bootstrap sample.

assumptionThe function $g=(g_1,g_2,\dots,g_m):\mathcal{O} \to \mathbb{R}^m$ is twice-continuously differentiable. The covariance matrix of $g(\theta_i)$, $\Gamma$, exists and is nonsingular. The elements of the Hessian matrices of $g_p$ for $p=1,2,\dots, m$, $g_{p_1} (\cdot) g_{p_2} (\cdot)$ for $p_1, p_2 = 1,2,\dots, m$, and $(g(\cdot) ^\top g(\cdot))$ are bounded. For any $p=1,2,\dots,m$, the function $g_p$ satisfies $E[( (\partial/\partial z_{j})g_p(z)|_{z=\theta_i})^4]<\infty$ for any $j=1,2,\dots,l$. For any $p_1, p_2 = 1,2,\dots, m$, $E[ ( (\partial / \partial z_j) g_{p_1}(z) |_{z=\theta_i} g_{p_2} (\theta_i))^2] < \infty$. For any $j=1,2,\dots, l$, $E[ ( g(\theta_i)^\top g(\theta_i) (\partial / \partial z_j) g_{p_1}(z) |_{z=\theta_i} g_{p_2} (\theta_i))^2] < \infty$ is satisfied.

The following theorem states that the bootstrap distribution converges to the asymptotic distribution of $\hat S$, but fails to capture the bias term. Let $P^*$ be the bootstrap distribution (that is identical here to the empirical distribution of $\hat \theta_i$, or as below, $\hat \xi_i$).

theoremLet $r^* = 4$ if $\theta_i = \mu_i$ such that $S =h( E(g(\mu_i)))$ for some $h$ and $g$, and $r^*=8$ if $\theta_i$ contains $\gamma_{k,i}$ for some $k$. Suppose that Assumptions (ref), (ref), (ref), (ref), and (ref) hold for $r_m = 4$ and $r_d =r^*$. When $N, T \to \infty$, we have \begin{align*} \sup_{x \in \mathbb{R}} \left| P^* \left( \sqrt{N} (\hat S^* - \hat S) \le x \right) - \Pr \left( \mathcal{N} \left(0, \nabla h(G) \Gamma (\nabla h(G))^\top \right) \le x \right) \right| \stackrel{p}{\longrightarrow} 0. \end{align*}

The bootstrap does not capture the bias properties of $\hat G$ shown in Section (ref). This implies that when $T$ is small, we must be cautious about using the bootstrap to make statistical inference. GalvaoKato14, GoncalvesKaffo14, and Kaffo14 also observe similar issues.

We can also show that the bootstrap can approximate the asymptotic distribution of the HPJ estimator. The proof is analogous to the proof of Theorem (ref), and is thus omitted.

theoremLet $r^* = 4$ if $\theta_i = \mu_i$ such that $S =h( E(g(\mu_i)))$ for some $h$ and $g$, and $r^* = 8$ if $\theta_i$ contains $\gamma_{k,i}$ for some $k$. Suppose that Assumptions (ref), (ref), (ref), (ref), and (ref) are satisfied for $r_m = 4$ and $r_d =r^*$. When $N,T \to \infty$, we have \begin{align*} \sup_{x \in \mathbb{R}} \left| P^* \left( \sqrt{N} (\hat S^{H*} - \hat S^H) \le x \right) - \Pr \left( \mathcal{N} \left(0, \nabla h(G) \Gamma (\nabla h(G))^\top \right) \le x \right) \right| \stackrel{p}{\longrightarrow} 0. \end{align*}

The cross-sectional bootstrap can approximate the asymptotic distribution of the HPJ estimator correctly under the condition that $N/T^2 $ does not diverge. Because the HPJ estimator has a smaller bias, the bootstrap approximation is more appropriate for the HPJ estimator.

Lastly, we show the pointwise validity of the bootstrap for the estimator of the distribution function evaluated at some point $a \in \mathbb{R}$.\footnote{While a uniform validity of the cross-sectional bootstrap for the distribution estimator would be desirable, this investigation is challenging because it requires new empirical process techniques. For now, we leave it as an interesting future research topic. } Let $\xi_i$ be one of $\mu_i$, $\gamma_{k,i}$, and $\rho_{k,i}$ with the distribution function $F_0 = F_0^\xi$, and $\hat \xi_i$ be the corresponding estimator. The pointwise estimator of $F_0(a)$ at $a \in \mathbb{R}$ is $\mathbb{F}_N (a) = N^{-1} \sum_{i=1}^N \mathbf{1}(\hat \xi_i \le a)$. The bootstrap estimator is $\mathbb{F}_N^* (a) \coloneqq N^{-1} \sum_{i=1}^N \mathbf{1}(\hat \xi_i^* \le a)$.

theoremSuppose that the assumptions in Theorem (ref) hold. When $N,T \to \infty$, it holds that \begin{align*} \sup_{x \in \mathbb{R}} \left| P^* \left(\sqrt{N}\left(\mathbb{F}_N^{*} (a) - \mathbb{F}_N(a)\right) \le x \right) - \Pr\Big( \mathcal{N} \Big(0, F(a)(1 - F(a)) \Big) \le x \Big) \right| \stackrel{p}{\longrightarrow} 0. \end{align*}

If the rate condition $N^{3 + \epsilon} / T^4 \to 0$ is satisfied for some $\epsilon \in (0, 1/3)$, the bootstrap distribution consistently estimates the asymptotic distribution of $\mathbb{F}_N(a)$.

Difference in degrees of heterogeneity

We develop a two-sample KS test as an application of the convergence for the distribution estimator in Section (ref). Specifically, we develop a test to examine whether the distributions of $\mu_i$, $\gamma_{k,i}$, and $\rho_{k,i}$ differ across distinct groups. In many applications, it would be interesting to see whether distinct groups possess different heterogeneous structures. For example, when studying the LOP deviation, we may want to know whether the distribution of LOP adjustment speed differs between goods and services. We develop a testing procedure for such hypotheses without any parametric specification. We consider two panel data sets for two different groups: $\{\{y_{it,(1)} \}_{t=1}^{T_{1}} \}_{i=1}^{N_1}$ and $\{\{y_{it,(2)}\}_{t=1}^{T_{2}}\}_{i=1}^{N_2}$. We allow $T_1 \neq T_2$ and/or $N_1 \neq N_2$. Define $y_{i,(1)} \coloneqq \{y_{it,(1)}\}_{t=1}^{T_{1}}$ and $y_{i,(2)} \coloneqq \{y_{it,(2)}\}_{t=1}^{T_{2}}$.

We estimate the distributions of the mean, autocovariances, or autocorrelations for each group. Let $\xi_{i,(a)} = \mu_{i,(a)}$, $\gamma_{k,i,(a)}$, or $\rho_{k,i,(a)}$ be the true quantity for group $a=1,2$. Let $\hat \xi_{i,(a)} = \hat \mu_{i,(a)}$, $\hat \gamma_{k,i,(a)}$, or $\hat \rho_{k,i,(a)}$ be the corresponding estimator of $\xi_{i,(a)}$. We denote the probability distribution of $\xi_{i,(a)}$ by $P_{0,(a)} = P_{0,(a)}^{\xi}$ and the empirical distribution of $\hat \xi_{i,(a)}$ by $\mathbb{P}_{N_a,(a)} = \mathbb{P}_{N_a,(a)}^{\hat \xi}$ for $a=1,2$.

We focus on the following hypothesis to examine the difference in the degrees of heterogeneity between the two groups.

align*[align* omitted — 101 chars of source]

Under the null hypothesis $H_0$, the distributions are identical for the two groups.

We investigate the hypothesis using the following two-sample KS statistic based on our empirical distribution estimators.

align*[align* omitted — 265 chars of source]

where $\| \cdot \|_{\infty}$ is the uniform norm. This measures the distance between the empirical distributions of the two groups and differs from the usual two-sample KS statistic in that it is based on the empirical distributions of the estimates.

We introduce the following assumption about the data sets.

assumptionEach of $\{\{y_{it,(1)} \}_{t=1}^{T_{1}} \}_{i=1}^{N_1}$ and $\{\{y_{it,(2)}\}_{t=1}^{T_{2}}\}_{i=1}^{N_2}$ satisfies Assumptions (ref), (ref), (ref), and (ref) with $r_m = 4$, $r_d = 4$ when $\hat \xi_{i,(a)} = \hat \mu_{i,(a)}$ and $\xi_{i,(a)} = \mu_{i,(a)}$; Assumptions (ref), (ref), (ref), and (ref) with $r_m = 8$, $r_d = 8$ when $\hat \xi_{i,(a)} = \hat \gamma_{k,i,(a)}$ and $\xi_{i,(a)} = \gamma_{k,i,(a)}$; and Assumptions (ref), (ref), (ref), and (ref) with $r_m = 8$, $r_d = 8$ when $\hat \xi_{i,(a)} = \hat \rho_{k,i,(a)}$ and $\xi_{i,(a)} = \rho_{k,i,(a)}$. $(y_{1,(1)}, \dots, y_{N_1,(1)})$ and $(y_{1,(2)}, \dots, y_{N_2, (2)})$ are independent.

We need the assumptions introduced in the previous sections along with the independence assumption, which implies that our test cannot be used to determine the equivalence of the distributions of two variables from the same units. Our test is intended to compare the distributions of the same variable from different groups. It is also important to note that this independence assumption may collapse when there are some time effects. For example, when the time periods of the two panel data sets overlap, the panel data sets can be dependent given the presence of common time trends.

The asymptotic null distribution of $KS_2$ is derived using Theorem (ref).

theoremSuppose that Assumption (ref) is satisfied. When $N_{1},T_{1} \to \infty$ with $N_{1}^{3+\epsilon}/T_{1}^4 \to 0$ and $N_{2},T_{2} \to \infty$ with $N_{2}^{3+\epsilon}/T_{2}^4 \to 0$ for some $\epsilon \in (0, 1/3)$ and $N_1 / (N_1 + N_2) \to \lambda$ for some $\lambda \in (0,1)$, it holds that $KS_2$ converges in a distribution to $\| \mathbb{G}_{P_{0,(1)}} \|_{\infty}$ under $H_{0}$.

The asymptotic null distribution of $KS_2$ is the uniform norm of a Gaussian process. We require the conditions $N_1^{3 + \epsilon} / T_1^{4} \to 0$ and $N_2^{3 + \epsilon} / T_2^{4} \to 0$ to use the result of Theorem (ref). The condition $N_1/(N_1+N_2) \to \lambda$ implies that $N_1$ is not much greater or less than $N_2$ and guarantees the existence of the asymptotic null distribution.

Note that the asymptotic distribution does not depend on $P_{0,(1)}$, and critical values can be computed readily. Kolmogorov1933 and Smirnov1944 (for easy reference see, e.g., Theorem 6.10 in Shao03 or Section 2.1.5 in Serfling02) showed that

align[align omitted — 144 chars of source]

for any continuous distribution $P_{0,(1)}$, with $a > 0$. The right-hand side of (ref) does not depend on $P_{0,(1)}$. Moreover, the critical values are readily available in many statistical software packages and it is easy to implement our tests.

remarkWhen the true distributions of the estimated quantities, $\hat \xi_{i,(1)}$ and $\hat \xi_{i,(2)}$, are the same, i.e., when $P_{T_1,(1)}^{\hat \xi} = P_{T_2,(2)}^{\hat \xi}$, neither the condition $N_1^{3 + \epsilon} / T_1^4 \to 0$ nor $N_2^{3 + \epsilon} / T_2^4 \to 0$ is needed to establish Theorem (ref). In particular, when $T_1 = T_2$ and the mean and dynamic structures of the two groups are completely identical under the null hypothesis, we can test the null hypothesis $H_0$ without restricting the relative order of $N_a$ and $T_a$ for $a=1,2$. In this case, both of the distribution function estimates suffer from the same bias, which is canceled out in $KS_2$ under the null hypothesis. Note that we still need the condition $N_1/(N_1 + N_2) \to \lambda \in (0,1)$.

Empirical application

We apply our procedures to panel data on prices in US cities. The speed of price adjustment toward the long-run law of one price (LOP) has important implications in economics. AndersonVanWincoop04 survey the literature on price adjustment and trade costs. Several studies focus on the properties of heterogeneity in price deviations from the LOP based on model specifications. For example, EngelRogers01 and ParsleyWei01 examine the heterogeneity in the time-series volatility of the LOP deviation, and CruciniShintaniTsuruga15 consider the heterogeneous properties for the time-series persistence of the LOP deviation.

We investigate the heterogeneous properties of the LOP deviations across cities and items using our procedures. We examine whether the LOP deviations dynamics are heterogeneous depending on the item-specific unobserved component such as city- or item-specific permanent trade costs or the item category (e.g., goods or services). Our model-free empirical results complement the findings in existing studies by investigating the heterogeneous properties of the permanent amount, time-series volatility, and persistence of the LOP deviations across cities and items.

Data

We use data from the American Chamber of Commerce Researchers Association Cost of Living Index produced by the Council of Community and Economic Research.\footnote{Mototsugu Shintani kindly provided us with the dataset ready for analysis.} ParsleyWei96, YazganYilmazkuday11, and CruciniShintaniTsuruga15 use the same data set as LeeOkuiShintani13 do for their empirical illustration. The data set contains quarterly price series of 48 consumer price index categorized goods and services for 52 US cities from 1990Q1 to 2007Q4.\footnote{While the original data source contains price information for more items in more cities, we restrict the observations to obtain a balanced panel data set, as in CruciniShintaniTsuruga15.}

The LOP deviation for item $k$ in city $i$ at time $t$ is $y_{i k t}=\ln p_{i k t}-\ln p_{0kt}$ where $p_{ikt}$ is the price of item $k$ in city $i$ at time $t$ and $p_{0kt}$ is that for the benchmark city of Albuquerque, NM. In this empirical application, we regard each item--city pair as a cross-sectional unit, implying a focus on the heterogeneity of the dynamic structures of the LOP deviations across item--city pairs. The number of units is $N=2448$ ($= 48 \times 51$) and the length of the time series is $T=72$ ($=18 \times 4$).

Results

Table (ref) summarizes the estimates based on the empirical distribution without bias correction (ED) and the HPJ and TOJ estimates for the distributional features of the heterogeneous means, variances, and first-order autocorrelations of the LOP deviations. The estimates of mean, standard deviation (std), 25% quantile (Q25), median (Q50), and 75% quantile (Q75) for each quantity are presented. We also estimate the correlations between these three quantities. The 95% confidence intervals are computed using the cross-sectional bootstrap.

table[table omitted — 2,763 chars of source]

The results show that the bias-corrected estimates can substantially differ from the ED estimates, even though this data set has a relatively long time series. In particular, both HPJ and TOJ estimates imply more volatile and persistent dynamics than those implied by the ED estimates. This result demonstrates that the bias correction is important even when $T$ is relatively large.

LOP deviations exhibit significant heterogeneity across item--city pairs, as shown in the estimates of the standard deviations and quantiles of the heterogeneous means, variances, and first-order autocorrelations. The standard deviation estimate of the heterogeneous mean indicates a substantial degree of permanent price differences across cities and items. Likewise, the magnitude of the variance in price differences shows large heterogeneity. Interestingly, the positive correlation between the means and the variances implies that the larger the permanent LOP deviation is, the larger the variance of the deviation tends to be.

The results for the first-order autocorrelations indicate that the LOP deviations are serially positively correlated. The amount of heterogeneity implied by the bias-corrected estimates is less than that implied by the ED estimate, but all estimates imply that the first-order autocorrelations have a substantial degree of heterogeneity. The first-order autocorrelations are negatively correlated with the mean LOP deviation, and the correlation between first-order autocorrelations and variances is slightly positive. This result indicates that item--city pairs with persistent price difference tend to have small permanent price differences but tend to suffer from relatively large shocks.

We also examine whether the distribution of the LOP deviations dynamics differs between goods and services, similarly to prior works that point out different price dynamics between goods and services (e.g., ParsleyWei96 and NakamuraSteinsson08). Table (ref) describes the classification of goods and services in our analysis. Table (ref) summarizes the estimation results, which indicate that price dynamics for goods are markedly different from those of services. In particular, prices for services tend to have more persistent dynamics. In fact, the value of the two-sample KS test for the first-order autocorrelations is 0.353, with a $p$-value of 0. This provides statistical evidence that the speed of price adjustment for services is slower than that for goods.

table[table omitted — 1,130 chars of source]
table[table omitted — 4,153 chars of source]

Our findings are informative in their own right and are in line with existing results. For example, CruciniShintaniTsuruga15 find significant heterogeneity in LOP deviation dynamics by considering city--city pairs in addition to the city--item pairs. choi2007heterogeneity find that the speed of price adjustment is heterogeneous, even among tradable goods using Japanese data. As existing studies comparing goods and services, ParsleyWei96 and NakamuraSteinsson08 find that services exhibit slower price adjustments and less frequent price changes. Those findings are based on model specifications for heterogeneity, so that our results complement them in a model-free manner with formal statistical procedures.

There could be several potential sources of significant heterogeneity in LOP deviation dynamics. For example, there may be some item- and/or city-specific unobservables, such as permanent trade costs and productivity shocks, which can be sources of heterogeneity across items and cities. As another example, an information difference across items and/or cities may lead to heterogeneous dynamic structures. From this viewpoint, CruciniShintaniTsuruga15 relate heterogeneity to an information difference across managers in different cities based on the noisy information model.

The empirical findings here are useful even when the ultimate goal of an application on the LOP deviations is a structural estimation based on some model specifications. For example, our findings here illustrate the importance of taking into account heterogeneity and the type of heterogeneity that needs to be considered in structural estimation. In particular, we demonstrate that goods and services exhibit different heterogeneous dynamic structures, so that empirical researchers should consider different heterogeneity for goods and services. Our recommendation is thus to implement the model-free procedure for understanding the properties of heterogeneous dynamics even when investigating the underlying mechanism and their implications based on structural estimation.

Monte Carlo simulation

This section presents the Monte Carlo simulation results. We conduct the simulation using { R} with 5,000 replications.

Design

For $N = 250, 1000, 4000$ and $T = 12, 24, 48$, we generate simulated data using an AR(1) process

align*[align* omitted — 103 chars of source]

where $u_{it} \sim i.i.d. \ \mathcal{N}(0,1)$. The initial observations are generated by $y_{i0} \sim i.i.d. \ \mathcal{N}(\varsigma_i, \sigma_i^2)$ and $u_{i0} \sim i.i.d. \ \mathcal{N}(0, 1)$. Note that this DGP satisfies $\mu_i = \varsigma_i$, $\gamma_{0,i}=\sigma^2_i$, and $\rho_{1,i}=\phi_i$. The unit-specific random variables $\varsigma_i, \phi_i$, and $\sigma_i^2$ are generated by the truncated normal distribution:

equation*[equation* omitted — 394 chars of source]

conditional on $\sigma_i^2 > 0$ and $|\phi_i| < 1$.

\paragraph{Parameters.} We estimate the means, standard deviations, 25%, 50%, and 75% quantiles, and correlation coefficients of $\mu_i, \gamma_{0,i}$, and $\rho_{1,i}$.

\paragraph{Estimators.} We consider three estimators: the empirical distribution (ED) without bias correction, the HPJ bias-corrected estimator, and the TOJ bias-corrected estimator.

Results

Tables (ref), (ref), (ref), and (ref) summarize the results of the Monte Carlo simulation and provide the bias and the root mean squared error (rmse) of each estimator and the coverage probability (cp) of the 95% confidence interval based on the cross-sectional bootstrap. The column labeled “true” displays the true value of the corresponding quantity.

table[table omitted — 6,424 chars of source]
table[table omitted — 6,409 chars of source]
table[table omitted — 6,397 chars of source]
table[table omitted — 4,272 chars of source]

The simulation result demonstrates that our asymptotic analyses provide information about the finite-sample behavior and the importance of bias correction. First, ED has large biases in some parameters of interest, such as the quantities $\gamma_{0,i}$ and $Cor(\gamma_{0,i}, \rho_{1,i})$. Second, for many parameters, the coverage probabilities of ED differ significantly from 0.95 because of these large biases. Third, the biases and coverage probabilities of ED can improve when $T$ is large, although significant biases can remain, even with a large $T$. These results recommend the importance of developing a bias-correction method.

The split-panel jackknife bias correction reduces biases and improves coverage probabilities for many parameters. HPJ can work well, especially when biases in ED are large. The coverage probabilities of HPJ are satisfactory for about half of the cases, in particular those with large $T$ and those in which the parameter of interest is $\mu_i$ and $\rho_{1,i}$. Conversely, when $T$ is small and when the parameter of interest is $\gamma_{0,i}$ or std, they are not satisfactory. We suspect that large higher-order biases caused by a small $T$ or highly nonlinear parameters may be present in those cases in which HPJ does not work well. For such cases, TOJ can further improve both the biases and coverage probabilities, which can be expected by our discussion for higher-order jackknife in the supplementary appendix. In contrast, in some cases TOJ eliminates biases at the inevitable cost of inflation of standard deviations, which may lead to wider confidence intervals, and the coverage probabilities for TOJ may be over 0.95 when estimating some quantiles.

In summary, our recommendation based on these simulation results is to employ split-panel jackknife bias-corrected estimation. When HPJ and TOJ estimates are close to each other, both estimates could be reliable. In contrast, when both estimates differ due to a severe higher-order bias, we could rely on TOJ, especially when estimating highly nonlinear parameters, while being cautious about the precision of point estimates. ED is not recommended.

Conclusion

This paper proposes methods to analyze heterogeneous dynamic structures using panel data. Our methods are easily implemented without requiring a model specification. We first compute the sample mean, autocovariances, and autocorrelations for each unit. We then use these to estimate the parameters of interest, such as the distribution function, the quantile function, and the other moments of the heterogeneous mean, autocovariances, and/or autocorrelations. We establish conditions on the relative magnitudes of $N$ and $T$ under which the estimator for the distribution function does not suffer from asymptotic bias. When the parameter of interest can be written as the expected value of a smooth function of the heterogeneous mean and/or autocovariances, the bias of the estimator is of order $O(1/T)$ and can be reduced using the split-panel jackknife bias correction. In addition, we develop inference based on the cross-sectional bootstrap and provide an extension based on the proposed procedures involving the testing of differences in heterogeneous dynamic structures across distinct groups. We apply our procedures to the dynamics of LOP deviations in different US cities for various items and obtain new empirical evidence for significant heterogeneity. The results of the Monte Carlo simulations demonstrate the desirable properties of the proposed procedures.

\paragraph{Future work.} Several future research topics are possible. First, it would be interesting to develop a formal testing procedure to examine whether the dynamics are heterogeneous. We are currently working on this extension. Second, it would be interesting to examine quantities in addition to means and autocovariances. For example, ArellanoBlundellBonhomme15 highlight the importance of nonlinearity and conditional skewness in earnings and consumption dynamics. Third, while we developed our analysis for stationary panel data, it would be interesting to consider nonstationary panel data. Finally, while we focus only on balanced panel data, an analysis based on unbalanced panel data would be useful.