EconBase
← Back to paper

Network and Panel Quantile Effects Via Distribution Regression

Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.

220,345 characters · 23 sections · 89 citation commands

Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.

Network and Panel Quantile Effects Via Distribution Regression

abstractThis paper provides a method to construct simultaneous confidence bands for quantile functions and quantile effects in nonlinear network and panel models with unobserved two-way effects, strictly exogenous covariates, and possibly discrete outcome variables. The method is based upon projection of simultaneous confidence bands for distribution functions constructed from fixed effects distribution regression estimators. These fixed effects estimators are debiased to deal with the incidental parameter problem. Under asymptotic sequences where both dimensions of the data set grow at the same rate, the confidence bands for the quantile functions and effects have correct joint coverage in large samples. An empirical application to gravity models of trade illustrates the applicability of the methods to network data.

{\bf Keywords:} Quantile Effects, Counterfactual Distributions, Fixed Effects, Incidental Parameter Problem, Long Panels

Introduction

Standard regression analyzes average effects of covariates on outcome variables. In many applications it is equally important to consider distributional effects. For example, a policy maker might be interested in the effect of an education reform not only on the mean but also the entire distribution of test scores or wages. Availability of panel data is very useful to identify ceteris paribus average and distributional effects because it allows the researcher to control for multiple sources of unobserved heterogeneity that might cause endogeneity or omitted variable problems. The idea is to use variation of the covariates over time for each individual or over individuals for each time period to account for unobserved individual and time effects. In this paper we develop inference methods for distributional effects in nonlinear models with two-way unobserved effects. They apply not only to traditional panel data models where the unobserved effects correspond to individual and time fixed effects, but also to models for other types of data where the unobserved effects reflect some grouping structure such as unobserved sender and receiver effects in network data models. The unobserved effects will be treated as fixed effects, i.e. parameters to be estimated, leaving their relation to observed covariates unrestricted.

We develop inference methods for quantile functions and effects. The quantile function corresponds to the marginal distribution of the outcome in a counterfactual scenario where the treatment covariate of interest is set exogenously at a desired level and the rest of the covariates and unobserved effects are held fixed, extending the construction of Chernozhukov Fernandez-Val and Melly ChernozhukovFernandezValMelly2013 for the cross section case. The quantile effect is the difference of quantile functions at two different treatment levels. Our methods apply to continuous and discrete treatments by appropriate choice of the treatment levels, and have causal interpretation under standard unconfoundedness assumptions for panel data. The inference is based upon the generic method of Chernozhukov, Fernandez-Val, Melly, and Wuthrich CFVMW2015 that projects joint confidence bands for distributions into joint confidence bands for quantile functions and effects. This method has the appealing feature that applies without modification to any type of outcome, let it be continuous, discrete or mixed.

The key input for the inference method is a joint confidence band for the counterfactual distributions at the treatment levels of interest. We construct this band from fixed effects distribution regression (FE-DR) estimators of the conditional distribution of the outcome given the observed covariates and unobserved effects. In doing so, we extend the distribution regression approach to model conditional distributions with unobserved effects. This version of the DR model is semiparametric because not only the DR coefficients can vary with the level of the outcome as in the cross section case, but also the distribution of the unobserved effects is left unspecified. We show that the FE-DR estimator can be obtained as a sequence of binary response fixed effects estimators where the binary response is an indicator of the outcome passing some threshold. To deal with the incidental parameter problem associated with the estimation of the unobserved effects (Neyman and Scott NeymanScott1948), we extend the analytical bias corrections of FernandezValWeidner2016 for single binary response estimators to multiple (possibly a continuum) of binary response estimators. In particular, the main technical contribution is to establish functional central limit theorems for the fixed effects estimators of the DR coefficients and associated counterfactual distributions, and show the validity of the bias corrections under asymptotic sequences where the two dimensions of the data set pass to infinity at the same rate. As in the single binary response model, the bias corrections remove the asymptotic bias of the fixed effects estimators without increasing their asymptotic variances.

We implement the inference method using multiplier bootstrap gz-84. This version of bootstrap constructs draws of an estimator as weighted averages of its influence function, where the weights are independent from the data. Compared to empirical bootstrap, multiplier bootstrap has the computational advantage that it does not involve any parameter reestimation. This advantage is particularly convenient in our setting because the parameter estimation require multiple nonlinear optimizations that can be highly dimensional due to the fixed effects. Multiplier bootstrap is also convenient to account for data dependencies. In network data, for example, it might be important to account for reciprocity or pairwise clustering. Reciprocity arises because observational units corresponding to the same pair of agents but reversing their roles as sender and receiver might be dependent even after conditioning on the unobserved effects. By setting the weights of these observational units equal, we account for this dependence in the multiplier bootstrap. In addition to the previous practical reasons, there are some theoretical reasons for choosing multiplier bootstrap. Thus, cck-16 established bootstrap functional central limit theorems for multiplier bootstrap in high dimensional settings that cover the network and panel models that we consider.

The methods developed in this paper apply to models that include unobserved effects to capture grouping or clustering structures in the data such as models for panel and network data. These effects allow us to control for unobserved group heterogeneity that might be related to the covariates causing endogeneity or omitted variable bias. They also serve to parsimoniously account for dependencies in the data. We illustrate the wide applicability with an empirical example to gravity models of trade. In this case the outcome is the volume of trade between two countries and each observational unit corresponds to a country pair indexed by exporter country (sender) and importer country (receiver). We estimate the distributional effects of gravity variables such as the geographical distance controlling for exporter and importer country effects that pick up unobserved heterogeneity possibly correlated with the gravity variables. We uncover significant heterogeneity in the effects of distance and other gravity variables across the distribution, which is missed by traditional mean methods. We also find that the Poisson model, which is commonly used in the trade literature to deal with zero trade in many country pairs, does not provide a good approximation to the distribution of the volume of trade due to heavy tails.

\paragraph{Literature review} Unlike mean effects, there are different ways to define distributional and quantile effects. For example, we can distinguish conditional effects versus unconditional or marginalized effects, or quantile effects versus quantiles of the effects. Here we give a brief review of the recent literature on distributional and quantile effects in panel data models emphasizing the following aspects: (1) type of effect considered; (2) type of unobserved effects in the model; and (3) asymptotic approximation. For the unobserved effects, we distinguish models with one-way effects versus two-way effects. For the asymptotic approximation we distinguish short panels with large $N$ and fixed $T$ versus long panels with large $N$ and large $T$ , where $N$ and $T$ denote the dimensions of the panel. We focus mainly on fixed effects approaches where the unobserved effects are treated as parameters to be estimated, but also mention some correlated random effects approaches that impose restrictions on the distribution of the unobserved effects. This paper deals with inference on marginalized quantile effects in large panels with two-way effects, which has not been previously considered in the literature. Indeed, to the best of our knowledge, it is the first paper to provide inference methods for quantile treatment effects from panel and network models with two-way fixed effects.

Koenker Koenker2004 introduced fixed effects quantile regression estimators of conditional quantile effects in large panel models with one-way individual effects using shrinkage to control the variability in the estimation of the unobserved effects. Lamarche2010 discussed the optimal choice of a tuning parameter in Koenker's method. In the same framework, Kato, Galvao, and Montes-Rojas KatoGalvaoMontesRojas2012, Galvao, Lamarche and Lima GalvaoLamarcheLima2013, Galvao and Kato GalvaoKato2016 and Arellano and Weidner ArellanoWeidner2016 considered fixed effects quantile regression estimators without shrinkage and developed bias corrections. All these papers require that $T$ pass to infinity faster than $N$, making it difficult to extend the theory to models with two-way individual and time effects. Graham, Hahn and Powell GrahamHahnPowell2009 found a special case where the fixed effects quantile regression estimator does not suffer of incidental parameter problem. Machado and Santos Silva mss18 has recently proposed a method to estimate conditional quantile effects in a location-scale model via moments.

In short panels, Rosen Rosen2012 showed that a linear quantile restriction is not sufficient to point identify conditional effects in a panel linear quantile regression model with unobserved individual effects. Chernozhukov, Fernandez-Val, Hahn and Newey ChernozhukovFernandezValHahnNewey2013 and chernozhukov2015nonparametric discussed identification and estimation of marginalized quantile effects in nonseparable panel models with unobserved individual effects and location and scale time effects under a time homogeneity assumption. They showed that the effects are point identified only for some subpopulations and characterized these subpopulations. Graham, Hahn, Poirier and Powell GrahamHahnPoirierPowell2015 considered quantiles of effects in linear quantile regression models with two-way effects. Finally, Abrevaya and Dahl AbrevayaDahl2008 and Arellano and Bonhomme ArellanoBonhomme2016 developed estimators for conditional quantile effects in linear quantile regression model with unobserved individual effects using correlated random effects approaches. None of the previous quantile regression based methods apply to discrete outcomes.

Finally, we review previous applications of panel data methods to network data. These include candelaria16, charbonneau17, CFW-16, Dzemski2017, FernandezValWeidner2016, gao20, Graham2016, Graham2017, jochmans18, toth17, and Yan2016statistical, which developed methods for models of network formation with unobserved sender and receiver effects for directed and undirected networks.\footnote{We refer to paula19 for an excellent up to date review on this topic.} None of these papers consider estimation of quantile effects as the outcome variable is binary, whether or not a link is formed between two agents.

\paragraph{Plan of the paper} Section (ref) introduces the distribution regression model with unobserved effects for network and panel data, and describes the quantities of interest including model parameters, distributions, quantiles and quantile effects. Section (ref) discusses fixed effects estimation, bias corrections to deal with the incidental parameter problem, and uniform inference methods. Section (ref) provides asymptotic theory for the fixed effects estimators, bias corrections, and multiplier bootstrap. Section (ref) and (ref) report results of the empirical application to the gravity models of trade and a Monte Carlo simulation calibrated to the application, respectively. The proofs of the main results are given in the Appendix, and additional technical results are provided in the Supplementary Appendix.

\paragraph{Notation} For any two real numbers $a$ and $b$, $a\vee b = \max\{a,b\}$ and $a\wedge b = \min\{a,b\}$. For a real number $a$, $\lfloor a \rfloor$ denotes the integer part of $a$. For a set $\mathcal{A}$, $| \mathcal{A}|$ denotes the cardinality or number of elements of $\mathcal{A}$.

Model and Parameters of Interest

Distribution Regression Model with Unobserved Effects

We observe the data set $\{(y_{ij}, x_{ij}) : (i,j) \in \mathcal{D} \}$, where $y_{ij}$ is a scalar outcome variable with region of interest $\mathcal{Y}$, and $x_{ij}$ is a vector of covariates with support $\mathcal{X} \subseteq \mathbb{R}^{d_x}$.\footnote{If $y_{ij}$ has unbounded support, then the region $\mathcal{Y}$ is usually a subset of the support to avoid tail estimation.} The variable $y_{ij}$ can be discrete, continuous or mixed. The subscripts $i$ and $j$ index individuals and time periods in traditional panels, but they might index other dimensions in more general data structures. In our empirical application, for example, we use a panel where $y_{ij}$ is the volume of trade between country $i$ and country $j$, and $x_{ij}$ includes gravity variables such as the distance between country $i$ and country $j$. Both $i$ and $j$ index countries as exporters and importers respectively. The set $\mathcal{D}$ contains the indexes of the pairs $(i,j)$ that are observed. It is a subset of the set of all possible pairs $\mathcal{D}_0 := \{(i,j) : i = 1,\dots,I; j = 1, \dots, J \}$, where $I$ and $J$ are the dimensions of the panel. We introduce $\mathcal{D}$ to allow for certain forms of missing data that are common in panel and network applications, see Assumption (ref)(v) in Section (ref). For example, in the trade application $I=J$ and $\mathcal{D} = \mathcal{D}_0 \setminus \{(i,i) : i = 1,\dots,I \}$ because we do not observe trade of a country with itself. We denote the total number of observed units by $n$, i.e. $n = |\mathcal{D}|$.

Let $v_i$ and $w_j$ denote vectors of unspecified dimension that contain unobserved random variables or effects that might be related to the covariates $x_{ij}$. In traditional panels, $v_i$ are individual effects that capture unobserved individual heterogeneity and $w_j$ are time effects that account for aggregate shocks. More generally, these variables serve to capture some forms of endogeneity and group dependencies in a parsimonious fashion. We specify the conditional distribution of $y_{ij}$ given $(x_{ij},v_i,w_{j})$ using the distribution regression (DR) model with unobserved effects

equation[equation omitted — 187 chars of source]

where $\Lambda_y$ is a known link function such as the normal or logistic distribution, which may vary with $y$, $x \mapsto P(x)$ is a dictionary of transformations of $x$ such us polynomials, b-splines and tensor products, $\beta(y)$ is an unknown parameter vector, which can vary with $y$, and $(v,y) \mapsto \alpha(v,y)$ and $(w,y) \mapsto \gamma(w,y)$ are unspecified measurable functions. This DR model is a semiparametric model for the conditional distribution because $y \mapsto \theta(y) := (\beta(y),\alpha(v_1,y), \ldots, \alpha(v_I,y), \gamma(w_1,y), \ldots, \gamma(w_J,y))$ is a function-valued parameter and the dimension of $\theta(y)$ varies with $I$ and $J$, although we do not make this dependence explicit. We shall treat the dimension of $P(x)$ as fixed and set $\Lambda_y$ equal to the logistic distribution for all $y$ in the asymptotic analysis.

When $y_{ij}$ is continuous, the model (ref) has the following representation as an implicit nonseparable model by the probability integral transform $$ \Lambda_{y_{ij}}(P(x_{ij})'\beta(y_{ij}) + \alpha(v_i,y_{ij}) + \gamma(w_{j}, y_{ij})) = u_{ij}, \ \ u_{ij} \mid x_{ij}, v_i, w_{j} \sim U(0,1), $$ where the error $u_{ij}$ represents the unobserved ranking of the observation $y_{ij}$ in the conditional distribution. The parameters of the model are related to derivatives of the conditional quantiles. Let $Q_{y_{ij}}(u \mid x_{ij}, v_{i}, w_{j})$ be the $u$-quantile of $y_{ij}$ conditional on $(x_{ij}, v_{i}, w_{j})$ defined as the left-inverse of $y \mapsto F_{y_{ij} }(y \mid x_{ij}, v_i, w_{j})$ at $u$, namely $$ Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j}) = \inf\{y \in \mathcal{Y} : F_{y_{ij} }(y \mid x_{ij}, v_i, w_{j}) \geq u\} \wedge \sup \{ y \in {\mathcal{Y}}\}, $$ and $x_{ij} = (x_{ij}^1,\ldots, x_{ij}^{d_x})$.\footnote{We use the convention $\inf \{\emptyset\} = + \infty$.} Then, it can be shown that if $y \mapsto F_{y_{ij} }(y \mid x_{ij}, v_i, w_{j})$ is strictly increasing in the support of $y_{ij}$, $\partial \Lambda_y(z)/\partial z > 0$ for all $y$ in the support of $y_{ij}$ and $x_{ij} \mapsto Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j})$ is differentiable,\footnote{Indeed, $\Lambda_y(P(x_{ij})'\beta(y) + \alpha(v_i,y) + \gamma(w_{j}, y)) =u$ at $y = Q_{y_{ij}}(u \mid x_{ij}, v_{i}, w_{j})$. Differencing this expression with respect to $x_{ij}^k$ yields $$\left. \partial_{x_{ij}^{k}} P(x_{ij})'\beta(y) \right|_{y = Q_{y_{ij}}(u \mid x_{ij}, v_{i}, w_{j})} = - \left. \frac{\partial \Lambda_y\left(P(x_{ij})'\beta(y) + \alpha(v_i,y) + \gamma(w_{j}, y) \right)/\partial y}{\lambda_y\left(P(x_{ij})'\beta(y) + \alpha(v_i,y) + \gamma(w_{j}, y)\right)} \right|_{y = Q_{y_{ij}}(u \mid x_{ij}, v_{i}, w_{j})} \partial_{x_{ij}^{k}} Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j}),$$ where $\lambda_y(z) = \partial \Lambda_y(z)/\partial z$. Note that the first term of the right hand side does not depend on $k$ and is positive because $y \mapsto F_{y_{ij} }(y \mid x_{ij}, v_i, w_{j}) = \Lambda_y(P(x_{ij})'\beta(y) + \alpha(v_i,y) + \gamma(w_{j}, y))$ is strictly increasing at $y = Q_{y_{ij}}(u \mid x_{ij}, v_{i}, w_{j})$.} $$ \left. \partial_{x_{ij}^{k}} P(x_{ij})'\beta(y) \right|_{y=Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j})} \propto - \partial_{x_{ij}^{k}} Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j}), \ \ k = 1,\ldots,d_x, \ \ \partial_{x_{ij}^{k}} := \partial/ \partial x_{ij}^k. $$ If $P(x_{ij}) = x_{ij}$, then $\partial_{x_{ij}^{k}} P(x_{ij})'\beta(y) = \beta_{k}(y)$ such that $$ \left. \frac{\beta_{\ell}(y)}{\beta_k(y)} \right|_{y = Q_{y_{ij}}(u \mid x_{ij}, v_{i}, w_{j})} = \frac{\partial_{x_{ij}^{\ell}} Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j})}{\partial_{x_{ij}^k} Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j})}, \ \ \ell,k = 1,\ldots,d_x, $$ provided that $\partial_{x_{ij}^k} Q_{y_{ij} }(u \mid x_{ij}, v_{i}, w_{j}) \neq 0.$ The DR coefficients therefore are proportional to (minus) derivatives of the conditional quantile function, and ratios of DR coefficients correspond to ratios of derivatives.

remark[Parametric models] There are many parametric models that are special cases of the DR model. Thus, ChernozhukovFernandezValMelly2013 and Chernozhukov, Fernandez-Val, Melly, and Wuthrich CFVMW2015 showed that the standard linear model, Cox proportional hazard model and Poisson regression model are encompassed by the DR model in the cross section case. These inclusions carry over to the panel versions of these models with two-way unobserved effects. {\tiny \ensuremath{\blacksquare} }

Estimands

In addition to the model parameter $\beta(y)$, we are interested in measuring the effect on the outcome of changing one of the covariates holding the rest of the covariates and the unobserved effects fixed. Let $x = (t, z')'$, where $t$ is the covariate of interest or treatment and $z$ are the rest of the covariates that usually play the role of controls. One effect of interest is the quantile (left-inverse) function (QF) $$ Q_k(\tau) = F_k^{\leftarrow}(\tau) := \inf \{y \in \mathcal{Y} : F_k(y) \geq \tau\} \wedge \sup \{ y \in {\mathcal{Y}}\}, \ \ \tau \in (0,1), $$ where $$ F_k(y) = n^{-1} \sum_{(i,j) \in \mathcal{D}} \Lambda_y(P(t_{ij}^k,z_{ij}')'\beta(y) + \alpha(v_i,y) + \gamma(w_j,y)), $$ $t_{ij}^k$ is a level of the treatment that may depend on $t_{ij}$, and $k \in \{0,1\}$. We provide examples below. Note that in the construction of the counterfactual distribution $F_k$, we marginalize $(x_{ij},v_i,w_j)$ using the empirical distribution. The resulting effects are finite population effects. We shall focus on these effects because conditioning on the covariates and unobserved effects is natural in the trade application.\footnote{The distinction between finite and infinite population effects does not affect estimation, but affects inference AAIW-14. The estimators of infinite population effects need to account for the additional sampling variation coming from the estimation of the distribution of $(x_{ij},v_i,w_j)$.} We construct the quantile effect function (QEF) by taking differences of the QF at two treatment levels $$ \Delta(\tau) = Q_1(\tau) - Q_0(\tau), \ \ \tau \in (0,1). $$

We can also obtain the average effect using the relationship between averages and distributions. Thus, the average effect is $$ \Delta = \mu_1 - \mu_0, $$ where $\mu_k$ is the counterfactual average obtained from $F_k$ as

equation[equation omitted — 95 chars of source]

The integral in (ref) is over the real line, but the formula nevertheless is applicable to the case where the support of $dF_k$ is discrete or mixed.

The choice of the levels $t_{ij}^0$ and $t_{ij}^1$ is usually based on the scale of the treatment:

itemize• If the treatment is binary, $\Delta(\tau)$ is the $\tau$-quantile treatment effect with $t_{ij}^0 = 0$ and $t_{ij}^1 = 1$. • If the treatment is continuous, $\Delta(\tau)$ is the $\tau$-quantile effect of a unitary or one standard deviation increase in the treatment with $t_{ij}^0 = t_{ij}$ and $t_{ij}^1 = t_{ij} + d$, where $d$ is $1$ or the standard deviation of $t_{ij}$. • If the treatment is the logarithm of a continuous treatment, $\Delta(\tau)$ is the $\tau$-quantile effect of doubling the treatment (100% increase) with $t_{ij}^0 = t_{ij}$ and $t_{ij}^1 = t_{ij} +\log 2$.

For example, in the trade application we use the levels $t_{ij}^0 = 0$ and $t_{ij}^1 = 1$ for binary covariates such as the indicators for common legal system and free trade area, and $t_{ij}^0 = t_{ij}$ and $t_{ij}^1 = t_{ij} +\log 2$ for the logarithm of distance.

All the previous estimands have causal interpretation under the standard unconfoundedness or conditional independence assumption for panel data where the conditioning set includes not only the observed controls but also the unobserved effects.

Fixed Effects Estimation and Uniform Inference

To simplify the notation in this section we write $P(x_{ij}) = x_{ij}$ without loss of generality, and define $\alpha_i(y) := \alpha(v_i,y)$ and $\gamma_{j}(y) := \gamma(w_{j},y)$.

Fixed Effects Distribution Regression Estimator

The parameters of the DR model can be estimated from multiple binary regressions with two-way effects. To see this, note that the conditional distribution in (ref) can be expressed as $$ \Lambda_y(x_{ij}'\beta(y) + \alpha_i(y) + \gamma_{j}(y)) = {\mathbb{E}}[1\{y_{ij} \leq y \} \mid x_{ij}, v_i, w_{j}] . $$ Accordingly, we can construct a collection of binary variables, $$1\{y_{ij} \leq y\}, \quad (i,j) \in \mathcal{D}, \quad y \in \mathcal{Y},$$ and estimate the parameters for each $y$ by conditional maximum likelihood with fixed effects. Thus, $\widehat \theta(y) := (\widehat \beta(y),$ $\widehat \alpha_1(y), \ldots, \widehat \alpha_I(y),$ $\widehat \gamma_1(y), \ldots, \widehat \gamma_{J}(y))$, the fixed effects distribution regression estimator of $\theta(y) := (\beta(y),$ $\alpha_1(y), \ldots, \alpha_I(y),$ $\gamma_1(y), \ldots, \gamma_{J}(y))$, is obtained as

align[align omitted — 338 chars of source]

for $y \in \mathcal{Y}$. When the link function is the normal or logistic distribution, the previous program is concave and smooth in parameters and therefore has good computational properties. See FernandezValWeidner2016, CFW-16 and alpaca17 for a discussion on computation of logit and probit regressions with two-way effects and available software.

The quantile functions and effects are estimated via plug-in rule, i.e., $$ \widehat Q_k(\tau) = \widehat F_k^{\leftarrow}(\tau) \wedge \sup \{ y \in {\mathcal{Y}}\}, \quad \tau \in (0,1), \quad k \in \{0,1\}, $$ where $$ \widehat F_k(y) = n^{-1} \sum_{(i,j) \in \mathcal{D}} \Lambda_y((t_{ij}^k,z_{ij}')' \widehat \beta(y) + \widehat \alpha_i(y) + \widehat \gamma_{j}(y)), \ \ y \in {\mathcal{Y}}, $$ and $$ \widehat \Delta(\tau) = \widehat Q_1(\tau) - \widehat Q_0(\tau) \quad \tau \in (0,1). $$

{

remark[Computation] When $\mathcal{Y}$ is not finite, we replace $\mathcal{Y}$ by a finite subset $\bar{\mathcal{Y}}$. Theoretically, this approximation works provided that the Hausdorff distance between $\bar{\mathcal{Y}}$ and $\mathcal{Y}$ goes to zero at a rate faster than $1/{\sqrt n}$. In practice, if $\mathcal{Y}$ is an interval $[\underline{y}, \bar{y}]$, $\bar \mathcal{Y} $ can be a fine mesh of $\sqrt{n} \log \log n$ equidistant points covering $\mathcal{Y}$, i.e., $\bar \mathcal{Y} = \{ \underline{y}, \underline{y}+d, \underline{y}+2d, \ldots, \bar{y}\}$ for $d = (\bar y - \underline{y})/ (\sqrt{n} \log \log n)$. Alternatively, if $\mathcal{Y}$ is the support of $y_{ij}$, $\bar \mathcal{Y}$ can be a grid of $\sqrt{n} \log \log n$ sample quantiles with equidistant indexes.

Incidental Parameter Problem and Bias Corrections

Fixed effects estimators can be severely biased in nonlinear models because of the incidental parameter problem (NeymanScott1948). These models include the binary regressions that we estimate to obtain the DR coefficients and estimands. We deal with the incidental parameter problem using the analytical bias corrections of FernandezValWeidner2016 for parameters and average partial effects (APE) in binary regressions with two-way effects. We note here that the distributions $F_0(y)$ and $F_1(y)$ can be seen as APE, i.e., they are averages of functions of the data, unobserved effects and parameters.

The bias corrections are based on expansions of the bias of the fixed effects estimators as $I,J \to \infty$. For example, Theorem (ref) shows that

equation[equation omitted — 137 chars of source]

where $n R^{(F)}_k(y) = o(I \vee J)$.\footnote{FernandezValWeidner2016 considered the case where $n = IJ$, i.e., there is no missing data, so that $I/n = 1/J$ and $J/n = 1/I$.} In Section (ref) we establish that this expansion holds uniformly in $y \in \mathcal{Y}$ and $k \in \{0,1\}$, i.e., $$\sup_{k \in \{0,1\}, y \in \mathcal{Y}} \| n R^{(F)}_k(y) \| = o(I \vee J).$$ This result generalizes the analysis of FernandezValWeidner2016 from a single binary regression to multiple (possibly a continuum) of binary regressions. This generalization is required to implement our inference methods for quantile functions and effects.

The expansion (ref) is the basis for the bias corrections. Let $\widehat B^{(F)}_k(y)$ and $\widehat D^{(F)}_k(y)$ be estimators of $B^{(F)}_k(y)$ and $D^{(F)}_k(y)$, which are uniformly consistent in $y \in \mathcal{Y}$ and $k \in \{0,1\}$. Bias corrected fixed effects estimators of $F_k$ and $Q_k$ are formed as

eqnarray*[eqnarray* omitted — 240 chars of source]

We also use the corrected estimators $\widetilde F_k$ as the basis for inference and to form a bias corrected estimator of the average effect.

remark[Shape Restrictions] If the bias corrected estimator $y \mapsto \widetilde F_k(y)$ is non-monotone on $ \mathcal{Y}$, we can rearrange it into a monotone function by simply sorting the values of function in a nondecreasing order. ChernozhukovFernandezValGalichon2009 showed that the rearrangement improves the finite sample properties of the estimator. Similarly, if the $\widetilde F_k(y)$ takes values outside of $[0,1]$, winsorizing its range to this interval improves the finite sample properties of the estimator (ccfkl18). {\tiny \ensuremath{\blacksquare} }

Uniform Inference

One inference goal is to construct confidence bands that cover the QF $\tau \mapsto Q_k(\tau)$ and the QEF $\tau \mapsto \Delta(\tau)$ simultaneously over a set of quantiles $\mathcal{T} \subseteq [\varepsilon,1-\varepsilon]$, for some $0 < \varepsilon < 1/2$, and treatment levels $k \in \mathcal{K} \subseteq \{0,1\}$. The set $\mathcal{T}$ is chosen such that $Q_k(\tau) \in [\inf \{y \in \mathcal{Y}\}, \sup \{y \in \mathcal{Y} \}]$, for all $\tau \in \mathcal{T}$ and $k \in \mathcal{K}$.

We use the generic method of CFVMW2015 to construct confidence bands for quantile functions and effects from confidence bands for the corresponding distributions. Let $\mathbb{D}$ denote the space of weakly increasing functions, mapping ${\mathcal{Y}}$ to $[0,1]$. Assume we have a confidence band $I_k = [L_k,U_k]$ for $F_k$, with lower and upper endpoint functions $y \mapsto L_k(y)$ and $y \mapsto U_k(y)$ such that $L_k, U_k \in \mathbb{D}$ and $L_k(y) \leq U_k(y)$ for all $y \in \mathcal{Y}$.\footnote{If $[L_k',U_k']$ is a confidence band for $F_k$ that does not obey the constraint $L_k',U_k' \in \mathbb{D}$, we can transform $[L_k',U_k']$ into a new band $[L_k,U_k]$ such that $L_k,U_k \in \mathbb{D}$ using the rearrangement method of ChernozhukovFernandezValGalichon2009.} We say that $I_k$ covers $F_k$ if $F_k \in I_k$ pointwise, namely $L_k(y) \leq F_k(y) \leq U_k(y)$ for all $y \in {\mathcal{Y}}$. If $U_k$ and $L_k$ are some data-dependent bands, we say that $I_k$ is a confidence band for $F_k$ of level $p$, if $I_k$ covers $F_k$ with probability at least $p$. Similarly, we say that the set of bands $\{I_k : k \in \mathcal{K}\}$ is a joint confidence band for the set of functions $\{F_k : k \in \mathcal{K}\}$ of level $p$, if $I_k$ covers $F_k$ with probability at least $p$ simultaneously over $k \in \mathcal{K}$. The index set $\mathcal{K}$ can be a singleton to cover individual confidence bands or $\mathcal{K} = \{0,1\}$ to cover joint confidence bands. In Section (ref) we provide a multiplier bootstrap algorithm for computing joint confidence bands based on the joint asymptotic distribution of the bias corrected estimators $\{\widetilde F_k : k \in \mathcal{K}\}$.

The following result provides a method to construct joint confidence bands for $\{Q_k = F_k^\leftarrow : k \in \mathcal{K}\}$, from joint confidence bands for $\{ F_k : k \in \mathcal{K} \}$.

lemma[CFVMW2015 (2016, Thm. 2(1))] Consider a set of distribution functions $\{F_k : k \in \mathcal{K}\}$ and endpoint functions $ \{L_k : k \in \mathcal{K} \}$ and $\{U_k : k \in \mathcal{K}\}$ with components in the class $\mathbb{D}$. If $\{F_k : k \in \mathcal{K}\}$ is jointly covered by $ \{I_k : k \in \mathcal{K} \}$ with probability $p$, then $\{Q_k = F_k^\leftarrow : k \in \mathcal{K}\}$ is jointly covered by $ \{I_k^{\leftarrow} : k \in \mathcal{K} \}$ with probability $p$, where $$ I_k^\leftarrow(\tau): = [U_k^\leftarrow(\tau), L_k^\leftarrow(\tau)], \ \ \tau \in \mathcal{T}, \ \ k \in \mathcal{K}. $$

This Lemma establishes that we can construct confidence bands for quantile functions by inverting the endpoint functions of confidence bands for distribution functions. The geometric intuition is that the inversion amounts to rotate and flip the bands, and these operations preserve coverage.

We next construct simultaneous confidence bands for the quantile effect function $\tau \mapsto \Delta(\tau)$ defined by $$\Delta(\tau) = Q_1(\tau) - Q_0(\tau) = F_1^\leftarrow(\tau) - F_0^\leftarrow(\tau), \quad \tau \in \mathcal{T}.$$ The basic idea is to take appropriate differences of the bands for the quantile functions $Q_1$ and $Q_0$ as the confidence band for the quantile effect. Specifically, suppose we have the set of confidence bands $\{I^\leftarrow_k = [U^\leftarrow_k, L^\leftarrow_k] : k = 0,1\}$ for the set of functions $\{F_k^\leftarrow: k = 0,1\}$ of level $p$. CFVMW2015 showed that a confidence band for the difference $Q_1 - Q_0$ of size $p$ can be constructed as $[U^\leftarrow_1 - L^\leftarrow_0, L^\leftarrow_1 - U^\leftarrow_0]$, i.e., $I^\leftarrow_1 \ominus I^\leftarrow_0$ where $\ominus$ is the pointwise Minkowski difference.

lemma[CFVMW2015 (2016, Thm. 2(2))] Consider a set of distribution functions $\{ F_k : k = 0,1\}$ and endpoint functions $\{ L_k : k = 0,1\}$ and $\{U_k : k = 0,1\}$, with components in the class $\mathbb{D}$. If the set of distribution functions $\{ F_k : k = 0,1\}$ is jointly covered by the set of bands $\{I_k : k = 0,1\}$ with probability $p$, then the quantile effect function $\Delta= F_1^\leftarrow- F_0^\leftarrow$ is covered by $I^{\leftarrow}_{\Delta}$ with probability at least $p$, where $ I^{\leftarrow}_{\Delta}$ is defined by: $$ I^\leftarrow_\Delta(\tau) := [U^\leftarrow_1(\tau), L^\leftarrow_1(\tau)] \ominus [ U^\leftarrow_0(\tau), L^\leftarrow_0(\tau)] = [ U^\leftarrow_1(\tau) -L^\leftarrow_0(\tau), L^\leftarrow_1(\tau)- U^\leftarrow_0(\tau)], \ \ \tau \in \mathcal{T}. $$

Asymptotic Theory

This section derives the asymptotic properties of the fixed effect estimators of $y \mapsto\beta(y)$ and $\{ F_k : k \in {\mathcal K} \}$, as both dimensions $I$ and $J$ grow to infinity. We focus on the case where the link function is the logistic distribution at all levels, $\Lambda_y = \Lambda$, where $\Lambda(\xi) = (1+ \exp(-\xi))^{-1}$. We choose the logistic distribution for analytical convenience. In this case the Hessian of the log-likelihood function does not depend on $y_{it}$, leading to several simplifications in the asymptotic expansions. In particular, there are various terms that drop out from the second order expansions that we use to characterize the structure of the incidental parameter bias of the estimators $\widehat \beta(y)$ and $\widehat F(y)$. For the case of single binary regressions, FernandezValWeidner2016 showed that the properties of fixed effects estimators are similar for the logistic distribution and other smooth log-concave distributions such as the normal distribution. Accordingly, we expect that our results can be extended to other link functions, but at the cost of more complicated proofs and derivations to account for additional terms.

We make the following assumptions:

assumption[Sampling and Model Conditions] \begin{itemize} • Sampling: The outcome variable $y_{ij}$ is independently distributed over $i$ and $j$ conditional on all the observed and unobserved covariates $ \mathcal{C}_B:= \{(x_{ij}, v_i, w_j): (i,j) \in \mathcal{D}\}$. • Model: For all $y \in \mathcal{Y}$, \begin{align*} F_{y_{ij}}(y \mid \mathcal{C}_B) = F_{y_{ij}}(y \mid x_{ij}, v_i, w_j) = \Lambda(x_{ij}' \beta(y) + \alpha(v_{i},y) + \gamma(w_{j},y) ), \end{align*} where $y \mapsto \beta(y)$, $y \mapsto \alpha(\cdot,y)$ and $y \mapsto \gamma(\cdot,y)$ are measurable functions. • Compactness: the support $\mathcal{X}$ of $x_{ij}$ is compact, and $\alpha(v_i,y)$ and $\gamma(w_j,y)$ are bounded uniformly over $i$, $j$, $I$, $J$ and $y \in \mathcal{Y}$. • Compactness and smoothness: Either $\mathcal{Y}$ is a discrete finite set, or $\mathcal{Y} \subset \mathbb{R}$ is a bounded interval. In the latter case, we assume that the conditional density function $f_{y_{ij}}(y \mid x_{ij}, v_i, w_j)$ exists, is uniformly bounded above and away from zero, and is uniformly continuous in $y$ on the interior of $\mathcal{Y}$, uniformly over the support of $(x_{ij}, v_i, w_j)$. • Missing data: There is only a fixed number of missing observations for every $i$ and $j$, that is, $\max_{i} ( J-|\{(i',j') \in \mathcal{D} : i' = i\}| ) \leq c_2$ and $\max_{j}( I - |\{(i',j') \in \mathcal{D} : j' = j\}| ) \leq c_2$ for some constant $c_2<\infty$ that is independent of the sample size. • Non-collinearity: The regressors $x_{ij}$ are non-collinear after projecting out the two-way fixed effects, that is, there exists a constant $c_3>0$, independent of the sample size, such that \begin{align*} \min_{\{ \delta \in \mathbb{R}^{d_x} \, : \, \| \delta \|=1 \}} \; \; \min_{(a,b) \in \mathbb{R}^{I+J}} \left[ \frac 1 n \sum_{(i,j) \in \mathcal{D}} (x'_{ij} \delta - a_i - b_j )^2 \right] \geq \; c_3 . \end{align*} • Asymptotics: We consider asymptotic sequences where $I_n, J_n \to \infty$ with $I_n/J_n \to c$ for some positive and finite $c$, as the total sample size $n \to \infty$. We drop the indexing by $n$ from $I_n$ and $J_n$, i.e. we shall write $I$ and $J$. \end{itemize}
remark[Assumption (ref)] Part (i) holds if $(y_{ij},x_{ij})$ is i.i.d. over $i$ and $j$, $v_i$ is i.i.d. over $i$, and $w_j$ is i.i.d. over $j$; but it is more general as it does not restrict the distribution of $(x_{ij},v_i,w_j)$ nor its dependence across $i$ and $j$. We show how to relax this assumption allowing for a form of weak conditional dependence in Section (ref). Part (ii) holds if the observed covariates are strictly exogenous conditional on the unobserved effects and the conditional distribution is correctly specified for all $y \in \mathcal{Y}$. We expect that our theory carries over to predetermined or weakly exogenous covariates that are relevant in panel data models, following the analysis FernandezValWeidner2016. We focus on the strict exogeneity assumption because it is applicable to both panel and network data, and leave the extension to weak exogeneity to future research. Part (iii) imposes that the covariates $x_{ij}$ and unobserved effects $\alpha(v_i,y)$ and $\gamma_j(w_j,y)$ are all uniformly bounded. For fixed values $y$ it is possible to obtain asymptotic results of our estimators without the compact support assumption, see e.g. Yan2016statistical, but deriving empirical process results that hold uniformly over $y$ is much more involved without this assumption. The compact support assumption guarantees that the conditional probabilities of the events $\{y_{ij} \leq y\}$ are bounded away from zero and one, that is, the network of binarized outcomes $1\{y_{ij} \leq y\}$ is assumed to be dense. In the network econometrics literature charbonneau17, Graham2017 and jochmans18 provide methods that are also applicable to sparse networks. Part (iv) can be slightly weakened to Lipschitz continuity with uniformly bounded Lipschitz constant, instead of differentiability. It covers discrete, continuous, and mixed outcomes with mass points at the boundary of the support such as censored variables. For the mixed outcomes, the data generating process for the mass points can be arbitrarily different from the rest of the support because the density $y \mapsto f_{y_{ij}}(y \mid \cdot)$ only needs to be continuous in the interior of $\mathcal{Y}$. Part (v) of the assumption allows for a finite (and asymptotically bounded) number of missing observations for each unit $i$, and each unit $j$. For example, in the trade network example only the observations with $i=j$ are missing, implying that there is one missing observation for every $i$ and for every $j$, i.e. $c_2=1$. If the panel is balanced, part (vi) can be stated as \begin{align*} \frac 1 {I J} \sum_{i=1}^I \sum_{j=1}^J \widetilde x_{ij} \widetilde x'_{ij} \; \geq \; c_3 \; \mathbb{I}_{d_x}, \end{align*} where $\widetilde x_{ij} = x_{ij} - x_{i \cdot} - x_{\cdot j} + x_{\cdot \cdot}$, $x_{i \cdot} = J^{-1} \sum_{j=1}^J x_{ij}$, $x_{\cdot j} = I^{-1} \sum_{i=1}^I x_{ij}$, and $x_{\cdot \cdot} = (I J)^{-1} \sum_{i=1}^I \sum_{j=1}^J x_{ij}$. This is the typical condition in linear panel models requiring that all the covariates display variation in both dimensions. The asymptotic sequences considered in part (vii) exactly balance the order of the bias and standard deviation of the fixed effect estimator yielding a non-degenerate asymptotic distribution. {\tiny \ensuremath{\blacksquare} }

Asymptotic Distribution of the Uncorrected Estimator

We introduce first some further notation. Denote the $q^{th}$ derivatives of the cdf $\Lambda$ by $\Lambda^{(q)}$, and define $\Lambda^{(q)}_{ij}(y) = \Lambda^{(q)}( x_{ij}'\beta(y) + \alpha_{i}(y) + \gamma_{j}(y) )$ and $\Lambda^{(q)}_{ij,k}(y) = \Lambda^{(q)}( \mathbbm{x}_{ij,k}'\beta(y) + \alpha_{i}(y) + \gamma_{j}(y) )$ with $\mathbbm{x}_{ij,k}:=(t_{ij}^k,z_{ij}')'$ and $q = 1,2, \ldots$. For $\ell \in \{1,\ldots, d_x\}$ define the following projections of the $\ell$'th covariate $x^\ell_{ij}$,

align[align omitted — 268 chars of source]

and let $ \alpha_{x,i}(y)$ and $\gamma_{x,j}(y)$ be the $d_x$-vectors with components $\alpha^\ell_{x,i}(y)$ and $\gamma^\ell_{x,j}(y)$, where $\alpha^\ell_{x,i}(y)$ is the $i$th component of $\alpha^\ell_{x}(y)$ and $\gamma^\ell_{x,j}(y)$ is the $j$th component of $\gamma^\ell_{x}(y)$. Also define $\widetilde x_{ij}(y) = x_{ij} - \alpha_{x,i}(y) - \gamma_{x,j}(y)$ and $\widetilde{\mathbbm{x}}_{ij,k}(y) = \mathbbm{x}_{ij,k} - \alpha_{x,i}(y) - \gamma_{x,j}(y)$. Notice that $\widetilde{\mathbbm{x}}_{ij,k}(y)$ is defined using projections of $x_{ij}$ instead of ${\mathbbm{x}}_{ij,k}$. Also, while the locations of $\alpha_{x,i}(y)$ and $\gamma_{x,j}(y)$ are not identified, $\widetilde x_{ij}(y)$ and $\widetilde{\mathbbm{x}}_{ij,k}(y)$ are uniquely defined. Analogous to the projection of $x_{ij}^{\ell}$ above, we define $ \Psi_{ij,k}(y) = \alpha^\Psi_{i}(y) + \gamma^\Psi_{j}(y) $, where

align[align omitted — 328 chars of source]

For example, if $\mathbbm{x}_{ij,k} = x_{ij}$, then $\Psi_{ij,k}(y)=1$. Furthermore, we define\footnote{ The FOC of problem (ref) imply that $\sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{ij,k}(y) \, \widetilde{x}_{ij}(y)^{\, \prime} =0$, and we can therefore equivalently write $ \partial_{\beta} F_k(y) = \frac 1 {n} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{ij,k}(y) \, \left[ \widetilde{\mathbbm{x}}_{ij,k}(y) - \widetilde{x}_{ij}(y) \right]^{\, \prime} = \frac 1 {n} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{ij,k}(y) \, \left[ {\mathbbm{x}}_{ij,k}(y) - {x}_{ij}(y) \right]^{\, \prime}. $ }

align*[align* omitted — 295 chars of source]

and

align*[align* omitted — 1,119 chars of source]

where $\mathcal{D}_i := \{(i',j') \in \mathcal{D} : i' = i\}$ and $\mathcal{D}_j := \{(i',j') \in \mathcal{D} : j' = j\}$ are the subsets of observational units that contain the index $i$ and $j$, respectively. In the previous expressions, $\partial_{\beta} F_k(y)$ is a $1 \times d_x$ vector for each $k \in {\mathcal K}$ that we stack in the $|{\mathcal K}| \times d_x$ matrix $\partial_{\beta} F(y) = [\partial_{\beta} F_{k}(y) \, : \, k \in {\mathcal K}]$. Similarly, $F_{k}(y)$, $B^{(\Lambda)}_{k}(y)$, $ D^{(\Lambda)}_{k}(y)$ and $\Psi_{ij,k}(y)$ are scalars for each $k \in {\mathcal K}$, that we stack in the $|{\mathcal K}| \times 1$ vectors $ F(y) = [F_{k}(y) \, : \, k \in {\mathcal K}]$, $ B^{(\Lambda)}(y) = [B^{(\Lambda)}_{k}(y) \, : \, k \in {\mathcal K}]$, $ D^{(\Lambda)}(y) = [D^{(\Lambda)}_{k}(y) \, : \, k \in {\mathcal K}]$, $ \Psi_{ij}(y) = [\Psi_{ij,k}(y) \, : \, k \in {\mathcal K}]$.

Let $\ell^{\infty}(\mathcal{Y})$ be the space of real-valued bounded functions on $\mathcal{Y}$ equipped with the sup-norm $\| \cdot \|_{\mathcal{Y}}$, and $\rightsquigarrow$ denote weak convergence (in distribution). We establish a functional central limit theorem for the fixed effects estimators of $y \mapsto \beta(y)$ and $y \mapsto F(y)$ in $\mathcal{Y}$. All stochastic statements are conditional on $ \{(x_{ij}, v_i, w_j): (i,j) \in \mathcal{D}\}$.

theorem[FCLT for Fixed Effects DR Estimators] Let Assumption (ref) hold. For all $y_1,y_2 \in \mathcal{Y}$ with $y_1 \geq y_2$ we assume the existence of \begin{align*} \overline V(y_1,y_2) &= \operatorname*{plim}_{n \rightarrow \infty} \frac 1 n \sum_{(i,j) \in \mathcal{D}} \Lambda_{ij}(y_1) \left[ 1 - \Lambda_{ij}(y_2) \right] \; \widetilde x_{ij}(y_1) \; \widetilde x_{ij}(y_2)' , \\ \overline \Omega(y_1,y_2) &= \operatorname*{plim}_{n \rightarrow \infty} \frac 1 n \sum_{(i,j) \in \mathcal{D}} \Lambda_{ij}(y_1) \left[ 1 - \Lambda_{ij}(y_2) \right] \; \Xi_{ij}(y_1) \Xi_{ij}(y_2)' , \end{align*} where $\Xi_{ij}(y) = \Psi_{ij}(y) + \partial_{\beta} F(y) W^{-1}(y) \, \widetilde x_{ij}(y)$. Let $\overline V(y_2,y_1) := \overline V(y_1,y_2)'$, $\overline \Omega(y_2,y_1) := \overline \Omega(y_1,y_2)'$, and $\overline W(y_1) := \overline V(y_1,y_1)$. Then, in the metric space $\ell^{\infty}(\mathcal{Y})^{d_x}$, \begin{align*} \sqrt{n}\left[ \widehat \beta(y) - \beta(y) - \frac I {n} B^{(\beta)}(y) - \frac J {n} D^{(\beta)}(y) \right] \rightsquigarrow Z^{(\beta)}(y) , \end{align*} and, in the metric space $\ell^{\infty}(\mathcal{Y})^{|\mathcal{K}|}$, \begin{multline*} \sqrt{n}\left\{ \widehat F(y) - F(y) - \frac I {n} \underset{B^{(F)}(y)}{\underbrace{\left[ B^{(\Lambda)}(y) + (\partial_{\beta} F(y)) B^{(\beta)}(y) \right]}} - \frac J {n} \underset{D^{(F)}(y)}{\underbrace{ \left[ D^{(\Lambda)}(y) + (\partial_{\beta} F(y)) D^{(\beta)}(y) \right]}} \right\} \\ \rightsquigarrow Z^{(F)}(y) , \end{multline*} as stochastic processes indexed by $y \in \mathcal{Y}$, where $y \mapsto Z^{(\beta)}(y)$ and $y \mapsto Z^{(F)}(y)$ are tight zero-mean Gaussian processes with covariance functions $(y_1,y_2) \mapsto \overline W^{-1}(y_1) \; \overline V(y_1,y_2) \; \overline W^{-1}(y_2)$ and $(y_1,y_2) \mapsto \overline \Omega(y_1,y_2)$, respectively.

Assumption (ref)(vi) guarantees the invertibility of $W(y)$ and $\overline W(y) $. Notice that $\overline W(y) $ is equal to the limit of $W(y)$ because $\Lambda^{(1)}_{ij}(y) = \Lambda_{ij}(y) \left[ 1 - \Lambda_{ij}(y) \right]$ by the properties of the logistic distribution. This information equality follows by the correct specification condition in Assumption (ref)(ii). By Assumption (ref)(v), we could have used $\sqrt{IJ}$ instead of $\sqrt{n}$, $1/J$ instead of $I/n$, and $1/I$ instead of $J/n$. However, if the panel is not balanced, then we expect the expressions in the theorem to provide a more accurate finite-sample approximation, because the standard deviation of the estimates will generally be of order $1/\sqrt{n}$ for unbalanced panels, and the leading order incidental parameter biases are generally proportional to the number of incidental parameters ($I$ and $J$ here) divided by the total sample size $n$, see e.g. FernandezValWeidner2018.

remark[Comparison with binary response models] FernandezValWeidner2016 derived central limit theorems (CLTs) for the fixed effects estimators of coefficients and APEs in panel regressions with two-way effects. Pointwise, for given $y \in \mathcal{Y}$, Theorem (ref) yields these CLTs. Moreover, it covers multiple binary regressions by establishing the limiting distribution of $\widehat \beta(y) $ and $ \widehat F(y)$ treated as stochastic processes indexed by $y \in \mathcal{Y}$. This generalization is key for our inference results and does not follow from well-known empirical process results. We need to deal with a double asymptotic approximation where both $I$ and $J$ grow to infinity, and to bound all the remainder terms in the second order expansions used by FernandezValWeidner2016 uniformly over $y \in \mathcal{Y}$. We refer to the appendix and supplementary material for more details. {\tiny \ensuremath{\blacksquare} }
remark[Case $\mathbbm{x}_{ij,k} = x_{ij}$] When $\mathbbm{x}_{ij,k} = x_{ij}$, that is, when the counterfactual values are equal to the observed values, then the asymptotic bias of $\widehat F_k$ vanishes, because $B_k^{(\Lambda)}(y) = D_k^{(\Lambda)}(y) = 0$, and $\partial_{\beta} F_k(y)=0$ (see footnote (ref)). In fact, in that case $\widehat F_k$ is equal to the empirical distribution function, namely $$ \widehat F_k(y) = \frac{1}{n} \sum_{(i,j) \in \mathcal{D}} \Lambda(x_{ij}'\widehat \beta(y) + \widehat \alpha_i(y) + \widehat \gamma_j(y)) = \frac{1}{n} \sum_{(i,j) \in \mathcal{D}} 1\{y_{ij} \leq y \}, $$ by the first order conditions of the fixed effects logit DR estimator with respect to the fixed effect parameters. This property provides another appealing feature to choose the logistic distribution. {\tiny \ensuremath{\blacksquare} }

Bias Corrections

Theorem (ref) shows that the fixed effects DR estimator has asymptotic bias of the same order as the asymptotic standard deviation under the approximation that we consider. The finite-sample implications are that this estimator can have substantial bias and that confidence regions constructed around it can have severe undercoverage. We deal with these problems by removing the first order bias of the estimator.

We estimate the bias components using the plug-in rule. Define $\widehat \Lambda^{(q)}_{ij}(y) = \Lambda^{(q)}( x_{ij}' \widehat \beta(y) + \widehat \alpha_{i}(y) + \widehat \gamma_{j}(y) )$ and $\widehat \Lambda^{(q)}_{ij,k}(y) = \widehat \Lambda^{(q)}( \mathbbm{x}_{ij,k}' \widehat \beta(y) + \widehat \alpha_{i}(y) + \widehat \gamma_{j}(y) )$. Replacing $\Lambda^{(1)}_{ij}(y)$ and $\Lambda^{(1)}_{ij,k}(y)$ by $\widehat \Lambda^{(1)}_{ij}(y)$ and $\widehat \Lambda^{(1)}_{ij,k}(y)$ in the definitions of $\alpha^\ell_x(y)$, $\gamma^\ell_x(y)$, $\alpha^\Psi(y)$, and $\gamma^\Psi(y)$ yields the corresponding estimators. We plug-in these estimators to obtain $\widehat x_{ij}(y) = x_{ij} - \widehat \alpha_{x,i}(y) - \widehat \gamma_{x,j}(y)$, $\widehat {\mathbbm x}_{ij,k}(y) = \mathbbm{x}_{ij,k} - \widehat \alpha_{x,i}(y) - \widehat \gamma_{x,j}(y)$, and $\widehat \Psi_{ij,k}(y) = \widehat \alpha^\Psi_{i}(y) + \widehat \gamma^\Psi_{j}(y) $. Then we construct

align*[align* omitted — 326 chars of source]

and

align*[align* omitted — 1,279 chars of source]

We also define the $|{\mathcal K}| \times d_x$ matrix $\partial_{\beta} \widehat F(y) = [(\partial_{\beta} \widehat F_{k}(y)) \, : \, k \in {\mathcal K}]$, and the $|{\mathcal K}| \times 1$ vectors $ \widehat B^{(F)}(y) = [\widehat B^{(F)}_{k}(y) \, : \, k \in {\mathcal K}]$, $ \widehat D^{(F)}(y) = [\widehat D^{(F)}_{k}(y) \, : \, k \in {\mathcal K}]$, $ \widehat \Psi_{ij}(y) = [\widehat \Psi_{ij,k}(y) \, : \, k \in {\mathcal K}]$. Finally, we also construct the estimator of the asymptotic variance of $\widehat F(y)$

align*[align* omitted — 196 chars of source]

where $\widehat \Xi(y) = \widehat \Psi_{ij}(y) + (\partial_{\beta} \widehat F(y)) \widehat W^{-1}(y) \, \widehat x_{ij}(y)$.

Lemma (ref) in the Appendix shows that the estimators of the asymptotic bias are consistent, uniformly in $y \in \mathcal{Y}$. Bias corrected estimators of $\beta(y)$ and $F(y)$ can then be formed as

equation[equation omitted — 201 chars of source]

and

align*[align* omitted — 483 chars of source]

Alternatively, we could define the bias corrected version of $ \widehat F(y) $ as

align*[align* omitted — 317 chars of source]

where $\widetilde \xi(y) := (\widetilde \alpha_1(y), \ldots, \widetilde \alpha_I(y), \widetilde \gamma_{1}(y), \ldots, \widetilde \gamma_J(y))$ is a solution to $$ \max_{\xi \in \mathbb{R}^{I+J}} \sum_{(i,j) \in \mathcal{D}} (1\{y_{ij} \leq y \} \log \Lambda(x_{ij}'\widetilde \beta(y) + \alpha_i + \gamma_{j}) + 1\{y_{ij} > y \} \log [1 - \Lambda(x_{ij}'\widetilde \beta(y) + \alpha_i + \gamma_{j})]). $$ It can be shown that $\sup_{y \in \mathcal{Y}} \sqrt{n} \left| \widetilde F^*_k(y) - \widetilde F_k(y) \right| = o_P(1)$, that is, the difference between those alternative bias corrected estimators is asymptotically negligible. There is no obvious reason to prefer one over the other, and we present result for $\widetilde F_k$ in the following, which equivalently hold for $\widetilde F^*_k$.\footnote{We use the estimator $\widetilde F^*_k$ in the numerical examples for computational convenience as the bias correction involves estimating less terms. }

remark[Alternative Approaches] The conditional approach of charbonneau17 and jochmans18 for the logit model with two-way effects could be also adopted to estimate the coefficient $\beta(y)$. However, this approach does not produce estimators of $F(y)$ as it is based on differencing-out the unobserved effects. The bias correction method proposed is analytical in that it requires explicit characterization and estimation of the bias. A natural alternative is a correction based on Jackknife or bootstrap following the analysis of CFW-16, DhaeneJochmans2015, FernandezValWeidner2016, Hahn:2004p882, and KimSun2016 for nonlinear panel models. We do not consider any of these corrections because they require repeated parameter estimation that can be computationally expensive in this case. {\tiny \ensuremath{\blacksquare} }

The following main result establishes the functional central limit theorem for the bias corrected estimators and uniform consistency of the estimators of the variance function.

theorem[FCLT for Bias Corrected Fixed Effects DR Estimators] Let Assumption (ref) hold. Then, in the metric space $\ell^{\infty}( \mathcal{Y})^{d_x}$, \begin{align*} \sqrt{n}\left[ \widetilde \beta(y) - \beta(y) \right] \rightsquigarrow Z^{(\beta)}(y) , \end{align*} and, in the metric space $\ell^{\infty}(\mathcal{Y})^{|\mathcal{K}|}$, $$ \sqrt{n}\left[ \widetilde F(y) - F(y) \right] \rightsquigarrow Z^{(F)}(y) , $$ as stochastic processes indexed by $y \in \mathcal{Y}$, where $Z^{(\beta)}(y)$ and $Z^{(F)}(y)$ are the same Gaussian processes that appear in Theorem (ref). Moreover, $$ \sup_{y \in \mathcal{Y}} \left\| \widehat W(y)^{-1} - \overline W(y)^{-1} \right\| = o_P(1) \ \ \text{ and } \ \ \sup_{y \in \mathcal{Y}} \left\| \widehat \Omega(y) - \overline \Omega(y) \right\|= o_P(1). $$

Uniform Confidence Bands and Bootstrap

We show how to construct pointwise and uniform confidence bands for $y \mapsto \beta(y)$ and $y \mapsto F(y)$ on $ \mathcal{Y}$ using Theorem (ref). The uniform bands for $F$ can be used as inputs in Lemmas (ref) and (ref) to construct uniform bands for the QFs $\tau \mapsto Q_k(\tau) = F_k^{\leftarrow}(\tau),$ $k \in \mathcal{K}$, and the QEF $\tau \mapsto \Delta(\tau)$ on $\mathcal{T}$.

Let $\mathcal{B} \subseteq \{1, \ldots, d_x\}$ be the set of indexes for the coefficients of interest. For given $y \in \mathcal{Y}$, $\ell \in \mathcal{B}$, $k \in \mathcal{K}$, and $p \in (0,1)$, a pointwise $p$-confidence interval for $\beta_{\ell}(y)$, the $\ell$'th component of $\beta(y)$, is

equation[equation omitted — 113 chars of source]

and a pointwise $p$-confidence intervals for $F_k(y)$ is $$[ \widetilde F_k(y) \pm \Phi^{-1}(1-p/2) \widehat{\sigma}_{F_k}(y)],$$ where $\Phi$ denotes the cdf of the standard normal distribution, $\widehat{\sigma}_{\beta_\ell}(y)$ is the standard error of $\widetilde \beta_{\ell}(y)$ given in (ref), and $\widehat{\sigma}_{F_k}(y)$ is the standard error of $\widetilde F_k(y)$ given in (ref). These intervals have coverage $p$ in large samples by Theorem (ref).

We construct joint uniform bands for the coefficients and distributions using Kolmogorov-Smirnov type critical values, instead of quantiles from the normal distribution. A uniform $p$-confidence band joint for the vector of functions $\{ \beta_{\ell}(y) : \ell \in \mathcal{B}, y \in \mathcal{Y}\}$ is

equation[equation omitted — 208 chars of source]

where $t_{\mathcal{B}, \mathcal{Y}}^{(\beta)}(p)$ is the $p$-quantile of the maximal $t$-statistic

align[align omitted — 199 chars of source]

where $\sigma^{(\beta)}_{\ell}(y) = [\overline{W}(y)^{-1}]_{\ell,\ell}^{1/2},$ the square root of the $(\ell,\ell)$ element of the matrix $\overline{W}(y)^{-1}$. Similarly, a uniform $p$-confidence band joint for the set of distribution functions $\{ F_k(y) : k \in \mathcal{K}, y \in \mathcal{Y}\}$ is

align[align omitted — 183 chars of source]

where $t_{\mathcal{K}, \mathcal{Y}}^{(F)}(p)$ is the $p$-quantile of the maximal $t$-statistic

align[align omitted — 178 chars of source]

where $\sigma^{(F)}_{k}(y) = [\overline{\Omega}(y)]_{k,k}^{1/2}$, the square root of the $(k,k)$ element of the matrix $\overline{\Omega}(y,y)$. The previous confidence bands also have coverage $p$ in large samples by Theorem (ref).

The maximal t-statistics used to construct the bands $I_{\beta}$ and $I_{F}$ are not pivotal, but their distributions can be approximated by simulation after replacing the variance functions of the limit processes by uniformly consistent estimators. In practice, however, we find it more convenient to use resampling methods. We consider a multiplier bootstrap scheme that resamples the efficient scores or influence functions of the fixed effects estimators $\widehat \beta(y)$ and $\widehat F(y)$. This scheme is computationally convenient because it does not need to solve the high dimensional nonlinear fixed effects conditional maximum likelihood program (ref) or making any bias correction in each bootstrap replication. In these constructions we rely on the uncorrected fixed effects estimators instead of the bias corrected estimators, because they have the same influence functions and the uncorrected estimators are consistent under the asymptotic approximation that we consider.

To describe the standard errors and multiplier bootstrap we need to introduce some notation for the influence functions of $\widehat \theta(y)$ and $\widehat F(y)$. Let $\theta = (\beta, \alpha_1, \ldots, \alpha_I, \gamma_1, \ldots, \gamma_J)$ be a generic value for the parameter $\theta(y)$, the influence function of $\widehat \theta(y)$ is the $(d_x+I+J)$-vector $\psi_{ij}^y(\theta(y))$, where $$ \psi_{ij}^y(\theta) = H(\theta)^{\dagger} [\boldsymbol{1}\{y_{ij} \leq y \} - \Lambda(x_{ij}'\beta + \alpha_i + \gamma_j)] w_{ij}, \ \ w_{ij} = (x_{ij}, e_{i,I}, e_{j,J}) , \ \ y \in \mathcal{Y}, $$ $e_{i,I}$ is a unit vector of dimension $I$ with a one in the position $i$, $e_{j,J}$ is defined analogously, $H(\theta)^{\dagger}$ is the Moore-Penrose pseudo-inverse of $H(\theta)$, and $$ H(\theta) = \frac{1}{n} \sum_{(i,j)\in \mathcal{D}} \Lambda^{(1)}(x_{ij}'\beta + \alpha_i + \gamma_j) w_{ij} w_{ij}', \ \ \Lambda^{(1)}(z) = \Lambda(z) \Lambda(-z), $$ is minus the Hessian of the log-likelihood with respect to $\theta$, which does not depend on $y$ in the case of the logistic distribution.\footnote{We use the Moore-Penrose pseudo-inverse because $H(\theta)$ is singular if we do not impose a normalization on the location of $\alpha_i(y)$ and $\gamma_j(y)$.} The influence function of $\widehat F_k(y)$ is $\varphi_{ij,k}^y(\theta(y))$, where $$ \varphi_{ij,k}^y(\theta) = J_k(\theta)' \psi_{ij}^y(\theta), $$ and $$ J_k(\theta) = \frac{1}{n} \sum_{(i,j)\in \mathcal{D}} \Lambda^{(1)}(\mathbbm{x}_{ij,k}'\beta + \alpha_i + \gamma_j) \mathbbm{w}_{ij,k}, \ \ \mathbbm{w}_{ij,k} = (\mathbbm{x}_{ij,k}, e_{i,I}, e_{j,J}). $$

The standard error of $\widetilde \beta_{\ell}(y)$ is constructed as

equation[equation omitted — 203 chars of source]

the square root of the $(\ell,\ell)$ element of the sandwich matrix $n^{-2} \sum_{(i,j) \in \mathcal{D}} \psi_{ij}^y(\widehat \theta(y)) \psi_{ij}^y(\widehat \theta(y))'$. Similarly, the standard error of $\widetilde F_k(y)$ is constructed as

equation[equation omitted — 156 chars of source]

The following algorithm describes a multiplier bootstrap scheme to obtain the critical values for a set of parameters indexed by $\ell \in \mathcal{B} \subseteq \{1, \ldots, d_x\}$ and a set of distributions indexed by $k \in \mathcal{K} \subseteq \{0,1\}$. This scheme is based on perturbing the first order conditions of the fixed effects estimators with random multipliers independent from the data.

algorithm[algorithm omitted — 2,229 chars of source]

The next result shows that the multiplier bootstrap provides consistent estimators of the critical values of the inferential statistics. The proof follows from Theorem 2.2 of cck-16.

theorem[Consistency of Multiplier Bootstrap Inference] Let Assumption (ref) hold. Then, conditional on the data $\{(y_{ij}, x_{ij}) : (i,j) \in \mathcal{D} \}$, as $n \to \infty$ and $M \to \infty$ $$ \widehat{t}^{(\beta)}_{\mathcal{B}, \mathcal{Y}}(p) \to_{{\mathrm{P}}} t^{(\beta)}_{\mathcal{B}, \mathcal{Y}}(p) \ \text{ and } \ \widehat{t}^{(F)}_{\mathcal{K}, \mathcal{Y}}(p) \to_{{\mathrm{P}}} t^{(F)}_{\mathcal{K}, \mathcal{Y}}(p), $$ where $t^{(\beta)}_{\mathcal{B}, \mathcal{Y}}(p)$ and $t^{(F)}_{\mathcal{K}, \mathcal{Y}}(p)$ are defined in (ref) and (ref), respectively.

Theorem (ref) together with Theorem (ref) guarantee the asymptotic validity of the confidence bands $I_{\beta}$ and $I_F$ defined in (ref) and (ref) with the critical values $t^{(\beta)}_{\mathcal{B}, \mathcal{Y}}(p)$ and $t^{(F)}_{\mathcal{K}, \mathcal{Y}}(p)$ replaced by the bootstrap estimators $\widehat{t}^{(\beta)}_{\mathcal{B}, \mathcal{Y}}(p)$ and $\widehat{t}^{(F)}_{\mathcal{K}, \mathcal{Y}}(p)$.

Pairwise Clustering Dependence or Reciprocity

The conditional independence of Assumption (ref)(i) can be relaxed to allow for some forms of conditional weak dependence. A form of dependence that is relevant for network data is pairwise clustering or reciprocity where the observational units with symmetric indexes $(i,j)$ and $(j,i)$ might be dependent due to unobservable factors not accounted by unobserved effects.\footnote{CM-14 consider other patterns of dependence in linear models for dyadic data.} In the trade application, for example, these factors may include distributional channels or multinational firms operating in both countries. Formally, pairwise clustering means that $(y_{ij},y_{ji})$ is independently distributed across $(i,j) \in \mathcal{D}$ with $i \leq j$, conditional on all the observed and unobserved covariates $ \mathcal{C}_B:= \{(x_{ij}, v_i, w_j): (i,j) \in \mathcal{D}\}$.

The presence of reciprocity does not change the bias of the fixed effects estimators, but affects the standard errors and the implementation of the multiplier bootstrap. The standard error of $\widetilde \beta_{\ell}(y)$ becomes

equation[equation omitted — 260 chars of source]

Similarly, the standard error of $\widetilde F_k(y)$ needs to be adjusted to

equation[equation omitted — 249 chars of source]

In the previous expressions we assume that if $(i,j) \in \mathcal{D}$ then $(j,i) \in \mathcal{D}$ to simplify the notation. The modified multiplier bootstrap algorithm becomes:

algorithm[algorithm omitted — 2,250 chars of source]

The clustered multiplier bootstrap preserves the dependence in the symmetric pairs $(i,j)$ and $(j,i)$ by assigning the same multiplier to each of these pairs.

Average Effect

A bias corrected estimator of the average effect can be formed as

equation[equation omitted — 87 chars of source]

where $$ \widetilde \mu_k = \int [1(y \geq 0) - \mathbf{C} \widetilde F_k(y)] dy, \ \ k \in \{0,1\}. $$ Here the integral is over the real line, and $\mathbf{C}$ is an operator that extends $\widetilde F_k(y)$ from $\mathcal{Y}$ to $\mathbb{R}$ as a step function, that is, it maps any $f: \mathcal{Y} \to \mathbb{R}$ to $\mathbf{C} f: \mathbb{R} \to \mathbb{R}$, where $\mathbf{C} f(y) = 0$ for $y\leq \inf \mathcal{Y}$, $\mathbf{C} f(y) = 1$ for $y\geq \sup \mathcal{Y}$, and $\mathbf{C} f(y) = f(\sup\{ y' \in \mathcal{Y} : y' \leq y \})$ otherwise. The following central limit theorem for the bias corrected estimator of the average effect is a corollary of Theorem (ref) together with the functional delta method.

corollary[CLT for Bias Corrected Fixed Effects Estimators of Average Effect] Let Assumption (ref) hold and $\int_{\mathcal{Y}} dF_k(y) = 1,$ $k \in \{0,1\}$. Then, \begin{equation} \sqrt{n}\left( \widetilde \Delta - \Delta \right) \to_d - \int \left[ \mathbf{C} Z_1^{(F)}(y) - \mathbf{C} Z_0^{(F)}(y)\right] dy =: Z^{(\Delta)}, \end{equation} where $Z^{(F)}(y) = [ Z_0^{(F)}(y), Z_1^{(F)}(y)]'$ is the same Gaussian process that appears in Theorem (ref) with $\mathcal{K} = \{0,1\}$.
remark[Support of $Y$] The condition that $\int_{\mathcal{Y}} dF_k(y) = 1$ guarantees that $\mathcal{Y}$ is the support of the potential outcome corresponding to the distribution $F_k$, so that (ref) yields the average potential outcome under $F_k$. Together with Assumption (ref), this condition is satisfied when $Y$ is discrete with finite support $\mathcal{Y}$, or continuous or mixed with bounded support $\mathcal{Y}$ and conditional density bounded away from zero in the interior of $\mathcal{Y}$. This support condition is not required for the estimation of the quantile effects.

We can construct confidence intervals for the average effect using Corollary (ref). Let $$ \widehat{\sigma}_{\Delta} = n^{-1} \left[\sum_{(i,j) \in \mathcal{D}} \widehat \varphi_{ij}^2 \right]^{1/2}, \ \ \widehat \varphi_{ij} = - \int \left[\mathbf{C}\varphi_{ij,1}^y(\widehat \theta(y)) - \mathbf{C}\varphi_{ij,0}^y(\widehat \theta(y)) \right] dy. $$ Then, $\widehat{\sigma}_{\Delta}$ is an estimator of $\sigma_{\Delta}$, the standard deviation of the limit process $Z^{(\Delta)}$ in (ref), and $$ I_{\Delta} = [\widetilde{\Delta} \pm \Phi^{-1}(1-p/2) \widehat{\sigma}_{\Delta}], $$ is an asymptotic $p$-confidence interval for $\Delta$. The normal critical value $\Phi^{-1}(1-p/2)$ can be replaced by a multiplier bootstrap critical value $\widehat{t}^{(\Delta)}(p)$ obtained from Algorithm (ref) as $$ \widehat{t}^{(\Delta)}(p) = p-\text{quantile of } \{t^{(\Delta),m} : 1 \leq m \leq M\} $$ where $ t^{(\Delta),m} = |\widehat \Delta^m- \widehat \Delta|/\widehat \sigma_{\Delta} $ and $ \widehat \Delta^m = \widehat \Delta + n^{-1} \sum_{(i,j) \in \mathcal{D}} \omega_{ij}^m \widehat \varphi_{ij}. $

The standard errors and critical values of the average effects can be adjusted to account for pairwise clustering following the procedure described in Section (ref). Thus, the pairwise clustering robust standard error is $$ \widehat{\sigma}_{\Delta} = n^{-1} \left[\sum_{(i,j) \in \mathcal{D}} \left\{ \widehat \varphi_{ij} + \widehat \varphi_{ji}\right\} \widehat \varphi_{ij} \right]^{1/2}. $$

Quantile Effects in Gravity Equations for International Trade

We consider an empirical application to gravity equations for bilateral trade between countries. We use data from Helpman01052008, extracted from the Feenstra's World Trade Flows, CIA's World Factbook and Andrew Rose's web site. These data contain information on bilateral trade flows and other trade-related variables for 157 countries in 1986.\footnote{The original data set includes 158 countries. We exclude Congo because it did not export to any other country in 1986.} The data set contains network data where both $i$ and $j$ index countries as senders (exporters) and receivers (importers), and therefore $I = J = 157$. The outcome $y_{ij}$ is the volume of trade in thousands of constant 2000 US dollars from country $i$ to country $j$, and the covariates $P(x_{ij}) = x_{ij}$ include determinants of bilateral trade flows such as the logarithm of the distance in kilometers between country $i$'s capital and country $j$'s capital and indicators for common colonial ties, currency union, regional free trade area (FTA), border, legal system, language, and religion. Following AndersonWincoop2003, we include unobserved importer and exporter country effects.\footnote{See Harrigan1994 for an earlier empirical international trade application that includes unobserved country effects.} These effects control for other country specific characteristics that may affect trade such as GDP, tariffs, population, institutions, infrastructures or natural resources. We allow for these characteristics to affect differently the imports and exports of each country, and be arbitrarily related with the observed covariates.

Table (ref) reports descriptive statistics of the variables used in the analysis. There are $157 \times 156 = 24,492$ observations corresponding to different pairs of countries. The observations with $i = j$ are missing because we do not observe trade flows from a country to itself. The trade variable in the first row is an indicator for positive volume of trade. There are no trade flows for 55% of the country pairs. The volume of trade variable exhibits much larger standard deviation than the mean. Since this variable is bounded below at zero, this indicates the presence of a very heavy upper tail in the distribution. This feature also makes quantile methods specially well-suited for this application on robustness grounds.\footnote{In results not reported, we find that estimates of average effects are very sensitive to the trimming of outliers at the top of the distribution.}

table[table omitted — 626 chars of source]

The previous literature estimated nonlinear parametric models such as Poisson, Negative Binomial, Tobit and Heckman-selection models to deal with the large number of zeros in the volume of trade (e.g., EatonKortum2001, SantosSilvaTenreyro2006, and Helpman01052008).\footnote{See HeadMayer2014 for a recent survey on gravity equations in international trade.} These models impose strong conditions on the process that generates the zeros and/or on the conditional heteroskedasticity of the volume of trade. The DR model deals with zeros and any other fixed censoring points in a very flexible and natural fashion as it specifies the conditional distribution separately at the mass point. In particular, the model coefficients at zero can be arbitrarily different from the model coefficients at other values of the volume of trade. Moreover, the DR model can also accommodate conditional heteroskedasticity.

Figure (ref) shows estimates and 95% pointwise confidence intervals for the DR coefficients of log distance and common legal system plotted against the quantile indexes of the volume of trade. We report uncorrected and bias corrected fixed effects estimates obtained from (ref) and (ref), respectively. The confidence intervals are constructed using (ref). The x-axis starts at .54, the maximum quantile index corresponding to zero volume of trade. The region of interest $\mathcal{Y}$ corresponds to the interval between zero and the $0.95$-quantile of the volume of trade. The difference between the uncorrected and bias corrected estimates is the same order of magnitude as the width of the confidence intervals for the coefficient of log distance. We find the largest estimated biases for both coefficients at highest quantiles of the volume of trade, where the indicators $1\{y_{ij} \leq y\}$ take on many ones. The signs of the DR coefficients indicate that increasing distance has a negative effect and having a common legal system has a positive effect on the volume of trade throughout the distribution. Recall that the sign of the effect in terms of volume of trade, $y_{ij},$ is the opposite to the sign of the DR coefficient.

figure[figure omitted — 313 chars of source]

Figures (ref) and (ref) show estimates and 95% uniform confidence bands for distribution and quantile functions of the volume of trade at different values of the log of distance and the common legal system. The left panels plot the functions when distance takes the observed levels ($\text{dist}$) and two times the observed values $(\text{2*dist})$, i.e. when we counterfactually double all the distances between the countries. The right panels plot the functions when all the countries have the same legal system (legal=1) and different systems (legal=0). The confidence bands for the distribution are obtained by Algorithm (ref) with 500 bootstrap replications and standard normal multipliers, and a grid of values $\bar \mathcal{Y}$ that includes the sample quantiles of the volume of trade with indexes $\{.54, .55, \ldots, .95\}$. The bands are joint for the two functions displayed in each panel. The confidence bands for the quantile functions are obtained by inverting and rotating the bands for the corresponding distribution functions using Lemma (ref).

figure[figure omitted — 391 chars of source]
figure[figure omitted — 388 chars of source]

Figure (ref) displays estimates and 95% uniform confidence bands for the quantile effects of the log of distance and the common legal system on the volume of trade, constructed using Lemma (ref). For comparison, we also include estimates from a Poisson model. Here, we replace the DR estimators of the distributions by

equation[equation omitted — 220 chars of source]

where $\lfloor y \rfloor$ is the integer part of $y$, $\lambda_{ij,k} = \exp(\mathbbm{x}_{ij,k}'\widehat \beta + \widehat \alpha_i + \widehat \gamma_j)$, and $\widehat \theta = (\widehat \beta, \widehat \alpha_1, \ldots, \widehat \alpha_I, \widehat \gamma_1, \dots, \widehat \gamma_J)$ is the Poisson fixed effects conditional maximum likelihood estimator $$ \widehat \theta \in \arg \max_{\theta \in \mathbb{R}^{d_x + I + J}} \sum_{(ij) \in \mathcal{D}} [y_{ij} (x_{ij}'\beta + \alpha_i + \gamma_j) - \exp (x_{ij}'\beta + \alpha_i + \gamma_j)]. $$ We find that distance and common legal system have heterogeneously increasing effects along the distribution. For example, the negative effects of doubling the distance grows more than proportionally as we move up to the upper tail of the distribution of volume of trade. Putting all the countries under the same legal system has little effects in the extensive margin of trade, but has a strong positive effect at the upper tail of the distribution. The Poisson estimates lie outside the DR confidence bands reflecting heavy tails in the conditional distribution of the volume of trade that is missed by the Poisson model.\footnote{This misspecification problem with the Poisson model is well-known in the international trade literature. The Poisson estimator is treated as a quasi-likelihood estimator and standard errors robust to misspecification are reported (SantosSilvaTenreyro2006).} Figure (ref) shows confidence bands of the quantile effects that account for pairwise clustering. The bands are constructed from confidence bands from the distributions using Algorithm (ref) with $500$ bootstrap draws and standard normal multipliers. Accounting for unobservables that affect symmetrically to the country pairs has very little effect on the width of the bands in this case.

figure[figure omitted — 426 chars of source]
figure[figure omitted — 427 chars of source]

Montecarlo Simulation

We conduct a Montecarlo simulation calibrated to the empirical application of Section (ref). The outcome is generated by the censored logistic process $$ y^s_{ij} = \max\{x_{ij}'\widehat \beta + \widehat \alpha_i + \widehat \gamma_{j} + \widehat{\sigma} \Lambda^{-1}(u^s_{ij})/\sigma_{L}, 0 \}, \ \ (i,j) \in \mathcal{D}, $$ where $\mathcal{D} = \{(i,j): 1 \leq i,j \leq 157, i \neq j\}$, $x_{ij}$ is the value of the covariates for the observational unit $(i,j)$ in the trade data set, $\sigma_L = \pi/\sqrt{3}$, the standard deviation of the logistic distribution, and $(\widehat \beta, \widehat \alpha_1, \ldots, \widehat \alpha_I, \widehat \gamma_{1}, \ldots, \widehat \gamma_{J}, \widehat \sigma)$ are Tobit fixed effect estimates of the parameters in the trade data set with lower censoring point at zero.\footnote{We upper winsorize the volume of trade $y_{ij}$ at the $95.5\%$ quantile to reduce the effect of outliers in the Tobit estimation of the parameters.} We consider two designs: independent errors with $u^s_{ij} \sim \text{ i.i.d } \mathcal{U}(0,1),$ and pairwise dependent errors with $u^s_{ij} = \Phi(0.75 e^s_{ij} + \sqrt{1-0.75^2} e^s_{ji}),$ where $e^s_{ij} \sim \text{ i.i.d } \mathcal{N}(0,1)$ and $\Phi$ is the standard normal CDF.\footnote{The Spearman rank correlation between $u^s_{ij}$ and $u^s_{ji}$ in the design with pairwise-dependent errors is $0.73$.} In both cases the conditional distribution function of $y_{ij}^s$ is a special case of the DR model (ref) with link function $\Lambda_y = \Lambda$, the logistic distribution, for all $y$, $$ \beta(y) = \sigma_L (e_1 y - \widehat \beta)/\widehat \sigma, \ \ \alpha_i(y) = -\sigma_L \widehat \alpha_i/\widehat \sigma, \ \text{and} \ \gamma_j(y) = - \sigma_L \widehat \gamma_j/\widehat \sigma, $$ where $e_1$ is a unit vector of dimension $d_x$ with a one in the first component. As in the empirical application, the region of interest $\mathcal{Y}$ is the interval between zero and the $0.95$-quantile of the volume of trade in the data set. All the results are based on 500 simulated panels $\{(y^s_{ij}, x_{ij}) : (i,j) \in \mathcal{D}\}$.

Figures (ref) and (ref) report the biases, standard deviations and root mean square errors (rmses) of the fixed effects estimators of the DR coefficients of log-distance and legal system as a function of the quantiles of $y_{ij}$ in the design with independent errors.\footnote{The design with pairwise dependent errors produces similar results, which are not reported for the sake of brevity.} All the results are in percentage of the true value of the parameter. As predicted by the large sample theory, the fixed effects estimator displays a bias of the same order of magnitude as the standard deviation. As in fig. (ref), the bias is more severe for the coefficient of log distance. The bias correction removes most of the bias and does not increase the standard deviation, yielding a reduction in rmse of about 5% for the coefficient of log distance at the highest quantile indexes.

figure[figure omitted — 518 chars of source]
figure[figure omitted — 524 chars of source]

Figure (ref) reports the biases, standard deviations and rmses of the estimators of the counterfactual distributions at two levels of log-distance as a function of the quantiles of $y_{ij}$ in the design with independent errors. The levels of distance in these distributions are the same as in the empirical application, i.e. $k=0$ and $k=1$ correspond to the observed values and two times the observed values, respectively. All the results are in percentage of the true value of the functions. In this case we find that the uncorrected and bias corrected estimators display small biases relative to their standard deviations, and have similar standard deviations and rmses at both treatment levels. Indeed the standard deviations and rmses are difficult to distinguish in the figure as they are almost superposed. In results not reported, we find very similar patterns in the design with pairwise dependent errors and for the estimators of the counterfactual distributions at the same two levels of legal as in the empirical application.

figure[figure omitted — 838 chars of source]

Table (ref) shows results on the finite sample properties of 95% confidence bands for the DR coefficients and counterfactual distributions in the design with independent errors. The confidence bands are constructed by multiplier bootstrap with 500 draws, standard normal weights, and a grid of values $\bar \mathcal{Y}$ that includes the sample quantiles of the volume of trade with indexes $\{.54, .55, \ldots, .95\}$ in the trade data set. For the coefficients, it reports the average length of the confidence bands integrated over threshold values, the average value of the estimated critical values, and the empirical coverages of the confidence bands. For the distributions, it reports the same measures averaged also over the two treatment levels and where the coverage of the bands is joint for the two counterfactual distributions.\footnote{The joint coverage of the bands for the quantile functions and quantile effect is determined by the joint coverage of the bands of the distribution functions in our construction. We refer to CFVMW2015 for a numerical analysis on the marginal coverage of the bands for the quantile effects.} For comparison, it also reports the coverage of pointwise confidence bands using the normal distribution, i.e. with critical value equal to 1.96. The last row computes the ratio of the standard error averaged across simulations to the simulation standard deviation, integrated over threshold values for the coefficients and over thresholds and treatment levels for the distributions. We consider standard errors and confidence bands with and without accounting for pairwise clustering. All the results are computed for confidence bands centered at the uncorrected fixed effects estimates and at the bias corrected estimates. For the coefficients, we find that the bands centered at the uncorrected estimates undercover the true coefficients, whereas the bands centered at the bias corrected estimates have coverages close to the nominal level. The joint coverage of the bands for the distributions is close to the nominal level regardless of whether they are centered at the uncorrected or bias corrected estimates. We attribute this similarity in coverage to the small biases in the uncorrected estimates of the distributions found in fig. (ref). As expected, pointwise bands severely undercover the entire functions. The standard errors based on the asymptotic distribution provide a good approximation to the sampling variability of both the uncorrected and bias corrected estimators. Accounting for pairwise clustering in this design where it is not necessary has very little effect on the quality of the inference.

table[table omitted — 1,691 chars of source]

Table (ref) reports the same results as table (ref) for the design with pairwise dependent errors. The bands that do not account for pairwise clustering undercover the functions because the standard errors underestimate the standard deviations of the estimators. Compared to the design with independent errors, the critical values are similar but the bands that account for clustering are wider due to the increase in the standard errors. To sum up, inference methods robust to pairwise clustering perform well in both designs, whereas inference methods that do not account for clustering undercover in the presence of pairwise dependence. The bias corrections are effective in reducing bias and bringing the coverage probabilities of the bands close to their nominal level for the coefficients, whereas they have little effect for the distributions.

table[table omitted — 1,698 chars of source]

Conclusion

We have constructed confidence bands for quantile functions and quantile effects in nonlinear network and panel models with two-way unobserved effects. Our construction relies on the generic method of CFVMW2015 to convert confidence bands for distributions into confidence bands for quantiles. The same method can be applied to more complicated models such as nonlinear models with interactive unobserved effects or factor structure, provided that confidence bands for distributions in these models are supplied. Such bands are not currently available, but could be obtained by extending the central limit theorem of Chen, Fern\'andez-Val and Weidner (in press) to a functional central limit theorem. We leave such extension to future work.

\phantom{cfw14}

appendix\setcounter{equation}{0} \section{Proofs of Main Text Results} We present the proofs of Theorems (ref) and (ref), and relegate various technical details to the on-line supplementary appendix. Once Theorems (ref) and (ref) are shown, the proof of Theorem (ref) for the multiplier bootstrap follows from Theorem 2.2 in cck-16. The uniform confidence bands $I_F$ for the cdfs in (ref) obtained by the multiplier bootstrap can then be inverted and differenced to obtain uniform confidence bands for the quantile function and quantile effects, see CFVMW2015 and also Lemma (ref) and (ref) above. This appendix thus contains the proofs of all the main results that are new to the current paper. The proofs for all of the lemmas below are given in the supplementary appendix. All stochastic statements in the following are conditional on $ \{(x_{ij}, v_i, w_j): (i,j) \in \mathcal{D}\}$. As explained in Section (ref), we consider the logistic cdf $\Lambda_y(\pi) = \Lambda(\pi) = (1+\exp(-\pi))^{-1}$ for all our theorems. In the following we indicate the dependence on $y \in \mathcal{Y}$ as a subscript, for example, we write $\theta_y$ instead of $\theta(y)$ from now on. We use the column vector $w_{ij} = (x_{ij}', e_{i,I}', e_{j,J}')'$, as in Section (ref), and can then write the single index $\pi_{y,ij} := x_{ij}' \beta_y + \alpha_{y,i} + \gamma_{y,j}$ simply as $\pi_{y,ij} = w_{ij}' \theta_y$. The corresponding estimator is $\widehat \pi_{y,ij} = w_{ij}' \widehat \theta_y$. We also define minus the log-likelihood function as $ \ell_{y,ij}(\pi) := - 1\{y_{ij} \leq y \} \log \Lambda(\pi) - 1\{y_{ij} > y \} \log [1 - \Lambda(\pi)]$. Let $\pi_y$ be a $n$-vector containing $\pi_{y,ij}$, $(i,j) \in \mathcal{D}$. For a given $y \in \mathcal{Y}$ we can then rewrite the estimation problem in (ref) as \begin{align} \widehat \pi_y &= \arg \min_{\pi_y \in \mathbb{R}^n} \sum_{(i,j) \in \mathcal{D}} \ell_{y,ij}(\pi_{y,ij}) , && s.t. & \exists\, \theta \in \mathbb{R}^{d_x + I + J}: \, \pi_{y,ij} = w_{ij}' \theta_y . \end{align} In the following we denote the true parameter values by $\theta^0$, and correspondingly we write $\pi^0_{y,ij} = w_{ij}' \theta^0_y$, in order to distinguish the true value from generic values like the argument $\pi_{y,ij}$ in the last display. For the $k$'th derivative of $\ell_{y,ij}(\pi_{y,ij})$ with respect to $\pi_{y,ij}$ we write $\partial_{\pi^k} \ell_{y,ij}(\pi_{y,ij})$, and we drop the argument when the derivative is evaluated at $\pi^0_{y,ij}$, that is, $\partial_{\pi^k} \ell_{y,ij} = \partial_{\pi^k} \ell_{y,ij}(\pi^0_{y,ij})$. The normalized score for observation $i,j$ then reads \begin{align*} s_{y,ij} := \left[ \partial_{\pi^2} \ell_{y,ij} \right]^{-1/2} \partial_\pi \ell_{y,ij} = \left( \Lambda^{(1)}_{y,ij} \right)^{-1/2} \partial_\pi \ell_{y,ij} , \end{align*} where $\Lambda^{(1)}_{y,ij} = \Lambda^{(1)}(\pi^0_{y,ij}) = \partial_{\pi} \Lambda(\pi^0_{y,ij}) $, as defined in Section (ref). Note that ${\mathbb{E}} s_{y,ij} = 0$ and ${\mathbb{E}} s_{y,ij}^2 =1$. Let $s_y$ be the $n$-vector obtained by stacking the elements $s_{y,ij}$ across all observations $(i,j) \in \mathcal{D}$. Similarly, let $\Lambda^{(1)}_{y}$ be the $n \times n$ diagonal matrix with diagonal elements given by $\Lambda^{(1)}_{y,ij}$, $(i,j) \in \mathcal{D}$. Finally, let $w$ be the $n \times (d_x+I+J)$ matrix with rows given by $w_{ij}'$, $(i,j) \in \mathcal{D}$. We define the $n \times n$ symmetric idempotent matrix \begin{align*} Q_y := \left( \Lambda^{(1)}_{y} \right)^{1/2} w \left( w' \Lambda^{(1)}_{y} w \right)^\dagger w' \left( \Lambda^{(1)}_{y} \right)^{1/2} , \end{align*} where $\dagger$ is the Moore-Penrose pseudoinverse. For the elements of this matrix we write $Q_{y,ij,i'j'}$. We have $\left( Q_y s_y \right)_{ij} = \sum_{(i',j') \in \mathcal{D}} Q_{y, ij, i'j'} s_{y,i'j'}$. The constraint $\exists\, \theta: \, \pi_{y,ij} = w_{ij}' \theta_y$ in (ref) can then equivalently be written as\footnote{ In matrix notation the constraint can be written as $ \pi_y= w \, \theta_y$, and we thus have $ Q_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \pi_y = Q_y \left( \Lambda^{(1)}_{y} \right)^{1/2} w \, \theta_y = \left( \Lambda^{(1)}_{y} \right)^{1/2} w \, \theta_y = \left( \Lambda^{(1)}_{y} \right)^{1/2} \pi_y $, where we also used that $ Q_y \left( \Lambda^{(1)}_{y} \right)^{1/2} w = \left( \Lambda^{(1)}_{y} \right)^{1/2} w$, which follows from the definition of $Q_y$. } \begin{align} Q_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \pi_y = \left( \Lambda^{(1)}_{y} \right)^{1/2} \pi_y . \end{align} The matrix $Q_y$ projects onto the column span of $ \left( \Lambda^{(1)}_{y} \right)^{1/2} w$. This projector acts in the space of weighted index vectors $\left[ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \pi_{y,ij} \, : \, (i,j) \in \mathcal{D} \right]$, and the weighting of each $ \pi_{y,ij}$ by $\left( \Lambda^{(1)}_{y,ij} \right)^{1/2}$ is natural, because $\Lambda^{(1)}_{y,ij} $ is simply the expected Hessian for observation $(i,j)$. \subsection{Technical Lemmas} We require some results for the proofs of the main theorems below. The following lemma provides an asymptotic expansion of $\widehat \pi_{y,ij} - \pi^0_{y,ij} $. \begin{lemma}[Score expansion of fixed effect estimates] Under Assumption (ref), for $y \in \mathcal{Y}$ and $(i,j) \in \mathcal{D}$, we have \begin{align*} \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \left( \widehat \pi_{y,ij} - \pi^0_{y,ij} \right) &= - \left( Q_y s_y \right)_{ij} - \frac 1 2 \sum_{(i',j') \in \mathcal{D}} \, Q_{y, ij, i'j'} \, \frac{ \Lambda^{(2)}_{y,i'j'} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{3/2} } \left[ \left( Q_y s_y \right)_{i'j'} \right]^2 + r_{y,ij}, \end{align*} and the remainder $r_{y,ij}$ satisfies $\sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| r_{y,ij} \right| = o_P(n^{-1/2})$. \end{lemma} The expansion in the preceding lemma is a second-order stochastic expansion, because it does not only describe the terms linear in the score $s_y$, but also the terms quadratic in $s_y$. We need to keep track of those quadratic terms, because they yield the leading order incidental parameter biases that appear in Theorem (ref). The remainder $r_{y,ij}$ contains higher-order terms in $s_y$ (cubic, quartic, etc), which turn out not to matter for the result in Theorem (ref). Note also that $\Lambda^{(2)}_{y,ij} = \partial_{\pi^3} \ell_{y,ij} $. Thus, the term quadric in the score is proportional to the third derivative of the objective function. We now want to decompose the projector $Q_y$ into the parts stemming from $x_{ij}$, $e_{i,I}$ and $e_{j,J}$, respectively. We have already introduced the $d_x$-vector $\widetilde x_{y,ij} = \widetilde x_{ij}(y)$ in Section (ref). Let $\widetilde x_y$ be the $n \times d_x$ matrix with rows given by $\widetilde x'_{y,ij}$, $(i,j) \in \mathcal{D}$. The $d_x \times d_x$ matrix $W_y = W(y) = n^{-1} \widetilde x_y' \Lambda^{(1)}_{y} \widetilde x_y$ was also introduced in Section (ref). Invertibility of $W_y$ is guaranteed by Assumption (ref)$(vi)$, and uniform boundedness of $\Lambda^{(1)}_{y,ij} $ and $\left(\Lambda^{(1)}_{y,ij} \right)^{-1}$, as formalized by the following lemma. \begin{lemma}[Invertibility of $W_y$] Let Assumption (ref) hold. Then $\sup_{y \in \mathcal{Y}} \| W_y^{-1} \| = O_P(1)$. \end{lemma} Next, define $w^{(2)}_{ij} = e_{i,I} $ and $w^{(3)}_{ij} = e_{j,J}$, and let $w^{(2)}$ and $w^{(3)}$ be the corresponding $n \times I$ and $n \times J$ matrices with rows given by $w^{(2)'}_{ij}$ and $w^{(3)'}_{ij}$, respectively. Let \begin{align*} Q^{(1)}_y &:= n^{-1} \, \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_y \, W_y^{-1} \, \widetilde x_y' \left( \Lambda^{(1)}_{y} \right)^{1/2} , \\ Q^{({\rm FE})}_y &:= \left( \Lambda^{(1)}_{y} \right)^{1/2} \left[w^{(2)},w^{(3)} \right] \left( \left[w^{(2)},w^{(3)} \right]' \Lambda^{(1)}_{y} \left[w^{(2)},w^{(3)} \right] \right)^\dagger \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}_{y} \right)^{1/2} . \end{align*} $\widetilde x_{y,ij}$ is defined as the part of $ x_{y,ij}$ that is orthogonal to the fixed effects under a metric given by $\Lambda^{(1)}_{y,ij} $. We have $ Q^{({\rm FE})}_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_y = 0$, which implies that \begin{align} Q_y = Q^{(1)}_y + Q^{({\rm FE})}_y \end{align} and also $Q^{(1)}_y Q^{({\rm FE})}_y = Q^{({\rm FE})}_y Q^{(1)}_y = 0$. Also, because $Q^{(1)}_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_{y} = \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_{y}$ and also $Q^{({\rm FE})}_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_{y} = 0$, we obtain \begin{align} Q_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_{y} = \left(Q^{(1)}_y + Q^{({\rm FE})}_y\right) \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_{y} = \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_{y} . \end{align} We have thus decomposed $Q_y$ into the component stemming from the regressors and a component stemming from the fixed effects. For the elements of $ Q^{(1)}_y$, \begin{align} Q^{(1)}_{y,ij,i'j'} &= n^{-1} \left( \Lambda^{(1)}_{y,ij} \, \Lambda^{(1)}_{y,i'j'} \right)^{1/2} \widetilde x'_{y,ij} \, W_y^{-1} \, \widetilde x_{y,i'j'} . \end{align} Next, define the projection matrices \begin{align*} Q^{(2)}_y &:= \left( \Lambda^{(1)}_{y} \right)^{1/2} w^{(2)} \left( w^{(2) \, \prime} \Lambda^{(1)}_{y} w^{(2)} \right)^{-1} w^{(2) \, \prime} \left( \Lambda^{(1)}_{y} \right)^{1/2} , \\ Q^{(3)}_y &:= \left( \Lambda^{(1)}_{y} \right)^{1/2} w^{(3)} \left( w^{(3) \, \prime} \Lambda^{(1)}_{y} w^{(3)} \right)^{-1} w^{(3) \, \prime} \left( \Lambda^{(1)}_{y} \right)^{1/2} . \end{align*} Notice that $w^{(2) \, \prime} \Lambda^{(1)}_{y} w^{(2)}$ and $w^{(3) \, \prime} \Lambda^{(1)}_{y} w^{(3)}$ are simply diagonal $I \times I$ and $J \times J$ matrices with diagonal entries $\sum_{j \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij} $ and $\sum_{i \in \mathcal{D}_j} \Lambda^{(1)}_{y,ij} $, respectively, and therefore \begin{align} Q^{(2)}_{y,ij,i'j'} &= 1(i=i') \frac{ \left( \Lambda^{(1)}_{y,ij} \, \Lambda^{(1)}_{y,i j'} \right)^{1/2}} {\sum_{j” \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij”}} , & Q^{(3)}_{y,ij,i'j'} &= 1(j=j') \frac{ \left( \Lambda^{(1)}_{y,ij} \, \Lambda^{(1)}_{y,i'j} \right)^{1/2}} {\sum_{i” \in \mathcal{D}_j} \Lambda^{(1)}_{y,i”j}} . \end{align} It is not exactly true that $Q^{({\rm FE})}_y$ equals $Q^{(2)}_y + Q^{(3)}_y$, but Lemma (ref) shows that this is approximately true in a well-defined sense. \begin{lemma}[Properties of $Q_y$] Under Assumption (ref), \begin{itemize} • $ Q_y = Q^{(1)}_y + Q^{({\rm FE})}_y $ and $Q^{({\rm FE})}_y = Q_y^{(2)} + Q_y^{(3)} + Q_y^{({\rm rem})},$ where $$ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \max_{(i',j') \in \mathcal{D}} \left| Q_{y,ij,i'j'}^{({\rm rem})} \right| = O_P(n^{-1}).$$$ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \sum_{(i',j') \in \mathcal{D}} \left| Q_{y, ij, i'j'} \right| = O_P(1),$ and \\[3pt] $ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \sum_{(i',j') \in \mathcal{D}} \left| Q^{({\rm FE})}_{y, ij, i'j'} \right| = O_P(1).$$ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \max_{(i',j') \in \mathcal{D}} \left| Q_{y, ij, i'j'} \right| = O_P(n^{-1/2}).$ \end{itemize} \end{lemma} \begin{remark}[Bias of $\widehat \pi_{y,ij}$] According to part (i) of this lemma the remainder term $Q_y^{({\rm rem})} = Q^{({\rm FE})}_y - Q^{(2)}_y - Q^{(3)}_y$ has elements uniformly bounded of order $n^{-1}$, and it can easily be seen from (ref) that the same is true for $Q_y^{(1)}$, because the elements of $\widetilde x_{y}$ are also uniformly bounded under our assumptions. By contrast, $Q_y^{(2)}$ and $Q_y^{(3)}$ have elements of order $J^{-1}$ and $I^{-1}$, respectively, that is, of order $n^{-1/2}$. Using this and the fact that $s_{y,ij}$ has variance one and is independent across observations $(i,j)$ we find \begin{align} {\mathbb{E}} \left[ \left( Q_y s_y \right)_{ij} \right]^2 &= \sum_{(i',j') \in \mathcal{D}} [Q_{y,ij,i'j'}]^2 = Q_{y,ij,ij} = Q^{(2)}_{y,ij,ij} + Q^{(3)}_{y,ij,ij} + O_P(n^{-1}) \nonumber \\ &= \frac{\Lambda^{(1)}_{y,ij} } {\sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'} } + \frac{ \Lambda^{(1)}_{y,ij}} { \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j} } + O_P(n^{-1}) , \end{align} where we use that $Q_y$ is idempotent in the second step, and (ref) in the third step. Combining this with Lemma (ref) one finds that the leading order bias term in $\widehat \pi_{y,ij} - \pi^0_{y,ij} $ is given by \begin{align*} - \frac 1 2 \sum_{(i',j') \in \mathcal{D}} \, Q_{y, ij, i'j'} \, \frac{ \Lambda^{(2)}_{y,i'j'} } { \Lambda^{(1)}_{y,i'j'} } \left[ \frac{1} {\sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'} } + \frac{1} { \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j} } \right] , \end{align*} which then translates into corresponding bias terms for all other estimators as well. \end{remark} For the following lemma, let $Z^{(\beta)}_y = Z^{(\beta)}(y)$, $Z^{(F)}_y = Z^{(F)}(y) $, $B^{(\beta)}_y=B^{(\beta)}(y)$, $D^{(\beta)}_y =D^{(\beta)}(y) $, $B^{(\Lambda)}_{y,k} =B^{(\Lambda)}_k(y) $ and $D^{(\Lambda)}_{y,k}=D^{(\Lambda)}_k(y)$ be as defined in and before Theorem (ref) in the main text. \begin{lemma}[Properties of score averages] Under Assumption (ref), \begin{itemize} • $\sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q_y s_y \right)_{ij} \right| = o_P(n^{-1/6})$. • $- W_y^{-1} \, n^{-1/2} \, \sum_{(i,j) \in \mathcal{D}} \, \widetilde x_{y,ij} \, \partial_\pi \ell_{y,ij} \rightsquigarrow Z^{(\beta)}_y$, in $\ell^{\infty}(\mathcal{Y})^{d_x}$. • $- \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \left[ \Psi_{y,ij} + (\partial_\beta F_{y}) \, W_y^{-1} \, \widetilde x_{y,ij} \right] \partial_\pi \ell_{y,ij} \rightsquigarrow Z^{(F)}_y$, in $\ell^{\infty}(\mathcal{Y})^{|\mathcal{K}|}$. • $ - \frac 1 2 W_y^{-1} \; \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \Lambda^{(2)}_{y,ij} \left[ \left( Q_y s_y \right)_{ij} \right]^2 - \left( \frac{ I } {\sqrt{n}} B^{(\beta)}_y + \frac{ J} {\sqrt{n}} D^{(\beta)}_y \right) \rightarrow_P 0 $, uniformly in $y \in \mathcal{Y}$. • $ \frac 1 {2 \sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \left( \Lambda^{(2)}_{y,ij,k} - \Lambda^{(2)}_{y,ij} \Psi_{y,ij,k} \right) \left[ \left( Q_y s_y \right)_{ij} \right]^2 - \left( \frac{ I } {\sqrt{n}} B^{(\Lambda)}_{y,k} + \frac{ J} {\sqrt{n}} D^{(\Lambda)}_{y,k} \right) \rightarrow_P 0 $, uniformly in $y \in \mathcal{Y}$. \end{itemize} \end{lemma} Regarding part (i) of this lemma, notice that pointwise we have $ \left( Q_y s_y \right)_{ij} = O_P(n^{-1/4})$, because (ref) implies that $ {\mathbb{E}} \left[ \left( Q_y s_y \right)_{ij} \right]^2 = O_P(n^{-1/2})$. However, after taking the supremum over $y$, $i$, $j$ the term is growing faster than $n^{-1/4}$. The rate $o_P(n^{-1/6})$ in part (i) of the lemma is crude, but sufficient for our purposes. \begin{lemma}[Uniform Consistency of Estimators of Bias and Variance Components] Let Assumption (ref) hold. Then, \begin{align*} \sup_{y \in \mathcal{Y}} \left\| \widehat W(y) - \overline W(y) \right\| &= o_P(1), & \sup_{y \in \mathcal{Y}} \left\| \partial_{\beta} \widehat F(y) - \partial_{\beta} F(y) \right\| &= o_P(1), \\ \sup_{y \in \mathcal{Y}} \left\| \widehat B^{(\beta)}(y) - B^{(\beta)}(y) \right\| &= o_P(1), & \sup_{y \in \mathcal{Y}} \left\| \widehat D^{(\beta)}(y) - D^{(\beta)}(y) \right\| &= o_P(1), \\ \sup_{y \in \mathcal{Y}} \left\| \widehat B^{(\Lambda)}(y) - B^{(\Lambda)}(y) \right\| &= o_P(1), & \sup_{y \in \mathcal{Y}} \left\| \widehat D^{(\Lambda)}(y) - D^{(\Lambda)}(y) \right\| &= o_P(1), \\ \sup_{y \in \mathcal{Y}} \left\| \widehat \Omega(y) - \overline \Omega(y) \right\| &= o_P(1), \end{align*} where $\|\cdot\|$ denotes the Frobenius matrix norm, i.e. $\|A\| = \text{trace}(AA')^{1/2}$ for a matrix $A$. \end{lemma} As already mentioned above, the proof of the technical lemmas that we have stated here is provided in the Supplementary Appendix. \subsection{Proof of Main Text Theorems} \begin{proof}[\bf Proof of Theorem (ref)] \# Part 1: FCLT for $\widehat \beta_y =\widehat \beta(y) $. \\ The definition of $\widetilde x_y$ implies that $\sum_{i \in \mathcal{D}_j} \Lambda^{(1)}_{y,ij} \widetilde x_{y,ij} = 0$ and $\sum_{j \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij} \widetilde x_{y,ij} = 0$, and $n^{-1} \sum_{(i,j) \in \mathcal{D}} \allowbreak \Lambda^{(1)}_{y,ij} \widetilde x_{y,ij} x_{ij}' = n^{-1} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{y,ij} \widetilde x_{y,ij} \widetilde x_{ij}' = W_y$. Using this and \begin{align*} \widehat \pi_{y,ij} - \pi^0_{y,ij} := x_{ij}' \left( \widehat \beta_y - \beta^0_y \right) + \left( \widehat \alpha_{y,i} - \alpha^0_{y,i} \right) + \left( \widehat \gamma_{y,j} - \gamma^0_{y,j} \right) \end{align*} we obtain \begin{align*} n^{-1} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \, \Lambda^{(1)}_{y,ij} \, \left( \widehat \pi_{y,ij} - \pi^0_{y,ij} \right) &= n^{-1} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \, \Lambda^{(1)}_{y,ij} \, x_{ij}' \left( \widehat \beta_y - \beta^0_y \right) = W_y \left( \widehat \beta_y - \beta^0_y \right) , \end{align*} and therefore \begin{align*} \widehat \beta_y - \beta^0_y &= W_y^{-1} \; n^{-1} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \, \Lambda^{(1)}_{y,ij} \, \left( \widehat \pi_{y,ij} - \pi^0_{y,ij} \right) . \end{align*} By combining this with Lemma (ref) we obtain \begin{align} \sqrt{n}\left( \widehat \beta_y - \beta^0_y \right) &= T^{(1,\beta)}_{y} + T^{(2,\beta)}_{y} + r^{(\beta)}_{y} , \end{align} where \begin{align*} T^{(1,\beta)}_{y} &:= - n^{-1/2} \; W_y^{-1} \; \sum_{(i,j) \in \mathcal{D}} \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \; \widetilde x_{y,ij} \, \left( Q_y s_y \right)_{ij} , \\ T^{(2,\beta)}_{y} &:= - \frac 1 2 n^{-1/2} \; W_y^{-1} \; \sum_{(i,j) \in \mathcal{D}} \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \; \widetilde x_{y,ij} \, \sum_{(i',j') \in \mathcal{D}} \, Q_{y, ij, i'j'} \, \frac{ \Lambda^{(2)}_{y,i'j'} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{3/2} } \left[ \left( Q_y s_y \right)_{i'j'} \right]^2 , \end{align*} and $r^{(\beta)}_{y} := W_y^{-1} \, n^{-1/2} \sum_{(i,j) \in \mathcal{D}} \widetilde x_{y,ij} \, \left(\Lambda^{(1)}_{y,ij} \right)^{1/2} \, r_{y,ij}$ satisfies \begin{align*} \sup_{y \in \mathcal{Y}} \left| r^{(\beta)}_{y} \right| &\leq \underbrace{ \left( \sup_{y \in \mathcal{Y}} \, W_y^{-1} \, n^{-1/2} \, \sum_{(i,j) \in \mathcal{D}} \left| \widetilde x_{y,ij} \right| \left| \left(\Lambda^{(1)}_{y,ij} \right)^{1/2} \right| \right) }_{= O_P(n^{1/2})} \underbrace{ \left( \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| r_{y,ij} \right| \right) }_{= o_P(n^{-1/2})} = o_P(1) , \end{align*} where we also use that $ \Lambda^{(1)}_{y,ij}$ and $\widetilde x_{y,ij}$ are uniformly bounded under our assumptions. For the term linear in the score we find \begin{align*} T^{(1,\beta)}_{y} &= - n^{-1/2} W_y^{-1} \, \widetilde x'_{y} \, \left( \Lambda^{(1)}_{y} \right)^{1/2} Q_y s_y = - n^{-1/2} W_y^{-1} \, \widetilde x'_{y} \, \left( \Lambda^{(1)}_{y} \right)^{1/2} \, s_y \\ &= - W_y^{-1} \, n^{-1/2} \, \sum_{(i,j) \in \mathcal{D}} \, \widetilde x_{y,ij} \, \partial_\pi \ell_{y,ij} \rightsquigarrow Z^{(\beta)}_y , \end{align*} where in the second step we used (ref), and the final step follows from part $(ii)$ of Lemma (ref). Employing again (ref) we find \begin{align*} T^{(2,\beta)}_{y} &:= - \frac 1 2 \; W_y^{-1} \, n^{-1/2} \sum_{(i',j') \in \mathcal{D}} \, \underbrace{ \sum_{(i,j) \in \mathcal{D}} \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \; \widetilde x_{y,ij} \, Q_{y, ij, i'j'} }_{= \left( \Lambda^{(1)}_{y,i'j'} \right)^{1/2} \; \widetilde x_{y,i'j'}} \frac{ \Lambda^{(2)}_{y,i'j'} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{3/2} } \left[ \left( Q_y s_y \right)_{i'j'} \right]^2 \\ &= - \frac 1 2 W_y^{-1} \; n^{-1/2} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \frac{ \Lambda^{(2)}_{y,ij} } { \Lambda^{(1)}_{y,ij} } \left[ \left( Q_y s_y \right)_{ij} \right]^2 , \end{align*} and according to part $(iv)$ of Lemma (ref) we thus have \begin{align*} T^{(2,\beta)}_{y} - \left( \frac{I} {n^{1/2}} \, B^{(\beta)}_y + \frac{J} {n^{1/2}} \, D^{(\beta)}_y \right) & \rightarrow_P 0, \end{align*} uniformly in $y \in \mathcal{Y}$. Combining the above gives the result for $\sqrt{n}\left( \widehat \beta_y - \beta^0_y \right)$ in the theorem. \# Part 2: FCLT for $\widehat F_{y,k} =\widehat F_{k}(y) $. \\ Let $ \pi_{y,ij,k}^0 := \pi_{y,ij}^0 + (\mathbbm{x}_{ij,k} - x_{ij})' \beta_y^0 $ and $\widehat \pi_{y,ij,k} := \widehat \pi_{y,ij} + (\mathbbm{x}_{ij,k} - x_{ij})' \widehat \beta_y $. Because $\mathbbm{x}_{ij,k} - x_{ij} = \widetilde{\mathbbm{x}}_{y,ij,k} - \widetilde x_{y,ij}$ we have \begin{align} \widehat \pi_{y,ij,k} - \pi_{y,ij,k}^0 &= \widehat \pi_{y,ij} - \pi_{y,ij}^0 + (\widetilde{\mathbbm{x}}_{y,ij,k} - \widetilde x_{y,ij})' ( \widehat \beta_y -\beta_y^0 ) . \end{align} Using (ref) and $Q^{(1)}_y \left( \Lambda^{(1)}_{y} \right)^{1/2} \pi_y = \left( \Lambda^{(1)}_{y} \right)^{1/2} \widetilde x_y \beta_y$ for any $\pi_y = w \theta_y$, \begin{align*} \widehat \pi_y - \pi^0_y &= \left( \Lambda^{(1)}_{y} \right)^{-1/2} \underbrace{ \left(Q^{(1)}_y+Q^{(\rm FE)}_y \right) }_{=Q_y} \left( \Lambda^{(1)}_{y} \right)^{1/2} ( \widehat \pi_y - \pi^0_y) \\ &= \left( \Lambda^{(1)}_{y} \right)^{-1/2} Q^{(\rm FE)}_y \left( \Lambda^{(1)}_{y} \right)^{1/2} ( \widehat \pi_y - \pi^0_y) + \widetilde x_{y} ( \widehat \beta_y -\beta_y^0 ) . \end{align*} Combining the above gives \begin{align*} \widehat \pi_{y,ij,k} - \pi_{y,ij,k}^0 &= \left[ \left( \Lambda^{(1)}_{y} \right)^{-1/2} Q^{(\rm FE)}_y \left( \Lambda^{(1)}_{y} \right)^{1/2} ( \widehat \pi_y - \pi^0_y) \right]_{ij} + \widetilde{\mathbbm{x}}_{y,ij,k}' ( \widehat \beta_y -\beta_y^0 ) . \end{align*} Using Lemma (ref) and the properties of $Q_y$, $Q^{(1)}_y$ and $Q^{(\rm FE)}_y$, we thus find \begin{align} \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \left( \widehat \pi_{y,ij,k} - \pi_{y,ij,k}^0 \right) &= - \left( Q^{(\rm FE)}_y s_y \right)_{ij} - \frac 1 2 \sum_{(i',j') \in \mathcal{D}} \, Q^{(\rm FE)}_{y, ij, i'j'} \, \frac{ \Lambda^{(2)}_{y,i'j'} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{3/2} } \left[ \left( Q_y s_y \right)_{i'j'} \right]^2 \nonumber \\ & \qquad + \left( Q^{(\rm FE)} r_{y} \right)_{ij} + \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \widetilde{\mathbbm{x}}_{y,ij,k}' ( \widehat \beta_y -\beta_y^0 ) . \end{align} Next, by expanding $\Lambda(\widehat \pi_{y,ij,k})$ in $\widehat \pi_{y,ij,k}$ around $ \pi_{y,ij,k}^0$ we find \begin{align*} \widehat F_{y,k} - F_{y,k} &= n^{-1} \sum_{(i,j) \in \mathcal{D}} \left[ \Lambda(\widehat \pi_{y,ij,k}) - \Lambda(\pi^0_{y,ij,k}) \right] \\ & = n^{-1} \sum_{(i,j) \in \mathcal{D}} \bigg[ \Lambda^{(1)}_{y,ij,k} \left( \widehat \pi_{y,ij,k} - \pi^0_{y,ij,k} \right) + \frac 1 2 \Lambda^{(2)}_{y,ij,k} \left( \widehat \pi_{y,ij,k} - \pi^0_{y,ij,k} \right)^2 \\ & \qquad \qquad \qquad \qquad \qquad \qquad \qquad + \frac 1 6 \Lambda^{(3)}(\widetilde \pi_{y,ij,k}) \left( \widehat \pi_{y,ij,k} - \pi^0_{y,ij,k} \right)^3 \bigg], \end{align*} where $\widetilde \pi_{y,ij,k}$ is some value between $\widehat \pi_{y,ij,k}$ and $ \pi^0_{y,ij,k}$, and we use the notation $\Lambda^{(\ell)}_{y,ij,k} = \Lambda^{(\ell)}(\pi^0_{y,ij,k}) $, which corresponds to $\Lambda^{(\ell)}_{ij,k}(y)$ in the main text. By appropriately inserting (ref) and (ref) into this expansion, also using (ref), and sorting by terms linear in $s_y$, quadratic in $s_y$, and remainder, we find \begin{align} \sqrt{n}\left( \widehat F_{y,k} - F_{y,k} \right) &= T^{(1,F)}_{y,k} + T^{(2,F)}_{y,k} + r^{(F)}_{y,k} , \end{align} where the terms linear in $s_y$ read \begin{align*} T^{(1,F)}_{y,k} &= - \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{y,ij,k} \left[ \frac{ \left( Q^{(\rm FE)}_y s_y \right)_{ij} } { \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}} + \widetilde{\mathbbm{x}}_{y,ij,k}' W_y^{-1} \frac 1 n \sum_{(i',j') \in \mathcal{D}} \widetilde x_{y,i'j'} \, \partial_\pi \ell_{y,i'j'} \right], \end{align*} with $\partial_\pi \ell_{y,i'j'} = \left( \Lambda^{(1)}_{y,i'j'} \right)^{1/2} s_{y,i'j'}$. The projection $\Psi_{y,ij,k} = \Psi_{ij,k}(y)$, defined just before (ref) in the main text, can be written in terms of the matrix $Q^{({\rm FE})}_y$ as \begin{align} \Psi_{y,ij,k} &= \left( \Lambda^{(1)}_{y,ij} \right)^{-1/2} \sum_{(i',j') \in \mathcal{D}} Q^{({\rm FE})}_{y,ij,i'j'} \frac{ \Lambda^{(1)}_{y,i'j',k} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{1/2}} , \end{align} which implies that $\sum_{(i,j) \in \mathcal{D}} \Psi_{y,ij,k} \partial_\pi \ell_{y,ij} = \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{y,ij,k} \left( \Lambda^{(1)}_{y,ij} \right)^{-1/2} \left( Q^{({\rm FE})}_y s_y \right)_{ij} $. Using $\partial_\beta F_{y,k} = \partial_\beta F_k(y) = n^{-1} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{ij,k}(y) \, \widetilde{\mathbbm{x}}_{y,ij,k}^{\, \prime}$ we obtain \begin{align} T^{(1,F)}_{y,k} &= - \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \left( \Psi_{y,ij,k} + \partial_\beta F_{y,k} W_y^{-1} \widetilde x_{y,ij} \right) \partial_\pi \ell_{y,ij} . \end{align} According to part $(iii)$ of Lemma (ref) the vector $T^{(1,F)}_{y} = \left[ T^{(1,F)}_{y,k} \, : \, k \in \mathcal{K} \right]$ therefore satisfies $T^{(1,F)}_{y} \rightsquigarrow Z^{(F)}_y$ asymptotically. The terms quadratic in $s_y$ read \begin{align*} T^{(2,F)}_{y,k} &= - \frac 1 2 \, \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{y,ij,k} \left( \Lambda^{(1)}_{y,ij} \right)^{-1/2} \sum_{(i',j') \in \mathcal{D}} \, Q^{(\rm FE)}_{y, ij, i'j'} \, \frac{ \Lambda^{(2)}_{y,i'j'} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{3/2} } \left[ \left( Q_y s_y \right)_{i'j'} \right]^2 \\ & \quad + \frac 1 2 \, \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \frac{ \Lambda^{(2)}_{y,ij,k}} { \Lambda^{(1)}_{y,ij} } \left[ \left( Q_y s_y \right)_{ij} \right]^2 + (\partial_\beta F_{y,k}) T^{(2,\beta)}_{y} , \end{align*} where for the term quadratic in $\widehat \pi_{y,ij,k} - \pi^0_{y,ij,k} $ in the expansion of $ \widehat F_{y,k} - F_{y,k} $ we do not insert (ref) but rather insert (ref), and we ignore the terms involving $ \widehat \beta_y -\beta_y^0$ here --- they give contributions quadratic in the score $s_y$, but only of smaller order, and we therefore rather include those in the remainder term $r^{(F)}_{y,k}$ below. Using again (ref) we find \begin{align*} T^{(2,F)}_{y,k} &= \frac 1 2 \, \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \frac{ \Lambda^{(2)}_{y,ij,k} - \Lambda^{(2)}_{y,ij} \Psi_{y,ij,k}} { \Lambda^{(1)}_{y,ij} } \left[ \left( Q_y s_y \right)_{ij} \right]^2 + (\partial_\beta F_{y,k}) T^{(2,\beta)}_{y} . \end{align*} Using part $(v)$ of Lemma (ref), and our previous result for $T^{(2,\beta)}_{y} $, we thus obtain \begin{align} T^{(2,F)}_{y,k} - \frac{I} {n^{1/2}} \left[ B^{(\Lambda)}_{y,k} + (\partial_\beta F_{y,k}) B^{(\beta)}_y \right] - \frac{J} {n^{1/2}} \left[ D^{(\Lambda)}_{y,k} + (\partial_\beta F_{y,k}) D^{(\beta)}_y \right] & \rightarrow_P 0, \end{align} uniformly in $y \in \mathcal{Y}$ and $k \in \mathcal{K}$. The remainder term of the expansion reads \begin{align*} r^{(F)}_{y,k} &= n^{-1/2} \sum_{(i,j) \in \mathcal{D}} \bigg\{ \Lambda^{(1)}_{y,ij,k} \left( \Lambda^{(1)}_{y,ij} \right)^{-1/2} \left( Q^{(\rm FE)} r_{y} \right)_{ij} + n^{-1/2} \Lambda^{(1)}_{y,ij,k} \widetilde{\mathbbm{x}}_{y,ij,k}' r^{(\beta)}_{y} \\ & \qquad \qquad \qquad \quad + \frac 1 8 \Lambda^{(2)}_{y,ij,k} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \left[ {\textstyle \sum_{(i',j') \in \mathcal{D}} } \, Q_{y, ij, i'j'} \, \left( \Lambda^{(1)}_{y,i'j'} \right)^{-3/2} \Lambda^{(2)}_{y,i'j'} \left( Q_y s_y \right)_{i'j'}^2 \right]^2 \\ & \qquad \qquad \qquad \quad + \frac 1 2 \Lambda^{(2)}_{y,ij,k} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} (r_{y,ij})^2 + \frac 1 2 \Lambda^{(2)}_{y,ij,k} \left[ ( \mathbbm{x}_{ij,k} - x_{ij})' ( \widehat \beta_y -\beta_y^0 ) \right]^2 \\ & \qquad \qquad \qquad \quad + \frac 1 6 \Lambda^{(3)}(\widetilde \pi_{y,ij,k}) \left[ \widehat \pi_{y,ij} - \pi_{y,ij}^0 + ( \mathbbm{x}_{ij,k} - x_{ij})' ( \widehat \beta_y -\beta_y^0 ) \right]^3 \bigg\}. \end{align*} Our assumptions guarantee that $\Lambda^{(\ell)}_{y,ij} $ and $\Lambda^{(\ell)}_{y,ij,k} $, $\ell \in \{1,2,3\}$, and $\left( \Lambda^{(1)}_{y,ij} \right)^{-1}$ are all uniformly bounded. Lemma (ref) guarantees that $r_{y,ij} = o_P(n^{-1/2})$, uniformly over $y,i,j$, and using Lemma (ref)$(ii)$ this also implies that $ \left( Q^{(\rm FE)} r_{y} \right)_{ij} = o_P(n^{-1/2})$, uniformly over $y,i,j$. Above we have shown $ r^{(\beta)}_{y} = o_P(1)$, uniformly over $y$. Lemma (ref)$(ii)$ and Lemma (ref)$(i)$ imply that \begin{align*} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left[ {\textstyle \sum_{(i',j') \in \mathcal{D}} } \, Q_{y, ij, i'j'} \, \left( \Lambda^{(1)}_{y,i'j'} \right)^{-3/2} \Lambda^{(2)}_{y,i'j'} \left( Q_y s_y \right)_{i'j'}^2 \right]^2 = o_P(n^{-1+1/3}) = o_P(n^{-1/2}) . \end{align*} Our asymptotic result for $\widehat \beta_y$ from part 1 of this proof guarantees that $ \sup_{y \in \mathcal{Y}} \| \widehat \beta_y -\beta_y^0 \|^2 = o_P(n^{-1/2})$. Lemma (ref) together with Lemma (ref)$(ii)$ and Lemma (ref)$(i)$ guarantee that $ \widehat \pi_{y,ij} - \pi^0_{y,ij} = o_P(n^{-1/6})$, uniformly over $y,i,j$. We thus find, uniformly over $y \in \mathcal{Y}$ and $k \in \mathcal{K}$, \begin{align*} & \left| r^{(F)}_{y,k} \right| \\ &\leq \frac 1 {\sqrt{n}} \underbrace{ \left[ \sum_{(i,j) \in \mathcal{D}} \left| \frac{ \Lambda^{(1)}_{y,ij,k} } { \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} } \right| \right] }_{=O_P(n)} \underbrace{ \left[ \max_{(i,j) \in \mathcal{D}} \left| \left( Q^{(\rm FE)} r_{y} \right)_{ij} \right| \right] }_{=o_P(n^{-1/2})} + \underbrace{ \left( \frac 1 n \sum_{(i,j) \in \mathcal{D}} \left\| \Lambda^{(1)}_{y,ij,k} \widetilde{\mathbbm{x}}_{y,ij,k} \right\| \right) }_{=O_P(1)} \underbrace{ \left\| r^{(\beta)}_{y} \right\| }_{=o_P(1)} \\ & + \frac 1 {8 \sqrt{n}} \underbrace{ \left( \sum_{(i,j) \in \mathcal{D}} \left| \frac{ \Lambda^{(2)}_{y,ij,k} } { \Lambda^{(1)}_{y,ij}} \right| \right) }_{=O_P(n)} \underbrace{ \left\{ \max_{(i,j) \in \mathcal{D}} \left[ {\textstyle \sum_{(i',j') \in \mathcal{D}} } \, Q_{y, ij, i'j'} \, \left( \Lambda^{(1)}_{y,i'j'} \right)^{-3/2} \Lambda^{(2)}_{y,i'j'} \left( Q_y s_y \right)_{i'j'}^2 \right]^2 \right\} }_{=o_P(n^{-1/2})} \\ & + \frac 1 {2 \sqrt{n}} \underbrace{ \left( \sum_{(i,j) \in \mathcal{D}} \left| \frac{ \Lambda^{(2)}_{y,ij,k} } { \Lambda^{(1)}_{y,ij}} \right| \right) }_{=O_P(n)} \underbrace{ \left[ \max_{(i,j) \in \mathcal{D}} (r_{y,ij})^2 \right] }_{=o_P(n^{-1})} + \frac 1 {2 \sqrt{n}} \underbrace{ \sum_{(i,j) \in \mathcal{D}} \left| \Lambda^{(2)}_{y,ij,k} \right| \left\| \mathbbm{x}_{ij,k} - x_{ij}) \right\|^2 }_{=O_P(n)} \underbrace{ \left\| \widehat \beta_y -\beta_y^0 \right\|^2 }_{=o_P(n^{-1/2)}} \\ & + \frac 4 {3 \sqrt{n}} \underbrace{ \left( \sum_{(i,j) \in \mathcal{D}} \left| \Lambda^{(3)}(\widetilde \pi_{y,ij,k}) \right| \right) }_{=O_P(n)} \bigg\{ \underbrace{ \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi_{y,ij} - \pi_{y,ij}^0 \right|^3 }_{=o_P(n^{-1/2})} + \underbrace{ \max_{(i,j) \in \mathcal{D}} \left\| \mathbbm{x}_{ij,k} - x_{ij} \right\|^3 }_{=O_P(1)} \underbrace{ \left\| \widehat \beta_y -\beta_y^0 ) \right\|^3 }_{=o_P(n^{-1/2})} \bigg\} , \end{align*} and therefore \begin{align} \sup_{y \in \mathcal{Y}, k \in \mathcal{K}} \left| r^{(F)}_{y,k} \right| = o_P(1) . \end{align} Combing (ref), (ref), (ref) and (ref) gives the statement for $\widehat F(y) - F(y)$ in the theorem. \end{proof} \begin{proof}[\bf Proof of Theorem (ref)] The theorem follows from Theorem (ref) by applying Lemma (ref), which provides the uniform consistency of the estimators of the components of the asymptotic bias and variance functions. \end{proof}

\setcounter{page}{1} \pagenumbering{roman} \setcounter{section}{0} \setcounter{theorem}{0} \setcounter{corollary}{0} \setcounter{lemma}{0} \setcounter{equation}{0}

center[center omitted — 49 chars of source]
abstractThis supplementary material contains the proofs of Lemmas (ref)--(ref), together with some technical intermediate results.

The following proof of Lemma (ref) also relies on the results of Lemma (ref) and Lemma (ref)$(i)$, whose proof is presented afterwards, without using Lemma (ref) of course.

proof[\bf Proof of Lemma (ref)] Define $Q^\perp_y := \mathbb{I}_n - Q_y$, which is the $n \times n$ symmetric idempotent matrix that projects onto the space orthogonal to the column span of $\left( \Lambda^{(1)}_{y} \right)^{1/2} w $, with $w=(w_{ij}: (i,j) \in \mathcal{D})$. In component notation we have $Q^\perp_{y,ij,i'j'} = \delta_{ii'} \delta_{j j'} - Q_{y,ij,i'j'}$, where $\delta_{..}$ refers to the Kronecker delta. We also define \begin{align*} \pi^*_{y,ij} &:= \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \pi_{y,ij} , & \pi^{* \, 0}_{y,ij} &:= \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \pi^0_{y,ij} , & \ell^*_{y,ij}( \pi^*_{y,ij}) &:= \ell_{y,ij}\left[ \left( \Lambda^{(1)}_{y,ij} \right)^{-1/2} \pi^*_{y,ij} \right] , \end{align*} which is simply a rescaling of $\pi_{y,ij}$ by $ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}$. The rescaling is infeasible, because $ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}$ depends on the true parameter values, but for the analysis here it is more convenient to work with $ \ell^*_{y,ij}( \pi^*_{y,ij})$ than with $\ell_{y,ij}( \pi_{y,ij})$. After the rescaling we have $s_{y,ij} = \partial_{ \pi^*} \ell^*_{y,ij} := \partial_{ \pi^*} \ell^*_{y,ij}\left( \pi^{*\, 0}_{y,ij} \right)$ and $1 = \partial_{ \pi^{*2}} \ell^*_{y,ij} := \partial_{ \pi^{*2}} \ell^*_{y,ij}\left( \pi_{y,ij}^{*\, 0} \right)$, that is, the variance of the score and the Hessian of $ \ell^*_{y,ij}( \pi^*_{y,ij})$ evaluated at the true parameter values are normalized to one. Equation (ref) can be rewritten as $ Q^\perp_y \pi^*_y = 0 $. where $\pi^*_y$ is the $n$-vector with elements $ \pi^*_{y,ij}$. Solving (ref) is then equivalent to minimizing the function \begin{align*} \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}( \pi^*_{y,ij}) + \sum_{(i,j) \in \mathcal{D}} \; \pi^*_{y,ij} \, \; \sum_{(i',j') \in \mathcal{D}} \left[ Q^\perp_{y,ij,i'j'} \, \mu_{y,i'j'} \right] \end{align*} over $ \pi^*_{y}$ and $\mu_{y}$, where the $\mu_{y}$ are the Lagrange multipliers corresponding to the constraint $Q^\perp_y \pi^*_{y} = 0$, which is equivalent to existence of $\theta$ such that $\pi_{y} = w \; \theta_y$. The FOCs with respect to $ \pi^*_{y}$ read \begin{align*} \partial_{ \pi^*} \ell^*_{y}( \widehat \pi^*_{y}) + Q^\perp_{y} \, \widehat \mu_{y} &= 0 , \end{align*} where $ \partial_{ \pi^*} \ell^*_{y}( \widehat \pi^*_{y})$ and $ \widehat \mu_{y} $ are $n$-vectors obtained by stacking the elements of $\partial_{ \pi^*} \ell^*_{y,ij}( \widehat \pi^*_{y})$ and $\widehat \mu_{y,ij}$ for all $(i,j) \in \mathcal{D}$. Existence of $\widehat \mu_{y} $ that satisfy those FOCs is equivalent to \begin{align} Q_{y} \partial_{ \pi^*} \ell^*_{y}( \widehat \pi^*_{y}) + Q_{y} Q^\perp_{y} \, \widehat \mu_{y} = Q_{y} \partial_{ \pi^*} \ell^*_{y}( \widehat \pi^*_{y}) = \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \, \partial_{\pi^*} \ell^*_{y,i'j'}( \widehat \pi^*_{y,i'j'}) &= 0. \end{align} In addition to this first order condition we have the constraint $Q^\perp_y \widehat \pi^*_{y} = 0$, which implies that $\widehat \pi^*_{y} = Q_y \xi_y$ for some $\xi_y \in \mathbb{R}^n$, that is, we only need to consider parameters $\pi^*_{y}$ that can be represented as $ Q_y \xi_y$. In the following we perform three expansion steps for the log-likelihood function (or for the corresponding score function), each time restricting $ \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} $ further. \# Step 1: We assume uniform boundedness of all parameters and variables that enter into the single index. Therefore, for all $y \in \mathcal{Y}$ and $(i,j) \in \mathcal{D}$ we have $\pi^{0}_{y,ij} \in [\pi_{\min}, \pi_{\max}]$, where $[\pi_{\min}, \pi_{\max}]$ is some bounded interval. By strict convexity of minus the logistic log-likelihood function there exist constants $c_{\min}$ and $c_{\max}$ such that $0< c_{\min} \leq \Lambda^{(1)}_{y,ij} \leq c_{\max} < \infty$ for all $y \in \mathcal{Y}$ and $(i,j) \in \mathcal{D}$. Hence, $\pi^{* \, 0}_{y,ij} \in [c_{\min}^{1/2} \pi_{\min}, c_{\max}^{1/2} \pi_{\max} ]$, for all $y \in \mathcal{Y}$ and $(i,j) \in \mathcal{D}$. Define $\Pi_{\rm bnd} := [c_{\min}^{1/2} \pi_{\min} - \epsilon, c_{\max}^{1/2} \pi_{\max} + \epsilon]$, where $\epsilon>0$ is an arbitrary finite constant. In the following we only need to consider values of $\pi^{*}_{y,ij}$ inside $\Pi_{\rm bnd}$. Because $\Pi_{\rm bnd}$ is bounded and $ \ell^*_{y,ij}( \pi^*_{y,ij} ) $ is smooth we know that all the derivatives of $ \ell^*_{y,ij}( \pi^*_{y,ij} ) $ are uniformly bounded inside $\Pi_{\rm bnd}$. In particular, there exists a finite constant $b$ such that, for $k \in \{1,2,3\}$, \begin{align*} \sup_{\pi \in \Pi_{\rm bnd}} \; \sup_{y \in \mathcal{Y}} \; \max_{(i,j) \in \mathcal{D}} \left| \partial_{\pi^{*k}} \ell^*_{y,ij}( \pi ) \right| \leq b . \end{align*} By a third order expansion of $\pi^*_{y,ij} \mapsto \ell^*_{y,ij}( \pi^*_{y,ij})$ around $\pi^{*\, 0}_{y,ij}$ we find \begin{align} & \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}( \pi^*_{y,ij}) - \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}( \pi^{*\, 0}_{y,ij}) \nonumber \\ &= \sum_{(i,j) \in \mathcal{D}} s_{y,ij} \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right) + \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right)^2 + \frac 1 6 \sum_{(i,j) \in \mathcal{D}} \left(\partial_{\pi^{*3}} \ell^*_{y,ij}( \underline \pi^*_{y,ij} ) \right) \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right)^3 \nonumber \\ &\geq \sum_{(i,j) \in \mathcal{D}} s_{y,ij} \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right) + \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right)^2 - \frac b 6 \sum_{(i,j) \in \mathcal{D}} \left| \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right|^3 , \end{align} where $\underline \pi^*_{y,ij} $ is an intermediate values between $ \pi^*_{y,ij}$ and $\pi^{*\, 0}_{y,ij}$. Analogously, \begin{align} & \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}( \pi^*_{y,ij}) - \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}( \pi^{*\, 0}_{y,ij}) \nonumber \\ &\leq \sum_{(i,j) \in \mathcal{D}} s_{y,ij} \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right) + \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left( \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right)^2 + \frac b 6 \sum_{(i,j) \in \mathcal{D}} \left| \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right|^3 , \end{align} Evaluating (ref) at $\pi^*_{y,ij} = \pi^{*\, 0}_{y,ij} - \left( Q_y s_y \right)_{ij} + \left( Q_y \zeta_y \right)_{ij}$, and (ref) at $\pi^*_{y,ij}= \pi^{*\, 0}_{y,ij} - \left( Q_y s_y \right)_{ij}$ gives \begin{align} & \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}\left[ \pi^{*\, 0}_{y,ij} - \left( Q_y s_y \right)_{ij} + \left( Q_y \zeta_y \right)_{ij} \right] - \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}\left[ \pi^{*\, 0}_{y,ij} - \left( Q_y s_y \right)_{ij} \right] \nonumber \\ &\geq \sum_{(i,j) \in \mathcal{D}} s_{y,ij} \left[ \left( Q_y \zeta_y \right)_{ij} - \left( Q_y s_y \right)_{ij} \right] + \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left[ \left( Q_y \zeta_y \right)_{ij} - \left( Q_y s_y \right)_{ij} \right]^2 - \frac b 6 \sum_{(i,j) \in \mathcal{D}} \left| \left( Q_y \zeta_y \right)_{ij} - \left( Q_y s_y \right)_{ij} \right|^3 \nonumber \\ & \quad + \sum_{(i,j) \in \mathcal{D}} s_{y,ij} \left( Q_y s_y \right)_{ij} - \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left( Q_y s_y \right)_{ij}^2 - \frac b 6 \sum_{(i,j) \in \mathcal{D}} \left| \left( Q_y s_y \right)_{ij} \right|^3 \nonumber \\ &= \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left[ \left( Q_y \zeta_y \right)^2_{ij} - \frac b 3 \left| \left( Q_y \zeta_y \right)_{ij} - \left( Q_y s_y \right)_{ij} \right|^3 - \frac b 3 \left| \left( Q_y s_y \right)_{ij} \right|^3 \right] \nonumber \\ &\geq \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left[ \left( Q_y \zeta_y \right)^2_{ij} - \frac {4 b} 3 \left| \left( Q_y \zeta_y \right)_{ij} \right|^3 - \frac {5 b} 3 \left| \left( Q_y s_y \right)_{ij} \right|^3 \right] \nonumber \\ &= \frac 1 2 \sum_{(i,j) \in \mathcal{D}} \left\{ \left( Q_y \zeta_y \right)^2_{ij} \left[ 1 - \frac {4 b} 3 \left| \left( Q_y \zeta_y \right)_{ij} \right| \right] - \frac {5 b} 3 \left| \left( Q_y s_y \right)_{ij} \right|^3 \right\} , \end{align} where we also used that $Q_y Q_y = Q_y$ and $ \left| \left( Q_y \zeta_y \right)_{ij} - \left( Q_y s_y \right)_{ij} \right|^3 \leq 4 \left| \left( Q_y \zeta_y \right)_{ij} \right|^3 + 4 \left| \left( Q_y s_y \right)_{ij} \right|^3 $. By the result of Lemma (ref)$(i)$ we know that there exists a sequence $\kappa_n = o(1)$ such that wpa1 $$ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q_y s_y \right)_{ij} \right| \leq \kappa_n \; n^{-1/6}, $$ which implies that \begin{align*} \sup_{y \in \mathcal{Y}} \sum_{(i,j) \in \mathcal{D}} \left| \left( Q_y s_y \right)_{ij} \right|^3 &\leq n^{1/2} \, \kappa_n^3 . \end{align*} Consider the sets \begin{align*} \Pi^*_{y,n} &:= \left\{ \pi^*_y \in \mathbb{R}^n \, : \, Q^\perp_y \widehat \pi^*_{y} = 0 \; \; and \; \; \sum_{(i,j) \in \mathcal{D}} \left( \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij} \right)^2 \leq n^{1/2} \, \kappa^2_n \right\} , \\ \overline \Pi^*_{y,n} &:= \left\{ \pi^*_y \in \mathbb{R}^n \, : \, Q^\perp_y \widehat \pi^*_{y} = 0 \; \; and \; \; \sum_{(i,j) \in \mathcal{D}} \left( \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij} \right)^2 = n^{1/2} \, \kappa^2_n \right\} . \end{align*} Here, $ \overline \Pi^*_{y,n}$ is the boundary of $\Pi^*_{y,n}$ within the set of all $\pi^*_y$ that satisfy the constraint $ Q^\perp_y \widehat \pi^*_{y} = 0$. For any $\zeta \in \mathbb{R}^n$ with $Q^\perp_y \zeta = 0$ we have $Q_y \zeta =\zeta$, and by applying Cauchy-Schwarz inequality we thus find \begin{align} \|\zeta\|_\infty &:= \max_{(i,j) \in \mathcal{D}} \left| \zeta_{ij} \right| = \max_{(i,j) \in \mathcal{D}} \left| \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \zeta_{i'j'} \right| \nonumber \\ &\leq \max_{(i,j) \in \mathcal{D}} \left( \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'}^2 \right)^{1/2} \left( \sum_{(i',j') \in \mathcal{D}} \zeta_{i'j'}^2 \right)^{1/2} \nonumber \\ &= \max_{(i,j) \in \mathcal{D}} \left( Q_{y,ij,ij} \right)^{1/2} \| \zeta \| = O_P(n^{-1/4}) \| \zeta \| , \end{align} where we also used that $Q_yQ_y=Q_y$ and employed Lemma (ref)$(iii)$. By applying (ref) to $ \zeta_{ij} = \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij}$ we find that for $\pi^*_{y} \in \Pi^*_{y,n}$ we have \begin{align*} \sup_{y \in \mathcal{Y}} \sup_{\pi^*_y \in \Pi^*_{y,n}} \max_{(i,j) \in \mathcal{D}} \left| \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij} \right| = O_P(\kappa_n) , \end{align*} and also using Lemma (ref)$(i)$ we thus have \begin{align} \sup_{y \in \mathcal{Y}} \sup_{\pi^*_y \in \Pi^*_{y,n}} \max_{(i,j) \in \mathcal{D}} \left| \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} \right| = O_P(\kappa_n) + o_P(n^{-1/6}) = o_P(1) . \end{align} Hence, when applying (ref) to $\pi^*_y \in \Pi^*_{y,n}$ with $\left( Q_y \zeta_y \right)_{ij} = \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij}$, then the term $\frac {4 b} 3 \left| \left( Q_y \zeta_y \right)_{ij} \right|$ is of order $o_P(1)$ and the term $ \left| \left( Q_y s_y \right)_{ij} \right|^3$ is of smaller order than $\left( Q_y \zeta_y \right)^2_{ij}$. In addition, note that $ \pi^{*\, 0}_{y,ij} - \left( Q_y s_y \right)_{ij} \in \Pi^*_{y,n} . $ Thus, by applying (ref) with $\left( Q_y \zeta_y \right)_{ij} = \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij}$, and using (ref) we find that with probability approaching one we have \begin{align} \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}\left( \pi^*_{y,ij} \right) - \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}\left[ \pi^{*\, 0}_{y,ij} - \left( Q_y s_y \right)_{ij} \right] > 0 , \qquad for all $\pi^*_y \in \overline \Pi^*_{y,n}$. \end{align} Thus, we have a convex set $ \Pi^*_{y,n}$ such that the convex function $\pi^*_y \mapsto \sum_{(i,j) \in \mathcal{D}} \ell^*_{y,ij}\left( \pi^*_{y,ij} \right) $ takes a smaller value inside the set $ \Pi^*_{y,n}$ than on any point of its boundary $ \overline \Pi^*_{y,n}$ (within the set of all $\pi^*_y$ that satisfy the constraint $ Q^\perp_y \widehat \pi^*_{y}=0$). This guarantees that the minimizer of the objective function needs to be inside the set $ \Pi^*_{y,n}$, that is, we have $\widehat \pi_y \in \Pi^*_{y,n}$, which implies \begin{align*} \sup_{y \in \mathcal{Y}} \sum_{(i,j) \in \mathcal{D}} \left( \widehat \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij} \right)^2 &\leq \kappa_n^2 \, n^{1/2} = o_P(n^{1/2}) , \end{align*} and by the inequality (ref) with $ \zeta_{ij} = \widehat \pi^*_{y,ij} - \pi^{*\, 0}_{y,ij} + \left( Q_y s_y \right)_{ij}$, and Lemma (ref)$(i)$, we find \begin{align} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} \right| = O_P(\kappa_n) + o_P(n^{-1/6}) = o_P(1) . \end{align} \# Step 2: An expansion of (ref) in $\widehat \pi^*_{y,i'j'}$ around $ \pi^{*\,0}_{y,i'j'}$ up to second order yields \begin{align*} & \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \Bigg[ s_{y,i'j'} + \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right) + \frac 1 2 \left(\partial_{\pi^{*3}} \ell^*_{y,i'j'}(\widetilde\pi^*_{y,i'j'} ) \right) \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right)^2 \Bigg] = 0 , \end{align*} where $\widetilde\pi^*_{y,i'j'} $ is a value between $ \pi^{*\,0}_{y,i'j'} $ and $\widehat \pi^*_{y,i'j'}$. By combining this expansion with the constraint $Q^\perp_y (\widehat \pi^*_{y}-\pi^{*\,0}_y) = 0$, which implies that $\widehat \pi^*_{y}-\pi^{*\,0}_y = Q_y \xi_y$, for some $\xi_y$, we obtain \begin{align*} \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} &= - \left( Q_y s_y \right)_{ij} + r^{(1)}_{y,ij}, \end{align*} where \begin{align*} r^{(1)}_{y,ij} &= - \frac 1 2 \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \left(\partial_{\pi^{*3}} \ell^*_{y,i'j'}(\widetilde\pi^*_{y,i'j'} ) \right) \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right)^2 \end{align*} Using our initial convergence rate result (ref) in part 1 of this proof, and Lemma (ref), and also uniform boundedness of all the derivatives of $ \ell^*_{y,i'j'}( \pi^* )$ within $\Pi_{\rm bnd}$, we find $$ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| r^{(1)}_{y,ij} \right| = o_P(n^{-1/2+1/6}) + O_P(\kappa_n^2) . $$ Hence, by Lemma (ref)$(i)$, \begin{align} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} \right| = o_P(n^{-1/6}) + O_P(\kappa_n^2) . \end{align} Using (ref) instead of (ref), and reapplying the same argument a second time we obtain \begin{align*} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} \right| = o_P(n^{-1/6}) + O_P(\kappa_n^4) . \end{align*} And by iterating this argument $q$-times we obtain \begin{align*} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} \right| = o_P(n^{-1/6}) + O_P(\kappa_n^{2q}) . \end{align*} for any positive integer $q$. Since $\kappa_n = o(1)$ we can choose $q$ large enough such that \begin{align} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} \right| = o_P(n^{-1/6}) . \end{align} \# Step 3: An expansion of (ref) in $\widehat \pi^*_{y,i'j'}$ around $ \pi^{*\,0}_{y,i'j'}$ up to third order yields \begin{align*} & \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \Bigg[ s_{y,i'j'} + \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right) + \frac 1 2 \left(\partial_{\pi^{*3}} \ell^*_{y,i'j'} \right) \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right)^2 \& \qquad \qquad \qquad \qquad \qquad \qquad \qquad \quad + \frac 1 6 \left(\partial_{\pi^{*4}} \ell^*_{y,i'j'}(\overline \pi^*_{y,i'j'} ) \right) \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right)^3 \Bigg] = 0 , \end{align*} where $\overline \pi^*_{y,i'j'} $ is a value between $ \pi^{*\,0}_{y,i'j'} $ and $\widehat \pi^*_{y,i'j'}$. By again using the constraint $\widehat \pi^*_{y}-\pi^{*\,0}_y = Q_y \xi_y$, for some $\xi_y$, we obtain \begin{align*} \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} &= - \left( Q_y s_y \right)_{ij} - \frac 1 2 \sum_{(i',j') \in \mathcal{D}} \underbrace{ \left(\partial_{\pi^{*3}} \ell^*_{y,i'j'} \right) }_{ = \frac{ \partial_{\pi^3} \ell_{y,i'j'} } { \left( \Lambda^{(1)}_{y,i'j'} \right)^{3/2} } } \, Q_{y, ij, i'j'} \, \left[ \left( Q_y s_y \right)_{i'j'} \right]^2 + r_{y,ij}, \end{align*} where \begin{align*} r_{y,ij} &= - \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \Bigg\{ \frac 1 2 \left(\partial_{\pi^{*3}} \ell^*_{y,i'j'} \right) r^{(1)}_{y,i'j'} \left[ 2 \left( Q_y s_y \right)_{i'j'} + r^{(1)}_{y,i'j'} \right] \& \qquad \qquad \qquad \qquad \qquad \qquad \qquad \quad + \frac 1 6 \left(\partial_{\pi^{*4}} \ell^*_{y,i'j'}(\overline \pi^*_{y,i'j'} ) \right) \left( \widehat \pi^*_{y,i'j'} - \pi^{*\,0}_{y,i'j'} \right)^3 \Bigg\} , \end{align*} and therefore \begin{align*} \max_{(i,j) \in \mathcal{D}} \left| r_{y,ij} \right| &\leq \left( \max_{(i,j) \in \mathcal{D}} \sum_{(i',j') \in \mathcal{D}} Q_{y,ij,i'j'} \right) \max_{(i,j) \in \mathcal{D}} \Bigg| \frac 1 2 \left(\partial_{\pi^{*3}} \ell^*_{y,ij} \right) r^{(1)}_{y,ij} \left[ 2 \left( Q_y s_y \right)_{ij} + r^{(1)}_{y,ij} \right] \& \qquad \qquad \qquad \qquad \qquad \qquad \qquad \qquad + \frac 1 6 \left(\partial_{\pi^{*4}} \ell^*_{y,ij}(\overline \pi^*_{y,ij} ) \right) \left( \widehat \pi^*_{y,ij} - \pi^{*\,0}_{y,ij} \right)^3 \Bigg| . \end{align*} Thus, using (ref), Lemma (ref), and Lemma (ref)$(i)$, and also uniform boundedness of all the derivatives of $ \ell^*_{y,i'j'}( \pi^* )$ within $\Pi_{\rm bnd}$, we thus find $\sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| r_{y,ij} \right| = o_P(n^{-1/2})$. This gives the result of the lemma, since $ \widehat \pi^*_{y,ij} - \pi^{* \, 0}_{y,ij} = \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \left( \widehat \pi_{y,ij} - \pi^0_{y,ij} \right)$.
proof[\bf Proof of Lemma (ref)] We prove this lemma by showing that the smallest eigenvalue of $W_y$ is bounded from below, uniformly over $y \in {\mathcal Y}$. We know that there exists $b_{\min}>0$ such that $ \Lambda^{(1)}_{y,ij} \geq b_{\min}$, uniformly over $y$, $i$, $j$. Then, \begin{align*} \lambda_{\min}( W_y ) &= \min_{\| \delta \|=1} \delta' W_y \delta \\ &= \min_{\| \delta \|=1} \min_{(\alpha,\gamma) \in \mathbb{R}^{I+J}} \left[ \frac 1 n \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}_{y,ij} \; \, (x'_{ij} \delta - \alpha_i - \gamma_j )^2 \right] \\ &\geq \min_{\| \delta \|=1} \min_{(\alpha,\gamma) \in \mathbb{R}^{I+J}} \left[ \frac 1 n \sum_{(i,j) \in \mathcal{D}} b_{\min} \; (x'_{ij} \delta - \alpha_i - \gamma_j )^2 \right] \\ &= b_{\min} \; \min_{\| \delta \|=1} \min_{(\alpha,\gamma) \in \mathbb{R}^{I+J}} \left[ \frac 1 n \sum_{(i,j) \in \mathcal{D}} (x'_{ij} \delta - \alpha_i - \gamma_j )^2 \right] \\ &\geq b_{\min} \; c_3 >0 , \end{align*} where existence of $c_3>0$ is guaranteed by Assumption (ref)$(vi)$.
proof[\bf Proof of Lemma (ref)] We showed that $ Q_y = Q^{(1)}_y + Q^{({\rm FE})}_y $ in equation (ref). We now want to find the bound on $Q_y^{({\rm rem})} = Q^{({\rm FE})}_y - Q_y^{(2)} - Q_y^{(3)}$ in part (i) of the lemma. Let \begin{align*} {\mathcal H}_y := \left[w^{(2)},w^{(3)} \right]' \Lambda^{(1)}_{y} \left[w^{(2)},w^{(3)} \right] . \end{align*} Then, \begin{align*} Q^{({\rm FE})}_y := \left( \Lambda^{(1)}_{y} \right)^{1/2} \left[w^{(2)},w^{(3)} \right] {\mathcal H}_y^\dagger \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}_{y} \right)^{1/2} , \end{align*} where we use the Moore-Penrose pseudo-inverse $\dagger$, because ${\mathcal H}_y$ has one zero-eigenvalue with corresponding eigenvector $v=(1_I,-1_J)$, that is, $v$ is a column vector with $I$ ones follows by $J$ minus ones.\footnote{Note that the additively separable structure $\alpha_i(y) + \gamma_j(y)$ is invariant to adding a constant to all the $\alpha_i(y)$ and subtracting the same constant to all the $\gamma_j(y)$.} We can therefore write \begin{align*} {\mathcal H}_y^\dagger &= \left[ {\mathcal H}_y + vv' / (I+J) \right]^{-1} - vv' / (I+J). \end{align*} The matrix ${\mathcal H}_y = \partial_{\phi_y \phi_y'} \sum_{(i,j) \in \mathcal{D}} \ell_{y,ij}(\pi^0_{y,ij})$ is simply the $(I+J) \times (I+J)$ Hessian matrix of minus the log-likelihood function with respect to all the fixed effects $\phi_y = (\alpha_y', \gamma_y')'$. We decompose ${\mathcal H}_y = {\mathcal D}_y + {\mathcal R}_y$, where \begin{align*} {\mathcal D}_y &:= w^{(2) \prime} \Lambda^{(1)}_{y} w^{(2)} + w^{(3) \prime} \Lambda^{(1)}_{y} w^{(3)} = \left( \begin{array}{cc} \operatorname{diag}\left( \sum_{j \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij} \right)_{i=1\ldots,I} & 0_{I \times J}\\ 0_{J \times I} & \operatorname{diag}\left( \sum_{i \in \mathcal{D}_j} \Lambda^{(1)}_{y,ij} \right)_{j=1\ldots,J} \end{array} \right) \\ {\mathcal R}_y &:= w^{(2) \prime} \Lambda^{(1)}_{y} w^{(3)} + w^{(3) \prime} \Lambda^{(1)}_{y} w^{(2)} = \left( \begin{array}{cc} 0_{I \times I} & A_y \\ A_y' & 0_{J \times J} \end{array} \right) , \end{align*} where $A_y$ is the $I \times J$ matrix with entries $A_{y,ij}= \Lambda^{(1)}_{y,ij}$ if $(i,j) \in \mathcal{D}$, and zero otherwise. Because $\infty > b_{\max} \geq \Lambda^{(1)}_{y,ij} \geq b_{\min} >0$, Lemma D.1 in FernandezValWeidner2016 shows that this incidental parameter Hessian satisfies \begin{align} \sup_{y \in \mathcal{Y}} \left\| {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} \right\|_{\max} = O_P( n^{-1} ), \end{align} where $\| A \|_{\max}$ refers to the maximum over the absolute values of all the elements of the matrix $A$. Note that Lemma D.1 in FernandezValWeidner2016 is for the “expected Hessian”, but for our logit model we have ${\mathcal H}_y = {\mathbb{E}} {\mathcal H}_y$, conditional on regressors and fixed effects, so the distinction between Hessian and expected Hessian is irrelevant here. Also, in FernandezValWeidner2016 the Hessian is not indexed by $y$, but the derivation of the bound there is in terms of global constants $b_{\min}$, $b_{\max}$ and thus holds uniformly over $y$. Finally, FernandezValWeidner2016 does not allow for missing observations, but since we only allow for a finite number of missing observations for every $i$ and $j$ that can only have a negligible effect on the Hessian matrix. We thus have \begin{align*} Q^{({\rm FE})}_y &:= \left( \Lambda^{(1)}_{y} \right)^{1/2} \left[w^{(2)},w^{(3)} \right] {\mathcal D}_y^{-1} \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}_{y} \right)^{1/2} \\ & \quad + \left( \Lambda^{(1)}_{y} \right)^{1/2} \left[w^{(2)},w^{(3)} \right] \left[ {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} \right] \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}_{y} \right)^{1/2} \\ &= Q_y^{(2)} + Q_y^{(3)} + Q_y^{({\rm rem})} , \end{align*} where \begin{align*} Q_y^{({\rm rem})} &= \left( \Lambda^{(1)}_{y} \right)^{1/2} \left[w^{(2)},w^{(3)} \right] \left[ {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} \right] \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}_{y} \right)^{1/2}, \end{align*} and therefore \begin{align*} \sup_{y \in \mathcal{Y}} \left\| Q_y^{({\rm rem})} \right\|_{\max} &\leq \sup_{y \in \mathcal{Y}} \left\| \left( \Lambda^{(1)}_{y} \right)^{1/2} \right\|_{\max} \left\| {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} \right\|_{\max} \left\| \left( \Lambda^{(1)}_{y} \right)^{1/2} \right\|_{\max} \\ &= \sup_{y \in \mathcal{Y}} \left( \max_{(i,j)\in \mathcal{D}} \Lambda^{(1)}_{y,ij} \right) \left\| {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} \right\|_{\max} = O_P(n^{-1}), \end{align*} which can equivalently be written as $ \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \max_{(i',j') \in \mathcal{D}} \left| Q_{y,ij,i'j'}^{({\rm rem})} \right| = O_P(n^{-1})$. Part $(ii)$ and $(iii)$ follow immediately from part $(i)$ and the explicit formulas for the elements of $Q_y^{(1)}$, $Q_y^{(2)}$ and $Q_y^{(3)}$ in (ref) and (ref) above.

\bf Intermediate results for the proof of of Lemma (ref)

The proof of Lemma (ref) requires several intermediate results from the theory of stochastic processes, which are presented in the following. The notation $a_n \lesssim b_n$ means that $a_n \leq C \, b_n$ for some constant $C$ that is independent of the sample size $n$. It is also convenient to define ${\bf I} := \{ 1,2,\ldots, I\}$ and ${\bf J} := \{ 1,2,\ldots, J\}$. In this section we assume that $\mathcal{Y}$ is a bounded interval, and that $y_{ij}$ is continuously distributed with density bounded away from zero. The results for the case where $y_{ij}$ is discrete follow directly from FernandezValWeidner2016. Results for a mixed distribution of $y_{ij}$ follow by combining the results for the continuous and discrete cases.

Bounds on sample averages over the score $\partial_{\pi} \ell_{y,ij}$

For every $i \in {\bf I}$ we define the empirical process

align[align omitted — 304 chars of source]

Here, for ease of notation, we use the subscript $J$ to denote the sample size, corresponding to the balanced panel case where $|\mathcal{D}_i|=J$. Following standard notation we write $\| \mathbb{G}_{J,i} \|_{\mathcal F} := \sup_{f \in {\mathcal F} } \left| \mathbb{G}_{J,i} f \right| $. Every element of ${\mathcal F}$ correspond to exactly one $y \in {\mathcal Y} $, and in the following we write $ f_y : \widetilde y \; \mapsto \; 1(\widetilde y \leq y) $ for that element. Since ${\mathbb{E}} \; 1\{y_{ij} \leq y\} = \Lambda_{y,ij}$,

align[align omitted — 161 chars of source]

where

align*[align* omitted — 137 chars of source]

Our goal is to show that $\max_{i \in {\bf I}} \| \mathbb{G}_{J,i} \|_{\mathcal F} = o_P\left( I^{1/6} \right)$ by using the following theorem. The theorem uses standard notation $\mathbb{G}_n$ for the empirical process, denoting the sample size by $n$ (not $J$ or $|\mathcal{D}_i|$), and without an extra index $i$. The definition of $J(\delta, {\mathcal F})$ is given on p.239 of van der Vaart and Wellner (1996). All that matters to us is that $J(1, {\mathcal F})$ only depends on ${\mathcal F}$ (not on the probability measure or on the empirical process) and that for the ${\mathcal F}$ defined in (ref) we have $J(1, {\mathcal F}) < \infty$, because ${\mathcal F}$ is VC class. An obvious envelope function for that ${\mathcal F}$ is $F: \tilde y \mapsto 1$, which satisfies $\| F \|_n=1$. The minimal measurable majorant of $\{ \mathbb{G}_{n} f : f \in {\mathcal F} \} $ is denoted by $\| \mathbb{G}_{n} \|^*_{\mathcal F}$, and is identical to $\| \mathbb{G}_{n} \|_{\mathcal F}$ for our purposes.

lemma[\bf Restatement of Theorem 2.14.1 in van der Vaart and Wellner, 1996, for INID case] Let $\mathbb{G}_{n} $ be the empirical process of an i.n.i.d. sample.\footnote{ An example is (ref). In that example the sample size is $n=|\mathcal{D}_i|$. We require results for non-identically distributed samples, because $y_{ij}$ conditional on regressors and fixed effects is independent across $j$ under our assumptions, but not identically distributed. } Let ${\mathcal F}$ be a $P$-measurable class of measurable functions with measurable envelope $F$. Then, for $p\geq 2$, \begin{align*} {\mathbb{E}}\left[ \left( \| \mathbb{G}_{n} \|^*_{\mathcal F} \right)^p \right] \lesssim J(1, {\mathcal F})^p \; {\mathbb{E}} \| F \|^p_n , \end{align*} where $ \| F \|_n$ is the $L_2( \mathbb{P}_n )$-seminorm and the inequality is valid up to a constant depending only on the $p$ involved in the statement.
proofIn van der Vaart and Wellner (1996) the theorem is stated for empirical processes from iid samples , but their proof relies only on symmetrization arguments (their Lemma 2.3.1) and sub-Gaussianity of the symmetrized process, which continue to hold for INID samples that we consider here (our $y_{ij}$ are conditionally independent, but not identically distributed).
corollaryUnder Assumption (ref) we have $$\sup_{y \in {\mathcal Y} } \max_{i \in {\bf I}} \left| \frac 1 {\sqrt{|\mathcal{D}_i|}} \sum_{j \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij} \right| =o_P\left( n^{1/12} \right) ,$$ and $$\sup_{y \in {\mathcal Y} } \max_{j \in {\bf J}} \left| \frac 1 {\sqrt{|\mathcal{D}_j|}} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right| =o_P\left( n^{1/12} \right) .$$
proofThe definition (ref) implies (ref), so we want to show $\max_{i \in {\bf I}} \| \mathbb{G}_{J,i} \|_{\mathcal F} = o_P\left( I^{1/6} \right)$. Applying Lemma (ref) for the function class $\mathcal{F}$with the envelope function $F: \tilde y \mapsto 1$ we find for $p \geq 1$, \begin{align*} {\mathbb{E}} \left( \max_{i \in {\bf I}} \| \mathbb{G}_{J,i} \|_{\mathcal F} \right)^p &= {\mathbb{E}} \max_{i \in {\bf I}} \left( \| \mathbb{G}_{J,i} \|_{\mathcal F} \right)^p \leq {\mathbb{E}} \sum_{i \in {\bf I}} \left( \| \mathbb{G}_{J,i} \|_{\mathcal F} \right)^p = \sum_{i \in {\bf I}} {\mathbb{E}} \left( \| \mathbb{G}_{J,i} \|_{\mathcal F} \right)^p \\ &\leq I \, J(1, {\mathcal F})^p = O(I), \end{align*} where $J(1, {\mathcal F})$ is a finite constant, independent of $i$, as noted earlier above. By Markov's inequality we thus find $\max_{i \in {\bf I}} \| \mathbb{G}_{J,i} \|_{\mathcal F} = O_P( I^{1/p} )$. Choosing $p>6$ gives the desired result. The second statement $\sup_{y \in {\mathcal Y} } \max_{j \in {\bf J}} \left| \frac 1 {\sqrt{|\mathcal{D}_j|}} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right| =o_P\left( n^{1/12} \right)$ can be shown analogously.

Bounds on weighted sample averages over the score $\partial_{\pi} \ell_{y,ij}$

We also need results on sample averages of the form e.g. $ \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \, b^{(n)}_{y,hij} \, \partial_{\pi} \ell_{y,ij}$, where $b^{(n)}_{y,hij}$ are weights that also depend on the index $y$. The following lemma is useful for that purpose.

lemmaSuppose $Z_1(t)$, \ldots, $Z_n(t)$ are independent, stochastic processes indexed by $t \in T$ which are suitably measurable. Let $B_i$ denote a measurable envelope of $\{ Z_i(t), t \in T \}$. such that $ {\mathbb{E}} B_i^p < \infty$ for $p \geq 1$. Let $$ X_n(t) = \frac 1 n \sum_{i=1}^n Z_i(t), \quad {\mathbb{E}} X_n(t) = \frac 1 n \sum_{i=1}^n {\mathbb{E}} Z_i(t) \quad t \in T . $$ Let $B_i$ denote a measurable envelope of $\{ Z_i(t), t \in T \}$. Let $T$ be equipped with the pseudo-metric $$ d_n(t,t') = \sqrt{ \frac 1 n \sum_{i=1}^n \left( Z_i(t) - Z_i(t') \right)^2} . $$ Let $N(\epsilon,T,d_n)$ denote the covering number of $T$ under $d_n$ balls of radius $\epsilon$. Let $$ J_n(\delta,T) = \int_0^\delta \sqrt{1+\log N( \epsilon \|B\|_n, T,d_n) } d \epsilon , $$ where $$\| B \|_n = \sqrt{\frac 1 n \sum_{i=1}^n |B_i|^2}.$$ Then \begin{align*} \left\| \left\| X_n - {\mathbb{E}} X_n \right\|_T^* \right\|_{P,p} \lesssim \left\| J_n(1,T) \, \|B\|_n \right\|_{P,p} . \end{align*}
proofThe proof is analogous to the proof of Theorem 2.14.1 in vanderVaartandWellner1996, p.239, with a few notational adjustments. Let $$ X_n^o(t) = \frac 1 n \sum_{i=1}^n \varepsilon_i Z_i(t), \quad t \in T , $$ denote the symmetrized version of $X_n$, where $\varepsilon = (\varepsilon_i)_{i=1}^n$ are independent Rademacher. By Lemma 2.3.6 in vanderVaartandWellner1996 the $L^p(P)$ norm of $\|X_n - {\mathbb{E}} X_n\|^*_T$ is bounded by the $L^p(P)$ norm of $2 \|X_n^o\|^*_T$. Let $P_\varepsilon$ denote the distribution of $\varepsilon$. Then by the standard argument, conditional on $(Z_i)_{i=1}^n$, $X_n^o$ is sub-Gaussian with respect to $d_n$: $$ \left\| X_n^o(t) - X_n^0(t') \right\|_{\Psi_2(P_\varepsilon)} \lesssim d_n(t,t') . $$ Hence by Corollary 2.2.5 in vanderVaartandWellner1996, we conclude $$ \left\| \|X_n^o\|_T \right\|_{\Psi_2(P_\varepsilon)} \leq \int_0^{{\rm diam}(T,d_n)} \sqrt{1+ \log N(\epsilon,T,d_n)} d \epsilon . $$ By a change of variables the right side is bounded by $$ \|B\|_n \int_0^{{\rm diam}(T,d_n)/ \|B\|_n} \sqrt{1+ \log N(\epsilon \|B\|_n,T,d_n)} d \epsilon , $$ which is further bounded by $$ \|B\|_n \, J_n(1,T) . $$ Every $L_p$-norm is bounded by a multiple of the $\Psi_2$-Orliczs norm. Hence $$ {\mathbb{E}}_\varepsilon \left\| X_n^o \right\|_T^p \lesssim \left( J_n(1,T) \, \|B\|_n \right)^p, $$ where $ {\mathbb{E}}_\varepsilon$ is the expectation conditional on $(Z_i)_{i=1}^n$. Take expectations over $(Z_i)_{i=1}^n$ to obtain the lemma.

Using Lemma (ref) we obtain the following corollary.

corollaryLet Assumption (ref) hold. For $y \in {\mathcal Y}$, $h \in \{1,\ldots,I+J\}$, $i \in {\bf I}$ and $j \in {\bf J}$, let $b^{(n)}_{y,hij}, c^{(n)}_{y,i}$, $d^{(n)}_{y,j}$ be real numbers, which can depend on the sample size $n$, and on the regressors and fixed effects, but not on the outcome variable, and assume that $ \sup_{y \in {\mathcal Y} } \max_{h \in \{1,\ldots,I+J\}} \allowbreak \max_{i \in {\bf I}} \max_{j \in {\bf I}} \max\left( \left| b^{(n)}_{y,hij} \right| , \left| \frac{\partial b^{(n)}_{y,hij}} {\partial y} \right| \right) = O_P(1)$, and also that $ \sup_{y \in {\mathcal Y} } \max_{i \in {\bf I}} \max\left( \left| c^{(n)}_{y,i} \right| , \left| \frac{\partial c^{(n)}_{y,i}} {\partial y} \right| \right) = O_P(1)$, and $ \sup_{y \in {\mathcal Y} } \max_{j \in {\bf I}} \max\left( \left| d^{(n)}_{y,j} \right| , \left| \frac{\partial d^{(n)}_{y,j}} {\partial y} \right| \right) = O_P(1)$. Then, \begin{align*} (i)&&& \sup_{y \in {\mathcal Y} } \max_{h \in \{1,\ldots,I+J\}} \left| \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \, b^{(n)}_{y,hij} \, \partial_{\pi} \ell_{y,ij} \right| = O_P \left( n^{1/6} \right), && \qquad \qquad\qquad\qquad \qquad \end{align*} and \begin{align*} (ii) &&& \sup_{y \in {\mathcal Y} } \left| \frac 1 I \sum_{i=1}^I c^{(n)}_{y,i} \left\{ \left( \frac 1 {\sqrt{|\mathcal{D}_i|}} \sum_{j \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij} \right)^2 - {\mathbb{E}}\left[ \left( \frac 1 {\sqrt{|\mathcal{D}_i|}} \sum_{j \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij} \right)^2 \right] \right\} \right| = o_P(1), \\[10pt] &&& \sup_{y \in {\mathcal Y} } \left| \frac 1 J \sum_{j=1}^J d^{(n)}_{y,j} \left\{ \left( \frac 1 {\sqrt{|\mathcal{D}_j|}} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right)^2 - {\mathbb{E}}\left[ \left( \frac 1 {\sqrt{|\mathcal{D}_j|}} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right)^2 \right] \right\} \right| = o_P(1) . \end{align*}
proofFor part (i) we apply Lemma (ref) with $T= \mathcal{Y}$ and $$ Z_i(y) = b^{(n)}_{y,hij} \, \partial_{\pi} \ell_{y,ij} , $$ for given $h \in \{1,\ldots,I+J\}$, we can use constant envelope $B_i = B $ and the bound $J_n(1,T) \leq C$, which can be established using standard arguments, we find that $A_h = \sup_{y \in {\mathcal Y} } \left| \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \, b^{(n)}_{y,hij} \, \partial_{\pi} \ell_{y,ij} \right| $ satisfies $ \max_{h \in \{1,\ldots,I+J\}} {\mathbb{E}} A_h^4 = O_P(1)$. We therefore have \begin{align*} {\mathbb{E}} \left( \max_{h \in \{1,\ldots,I+J\}} A_h \right)^4 \leq {\mathbb{E}} \left( \sum_{h=1}^{I+J} A_h^4 \right) \leq (I+J) \max_{h} {\mathbb{E}} \left( A_h^4 \right) =O_P( n^{1/2}) , \end{align*} and therefore $ \max_{h \in \{1,\ldots,I+J\}} A_h = O_P(n^{1/6})$ as desired. For the first result in part (ii), we apply Lemma (ref) with $T= \mathcal{Y}$ and $$ Z_i(y) := c^{(n)}_{y,i} \left[ \left( \frac 1 {\sqrt{|\mathcal{D}_i|}} \sum_{j \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij} \right)^2- {\mathbb{E}} \left( \frac 1 {\sqrt{|\mathcal{D}_j|}} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right)^2 \right]. $$ Verification of the conditions of the lemma gives the desired result. The second result in part (ii) follows analogously.

FCLT for weighted sample averages over the score $\partial_{\pi} \ell_{y,ij}$

The following theorem will be used in the proof of part $(ii)$ and $(iii)$ of Lemma (ref).

lemma[\bf Theorem 2.11.11 in van der Vaart and Wellner, 1996] For each $n$, let $Z_{n1}, \ldots, Z_{n,m_n}$ be independent stochastic processes indexed by an arbitrary index set ${\mathcal F}$. Suppose that there exists a Gaussian-dominated semimetric $\rho$ on ${\mathcal F}$ such that \begin{align*} (i) \qquad \quad &\sum_{\ell=1}^{m_n} {\mathbb{E}}^* \left[ \| Z_{n\ell} \|_{\mathcal F} \; \; 1 \left\{ \| Z_{n\ell} \|_{\mathcal F} > \eta \right\} \right] \rightarrow 0 , \qquad for every $\eta>0$, \\ (ii) \qquad \quad & \sum_{\ell=1}^{m_n} {\mathbb{E}}\left( Z_{n\ell}(f) - Z_{n\ell}(g) \right)^2 \leq \rho^2(f,g), \qquad for every $f,g \in {\mathcal F}$, \\ (iii) \qquad \quad &\sup_{t>0} \, \sum_{\ell=1}^{m_n} t^2 \, \mathbb{P}^*\left( \sup_{f,g \in {\mathcal B}(\varepsilon)} \left| Z_{n\ell}(f) - Z_{n\ell}(g) \right| > t \right) \leq \varepsilon^2 , \end{align*} for every $\rho$-ball ${\mathcal B}(\varepsilon) \subset {\mathcal F}$ of radius less than $\varepsilon$ and for every $n$. Then the sequence $ \sum_{\ell=1}^{m_n} \left( Z_{\ell,n} - {\mathbb{E}}\, Z_{\ell,n} \right)$ is asymptotically tight in $\ell^\infty({\mathcal F})$. It converges in distribution provided it converges marginally.

A semi-metric $\rho$ is Gaussian-dominated if it is bounded above by a Gaussian semi-metric. Any semi-metric such that $\int_0^\infty \sqrt{\log N(\epsilon, \mathcal{F}, \rho)} d \epsilon < \infty$ is Gaussian dominated.

\bf Proof of Lemma (ref)

proof[\bf Proof of Lemma (ref), Part $(i)$] We have \begin{align} \left( Q^{(2)}_y s_y \right)_{ij} &= |\mathcal{D}_i|^{-1/2} \frac{ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}} {|\mathcal{D}_i|^{-1} \sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'}} \left[ |\mathcal{D}_i|^{-1/2} \sum_{j' \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij'} \right] , \nonumber \\ \left( Q^{(3)}_y s_y \right)_{ij} &= |\mathcal{D}_j|^{-1/2} \frac{ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}} { |\mathcal{D}_j|^{-1} \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j}} \left[ |\mathcal{D}_j|^{-1/2} \sum_{i' \in \mathcal{D}_j} \partial_{\pi} \ell_{y,i'j} \right] . \end{align} With $\max_i |\mathcal{D}_i|^{-1/2} = O_P(n^{-1/4})$, $\max_j |\mathcal{D}_j|^{-1/2} = O_P(n^{-1/4})$, \begin{align*} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \frac{ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}} {|\mathcal{D}_i|^{-1} \sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'}} \right| &= O_P(1) , & \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \frac{ \left( \Lambda^{(1)}_{y,ij} \right)^{1/2}} { |\mathcal{D}_j|^{-1} \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j}} \right| &= O_P(1) , \end{align*} we obtain by Corollary (ref) that \begin{align} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q^{(2)}_y s_y \right)_{ij} \right| &= o_P(n^{-1/6}) & \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q^{(3)}_y s_y \right)_{ij} \right| &= o_P(n^{-1/6}) . \end{align} Next, \begin{align*} \left( Q^{(1)}_y s_y \right)_{ij} &= \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \widetilde x'_{y,ij} \, W_y^{-1} \left[ \frac 1 n \sum_{(i',j')\in \mathcal{D}} \widetilde x_{y,i'j'} \, (\partial_{\pi} \ell_{y,i'j'}) \right] , \\ \left( Q^{({rem})}_y s_y \right)_{ij} &= \left\{ \left( \Lambda^{(1)}_{y} \right)^{1/2} \left[w^{(2)},w^{(3)} \right] \left( {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} \right) \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}_{y} \right)^{1/2} s_y \right\}_{ij} \\ &= \left( \Lambda^{(1)}_{y,ij} \right)^{1/2} \sum_{(i',j') \in \mathcal{D}} \left[ {\mathcal G}^{(I \times I)}_{y,ii'} + {\mathcal G}^{(I \times J)}_{y,ij'} + {\mathcal G}^{(J \times I)}_{y,ji'} + {\mathcal G}^{(J \times J)}_{y,jj'} \right] \partial_{\pi} \ell_{y,i'j'} \end{align*} where ${\mathcal H}_y$ and ${\mathcal D}_y$ are $(I+J) \times (I+J)$ matrices introduced in the proof of Lemma (ref), and ${\mathcal G}_y := {\mathcal H}_y^\dagger - {\mathcal D}_y^{-1} $, and ${\mathcal G}_y^{(I \times I)}$, $ {\mathcal G}_y^{(I \times J)}$, $ {\mathcal G}_y^{(J \times I)}$, $ {\mathcal G}_y^{(J \times J)}$ denotes the various blocks of this $(I+J) \times (I+J)$ matrix. Remember that according to (ref) all the elements of ${\mathcal G}_y$ are uniformly bounded of order $n^{-1}$. Thus, by applying Corollary (ref)$(i)$ with $b^{(n)}_{y,hij}$ equal to $\widetilde x^h_{y,ij}$, for $h=1,\ldots,d_x$, and also with $b^{(n)}_{y,hij}$ equal to $n \left( {\mathcal G}^{(I \times I)}_{y,hi} + {\mathcal G}^{(I \times J)}_{y,hj} \right)$, for $h=1,\ldots,I$, and equal to $n \left( {\mathcal G}^{(J \times I)}_{y,hi} + {\mathcal G}^{(J \times J)}_{y,hj} \right)$, for $h=1,\ldots,J$, we find that \begin{align} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q^{(1)}_y s_y \right)_{ij} \right| &= O_P(n^{-1/2+1/6}) & \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q^{({rem})}_y s_y \right)_{ij} \right| &= O_P(n^{-1/2+1/6}) . \end{align} Combining the above we find that $Q_y s_y = Q^{(1)}_y s_y + Q^{(2)}_y s_y + Q^{(3)}_y s_y + Q^{({\text{rem}})}_y s_y$ indeed satisfies $\sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \left( Q_y s_y \right)_{ij} \right| = o_P(n^{-1/6})$.
proof[\bf Proof of Lemma (ref), Part $(ii)$ and $(iii)$] Here, we use Theorem 2.11.11 in vanderVaartandWellner1996, which is restated above as Lemma (ref). To relate this to our model we define \begin{align} Z_{\ell,n}(y,k) = \frac {\left[ W_y^{-1} \; \widetilde x_{y,i_\ell j_\ell} \right]_k} {\sqrt{n}} \; 1\{y_{i_\ell j_\ell} \leq y \} , \end{align} where $\ell \in \{1,\ldots,n\}$, and $i_\ell \in {\bf I}$, $j_\ell \in {\bf J}$ are chosen such that $B = \{ (i_\ell, j_\ell) \; : \; \ell = 1,\ldots,n\}$. $Z_{\ell,n}$ defines a stochastic process with index set ${\mathcal F} = {\mathcal Y} \times \{1,\ldots,\dim \beta\}$. For $f=(y,k) \in {\mathcal F}$ we write $Z_{\ell,n}(f)$. Part $(ii)$ of Lemma (ref) can then be written as \begin{align*} \sum_{\ell=1}^n \left( Z_{\ell,n} - {\mathbb{E}}\, Z_{\ell,n} \right) \rightsquigarrow {\mathcal Z}^{(\beta)} , \end{align*} where the limiting process ${\mathcal Z}^{(\beta)}$ is also indexed by $f \in {\mathcal F}$. We also define the following metric on ${\mathcal F}$, \begin{align} \rho(f_1,f_2) := C \left[ \left| y_1 - y_2 \right|^{1/2} + 1( k_1 \neq k_2 ) \right] , \end{align} for some sufficiently large constant $C>0$. For a general index set ${\mathcal F}$, a sufficient condition for a metric $\rho$ on ${\mathcal F}$ to be “Gaussian dominated” is given by (see vanderVaartandWellner1996, p.212) \begin{align} \int_0^\infty \sqrt{ \log N(\varepsilon, {\mathcal F}, \rho) } \, d \varepsilon \; < \; \infty , \end{align} where $N(\varepsilon, {\mathcal F}, \rho)$ denotes the covering number. $Z_{\ell,n}$ is a triangular array, because $W_y$ and $ \widetilde x_{y,ij}$ both implicitly depend on $n$, implying that $Z_{\ell,n_1} \neq Z_{\ell,n_2}$ for $n_1 \neq n_2$. Remember that the probability measure we use throughout is conditional on $x$, $\alpha^0$, $\gamma^0$, implying that the $Z_{\ell,n}$ are independent (but not identically distributed) across $\ell$, according to our assumptions. Using the model and the definition (ref) we have \begin{align*} W_y^{-1} \left[ - \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \partial_{\pi} \ell_{y,ij} \; \widetilde x_{y,ij} \right] &= \sum_{\ell=1}^n \left( Z_{\ell,n} - {\mathbb{E}}\, Z_{\ell,n} \right) =: Z_n . \end{align*} Using the Lyapunov CLT it is easy to verify that all the finite dimensional marginals $(Z_n(f_1), Z_n(f_2), \allowbreak \ldots, Z_n(f_p))$ of the stochastic process $Z_n$ converge weakly to a zero mean Gaussian limit process $({\mathcal Z}^{(\beta)}(f_1), {\mathcal Z}^{(\beta)}(f_2), \allowbreak \ldots, {\mathcal Z}^{(\beta)}(f_p))$. It is also easy to show that the second moments of the limit process are given by ${\mathbb{E}} {\mathcal Z}^{(\beta)}(f_1) {\mathcal Z}^{(\beta)}(f_2) = \left[ \overline W_{y_1}^{-1} \; \overline V_{y_1,y_2} \; \overline W_{y_2}^{-1} \right]_{k_1 k_2}$. In order to conclude that the process $Z_n$ is weakly convergent we also need to show that $Z_n$ is tight. For this we employ Lemma (ref) above with $m_n = n$ and metric $\rho$ given in (ref). This $\rho$ is Gaussian dominated on ${\mathcal F}$, because we have \begin{align*} \log N(\varepsilon, {\mathcal F}, \rho) \lesssim \left\{ \begin{array}{ll} \log( K/ \varepsilon ), & for \; 0<\varepsilon<K , \\ 0, & for \; \varepsilon \geq K , \end{array} \right. \end{align*} for some constant $K>0$, implying that (ref) is satisfied. To verify condition (i) of Lemma (ref), we calculate \begin{align*} \sum_{\ell=1}^{n} {\mathbb{E}}^* \left[ \| Z_{n\ell} \|_{\mathcal F} \; \; 1 \left\{ \| Z_{n\ell} \|_{\mathcal F} > \eta \right\} \right] & \leq n \, \max_{\ell} {\mathbb{E}}^* \left[ \| Z_{n\ell} \|_{\mathcal F} \; \; 1 \left\{ \| Z_{n\ell} \|_{\mathcal F} > \eta \right\} \right] \\ & \leq n \, \max_{\ell} {\mathbb{E}}^* \left[ \frac{ \left\| Z_{n\ell} \right\|^2_{\mathcal F} } {\eta} \; \; 1 \left\{ \| Z_{n\ell} \|_{\mathcal F} > \eta \right\} \right] \\ &\leq \max_{i,j} {\mathbb{E}} \left[ \frac{ \sup_y \left\| W_y^{-1} \; \widetilde x_{y,ij} \right\|_\infty^2 } {\eta} \; \; 1 \left\{ \frac{ \sup_y \| W_y^{-1} \; \widetilde x_{y,ij} \|_\infty} {\sqrt{n}} > \eta \right\} \right] , \\ & \rightarrow 0 . \end{align*} where for the second inequality we multiplied with $ \| Z_{n\ell} \|_{\mathcal F} / \eta$ inside the expectation, which is larger than one for $ \| Z_{n\ell} \|_{\mathcal F} > \eta$; for the third inequality we used that $ \| Z_{n\ell} \|_{\mathcal F} \leq \sup_y \| W_y^{-1} \; \widetilde x_{y,i_\ell j_\ell} \|_\infty / \sqrt{n}$; and for the final conclusion we used that $ \sup_{i,j} E \sup_{y} \left\| W_y^{-1} \; \widetilde x_{y,ij} \right\|^{2+\delta}$ is uniformly bounded. Next, for $y_1 \leq y_2$ we have \begin{align} \sqrt{n} \left| Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right| &= \left| [W_{y_1}^{-1} \; \widetilde x_{y_1,i(\ell)j(\ell)}]_{k_1} \; 1\{y_{i(\ell)j(\ell)} \leq y_1 \} - [W_{y_2}^{-1} \; \widetilde x_{y_2,i(\ell)j(\ell)}]_{k_2} \; 1\{y_{i(\ell)j(\ell)} \leq y_2 \} \right| \nonumber \\ &\leq \left| [W_{y_2}^{-1} \; \widetilde x_{y_2,i(\ell)j(\ell)}]_{k_2} \right| 1\{y_1 < y_{i(\ell)j(\ell)} \leq y_2 \} \nonumber \\ & \qquad \qquad \qquad \qquad + \left| [W_{y_1}^{-1} \; \widetilde x_{y_1,i(\ell)j(\ell)} ]_{k_1} - [W_{y_2}^{-1} \; \widetilde x_{y_2,i(\ell)j(\ell)} ]_{k_2} \right| \nonumber \\ & \lesssim 1\{y_1 < y_{i(\ell)j(\ell)} \leq y_2 \} \nonumber \\ & \qquad \qquad + \left\| W_{y_1}^{-1} \; \widetilde x_{y_1,i(\ell)j(\ell)} - W_{y_2}^{-1} \; \widetilde x_{y_2,i(\ell)j(\ell)} \right\|_{\infty} + 1( k_1 \neq k_2 ) \nonumber \\ & \lesssim \left| 1\{ y_{i(\ell)j(\ell)} \leq y_1 \} - 1\{ y_{i(\ell)j(\ell)} \leq y_2 \} \right| + \left| y_1 - y_2 \right| + 1( k_1 \neq k_2 ) . \end{align} where we used uniform boundedness of $W_y^{-1} \; \widetilde x_{y,ij} $ and of its derivative wrt $y$. The final result in (ref) is written such that the bound is also applicable for $y_1>y_2$. Using the bound (ref) we now verify condition (ii) of Lemma (ref), \begin{align*} \sum_{\ell=1}^{n} {\mathbb{E}}\left( Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right)^2 &\leq n \, \max_{\ell} {\mathbb{E}}\left( Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right)^2 \\ &= \max_{\ell} {\mathbb{E}}\left[ \sqrt{n} \left( Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right) \right]^2 \\ & \lesssim \max_{i,j} {\mathbb{E}}\left\{ \left| 1\{ y_{ij} \leq y_1 \} - 1\{ y_{ij} \leq y_2 \} \right| + \left| y_1 - y_2 \right| + 1( k_1 \neq k_2 ) \right\}^2 \\ &\lesssim \max_{i,j} {\mathbb{E}} \left| 1\{ y_{ij} \leq y_1 \} - 1\{ y_{ij} \leq y_2 \} \right|^2 + \left| y_1 - y_2 \right|^2 + \left[ 1( k_1 \neq k_2 ) \right]^2 \\ & \lesssim \max_{i,j} \left| \Lambda(\pi^0_{y_2,ij} ) - \Lambda(\pi^0_{y_1,ij} ) \right| + \left| y_1 - y_2 \right|^2 + 1( k_1 \neq k_2 ) \\ & \lesssim \left| y_1 - y_2 \right| + \left| y_1 - y_2 \right|^2 + 1( k_1 \neq k_2 ) \\ & \lesssim \left[ \left| y_1 - y_2 \right|^{1/2} + 1( k_1 \neq k_2 ) \right]^2. \end{align*} where, we used that $ {\mathbb{E}}\left| 1\{ y_{ij} \leq y_1 \} - 1\{ y_{ij} \leq y_2 \} \right| = \left| \Lambda(\pi^0_{y_2,ij} ) - \Lambda(\pi^0_{y_1,ij} ) \right| \lesssim \left| y_1 - y_2 \right|$; and we also used that ${\mathcal Y}$ is bounded, implying that $ \left| y_1 - y_2 \right|^2 \lesssim \left| y_1 - y_2 \right|$. Thus, condition (ii) of Lemma (ref) holds for sufficiently large $C$ in the definition of $\rho$ in (ref). To verify condition (iii) of Lemma (ref), let $C_1>0$ be the omitted constant that makes the result in (ref) a regular inequality. We then have \begin{align*} & \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right| > \frac{t} {\sqrt{n}} \right) \\ &\leq \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} C_1 \left[ \left| 1\{ y_{i(\ell)j(\ell)} \leq y_1 \} - 1\{ y_{i(\ell)j(\ell)} \leq y_2 \} \right| + \left| y_1 - y_2 \right| + 1( k_1 \neq k_2 ) \right] > t \right) \\ &\leq \mathbb{P}^*\Bigg( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| 1\{ y_{i(\ell)j(\ell)} \leq y_1 \} - 1\{ y_{i(\ell)j(\ell)} \leq y_2 \} \right| \\ & \qquad \qquad \qquad + \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| y_1 - y_2 \right| + \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} 1( k_1 \neq k_2 ) > \frac{t} {C_1} \Bigg) \\ &\leq \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| 1\{ y_{i(\ell)j(\ell)} \leq y_1 \} - 1\{ y_{i(\ell)j(\ell)} \leq y_2 \} \right| > \frac{t} {3 \, C_1} \right) \\ & \qquad + \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| y_1 - y_2 \right| > \frac{t} {3 \, C_1} \right) + \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} 1( k_1 \neq k_2 ) > \frac{t} {3 \, C_1} \right) . \end{align*} Any given $\rho$-ball ${\mathcal B}(\varepsilon)$ of radius less then $\varepsilon$ also corresponds to a given ball in ${\mathcal Y}$ of radius less than $(\varepsilon/C)^2$. The event $\left[ \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| 1\{ y_{i(\ell)j(\ell)} \leq y_1 \} - 1\{ y_{i(\ell)j(\ell)} \leq y_2 \} \right| > \frac{t} {3 \, C_1} \right]$ can only occurs if $ \frac{t} {3 \, C_1}\leq 1$ and if $ y_{i(\ell)j(\ell)}$ is realized in that particular ball in ${\mathcal Y}$ of radius less than $(\varepsilon/C)^2$. Since our assumptions guarantee that the pdf of $ y_{i(\ell)j(\ell)}$ is uniformly bounded from below by a constant $C_2>0$ we thus find that \begin{align*} \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| 1\{ y_{i(\ell)j(\ell)} \leq y_1 \} - 1\{ y_{i(\ell)j(\ell)} \leq y_2 \} \right| > \frac{t} {3 \, C_1} \right) &\leq 2 \, C_2 \left( \frac{ \varepsilon} C \right)^2 \; 1\left( \frac{t} {3 \, C_1} \leq 1 \right) . \end{align*} Similarly we find \begin{align*} \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| y_1 - y_2 \right| > \frac{t} {3 \, C_1} \right) &\leq 1\left( \frac{t} {3 \, C_1} \leq 2 \left( \frac{ \varepsilon} C \right)^2 \right) , \\ \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} 1( k_1 \neq k_2 ) > \frac{t} {3 \, C_1} \right) &\leq 1\left( \frac{t} {3 \, C_1} \leq 1 \; \; & \; \; C \leq \varepsilon \right). \end{align*} We thus calculate \begin{align*} & \sup_{t>0} \, \sum_{\ell=1}^{n} t^2 \, \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right| > t \right) \\ &\leq \sup_{t>0} \, \max_{\ell} \, n \, t^2 \, \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right| > t \right) \\ &= \sup_{t>0} \, \max_{\ell} \, t^2 \, \mathbb{P}^*\left( \sup_{f_1,f_2 \in {\mathcal B}(\varepsilon)} \left| Z_{n\ell}(f_1) - Z_{n\ell}(f_2) \right| > \frac{t} {\sqrt{n}} \right) \\ &\leq \sup_{t>0} \, t^2 \, \left\{ 2 \, C_2 \left( \frac{ \varepsilon} C \right)^2 \; 1\left( \frac{t} {3 \, C_1} \leq 1 \right) + 1\left( \frac{t} {3 \, C_1} \leq 2 \left( \frac{ \varepsilon} C \right)^2 \right) + 1\left( \frac{t} {3 \, C_1} \leq 1 \; \; & \; \; C \leq \varepsilon \right) \right\} \\ &\leq \varepsilon^2 , \end{align*} for sufficiently large choice of $C$. In the last step we also use that ${\mathcal Y}$ is bounded, which together with ${\mathcal B}(\varepsilon) \subset {\mathcal F}$ implies that the possible values of $\varepsilon$ are bounded, so that we can always choose $C$ sufficiently large to guarantee that $ 1\left( \frac{t} {3 \, C_1} \leq 1 \; \; \& \; \; C \leq \varepsilon \right) = 0$. Thus, we can apply Lemma (ref) to find that $ \sum_{\ell=1}^n \left( Z_{\ell,n} - {\mathbb{E}}\, Z_{\ell,n} \right) \rightsquigarrow {\mathcal Z}^{(\beta)}$, where ${\mathcal Z}^{(\beta)}$ is a tight zero mean Gaussian process with second moments given above. The proof of part $(iii)$ of Lemma (ref) is analogous.
proof[\bf Proof of Lemma (ref), Part $(iv)$ and $(v)$] Decomposing $Q_y s_y = Q^{(1)}_y s_y + Q^{(2)}_y s_y + Q^{(3)}_y s_y + Q^{({\text{rem}})}_y s_y$ and using (ref) and (ref) we find that \begin{align*} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left\{ \left[ \left( Q_y s_y \right)_{ij} \right]^2 - \left[ \left( Q^{(2)}_y s_y \right)_{ij} + \left( Q^{(3)}_y s_y \right)_{ij} \right]^2 \right\} = o_P(n^{-1}) , \end{align*} and therefore \begin{align*} - \frac 1 2 W_y^{-1} \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \Lambda^{(2)}_{y,ij} \left[ \left( Q_y s_y \right)_{ij} \right]^2 &= \frac{I} {\sqrt{n}} C^{(1,\beta)}_y + \frac{J} {\sqrt{n}} C^{(2,\beta)}_y + C^{(3,\beta)}_y + o_P(1) , \end{align*} where \begin{align*} C^{(1,\beta)}_y &:= - \frac 1 2 W_y^{-1} \; \frac 1 I \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \Lambda^{(2)}_{y,ij} \left[ \left( Q^{(2)}_y s_y \right)_{ij} \right]^2 , \\ C^{(2,\beta)}_y &:= - \frac 1 2 W_y^{-1} \; \frac 1 I \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \Lambda^{(2)}_{y,ij} \left[ \left( Q^{(3)}_y s_y \right)_{ij} \right]^2 , \\ C^{(3,\beta)}_y &:= - W_y^{-1} \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \Lambda^{(2)}_{y,ij} \left( Q^{(2)}_y s_y \right)_{ij} \left( Q^{(3)}_y s_y \right)_{ij} . \end{align*} Using that ${\mathbb{E}} \left[ \left( Q^{(2)}_y s_y \right)_{ij} \right]^2 = Q^{(2)}_{y,ij,ij}= \Lambda^{(1)}_{y,ij} \left( \sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'}\right)^{-1} $ and ${\mathbb{E}} \left[ \left( Q^{(3)}_y s_y \right)_{ij} \right]^2 = Q^{(3)}_{y,ij,ij}= \Lambda^{(1)}_{y,ij} \left( \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j}\right)^{-1} $ we find that \begin{align*} {\mathbb{E}} C^{(1,\beta)}_y &= B^{(\beta)}_y, & {\mathbb{E}} C^{(2,\beta)}_y &= D^{(\beta)}_y. \end{align*} Furthermore, using the expressions for $\left( Q^{(2)}_y s_y \right)_{ij}$ and $\left( Q^{(3)}_y s_y \right)_{ij}$ in (ref) above we can write, for given $\ell \in \{1,\ldots, d_x\}$, \begin{align*} \left[ W_y\, C^{(1,\beta)}_y \right]_\ell &= - \frac 1 2 \, \frac 1 I \sum_{i=1}^I c^{(n)}_{y,i} \left( \frac 1 {\sqrt{|\mathcal{D}_i|}} \sum_{j \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij} \right)^2 , \\ \left[ W_y\, C^{(2,\beta)}_y \right]_\ell &= - \frac 1 2 \, \frac 1 J \sum_{j=1}^J d^{(n)}_{y,j} \left( \frac 1 {\sqrt{|\mathcal{D}_j|}} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right)^2 , \end{align*} where \begin{align*} c^{(n)}_{y,i} &= \frac{ |\mathcal{D}_i|^{-1} \sum_{j \in \mathcal{D}_i} \widetilde x_{y,ij} \Lambda^{(2)}_{y,ij} } {\left( |\mathcal{D}_i|^{-1} \sum_{j \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij} \right)^2} , & d^{(n)}_{y,j} &=\frac{ |\mathcal{D}_j|^{-1} \sum_{i \in \mathcal{D}_j} \widetilde x_{y,ij} \Lambda^{(2)}_{y,ij} } {\left( |\mathcal{D}_j|^{-1} \sum_{i \in \mathcal{D}_j} \Lambda^{(1)}_{y,ij} \right)^2} , \end{align*} which are of order $O_P(1)$, uniformly over $y$ and $i$ and $j$. By employing part $(ii)$ of Corollary (ref) we thus find that \begin{align*} C^{(1,\beta)}_y - {\mathbb{E}} C^{(1,\beta)}_y &= o_P(1) , & C^{(2,\beta)}_y - {\mathbb{E}} C^{(2,\beta)}_y &= o_P(1). \end{align*} Finally, again using (ref) we can write \begin{align*} C^{(3,\beta)}_y &= - W_y^{-1} \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \frac{ \widetilde x_{y,ij} \Lambda^{(2)}_{y,ij} } { |\mathcal{D}_i|^{1/2} |\mathcal{D}_j|^{1/2} } \frac{ \left( |\mathcal{D}_i|^{-1/2} \sum_{j' \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij'} \right) \left( |\mathcal{D}_j|^{-1/2} \sum_{i' \in \mathcal{D}_j} \partial_{\pi} \ell_{y,i'j} \right) } {\left( |\mathcal{D}_i|^{-1} \sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'} \right) \left( |\mathcal{D}_j|^{-1} \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j} \right)} , \end{align*} and therefore \begin{align*} \left\| C^{(3,\beta)}_y \right\| &\leq \max_{j \in {\bf J}} \left| |\mathcal{D}_j|^{-1/2} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right| \\ & \quad \times \left\| W_y^{-1} \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} \frac{ \widetilde x_{y,ij} \Lambda^{(2)}_{y,ij} } { |\mathcal{D}_i|^{1/2} |\mathcal{D}_j|^{1/2} } \frac{ \left( |\mathcal{D}_i|^{-1/2} \sum_{j' \in \mathcal{D}_i} \partial_{\pi} \ell_{y,ij'} \right) } {\left( |\mathcal{D}_i|^{-1} \sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'} \right) \left( |\mathcal{D}_j|^{-1} \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j} \right) } \right\| \\ &= \left( \max_{i \in I} |\mathcal{D}_i|^{-1/2} \right) \left( \max_{j \in {\bf J}} \left| |\mathcal{D}_j|^{-1/2} \sum_{i \in \mathcal{D}_j} \partial_{\pi} \ell_{y,ij} \right| \right) \left\| \frac 1 {\sqrt{n}} \sum_{(i,j) \in \mathcal{D}} e^{(n)}_{y,i} \; \partial_{\pi} \ell_{y,ij} \right\| , \end{align*} where \begin{align*} e^{(n)}_{y,i} &= W_y^{-1} |\mathcal{D}_i|^{-1/2} \sum_{j \in \mathcal{D}_i} |\mathcal{D}_j|^{-1/2} \frac{ \widetilde x_{y,ij} \Lambda^{(2)}_{y,ij} } {\left( |\mathcal{D}_i|^{-1} \sum_{j' \in \mathcal{D}_i} \Lambda^{(1)}_{y,ij'} \right) \left( |\mathcal{D}_j|^{-1} \sum_{i' \in \mathcal{D}_j} \Lambda^{(1)}_{y,i'j} \right) } , \end{align*} which is of order one, uniformly over $y$ and $i$. Thus, by applying Corollary (ref), and Corollary (ref) with $b^{(n)}_{y,hij}$ equal to the elements of the $d_x$-vector $e^{(n)}_{y,i}$ (i.e. no $j$-dependence), we find that $ \left\| C^{(3,\beta)}_y \right\| = O_P(n^{-1/4}) o_P\left( n^{1/12} \right) O_P \left( n^{1/6} \right) = o_P(1)$. Combining the above we conclude $$ - \frac 1 2 W_y^{-1} \; n^{-1/2} \sum_{(i,j) \in \mathcal{D}} \; \widetilde x_{y,ij} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \Lambda^{(2)}_{y,ij} \left[ \left( Q_y s_y \right)_{ij} \right]^2 -\left( n^{-1/2} I B^{(\beta)}_y + n^{-1/2} J D^{(\beta)}_y \right) \rightarrow_P 0 . $$ The proof for $$ \frac 1 {2 \sqrt{n}} \, \sum_{(i,j) \in \mathcal{D}} \left( \Lambda^{(1)}_{y,ij} \right)^{-1} \left( \Lambda^{(2)}_{y,ij,k} - \Lambda^{(2)}_{y,ij} \Psi_{y,ij,k} \right) \left[ \left( Q_y s_y \right)_{ij} \right]^2 - \left( n^{-1/2} I B^{(\Lambda)}_{y,k} + n^{-1/2} J D^{(\Lambda)}_{y,k} \right) \rightarrow_P 0 $$ is analogous.

\bf Proof of Lemma (ref)

proof[\bf Proof of Lemma (ref)] Let \begin{align*} \widetilde x_{y}(\pi_y) &= x_{y} - \left[w^{(2)},w^{(3)} \right] \left( \left[w^{(2)},w^{(3)} \right]' \Lambda^{(1)}(\pi_y) \left[w^{(2)},w^{(3)} \right] \right)^\dagger \left[w^{(2)},w^{(3)} \right]' \left( \Lambda^{(1)}(\pi_y) \right) x_{y} , \end{align*} and \begin{align*} W_y(\pi_y) = \frac 1 {n} \sum_{(i,j) \in \mathcal{D}} \Lambda^{(1)}(\pi_{y,ij}) \, \widetilde x_{y,ij}(\pi_y) \, \widetilde x_{y,ij}'(\pi_y) , \end{align*} and\footnote{ Note that instead of $B_y^{(\beta)}(\pi_y) $ we could simply write $B^{(\beta)}(\pi_y) $ here, because all the dependence on $y$ is through the parameter $\pi_y$. The only reason to write $B_y^{(\beta)}(\pi_y) $ is to avoid confusion with the notation $B^{(\beta)}(y)$ in the main text. } \begin{align*} B_y^{(\beta)}(\pi_y) = - \frac 1 2 W_y(\pi_y)^{-1} \left[ \frac 1 {I} \sum_{i=1}^I \frac{J^{-1} \sum_{j \in \mathcal{D}_i} \Lambda^{(2)}(\pi_{y,ij}) \, \widetilde x_{y,ij}(\pi_y) } {J^{-1} \sum_{j \in \mathcal{D}_i} \Lambda^{(1)}(\pi_{y,ij}) } \right] . \end{align*} Then we can write $ B^{(\beta)}_y = B_y^{(\beta)}(\pi^0_y) $ and $ \widehat B^{(\beta)}_y = B_y^{(\beta)}(\widehat \pi_y) $. The consistency result for $\widehat B^{(\beta)}_y= \widehat B^{(\beta)}(y)$ follows from an expansion of $= B_y^{(\beta)}(\widehat \pi_y) $ in $\widehat \pi_y$ around $\pi^0_y$. $\Lambda^{(1)}(\pi_{y,ij}) $ and $\Lambda^{(2)}(\pi_{y,ij}) $ and $\left( \Lambda^{(1)}(\pi_{y,ij}) \right)^{-1}$ are all uniformly bounded over $\pi_{y,ij} \in [\pi_{\min},\pi_{\max}]$, for any bounded interval $[\pi_{\min},\pi_{\max}]$. Using this one obtains \begin{align*} b_n := \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \sup_{\pi_y \in [\pi_{\min},\pi_{\max}]^n} \left\| \frac{ \partial B_y^{(\beta)}(\pi_y) } {\partial \pi_{y,ij}} \right\| = O_P(n^{-1}) , \end{align*} because any individual $\pi_{y,ij}$ only enters via an appropriately normalized sample average into $B_y^{(\beta)}(\pi_y) $. Indeed for any function of the form $$ B(\pi_y) = \frac 1 {I} \sum_{i=1}^I \frac{J^{-1} \sum_{j \in \mathcal{D}_i} f_1(\pi_{y,ij})} {J^{-1} \sum_{j \in \mathcal{D}_i} f_2(\pi_{y,ij}) } , $$ where $f_1$ and $f_2$ are differentiable with bounded derivatives $f_1'$ and $f_2'$, $$ \frac{\partial B(\pi_y)}{\partial \pi_{y,ij}} = \frac 1 {IJ} \frac{ f_1'(\pi_{y,ij})J^{-1} \sum_{j' \in \mathcal{D}_i} f_2(\pi_{y,ij'}) - J^{-1} \sum_{j' \in \mathcal{D}_i} f_1(\pi_{y,ij'})f_2'(\pi_{y,ij})} {\left[J^{-1} \sum_{j' \in \mathcal{D}_i} f_2(\pi_{y,ij'})\right]^2 } = O_P(n^{-1}). $$ Lemma (ref) together with Lemma (ref)$(ii)$ and Lemma (ref)$(i)$ guarantee that \begin{align*} \sup_{y \in \mathcal{Y}} \max_{(i,j) \in \mathcal{D}} \left| \widehat \pi_{y,ij} - \pi^0_{y,ij} \right| = o_P(n^{-1/6}) = o_P(1). \end{align*} By a mean value of expansion in $\widehat \pi_y$ around $\pi^0_y$ we thus obtain \begin{align*} \sup_{y \in \mathcal{Y}} \left\| B_y^{(\beta)}(\widehat \pi_y) - B_y^{(\beta)}(\pi^0_y) \right\| \leq b_n \sum_{(i,j) \in \mathcal{D}} \left| \widehat \pi_{y,ij} - \pi^0_{y,ij} \right| = o_P(1). \end{align*} The proof of consistency for the other estimators in Lemma (ref) is analogous.