Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
Rendered from LaTeX for readability, not typeset faithfully. Citation keys are highlighted; maths is left as source; figures, tables and equation environments are summarised rather than reproduced; unrecognised commands are greyed out so nothing is silently dropped. Email addresses are removed.
Bivariate distribution regression; theory, estimation and an application to intergenerational mobility
\onehalfspacing
\thispagestyle{empty}
\sloppy
We employ distribution regression (DR) to estimate the joint distribution of two outcome variables conditional on chosen covariates. While Bivariate Distribution Regression (BDR) is useful in a variety of settings,
it is particularly valuable when some dependence between the outcomes persists after accounting for the impact of the covariates.
Our analysis relies on a result from Chernozhukov2018distribution which shows that any conditional joint distribution has a local Gaussian representation. We describe how BDR can be implemented and present some associated functionals of interest. As modeling the unexplained dependence is a key feature of BDR, we focus on functionals related to this dependence. We decompose the difference between the joint distributions for different groups into composition, marginal and sorting effects.
We provide a similar decomposition for the transition matrices which describe how location in the distribution in one of the outcomes is associated with location in the other. Our theoretical contributions are the derivation of the properties of these estimated functionals and appropriate procedures for inference.
Our empirical illustration focuses on intergenerational mobility. Using the Panel Survey of Income Dynamics data, we model the joint distribution of parents' and children's earnings.
By comparing the observed distribution with constructed counterfactuals, we isolate the impact of observable and unobservable factors on the observed joint distribution. We also evaluate the forces responsible for the difference between the transition matrices of sons' and daughters'.
\noindentKeywords: Bivariate distribution regression; joint distribution; local Gaussian correlation, Decomposition, intergenerational mobility
\noindentJEL: C14, C21
singlespacing\begin{scriptsize}
\end{scriptsize}
\onehalfspacing
\onehalfspacing
Introduction
Although distribution regression (DR) was introduced in the 1970s by Williams1971,
and revisited by Foresi1995 in the 1990s, it has only relatively recently been more actively employed in empirical economic investigations. For example, inference for DR with a continuous outcome variable was only developed in Chernozhukov2013inference and for discrete, mixed discrete or continuous outcomes in Chernozhukovs2020. These papers have resulted in an examination of the economically interesting functionals which can be obtained from an estimated distribution of an economic variable conditional on a vector of exogenous variables. This has resulted in the use of DR in a range of different models and settings. These include, for example, models with endogeneity Chernozhukov2020nonseparable, sample selection Chernozhukov2018distribution, FVV2024, dynamic panels fernandezval2023dynamic, and most recently difference-in-difference estimation fernandezval2024.
While these extensions cover a wide class of models they, with the exception of
some studies we note below, are restricted to models with univariate outcomes. However, for many empirical questions it is necessary to examine how the joint distribution of two outcomes varies in response to changes in the conditioning variables. For example, in investigating household labor supply responses to changes in tax rates, one should quantify how the hours worked by each of the spouses respond and, perhaps more importantly, how changes in their individual labor supplies are correlated, thereby affecting overall household labor supply. Alternatively, in examining the impact of changes in the minimum wage it would be useful to investigate how both wages and hours of work individually and jointly respond. These examples are just illustrative of the large number of economic questions in which it is important to examine more than one outcome and, perhaps more importantly, how the joint distribution of the outcomes is affected.
The estimation of models with multiple outcomes by DR has been considered in Meier2020 and Wang2022.
Meier2020 extends univariate DR to the multivariate setting by using a multivariate indicator function at every location of the distribution. Wang2022 propose a fast factorization method that also employs univariate DR. However, this transformation to a univariate approach is potentially restrictive as it requires a single outcome variable to be
constructed from the multiple outcomes of interest. As DR then employs this constructed outcome, it does not enable each of the individual outcomes to be modeled separately. Moreover, it also bypasses the modeling of the correlation between the unobservables driving each of the outcome variables.
In contrast, BDR enables each of the individual outcomes to be explicitly modeled and facilitates an analysis of the local dependence structure. Furthermore, the choice of the link function in Meier2020 and Wang2022 might provide a poor approximation to the underlying distribution. In contrast, a result from Chernozhukov2018distribution, guarantees that the joint distribution is locally Gaussian and BDR is able to approximate it.
We employ DR to investigate settings in which the outcome of interest is the joint distribution of two outcome variables conditional on a set of covariates. Moreover, we describe how bivariate distribution regression (BDR) can be implemented, as well as the potentially interesting functionals that can be derived from BDR estimates. We separately analyze the roles of the marginal distributions and the dependence structure.
As each is modeled separately in BDR, a high degree of flexibility is incorporated between the role of both observable and unobservable factors.
Alternative approaches to modeling conditional joint distributions exist. These include the use of copulas Klein2022 and non-parametric estimators Bouzebda2019. Due to its semi-parametric properties, BDR can be seen as a mixture between these approaches. In contrast to copula models, BDR allows for greater flexibility in incorporating the impact of the covariates and requires relatively weaker parametric assumptions. Non-parametric approaches are more likely to suffer from the curse of dimensionality. A detailed overview of modeling choices for multivariate distributions can be found in Meier2020.
Bivariate or multivariate distribution regression has been employed elsewhere. For example, fernandezval2023 model the joint distribution of spouses' wages in the presence of selection rules, fernandezval2024 employ it in implementing difference-in-difference procedures with bivariate outcomes, while fernandezval2022cpscouples employ it to describe the joint distribution of spouses' annual earnings. The first two papers provide a theoretical contribution related to the literature on which they are focused and the third is purely a descriptive analysis. This paper provides important original theoretical contributions related to inference, the validity of the bootstrap employed, and the decompositions of the joint distribution and transition matrices.
Our empirical illustration is related to intergenerational mobility. This is a research area with potentially important policy implications on a range of topics such as tax policy and inequality reduction. It has received significant attention from policymakers and has generated a substantial academic literature.
In a seminal paper, Chetty2014 showed that schools, neighborhoods, and family stability are influential determinants of mobility. Others have shown that race Chetty2020, immigration status Abramitzky2021, human capital Adermon2021, or wealth Adermon2018 are correlated with various mobility measures (see Mogstad2021 for a recent overview). This suggests that one should include many covariates when modeling intergenerational mobility noting that the appropriate manner to do so is not straightforward given that the relationship between the covariates and earnings appears to vary over the earnings' distributions.
Previous studies typically present estimates of relative mobility across subsamples of the data or employ a linear regression approach in which the child's outcomes (rank of income, human capital, or wealth) are regressed on the parents' analog and (sometimes) covariates.
By employing BDR to model the joint distribution of fathers' and children's income
we provide an additional methodological approach for evaluating intergenerational mobility. First, we allow for the covariates to have varying effects at different points of the earnings' distributions. Second, we can allow for different covariates to have an impact on each of the marginal distributions and the dependence structure. Third, as the joint distribution captures the entire dependence structure between the respective income measures, standard mobility measures, such as the rank-rank relationship and the conditional expected rank, can be directly derived from the BDR estimates. Fourth, we can explore how these mobility measures are influenced by the dependence in the unobservables and how this dependence may vary across the income distribution. Finally, BDR estimates can be employed to produce counterfactual bivariate distributions corresponding to scenarios capturing alternative values of the local correlation.
The remainder of this paper is organized as follows. Section (ref) formally presents our methodological contribution. In Section (ref) we present a number of functionals which are potentially of interest in empirical work. Section (ref) outlines the associated estimation procedure. Section (ref) presents the asymptotic theory. Section (ref) contains our empirical application. Section (ref) concludes.
Bivariate Distribution Regression
Let $F_{Y,W \mid X}$ be the joint distribution of $(Y,W)$ conditional on $X$. We consider the bivariate distribution regression (BDR) model:
equation[equation omitted — 108 chars of source]
where $\Phi_{2}(\cdot, \cdot; \rho)$ is the distribution of the standard bivariate normal with parameter $\rho$, and $u \mapsto g(u)$ is a known link function with range $[-1,1]$ such as the Fisher transformation $g(u) = \tanh(u)$. In (ref) the marginal distributions of $Y$ and $W$ conditional on $X$ follow distribution regression models:
$$
F_{Y \mid X}(y \mid x) = \Phi(x'\mu_y), \quad F_{W\mid X}(w \mid x) = \Phi(x'\nu_w),
$$
where $\Phi$ is the distribution of the standard normal. The function $(y,w,x) \mapsto g(x'\delta_{yw})$ measures the local dependence or sorting between $Y$ and $W$ at $(Y,W,X) = (y,w,x)$. This sorting can vary with respect to observed covariates $X$, and along the distribution as indexed by $(y,w)$. The simplest case is $g(x'\delta_{yw}) = g(\delta_{yw})$, where the sorting only varies with respect to unobservables.
The BDR model can be motivated by the local Gaussian representation (LGR) of
Chernozhukov2018distribution, which establishes that for any conditional joint distribution,
equation[equation omitted — 116 chars of source]
for some functions $\mu$, $\nu$ and $\rho$. The LGR is the right-hand-side of the previous equation and is unique, that is there is a one-to-one mapping between a conditional joint distribution and its LGR. In the LGR the marginal distributions of $Y$ and $W$ conditional on $X$ are represented by nonparametric distribution regression models, that is
$$
F_{Y \mid X}(y \mid x) = \Phi(\mu(y \mid x)), \quad F_{W \mid X}(w \mid x) = \Phi(\nu(w \mid x)).
$$
The BDR model can be seen as a semiparametric specification for the LGR where the nonparametric functions $\mu$, $\nu$ and $\rho$ are replaced by (generalized) linear indexes with function-valued parameters. In particular, the parameters $y \mapsto \mu_y$ and $w \mapsto \nu_w$ measure the effect of the covariates on the marginal distributions of $Y$ and $W$, and $(y,w) \mapsto \rho_{yw}$ measures the effect of the covariance on the local dependence (copula) between $Y$ and $W$.
Let $\bar \mathcal{Y}$ and $\bar \mathcal{W}$ denote strict subsets of $\mathcal{Y}$ and $\mathcal{W}$, the supports of $Y$ and $W$, respectively. We impose the following restrictions on the coefficients at the tails to facilitate estimation and inference,
$$
\mu_{y,1} = \mu_{\bar y_y, 1} + (y - \bar y_y)\alpha_{\bar y_y}, \quad \mu_{y,-1} = \mu_{\bar y_y,-1},\quad y \in \mathcal{Y} \setminus\bar{\mathcal{Y}},
$$
$$
\nu_{w,1} = \nu_{\bar w_w,1} + (w - \bar w_w)\alpha_{\bar w_w}, \quad \nu_{w,-1} = \nu_{\bar w_w,-1},\quad w \in \mathcal{W} \setminus\bar{\mathcal{W}},
$$
and
$$
\delta_{y,w} = \delta_{\bar y_y \bar w_w},\quad y \in \mathcal{Y} \setminus\bar{\mathcal{Y}}, \quad w \in \mathcal{W} \setminus\bar{\mathcal{W}},
$$
where $\bar y_y := \arg \min_{y' \in \bar{\mathcal{Y}}} |y-y'|$, $\alpha_{\bar y_y} > 0$, $\bar w_w := \arg \min_{w' \in \bar{\mathcal{W}}} |w-w'|$, $\alpha_{\bar w_w} > 0$, and the subscript $1$ and $-1$ denote the first element of a vector and its complement. For example, $\mu_{y,1}$ is the first element of $\mu_y$ and $\mu_{y,-1}$ is a vector with the rest of the elements. Here, we follow chernozhukov2025 and postulate that the random variables $Y$ and $W$ behave in the tails like random variables with distribution $\Phi$, after subtracting the location shifts $x'\mu_{\bar y}$ and $x'\nu_{\bar w}$, and dividing by the scales
$\alpha_{\bar y_y}$ and $\alpha_{\bar w_w}$, which are different at the upper and lower tails. For the local dependence parameter $\delta_{yw}$, we postulate that it is constant at the tails. We could allow for additional tail parameters for the intercept of $\delta_{yw}$, but we set them to zero for simplicity.\footnote{Note that, unlike the intercepts of $\mu_y$ and $\nu_w$, the intercept of $\delta_{yw}$ does not need to satisfy any monotonicity restriction at the tails.}
Functionals of Interest
Rather than examine statistics which can be obtained in the univariate setting, we exploit the rich information contained in the conditional bivariate distribution and focus on functionals which highlight the dependence structure in the data. Accordingly, the local dependence parameter $\delta_{yw}$ features in each of the objects that follow.
Joint Distribution and Decomposition
The joint distribution of $Y$ and $W$ can be represented in terms of the BDR model as
$$
F_{Y,W}(y,w) = \int \Phi_2(x'\mu_y,x'\nu_w;g(x'\delta_{yw})) {\mathrm{d}} F_X(x),
$$
where $F_X$ is the distribution of $X$.
Using this representation, we can decompose the difference between the joint distribution of two groups, say $D=1$ and $D=0$. To do so, it is convenient to introduce counterfactual distributions that combine BDR parameters and distributions of $X$ from different groups. Let
equation[equation omitted — 144 chars of source]
where $\mu_y^i$ is the parameter $\mu_y$ in group $i$ and the rest of the terms are defined analogously. In this notation the actual distribution in group $d$ is $F^{(d,d,d,d)}_{Y,W}$.
The difference in the actual distributions between groups $1$ and $0$ can then be decomposed as
multline[multline omitted — 483 chars of source]
where the first term in brackets is a composition effect, the second term is a dependence or sorting effect, and the third term is the effect of the difference in the marginal distributions. The last term can be further decomposed into
equation[equation omitted — 252 chars of source]
where the first term is the marginal effect related to $W$ and the last term is the marginal effect related to $W$.
Transition Matrices and Decomposition
We can also construct transition matrices and decompose differences across those for different groups into composition, sorting and marginal distribution components using counterfactual distributions. Let $\{y_j: 0 \leqslant j \leqslant J\}$ and $\{w_k: 0 \leqslant k \leqslant K\}$ be grids of values covering the supports of $Y$ and $W$, where we set $y_0=w_0 = - \infty$ and $y_K = w_K = +\infty$. Then, the $(j,k)$ element of the counterfactual transition matrix $T^{(k,d,r,s)}$ is
equation[equation omitted — 192 chars of source]
for $j = 1,\ldots,J$ and $k = 1,\ldots,K$. These matrices provide a parsimonious representation of the joint distribution of $Y$ and $W$.
The difference in the actual transition matrices between groups $1$ and $0$ can then be decomposed as
multline*[multline* omitted — 504 chars of source]
We provide examples of this decomposition in Section (ref).
commentEach children's bracket CDF implies an average income and thus average quantile (evaluated at the unconditional marginal distribution). Thus, a classical rank-rank regression can be performed, generalizing approaches as in Chetty2014. Most notably, the advantage of this technique is that the covariates were allowed to flexibly affect the joint distribution instead of subsampling the data. To see the connection, suppose we set the quantiles to all percentiles of the unconditional father's distribution. As a result, we obtain 99 marginal CDFs for the children, one for each percentile range. Trivially, these CDFs imply an average, i.e. $\mu_{Y|Q_{j} < W < Q_{k}} = \int Y d F_{Y|Q_{j} < W < Q_{k}} $. Finally, it is straightforward to compare the latter to the unconditional ranks of the childrens distribution and deduce the corresponding average rank.
comment\subsection{Average Conditional Kendall Coefficient and Decomposition}
Let $(Y,W)$ and $(\tilde Y,\tilde W)$ be independent and identically distributed random variables.
The Kendall coefficient
$$
\tau := {\mathrm{P}}[(Y-\tilde Y)(W - \tilde W) > 0] - {\mathrm{P}}[(Y-\tilde Y)(W - \tilde W) < 0],
$$
is a classical measure of association between $Y$ and $W$ kendall1938new. It captures the probability of concordance minus the probability of discordance for $(Y,W)$. The coefficient $\tau$ is bounded between $-1$ and $1$ with positive values indicating positive association, negative values negative association and zero values no association. When $Y$ and $W$ are continuous, $\tau$ can be expressed as a functional of their joint distribution as
\begin{equation*}
\tau = 4 {\mathrm{E}}[F_{Y,W}(Y,W)] - 1.
\end{equation*}
The conditional Kendall coefficient between $Y$ and $W$ given $X=x$ can be defined similarly as
\begin{multline*}
\tau_x := {\mathrm{P}}[(Y-\tilde Y)(W - \tilde W) > 0 \mid X=x] - {\mathrm{P}}[(Y-\tilde Y)(W - \tilde W) < 0 \mid X=x] \\ = 4 {\mathrm{E}}\left[ F_{Y,W \mid X}(Y,W \mid X) - 1/4 \mid X=x\right],
\end{multline*}
where $(Y,W)$ and $(\tilde Y,\tilde W)$ are independent and identically distributed conditional on $X$ tsai1990testing, and we assume that $Y$ and $W$ are continuous to obtain the expression on the right-hand side. The coefficient $\tau(x)$ measures the association between $Y$ and $W$ within the group defined by $X=x$. The interpretation of $\tau(x)$ is similar to $\tau$, although $\tau(x)$ might change with the value $x$ to capture that the association between $Y$ and $W$ can differ across groups defined by $X$. A summary measure of within-group association is the average conditional Kendall coefficient between $Y$ and $W$ given $X$,
$$
\tau_W = {\mathrm{E}}[\tau_X] = \int \tau_x {\mathrm{d}} F_X(x).
$$
The coefficient $\tau_W$ can be expressed as a functional of the conditional Kendall coefficient function $x \mapsto \tau_x$ and the distribution of the covariates. Thus,
$$
\tau_W = \tau_W(\tau_x,F_X) = \int \tau_x {\mathrm{d}} F_X(x).
$$
Counterfactual average within-group Kendall coefficients can then be formed by modifying the covariate distribution. Thus we can decompose the difference between the average within-group Kendall coefficient of two groups, say $D=0$ and $D=1$, as
\begin{equation*}
\underset{Total}{\underbrace{ \tau_W(\tau_x^1,F_X^1) - \tau_W(\tau_x^0,F_X^0)}} = \underset{Composition}{\underbrace{ [\tau_W(\tau_x^1,F_X^1) - \tau_W(\tau_x^1,F_X^0)]}} \\ + \underset{Structure }{\underbrace{ [\tau_W(\tau_x^1,F_X^0) - \tau_W(\tau_x^0,F_X^0)]}},
\end{equation*}
where the two terms on the right-hand side correspond to differences in composition ($F_X$) and structure ($\tau_x$), respectively. The term $\tau_W(\tau_x^1,F_X^0)$ is a counterfactual average within-group Kendall coefficient, which can be written in terms of the propensity score to facilitate estimation:
\begin{equation}
\tau_W^{\pi} := \tau_W(\tau_x^1,F_X^0) = \int \tau_x \pi_x {\mathrm{d}} F_X(x),
\end{equation}
where we use the Bayes rule with
$$
\pi_x := \frac{{\mathrm{P}}(D=0 \mid X=x) {\mathrm{P}}(D=1)}{{\mathrm{P}}(D=1 \mid X=x) {\mathrm{P}}(D=0)}.
$$
Estimation
Rather than employing probit, as is done in univariate DR, BDR estimates a sequence of bivariate probits. Let $I^y := 1(Y \leqslant y)$, $\bar I^y := 1 - I^y$, $J^w := (W \leqslant w)$ and $\bar J^w := 1 - J^w$, for $(y,w) \in \mathcal{Y}_n \times \mathcal{W}_n$, where $\mathcal{Y}_n$ and $\mathcal{W}_n$ are grids of points in the supports of $Y$ and $W$, respectively.
Under the BDR model, the joint probability function of $I^y$ and $J^w$ conditional on $X=x$ is
align[align omitted — 398 chars of source]
Given a random sample of size $n$, $\{(Y_i,W_i,X_i)\}_{=1}^n$, the average conditional log-likelihood at $(y,w)$ is
align[align omitted — 149 chars of source]
The conditional maximum likelihood estimator (CMLE) of $(\mu_y,\nu_w, \delta_{yw})$ is
align[align omitted — 138 chars of source]
Several remarks should be noted regarding computation. First, when $\rho(x'\delta_{yw}) = \rho(\delta_{yw})$, then the CMLE is the bivariate probit estimator of $(I^y,J^w)$ on $X$. Second, the CMLE can be computed in two steps. In the first step, we obtain the estimators of $\mu_y$ and $\nu_w$ by probit distribution regression of $I^y$ on $X$ and $J^w$ on $X$, respectively. In the second step, we plug in the estimators of $\mu_y$ and $\nu_w$ from the first step in the average log-likelihood and maximize with respect to $\delta$, that is
align[align omitted — 123 chars of source]
where $\widehat \mu_y$ and $\widehat \nu_w$ are the distribution regression estimators of $\mu_y$ and $\nu_w$. Finally, to trace the joint and marginal distributions of $Y$ and $W$, we need to obtain the CMLE for a grid of values of $(y,w)$ in the support of $(Y,W)$. For example, we can use the tensor product of two grids for $Y$ and $W$, including sampling percentiles from the $1$ or $2\%$ to the $99$ or $98\%$.
Let ${\mathbb{E}_n}$ denote the empirical expectation, that is ${\mathbb{E}_n} := n^{-1} \sum_{i=1}$.
algorithm[algorithm omitted — 3,235 chars of source]
The counterfactual terms of the decomposition of the joint distribution can be estimated via a plug-in rule. For example, an estimator of the second integral on the right-hand side of (ref) can be constructed as follows:
$$
\frac{1}{n_0} \sum_{i=1}^n (1-D_i) \Phi_2(X_i'\widehat \mu^1_y,X_i'\widehat \nu^1_w;g(X_i'\widehat \delta^1_{yw})),
$$
where $\widehat \mu^1_y, \widehat \nu^1_w, \widehat \delta^1_{yw}$ are estimators of $\mu^1_y, \nu^1_w, \delta^1_{yw}$ in the subsample with $D=1$ and $n_0 := \sum_{i=1}^n (1-D_i)/n$. \footnote{Alternatively, a doubly-robust estimator can be formed as
$$
\frac{1}{n_0} \sum_{i=1}^n \frac{(1-D_i)}{1-\widehat p(X_i)} 1\{Y_i \leqslant y, W_i \leqslant w\} - \frac{1}{n_0} \sum_{i=1}^n \frac{(D_i-\widehat p(X_i))}{1-\widehat p(X_i)} \Phi_2(X_i'\widehat \mu^1_y,X_i'\widehat \nu^1_w;g(X_i'\widehat \delta^1_{yw})),
$$
where $\widehat p(x)$ is an estimator of the propensity score $p(x) = {\mathrm{P}}(D=1 \mid X=x)$.}
commentThe counterfactual terms of the decomposition of the Kendall coefficient can be estimated via a plug-in rule. For example, the average within-group Kendall coefficient $\tau_W$ in group $D=d$ can be estimated by
\begin{equation}
\widehat \tau_W^{d} = \frac{4}{n_d} \sum_{i=1}^n 1(D_i=d) \Phi_2(X_i'\widehat \mu^d_{Y_i}, X_i'\widehat \nu^d_{W_i}; g(X_i'\widehat \delta^d_{Y_i W_i})) - 1,
\end{equation}
where $\widehat \mu^d_y, \widehat \nu^d_w, \widehat \delta^d_{yw}$ are estimators of $\mu^d_y, \nu^d_w, \delta^d_{yw}$ in the subsample with $D=d$ and $n_d := \sum_{i=1}^n 1(D_i=d)$.
Similarly, the counterfactual average within-group Kendall coefficient $\tau_W^{\pi}$ in (ref) can be estimated by
$$
\widehat \tau_W^{\pi} = \frac{4}{n_1} \sum_{i=1}^n D_i \Phi_2(X_i'\widehat \mu^1_{Y_i}, X_i'\widehat \nu^1_{W_i}; g(X_i'\widehat \delta^1_{Y_i W_i})) \widehat \pi_{X_i} - 1, \quad \widehat \pi_{x} := \frac{(1-\widehat p(x)) \widehat p}{\widehat p(x)(1- \widehat p)},
$$
where
$\widehat p = n_1/n$ AND $\widehat p(x)$ is an estimator of the propensity score $p(x) = {\mathrm{P}}(D=1 \mid X=x)$.
Inference
We use the exchangeable bootstrap for inference. The following algorithm describes how to obtain counterfactual draws of the BDR estimator.
algorithm[algorithm omitted — 2,286 chars of source]
Exchangeable bootstrap draws of the estimators of the functionals of interest can be obtained similarly.
commentFor example,
$$
\widehat \tau_W^{d} = \frac{4}{n^*_d} \sum_{i=1}^n \omega_{ni} 1(D_i=d) \Phi_2(X_i'\widehat \mu^{d*}_{Y_i}, X_i'\widehat \nu^{d*}_{W_i}; g(X_i'\widehat \delta^{d*}_{Y_i W_i})) - 1,
$$
where $\widehat \mu^{d*}_y, \widehat \nu^{d*}_w, \widehat \delta^{d*}_{yw}$ are bootstrap draws of $\widehat \mu^d_y, \widehat \nu^d_w, \widehat \delta^d_{yw}$ and $n^*_d := \sum_{i=1}^n \omega_{ni} 1(D_i=d)$, is a bootstrap draw of the estimator of $\tau_W^d$ in (ref).
Asymptotic Theory
To simplify the expressions of some of the assumptions and limit processes, it is convenient to introduce the following notation for the tails. Let $\bar r_r := \arg \min_{r' \in \bar{\mathcal{R}}} |r-r'|$ for $r \in \{y,w\}$ and $\bar \mathcal{R} \in \{\bar \mathcal{Y},\bar \mathcal{W}\}$. Note that $\bar r_r = r$ if $r \in \bar \mathcal{R}$, $\bar r_r = \bar r$ if $r \ge \bar r$ and $\bar r_r = \underline r$ if $r \leqslant \underline r$, where $\bar r := \sup (\bar \mathcal{R})$ and $\underline r := \inf(\bar \mathcal{R})$. We use a superscript $d$ to denote variables, parameters and samples from the group $d \in \{0,1\}$. We also use the following notation for partial derivatives: $\partial_x f(x) := \partial f(x)/\partial x$ and $\partial_{x x} f(x) := \partial^2 f(x)/(\partial x \partial x')$.
assumption[Model and Sampling] For $d \in \{0,1\}$: (1) Random sampling: $\{Z^d_i :=( Y^d_i,W^d_i,X^d_i)\}_{i=1}^{n_d}$ is a sequence of independent and identically distributed copies of $Z^d := (Y^d,W^d,X^d)$, which is independent across $d$, and $n_d/n \to p_d>0$ for $n := n_0+n_1$.\footnote{Some forms of dependence between the samples across $d$ can be accommodated following the analysis in Chernozhukov2013inference. We assume independence for simplicity and because it holds in our application. }
(2) Model: the joint distribution of $(Y^d,W^d)$ conditional on $X^d$ follows the BDR model (ref) with the tail restrictions. (3) The support of $X^d$, $\mathcal{X}$, is a compact set. (4) The supports of $Y$ and $W$, $\mathcal{Y}$ and $\mathcal{W}$
are either (i) finite sets or (ii) open intervals. In the second case, the conditional density functions $f_{Y^d\mid X^d}(y \mid x)$ and $f_{W^d \mid X^d}(w \mid x)$ exist, are uniformly bounded above, and are uniformly continuous in $(y,x)$ on $\mathcal{Y} \times \mathcal{X}$ and in $(w,x)$ on $\mathcal{W} \times \mathcal{X}$, respectively. (5) Identification and non-degeneracy: the equation ${\mathrm{E}}[\partial_{\delta} \ell^{yw}_i(\mu^d_y,\nu^d_w,\tilde \delta_{yw})] = 0$ possesses a unique solution at $\tilde \delta_{yw} = \delta^d_{yw}$ that lies in the interior of a compact set $\mathcal{D} \subset \mathbb{R}^{d_{\delta}}$ for all $(y,w) \in \bar \mathcal{Y}\bar \mathcal{W} := \bar \mathcal{Y} \times \bar \mathcal{W}$; the minimum eigenvalues of the matrices ${\mathrm{E}}[\partial_{\mu \mu} \ell_i^y(\mu^d_y)]$, ${\mathrm{E}}[\partial_{\alpha \alpha}\ell_i^{y_0}(\alpha^d_{\bar y_y}, \mu_{\bar y_y})]$, ${\mathrm{E}}[\partial_{\nu \nu} \ell_i^w(\nu^d_w)]$, ${\mathrm{E}}[\partial_{\alpha \alpha}\ell_i^{w_0}(\alpha^d_{\bar w_w}, \mu_{\bar w_w})]$ and ${\mathrm{E}}[\partial_{\delta \delta} \ell^{yw}_i(\mu^d_y,\nu^d_w, \delta^d_{yw})]$ are bounded away from zero uniformly over $y \in \bar \mathcal{Y}$, $y \in \{\underline y, \bar y\}$, $w \in \bar \mathcal{W}$, $w \in \{\underline w, \bar w\}$, and $(y,w) \in \bar \mathcal{Y} \bar \mathcal{W}$, respectively; and ${\mathrm{E}}\|X\|^2 < \infty$.
Assumption (ref) implicitly imposes common support for the variables $Y^d$, $W^d$ and $X^d$ across $d$. This condition guarantees that all the counterfactual distributions that we consider are well-defined.
assumption[Exchangeable Bootstrap] For each $n_d$ and $d \in \{0,1\}$, $(\omega^d_{n_d1}, ..., \omega^d_{n_dn_d})$ is an exchangeable,\footnote{A sequence of random variables $X_1, X_2, ..., X_n$ is exchangeable if for any finite permutation $\sigma$ of the indices $1,2, ..., n$ the joint
distribution of the permuted sequence $X_{\sigma(1)}, X_{\sigma(2)},
...,X_{\sigma(n)} $ is the same as the joint distribution of the original
sequence.} nonnegative random vector, which is independent of the data and across $d$, such that for some $\epsilon> 0$
\begin{equation}
\begin{split}
\sup_{n} {\mathrm{E}}[(\omega_{n_d1}^d)^{2+\epsilon}] < \infty, \ \ n_d^{-1}\sum
_{i=1}^{n_d} \left( \omega^d_{n_di} - \bar{\omega}^d_{n_d} \right)^{2} \to_{{\mathrm{P}}} 1, \ \
\bar \omega^d_{n_d} \to_{{\mathrm{P}}} 1,
\end{split}
\end{equation}
where $\bar \omega^d_{n_d} = n_d^{-1} \sum_{i=1}^{n_d} \omega^d_{n_di} $.
Let $\widehat \theta^d_{yw} := ( \widehat \mu_y^{d'}, \widehat \nu_w^{d'}, \widehat \delta_{yw}^{d'})'$ and $\widehat \theta^{d*}_{yw} := ( \widehat \mu^{d*'}_y, \widehat \nu^{d*'}_w, \widehat \delta^{d*'}_{yw})'$ be the estimator and corresponding bootstrap draw of the parameter $\theta^d_{yw} := ( \mu_y^{d'},\nu_w^{d'},\delta_{yw}^{d'})'$, for $y \in \bar \mathcal{Y}$ and $w \in \bar \mathcal{W}$. Similarly, let $\widehat \xi_y^d := ( \widehat \alpha_y^d,\widehat \mu_y^{d'})'$ and $\widehat \xi_w^d := ( \widehat \alpha_w^d, \widehat \nu_w^{d'})'$ be the estimators of the tail parameters $\xi_y^d := ( \alpha_y^d, \mu_y^{d'})'$ and $\xi_w^d := ( \alpha_w^d, \nu_w^{d'})'$, for $y \in\{\underline{y} , \bar y\}$ and $w \in\{\underline{w} , \bar w\}$, and $\widehat \xi^{d*}_y := ( \widehat \alpha^{d*}_y,\widehat \mu^{d*'}_y)'$ and $\widehat \xi^{d*}_w := ( \widehat \alpha^{d*}_w, \widehat \nu^{d*'}_w)'$ be the corresponding bootstrap draws of the estimators.
Let $Z_n \leadsto Z $ in $\mathbb{D}$ denote weak convergence of a
stochastic process $Z_n$ to a random element $Z$ in a normed space $\mathbb{D
}$, as defined in van1996weak. For example, $\mathbb{D
} = \ell^{\infty}(\bar \mathcal{Y} \bar \mathcal{W})$, the set of measurable and bounded functions on $\bar \mathcal{Y} \bar \mathcal{W}$.
In order to state the results about bootstrap validity formally, we follow the notation and
definitions in van1996weak. Let $D_{n}$ denote the data
vector and $M_{n}$ be the vector of random variables used to generate
bootstrap draws given $D_{n}$. Consider the random element $
\mathbb{Z}^{*}_{n} = \mathbb{Z}_{n}(D_{n}, M_{n})$ in a normed space $
\mathbb{E}$. We say that the bootstrap law of $\mathbb{Z}^{*}_{n}$
consistently estimates the law of some tight random element $\mathbb{Z}$ and
write $\mathbb{Z}^{*}_{n} \leadsto_{{\mathrm{P}}} \mathbb{Z} $ in $\mathbb{D}$
if:
equation[equation omitted — 227 chars of source]
where $\text{BL}_{1}(\mathbb{D})$ denotes the space of functions with
Lipschitz norm at most 1 and ${\mathrm{E}}_{M_{n}}$ denotes the conditional expectation
with respect to $M_{n}$ given the data $D_{n}$; and $ \rightarrow_{{\mathrm{P}}}$ denotes
convergence in (outer) probability.
lemma[FCLT and Bootstrap FCLT for $(\widehat \theta_{yw}^d,\widehat \xi_{\bar y}^d,\widehat \xi_{\underline y}^d,\widehat \xi_{\bar w}^d,\widehat \xi_{\underline w}^d)$] Assume that Assumption (ref) holds. Then, for $d \in \{0,1\}$, (i)
$$
\sqrt{n}(\widehat \theta^d_{yw} - \theta^d_{yw}) \leadsto Z_{yw}^{d\theta} := \sqrt{p_d} \mathbb{G}[\psi_i(\theta^d_{yw})] \text{ in } \ell^{\infty}(\bar \mathcal{Y} \bar \mathcal{W})^{d_{\theta}},
$$
where $\mathbb{G}$ is a Brownian bridge and $\psi_i(\theta^d_{yw}) := H^{yw}(\theta^d_{yw})^{-1} S^{yw}_i(\theta^d_{yw})$ with
\begin{equation}
S^{yw}_i(\theta_{yw}^d) = \left[\begin{array}{c}
\partial_{\mu} \ell_i^y(\mu_y^d) \\
\partial_{\nu} \ell_i^w(\nu_w^d) \\
\partial_{\delta} \ell_i^{yw}(\mu_y^d,\nu_w^d,\delta_{yw}^d)
\end{array}\right],
\end{equation}
and
\begin{equation}
H^{yw}(\theta_{yw}^d) = {\mathrm{E}} \left[\begin{array}{ccc}
\partial_{\mu \mu}\ell_i^y(\mu_y^d) & 0 & 0 \\
0 & \partial_{\nu \nu}\ell_i^w(\nu_w^d) & 0 \\
\partial_{\delta \mu}\ell_i^{yw}(\mu_y^d,\nu_w^d,\delta_{yw}^d) & \partial_{\delta \nu}\ell_i^{yw}(\mu_y^d,\nu_w^d,\delta_{yw}^d) & \partial_{\delta \delta}\ell_i^{yw}(\mu_y^d,\nu_w^d,\delta_{yw}^d)
\end{array}\right];
\end{equation}
and (ii)
$\sqrt{n}(\widehat \xi_r^d - \xi_r^d) \leadsto Z^{d \xi_r}$ in $\mathbb{R}^{d_{\xi_r}}$, for $r \in \{\bar r, \underline r\}$ and $r \in \{y,w\}$, where
$$
Z^{d \xi_r} := \sqrt{p_d} {\mathrm{E}} \left[\begin{array}{cc}
\partial_{\alpha \alpha}\ell_i^{r_0}(\alpha_{\bar r_r}^d, \mu_{\bar r_r}^d) & \partial_{\alpha \mu}\ell_i^{r_0}(\alpha_{\bar r_r}^d, \mu_{\bar r_r}^d)
\\ 0 & \partial_{\mu \mu}\ell_i^y(\mu_{\bar r_r}^d)
\end{array}\right]^{-1}
\mathbb{G} \left[ \begin{array}{c}
\partial_{\alpha}\ell_i^{r_0}(\alpha_{\bar r_r}^d, \mu_{\bar r_r}^d)
\\ \partial_{\mu}\ell_i^r(\mu_{\bar r_r}^d)
\end{array} \right],
$$
has a zero-mean normal distribution.
Moreover, (i) and (ii) hold jointly, and $(Z_{yw}^{0\theta},Z^{0 \xi_{\bar r}},Z^{0 \xi_{\underline r}})$ and $(Z_{yw}^{1\theta},Z^{1 \xi_{\bar r}},Z^{1 \xi_{\underline r}})$ are independent. If in addition Assumption (ref) holds, for $d \in \{0,1\}$, jointly (i$^*$)
$$
\sqrt{n}(\widehat \theta^{d*}_{yw} - \widehat \theta^d_{yw}) \leadsto_{{\mathrm{P}}} Z_{yw}^{d\theta} \text{ in } \ell^{\infty}(\bar \mathcal{Y} \bar \mathcal{W})^{d_{\theta}},
$$
and (ii$^*$) $\sqrt{n}(\widehat \xi^{d*}_r - \widehat \xi^d_r) \leadsto_{{\mathrm{P}}} Z^{d\xi_r}$ in $\mathbb{R}^{d_{\xi_r}}$, for $r \in \{\bar r, \underline r\}$ and $r \in \{y,w\}$.
The quantities of interest are functionals of the joint distribution of $(Y,W)$ conditional on $X$ and the marginal distribution of $X$. To state the results about these functionals it is convenient to introduce some notation. The following definitions apply to all $j,k,l,m \in \{0,1\}$. Let $F^m_X$, $\widehat F^m_X$ and $\widehat F^{m*}_X$ be the joint distribution of $X^m$, empirical counterpart and bootstrap draw; and $F^{(jkl)}_{ywx} := \Phi_2(x'\mu^j_y,x'\nu^k_w;g(x'\delta^l_{yw}))$, $\widehat F^{(j,k,l)}_{ywx} := \Phi_2(x'\widehat \mu^j_y,x'\widehat \nu^k_w;g(x'\widehat \delta^l_{yw}))$ and $\widehat F^{(jkl)*}_{ywx} := \Phi_2(x'\widehat \mu^{j*}_y,x'\widehat \nu^{k*}_w;g(x'\widehat \delta^{l*}_{yw}))$ be the counterfactual conditional distribution, its estimator and bootstrap draw. Consider the empirical processes and their bootstrap draws, $(y,w,x) \mapsto \widehat Z^{(jkl)}_{ywx} := \sqrt{n}(\widehat F^{(jkl)}_{ywx} - F^{(jkl)}_{ywx})$, $(y,w,x) \mapsto \widehat Z^{(jkl)*}_{ywx} := \sqrt{n}(\widehat F^{(jkl)*}_{ywx} - \widehat F^{(jkl)}_{ywx})$, $f \mapsto \widehat G^m_X(f) := \sqrt{n} \int f \mathrm{d} (\widehat F^m_X - F^m_X)$ and $f \mapsto \widehat G^{m*}_X(f) := \sqrt{n} \int f \mathrm{d} (\widehat F^{m*}_X - \widehat F^m_X)$, for $f \in \mathcal{F}$, where $\mathcal{F}$ is a class of measurable functions that (i) includes $F^{(jkl)}_{ywx}$, the indicators of all the rectangles in $\bar{\mathbb{R}}^{d_x+2}$, for $\bar{\mathbb{R}} = \mathbb{R} \cup \{-\infty,+\infty\},$ the extended real line, and (ii) is totally bounded under the metric:
$$
\lambda(f; \tilde f) = \left[\int (f - \tilde f)\mathrm{d} F_X \right]^{1/2}, \quad f,\tilde f \in \mathcal{F}.
$$
For $d \in \{0,1\}$, the selection matrix $\boldsymbol{S}_d^{(jkl)}$ picks up the elements of $Z_{ywx}^{d\theta}$ corresponding to the components used in the construction of the counterfactual conditional distribution. For example, $\boldsymbol{S}_0^{(010)} = {\rm diag}(\boldsymbol{I}_{d_{\mu}},\boldsymbol{0}_{d_{\nu}},\boldsymbol{I}_{d_{\delta}})$ and $\boldsymbol{S}_1^{(010)} = {\rm diag}(\boldsymbol{0}_{d_{\mu}},\boldsymbol{I}_{d_{\nu}},\boldsymbol{0}_{d_{\delta}})$, where $\boldsymbol{0}_{p}$ is a $p\times p$ matrix of zeros and $\boldsymbol{I}_{p}$ is the identity matrix of size $p$.
theorem[FCLT and Bootstrap CLT for $\widehat F^{(jkl)}_{ywx}$ and $\widehat G^m_X(f)$] (i) Assume that Assumption (ref) holds. Then, jointly in $j,k,l,m \in \{0,1\}$,
$$
(\widehat Z_{ywx}^{(jkl)}, \widehat G^m_X(f)) \leadsto (Z^{(jkl)}_{ywx}, G^m_X(f)) \text{ in } \ell^{\infty}(\mathcal{Y}\mathcal{W}\mathcal{X}\mathcal{F}),
$$
where $G^m_X(f) := \sqrt{p_m} \mathbb{G}^m(f)$, with $\mathbb{G}^0$ and $\mathbb{G}^1$ independent, and
$$
Z_{ywx}^{(jkm)} := \partial_{\theta} F^{(jkl)}_{\bar y_y \bar w_w x} \sum_{d \in \{0,1\}} \boldsymbol{S}_d^{(jkl)} Z_{\bar y_y \bar w_w}^{d\theta} + \partial_{\alpha_y} F^{(jkl)}_{\bar y_y \bar w_w x} Z^{j \alpha_{\bar y_y}} 1(y \not\in \bar \mathcal{Y}) + \partial_{\alpha_w} F^{(jkl)}_{\bar y_y \bar w_w x} Z^{k \alpha_{\bar w_w}} 1(w \not\in \bar \mathcal{W}),
$$
with $\partial_{\theta} F^{(jkl)}_{\bar y_y \bar w_w x} := \partial_{\theta} \Phi_2(x'\mu^j_{\bar y_y},x'\nu^k_{\bar w_w};g(x'\delta^l_{\bar y_y \bar w_w}))$, $\partial_{\alpha_y} F^{(jkl)}_{\bar y_y w x} := \partial_{\alpha_{\bar y_y} }\Phi_2(\alpha^j_{\bar y_y}(y - \bar y_y) + x'\mu^j_{\bar y_y},x'\nu^k_w;g(x'\delta^l_{yw}))
$, $
\partial_{\alpha_w} F^{(jkl)}_{y \bar w_w x} := \partial_{\alpha_{\bar w_w} }\Phi_2( x'\mu^j_{y},\alpha^l_{\bar w_w}(w - \bar w_w) + x'\nu^l_{\bar w_w};g(x'\delta^l_{yw}))
$, $Z^{d\alpha_{r}} := e_1'Z^{d\xi_{r}}$ for $r \in \{y,w\}$ and $d \in \{0,1\}$, $e_1$ is a unitary vector with a one in the first position,
and
$Z_{yw}^{d\theta}$, $Z^{d\xi_y}$ and $Z^{d\xi_w}$ are defined in Lemma (ref). (ii) If in addition Assumption (ref) holds, then, jointly in $j,k,l,m \in \{0,1\}$,
$$
(\widehat Z^{(jkl)*}_{ywx}, \widehat G^{m*}_Z(f)) \leadsto_{{\mathrm{P}}} (Z^{(jkl)}_{ywx}, G^m_Z(f)) \text{ in } \ell^{\infty}(\mathcal{Y}\mathcal{W}\mathcal{X}\mathcal{F}).
$$
Let
$$
\widehat F_{Y,W}^{(j,k,l,m)}(y,w) = \dfrac{1}{n_m} \sum_{i=1}^{n_m} \Phi_2(X_i^{m'}\widehat \mu_y^j, X_i^{m'}\widehat \nu_w^k;g(X_i^{m'}\widehat \delta^l_{yw})),
$$
be an estimator of the counterfactual joint distribution in (ref) and
$$
\widehat F_{Y,W}^{*(j,k,l,m)}(y,w) = \dfrac{1}{n_m} \sum_{i=1}^{n_m} \omega_{in_m}^m \Phi_2(X_i^{m'}\widehat \mu_y^{j*}, X_i^{m'}\widehat \nu_w^{k*};g(X_i^{m'}\widehat \delta^{l*}_{yw})),
$$
be the corresponding bootstrap draw.
The following result follows from Theorem (ref), Lemma D.1 of Chernozhukov2013inference, which establish the Hadamard differentiability of the counterfactual map, and the functional delta method.
corollary[FCLT and Bootstrap FCLT for $\widehat F_{Y,W}^{(j,k,l,m)}$] Under the assumptions of Theorem (ref), jointly for $i,j,k,l \in \{0,1\}$,
$$
\sqrt{n}(\widehat F_{Y,W}^{(j,k,l,m)}(y,w) - F_{Y,W}^{(j,k,l,m)}(y,w)) \leadsto Z_{yw}^{(j,k,l,m)} := \int Z_{ywx}^{(jkl)} {\mathrm{d}} F^m_{X}(x) + G^m_X(F^{(jkl)}_{ywx}) \text{ in $\ell^{\infty}(\mathcal{Y}\mathcal{W})$},
$$
and
$$
\sqrt{n}(\widehat F_{Y,W}^{*(j,k,l,m)}(y,w) - \widehat F_{Y,W}^{(j,k,l,m)}(y,w)) \leadsto_{{\mathrm{P}}} Z_{yw}^{(j,k,l,m)} \text{ in $\ell^{\infty}(\mathcal{Y}\mathcal{W})$}.
$$
comment\begin{remark}[Counterfactual Distribution]
In the case of the counterfactual distributions defined in Comment (ref),
$$
\pi_x = \dfrac{[1-{\mathrm{P}}(D=1 \mid X=x)] {\mathrm{P}}(D=1)}{{\mathrm{P}}(D=1 \mid X=x) [1-{\mathrm{P}}(D=1)]}.
$$
An estimator of $\pi_x$ that satisfies the conditions of the theorem can be formed by modeling and estimating ${\mathrm{P}}(D=1 \mid X=x)$ using a binary response model such as probit or logit, and estimating ${\mathrm{P}}(D=1)$ by the empirical probability of $D=1$. The assumption $\pi_x \in \ell^{\infty}(\mathcal{X})$ requires that ${\mathrm{P}}(D=1 \mid X=x) >0$, which is a standard common support condition.
\end{remark}
commentLet $\widehat \tau_W := 4{\mathbb{E}_n} (\widehat F_{Y_i W_i X_i})-1$ and $\widehat \tau^*_W := 4{\mathbb{E}_n} (\omega_{ni} \widehat F^*_{Y_i W_i X_i})-1$ be the estimator and bootstrap draw of the average within-group Kendall coefficient $\tau_W := 4{\mathrm{E}} (F_{Y W X})-1$, where ${\mathbb{E}_n}$ denotes the empirical expectation, i.e. ${\mathbb{E}_n} := n^{-1} \sum_{i=1}$; and $\widehat \tau^{\pi}_W := 4{\mathbb{E}_n} (\widehat F^{\pi}_{Y_i W_i X_i})-1$ and $\widehat \tau^{\pi *}_W := 4{\mathbb{E}_n} (\omega_{ni} \widehat F^{\pi *}_{Y_i W_i X_i})-1$ be the estimator and bootstrap draw of the counterfactual average within-group Kendall coefficient $\tau^{\pi}_W := 4{\mathrm{E}} (F^{\pi}_{Y W X})-1$.
\begin{corollary}[CLT and Bootstrap CLT for $\widehat \tau_W$ and $\widehat \tau_W^{\pi}$] Under the assumptions of Theorem (ref)(i),
$$
\sqrt{n}(\widehat \tau_W - \tau_W, \widehat \tau_W^{\pi} - \tau_W^{\pi}) \leadsto 4 (Z^{\tau_W}, Z^{\tau_W^{\pi}}) \text{ in } \mathbb{R}^2,
$$
where
$$
Z^{\tau_W} := \int Z_{ywx}^{F} F_{Y,W,X}({\mathrm{d}} y,{\mathrm{d}} w,{\mathrm{d}} x) + G_Z(F_{ywx}) \text{ and } Z^{\tau_W^{\pi}} := \int Z_{ywx}^{F^{\pi}} F_{Y,W,X}({\mathrm{d}} y,{\mathrm{d}} w,{\mathrm{d}} x) + G_Z(F^{\pi}_{ywx}),
$$
are zero-mean Gaussian random variables. If in addition the assumptions of Theorem (ref)(ii) hold,
$$
\sqrt{n}(\widehat \tau^*_W - \widehat \tau_W, \widehat \tau_W^{\pi *} - \widehat \tau_W^{\pi}) \leadsto_{{\mathrm{P}}} 4(Z^{\tau_W}, Z^{\tau_W^{\pi}}) \text{ in } \mathbb{R}^2.
$$
\end{corollary}
comment\subsection{Model} We model the bivariate distribution of two outcome variables, $C$ and $F$, conditional on a vector of covariates $X$. We do so by employing a result from Chernozhukov2018distribution, which establishes that any conditional joint distribution can be written in a local Gaussian representation (LGR). Formally, this can be expressed as:
\begin{align}
F_{C,F \mid X} (c,f \mid x) = \Phi_2(\mu(c \mid x), \nu(f \mid x); \rho(c,f \mid x)),
\end{align}
where $\mu$, $\nu$ and $\rho$ are some functions and $\Phi_2$ denotes the standard bivariate normal distribution. The LGR, the right-hand side of equation (ref), is unique implying a one-to-one mapping between the conditional distribution and its LGR. In this setting, the conditional marginal distributions can be represented by nonparametric distribution regression models, i.e:
\begin{align}
F_{C \mid X}(c \mid x) = \Phi(\mu(c \mid x)), \quad F_{F \mid X}(f \mid x) = \Phi(\nu(f \mid x))
\end{align}
where $\Phi$ denotes the standard normal distribution. We propose replacing the nonparametric functions $\mu$, $\nu$, and $\rho$ with generalized linear indices. This is equivalent to modeling the joint distribution using the following bivariate distribution regression (BDR) approach:
\begin{align}
F_{C,F \mid X} (c,f) = \Phi_2\left( x'\beta(c), x'\theta(f), \rho(x'\delta(c,f))\right),
\end{align}
where $\beta$, $\theta$, and $\delta$ are coefficient vectors that are allowed to vary across the distribution. Analogous to equation (ref), the marginals are implied by $F_{C \mid X} (c \mid x) = \Phi\left( x'\beta(c)\right)$ and $F_{F \mid X} (f \mid x) = \Phi\left( x'\theta(f)\right)$. Furthermore, $u \mapsto \rho(u)$ is a known link function with range $[-1,1]$ such as the Fisher transformation $\rho(u) = \tanh(u)$.
The modeling approach in (ref) entails at least three attractive features. First, the BDR model is semiparametric thereby ensuring a high degree of flexibility. This reflects that each covariate can affect the marginal and joint distributions differently at every ($c$,$f$). Second, the marginals and the dependence structure can be separated. This is beneficial to assessing how $\rho(\cdot)$ varies across the distribution and with each of the covariates. Finally, with estimates of $\beta$, $\theta$, and $\delta$, it is straightforward to compute the implied distribution and to conduct insightful decomposition exercises. For instance, imposing $\rho(x'\delta(c,f)) = \rho(\delta(c,f))$ offers a tractable way to analyze how strongly unobservables affect the dependence. Alternatively, by setting $\rho(x'\delta(c,f))=0$, we obtain the distribution where the dependence is only a result of the marginals. This distribution will serve as a valuable benchmark case.
{\color[rgb]{0,0.501961,0} I do not understand why we use Y and W instead of C and F. Why not use Y and W everywhere????? Also many thanks are duplicated here. }To estimate counterfactuals and decompositions of Kendall coefficients, we need to model and estimate $F_{Y,W \mid X}$, the joint distribution of $(Y,W)$ conditional on $X$. We model this distribution using the bivariate distribution regression (BDR) model:
\begin{equation}
F_{Y,W \mid X}(y,w \mid x) = \Phi_2(x'\mu(y), x'\nu(w); g(x'\delta(y,w))),
\end{equation}
where $\Phi_{2}(\cdot, \cdot; \rho)$ is the distribution of the standard bivariate normal with parameter $\rho$, and $u \mapsto g(u)$ is a known link function with range $[-1,1]$ such as the Fisher transformation $g(u) = \tanh(u)$. Let $\bar \mathcal{Y}$ and $\bar \mathcal{W}$ denote strict subsets of $\mathcal{Y}$ and $\mathcal{W}$, the supports of $Y$ and $W$, respectively. We impose the following restrictions on the coefficients at the tails
$$
\mu_{1}(y) = \mu_{1}(\bar y) + (y - \bar y)\alpha(\bar y), \quad \mu_{-1}(y) = \mu_{-1}(\bar y),\quad y \in \mathcal{Y} \setminus\bar{\mathcal{Y}},
$$
$$
\nu_{1}(w) = \nu_{1}(\bar w) + (w - \bar w)\gamma(\bar w), \quad \nu_{-1}(w) = \nu_{-1}(\bar w),\quad w \in \mathcal{W} \setminus\bar{\mathcal{W}},
$$
and
$$
\delta(y,w) = \delta(\bar y, \bar w),\quad y \in \mathcal{Y} \setminus\bar{\mathcal{Y}}, \quad w \in \mathcal{W} \setminus\bar{\mathcal{W}},
$$
where $\bar y := \arg \min_{y' \in \bar{\mathcal{Y}}} |y-y'|$, $\alpha(\bar y) > 0$, $\bar w := \arg \min_{w' \in \bar{\mathcal{W}}} |w-w'|$, $\gamma(\bar w) > 0$, and the subscript $1$ and $-1$ denote the first element of a vector and its complement. For example, $\mu_1(y)$ is the first element of $\mu(y)$ and $\mu_{-1}(y)$ is a vector with the rest of the elements.
In the BDR model the marginal distributions of $Y$ and $W$ conditional on $X$ follow distribution regression models:
$$
F_{Y \mid X}(y \mid x) = \Phi(x'\mu(y)), \quad F_{W\mid X}(w \mid x) = \Phi(x'\nu(w)),
$$
where $\Phi$ is the distribution of the standard normal. The function $(y,w,x) \mapsto g(x'\delta(y,w))$ measures the local dependence or sorting between $Y$ and $W$ at $(Y,W,X) = (y,w,x)$. This sorting can vary with respect to observed covariates $X$, and along the distribution as indexed by $(y,w)$. The simplest case is $g(x'\delta(y,w)) = g(\delta(y,w))$, where the sorting only varies with respect to unobservables.
The BDR model can be motivated by the local Gaussian representation (LGR) of Chernozhukov2018distribution, which establishes that for any conditional joint distribution,
$$
F_{Y,W \mid X}(y,w \mid x) = \Phi_2(\mu(y \mid x), \nu(w \mid x); \rho(y,w \mid x)),
$$
for some functions $\mu$, $\nu$ and $\rho$. The LGR is the right-hand-side of the previous equation and is unique, that is there is a one-to-one mapping between a conditional joint distribution and its LGR. In the LGR the marginal distributions of $Y$ and $W$ conditional on $X$ are represented by nonparametric distribution regression models, that is
$$
F_{Y \mid X}(y \mid x) = \Phi(\mu(y \mid x)), \quad F_{W \mid X}(w \mid x) = \Phi(\nu(w \mid x)).
$$
The BDR model can be seen as a semiparametric specification for the LGR where the nonparametric functions $\mu$, $\nu$ and $\rho$ are replaced by (generalized) linear indices.
\subsection{Average Conditional Kendall}
{\color[rgb]{0,0.501961,0} Notation below is inconsistent with the rest of the paper????}
The conditional Kendall coefficient between $Y$ and $W$ given $X=x$ can be expressed as
\begin{multline*}
\tau(x) = 2{\mathrm{P}}[(Y-\tilde Y)(W - \tilde W) > 0 \mid X=x] - 1 = 4{\mathrm{E}}[1(Y >\tilde Y, W > \tilde W) \mid X=x] - 1 \\ = 4 {\mathrm{E}}\left[ F_{Y,W \mid X}(Y,W \mid X) - 1/4 \mid X=x\right] = 4 \int F_{Y,W \mid X}(y,w \mid x) F_{Y,W \mid X}({\mathrm{d}} y,{\mathrm{d}} w \mid x) - 1,
\end{multline*}
where $(Y,W)$ and $(\tilde Y,\tilde W)$ are independent and identically distributed conditional on $X$. The coefficient $\tau(x)$ measures the association between $Y$ and $W$ within the group defined by $X=x$. The interpretation of $\tau(x)$ is similar to $\tau$, although $\tau(x)$ might change with the value of $x$. A summary measure of within-group association is the average conditional Kendall coefficient between $Y$ and $W$ given $X$,
$$
\tau_W = {\mathrm{E}}[\tau(X)] = \int \tau(x) {\mathrm{d}} F_X(x) =4 \int F_{Y,W \mid X}(y,w \mid x) F_{Y,W, X}({\mathrm{d}} y,{\mathrm{d}} w, {\mathrm{d}} x) - 1,
$$
where $F_{Y,W, X}$ is the joint distribution of $(Y,W,X)$.
We can define other counterfactual Kendall coefficients in the BDR model. For example, let
$$
\tau_W = \tau(\mu,\nu,\delta,F_X) = 4 \int \Phi_2(x'\mu(y), x'\nu(w); g(x'\delta(y,w))) F_{Y,W \mid X}({\mathrm{d}} y, {\mathrm{d}} w \mid x) {\mathrm{d}} F_X(x) - 1.
$$
Then the counterfactual average within-group Kendall coefficient under $(\tilde \mu,\tilde \nu,\tilde \delta,\tilde F_X)$ is
$$
\tau_W(\tilde \mu,\tilde \nu,\tilde \delta,\tilde F_X) = 4 \int \Phi_2(x'\tilde \mu(y), x'\tilde \nu(w); g(x'\tilde \delta(y,w))) \tilde F_{Y,W \mid X}({\mathrm{d}} y, {\mathrm{d}} w \mid x) {\mathrm{d}} \tilde F_X(x) - 1,
$$
where
$$
\tilde F_{Y,W \mid X}(y, w \mid x) = \Phi_2(x'\tilde \mu(y), x'\tilde \nu(w); g(x'\tilde \delta(y,w))).
$$
We can use these counterfactual distributions to decompose the difference between the average within-group Kendall coefficient of two groups, say $D=0$ and $D=1$, as
\begin{multline*}
\tau_W(\mu^1,\nu^1,\delta^1,F_X^1) - \tau_W(\mu^0,\nu^0,\delta^0,F_X^0) = [\tau_W(\mu^1,\nu^1,\delta^1,F_X^1) - \tau_W(\mu^1,\nu^1,\delta^1,F_X^0)] \\ + [\tau_W(\mu^1,\nu^1,\delta^1,F_X^0) - \tau_W(\mu^1,\nu^1,\delta^0,F_X^0)] + [\tau_W(\mu^1,\nu^1,\delta^0,F_X^0) - \tau_W(\mu^0,\nu^0,\delta^0,F_X^0)],
\end{multline*}
where the three terms on the right-hand side correspond to components explained by differences in composition, sorting and marginals, respectively.
To facilitate estimation, some of the terms of the previous expression can be rewritten in terms of the propensity score. For example,
\begin{multline*}
\tau_W(\mu^1,\nu^1,\delta^1,F_X^0) \\= 4 \int \Phi_2(x'\mu^1(y), x'\nu^1(w); g(x' \delta^1(y,w))) \frac{{\mathrm{P}}(D=0 \mid X=x) {\mathrm{P}}(D=1)}{{\mathrm{P}}(D=1 \mid X=x) {\mathrm{P}}(D=0)} F^1_{Y,W, X}({\mathrm{d}} y, {\mathrm{d}} w, {\mathrm{d}} x) - 1.
\end{multline*}
In related work, Meier2020 and Wang2022 employ univariate DR to provide estimates of the joint distribution. Meier2020, extends univariate DR to the multivariate setting by using a multivariate indicator function at every location of the distribution. In the bivariate case, this implies the estimation of $c \cdot f$ single DRs - a flexible but computationally costly approach. {\color[rgb]{0,0.501961,0} ?????}Wang2022 propose a fast factorization approach that also employs univariate DRs. These approaches are potentially restrictive as they require a single outcome variable to be discrete and this abstracts from interaction effects between the covariates and the discrete outcome. In contrast, BDR enables the explicit analysis of the local dependence structure. Furthermore, the choice of the link function in Meier2020 and Wang2022 might provide a poor approximation to the underlying distribution. With BDR, the LGR in (ref) guarantees that the joint distribution is, locally, Gaussian.
\subsection{Estimation} The proposed estimator is a variation of the DR probit estimator. However, rather than estimating a sequence of probit models to trace out the conditional distribution, BDR estimates a sequence of bivariate probits models to trace out the conditional bivariate distribution. Let $I^c = 1(C \leqslant c)$ and $J^f = (F \leqslant f)$ for $(c,f) \in I$, where $I$ is a grid of points in the support of $(C,F)$. Under the BDR model, the joint probability function of $I^c$ and $J^f$ conditional on $X$ is
\begin{align}
f_{I^c,J^f \mid X}(i,j \mid x, \beta(c),\theta(f), \delta(c,f)) &=
\Phi_{2}(x'\beta(c), x'\theta(f); \rho(x'\delta(c,f)))^{ij} \nonumber \\
&\times \Phi_{2}(x'\beta(c), -x'\theta(f); -\rho(x'\delta(c,f)))^{i(1-j)} \nonumber \\
&\times \Phi_{2}(-x'\beta(c), x'\theta(f); -\rho(x'\delta(c,f)))^{(1-i)j} \nonumber \\
&\times \Phi_{2}(-x'\beta(c), -x'\theta(f); \rho(x'\delta(c,f)))^{(1-i)(1-j)} 1(i,j \in \{0,1\}).
\end{align}
Given a random sample of size $n$, $\{(C_i,F_i,X_i)\}_{=1}^n$, the average conditional log-likelihood is
\begin{align}
\ell^{c,f}(\beta,\theta,\delta) = \frac{1}{n} \sum_{i=1}^n f_{I^c,J^f \mid Z}(I_i^c, J_i^f \mid X_i, \beta,\theta, \delta),
\end{align}
The conditional maximum likelihood estimator (CMLE) of $(\beta(c),\theta(f), \delta(c,f)$ is
\begin{align}
(\widehat \beta(c),\widehat \theta(f),\widehat \delta(c,f)) \in \arg\max_{\beta,\theta,\delta} \ell^{c,f}(\beta,\theta,\delta).
\end{align}
Several remarks regarding the computation should be made. First, when $\rho(x'\delta(h,w)) = \rho(\delta(h,w))$, the CMLE is the bivariate probit estimator of $(I^h,J^w)$ on $X$. Second, the CMLE can be computed in two steps. In the first step, we obtain the estimators of $\beta(c)$ and $\theta(f)$ by probit distribution regression of $I^c$ on $X$ and $J^f$ on $X$, respectively. In the second step, we plug in the estimators of $\beta(c)$ and $\theta(f)$ from the first step in the average log-likelihood and maximize with respect to $\delta$, that is
\begin{align}
\widehat \delta(c,f) \in \arg\max_{\delta} \ell^{c,f}(\widehat \beta(c),\widehat \theta(f),\delta),
\end{align}
where $\widehat \beta(c)$ and $\widehat \theta(f)$ are the distribution regression estimators of $\beta(c)$ and $\theta(f)$. Finally, to trace the joint and marginal distributions of $C$ and $F$, we need to obtain the CMLE for a grid of values of $(c,f)$ in the support of $(C,F)$. For example, we can use the tensor product of two grids for $C$ and $F$, including sampling percentiles from the $1$ or $2\%$ to the $99$ or $98\%$.
{\color[rgb]{0,0.501961,0} From here notation changes again back to Y and W.}
\begin{algorithm}[BDR Estimator] Let $d_x := \dim X$, $\mathbb{R}_n$ denote the set containing the observed values of $R$ and $\bar{\mathbb{R}}_n = \mathbb{R}_n \cap \bar{\mathbb{R}}$, for $R \in \{Y,W\}$.
\begin{enumerate}
• Estimate $\mu_y$ at $y \in \bar{\mathcal{Y}}_n$ and $\nu_w$ at $w \in \bar{\mathcal{W}}_n$ by DR, that is,
$$
\widehat \mu_y \in \arg\max_{\mu \in \mathbb{R}^{d_x}} \ell^y(\mu) = {\mathbb{E}_n} [ \ell_i^{y}(\mu)], \quad \ell_i^{y}(\mu) := I_i^y \log \Phi(X_i'\mu) + \bar I_i^y \log \Phi(-X_i'\mu),
$$
and
$$
\widehat \nu_w \in \arg\max_{\nu \in \mathbb{R}^{d_x}} \ell^w(\mu) = {\mathbb{E}_n}[ \ell_i^{w}(\nu)], \quad \ell_i^{w}(\mu) := J_i^w \log \Phi(X_i'\nu) + \bar J_i^w \log \Phi(-X_i'\nu).
$$
• Estimate $\mu_y$ at $y \in \mathcal{Y}_n \setminus \bar{\mathcal{Y}}_n$ and $\nu_w$ at $w \in \mathcal{W}_n \setminus \bar{\mathcal{W}}_n$ by restricted DR, that is,
\begin{equation*}
\begin{split}
\widehat \mu_y = (y -\bar y)\widehat \alpha_{\bar y} + x'\widehat \mu_{\bar y} and \widehat \nu_y = (w -\bar w)\widehat \alpha_{\bar w} + x'\widehat \nu_{\bar w},
\end{split}
\end{equation*}
where $\bar y := \arg \min_{y' \in \bar{\mathcal{Y}}_n} |y-y'|$, $\bar w := \arg \min_{w' \in \bar{\mathcal{W}}_n} |w-w'|$,
\begin{equation*}
\begin{split}
\widehat \alpha_{\bar y} & \in \arg\max_{a \in \mathbb{R}} {\mathbb{E}_n}[ \ell_i^{y_0}(a,\widehat \mu_{\bar y})], \\
\ell_i^{y_0}(a,\mu) & := \left[ I_i^{y_0} \log \Phi((y_0-\bar y)a + X_i' \mu) + \bar I_i^{y_0} \log \{\Phi(-(y_0-\bar y)a - X_i'\mu)\right],
\end{split}
\end{equation*}
\begin{equation*}
\begin{split}
\widehat \alpha_{\bar w} & \in \arg\max_{a \in \mathbb{R}} {\mathbb{E}_n} [\ell_i^{w_0}(a,\widehat \nu_{\bar w})],
\\ \ell_i^{w_0}(a,\nu) & := \left[ J_i^{w_0} \log \Phi((w_0-\bar w)a + X_i'\nu) + \bar J_i^{w_0} \log \{\Phi(-(w_0-\bar w)a - X_i'\nu)\right],
\end{split}
\end{equation*}
and, for $r \in \{y,w\}$ and $\mathcal{R} \in \{\mathcal{Y},\mathcal{W}\},$ $r_0 \in \mathbb{R}_n \setminus \bar{\mathbb{R}}_n$ is such that (i) there are at least $m$ observations between $\bar r$ and $r_0$, and greater than $r_0$ if $r_0 > \bar r$ (upper tail) or less than $r_0$ if $r_0 < \bar r$ (lower tail), and (ii) $\widehat \alpha_{\bar r} > 0$.
• Estimate $\delta_{yw}$ at $(y,w) \in \bar{\mathcal{Y}}_n \times \bar{\mathcal{W}}_n$ by restricted BDR, that is,
$$
\widehat \delta_{yw} \in \arg\max_{\delta \in \mathbb{R}^{d_x}} \ell^{yw}(\widehat \mu_y,\widehat \nu_w,\delta) = {\mathbb{E}_n}[ \ell_i^{yw}(\widehat \mu_y,\widehat \nu_w,\delta)],
$$
where
\begin{eqnarray*}
\ell_i^{yw}(\mu,\nu,\delta) &=& I_i^y J_i^w \log \Phi_{2}(X_i'\mu, X_i'\nu; g(X_i'\delta) + I_i^y \bar J_i^w \log \Phi_{2}(X_i'\mu, -X_i'\nu; -g(X_i'\delta) \\ &+& \bar I_i^y J_i^w \log \Phi_{2}(-X_i'\mu, X_i'\nu; -g(X_i'\delta)) + \bar I_i^y \bar J_i^w \log \Phi_{2}(-X_i'\mu, -X_i'\nu; g(X_i'\delta)).
\end{eqnarray*}
• Estimate $\delta_{yw}$ at $(y,w) \in (\mathcal{Y}_n\setminus \bar{\mathcal{Y}}_n) \times (\mathcal{W}_n\setminus\bar{\mathcal{W}}_n)$ by imposing the tail restrictions, that is,
$$
\widehat \delta_{yw} = \widehat \delta_{\bar y \bar w},
$$
where $\bar y := \arg \min_{y' \in \bar{\mathcal{Y}}_n} |y-y'|$ and $\bar w := \arg \min_{w' \in \bar{\mathcal{W}}_n} |w-w'|$
\end{enumerate}
\end{algorithm}
We can use a weighted bootstrap algorithm to perform inference based on the estimators described in Algorithm (ref).
\begin{algorithm}[Exchangeable Bootstrap Draw of BDR Estimator]
\begin{enumerate}
• Draw a realization of the weights $(\omega_{n1},\ldots,\omega_{nn})$ independent and identically from the standard exponential distribution, independently for the data.. Normalize the weights to add-up to one.
• Obtain bootstrap draw of $\widehat \mu_y$ at $y \in \bar{\mathcal{Y}}_n$ and $\widehat \nu_w$ at $w \in \bar{\mathcal{W}}_n$ by weighted DR, that is,
$$
\widehat \mu^*_y \in \arg\max_{\mu \in \mathbb{R}^{d_x}} \ell_*^y(\mu) = {\mathbb{E}_n} [\omega_{ni} \ell_i^{y}(\mu)], \quad
\widehat \nu^*_w \in \arg\max_{\nu \in \mathbb{R}^{d_x}} \ell_*^w(\mu) = {\mathbb{E}_n} [\omega_{ni} \ell_i^{w}(\nu)].
$$
• Obtain a bootstrap draw of $\widehat \mu_y$ at $y \in \mathcal{Y}_n \setminus \bar{\mathcal{Y}}_n$ and $\widehat \nu_w$ at $w \in \mathcal{W}_n \setminus \bar{\mathcal{W}}_n$ by weighted restricted DR, that is,
$$
\widehat \mu^*_y = (y -\bar y)\widehat \alpha^*_{\bar y} + x'\widehat \mu^*_{\bar y} \text{ and } \widehat \nu^*_y = (w -\bar w)\widehat \alpha^*_{\bar w} + x'\widehat \nu^*_{\bar w},$$ where $\bar y := \arg \min_{y' \in \bar{\mathcal{Y}}_n} |y-y'|$, $\bar w := \arg \min_{w' \in \bar{\mathcal{W}}_n} |w-w'|$,
\begin{equation*}
\widehat \alpha^*_{\bar y} \in \arg\max_{a \in \mathbb{R}} {\mathbb{E}_n} [ \omega_{ni} \ell_i^{y_0}(a,\widehat \mu^*_{\bar y})], \quad
\widehat \alpha^*_{\bar w} \in \arg\max_{a \in \mathbb{R}} {\mathbb{E}_n} [\omega_{ni} \ell_i^{w_0}(a,\widehat \nu^*_{\bar w})],
\end{equation*}
and, for $r \in \{y,w\}$ and $\mathcal{R} \in \{\mathcal{Y},\mathcal{W}\},$ $r_0 \in \mathbb{R}_n \setminus \bar{\mathbb{R}}_n$ is the same as in Algorithm (ref)(2).
• Obtain a bootstrap draw of $\widehat \delta_{yw}$ at $(y,w) \in \bar{\mathcal{Y}}_n \times \bar{\mathcal{W}}_n$ by weighted restricted BDR, that is,
$$
\widehat \delta^*_{yw} \in \arg\max_{\delta \in \mathbb{R}^{d_x}} \ell_*^{yw}(\widehat \mu_y,\widehat \nu_w,\delta) = {\mathbb{E}_n} [\omega_{ni} \ell_i^{yw}(\widehat \mu_y,\widehat \nu_w,\delta)].
$$
• Obtain bootstrap draw of $\widehat \delta_{yw}$ at $(y,w) \in (\mathcal{Y}_n\setminus \bar{\mathcal{Y}}_n) \times (\mathcal{W}_n\setminus\bar{\mathcal{W}}_n)$ by imposing the tail restrictions, that is,
$$
\widehat \delta^*_{yw} = \widehat \delta^*_{\bar y \bar w},
$$
where $\bar y := \arg \min_{y' \in \bar{\mathcal{Y}}_n} |y-y'|$ and $\bar w := \arg \min_{w' \in \bar{\mathcal{W}}_n} |w-w'|$
\end{enumerate}
\end{algorithm}
Let $D_i$ denote the indicator function that equals 1 if individual $i$ belongs to group 1. The counterfactual average within-group Kendall coefficient under $(\tilde \mu,\tilde \nu,\tilde \delta,\tilde F_X) = (\mu^1,\nu^1,\delta^1,F_{X\mid D=0})$ can be estimated by
$$
\widehat \tau_W(\mu^1,\nu^1,\delta^1,F_{X\mid D=0}) = \frac{4}{n_1} \sum_{i=1}^n 1(D_i = 1)\Phi_2(X_i'\widehat \mu^1(Y_i), X_i'\widehat \nu^1(W_i); g(X_i'\widehat \delta^1(Y_i,W_i))) \frac{(1-\widehat p(X_i)) \widehat p}{\widehat p(X_i)(1- \widehat p)} - 1,
$$
where $\widehat p = n_1/n$ and $\widehat p(x)$ is an estimator of ${\mathrm{P}}(D = 1 \mid X=x)$.
\subsection{Functionals}
Ideally we will take advantage of the rich information that the bivariate distribution provides. In particular, we want to move beyond univariate statistics such as averages and variances, which are trivially implied by the joint distribution. While all the objects which are available in the univariate setting can also be obtained here, we focus on functionals which highlight the dependence structure which we uncover in the data. Accordingly, the parameter $\rho$ features prominently in each of the objects that we define in what follows. {\color[rgb]{0,0.501961,0} ?????}
\begin{align}
F_{C|Q_{j} < F < Q_{k}}(c) &= \frac{F_{C,F}(C,Q_{k}(F))(c,f) - F_{C,F}(C,Q_{j}(F))(c,f)}{F_{C,F}(\infty,Q_{k}(F))(c,f) - F_{C,F}(\infty,Q_{j}(F))(c,f)}
\end{align}
where $Q_{j}(F)$ and $Q_{k}(F)$ are the j-th and k-th percentile of the fathers' income distribution. Each children's bracket CDF implies an average income and thus average quantile (evaluated at the unconditional marginal distribution). Thus, a classical rank-rank regression can be performed, generalizing approaches as in Chetty2014. Most notably, the advantage of this technique is that the covariates were allowed to flexibly affect the joint distribution instead of subsampling the data. To see the connection, suppose we set the quantiles to all percentiles of the unconditional father's distribution. As a result, we obtain 99 marginal CDFs for the children, one for each percentile range. Trivially, these CDFs imply an average, i.e. $\mu_{C|Q_{j} < F < Q_{k}} = \int C d F_{C|Q_{j} < F < Q_{k}} $. Finally, it is straightforward to compare the latter to the unconditional ranks of the childrens distribution and deduce the corresponding average rank.
\subsection{Counterfactual Distributions} Before turning to counterfactual distributions, it is instructive to introduce the unconditional distribution $U_{C, F} (c,f)$. The latter is obtained by plugging in the estimated coefficients and integrating over the observed covariate distribution, i.e.,
\begin{align}
U_{C,F} (c,f) = \int \Phi_2\left( x'\widehat{\beta}(c), x'\widehat{\theta}(f), \rho(x'\widehat{\delta}(c,f))\right) d\widehat{F}_X.
\end{align}
Note that this distribution is equivalent to an average and thus no longer depends on $X$. In principle, it is feasible to obtain various counterfactuals (see section 3.3 in Chernozhukov2013inference for an overview). In the context of this analysis, we assess the effect of the covariates by artificially altering their distribution. For instance, in the context of our empirical example, consider a categorical variable $MS$ indicating a father's marital state. Assume our objective is to consider how fathers' marital status affects the distribution. We first set $MS$ equal to either one (married) or two (divorced) for all observations. Denote these modified regressor matrices by $X_{ms=1}$ and $X_{ms=2}$, respectively. Then, the distribution given fathers would be married is
\begin{align}
F_{C,F \mid MS=1} (c,f) = \int \Phi_2\left( x'\widehat{\beta}(c), x'\widehat{\theta}(f), \rho(x'\widehat{\delta}(c,f))\right) d\widehat{F}_{X_{ms=1}}.
\end{align}
Analogously, we obtain $F_{C,F \mid MS=2} (c,f)$ and can compare these distributions by applying the functionals discussed in the following subsection.
In addition to the covariates' effects on the distribution as a whole, we investigate the role of the local Gaussian correlation $\rho(x'\delta(c,f))$. Whereas the counterfactual distributions outlined above could be estimated using other models of the bivariate CDF, only BDR enables an analysis of $\rho(x'\delta(c,f))$. In doing so, we consider two additional distributions. First we impose $\rho(x'\delta(c,f)) = 0$ which eliminates the dependence across outcomes after conditioning on the covariates. Second, we set $\rho(x'\delta(c,f)) = \rho(\delta(c,f))$ which explores how this dependence varies across covariates. Integrating over the observed covariate distribution as in equation (ref), let us denote the resulting CDFs by $Z_{C, F} (c,f)$ (local correlation of zero) and $R_{C, F} (c,f)$ (restricted local correlation). Comparing $Z_{C, F} (c,f)$ and $R_{C, F} (c,f)$ enables us to answer how much of the dependence is due to $\rho(\delta(c,f))$. Building on this and relating $R_{C, F} (c,f)$ to $U_{C, F} (c,f)$, we can track how much of the local Gaussian correlation can be explained by covariates.
As we discuss below, the role of $\rho(x'\delta(c,f))$ can be of substantial interest in empirical investigations. For example, we may be interested in how the joint distribution of two outcomes is driven by the covariates and unobservables respectively. Below, we focus on mobility as reflected by the joint distribution of father's and children's income. Understanding how mobility is driven by correlated unobservable characteristics in addition to observed characteristics is an important policy issue.
\subsection{Inference}
Empirical Illustration
We now employ BDR to study intergenerational income mobility. BDR is a particularly useful and powerful tool for this area of research since it can model the joint distribution of incomes for different generations of family members.
We focus on the joint distribution of a child’s and their father's labor incomes. We begin by documenting the raw data. This provides some insight into the presence of intergenerational mobility in these data. We then employ BDR to estimate the joint conditional distribution of these two outcomes conditional on covariates for both the child and the father.
We examine the role of the estimated local dependence parameter in generating these observed outcomes. Finally, we decompose the observed differences in dependence between fathers/sons and fathers/daughters into composition, sorting and marginals effects.\footnote{We acknowledge the use of the term "sorting" in this potential empirical context is somewhat inappropriate given that one would not interpret the process by which fathers and children are paired is best characterized by a sorting process. However, we retain this description to avoid the introduction of additional terminology.}
Data
Our analysis examines data from the Panel Study of Income Dynamics (PSID), a rich longitudinal dataset including family and individual-level income data for individuals in the United States since 1968. The survey was conducted yearly until 1997 and biannually thereafter. The PSID has been employed in previous examiniations of intergenerational mobility (see, for example, Callaway2019 or landerso2017scandinavian).
Although the PSID data has 904,796 observations, the number for which we can construct father/children pairs is 6,6767 comprising 3,424 daughters and 3,243 sons.
Our empirical analysis is based on this smaller sample. A pair is included if both the father and the child are observed at least once between the ages of 25 and 50. The outcome variables are their respective average annual labor earnings. This encompasses wages, business income, bonuses, and overtime payments. Labor earnings have been standardized to 1982 dollars. Note that we exclude observations with zero labor income earnings for that year. The average frequency of observations is the same for both father-daughter and father-son pairs. That is, 9 years for children and 15 years for fathers. The equal frequency for males and females is puzzling given the higher labor force participation rates of males. This might reflect the construction of the data set but probably also be due to our relatively weak requirement that the child only needs to be observed with earnings in one year. The higher average annual work hours for sons (2011) than daughters (1540) is consistent with males having a relatively higher level of labor market engagement than females.
The inclusion of only pairs for which both the father and child report labor income may introduce some form of selection bias. Moreover, not accounting for the frequency that the pair is observed may also introduce an additional form of bias. While each of these issues is interesting, we delay their treatment to future work as they are beyond the scope of this paper.
Studies in the literature rely on various income measures to study intergenerational mobility. These include, for example, labor earnings, tax records, or lifetime income imputed over the life cycle. Mogstad2021 note that the estimated degree of mobility can vary considerably depending on the measure used. We focus on labor income, noting that intergenerational persistence tends to be stronger for broader income concepts landerso2017scandinavian.
table[table omitted — 862 chars of source]
The variables displayed in Table (ref) are all available since 1968 with the exception of “college”, which indicates that the individual has a college degree, which is available from 1975. Observations with missing entries for any of the variables are excluded. Table (ref) indicates that the father's information is generally collected during the 1980s, while the children's information is typically gathered in the early 2000s. Fathers are observed later in life, mostly between the ages of 34 and 47, while children are observed earlier between the ages of 27 and 36. This also explains the large difference in labor income in favor of fathers. Unsurprisingly, we find higher levels of labor income for fathers with a college degree. The same is true for their children. This can be partially explained by the high level of persistence in college education. For example, 30 percent of sons have a college degree, but that number rises to 61 percent among sons whose fathers have a college degree. Similar figures are found for daughters. We also find that white fathers, and their children, generally have higher labor income. Household size is smaller for children, which can be attributed to their younger age, although it may also capture broader demographic changes and trends.
Unconditional Mobility
Figure (ref) plots the transition matrices for the outcome variables.
The cells of the transition matrices are based on the quintiles of the fathers in USD on the y-axis and the quintiles of the children in USD on the x-axis. The values within these cells represent the percentage of observations observed with a father-daughter or father-son combination within these cells. Due to the overall wage gap between women and men, sons earn more than daughters and the percentages of sons are relatively higher on the right side of the figure, while they are relatively higher on the left side of the figure for daughters. As relative darkness of the squares capture larger probabilities, it is immediately apparent that father-daughter pairs are relatively more frequently located in the upper left corner and the father-son pairs are more relatively frequent in the lower right corner. A high degree of mobility would imply equal probabilities across all cells within each row. Therefore, the observed deviation from this pattern illustrates the limited mobility in the United States.
figure[figure omitted — 736 chars of source]
BDR Estimation
We now focus on the estimates of the BDR model. We first estimate the model using the covariates described below for each of the marginals while also allowing $\rho$ to be a function of the covariates. We also estimate the model in which $\rho$ is not a function of the covariates although these latter results are relegated to the appendix.
The empirical results reported in the main text uses the following variables. For the marginal distribution of father's labor income we employ age, age$^2$ and decade fixed effects for both fathers and children, father's and child's race, father's and child's household size and indicators for a college degree of the father and the child's origin (measuring the degree of urbanization where the child was raised). We use the same set of variables for the marginal distribution of the children. When $\rho$ is a function of the covariates we employ all of the covariates listed above but exclude the decade fixed effects. We acknowledge that some covariates are potentially endogenous. Accounting for this endogeneity is beyond the scope of this paper and we defer this important issue to further work. However, in the appendix we provide the corresponding results when we exclude some variables from the conditioning set. We note that their exclusion does not have substantial implication for the results reported.
comment\begin{figure}[h!]
\caption{Estimated Local Dependence $\rho$}
\begin{scriptsize}
\begin{center}
\begin{subfigure}[t]{.45\textwidth}
\caption{Daughters, raw data}
\end{subfigure}
\begin{subfigure}[t]{.45\textwidth}
\caption{Sons, raw data}
\end{subfigure} \\
\begin{subfigure}[t]{.45\textwidth}
\caption{Daughters, $X$ for marginals}
\end{subfigure}
\begin{subfigure}[t]{.45\textwidth}
\caption{Sons, $X$ for marginals}
\end{subfigure} \\
\begin{subfigure}[t]{.45\textwidth}
\caption{Daughters, $X$ for marginals and $\rho$}
\end{subfigure}
\begin{subfigure}[t]{.45\textwidth}
\caption{Sons, $X$ for marginals and $\rho$}
\end{subfigure}
\caption*{\tiny Notes: Panel (A) and (B) show the local correlation in the raw data. Panel (C) and (D) show the local correlation if the main covariates are used to estimate the marginals but no covariates affect $\rho$. Panel (E) and (F) show the average local correlation if main covariates are used to estimate the marginals and main covariates are used to estimate $\rho$. The BDR model was estimated using a grid of $12 \times 12$ values. To ensure readability, this figure shows a $4 \times 4$ matrix of $\widehat{\rho}$. }
\end{center}
\end{scriptsize}
\end{figure}
Model predictions and Counter Factual
We first report the capacity of the BDR estimates to reproduce the observed joint distribution of fathers' and children's earnings and examine the impact on this predicted joint distribution when we eliminate the dependence operating through $\rho$. Figure (ref) presents the estimated transition matrices based on the BDR model. To construct these matrices, we estimate the joint distribution of father-child earnings using the set of covariates listed above. We then integrate over the empirical distribution of the observed covariates to obtain the average joint distribution.
Panels (A) and (B) display the resulting transition matrices for daughters and sons, respectively. These matrices correspond to the estimated joint distribution. The values of these matrices are calculated based on equation (ref). Panels (C) and (D) show the same average distribution, but under the hypothetical assumption that the local correlation is set to zero. This counterfactual allows us to isolate the contribution of local dependence to intergenerational mobility. Panels (E) and (F) present the difference between the two distributions and quantifies the effect of local dependence.
It is useful to consider two issues before focusing on the results from this exercise. The first is the interpretation of $\rho$ in this context and the second is the resulting estimates of $\rho$. Given the nature of the outcomes, the parameter $\rho$ captures how the outcomes move together after conditioning out the impact of the covariates. If the estimated value of $\rho$ was zero, this implies no dependence between the outcomes after conditioning out the covariates. If the estimated $\rho$ is positive (negative) this implies that, conditional on the covariates, a higher value for one outcome is associated with a higher (lower) outcome for the other. In this particular context this dependence may capture some local correlation between unobservables affecting the respective outcomes.
As noted above an attractive feature of BDR is its capacity to flexibly model the local dependence. Although we do not report our estimates of $\rho$, a notable feature of the results is the substantial heterogeneity in these estimates across different points on the grid. This reflects that the level of dependence varies greatly at different points of the joint distribution. This highlights the importance of adopting a flexible approach to its estimation.
Several insights emerge from these results. First, the estimated transition matrices in Panels (A) and (B) closely resemble those obtained from the raw data (Figure (ref)), indicating that the model successfully captures the observed patterns of mobility. While this is reassuring it is not surprising given the nature of the estimator and the large number of parameters estimated.
Second, setting the local correlation parameter ($\rho$) to zero leads to a considerable flattening of the dependence structure. This effect is evident for both sons and daughters and is particularly pronounced in the upper tail of the income distribution, where the level of dependence is relatively strong in the raw data. The influence of local dependence is quantitatively meaningful. For example, the probability that a son reaches the top decile is 6.9% under local dependence, compared to 5.8% under the counterfactual with $\rho = 0$. This difference is economically significant and explains a large fraction of the departure from the benchmark probability of 4%, which would be expected under full independence and in the absence of gender wage gaps and compositional effects. This highlights the role of local correlation in capturing some aspect of the observed persistent intergenerational advantages. Comparable patterns are observed for daughters, for whom the impact of $\rho$ is most pronounced in the upper-left region of the figure.
Note that we also estimated the model predictions and the counterfactuals with a specification that does not take account of the covariates in $\rho$. These results are presented in Figure (ref). The results are very similar to the results presented in Figure (ref). This suggests that the results in this particulalr context are not sensitive to the treatment of the local dependence.
commentFigure 3 first consider the estinates when $\rho$ is not a function of the covariates. Panels A and B provide the prediction from the model while C and D give the corresponding predictions when $\rho$ is set to zero. To faciliate easier intepretation panels E and F report the difference due to $\rho$. Figure 4 provides the corresponding panels when estimation allows $\rho$ to be a function of teh covariates.
In interepreting these tables it is important to note the following:
\textcolor{red}{Jonas, Can you add something explain precisely how each of these cells are predicted...For example are the top qunitiles just based on estimates from a single bvariate probit explaining probabity of both being in that quantile...I thought something else was used here...Also can we say something about statistical significnace of of panels E and F? Can you also add somethiing about the magnitude etc } \textcolor{orange}{I dont think we can obtain standard errors for the transition matrices.}
figure[figure omitted — 1,568 chars of source]
Decomposition of Joint Conditional CDF
Figure (ref) presents a decomposition of the differences in transition matrices between sons and daughters. The decomposition follows equation (ref) and separates the overall difference in the transition matrices into three distinct components: (i) Composition effects, which capture differences in observable characteristics (e.g. education, region, cohort); (ii) sorting effects, reflecting differences in the estimated local dependence parameter $\rho$; and (iii) marginal effects, which account for gender-specific differences in how covariates relate to the marginal earnings distributions.
Panels (A) and (B) display the estimated transition matrices for sons and daughters, respectively, using the BDR model with the set of covariates as described in Section (ref). Panel (C) shows the element-wise difference between the two matrices. Panels (D), (E), and (F) then report how much of this difference can be explained by composition, sorting, and marginal effects, respectively, expressed as a percentage of the absolute difference in each cell.\footnote{Note that the difference in Panel (C) is, in some instances, very close to zero, which means that the composition, sorting, and marginal effects are divided by a number near zero. This partially explains the occasional occurrence of very large values in Panels (D)–(F).}
Several key insights emerge from this analysis. Marginal effects are by far the most important driver of the observed gender differences in intergenerational earnings mobility. In many cells, they account for the majority of the variation across gender, highlighting the importance of differential returns to characteristics in shaping the marginal earnings distributions of sons and daughters. These marginal effects capture the differences in the labor market experiences, reflecting both supply and demand factors, for females and males. Sorting effects, driven by differences in the estimated local correlation, explain roughly 10% of the overall difference. This suggests that sons and daughters differ not only in their marginal earnings prospects, but also in how tightly their outcomes are linked to their fathers’ incomes, even after controlling for observed characteristics. Composition effects contribute very little to the observed differences. This indicates that the sons and daughters in our sample are, on average, very similar in terms of the included covariates. This suggests that the large difference in intergenerational earnings mobility for daughters and sons cannot be explained by differences in observable characteristics. These results emphasize that gender differences in intergenerational earnings mobility arise primarily from structural differences in earnings determination. These arise through the impact of observables on earnings and the nature of dependence between father's and child's outcomes.
We also provide a robustness check that excludes the children's race and household size. The results are presented in Table (ref). We find no substantial deviations from the results shown in Figure (ref). While we do not consider this an exhaustive examination of the sensitivity of our results, it does not provide some indication of their sensitivity to the exclusion of variables which are potentially important.
figure[figure omitted — 1,652 chars of source]
comment\subsection{Average marginal and conditional Kendall’s $\tau$}
The above evidence suggests a strong dependence between a father's location in their earnings distribution and that of his son's and daughter's locations. This is characterized by large departures from random allocation in the conditional and unconditional transition matrices. However, these departures are difficult to characterize in a single measure and accordingly we now turn to the use of Kendall's $\tau$ to provide such a measure. In particular, we study both the marginal Kendall’s $\tau$ and average conditional Kendall’s $\tau$. The former is based on the marginal distribution of the outcomes and the latter is an average over local dependence conditional on covariates. By comparing model variants based on different sets of covariates, we can assess that the level of dependence is attributable to observed characteristics. In addition, we can evaluate the factors which are driving the differences between these estimates for fathers/sons and fathers/daughters.
We first compute the marginal Kendall’s $\tau$ under two scenarios: using the estimated local dependence parameter $\rho$, and setting $\rho = 0$. The difference between these two values quantifies how much of the total dependence is due to the local structure captured by $\rho$, versus what can be explained by the marginal distributions alone. In the most basic model (model (1) in Table (ref)), where the marginals include no covariates, all dependence is attributed to $\rho$, as the marginals are independent by construction.
As we allow for richer sets of covariates in the marginals, we find that an increasing share of the total dependence can be explained by the marginals alone, i.e. up to roughly two thirds in our most flexible specification. Moreover, across all specifications, the marginal Kendall’s $\tau$ is higher for father-son pairs than for father-daughter pairs, in line with our earlier findings.
\begin{table}[h!]
\begin{center}
\begin{threeparttable}[b]
{0pt}
\caption{Marginal and Average Conditional Kendalls $\tau$ for BDR models}
\begin{tabular*}{14cm}{ @{\extracolsep{\fill}} lllcccccc}
\toprule
& & & \multicolumn{2}{c}{Marginal $\tau$ } & \multicolumn{4}{c}{Average Conditional $\tau$} \\
\cmidrule{4-5} \cmidrule{6-9}
& $X$: Marg. & $X$: $\rho$ & Sons & Daug. & Sons & Daug. & Diff. & Comp. \\
\midrule
\primitiveinput{"tables/kend_table"}
\bottomrule
\end{tabular*}
\begin{tablenotes}[flushleft]
\tiny
• Base covariates: decade, age, age$^2$ (for both children and father). Main covariates: base covariates plus fathers race, college, household size, and mothers working status (0=does not work, 1=works, 2=earns more than the father) as well as childrens gender and origin. All covariates have been used to estimate both marginals. The covariates for $\rho$ do not include decade fixed effects.
\end{tablenotes}
\end{threeparttable}
\end{center}
\end{table}
Turning to the average conditional Kendall’s $\tau$ (columns 4 and 5 in table (ref)), we find that it decreases when more covariates are included in the marginal distributions. This reflects that some of the local dependence previously attributed to $\rho$ is now captured by differences in observable characteristics. Notably, the average conditional $\tau$ remains largely stable across different specifications for $\rho$, suggesting that the form of the local dependence parameter matters less once marginal structure is well accounted for.
\subsection{Decomposing the average conditional Kendall’s $\tau$}
In the next step of the analysis, we aim to understand why sons exhibit a higher conditional dependence with their fathers than daughters. We decompose the observed difference in average conditional Kendall’s $\tau$ into three channels: (1) composition effects, due to differences in observable characteristics between sons and daughters; (2) sorting effects, due to different patterns in local dependence ($\rho$); and (3) differences in marginal distributions, i.e., how covariates affect the marginals differently by gender.
This decomposition reveals that the marginal effect is the most sizeable. This is, differences in the estimated coefficients $\widehat{\mu}(y)$ and $\widehat{\nu}(w)$ account for most of the difference in the average conditional $\tau$. The two remaining parts of the decomposition, i.e. differences due to composition and sorting, are roughly equally important.
Discussion
Our empirical findings highlight the importance of modeling both the marginal distributions and the local dependence structure when analyzing intergenerational mobility. The BDR framework enables a flexible and interpretable decomposition of mobility, and highlights that both observable characteristics and residual local association patterns contribute to the overall structure. Importantly, one can isolate the channels through which gender differences in income dependence emerge. The stronger association observed in father-son pairs is largely due to the differences in the marginal distributions. However, accounting for differences in sorting, capturing local dependence, is also important. Overall, the evidence suggests that policies aiming to promote intergenerational equity should consider not just differences in endowments, but also structural differences in how income is transmitted across generations.
Conclusion
We employ bivariate distribution regression to estimate the joint distribution of two outcome variables conditional on set(s) of covariates. Our approach
is particularly valuable when the dependence between the outcomes persists even after controlling for observed covariates.
We describe how BDR can be implemented and present some associated functionals of interest. The functionals of primary interest in this setting are those involving the unexplained dependence. We provide a decomposition of the joint distributions for different groups into composition, marginal and sorting effects. We provide algorithms for estimation and inference, along with the associated theory.
We also provide a similar decomposition for the associated transition matrices
Using data from the Panel Survey of Income Dynamics, we model the joint distribution of parents' and children's earnings and find that the local dependence structure is an important contributor in explaining intergenerational mobility.