Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
97,698 characters · 20 sections · 93 citation commands
Limit theorems of Azadkia-Chatterjee's conditional graph correlation
{5pt} {5pt} {5pt} {5pt} \hypersetup{colorlinks,breaklinks,urlcolor=blue,linkcolor=blue}
{\bf Keywords}: Measure of conditional dependence, test of conditional independence, dependence measure, rank-based statistic, graph-based statistic
Consider the random triplet $(Y,{\boldsymbol{X}},{\boldsymbol{Z}})$, where $Y\in\mathbb{R}$ is a random scalar, and ${\boldsymbol{X}}\in\mathbb{R}^p$ and ${\boldsymbol{Z}}\in\mathbb{R}^q$ are random vectors of dimensions $p$ and $q$, respectively. Our goal is to infer the strength of conditional dependence between $Y$ and ${\boldsymbol{X}}$ given ${\boldsymbol{Z}}$, as well as to test the null hypothesis
on the basis of $n$ independent copies $(Y_i,{\boldsymbol{X}}_i,{\boldsymbol{Z}}_i)$'s of $(Y,{\boldsymbol{X}},{\boldsymbol{Z}})$.
While the problem of testing (ref) has been studied extensively in the literature, the problem of quantifying the strength of conditional dependence is arguably equally important. In this direction, the recent work of azadkia2019simple constitutes a major breakthrough. Building on ideas from MR3024030 and chatterjee2020new for measuring unconditional dependence, they introduced the following population quantity, where ${\mathrm P}_Y$ denotes the law of $Y$:
Azadkia and Chatterjee proved that $T=0$ if and only if $Y$ is conditionally independent of ${\boldsymbol{X}}$ given ${\boldsymbol{Z}}$, whereas $T=1$ if and only if $Y$ is almost surely a measurable function of ${\boldsymbol{X}}$ given ${\boldsymbol{Z}}$. To the best of our knowledge, this is the first measure of conditional dependence that captures the full range of dependence strength in this manner.
What makes the contribution of azadkia2019simple even more striking is the accompanying statistical estimator. Let $R_i$ denote the rank of $Y_i$ among $\{Y_j\}_{j=1}^n$, let $N(i)$ index the nearest neighbor (NN) of ${\boldsymbol{Z}}_i$, and let $M(i)$ index the nearest neighbor of $({\boldsymbol{X}}_i,{\boldsymbol{Z}}_i)$, with both nearest neighbors defined under the Euclidean metric. Azadkia and Chatterjee introduced the following rank/graph-based statistic, which we refer to as the “Azadkia--Chatterjee conditional graph correlation”,
as a strongly consistent for $T$. Moreover, $T_n$ possesses several notable advantages:
These features, together with the conceptual appeal of $T$, make $T_n$ an especially attractive tool for quantifying conditional dependence.
At the same time, $T_n$ has clear and important limitations. As noted in azadkia2019simple, it generally converges to $T$ at a subparametric rate, and no limit theory has been available for $T_n$. Consequently, one cannot directly quantify the uncertainty arising from random sampling. Resolving this difficulty is by no means routine, and for years after azadkia2019simple, the inferential theory of $T_n$ remained open.
The goal of this paper is to resolve this issue in a definitive manner. Our main contributions are threefold:
Combined with the bias-correction method developed in azadkia2026biascorrection, these results provide a complete inferential theory for $T_n$.
The study of conditional dependence is intimately related to that of unconditional dependence. Indeed, when ${\boldsymbol{Z}}$ is degenerate, the Azadkia--Chatterjee conditional graph correlation $T_n(Y,{\boldsymbol{X}} \mid {\boldsymbol{Z}})$ reduces to an unconditional graph correlation between $Y$ and ${\boldsymbol{X}}$, which we denote by $\xi_n=\xi_n(Y, {\boldsymbol{X}})$. It is therefore natural to discuss the related literature on both conditional and unconditional dependence together.
We first discuss the seminal work of chatterjee2020new on quantifying unconditional dependence between $Y$ and $X$ (when $p=1$), together with the subsequent work of azadkia2019simple on conditional and unconditional dependence. They have by now generated a large and steadily expanding literature, and below we try to give a brief and highly selective review.
Notably, the existing literature has so far focused predominantly on the setting of unconditional dependence, in which the conditioning variable ${\boldsymbol{Z}}$ is absent. To the best of our knowledge, the main exceptions are Shi_Drton_Han_2024_Bernoulli, which studied the use of $T_n$ for testing (ref) within the conditional randomization test framework; huang2022kernel, which proposed a class of conditional dependence measures by combining graph-based and kernel-based ideas; and azadkia2025new, which introduced refined versions of $T$ and $T_n$. Even so, inferential results remain unavailable beyond the simple setting in which $Y$ is further assumed to be independent of $({\boldsymbol{X}},{\boldsymbol{Z}})$.
Concerning the task (ref), the present paper is also inevitably connected to the vast literature on testing conditional independence, and the (bias-corrected) statistic $T_n$ does yield a consistent test of (ref). Our work therefore also complements the broad class of nonparametric, consistent conditional independence tests developed in MR2413488, MR3449068, 10.5555/3020548.3020641, cai2022distribution, and zhang2026doubly, among many others. At the same time, it is worth noting that these methods are not designed to consistently capture conditional perfect dependence, and their implementations are typically quadratic in $n$ or more expensive.
The present work builds on several earlier contributions, especially Lin_Han_2025_CLT and azadkia2026biascorrection, which established the asymptotic normality of the unconditional version of $T_n$ and resolved the corresponding bias-correction issue, respectively. It is therefore worth clarifying more explicitly what is technically new in the current paper.
Our first main technical contribution is a central limit theorem (CLT) for the Azadkia--Chatterjee conditional correlation coefficient $T_n$ in general settings. The main difficulty here is to handle the interaction between the following two terms in the nominator of (ref): \[ \sum_{i=1}^n \min\{R_i,R_{M(i)}\} \qquad\text{and}\qquad \sum_{i=1}^n \min\{R_i,R_{N(i)}\}, \] when $({\boldsymbol{X}},Y,{\boldsymbol{Z}})$ is allowed to be arbitrarily dependent. This issue is in our opinion technically far more challenging than in the unconditional setting considered in Lin_Han_2025_CLT, and took substantially additional work of ours. In fact, resolving it necessitates sharpening several results from Lin_Han_2025_CLT and Shi_Drton_Han_2024_Bernoulli; these improvements are highlighted in Section (ref) below.
Our second main contribution is the identification of a closed-form expression for the limiting variance of $T_n$. More precisely, we show that this variance can be represented explicitly as a functional of the joint distribution of $({\boldsymbol{X}},Y,{\boldsymbol{Z}})$; see (ref), (ref), and (ref) below. Moreover, under $H_0$ in (ref), a further simplification exists; see (ref) below. These explicit characterizations in turn enable us to construct a consistent and computationally efficient variance estimator for $T_n$ with $O(n\log n)$ complexity. Relative to the variance estimator proposed in Lin_Han_2025_CLT and the $m$-out-of-$n$ bootstrap considered in Dette_Kroll_2025, this provides a computationally more efficient inferential tool.
\paragraph*{Paper organization.}
The rest of the paper is organized as follows. Section (ref) revisits the limit theorems established in Lin_Han_2025_CLT for the Azadkia--Chatterjee unconditional correlation coefficient, and presents our new findings related to this unconditional dependence measure. Section (ref) introduces the proposed inferential framework for the Azadkia--Chatterjee conditional correlation coefficient. Section (ref) develops the corresponding theory. Section (ref) reports numerical experiments illustrating the finite-sample performance of the proposed procedure. All proofs are deferred to the Appendix.
\paragraph*{Notation.}
For any integer $n \ge 1$, let $\llbracket n \rrbracket = \{1,2,\dots,n\}$. A set consisting of distinct elements $x_1,\dots,x_n$ is written either as $\{x_1,\dots,x_n\}$ or as $\{x_i\}_{i=1}^n$. For a real random vector ${\boldsymbol{W}}$, let ${\mathrm P}_{{\boldsymbol{W}}}$, $F_{{\boldsymbol{W}}}$, and $\mathrm{supp}({\boldsymbol{W}})$ denote its induced probability measure, cumulative distribution function, and support, respectively. We write $\mathbf{1}(\cdot)$ for the indicator function. For a vector ${\boldsymbol{v}} \in \mathbb{R}^d$, let $\|{\boldsymbol{v}}\|$ denote its Euclidean norm. For any $a,b \in \mathbb{R}$, define $a \vee b = \max\{a,b\}$ and $a \wedge b = \min\{a,b\}$. For a finite set $A$, let $\#A$ or $|A|$ denote its cardinality. The symbols $\lfloor \cdot \rfloor$ and $\lceil \cdot \rceil$ denote the floor and ceiling functions. For a random variable $U$ and a random vector ${\boldsymbol{V}}$, let $\mu_U$ denote the law of $U$ and let $\mu_{U \mid {\boldsymbol{V}}}$ denote the conditional law of $U$ given ${\boldsymbol{V}}$. Finally, $\stackrel{\mathrm{a.s.}} \to$, $\stackrel{\mathrm{P}} {\to}$, and $\stackrel{\mathcal D} {\to}$ denote convergence almost surely, in probability, and in distribution, respectively. Unless stated otherwise, the terms “absolutely continuous” and “almost everywhere” are understood with respect to Lebesgue measure.
This section reviews and refines the CLT for Azadkia–Chatterjee’s unconditional correlation coefficient $\xi_n(Y,{\boldsymbol{X}})$. To facilitate comparison with $T_n$ in later sections and to maintain notational consistency throughout the paper, in this section we use ${\boldsymbol{Z}}$ in place of ${\boldsymbol{X}}$ and write $\xi_n(Y,{\boldsymbol{Z}})$ instead of $\xi_n(Y,{\boldsymbol{X}})$.
Specifically, in this section let $Y$ be a real-valued random variable and ${\boldsymbol{Z}}$ be a random vector in $\mathbb{R}^q$, both defined on the same probability space. Let $(Y_1,{\boldsymbol{Z}}_1),\dots,(Y_n,{\boldsymbol{Z}}_n)$ be $n$ independent copies of $(Y,{\boldsymbol{Z}})$. Under the assumption that $(Y,{\boldsymbol{Z}})$ is continuously distributed, Azadkia-Chatterjee's unconditional correlation coefficient proposed by azadkia2019simple is defined as
where, as before, $R_i$ denotes the rank of $Y_i$ among $\{Y_j\}_{j=1}^n$, and $N(i)$ denotes the index of the first NN of ${\boldsymbol{Z}}_i$ among $\{{\boldsymbol{Z}}_j\}_{j=1}^n$ under the Euclidean metric. Note that $\xi_n$ extends Chatterjee's original correlation coefficient chatterjee2020new from the univariate setting $p=1$ to the multivariate setting $p\ge 1$. As $n\to\infty$, $\xi_n$ converges almost surely to the population quantity
which is also known as the Dette--Siburg--Stoimenov dependence measure MR3024030.
In the special case where ${\boldsymbol{Z}}$ and $Y$ are independent, a CLT for $\xi_n$ was first established in Shi_Drton_Han_2024_Bernoulli. The subsequent work of Lin_Han_2025_CLT extended this result to the general setting in which ${\boldsymbol{Z}}$ and $Y$ may be arbitrarily dependent. We summarize the main conclusions of Lin_Han_2025_CLT in Proposition (ref) below.
Despite these results, two notable gaps remain in Lin_Han_2025_CLT: (1) no closed-form expression for $\sigma^2_{\xi(Y,{\boldsymbol{Z}})}$ is available; and (2) the estimator $\widetilde{\sigma}^2$ in Lin_Han_2025_CLT requires $O(n^2)$ computational time, which is substantially more demanding than the $O(n\log n)$ complexity typically associated with rank- and graph-based statistics, and thus limits its practical usefulness.
As a byproduct of developing our general inferential theory for $T_n$, we resolve both of these issues in a definitive manner. We present these improvements to Lin_Han_2025_CLT first, before turning to the general theory of $T_n$. We hope that this presentation makes it clearer that the present paper is not merely an extension of Lin_Han_2025_CLT to the setting of conditional dependence.
To derive the closed-form expression for $\sigma^2_{\xi(Y,{\boldsymbol{Z}})}$, we begin by reviewing and establishing several probabilistic asymptotic results for nearest neighbor graphs (NNGs), which form the foundation for our subsequent analysis.
Our first result in this section concerns a sample $\{{\boldsymbol{W}}_i\}_{i=1}^n$ consisting of $n$ independent copies of a random vector ${\boldsymbol{W}} \in \mathbb{R}^d$. Let $\mathcal{G}_n$ denote the associated directed nearest-neighbor graph (NNG) with vertex set $\llbracket n \rrbracket$. A directed edge $i \to j$ is drawn between two distinct vertices $i$ and $j$ whenever ${\boldsymbol{W}}_j$ is the nearest neighbor of ${\boldsymbol{W}}_i$. Denote by $\mathcal{E}(\mathcal{G}_n)$ the edge set of $\mathcal{G}_n$.
We begin by recalling Theorem 1 of MR937563 on the expected number of mutual NN pairs.
Note that the first statement may equivalently be written as ${\mathrm P}\{N(N(i))=i \mid {\boldsymbol{W}}_i\} \stackrel{\mathrm{P}} {\to} \mathfrak{q}_d$, that is, the conditional probability that the NN of ${\boldsymbol{W}}_i$ has ${\boldsymbol{W}}_i$ itself as its NN converges to $\mathfrak{q}_d$, regardless of the specific value of ${\boldsymbol{W}}_i$.
We are now ready to present our first new result, which extends the argument of Lemma (ref) to the conditional expectation of the number of shared nearest-neighbor triplets.
Note that, by the bounded convergence theorem, together with the well-known fact that the maximum degree of an NNG is bounded MR682809, Lemma (ref) immediately recovers the existing result on the unconditional expectation from MR914597:
Table (ref) reports the values of $\mathfrak{q}_d$ and $\mathfrak{o}_d$ for the first ten dimensions, updating the calculations reported in han2024azadkia.
Our second result concerns a setting involving two NNGs, generated from the full sample and from a subsample, respectively. Such configurations arise repeatedly in the analysis of the conditional correlation coefficient $T_n$.
To describe this setting, consider a sample $\{{\boldsymbol{W}}_i\}_{i=1}^n$, where each ${\boldsymbol{W}}_i = ({\boldsymbol{U}}_i,{\boldsymbol{V}}_i)$ is independently drawn from the random vector ${\boldsymbol{W}}=({\boldsymbol{U}},{\boldsymbol{V}})$, with ${\boldsymbol{U}} \in \mathbb{R}^{d_1}$ and ${\boldsymbol{V}} \in \mathbb{R}^{d_2}$. Let $\mathcal{G}^{{\boldsymbol{W}}}_n$ denote the NNG associated with the full sample $\{{\boldsymbol{W}}_i\}_{i=1}^n$, and let $\mathcal{G}^{{\boldsymbol{U}}}_n$ denote the NNG associated with the subsample $\{{\boldsymbol{U}}_i\}_{i=1}^n$. Lemma (ref) below establishes the convergence of the conditional expected number of shared-NN triplets across the two graphs $\mathcal{G}^{{\boldsymbol{W}}}_n$ and $\mathcal{G}^{{\boldsymbol{U}}}_n$.
Of note, the unconditional version
was previously established in Shi_Drton_Han_2024_Bernoulli. As in Lemmas (ref) and (ref), here we show that the asymptotic behavior of the corresponding conditional expectation is invariant with respect to the specific value of ${\boldsymbol{W}}_i$.
Lemmas (ref) and (ref) will be used to derive the closed-form expression for the limiting variance of $\xi_n$, whereas Lemma (ref) will be used to derive the closed-form expression for the limiting variance of $T_n$ in Section (ref).
In what follows, let ${\widetilde Y}_i$, ${\widetilde Y}'_i$, and ${\widetilde Y}''_i$ denote copies of $Y_i$ such that, conditional on ${\boldsymbol{Z}}_i$, they are independently and identically distributed ($\mathrm{i.i.d.}$) according to the conditional distribution of $Y_i$ given ${\boldsymbol{Z}}_i$.
Theorem (ref) below constitutes the main theoretical result of this section. It provides an explicit expression for the limiting variance of $\xi_n$ when ${\boldsymbol{Z}}$ and $Y$ are possibly dependent. In this way, it complements Lin_Han_2025_CLT and further extends the corresponding results of Shi_Drton_Han_2024_Bernoulli and chhaibi2026martingaleapproachfluctuationsrank to the settings of dependent pairs and multivariate ${\boldsymbol{Z}}$, respectively.
Notably, when $Y$ and ${\boldsymbol{Z}}$ are further assumed to be independent, all terms $T_1$ through $T_7$ in (ref) reduce to distribution-free constants, and (ref) further simplifies to the corresponding expression in Shi_Drton_Han_2024_Bernoulli, summarized in Proposition (ref) below.
Recall that the variance estimator proposed in Lin_Han_2025_CLT requires $O(n^2)$ computational time. In contrast, our new Theorem (ref) yields, as a byproduct, a new estimator of $\sigma^2_{\xi(Y,{\boldsymbol{Z}})}$ that can be computed in $O(n\log n)$ time. We first present the form of this estimator, along with its theoretical properties, in Theorem (ref) below.
Compared with the original estimator in Lin_Han_2025_CLT (Theorem 1.1), the new estimator $\widehat{\sigma}^2_{\xi(Y,{\boldsymbol{Z}})}$ is notably simpler, owing to the explicit closed-form expression of $\widehat{\sigma}^2_{\xi(Y,{\boldsymbol{Z}})}$ established in Theorem (ref) through the incorporation of the constants $\mathfrak{q}_q$ and $\mathfrak{o}_q$. Moreover, unlike $\widetilde\sigma^2$ in Lin_Han_2025_CLT, the following proposition shows that $\widehat{\sigma}^2_{\xi(Y,{\boldsymbol{Z}})}$ can be computed in $O(n\log n)$ time.
This section introduces inferential procedures for constructing confidence intervals for $T$ in (ref), as well as for testing $H_0$ in (ref), based on Azadkia--Chatterjee's conditional correlation coefficient $T_n$ in (ref). Before proceeding, we first introduce some notation and preliminary observations.
Let $({\boldsymbol{X}}_1,Y_1,{\boldsymbol{Z}}_1),\dots,({\boldsymbol{X}}_n,Y_n,{\boldsymbol{Z}}_n)$ be $n$ $\mathrm{i.i.d.}$ copies of the random triplet $({\boldsymbol{X}},Y,{\boldsymbol{Z}})$, where $Y \in \mathbb{R}$, ${\boldsymbol{X}} \in \mathbb{R}^p$, and ${\boldsymbol{Z}} \in \mathbb{R}^q$, with $p,q \ge 1$. Recall that $T_n$ in (ref) takes the form
where $\tau_n$ and $\kappa_n$ denote, respectively, the numerator and denominator of $T_n$ after scaling by $n^{-2}$, and $M(i)$ and $N(i)$ index the NNs of $({\boldsymbol{X}}_i,{\boldsymbol{Z}}_i)$ and ${\boldsymbol{Z}}_i$, respectively. Whenever $Y$ is not almost surely a function of ${\boldsymbol{Z}}$, $T_n(Y, {\boldsymbol{X}} \mid {\boldsymbol{Z}})$ converges almost surely to the conditional dependence measure in (ref), expressed as
where $\tau$ and $\kappa$ denote, respectively, the numerator and denominator of $T$.
Constructing confidence intervals for $T$ using $T_n$ hinges on deriving the limiting distribution of $T_n - T$, where
It was shown in azadkia2019simple that \[ \kappa_n \stackrel{\mathrm{a.s.}} \to \kappa >0 \qquad\text{and}\qquad \widetilde{T}_n \stackrel{\mathrm{a.s.}} \to 0. \] Accordingly, the main challenge is to infer the limiting distribution of the numerator term $\widetilde{T}_n$.
The construction of confidence intervals for $T$ proceeds in the following three steps.
Further simplifications arise when the goal is to test $H_0$ in (ref). Specifically, under $H_0$, we have $T=\tau=0$, so that \[ T_n - T = \tau_n/\kappa_n. \] Accordingly, testing $H_0$ is equivalent to testing $\tau=0$, which can be carried out using $\tau_n$ alone.
The construction of a test of $H_0$ based on $\tau_n$ proceeds as follows.
This section provides the theoretical foundation for the inferential procedures described in Section (ref). In particular,
Before presenting the main theorems in this section, we first introduce the following assumptions.
Recall that $T_n(Y, {\boldsymbol{X}} \mid {\boldsymbol{Z}}) = \tau_n(Y, {\boldsymbol{X}} \mid {\boldsymbol{Z}}) / \kappa_n(Y, {\boldsymbol{Z}})$ in (ref), with $\tau_n$ and $\kappa_n$ given by
It is worth noting that $\widetilde{\xi}_{1,n}$ and $\widetilde{\xi}_{2,n}$ can be viewed as unnormalized versions of the Azadkia--Chatterjee unconditional correlation coefficient $\xi_n$ in (ref), in the sense that
Using this notation, $\widetilde{T}_n$ in (ref) admits the decomposition
We first derive the general CLT. As noted earlier in Section (ref), the CLT for $T_n$ relies on that for $\widetilde{T}_n$. We therefore begin by establishing a CLT for $\widetilde{T}_n$ in the general case where $Y$ may depend on ${\boldsymbol{X}}$ conditionally on ${\boldsymbol{Z}}$. Throughout Section (ref), $\overline{Y}$, $\overline{Y}'$, ${\widetilde Y}$, and ${\widetilde Y}'$ denote copies of $Y$ such that, conditional on $({\boldsymbol{X}},{\boldsymbol{Z}})$, (i) they are mutually independent, (ii) $\overline{Y},\overline{Y}' \sim \mu_{Y \mid {\boldsymbol{X}},{\boldsymbol{Z}}}$, and (iii) ${\widetilde Y},{\widetilde Y}' \sim \mu_{Y \mid {\boldsymbol{Z}}}$.
By Slutsky's theorem, Theorem (ref) directly yields the CLT for $T_n$ and $T_n^{\mathrm{bc}}$, stated in Corollary (ref) below.
We next derive the CLT under $H_0$. To this end, only the limiting distribution of $\tau_n$ is needed.
We begin with the general case. In view of Theorem (ref), we can construct a consistent estimator of $\sigma^2$ in a manner analogous to that of Theorem (ref).
According to Theorem (ref) and Proposition (ref), the computational complexities of $\widehat{\sigma}_1^2$ and $\widehat{\sigma}_2^2$ are both of order $O(n \log n)$. For $\widehat{\sigma}_{1,2}$, an analysis similar to that in Proposition (ref) shows that its computational complexity is also of order $O(n \log n)$. Indeed, the terms $\widehat U_4$--$\widehat U_8$ involved in $\widehat{\sigma}_{1,2}$ can be computed via fast algorithms analogous to Algorithm (ref), so that each term can be evaluated in $O(n \log n)$ time. Consequently, the overall computational complexity of $\widehat{\sigma}^2$ is of order $O(n \log n)$.
Next, for conditional independence testing, it suffices to estimate $\sigma_0^2$ in (ref). To this end, we consider two alternative estimators: (1) the fast simplified estimator $\widehat{\sigma}^2_{0,\mathrm{F}}$, and (2) the $m$-out-of-$n$ bootstrap estimator $\widehat{\sigma}^2_{0,\mathrm{B}}$. Compared with $\widehat{\sigma}^2$ in Theorem (ref), both alternative estimators remain consistent under $H_0$, while offering simpler computation and improved estimation accuracy.
We first discuss the direct estimation approach based on Theorem (ref), which has time complexity $O(n\log n)$.
We next consider the $m$-out-of-$n$ bootstrap procedure proposed in Dette_Kroll_2025, which has computational complexity $O(B \, m \log m)$, where $B$ denotes the number of bootstrap replicates. The procedure is as follows. For each bootstrap iteration $b = 1,\dots,B$, draw $m<n$ observations without replacement from $\{(Y_i, {\boldsymbol{X}}_i,{\boldsymbol{Z}}_i)\}_{i=1}^n$, denoted by $\{(Y_{b,j}^*, {\boldsymbol{X}}_{b,j}^*, {\boldsymbol{Z}}_{b,j}^*)\}_{j=1}^m$, and compute the statistic $\tau_m$ in (ref) based on this bootstrap sample, denoted by $\tau_{m,b}^*$. The bootstrap estimator $\widehat{\sigma}^2_{0,\mathrm{B}}$ of $\sigma^2$ is then defined by
Recall that $L^{(\tau)}_n = {\mathrm E}(\tau_n) - \tau$ and $L^{(\kappa)}_n = {\mathrm E}(\kappa_n) - \kappa$ represent the biases of $\tau_n$ and $\kappa_n$, respectively. The goal of this subsection is to introduce consistent estimators $\widehat{L}^{(\tau)}_n$ and $\widehat{L}^{(\kappa)}_n$ such that $\widehat{L}^{(\tau)}_n - L^{(\tau)}_n= o_{\mathrm P}(n^{-1/2})$ and $\widehat{L}^{(\kappa)}_n - L^{(\kappa)}_n= o_{\mathrm P}(n^{-1/2})$, as required in (ref) and (ref) for our inferential procedures.
Recall from (ref) that $\tau_n$ and $\kappa_n$ admit the decompositions
As noted earlier in (ref), $\widetilde{\xi}_{1,n}$ and $\widetilde{\xi}_{2,n}$ can be viewed as unnormalized versions of the Azadkia--Chatterjee unconditional correlation coefficient $\xi_n$ in (ref). Therefore, as $n\to \infty$, we have
which correspond to the numerator of $\xi$ in (ref), with ${\boldsymbol{X}}$ therein replaced by $({\boldsymbol{X}},{\boldsymbol{Z}})$ and ${\boldsymbol{Z}}$, respectively. It is also straightforward to verify that the population quantities $\tau$ and $\kappa$ in (ref) and (ref) admit analogous decompositions, namely, $\tau = \widetilde{\xi}_1 - \widetilde{\xi}_2$ and $\kappa = 6^{-1} - \widetilde{\xi}_2$.
Denote the biases of $\widetilde{\xi}_{1,n}$ and $\widetilde{\xi}_{2,n}$ by
From the above decompositions, it is readily verified that
Therefore, it suffices to perform bias correction separately for $L_n^{{\boldsymbol{X}}, {\boldsymbol{Z}}}$ and $L_n^{{\boldsymbol{Z}}}$; that is, to construct estimators $\widehat{L}_n^{{\boldsymbol{X}}, {\boldsymbol{Z}}}$ and $\widehat{L}_n^{{\boldsymbol{Z}}}$ such that $\widehat{L}_n^{{\boldsymbol{X}}, {\boldsymbol{Z}}} =L_n^{{\boldsymbol{X}}, {\boldsymbol{Z}}} + o_{\mathrm P}(n^{-1/2})$ and $\widehat{L}_n^{{\boldsymbol{Z}}} =L_n^{{\boldsymbol{Z}}} + o_{\mathrm P}(n^{-1/2})$. Then
serve as the desired bias estimators satisfying (ref) and (ref).
Note that the construction of $L_n^{{\boldsymbol{X}}, {\boldsymbol{Z}}}$ is entirely analogous to that of $L_n^{{\boldsymbol{Z}}}$: one simply replaces the data $\{{\boldsymbol{Z}}_i\}_{i=1}^n$ by $\{({\boldsymbol{X}}_i,{\boldsymbol{Z}}_i)\}_{i=1}^n$. We therefore focus on the construction of $L_n^{{\boldsymbol{Z}}}$ below to illustrate the bias-correction procedure and its theoretical justification, following the framework of azadkia2026biascorrection.
Recall the function $G_{\boldsymbol{z}}(t) = {\mathrm E}\{\mathbf{1}(Y\geq t) \mid {\boldsymbol{Z}}={\boldsymbol{z}}\}$ defined in Assumption (ref). Section 3 of azadkia2026biascorrection establishes the following alternative representation of the bias:
where $Y^*$ is independent of ${\boldsymbol{Z}}$ and has the same marginal distribution as $Y$. This identity naturally suggests a two-step procedure for constructing an estimator. First, construct an appropriate estimator $\widehat{G}.(\cdot)$ of the bivariate regression function $G.(\cdot)$. Second, approximate the expectation in (ref) by replacing the population mean with the empirical distribution of $Y^*$ and ${\boldsymbol{Z}}$, leading to the estimator
Note that, for each fixed $t$, $G_{\boldsymbol{Z}}(t) = {\mathrm E}\{\mathbf{1}(Y\geq t) \mid {\boldsymbol{Z}}\}$ is the regression mean function of $\mathbf{1}(Y\geq t)$ on ${\boldsymbol{Z}}$. This motivates estimating $G.(t)$ by regression techniques. According to the results in Section 4.2.2 of azadkia2026biascorrection, $G.(t)$ can be effectively estimated by ridge least squares tuo2024asymptotic, which yields the estimator $\widehat{G}.(t)$ and hence $\widehat{L}_n^{{\boldsymbol{Z}}}$. The complete procedure for computing $\widehat{L}_n^{{\boldsymbol{Z}}}$ is summarized in Algorithm (ref).
Theorem (ref) below establishes the bias rate and the convergence rate of the bias estimators. For ease of exposition, Assumptions (ref)--(ref), which are needed in this subsection, are deferred to Appendix (ref).
Recall the confidence intervals proposed in (ref):
Based on the explicit variance-estimation and bias-correction procedures developed in Section (ref), we can now specify the concrete forms of $\widehat{\sigma}$ and $T_n^{\mathrm{bc}}$. Specifically, $\widehat{\sigma}$ is a consistent estimator of $\sigma$, as given in (ref) of Theorem (ref), whereas $ T_n^{\mathrm{bc}} = \big(\tau_n - \widehat{L}^{(\tau)}_n\big)/\big(\kappa_n - \widehat{L}^{(\kappa)}_n\big), $ with $\widehat{L}^{(\tau)}_n$ and $\widehat{L}^{(\kappa)}_n$ defined in (ref).
As a direct consequence of the CLT established in Corollary (ref), we then obtain the validity of the confidence intervals in Theorem (ref) below.
For conditional independence testing, by combining the two limiting variance-estimation methods developed in the latter part of Section (ref) with the bias-correction procedure in Section (ref), we obtain four distinct level-$\alpha$ tests:
where $\widehat{\sigma}_{0,\mathrm{F}}$ and $\widehat{\sigma}_{0,\mathrm{B}}$ correspond to the fast estimator in (ref) and the bootstrap estimator in (ref), respectively, and $\widehat{L}_n^{(\tau)} = \widehat{L}_n^{{\boldsymbol{X}}, {\boldsymbol{Z}}} - \widehat{L}_n^{{\boldsymbol{Z}}}$ is the bias estimator. Let $H_1$ denote the alternative hypothesis consisting of all distributions of $({\boldsymbol{X}}, Y, {\boldsymbol{Z}})$ under which $Y$ is not conditionally independent of ${\boldsymbol{X}}$ given ${\boldsymbol{Z}}$. Theorem (ref) establishes the asymptotic size control and consistency of these four tests.
We conduct simulation studies to investigate the finite-sample performance of the proposed confidence intervals and conditional independence tests. To this end, we consider the following two data-generating models on $({\boldsymbol{X}}, Y, {\boldsymbol{Z}})$.
For the settings of dimensions $p, q$, we consider the following five scenarios \[ (p,q) \in \{(1,1), (1,2), (3,1), (3,3), (5,5)\}. \] In each simulation run, we generate $\mathrm{i.i.d.}$ $\{({\boldsymbol{X}}_i, Y_i, {\boldsymbol{Z}}_i)\}_{i=1}^n$ from the selected model, with sample size \[ n \in \{1000,5000,10000\}. \] For the the confidence interval $\mathsf{CI}^{\mathrm{bc}}_{\alpha}(T) $ and testing methods $\mathsf{T}^{\mathrm{F,bc}}$, $\mathsf{T}^{\mathrm{B,bc}}$ that involve bias correction, we set the penalty parameter $\lambda_n = \lceil n^{-0.85} \rceil$ in Algorithm (ref). For the methods $\mathsf{T}^{\mathrm{B}}$ and $\mathsf{T}^{\mathrm{B,bc}}$ that employ the $m$-out-of-$n$ bootstrap, we set the number of bootstrap replications to $B = 200$ and the subsample size to $m = \lceil n^{0.5} \rceil$. In each scenario, the true values of $T$ and $\sigma^2$ (or $\sigma_0^2$) are approximated by Monte Carlo simulation by evaluating $T_n$ and $\widehat{\sigma}^2$ with $n=10^7$.
Note that {\bf Model 2} represents a challenging setting in which the observed random variables are unbounded, making bias correction---which essentially amounts to a nonparametric regression adjustment---substantially more difficult. We include this setting to contrast it with {\bf Model 1}, which represents the most idealized case, and to assess the robustness of our methods in scenarios that fall outside the scope of the available theoretical guarantees.
All code required to reproduce the results in this paper is publicly available at: \\\url{https://github.com/MuhongGao/Conditional_Independence}.
Tables (ref) and (ref) report the empirical coverage probabilities (ECPs) of the proposed confidence intervals $\mathsf{CI}_{\alpha}(T) $ and $\mathsf{CI}^{\mathrm{bc}}_{\alpha}(T) $ under Models 1 and 2, respectively. In addition, the tables report the relative empirical root mean squared error (rRMSE), defined below, to assess the accuracy of the limiting variance estimator $\widehat{\sigma}^2$ in (ref):
From the tables, we observe that when $(p,q)=(1,1)$ and $(1,2)$, so that $p+q\leq 3$, both $\mathsf{CI}$ and $\mathsf{CI}^{\mathrm{bc}}$ achieve ECPs close to the nominal level $1-\alpha=0.9$. By contrast, when $(p,q)=(3,3)$, so that $p+q>3$, the ECPs of $\mathsf{CI}$ deteriorate substantially, whereas those of $\mathsf{CI}^{\mathrm{bc}}$ remain close to $0.9$. This pattern is especially pronounced under {\bf Model 1} when $\rho$ is not too close to $1$. These findings are consistent with Theorem (ref), which indicates that bias correction is necessary when $p+q>3$, and they further demonstrate the effectiveness of the proposed bias-correction procedure. The case $(p,q)=(5,5)$, on the other hand, illustrates the curse of dimensionality, as one would expect.
The situation is also of interest under {\bf Model 2}, where the assumptions required for bias correction are violated because $({\boldsymbol{X}},{\boldsymbol{Z}})$ is supported on an unbounded domain. In this case, as shown in Table (ref), both $\mathsf{CI}$ and $\mathsf{CI}^{\mathrm{bc}}$ continue to perform well when $p+q\leq 3$, suggesting that bias correction may serve as a safe alternative to $\mathsf{CI}$, albeit at a higher computational cost. On the other hand, when $p+q>3$, $\mathsf{CI}^{\mathrm{bc}}$ no longer performs as well as it does in Table (ref), although it remains substantially superior to $\mathsf{CI}$. This suggests that the bias-correction step is indeed sensitive to tail observations, and points to the potential value of applying a rank transformation, as in cattaneo2025rosenbaum, to stabilize the bias correction. Given the already broad scope of the present paper, we do not pursue this direction further.
Regarding the rRMSE, it decreases uniformly with $n$ across all scenarios, providing empirical evidence for the consistency of $\widehat{\sigma}^2$ established in Theorem (ref). Moreover, the rRMSE increases noticeably with both $p+q$ and $\rho$, indicating that the convergence rate of $\widehat{\sigma}^2$ deteriorates in higher-dimensional settings and under stronger dependence. Such behavior is in line with theoretical intuition.
The empirical powers under {\bf Models 1} and {\bf 2} are reported in Figures (ref) and (ref), respectively. We begin with the results under {\bf Model 1} (Figure (ref)). When $(p,q) = (1,1), (1,2)$, or $(3,1)$, all four methods perform similarly well, with power curves that nearly overlap. By contrast, when $(p,q) = (3,3)$ or $(5,5)$, the bias-corrected methods $\mathsf{T}^{\mathrm{F,bc}}$ and $\mathsf{T}^{\mathrm{B,bc}}$ clearly outperform their non-bias-corrected counterparts $\mathsf{T}^{\mathrm{F}}$ and $\mathsf{T}^{\mathrm{B}}$, and this advantage becomes more pronounced as $(p,q)$ increases. This pattern is in line with Theorem (ref), which shows that bias correction is unnecessary when $p+q < 4$, whereas its benefit becomes increasingly substantial as the dimension grows. Furthermore, when $p$ and $q$ are large, although the non-bias-corrected methods $\mathsf{T}^{\mathrm{F}}$ and $\mathsf{T}^{\mathrm{B}}$ control size under $H_0$ (that is, when $\rho = 0$) well below the nominal level $\alpha = 0.05$, their power increases much more slowly as $\rho$ grows. This suggests that, under {\bf Model 1}, the bias $L_n = {\mathrm E}(\tau_n) - \tau$ is positive, rendering the tests more conservative and thereby lowering their rejection probabilities. Finally, comparing the two variance-estimation methods, we observe little difference in either size or empirical power: $\mathsf{T}^{\mathrm{F,bc}}$ and $\mathsf{T}^{\mathrm{B,bc}}$ behave almost identically, and the same is true for $\mathsf{T}^{\mathrm{F}}$ and $\mathsf{T}^{\mathrm{B}}$.
We next examine the results under {\bf Model 2} (Figure (ref)). Overall, the patterns are highly consistent with those observed under {\bf Model 1}, exhibiting similar trends and leading to the same qualitative conclusions. A closer inspection reveals that the discrepancies are, if anything, slightly more pronounced under {\bf Model 2}. In particular, (i) when $(p,q) = (1,2)$ or $(3,1)$, the four methods exhibit less overlap in their power curves; and (ii) when $(p,q) = (5,5)$ and the sample size is relatively small (e.g., $n = 1000$), the bias-corrected methods $\mathsf{T}^{\mathrm{F,bc}}$ and $\mathsf{T}^{\mathrm{B,bc}}$ exhibit size inflation under $H_0$ (that is, when $\rho = 0$), with rejection probabilities around $0.2$, substantially above the nominal level $0.05$. However, this issue is quickly alleviated as the sample size increases.
Overall, these results show that, unlike the confidence-interval counterpart, the proposed testing procedures exhibit consistently stable and favorable performance across different models, even in the presence of unbounded distributions. This is in line with the general intuition that testing is often statistically easier than estimation.
We next take a closer look at the performance of the two asymptotic variance estimators under $H_0$: the fast $k$NN-based estimator $\widehat{\sigma}^2_{0,\mathrm{F}}$ in (ref)$,$ and the $m$-out-of-$n$ bootstrap estimator $\widehat{\sigma}^2_{0,\mathrm{B}}$ in (ref).
We focus on the following three aspects:
Figures (ref) and (ref) report the results for {\bf Models 1} and {\bf 2}, respectively. The overall patterns in the two figures are nearly identical. We therefore focus on Figure (ref) under {\bf Model 1}. For the rRMSE, the bootstrap estimator $\widehat{\sigma}^2_{0,\mathrm{B}}$ consistently maintains a relatively low level, whereas the fast estimator $\widehat{\sigma}^2_{0,\mathrm{F}}$ exhibits larger values when the sample size is small (e.g., $n = 1000$). As $n$ increases, however, the rRMSE of $\widehat{\sigma}^2_{0,\mathrm{F}}$ decreases substantially, eventually becoming comparable to, and even slightly smaller than, that of $\widehat{\sigma}^2_{0,\mathrm{B}}$ when $n = 10000$. This suggests that $\widehat{\sigma}^2_{0,\mathrm{F}}$ converges more slowly than $\widehat{\sigma}^2_{0,\mathrm{B}}$, but attains comparable performance once the sample size is sufficiently large.
Despite these differences in rRMSE, they do not translate into noticeable differences in statistical inference. Both in terms of empirical power (see Section (ref)) and ECP, the two estimators yield nearly identical results, with their corresponding curves largely overlapping.
Finally, in terms of computational efficiency, the $k$NN-based estimator $\widehat{\sigma}^2_{0,\mathrm{F}}$ is substantially faster to compute than the bootstrap estimator $\widehat{\sigma}^2_{0,\mathrm{B}}$. Even with a relatively small number of bootstrap replications ($B = 200$), the $m$-out-of-$n$ bootstrap incurs a much higher computational cost than the $k$NN-based estimator.
In summary, $\widehat{\sigma}^2_{0,\mathrm{B}}$ achieves lower rRMSE when the sample size is small, whereas $\widehat{\sigma}^2_{0,\mathrm{F}}$ becomes increasingly competitive, faster, and more stable as the sample size grows.
{ Supplement to “Limit theorems of Azadkia-Chatterjee's conditional graph correlation” }