EconBase
← All papers

Dimension Reduction for Conditional Density Estimation with Applications to High-Dimensional Causal Inference

Jianhua Mei, Fu Ouyang, Thomas T. Yang

arXiv 30 Jul 2025 · Econometrics

arXiv:2507.22312 · PDF · Extracted main text

Abstract

We propose a novel and computationally efficient approach for nonparametric conditional density estimation in high-dimensional settings that achieves dimension reduction without imposing restrictive distributional or functional form assumptions. To uncover the underlying sparsity structure of the data, we develop an innovative conditional dependence measure and a modified cross-validation procedure that enables data-driven variable selection, thereby circumventing the need for subjective threshold selection. We demonstrate the practical utility of our dimension-reduced conditional density estimation by applying it to doubly robust estimators for average treatment effects. Notably, our proposed procedure is able to select relevant variables for nonparametric propensity score estimation and also inherently reduce the dimensionality of outcome regressions through a refined ignorability condition. We evaluate the finite-sample properties of our approach through comprehensive simulation studies and an empirical study on the effects of 401(k) eligibility on savings using SIPP data.

Citation extraction

59
references
131
in-text mentions
59
distinct cited
0
self-citations
18,127
main-text words

appendix boundary found by appendix_command · 57% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Farrell, M. H., T. Liang, and S. Misra (2021) Deep neural networks for estimation and inference1.00063100%
2Chernozhukov, V., D. Chetverikov, M. Demirer, E. Duflo, C. Hansen, W… (2018) Double/debiased machine learning for treatment and structural parameters1.00053100%
3Wang, X., W. Pan, W. Hu, Y. Tian, and H. Zhang (2015) Conditional distance correlation0.92844100%
4Azadkia, M. and S. Chatterjee (2021) A simple measure of conditional dependence0.92844100%
5Hall, P., J. Racine, and Q. Li (2004) Cross-validation and the estimation of conditional probability densities0.80425652%
6Mai, Q. and H. Zou (2015) The fused Kolmogorov filter: A nonparametric model-free screening method0.73732100%
7Chernozhukov, V., C. Hansen, N. Kallus, M. Spindler, and V. Syrgkanis (2024) Applied causal inference powered by ML and AI0.73732100%
8Farrell, M (2015) Robust inference on average treatment effects with possibly more covariates than observations0.73732100%
9Gelber, A. M (2011) How do 401 (k) s Affect Saving? Evidence from Changes in 401 (k) Eligibility0.693131100%
10Benjamin, D. J (2003) Does 401 (k) eligibility increase saving? Evidence from propensity score subclassification0.69361100%

Showing the top 10 of 59 scored citations.