EconBase
← All papers

Non-Parametric Inference Adaptive to Intrinsic Dimension

Khashayar Khosravi, Greg Lewis, Vasilis Syrgkanis

arXiv 11 Jan 2019 · Machine Learning · 4 citations (OpenAlex)

arXiv:1901.03719 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We consider non-parametric estimation and inference of conditional moment models in high dimensions. We show that even when the dimension $D$ of the conditioning variable is larger than the sample size $n$, estimation and inference is feasible as long as the distribution of the conditioning variable has small intrinsic dimension $d$, as measured by locally low doubling measures. Our estimation is based on a sub-sampled ensemble of the $k$-nearest neighbors ($k$-NN) $Z$-estimator. We show that if the intrinsic dimension of the covariate distribution is equal to $d$, then the finite sample estimation error of our estimator is of order $n^{-1/(d+2)}$ and our estimate is $n^{1/(d+2)}$-asymptotically normal, irrespective of $D$. The sub-sampling size required for achieving these results depends on the unknown intrinsic dimension $d$. We propose an adaptive data-driven approach for choosing this parameter and prove that it achieves the desired rates. We discuss extensions and applications to heterogeneous treatment effect estimation.

Citation extraction

64
references
142
in-text mentions
65
distinct cited
3
self-citations
29,135
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Susan Athey, Julie Tibshirani, and Stefan Wager (2019) Generalized random forests1.000164100%
2Stefan Wager and Susan Athey (2018) Estimation and inference of heterogeneous treatment effects using random forests1.000136100%
3Yingying Fan, Jinchi Lv, and Jingbo Wang (2018) Dnn: A two-scale distributional tale of heterogeneous treatment effect inference1.000124100%
4Miruna Oprescu, Vasilis Syrgkanis, and Zhiwei Steven Wu (2018) Orthogonal random forest for heterogeneous treatment effect estimation self1.000105100%
5Samory Kpotufe (2011) $k$-nn regression adapts to local intrinsic dimension1.00095100%
6Sanjoy Dasgupta and Yoav Freund (2008) Random projection trees and low dimensional manifolds1.00053100%
7Samory Kpotufe and Sanjoy Dasgupta (2012) A tree-based regressor that adapts to intrinsic dimension0.87452100%
8Victor Chernozhukov, Denis Chetverikov, Mert Demirer, Esther Duflo,… (2018) Double/debiased machine learning for treatment and structural parameters0.81142100%
9Samory Kpotufe and Vikas Garg (2013) Adaptivity to local smoothness and dimension in kernel regression0.81142100%
10Susan Athey and Guido Imbens (2016) Recursive partitioning for heterogeneous causal effects0.64422100%

Showing the top 10 of 65 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Simultaneous Inference for Local Structural Parameters with Random Forests$^*$0.87452
2Debiased Machine Learning without Sample-Splitting for Stable Estimators0.51122
3Efficient Policy Learning from Surrogate-Loss Classification Reductions0.40511
4Adversarial Estimation of Riesz Representers0.40511
5On the adaptation of causal forests to manifold data0.40511