EconBase
← All papers

De-Biased Machine Learning of Global and Local Parameters Using Regularized Riesz Representers

Victor Chernozhukov, Whitney Newey, Rahul Singh

arXiv 23 Feb 2018 · Statistics — Machine Learning · 26 citations (OpenAlex)

arXiv:1802.08667 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We provide adaptive inference methods, based on $\ell_1$ regularization, for regular (semi-parametric) and non-regular (nonparametric) linear functionals of the conditional expectation function. Examples of regular functionals include average treatment effects, policy effects, and derivatives. Examples of non-regular functionals include average treatment effects, policy effects, and derivatives conditional on a covariate subvector fixed at a point. We construct a Neyman orthogonal equation for the target parameter that is approximately invariant to small perturbations of the nuisance parameters. To achieve this property, we include the Riesz representer for the functional as an additional nuisance parameter. Our analysis yields weak “double sparsity robustness”: either the approximation to the regression or the approximation to the representer can be “completely dense” as long as the other is sufficiently “sparse”. Our main results are non-asymptotic and imply asymptotic uniform validity over large classes of models, translating into honest confidence bands for both global and local parameters.

Citation extraction

99
references
333
in-text mentions
218
distinct cited
15
self-citations
16,856
main-text words

appendix boundary found by appendix_command · 58% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chernozhukov, V., D. Chetverikov, M. Demirer, E. Duflo, C. Hansen, W… (2018) Double/debiased machine learning for treatment and structural parameters self0.96911591%
2Chernozhukov, V., W. K. Newey, and R. Singh (2018) Learning L2 continuous regression functionals via regularized Riesz representers self0.9507486%
3Chernozhukov, V., J. C. Escanciano, H. Ichimura, W. K. Newey, and J.… (2016) Locally robust semiparametric estimation self0.8746367%
4Belloni, A., V. Chernozhukov, and L. Wang (2014) Pivotal estimation via square-root lasso in nonparametric regression0.87452100%
5Semenova, V. and V. Chernozhukov (2021) Debiased machine learning of conditional average treatment effects and other causal functions0.8435360%
6Van der Vaart, A. W (2000) Asymptotic Statistics, Volume 30.8435360%
7Foster, D. J. and V. Syrgkanis (2019) Orthogonal statistical learning0.7373367%
Chernozhukovunmatched citation key Chernozhukov0.693141100%
Neweyunmatched citation key Newey0.693101100%
Belloniunmatched citation key Belloni0.69351100%

Showing the top 10 of 218 scored citations. 3 of these could not be matched to a bibliography entry, so only the citation key is shown.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Clustered Covariate Regression0.95684
2Long Story Short: Omitted Variable Bias in Causal Machine Learning0.92854
3Adversarial Estimation of Riesz Representers0.73743
4Regularized Orthogonal Machine Learning for Nonlinear Semiparametric Models0.40511
5Generalized Kernel Ridge Regression for Causal Inference with Missing-at-Random Sample Selection0.40511
6Robust Semiparametric Inference for Bayesian Additive Regression Trees0.40511
7Automatic Debiased Machine Learning of Structural Parameters with General Conditional Moments0.40511
8A Machine-Learning-Compatible Omnibus Test for Treatment Effect Heterogeneity0.40511
9Double Robustness for Complier Parameters and a Semiparametric Test for Complier Characteristics0.00021
10The Uncertainty of Machine Learning Predictions in Asset Pricing0.00011