EconBase
← All papers

Regularized Orthogonal Machine Learning for Nonlinear Semiparametric Models

Denis Nekipelov, Vira Semenova, Vasilis Syrgkanis

arXiv 13 Jun 2018 · Mathematics — Statistics Theory · publishedEconometrics Journal (2021) · 9 citations (OpenAlex)

arXiv:1806.04823 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper proposes a Lasso-type estimator for a high-dimensional sparse parameter identified by a single index conditional moment restriction (CMR). In addition to this parameter, the moment function can also depend on a nuisance function, such as the propensity score or the conditional choice probability, which we estimate by modern machine learning tools. We first adjust the moment function so that the gradient of the future loss function is insensitive (formally, Neyman-orthogonal) with respect to the first-stage regularization bias, preserving the single index property. We then take the loss function to be an indefinite integral of the adjusted moment function with respect to the single index. The proposed Lasso estimator converges at the oracle rate, where the oracle knows the nuisance function and solves only the parametric problem. We demonstrate our method by estimating the short-term heterogeneous impact of Connecticut's Jobs First welfare reform experiment on women's welfare participation decision.

Citation extraction

64
references
104
in-text mentions
64
distinct cited
2
self-citations
16,162
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Negahban, S. N., P. Ravikumar, M. J. Wainwright, and B. Yu (2012, Nov) (2012) A unified framework for high-dimensional analysis of $m$-estimators with decomposable regularizers1.00064100%
2Belloni, A., V. Chernozhukov, and Y. Wei (2016) Post-selection inference for generalized linear models with many controls0.87462100%
3van der Geer, S., P. Bühlmann, Y. Ritov, and R. Dezeure (2014) On asymptotically optimal confidence regions and tests for high-dimensional models0.87452100%
4Semenova, V., M. Goldman, V. Chernozhukov, and M. Taddy (2017, Decem… (2017) Estimation and inference about heterogeneous treatment effects in high-dimensional dynamic panels self0.73732100%
5Ichimura, H (1993) Semiparametric least squares (sls) and weighted sls estimation of single-index models0.73732100%
6Newey, W. (1994, November) (1994) The asymptotic variance of semiparametric estimators0.73732100%
7Shalev-Shwartz, S. and S. Ben-David (2014) Understanding Machine Learning: From Theory to Algorithms0.73732100%
8Chernozhukov, V., D. Chetverikov, M. Demirer, E. Duflo, C. Hansen, W… (2018) Double/debiased machine learning for treatment and structural parameters0.73732100%
9Klein, R. and R. Spady (1993) An efficient semiparametric estimator for binary response models0.73732100%
10Chernozhukov, V., J. C. Escanciano, H. Ichimura, W. K. Newey, and J.… (2016) Locally Robust Semiparametric Estimation0.64422100%

Showing the top 10 of 64 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Double/Debiased Machine Learning for Dynamic Treatment Effects via $g$-Estimation0.64422
2Stable Probability Weighting Large-Sample and Finite-Sample Estimation and Inference Methods for Heterogeneous Causal Effects of Multivalued Treatments Under Limited Overlap0.51121
3Estimation of Heterogeneous Treatment Effects Using a Conditional Moment Based Approach0.40511