EconBase
← All papers

Dual Instrumental Variable Regression

Krikamol Muandet, Arash Mehrjou, Si Kai Lee, Anant Raj

arXiv 27 Oct 2019 · Statistics — Machine Learning · 17 citations (OpenAlex)

arXiv:1910.12358 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We present a novel algorithm for non-linear instrumental variable (IV) regression, DualIV, which simplifies traditional two-stage methods via a dual formulation. Inspired by problems in stochastic programming, we show that two-stage procedures for non-linear IV regression can be reformulated as a convex-concave saddle-point problem. Our formulation enables us to circumvent the first-stage regression which is a potential bottleneck in real-world applications. We develop a simple kernel-based algorithm with an analytic solution based on this formulation. Empirical results show that we are competitive to existing, more complicated algorithms for non-linear instrumental variable regression.

Citation extraction

52
references
139
in-text mentions
52
distinct cited
2
self-citations
7,500
main-text words

appendix boundary found by appendix_command · 56% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Rahul Singh, Maneesh Sahani, and Arthur Gretton (2019) Kernel instrumental variable regression1.000155100%
2Bo Dai, Niao He, Yunpeng Pan, Byron Boots, and Le Song (2017) Learning from Conditional Distributions via Dual Embeddings1.000124100%
3Jason Hartford, Greg Lewis, Kevin Leyton-Brown, and Matt Taddy (2017) Deep IV: A flexible approach for counterfactual prediction1.000124100%
4Andrew Bennett, Nathan Kallus, and Tobias Schnabel (2019) Deep generalized method of moments for instrumental variable analysis0.92843100%
5Joshua D. Angrist and Jörn-Steffen Pischke (2008) Mostly Harmless Econometrics: An Empiricist's Companion0.874102100%
6Whitney K. Newey and James L. Powell (2003) Instrumental variable estimation of nonparametric models0.87472100%
7Alexander Shapiro, Darinka Dentcheva, and Andrzej Ruszczynski (2014) Lectures on Stochastic Programming: Modeling and Theory, Second Edition0.8434375%
8Krikamol Muandet, Kenji Fukumizu, Bharath Sriperumbudur, and Bernhar… (2017) Kernel mean embedding of distributions: A review and beyond self0.7374450%
9Luofeng Liao, You-Lin Chen, Zhuoran Yang, Bo Dai, Zhaoran Wang, and… (2020) Provably efficient neural estimation of structural equation model: An adversarial approach0.7373367%
10Joshua D. Angrist, Guido W. Imbens, and Donald B. Rubin (1996) Identification of causal effects using instrumental variables0.73732100%

Showing the top 10 of 52 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1The Variational Method of Moments1.00053
2Fast Instrument Learning with Faster Rates0.89475
3Stochastic Optimization Algorithms for Instrumental Variable Regression with Streaming Data0.874132
4Penalized GMM Framework for Inference on Functionals of Nonparametric Instrumental Variable Estimators0.64422
5Kernel Conditional Moment Test via Maximum Moment Restriction0.51142
6Minimax Instrumental Variable Regression and $L_2$ Convergence Guarantees without Identification or Closedness0.51121
7Minimax Kernel Machine Learning for a Class of Doubly Robust Functionals with Application to Proximal Causal Inference0.40521
8Learning Causal Models from Conditional Moment Restrictions by Importance Weighting0.40511
9Towards Principled Causal Effect Estimation by Deep Identifiable Models0.40511
10Inference on Strongly Identified Functionals of Weakly Identified Functions0.40511