EconBase
← All papers

Mining Causality: AI-Assisted Search for Instrumental Variables

Sukjin Han

arXiv 21 Sep 2024 · Econometrics · 5 citations (OpenAlex)

arXiv:2409.14202 · PDF · DOI · OpenAlex · Extracted main text

Abstract

The instrumental variables (IVs) method is a leading empirical strategy for causal inference. Finding IVs is a heuristic and creative process, and justifying its validity -- especially exclusion restrictions -- is largely rhetorical. We propose using large language models (LLMs) to search for new IVs through narratives and counterfactual reasoning, similar to how a human researcher would. The stark difference, however, is that LLMs can dramatically accelerate this process and explore an extremely large search space. We demonstrate how to construct prompts to search for potentially valid IVs. We contend that multi-step and role-playing prompting strategies are effective for simulating the endogenous decision-making processes of economic agents and for navigating language models through the realm of real-world scenarios, rather than anchoring them within the narrow realm of academic discourses on IVs. We apply our method to three well-known examples in economics: returns to schooling, supply and demand, and peer effects. We then extend our strategy to finding (i) control variables in regression and difference-in-differences and (ii) running variables in regression discontinuity designs.

Citation extraction

57
references
76
in-text mentions
57
distinct cited
0
self-citations
13,051
main-text words

appendix boundary found by appendix_command · 92% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Imbens, G. W. and J. D. Angrist (1994) Identification and Estimation of Local Average Treatment Effects0.84333100%
2Ludwig, J. and S. Mullainathan (2024) Machine Learning as a Tool for Hypothesis Generation0.73732100%
3Angrist, J. D., K. Graddy, and G. W. Imbens (2000) The Interpretation of Instrumental Variables Estimators in Simultaneous Equations Models with an Application to the Demand for F…0.64441100%
4Du, T., A. Kanodia, H. Brunborg, K. Vafa, and S. Athey (2024) LABOR-LLM: Language-Based Occupational Representations with Large Language Models0.64422100%
5Heckman, J. J. and E. Vytlacil (2005) Structural Equations, Treatment Effects, and Econometric Policy Evaluation10.64422100%
6Pearl, J (2000) Causality: Models, Reasoning, and Inference0.64422100%
7Card, D. and A. B. Krueger (1994) Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania0.5112250%
8Ackerberg, D. A., K. Caves, and G. Frazer (2015) Identification Properties of Recent Production Function Estimators0.51121100%
9Card, D (1995) Using Geographic Variation in College Proximity to Estimate the Return to Schooling, in0.51121100%
10Card, D (2001) Estimating the return to schooling: Progress on some persistent econometric problems0.51121100%

Showing the top 10 of 57 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Large Language Models: An Applied Econometric Framework0.40511
2Can AI Master Econometrics? Evidence from Econometrics AI Agent on Expert-Level Tasks0.40511
3How Well Do LLMs Predict Human Behavior? A Measure of their Pretrained Knowledge0.40511
4CausalForge: A Formally Grounded, Self-Improving Agentic Framework for Automated Research in Causal Inference0.40511