EconBase
← All papers

Program Evaluation with Remotely Sensed Outcomes

Ashesh Rambachan, Rahul Singh, Davide Viviano

arXiv 17 Nov 2024 · Econometrics

arXiv:2411.10959 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Economists often estimate treatment effects in experiments using remotely sensed variables (RSVs), e.g. satellite images or mobile phone activity, in place of directly measured economic outcomes. A common practice is to use an observational sample to train a predictor of the economic outcome from the RSV, and then to use its predictions as the outcomes in the experiment. We show that this method is biased whenever the RSV is post-outcome, i.e. if variation in the economic outcome causes variation in the RSV. In program evaluation, changes in poverty or environmental quality cause changes in satellite images, but not vice versa. As our main result, we nonparametrically identify the treatment effect by formalizing the intuition that underlies common practice: the conditional distribution of the RSV given the outcome and treatment is stable across the samples.Based on our identifying formula, we find that the efficient representation of RSVs for causal inference requires three predictions rather than one. Valid inference does not require any rate conditions on RSV predictions, justifying the use of complex deep learning algorithms with unknown statistical properties. We re-analyze the effect of an anti-poverty program in India using satellite images.

Citation extraction

80
references
144
in-text mentions
80
distinct cited
1
self-citations
14,300
main-text words

appendix boundary found by appendix_command · 40% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chamberlain, G (1987) Asymptotic efficiency in estimation with conditional moment restrictions0.9416483%
2Newey, W. K (1993) Efficient estimation of models with conditional moment restrictions0.9285480%
3Jack, B. K., S. Jayachandran, N. Kala, and R. Pande (2025) Money (not) to burn: Payments for ecosystem services to reduce crop residue burning0.85113462%
4Athey, S., R. Chetty, G. W. Imbens, and H. Kang (2025, 09) (2025) The surrogate index: Combining short-term proxies to estimate long-term treatment effects more rapidly and precisely0.8434375%
5Prentice, R. L (1989) Surrogate endpoints in clinical trials: Definition and operational criteria0.8434375%
6Huang, L. Y., S. M. Hsiang, and M. Gonzalez-Navarro (2021) Using satellite imagery and deep learning to evaluate the impact of anti-poverty programs0.84333100%
7Jean, N., M. Burke, M. Xie, W. M. Davis, D. B. Lobell, and S. Ermon (2016) Combining satellite imagery and machine learning to predict poverty0.84333100%
8Muralidharan, K., P. Niehaus, and S. Sukhtankar (2016) Building state capacity: Evidence from biometric smartcards in India0.84333100%
9Muralidharan, K., P. Niehaus, and S. Sukhtankar (2023) General equilibrium effects of (improving) public employment programs: Experimental evidence from India0.79410550%
10Asher, S., T. Lunt, R. Matsuura, and P. Novosad (2021) Development research at high geographic resolution: An analysis of night-lights, firms, and poverty in India using the SHRUG ope…0.7375340%

Showing the top 10 of 80 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1A Unifying Framework for Robust and Efficient Inference with Unstructured Data0.64422
2Econometric Inference with Machine-Learned Proxies: Partial Identification via Data Combination0.51121
3Inference for Regression with Variables Generated by AI or Machine Learning0.40511
4Identification of Long-Term Treatment Effects via Temporal Links, Observational, and Experimental Data0.40511
5Linear Regressions with Combined Data0.40511
6Large Language Models: An Applied Econometric Framework0.40511
7Causal Inference on Outcomes Learned from Text0.40511
8The Identification Power of Combining Experimental and Observational Data for Distributional Treatment Effect Parameters0.40511
9Learning What to Learn: Experimental Design when Combining Experimental with Observational Evidence0.40511
10Making Interpretable Discoveries from Unstructured Data: A High-Dimensional Multiple Hypothesis Testing Approach0.40511