EconBase
← All papers

Assessing the Sensitivity of Synthetic Control Treatment Effect Estimates to Misspecification Error

Billy Ferguson, Brad Ross

arXiv 30 Dec 2020 · Econometrics

arXiv:2012.15367 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We propose a sensitivity analysis for Synthetic Control (SC) treatment effect estimates to interrogate the assumption that the SC method is well-specified, namely that choosing weights to minimize pre-treatment prediction error yields accurate predictions of counterfactual post-treatment outcomes. Our data-driven procedure recovers the set of treatment effects consistent with the assumption that the misspecification error incurred by the SC method is at most the observable misspecification error incurred when using the SC estimator to predict the outcomes of some control unit. We show that under one definition of misspecification error, our procedure provides a simple, geometric motivation for comparing the estimated treatment effect to the distribution of placebo residuals to assess estimate credibility. When we apply our procedure to several canonical studies that report SC estimates, we broadly confirm the conclusions drawn by the source papers.

Citation extraction

27
references
91
in-text mentions
27
distinct cited
0
self-citations
14,344
main-text words

appendix boundary found by appendix_command · 79% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Alberto Abadie, Alexis Diamond, and Jens Hainmueller (2010) Synthetic control methods for comparative case studies: Estimating the effect of california’s tobacco control program1.000243100%
2Alberto Abadie (2020) Using synthetic controls: Feasibility, data requirements, and methodological aspects1.000114100%
3Matias D Cattaneo, Yingjie Feng, and Rocio Titiunik (2019) Prediction intervals for synthetic control methods0.9416483%
4Alberto Abadie, Alexis Diamond, and Jens Hainmueller (2015) Comparative politics and the synthetic control method0.9285480%
5Victor Chernozhukov, Kaspar Wuthrich, and Yinchu Zhu (2017) An exact and robust conformal inference method for counterfactual and synthetic controls0.8435360%
6Victor Chernozhukov, Kaspar Wuthrich, and Yinchu Zhu (2018) Practical and robust $ t $-test based inference for synthetic control and related methods0.84333100%
7Stephen P Boyd and Lieven Vandenberghe (2004) Convex optimization0.7374350%
8Giovanni Peri and Vasil Yasenov (2019) The labor market effects of a refugee wave synthetic control method meets the mariel boatlift0.64441100%
9Alberto Abadie and Jeremy L’Hour (2018) A penalized synthetic control estimator for disaggregated data0.6443267%
10Maxwell Kellogg, Magne Mogstad, Guillaume Pouliot, and Alexander Tor… (2020) Combining matching and synthetic controls to trade off biases from extrapolation and interpolation0.6443267%

Showing the top 10 of 27 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Distributionally Robust Synthetic Control: Ensuring Robustness Against Highly Correlated Controls and Weight Shifts0.40511
2Synthetic Parallel Trends0.40511