EconBase
← All papers

Policy Evaluation during a Pandemic

Brantly Callaway, Tong Li

arXiv 14 May 2021 · Econometrics · publishedJournal of Econometrics (2023) · 33 citations (OpenAlex)

arXiv:2105.06927 · PDF · DOI · OpenAlex · Extracted main text

Abstract

National and local governments have implemented a large number of policies in response to the Covid-19 pandemic. Evaluating the effects of these policies, both on the number of Covid-19 cases as well as on other economic outcomes is a key ingredient for policymakers to be able to determine which policies are most effective as well as the relative costs and benefits of particular policies. In this paper, we consider the relative merits of common identification strategies that exploit variation in the timing of policies across different locations by checking whether the identification strategies are compatible with leading epidemic models in the epidemiology literature. We argue that unconfoundedness type approaches, that condition on the pre-treatment "state" of the pandemic, are likely to be more useful for evaluating policies than difference-in-differences type approaches due to the highly nonlinear spread of cases during a pandemic. For difference-in-differences, we further show that a version of this problem continues to exist even when one is interested in understanding the effect of a policy on other economic outcomes when those outcomes also depend on the number of Covid-19 cases. We propose alternative approaches that are able to circumvent these issues. We apply our proposed approach to study the effect of state level shelter-in-place orders early in the pandemic.

Citation extraction

72
references
94
in-text mentions
72
distinct cited
3
self-citations
19,401
main-text words

appendix boundary found by appendix_command · 85% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Blundell, Richard, Costa Dias, Monica (2009) Alternative approaches to evaluation in empirical microeconomics0.73732100%
2Callaway, Brantly, Sant'Anna, Pedro HC (2021) Difference-in-differences with multiple time periods self0.73732100%
3Goodman-Bacon, Andrew, Marcus, Jan (2020) Using difference-in-differences to identify causal effects of COVID-19 policies0.73732100%
4Goolsbee, Austan, Syverson, Chad (2021) Fear, lockdown, and diversion: Comparing drivers of pandemic economic decline 20200.73732100%
5Dave, Dhaval, Friedson, Andrew I, Matsuzawa, Kyutaro, Sabia, Joseph J (2021) When do shelter-in-place orders fight COVID-19 best? Policy heterogeneity across states and adoption time0.64441100%
6Berry, Christopher R, Fowler, Anthony, Glazer, Tamara, Handel-Meyer,… (2021) Evaluating the effects of shelter-in-place policies during the COVID-19 pandemic0.64422100%
7Chernozhukov, Victor, Kasahara, Hiroyuki, Schrimpf, Paul (2021) Causal impact of masks, policies, behavior on early Covid-19 pandemic in the US0.64422100%
8Courtemanche, Charles, Garuccio, Joseph, Le, Anh, Pinkston, Joshua,… (2020) Strong social distancing measures in the United States reduced the COVID-19 growth rate0.64422100%
9Dave, Dhaval M, Friedson, Andrew I, Matsuzawa, Kyutaro, McNichols, D… (2020) Did the Wisconsin Supreme Court restart a COVID-19 epidemic? Evidence from a natural experiment0.64422100%
10Dave, Dhaval, Friedson, Andrew, Matsuzawa, Kyutaro, Sabia, Joseph J,… (2020) Were urban cowboys enough to control COVID-19? Local shelter-in-place orders and coronavirus case growth0.64422100%

Showing the top 10 of 72 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Evaluating Policies Early in a Pandemic: Bounding Policy Effects with Nonrandomly Missing Data0.92843
2On the Use of Two-Way Fixed Effects Models for Policy Evaluation During Pandemics0.51121
3Treatment Effects in Interactive Fixed Effects Models with a Small Number of Time Periods0.40511
4Difference in Differences with Time-Varying Covariates0.40511
5Recent Advances in Causal Analysis of the Stochastic Frontier Model0.40511