Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
44,286 characters · 17 sections · 37 citation commands
On the Misspecification of Linear Assumptions in Synthetic Control
The synthetic control (SC) method is a popular approach for analyzing observational panel data to estimate causal effects abadie2021using. SC has been widely used in science pieters2016effect and social science heersink2017disasters, as well as for evaluating public policies donohue2019right,pinotti2015economic, allegretto2017credible.\looseness=-1
The typical SC setup involves measurements of an outcome variable over time. One unit, called the target, received an intervention at a certain time. The other units, called donors, never received an intervention. The goal of SC is to estimate the target's counterfactual outcomes. What would have happened had it not received the intervention?
Example: The panel data in (ref) (left) contains cigarette sales across states and time. In 1988 California implemented a program that increased the tobacco tax by 25 cents. After 1988, how much would Californians have smoked had the program not been implemented? Here, California is the target; the other states are the donors.
The idea behind SC is to approximate the target's control outcomes---the smoking rate in California without its policy---with a weighted combination of the donor's control outcomes. In the example, SC uses data from the pre-policy periods to fit California's pre-policy smoking rates as a weighted combination of the other states' smoking rates. It then uses its fitted weights to estimate the smoking rate in California after 1988, had the policy not been introduced. These estimates, along with California's post-policy rates, help assess the causal effect of the policy.
What justifies this procedure? In its original formulation, abadie2010synthetic shows that SC is justified if the control outcomes follow a linear factor model, where a per-period factor linearly combines with a per-unit factor. Following this work, shi2022assumptions shows that the linear factor model itself can be justified through assumptions about the individuals within each unit (e.g., people within each state) and invariances around the causal structure of the individual-level outcomes (e.g., whether they smoke). But whether at the aggregate or individual level, these assumptions point to the same requirement: that the target need to be expressed as a linear combination of the donors.
What if this requirement is not satisfied? What if California is not a linear combination of the other states? This paper studies the practical situation where the synthetic control is misspecified. We study how to quantify this misspecification error and how to minimize it.
In detail, we derive two bounds on the SC error, the M bound and the James Bound. Both bounds build on the causal framework of shi2022assumptions. It assumes a set of invariant causes, variables that govern the individual-level outcomes in the same way across units, and where the difference between the units' outcomes involves different distributions of those causes. For example, whether someone smokes might be caused by their age and education level, and the difference between California's and Nevada's smoking rates lies in their different population distributions of those demographic variables. Our theory shows how the similarity between the true target distribution of the causes and its synthetic distribution, induced by the SC weights, helps bound the error of the corresponding SC estimates.
We then consider a situation where we additionally observe external data about the invariant causes, such as demographic information about each state. We show how to use such data to estimate the misspecification interval for a fixed set of SC weights, and we develop two new algorithms for estimating SC weights that explicitly minimize the width of this interval. (One algorithm assumes we observe all invariant causes; the other does not make that assumption, but provides wider misspecification intervals.)
Thus this paper provides a new form of SC analysis, one where we analyze panel data and demographic data together to estimate the target counterfactual and assess its robustness to misspecification. (ref) illustrates this analysis on the California tobacco data, now also using additional data from the U.S. census about per-state demographics. Our estimators show that the observed outcome in the pre-policy period lies within the bounds of misspecification error, and that the observed outcome post-policy lies outside of those bounds. These results suggest that California's 1988 anti-tobacco program had a true effect, despite possible misspecification of the synthetic control.
\parhead{Related Work.} This paper contributes to the literature on synthetic controls abadie2003economic, abadie2010synthetic. The M-bound and James-bound estimators of (ref) contribute to research on novel SC estimators abadie2011bias, abadie2015comparative, doudchenko2016balancing, xu2017generalized, amjad2018robust, amjad2019mrsc, li2020statistical, athey2021matrix, imbens2021controlling. Notably, several estimators penalize the optimization objective abadie2021penalized or adjust the weights kellogg2021combining to select donors with outcomes similar to the target. Including covariates in the estimator is recommended in abadie2003economic but is not mathematically justified. In contrast, the M and James bounds justify why selecting similar donors is important for estimation.
This paper also contributes to the literature on SC methods that are robust to misspecifications. Many existing works make additional assumptions; for example, outcomes follow linear factor models ben2021augmented, latent factors are perfectly matched amjad2018robust, powell2018imperfect, ferman2021synthetic, treatments are assigned randomly abadie2015comparative, or many time points are observed chernozhukov2021exact. In contrast, we leverage external data to quantify the errors.
We review the assumptions behind synthetic controls, the fine-grained model of shi2022assumptions, and formulate the problem of how to characterize the misspecification error induced by violation of the linearity assumptions.
Consider a panel dataset containing outcome measurements $y_{jt}$ for units $j\in \llbracket 0, J \rrbracket$ over time periods $t\in\llbracket 0, T \rrbracket$. Unit $j=0$ is the target. It has received an intervention at $T_0$ that may have affected its outcomes $y_{0t}$ for $t \geq T_0$. The remaining units are donors. They did not receive an intervention.
For each unit and time, define a pair of potential outcomes $(Y_{jt}, \widetilde{Y}_{jt})$, where $\widetilde{Y}_{jt}$ is the potential outcome of unit $j$ at time $t$ in the world where $j$ received intervention at $T_0$, while $Y_{jt}$ is the potential outcome in a world with no intervention. For $j=0$ and $t \geq T_0$, $y_{jt} =\widetilde{Y}_{jt}$, otherwise, $y_{jt} = Y_{jt}$.
Our causal question is, what would the target counterfactual be, had the intervention not occurred? We would like to estimate $Y_{0t}$ for $t \geq T_0$.
Synthetic control methods estimate the counterfactual outcomes of the target $Y_{0t}, t \geq T_0$ with a weighted combination of the outcomes of the donors: $Y_{0t} = \sum_j w_j y_{jt}$. The SC weights are fitted from the pre-intervention outcomes,
The validity of SC relies on two conditions: (1) During the pre-intervention period, the target's outcomes can be written as a weighted combination of the control units' outcomes. (2) The weighted combination from the pre-intervention periods generalizes to the post-intervention periods.
As a first step to obtain these two conditions, abadie2010synthetic and most other works assume that the outcomes under no intervention are generated by a linear factor model bai2009panel, abadie2010synthetic, ben2021augmented, ferman2021synthetic. We call it assumption A1.
Then, abadie2010synthetic assumes that the target's outcomes can be written as a convex combination of the donors' outcomes. This implies that the target's latent factor is a convex combination of the donors' latent factors, we it call A2.\looseness=-1
With assumptions A1 and A2 in hand, estimator ((ref)) will identify the weights of A2. These weights will then estimate the untreated potential outcomes using the factor model A1. With assumptions A1 and A2, synthetic control is possible.
When does the linear factor model assumption A1 hold in practice? shi2022assumptions explores a justification.
First, the authors notice that SC often considers large units composed of multiple individuals (states, countries) and aggregated outcomes that are averages of individual-level outcomes (per-capita cigarette consumption). Therefore, they propose a “fine-grained" model of synthetic controls, which introduces individual-level variables. The variable $Y_{ijt}$ denotes individual $i$'s outcome in unit $j$ at time $t$ (their cigarette consumption at time $t$). The outcome of each unit $Y_{jt}$ is the average of the individual outcomes in the unit.
Second, shi2022assumptions posits the idea of invariant causes, which we denote as $x_{ijt}$. The invariant causes $x_{ijt}$ are individual-level variables that follow two invariance assumptions. (1) When conditioned on the invariant causes, the individual-level outcomes do not depend on which unit the individual is from. This way, $x \mapsto \mathbb{E}\ifx\\\left[\right]\\\else_{}\fi \left[Y_{ijt} | x_{ijt}=x\right]$ is the same function for all $i$ and $j$; we write it $\mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y | x\right]$. (2) The distribution of the invariant causes in each unit can change from unit to unit but remain the same across time. The distribution of invariant causes over the individuals in unit $j$ is denoted $x \mapsto p_j(x)$, with no dependence in $t$.
Finally, with these individual-level variables, shi2022assumptions shows that the unit-level outcomes are
Further, if the distributions of invariant causes $p_j$ are discrete and finite then (ref) becomes a finite sum,
Thus (ref) justifies the linear factor model A1 and provides context about what the latent factors might represent.
Regarding A2, shi2022assumptions still assumes it; it rewrites,
where the equality is in the space of probability distributions.
shi2022assumptions explains where the linear factor model A1 can come from. However, even with the fine-grained approach, the factor model arises from the strong assumption of discrete and finite causes, which might not hold in practice. In other words, the factor model A1 is not guaranteed.
The convex combination A2 is also a key assumption that is unlikely to hold in practice. With a limited number of donors, the $p_j$ (or $\mu_j$) can be linearly independent. And with continuous invariant causes, the $p_j$ are densities, making it impossible to match $p_0$ even with infinitely many donors.
In this work, we relax A1 and A2. To relax A1, we use the fine-grained model of shi2022assumptions but do not assume that causes are discrete and finite. To relax A2, is the focus of the paper. When A2 is violated, the target is not a convex combination of the donors. The synthetic control is misspecified, which leads to errors in the estimation of causal effects. Formally, we define the misspecification error as the absolute difference between the expected counterfactual outcome and the synthetic outcome (after intervention):
We turn to the problem of how to bound and minimize this error. We will show how to leverage external data about the invariant causes -- such as demographic data from the census -- to estimate a misspecification interval for the synthetic outcomes. We then derive new ways to fit the SC weights that minimize the width of that interval. The result is a new type of estimate of the SC counterfactual, and an assessment of its sensitivity to the linearity misspecification of A2.
In this section, we derive an exact bound that quantifies errors induced by violation of A2. Using this bound, we develop an estimator minimizing A2 misspecification errors.
Let $\hat{p}_0$ be the synthetic distribution, defined as $\hat p_0(w) = \sum_j w_j p_j$. We examine the difference between the distribution of the target unit $p_0$ and the synthetic distribution $\hat p_0$. If $p_0 \neq \hat p_0$ but $\hat p_0$ remains “close” to $p_0$, we expect the synthetic control estimate to remain approximately correct, \[ \mathbb{E}\ifx\\\left[\right]\\\else_{}\fi \left[Y_{0t}\right] \approx \sum_{j=1}^J w_j \mathbb{E}\ifx\\\left[\right]\\\else_{}\fi \left[Y_{jt}\right]. \] We formalize this intuition by bounding the errors resulting from the misspecification of A2.
The proof is in (ref).
The Wasserstein distance $W_1$ is a distance between probability distributions villani2009optimal. It quantifies the differences between the true population distribution $p_0$ and the synthetic population distribution $\hat p_0$.
For any set of weights $w$, the M bound ((ref)) circumscribes the error of the SC estimate by a function of the weights, the population distributions of each unit (the $p_j$), and the sensitivity of the outcome variables to the variation of the causes (the Lipschitz constant $\ell$).
If $p_0 = \hat p_0$, then the Wasserstein distance $W_1\bigl(p_0, \hat p_0)$ between the true and the synthetic distribution is zero. The M bound recovers that the SC estimate is correct. When $p_0 \neq \hat p_0$, the M bound shows that the estimation error is proportional to the distance $W_1\bigl(p_0, \hat p_0)$.
The intuition behind (ref) is that when a misspecification occurs, a portion of the population $p_0$ is approximated with an incorrect portion of the synthetic population $\hat p_0$. It is unpredictable how these populations will behave. In the worst case, their outcomes can differ by at most the distance between them (captured by $W_1$) and the maximum possible variation of the conditional outcome (captured by $\ell$). Hence, the M bound proves (theoretically) that a small misspecification induces a small estimation error.
We established the M bound, which quantifies the misspecification error for any set of weights $w$. To find weights with minimal misspecification error, we develop the M-bound estimator. See (ref).
The M-bound estimator takes population distribution data $p_j$ for each unit as input and returns a set of weights that minimizes the M bound. To obtain the weights, it uses projected gradient descent with the following objective,
Notice it computes the SC weights using the population distribution of each unit. It does not use the outcomes data.
After obtaining a set of weights from (ref), we can use (ref) with an estimated constant $\ell$ to create a misspecification interval around the synthetic control estimate,
where $\hat y_{0t} := \sum_{j=1}^J w_j y_{jt}, ~M := \ell \cdot W_1\left( p_{0}, \hat p_0 \right)$. Thus, the M bound, with its associated estimator and misspecification interval, can be used to discover causal effects.
In (ref), we revisit the California tobacco example. We use demographic data of each US state to form the invariant causes distributions $p_j$ and fit the M-bound estimator with these $p_j$. Like standard SC, the weights returned by the estimator are used to form the synthetic outcomes. In addition, the M bound provides misspecification intervals accounting for the A2 misspecification error. (ref) illustrates the synthetic control estimate with its misspecification interval generated by the M-bound estimator. We see that California's observed outcomes lie within the interval before intervention and escape it after the intervention. This suggests that a causal effect is present, even in case of misspecification.\looseness=-1
In (ref), we derived a theoretical bound on misspecification error and showed how to use the M-bound estimator to detect a causal effect. In theory, the true outcome is guaranteed to lie within the M bound. In practice, the misspecification interval produced by the M bound is only valid if we observe the distribution of all invariant causes $p_j$. Observing all invariant causes is a strong assumption that may not hold.
Here, we consider the setting where the invariant causes are only partially observed. We first derive a new error bound, the James bound, that accounts for misspecification on both the observed and unobserved causes. The James bound leverages the pre-intervention outcome data to estimate the influence of the unobserved causes on the outcome variable. To find the weights that minimize the James bound, we develop the James-bound estimator. Finally, we discuss when it is appropriate to use the M bound versus the James bound.\looseness=-1
So far, we have used $x$ to denote all the invariant causes. With a redefinition of notation, we now refer to the observed causes as $x$, and the unobserved causes as $z$. Such that (ref) becomes $\mathbb{E}\ifx\\\left[\right]\\\else_{}\fi \left[Y_{jt}\right] = \int_{(x,z)}p_j(x,z) \mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y|x,z\right]\text{d}x\text{d}z$.
In general, we cannot bound the effect of unobserved variables without further assumptions. Here, we assume that the unobserved causes and observed causes are independent and that their respective effect on the outcome can be decomposed into two distinct terms, this is A3. We note that A1, which we relaxed, was more restrictive than A3.
We note that the distributions of the observed causes $x\mapsto p_j(x)$ and the unobserved causes $z\mapsto p_j(z)$ remain arbitrary, and so are $g_t$ and $h_t$.
With A3, we have “just another misspecification error” bound, the James bound.
The proof is in (ref).
The first term ((ref)) mirrors the M bound. It quantifies the similarity between the target and synthetic unit's distributions of observed causes, $x\mapsto p_0(x)$ and $x\mapsto \hat p_0(x)$.
The second term ((ref)) measures the goodness of fit of the pre-intervention outcomes. It indirectly estimates the similarity between the target and the synthetic unit's distributions of unobserved causes, $z\mapsto p_j(z)$ and $z\mapsto \hat p_j(z)$.
The last term ((ref)) contains the remaining error terms. We cannot compute this term directly because it contains unobserved quantities. In (ref), we argue that this term is small, and we may ignore it in practice. We also present two explicit models in which the term is null and show that it is null in the standard SC factor model.
Building on the James bound ((ref)), we derive the James-bound estimator. The estimator identifies the weights that minimize the following objective,
where $\lambda$ is a hyperparameter. We update (ref) into a minimization algorithm for this objective function, it is reported in (ref).
If hyperparameter $\lambda$ is set to $\ell$, and if term ((ref)) is effectively negligible, then (ref) is precisely the James bound. Otherwise, it can be viewed as the pre-intervention errors (first term), regularized by the Wasserstein distance over external data (second term). With this perspective, the James-bound estimator finds weights that minimize pre-intervention errors while favoring donors that are similar to the target.\looseness=-1
We introduced two bounds, along with associated estimators and misspecification intervals. M bounds are tighter but require data about all the invariant causes. James bounds can be wider but require fewer data.
As a practical guide, we recommend using the James-bound estimator first. It is indeed more prudent to assume that some invariant causes might be unobserved. If the post-intervention target outcomes fall outside the misspecification interval, we have discovered a causal effect robust to A2 misspecification (see (ref)).
If the post-intervention misspecification interval is too wide to detect a causal effect, then it could be that there is no causal effect. But it could also be that there is too much misspecification to use SC or that the James bound is too loose. We cannot conclude in favor of a causal effect in the first two cases. To check if the James bound is too loose and find a tighter bound, we can use the M bound.
The M bound is guaranteed valid if all invariant causes are observed. Since the M estimator does not use outcome data, the target's pre-intervention outcomes can be used as a validation set. If the observed pre-intervention outcomes fall outside the predicted misspecification interval, not all invariant causes were observed, and we cannot apply the M bound. Otherwise, we may use the M bound.\looseness=-1
We examine the M-bound and James-bound estimators using synthetic and tobacco consumption data. With synthetic data, we demonstrate that the M-bound and James-bound estimators produce better estimates in case of misspecification, and show that their misspecification intervals contain the counterfactual outcomes correctly. Using the tobacco consumption case study, we demonstrate how to collect external data and how to choose between M-bound and James-bound estimators. We find that the post-intervention California outcomes escape the misspecification error bound, suggesting that there is an actual causal effect.\looseness=-1
\parhead{Implementation Details.} To implement the algorithms we need to manipulate probability distributions and calculate Wasserstein distances with their gradients. Our implementation expects the input $p_j$ to be non-parametric distributions represented by a collection of atoms and associated probabilities: $p_j = \sum_{x\in X} \delta_{x}\cdot p_j(x)$, where $X$ is the set of atoms and $\delta_x$ is a point mass at $x$. If $p_j$ is discrete, such as a histogram, then the atoms are the possible values of the causes, and $p_j(x)$ their associated probabilities. If $p_j$ is continuous, then the atoms are samples of $p_j$, and $p_j(x)$ is the normalized density at $x$. For all experiments, we compute the gradients of $ (w_1, ..., w_J) \mapsto W_1\bigl(p_0, \sum_j w_j p_j \bigr),$ using the Python Optimal Transport library flamary2021pot coupled with PyTorch pytorch2019. We use gradient descent with a learning rate $\alpha=5\cdot 10^{-6}$ and $200,000$ epochs.\looseness=-1
\parhead{Data Description.} We generate synthetic data by defining the conditional distribution $\mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y | x\right] = f(x,t)$ and the causes distributions $p_j(x)$. We create six different units (called g20, g45, g50, g60, g65, g70), and consider that a single cause $x \in \mathbb{R}$ impacts the outcome $Y$. The units can be thought of as different groups of people (e.g. cities), and the cause $x$ as the age of each individual in these groups. The six units have different distributions of age (group gX has an average age of X). The target group is g45, the panel duration is $T=50$, and the intervention time is $T_0=15$.
The closed form equations of $(t,x) \mapsto \mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y | x\right]$ and $(j,x) \mapsto p_j(x)$ are in (ref) while (ref) shows the evolution of $x \mapsto \mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y | x\right]$ over time $t$ as well as the distributions $x \mapsto p_j(x)$ for each unit $j$. The expected outcome $\mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y | x\right]$ varies over time, in different ways for each $x$.
We input the distributions $p_j$ to (ref) and obtain the weights that minimize the M bound. As a comparison, we calculate the weights obtained from the standard SC in (ref). We report the weights and the induced synthetic outcomes in (ref). Furthermore, we compute $\ell = 4.0$ from $x \mapsto \mathbb{E}\ifx\\\left[t\right]\\\else_{t}\fi \left[Y\mid x\right]$ (valid for all $t$). This way, we obtain the exact value of the M-bound and we can form the misspecification interval of (ref), shaded on (ref).
\parhead{Analysis.} As shown in (ref), the standard SC places a large weight on donor g20, which is a unit whose individuals are very different from g45 but with similar pre-treatment outcomes. When time increases, the individuals in g20 and g45 evolve differently and the synthetic outcome of the standard SC weights deviates away from the true outcome. In contrast, the M-bound estimator places most of the weight mass on the donor g50, which contains individuals with similar $x$ as the target g45. By doing so, the synthetic outcomes might not exactly match the g45 outcomes, but they generalize better over time. We also verify that the true outcome is always contained in the misspecification interval ((ref)). We repeat the analysis with the James bound and obtain the same conclusions, reported in (ref).
With external data, we estimated the misspecification error and limited it using the M-bound and James-bound estimators. Without external data, standard SC was incorrect.
We revisit the tobacco study from abadie2010synthetic to illustrate how to collect external data, apply different estimators, and calculate the misspecification intervals.
\parhead{Prop 99. } A tobacco control program was passed in California in 1988, which increased tobacco taxes by 25 cents. The tax revenue was used to fund anti-tobacco campaigns. Our goal is to estimate the causal effect of the tobacco control program on California's tobacco consumption.
The tobacco panel dataset ((ref)) is from the taxburden2019, which provides the per capita tobacco consumption for 50 states from 1970 to 2019. The intervention of interest is the tobacco program, Prop 99. The observed outcomes for California after 1988 are under intervention. All the other observed outcomes in the dataset are assumed to be under no intervention.
\parhead{External Data Collection.} First, we identify the potential causes of smoking. According to turner2004individual, smoking is heavily influenced by societal and cultural factors. While these factors are difficult to measure directly, they are often correlated with demographics. Several studies have found that cigarette consumption varies significantly by age, gender, race, and ethnicity sakuma2016tobacco, cornelius2022tobacco. As a result, we use age, sex, and ethnicity/race as proxies for the causes of smoking.
We use the American Community Survey (ACS) to formulate a distribution of causes for each unit. The ACS is a demographics survey program conducted continuously by the U.S. Census Bureau censusbureau2020acs. It reports population demographics at different geographical scales, from city boroughs to states. We accessed the ACS data with the Census Reporter API censusreporter. For each state, the ACS provides the joint distribution of the variables age, race, sex. Each variable is discretized into multiple bins: age into 14 bins (e.g. 15 to 17, 20 to 24 years old), race takes 8 values (Asian, Black, Native American, Pacific Islander, White non-Hispanic, White Hispanic, Mix, and Other), and sex takes 2 values (Male, Female). The joints $x \mapsto p_j(x)$ over these variables are defined for each state on these $14 \times 8\times2=224$ demographics combinations (atoms).\looseness=-1
We estimate $\ell$ using additional survey data from the Tobacco Use Supplement to the Current Population Survey. This independent study collects individual demographic information along with tobacco consumption. We form the expected tobacco consumption given each invariant cause and compute the induced $\ell$. More details about the computation of Lipschitz constant can be found in (ref).
\parhead{The M-bound Estimator.} The M-bound estimator uses our newly formed distributions $p_0, ..., p_J$ to compute a set of SC weights. We report the weights in (ref) and the SC outcomes with the misspecification interval in (ref). Among the set of 50 potential donors, five obtained non-zero weights: New Mexico, Nevada, D.C, Hawaii and Texas. As expected, the M-bound estimator selected states that are similar to California. New Mexico and Nevada are geographically close and have similar demographics. Both D.C. and California have a relatively young active population. And, California is the number one destination for Hawaiians moving to the US mainland (from US census).
In (ref), the solid and dotted lines denote the observed and synthetic California outcomes. The shaded areas represent the misspecification intervals. California pre-intervention outcomes fall within the estimated M-bound interval, but synthetic California is not a perfect fit, there is misspecification. In spite of the misspecification, (ref) shows that the post-intervention outcomes are outside of the bounds, suggesting a causal effect.
\parhead{The James-bound Estimator.} As discussed in (ref), the M-bound misspecification interval is only valid if we observe all the invariant causes. According to (ref), California's pre-intervention outcomes fall within the M-bound intervals. We find, however, that when some other states are considered as the target unit, their observed outcomes before the intervention are not always within the interval.
We perform placebo tests abadie2010synthetic where each donor is considered to be the target and a synthetic control is constructed using the other donors. Because the donors did not receive the intervention, we expect synthetic outcomes to match observed outcomes. In (ref), we illustrate the comparisons for three states, Colorado, Massachusetts, New Mexico. For comparisons on all states, see (ref).
(ref) (left) shows the synthetic outcome estimates by the M-bound estimator. Both Colorado and Massachusetts's pre-intervention outcomes are outside of the misspecification interval. This suggests that not all invariant causes are observed. While New Mexico's pre-intervention outcomes lie within the misspecification interval of the synthetic New Mexico, the error bound is too large to use synthetic control.
(ref) (right) shows the synthetic outcome estimates using the James-bound estimator. We observe that the pre-intervention outcomes across states now all fall within the James-bound misspecification intervals, which are also wider than the M-bound intervals. After the intervention, the observed tobacco consumption in Colorado remains in the James-bound misspecification interval, suggesting the intervention had no effect. This is expected because Colorado did not implement an anti-tobacco program like California. For Massachusetts, the James-bound interval is narrow enough to detect a decrease in tobacco consumption that is not due to misspecification. In fact, this is consistent with the policies taken by this state in 1993 to raise taxes and increase its Massachusetts Tobacco Control Program.
The placebo test provides further evidence that the tobacco control program in California indeed had a causal effect on tobacco consumption. In states without tobacco control programs, their outcomes fall within the misspecification interval, whereas California's outcome does not.
We address the problem of the misspecification of linear assumptions in synthetic controls. We relax assumptions commonly assumed in the literature (A1, A2), derive two misspecification bounds, and propose corresponding estimators. The key idea is to leverage external data to bound and minimize misspecification. Each bound comes with requirements: data must be available for the M bound (observe all causes), and we identify a modeling assumption for the James bound (A3). As an area of future research, we can explore other SC estimation procedures that might be enabled by these two requirements.
\onecolumn \printbibliography