Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
118,046 characters · 8 sections · 53 citation commands
When Do Treatment Changes Identify Causal Effects?
\thispagestyle{empty}
{ Keywords: treatment effects, treatment changes, conditional independence, instrumental variables, overidentification.\\[0.3ex] JEL Classification: C12, C14, C21, C23.\\[0.3ex] Address for correspondence: Martin Huber, University of Fribourg, Bd.\ de P\'{e}rolles 90, 1700 Fribourg, Switzerland; [email removed].\\[0.3ex] Acknowledgements: The author is indebted to Michael Knaus and Henri Pfleiderer for valuable comments that helped to correct and substantially revise an earlier version of the draft. The author used the AI assistant Claude (developed by Anthropic) as an aid for scientific writing and coding. Specifically, it was used to rephrase and improve author-written text and to optimize code.}
\setcounter{page}{1} \onehalfspacing
Identifying causal effects in observational data remains a central challenge in empirical research. In the absence of random assignment, applied work frequently relies either on selection-on-observables assumptions, which require treatment assignment (such as a medical treatment dose or participation in a training program) to be independent of potential outcomes conditional on observed covariates, or on difference-in-differences (DiD) designs, which exploit repeated observations over time and assume parallel trends in potential outcomes, possibly conditional on covariates. Both approaches impose identifying assumptions with respect to the treatment level that are non-nested, as discussed in WebervanderLaanPetersen2015, ChabeFerret2017, xu2023causal, and huber2024joint.
There exists a third practice that is not uncommon in applied work but rarely made theoretically explicit: assessing the effect of changes in a dynamically evolving treatment rather than of specific treatment levels. Examples include studies of tax reforms that change marginal rates over time, labor market regulations that adjust minimum wages, education policies that shift compulsory schooling ages, and medical dosage protocols that modify treatment intensity. In such settings, researchers often implicitly assume that treatment changes rather than levels are quasi-randomly assigned conditional on observed covariates, without articulating precisely what structural conditions this requires or how it relates to conventional identification strategies. A common example is recoding the treatment as one in the case of a treatment increase and as zero if the treatment remains constant over time. CardKrueger1994, for instance, apparently a classical DiD study, define the treatment group as observations experiencing an increase in the minimum wage (in the US state of New Jersey) and the control group as those where the minimum wage remains constant but is nonzero (in Pennsylvania).
This paper provides a systematic analysis of identification based on treatment changes, aiming at differencing out time-constant confounders jointly affecting the outcome and the treatment from the treatment equation. We ask under what conditions on the underlying treatment and outcome processes the change in a unit's treatment from one period to the next can be treated as if it were randomly assigned, conditional on observed covariates, and what this requires beyond simply removing time-constant confounders. The treatment level of a unit in a specific time period consists of the treatment change added to the unit's treatment level in the previous period, and this previous level is itself a consequence of the unit's history, possibly related to the same unobserved factors that determine the outcome. Consequently, even after differencing out time-constant unobserved confounders from the treatment equation, the treatment change may still be related to the outcome indirectly, through the unit's prior treatment level.
We characterize two structural models that resolve this. In Model A, the part of each period's treatment that is not explained by observed covariates and a time-constant confounder follows a random walk: each period's treatment shock is a fresh draw, unrelated to the entire history of past shocks and to the time-constant confounder. The treatment change therefore is unrelated to the unit's prior treatment level conditional on covariates, which permits the identification of heterogeneous treatment effects without strong restrictions on the outcome process, allowing e.g.\ for dynamic effects of earlier treatment levels on the outcome. Model B retains the same additive role for the time-constant confounder, so that it is removed by differencing the treatment just as in Model A, but drops the random-walk restriction on the time-varying part of the process, leaving its evolution otherwise unrestricted, and instead rules out dynamic treatment effects in the outcome equation. We show that this combination does not deliver the conditional independence assumption needed to identify treatment-change effects in general, since the treatment change can still be correlated with the unit's prior treatment level. Models A and B impose genuinely different and non-nested restrictions, and we show that they generally do not identify the same object.
Although Model B does not deliver the treatment-change conditional independence assumption, it is not without content. In an outcome model that is linear in the treatment level with a coefficient that is homogeneous given covariates, Model B's restrictions suffice for the treatment change to be uncorrelated with the part of the outcome left unexplained by the treatment level. This permits applying an instrumental-variables strategy, see e.g.\ Wright1928 and Imbens+94, with the treatment change serving as the instrument and the treatment effect recovered as a ratio of two coefficients of a reduced-form and first-stage regression. Once the treatment effect is heterogeneous across treatment levels, the same ratio continues to identify a weighted average of the marginal response, in the spirit of analogous results in the instrumental-variables literature on treatment effect heterogeneity, see AngristImbens95. However, it generally does not identify the same conditional average marginal effect targeted directly by selection-on-observables or DiD under more general models permitting effect heterogeneity.
We compare the conditions delivered by Models A and B to those underlying two conventional identification strategies that operate on treatment levels: selection-on-observables conditional on the lagged treatment, lagged outcome, and covariates, and DiD conditional on the lagged treatment and covariates but not the lagged outcome. Under Model A, all three identification strategies coincide and are informationally equivalent, since they all exploit the same underlying treatment shock. This equivalence motivates the construction of Hausman1978-type overidentification tests by jointly considering methods based on treatment levels and treatment changes. Absent the structural assumptions of Model A, however, the linear regression coefficients these strategies rely on in practice need not coincide, as the corresponding identifying assumptions are generally non-nested with one another.
Beyond these overidentification tests, the non-nesting results carry a double-robustness (DR) implication, see Robins+94, for an estimator that relies on more than one identification strategy at once. Consider DiD and the treatment-change strategy, which aim to difference out the time-constant confounder from the outcome and the treatment equations, respectively. We show that, under specific structural conditions, the regression coefficient of the differenced outcome on the differenced treatment, as computed by the classical two-way fixed effects (TWFE) estimator, recovers the treatment effect if the time-constant confounder enters the treatment equation, or the outcome equation, in a way that cancels exactly under differencing, without requiring this for both equations simultaneously. This double robustness does not extend to models with treatment effects that are heterogeneous in the treatment level or in time. This structural notion of double robustness, which operates by combining two restrictions on the data-generating process, is related to the design-based and model-based notions of double robustness in arkhangelsky2022doubly and arkhangelsky2021double.
We investigate the finite-sample behavior of the different identification strategies in a simulation study calibrated to a panel setting, confirming the non-nesting results, the rescaling requirement for the instrumental-variables estimator, and the double robustness of TWFE. As an empirical illustration, we estimate the price elasticity of cigarette consumption using the state-level panel of baltagi1994 covering 46 US states over the period 1963--1992. Applying the different identification strategies and the associated Hausman overidentification tests, we find a substantial gap between the estimate based on treatment changes and the estimates based on treatment levels and TWFE.
The remainder of the paper is organized as follows. Section (ref) introduces the causal framework and the estimand of interest. Section (ref) presents Model A and Model B, the conditions each requires, and the relationship between them. Section (ref) compares the resulting conditions to those underlying DiD and selection-on-observables strategies. Section (ref) discusses overidentification tests and the double-robustness result for TWFE. Section (ref) presents a simulation study and Section (ref) an empirical application to the price elasticity of cigarette demand. Section (ref) concludes.
Most identification strategies for panel data or repeated cross-sections rely on differencing outcomes over time to remove unobserved time-constant confounders, also known as fixed effects; see e.g.\ the extensive difference-in-differences (DiD) literature Snow1855, Ashenfelter78. This paper considers an alternative identification strategy based on treatment changes over time. Let $Y_T$ and $D_T$ denote the outcome and the treatment in period $T$, respectively. The treatment $D_T$ is presumably assigned at the beginning of period $T$, while the outcome $Y_T$ is measured at the end of that period. Let $X_T$ denote a vector of covariates observed in period $T$, also measured later in that period after treatment assignment $D_T$, which may contain both time-invariant and time-varying variables. For any variable $A$, let $\bar{A}_{T}=\{A_1,\dots,A_T\}$ denote its history up to period $T\ge 2$. Throughout, capital letters denote random variables, while lowercase letters denote their realizations.
To define our causal effect of interest (or estimand), we employ the potential outcomes framework Neyman23, Rubin74. Standard potential outcomes are defined with respect to treatment levels: $Y_T(d_T)$ denotes the potential outcome at time $T$ under treatment level $d_T$ in that period. In contrast, we are interested in the causal effect of a change in treatment. For a treatment change value $\nabla d$, we consider the potential outcome $Y_T(D_{T-1}+\nabla d_T)$, where $\nabla d_T$ is a specific value of the treatment increment $\nabla D_T = D_T - D_{T-1}$. For notational convenience, we henceforth drop the time index and write the treatment increment as $\nabla d$. We focus on the average effect of a treatment change of size $\nabla d$ relative to no change in period $T=t$, denoted by $\Delta_t(\nabla d)$ and defined as
and more generally, on the average effect of two arbitrary treatment changes $\nabla d$ and $\nabla d'$ in period $T=t$, denoted by $\Delta_t(\nabla d, \nabla d')$ and defined as
A crucial feature of this definition, and one that will be central to the analysis below, is that the potential outcome $Y_T(D_{T-1}+\nabla d)$ is evaluated at the unit's own, realized baseline treatment level $D_{T-1}$. This is what distinguishes the treatment-change estimand from a conventional treatment-level estimand $Y_T(d)$, which fixes $d$ independently of the unit. It is also worth noting that the same treatment increment may be realized under different baseline treatment levels across units, so treatment effects indexed by increments do not generally correspond to the effects of uniquely defined treatment levels. Such effects of treatment changes are nonetheless of direct policy relevance in settings where the treatment is dynamically adjusted, such as changes in tax rates, adjustments in public expenditures, or gradual modifications of medical dosages. Throughout we impose SUTVA Rubin80, Cox58 and rule out anticipation effects as is commonly assumed in DiD studies Lechner2010.
The central identifying assumption we study throughout the paper is the following conditional independence assumption, which requires the treatment change to be independent of the treatment-change potential outcome conditional on past covariates.
Assumption (ref) states that, after conditioning on the history of covariates observed prior to the treatment change, the treatment change $\nabla D_T$ is as good as randomly assigned. While the level of the treatment $D_T$ may be endogenous, identification hinges solely on the exogeneity of the treatment increment $\nabla D_T$ with respect to the unit's own treatment-change potential outcome. We condition on $\bar{X}_{T-1}$ rather than contemporaneous covariates $X_T$ because the latter may include variables influenced by the treatment assignment in period $T$. Conditioning on post-treatment variables generally invalidates identification by introducing selection on outcomes, as e.g. discussed in angrist2009mostly.
As a further remark, note that if the lagged treatment $D_{T-1}$ is constant across units, then Assumption (ref) coincides with the conventional selection-on-observables (or unconfoundedness) assumption for treatment evaluation formulated in terms of treatment levels, $Y_T(d) \perp D_T \mid \bar X_{T-1}$, see, for example, Im04. A leading case is one in which no unit is treated in the earlier period, so that $D_{T-1}=0$ for all units and $\nabla D_T = D_T-0=D_T$. In this case, treatment changes and treatment levels coincide, and the baseline-dependence issue discussed in the introduction does not arise, precisely because there is no variation in the baseline to begin with. Therefore, formulating identifying assumptions in terms of treatment changes rather than levels, and confronting the baseline-dependence problem that this formulation introduces, is conceptually meaningful only when there is variation in $D_{T-1}$ across units.
In addition to Assumption (ref), identification requires a common support condition, ensuring sufficient overlap in treatment changes across covariate histories.
Assumption (ref) guarantees that each treatment change of interest occurs with positive probability for all relevant values of the conditioning variables, ensuring that the causal effects of treatment increments are empirically identifiable. While this condition is stated for discrete treatment changes, in the case of continuously distributed treatment changes it should be interpreted in terms of the conditional density: the density of $\nabla D_T$ given $\bar{X}_{T-1}$ must be bounded away from zero on its support, rather than requiring strictly positive probability mass at a point.
Under Assumptions (ref) and (ref), both the average treatment effect (ATE) of a treatment change and the conditional average treatment effect (CATE) given $\bar{X}_{T-1}$ are identified:
where the first equality follows from the law of iterated expectations, and the second follows from Assumption (ref). Assumption (ref) ensures that subpopulations with $\nabla d$ and $\nabla d'$ exist conditional on $\bar{X}_{T-1}$, so that the conditional expectations are well-defined. Analogous arguments can establish identification of distributional effects, such as quantile treatment effects, as considered for instance in Firpo03.
The remainder of the paper investigates under what structural conditions on the joint evolution of treatment, covariates, and unobservables Assumption (ref) can be justified, since the assumption as stated is a high-level condition whose plausibility is not transparent without reference to an underlying data-generating process.
Assumption (ref) is stated at a high level, and its plausibility is not transparent without reference to an underlying data-generating process. To understand the types of structural models in which this assumption is satisfied or violated, consider the following general equations for the outcome and treatment:
where $V_T$ and $W_T$ are time-varying unobservables and $U$ is a time-invariant unobservable or fixed effect. In general, Assumption (ref) will not hold in model (ref) without further constraints. To see this, note that
In nonlinear models, the fixed effect $U$ will typically not cancel, as its effect may interact with time. Consequently, $U$ remains a potential confounder that jointly affects $\nabla D_T$ and $Y_T$. Further violations of Assumption (ref) can arise in several ways. First, if the time-varying unobservables $V_T$ and $W_T$ are statistically dependent, then $\nabla D_T$ and $Y_T$ may be statistically associated even after conditioning on past covariates. Second, if past treatments directly affect future outcomes --- i.e., there are dynamic treatment effects as e.g. considered in Ro86 and RoHeBr00 --- and also influence future treatments, then past treatments themselves become confounders of treatment changes and outcomes. In this case, conditioning on covariates alone may be insufficient for identification.
A further point deserves emphasis at the outset, since it shapes everything that follows. The treatment change $\nabla D_T$ enters our analysis through the potential outcome $Y_T(D_{T-1}+\nabla d)$: the change of size $\nabla d$ is added on top of the treatment level $D_{T-1}$ that the unit actually had in the previous period. This previous treatment level $D_{T-1}$ is itself a random variable, determined by the unit's own history through equation (ref) at $T-1$, and it may depend on the same unobserved factors --- the fixed effect $U$ or the time-varying shocks $W_{T-1}$ --- that also affect the outcome. Removing $U$ from the treatment change $\nabla D_T$, as in (ref), addresses only part of the problem: even after $U$ cancels, $\nabla D_T$ may still be informative about $D_{T-1}$, and through $D_{T-1}$ about the unobservables that drove the treatment process in earlier periods, which the potential outcome continues to depend on. Any structural restriction that delivers Assumption (ref) must therefore ensure that the treatment change carries no information about the unit's prior treatment level, not only that it is free of the time-constant confounder.
We now characterize two structural models. The first, Model A, restricts the time-varying part of the treatment process to follow a random walk. We show that this is sufficient to sever the link between the treatment change and the unit's prior treatment level entirely, delivering Assumption (ref) for an unrestricted, dynamic, and heterogeneous treatment effect model. The second, Model B, retains only the restriction that the time-constant confounder enters the treatment equation additively, without any restriction on how the time-varying shock evolves over time, and additionally rules out dynamic treatment effects. We show that Model B does not deliver Assumption (ref): the link between the treatment change and the unit's prior treatment level remains open. Models A and B are not nested --- neither set of restrictions implies the other --- and we show that they do not, in general, identify the same object. Model B nonetheless delivers a related and useful condition: an instrumental-variables-type exogeneity condition that identifies a treatment effect that is constant given covariates, through the same logic as a standard instrumental-variables estimator.
Model A restricts the treatment equation so that both the time-constant and time-varying unobservables are additively separable,
where $U$ is a scalar, time-constant unobservable or fixed effect, and $W_T$ is the time-varying unobservable specific to period $T$. We further assume that $W_T$ follows a random walk, implying that the treatment level in some period $T$ corresponds to the treatment level in the previous period $T-1$ plus a quasi-random shock that fully explains the change over time:
where $\varepsilon_T$ is the period-$T$ shock to treatment. The independence in (ref) is required with respect to the entire history $\bar{W}_{T-1}=\{W_1,\dots,W_{T-1}\}$, and not merely the immediately preceding shock $W_{T-1}$. This full-history property is what will let us show that the treatment change carries no information about the unit's prior treatment level, and it is correspondingly the feature that fails under Model B, introduced below.
Under the treatment model restrictions in equations (ref) and (ref), Assumption (ref) holds if the time-specific shock $\varepsilon_T$ in the treatment equation is independent of the outcome-relevant unobservables, the time-invariant fixed effect, and the entire history of past treatment shocks, conditional on past covariates:
To see this, note that under (ref) the treatment change satisfies
where the first equality follows from cancellation of the fixed effect $U$, and the second from the random-walk specification (ref). Since $T$ is deterministic, the only stochastic element in the treatment change (ref) conditional on $\bar{X}_{T-1}$ is the shock $\varepsilon_T$. Therefore, imposing (ref) immediately gives
where the inclusion of $\bar{D}_{T-1}$ follows because $\bar{D}_{T-1}$ is a deterministic function of $(U,\bar{W}_{T-1},\bar{X}_{T-2})$, and (ref) makes $\varepsilon_T$ independent of both $U$ and $\bar{W}_{T-1}$ --- the entire history that determines $\bar{D}_{T-1}$ --- given $\bar{X}_{T-1}$. This is the step that severs the link between $\nabla D_T$ and the unit's prior treatment level: under condition (ref), $D_{T-1}$ itself is rendered independent of $\nabla D_T$, not merely the fixed effect $U$.
Next, consider the potential outcome based on the unrestricted outcome model in (ref) under a treatment change $\nabla d$:
Conditional on $\bar X_{T-1}$, the stochastic elements in $Y_T(\nabla d)$ are $\bar D_{T-1}, \bar V_T$, and $U$ --- and, crucially, $\bar D_{T-1}$ enters explicitly, since the potential outcome is evaluated at the unit's own prior-level-plus-change $D_{T-1}+\nabla d$ rather than at a level fixed independently of the unit. By (ref), $\bar D_{T-1}, \bar V_T, U$ are jointly independent of $\nabla D_T$ conditional on $\bar X_{T-1}$. It follows that, for all $\nabla d$, $Y_T(\nabla d) \perp \nabla D_T \mid \bar X_{T-1}$, which is Assumption (ref). This result is formalized in Proposition (ref), which permits an unrestricted, dynamic, and heterogeneous treatment effect model.
Figure (ref) illustrates the causal structure underlying Model A using a directed acyclic graph (DAG); see, for instance, Pearl00 for background discussion. Solid nodes represent observed variables, dashed nodes represent unobserved variables, and arrows denote causal effects between variables. The left panel shows the model formulated in terms of treatment levels $D_0$ and $D_1$, whereas the right panel depicts the corresponding model for the treatment change $\nabla D_1 = D_1 - D_0$, with $D_1$ included explicitly as a node, fed by both $D_0$ and $\nabla D_1$, since $D_1 = D_0 + \nabla D_1$ is an identity. Both panels also include a direct arrow from $D_0$ to $Y_1$, reflecting that Model A's outcome equation permits a dynamic effect of the prior treatment level on the outcome beyond what is mediated by $D_1$.
Conditional on $\bar{X}_0=\{X_{-1},X_0\}$, there are no variables that jointly affect $\nabla D_1$ and $Y_1$: in particular, neither the direct path from $D_0$ to $Y_1$ nor the path through $D_1$ confounds $\nabla D_1$ and $Y_1$, because under the full-history property (ref), $\varepsilon_1$ --- the only stochastic driver of $\nabla D_1$ --- is independent of $D_0$ given $X_0$, so neither edge into $Y_1$ opens a back-door path into $\nabla D_1$. Model B, illustrated in Figure (ref) below, instead rules out dynamic treatment effects altogether, so that the direct edge from $D_0$ to $Y_1$ is absent there and $D_0$ and $\nabla D_1$ affect $Y_1$ only through the mediator $D_1$. The analogous confounding nonetheless arises there because $\nabla D_1$ is correlated with $D_0$.
It is natural to ask whether the random-walk restriction (ref) can be dispensed with, which is considered in Model B, introduced in the following discussion. Consider a weaker treatment equation that retains additive separability of the time-invariant unobservable, but otherwise leaves the evolution of the time-varying shock $W_T$ unrestricted:
where $U$ is again a scalar, time-constant unobservable. Under (ref), the fixed effect still cancels in the treatment change:
so that, conditional on $\bar X_{T-1}$, $\nabla D_T$ depends stochastically only on $\bar W_T$. Suppose, in addition to (ref), that the outcome equation rules out dynamic treatment effects of earlier treatments on later outcomes, restricting the outcome to depend only on the contemporaneous treatment level and shock,
and impose the conditional independence condition
Conditional on $\bar X_{T-1}$, equation (ref) shows that $\nabla D_T$ depends stochastically only on $\bar W_T$, and condition (ref) makes $\{U,V_T\}$ independent of $\bar W_T$, and hence of $\nabla D_T$. This step is identical in form to the corresponding step in the proof of Proposition (ref). The decisive difference arises one step later, when we examine the potential outcome itself.
The potential outcome under (ref) is $Y_T(D_{T-1}+\nabla d) = \mathcal{F}_Y(T,D_{T-1}+\nabla d,\bar X_{T-1},V_T,U)$. Conditional on $\bar X_{T-1}$, this depends on $D_{T-1}$ explicitly, and $D_{T-1} = \mathcal{F}_D(T-1,\bar X_{T-2},\bar W_{T-1}) + U$ depends on $\bar W_{T-1}$ --- which is part of the history that determines $\nabla D_T$ in (ref). Condition (ref) says nothing about the relationship between $\bar W_{T-1}$ and $\bar W_T$. In particular, it does not rule out $W_{T-1}$ and $W_T$ being correlated, for instance through an autoregressive process of order one. The link between the treatment change and the unit's prior treatment level is therefore not broken by (ref)--(ref), such that Assumption (ref) does not hold: ruling out dynamic treatment effects restricts the outcome equation, while the source of the problem lies in the treatment equation's evolution over time and is unaffected by restrictions on the outcome equation. The following example makes this failure explicit.
A natural question is whether conditioning on the observed prior treatment level $D_{T-1}$ itself --- in addition to $\bar X_{T-1}$ --- repairs the conditional independence claim, i.e.\ whether $Y_T(D_{T-1}+\nabla d) \perp \nabla D_T \mid \bar X_{T-1}, D_{T-1}$ might hold under Model B even though Assumption (ref) as stated does not. This is not a generic repair, because $D_{T-1}$ is itself jointly determined by $W_{T-1}$ and $U$ in the additive treatment model (ref): conditioning on $D_{T-1}$ induces an association between $W_{T-1}$ (which affects $\nabla D_T$) and $U$ (which affects the outcome), since knowing the sum $D_{T-1}=U+W_{T-1}$ makes a high realization of one component informative about a low realization of the other. Concretely, in the setting of Example (ref) with $U,W_0,W_1$ mutually independent Gaussian variables with variances $\sigma_U^2,\sigma_{W_0}^2,\sigma_{W_1}^2$, one obtains
so that $\mathrm{Cov}(\nabla D_1,Y_1(D_0+a)\mid D_0) = \gamma\,\sigma_U^2\sigma_{W_0}^2/(\sigma_U^2+\sigma_{W_0}^2)$, which is nonzero whenever $\gamma\neq0$. Conditioning on $D_{T-1}$ therefore closes one confounding path while opening another, and is not a substitute for the random-walk restriction of Model A.
Figure (ref) illustrates Model B and Example (ref) using the same type of diagram as Figure (ref). The left panel depicts the causal model in terms of the original treatment levels $D_0$ and $D_1$, whereas the right panel represents the model when considering the treatment change $\nabla D_1 = D_1-D_0$, now including $D_1$ itself as an explicit node. Considering first the left graph, treatment $D_1$ and outcome $Y_1$ are confounded by the time-invariant unobservable $U$, even after conditioning on $X_0$. In the right graph, $U$ is, due to its additive separability, removed from the treatment-change node $\nabla D_1$ itself. Both $\nabla D_1$ and $D_0$ feed into $D_1$, reflecting the identity $D_1=D_0+\nabla D_1$, and $D_1$ in turn is the only node with a direct edge into $Y_1$, making explicit that neither $\nabla D_1$ nor $D_0$ affects the outcome other than through $D_1$.
Furthermore, an edge $W_0 \to \nabla D_1$ is required in general, since, writing $\nabla D_1 = \mathcal{F}_D(1,\bar X_0,W_0,W_1) - \mathcal{F}_D(0,X_{-1},W_0)$, the dependence of this difference on $W_0$ does not cancel except in special cases, discussed further below, and is otherwise present. The confounding path $\nabla D_1 \leftarrow W_0 \to D_0 \to D_1 \to Y_1$ exhibits the same problem as Example (ref): $\nabla D_1$, which affects $Y_1$ through the treatment $D_1$, is correlated with $D_0$, the other determinant of $D_1$, through the shared dependence on $W_0$, which also affects $Y_1$ through $D_1$ and is thus a confounder of $\nabla D_1$.
One notable property of our framework is the exclusion of a direct effect of $D_0$ on $X_0$, ensuring that $X_0$ is not affected by $W_0$ through $D_0$. Otherwise, $X_0$ would act as a collider on the path $U \rightarrow X_0 \leftarrow D_0 \leftarrow W_0$ according to the d-separation theorem for causal inference pearl1988probabilistic. For this reason, conditioning on $X_0$ would induce a spurious association between $U$ and $W_0$, further compounding the violation of condition (ref). Importantly, this restriction implies that earlier treatments do not affect post-treatment covariates that are used as control variables for later treatment assignment, which may be restrictive in practice. One reason is that covariates may include earlier outcomes that are plausibly affected by past treatments.
Although Model B does not deliver Assumption (ref), it is not without identifying content. We now show that, in an outcome model that is linear in the treatment level within each covariate cell, Model B delivers a condition that identifies the treatment effect through the same logic as an instrumental variable. Consider the partially linear model
where $\delta_T(\bar X_{T-1})$ is the marginal effect of the treatment level, which may vary freely with covariates and across periods, and $\eta_T$ collects the time-invariant and time-varying unobservables additively, without any direct dependence on $D_{T-1}$ beyond the explicit term $\delta_T(\bar X_{T-1}) D_T$ --- this is the natural linear specialization of the no-dynamic-effects restriction (ref). Define the persistence factor
which measures the degree to which the treatment level co-moves with its own change, conditional on covariates. We return to this object throughout the remainder of the paper.
Proposition (ref) and Proposition (ref) are not substitutes for one another: Appendix (ref) shows that, in the partially linear model (ref), requiring Assumption (ref) to hold at the level of covariances forces a specific balance between the persistence factor $\lambda_T(\bar x)$ and the instrumental-variables condition (ref), and that, except in a non-generic special case, this balance requires the random-walk property of Model A; Model B's restrictions deliver condition (ref) directly, without a random walk, but are on their own insufficient for Assumption (ref) to hold, as shown in Example (ref).
The treatment change $\nabla D_T$ in Proposition (ref) has a natural instrumental-variables (IV) interpretation, see e.g.\ Wright1928 and Imbens+94: it serves as an instrument for the treatment level $D_T$, with the persistence factor $\lambda_T(\bar x)$ playing the role of the first-stage coefficient conditional on $\bar X_{T-1}=\bar x$. Although $\nabla D_T$ is not a separately assigned instrument but an algebraic component of $D_T$ itself, since $D_T = D_{T-1} + \nabla D_T$ by definition, it satisfies the requirements of a valid instrument for $D_T$ in the relevant nonparametric sense: $D_{T-1}$, the remaining component of $D_T$, affects $Y_T$ only through $D_T$ rather than directly, so that it does not violate the exclusion restriction, and $\nabla D_T$ is correlated with $D_{T-1}$ without this constituting a violation of instrument validity, exactly as an instrument may be correlated with other determinants of the treatment as long as it is unrelated to the outcome except through the treatment.
This connects the present setting to the literature on instrumental variables under heterogeneity in treatment effects, related to both observed and unobserved characteristics, as surveyed in mogstad2024instrumental. Throughout, $\delta_T(\bar x)$ has been a single number within each covariate cell, governing a treatment effect that is linear in the treatment level. A researcher using a flexible, nonparametric estimator such as a causal forest is typically interested in the opposite case, where the treatment effect is heterogeneous across treatment levels, with target parameter the conditional average marginal effect
which reduces to the constant $\delta_T(\bar x)$ of the partially linear model (ref) when the treatment effect is homogeneous. For a continuously varying treatment, AngristImbens95 show that the probability limit of two-stage least squares is, under such heterogeneity, a weighted average of the marginal treatment response along the support of the treatment, with weights determined by how the instrument shifts the distribution of the treatment, and not generally the conditional average marginal effect that selection-on-observables or DiD strategies target. The same logic applies to the ratio in equation (ref): under treatment effect heterogeneity, it identifies a particular weighted average of the marginal effect, rather than the conditional average marginal effect $\delta_t(\bar x)$ that a selection-on-observables or DiD strategy targets directly. TWFE does not escape this either: its recovery of $\delta_t(\bar x)$ established in Section (ref) is specific to a homogeneous treatment effect, and a nonparametric version of TWFE faces an analogous weighting once the treatment effect varies with the treatment level. Different identification strategies can therefore yield different point estimates not because any of their underlying assumptions is violated, but because each implicitly targets a different weighted average of an effect that varies with the treatment level: a form of treatment effect heterogeneity rather than a specification error.
The IV structure of our framework connects naturally to the shift-share or Bartik instrument literature, see for instance bartik1991benefits and borusyak2024practical, in which the treatment change $\nabla D_t$ is constructed as the product of an aggregate shock (shift) and an initial treatment exposure (share). One example is autor2013china, who assess the effect of rising Chinese import competition on regional employment in the US. They construct a shift-share instrument by multiplying industry-level import growth in non-US countries by regional industry employment shares reflecting each region's initial exposure to those shocks, and use this instrument to predict US regional import exposure (the treatment). In such settings, $\nabla D_t$ plays the role of the shift-share instrument, $D_t$ is the endogenous treatment, and $\hat\lambda$ is the first-stage coefficient. The exogeneity of $\nabla D_t$ under condition (ref) then corresponds to the conditions discussed in Borusyaketal2021 and GoldsmithPinkhametal2020, who show that instrument validity requires either the shifts or the shares to be exogenous.
Table (ref) summarizes the conditions associated with Models A and B and what each delivers.
We now compare the conditions derived in the previous section to those underlying two conventional identification strategies that operate on treatment levels rather than changes: classical selection-on-observables, which treats treatment levels as exogenous conditional on observed variables when considering outcome levels, and DiD, which treats treatment levels as exogenous conditional on observed variables when considering outcome trends. Formally, selection on observables relies on the following conditional independence assumption (CIA), see e.g.\ Im04:
The parallel trends assumption underlying DiD can be formalized as follows:
Our approach based on treatment changes and the two approaches based on treatment levels all impose specific conditional independence assumptions, but differ in which source of variation is deemed exogenous for causal analysis and in the set of control variables. CIA-$\nabla D$ (Assumption (ref)) treats the treatment change $\nabla D_T$ as exogenous conditional on $\bar{X}_{T-1}$. CIA-$D$ (Assumption (ref)) treats the treatment level $D_T$ as exogenous conditional on $\bar{D}_{T-1}$, $\bar{X}_{T-1}$, and $\bar{Y}_{T-1}$. CIA-$\nabla Y$ (Assumption (ref)) imposes treatment exogeneity with respect to potential outcome changes, conditional on $\bar{D}_{T-1}$ and $\bar{X}_{T-1}$. It is worth emphasizing that for DiD identification based on CIA-$\nabla Y$, the conditioning set $\bar{X}_{T-1}$ must not include lagged outcomes $\bar{Y}_{T-1}$. If lagged outcomes are added to the conditioning set, the parallel trends assumption in Assumption (ref) collapses to CIA-$D$, i.e.\ selection-on-observables formulated in terms of levels rather than differences of potential outcomes (see KnausPfleiderer2026 for a general graphical treatment of such conditioning-set questions).\footnote{ To see this, write $\bar{Y}_{T-1}$ explicitly in the conditioning set as a slight abuse of our previous notation:
where the second equivalence follows from the absence of anticipation effects, so that $Y_{T-1}(d) = Y_{T-1}$ for all $d$, and the third from the fact that $Y_{T-1}$ is measurable with respect to the conditioning set and therefore fixed conditional on it, so that subtracting it does not affect conditional independence.}
We note that in the DiD literature, typically weaker versions of parallel trends than Assumption (ref) are imposed. Most commonly, parallel trends are required to hold only on average and only for the potential outcome difference under nontreatment, $\nabla Y_T(0)$, conditional on not having been treated in earlier periods, $\bar{D}_{T-1}=0$. Together with suitable common support conditions, this is sufficient for identifying the average treatment effect on the treated (ATET) among units switching from nontreatment in earlier periods to treatment in period $T$; see, for example, Abadie2005 for semiparametric ATET identification and the literature on staggered treatment adoption, including borusyak2024revisiting, CallawaySantAnna2018, GoodmanBacon2018, cha19, and sun2021estimating. For conceptual clarity, we focus here on the stronger Assumption (ref), which is imposed on the entire distribution of potential outcomes rather than only on means, and for all treatment levels $d$ rather than only for $d=0$, as also considered in Fricke2017, deChaisemartin2022did, and haddad2024difference. This stronger assumption also allows identification of effects in the total population, such as the ATE, rather than only the ATET. For the sake of brevity, we also omit an explicit discussion of common support conditions.
We first show that, under Model A, all three conditional independence assumptions hold simultaneously. To see why CIA-$D$ holds in addition to CIA-$\nabla D$ under Model A, recall from equation (ref) that
Conditional on $\bar{X}_{T-1}$ and $D_{T-1}$, the only stochastic variation in $D_T$ is driven by $\varepsilon_T$, which is also the only stochastic element in $\nabla D_T$ conditional on $\bar{X}_{T-1}$. Therefore,
where $\sigma(\cdot)$ denotes the generated $\sigma$-algebra. This is a purely mechanical consequence of the identity $D_T = D_{T-1}+\nabla D_T$ together with the random-walk restriction, and holds regardless of whether $\bar Y_{T-1}$ is additionally included in the conditioning set, since $\bar Y_{T-1}$ does not affect this $\sigma$-algebra equivalence. Conditional independence between $\{U, \bar{V}_T\}$ and $D_T$ given $\bar{X}_{T-1}$ and $D_{T-1}$ holds if and only if $\{U, \bar{V}_T\}$ is independent of $\varepsilon_T$ given $\bar{X}_{T-1}$, which is precisely condition (ref) and is in turn what delivers CIA-$\nabla D$ by Proposition (ref). Hence CIA-$\nabla D$ and CIA-$D$ are simultaneously satisfied under Model A.
We now turn to CIA-$\nabla Y$. Since conditioning on $D_{T-1}$ and $\bar{X}_{T-1}$ renders $D_T$ independent of $\{U, \bar{V}_T\}$, the fixed effect $U$ is not a confounder of the treatment and the outcome under Model A, regardless of whether $U$ cancels in $\nabla Y_T$ or not. Even if $U$ remains in $\nabla Y_T$, it does not jointly determine $D_T$ given the conditioning set and therefore does not violate CIA-$\nabla Y$. This equivalence result is stated in Proposition (ref).
Proposition (ref) shows that under Model A, all three strategies achieve identification by exploiting the same source of variation, namely the conditionally random treatment shock $\varepsilon_T$ that follows a random walk and is independent of the fixed effect $U$. This equivalence is the basis for the overidentification tests developed in Section (ref).
Having established that CIA-$\nabla D$, CIA-$D$, and CIA-$\nabla Y$ coincide under Model A, we now ask whether they are otherwise non-nested. Given the results of Section (ref), however, the only structural route to Assumption (ref) that we have identified in the heterogeneous, nonparametric case is Model A itself, under which the other two assumptions hold as well. We are not aware of a structural model strictly weaker than Model A that delivers Assumption (ref) for a heterogeneous treatment effect model while CIA-$D$ or CIA-$\nabla Y$ fails. We instead move from this nonparametric comparison to the partially linear model that underlies Model B's instrumental-variables route, where the conditional average marginal effects targeted by the different strategies coincide and can be compared directly. What we can establish there, and what is in fact the relevant comparison for the linear and instrumental-variables results of Section (ref) and for the simulation study of Section (ref), is non-nesting at the level of the linear moment conditions that the corresponding ordinary least squares (OLS) estimators rely on. Consider the partially linear outcome model (ref) with a treatment effect $\delta_T(\bar X_{T-1})$ that is homogeneous given covariates, and define the three moment conditions
corresponding to the exogeneity conditions required for the OLS estimators based on, respectively, the instrumental-variables route of Proposition (ref), the level-based selection-on-observables regression underlying CIA-$D$, and the DiD regression underlying CIA-$\nabla Y$. These moment conditions are precisely what is being verified, numerically, in the simulation study of Section (ref).
We demonstrate Proposition (ref) through six examples, two for each pair, all built on the base case $D_0=U+W_0$, $D_1=U+W_1$ with $U,W_0,W_1,V_0,V_1$ mutually independent.
Examples (ref)--(ref) establish Proposition (ref). This non-nesting result is the operative one for the remainder of the paper: it explains why, in the simulation study of Section (ref), each linear estimator can be biased while the others remain consistent, and it underlies the construction of the overidentification tests in Section (ref), which compare estimates that are guaranteed to coincide only under the stronger structural assumption of Model A.
The equivalence result of Proposition (ref) implies that when Model A holds, the resulting causal parameters coincide in the population, and a Hausman-style comparison of estimates constitutes an overidentification test. Before developing these tests, we establish that all three identification strategies --- CIA-$\nabla D$, CIA-$D$, and CIA-$\nabla Y$ --- can in principle be used to identify the same treatment-change-based causal parameters, as defined in equations (ref) and (ref), which puts them on a common footing for comparison.
Under CIA-$\nabla D$ (Assumption (ref)) and common support (Assumption (ref)), the average potential outcome under a treatment change $\nabla d$ is identified as
where identification follows from the conditional independence in Assumption (ref) by the same argument as in Section (ref). Note that $\bar{X}_{t-1}$ may include lagged outcomes as control variables under CIA-$\nabla D$.
Under CIA-$D$ (Assumption (ref)), setting $d = D_{t-1} + \nabla d$ and applying the conditional independence directly gives
where $\bar{X}_{t-1}$ under CIA-$D$ may include lagged outcomes $\bar{Y}_{t-1}$. Averaging over the distribution of $\bar{D}_{t-1}$ conditional on $\bar{X}_{t-1}$ then identifies $E[Y_t(D_{t-1}+\nabla d) \mid \bar{X}_{t-1}]$.
Under CIA-$\nabla Y$ (Assumption (ref)), the parallel trends assumption identifies the average potential outcome change under treatment level $d = D_{t-1}+\nabla d$ as
Adding back the observed lagged outcome $E[Y_{t-1} \mid \bar{D}_{t-1}, \bar{X}_{t-1}]$ and averaging over the distribution of $\bar{D}_{t-1}$ conditional on $\bar{X}_{t-1}$ identifies $E[Y_t(D_{t-1}+\nabla d) \mid \bar{X}_{t-1}]$. As discussed in Section (ref), the conditioning set $\bar{X}_{t-1}$ must not include lagged outcomes $\bar{Y}_{t-1}$ under CIA-$\nabla Y$, since their inclusion collapses this assumption to CIA-$D$.
Since all three strategies identify $E[Y_t(D_{t-1}+\nabla d) \mid \bar{X}_{t-1}]$ under their respective assumptions, the average treatment effects $\Delta_t(\nabla d)$ and $\Delta_t(\nabla d, \nabla d')$ are also identified under each strategy, and the resulting estimates should agree whenever Model A holds, so that all three assumptions are simultaneously satisfied. This motivates Hausman-type overidentification tests: under Model A, the estimates of $\Delta_t(\nabla d, \nabla d')$, denoted by $\hat{\Delta}_{t,j}$ and $\hat{\Delta}_{t,k}$ for strategies $j,k\in\{\nabla D, D, \nabla Y\}$, are asymptotically equivalent. Furthermore, the test statistic
with $\hat{\sigma}^2_{t,j}$ and $\hat{\sigma}^2_{t,k}$ denoting the standard errors of $\hat{\Delta}_{t,j}$ and $\hat{\Delta}_{t,k}$, is asymptotically valid under standard regularity conditions. Rejection of $H_{t,jk}$ establishes that Model A, or one of the maintained assumptions, fails, but cannot identify which one without additional prior restrictions. Non-rejection is consistent with Model A but also with violations that bias both strategies in exactly the same way, a case that may be ruled out by imposing a causal faithfulness assumption, see e.g.\ Pearl00.
When only Model B's instrumental-variables route (Proposition (ref)) is available rather than the full Model A, the treatment effect $\delta_T(\bar X_{T-1})$ is not identified directly by the OLS regression of $Y_T$ on $\nabla D_T$: as the expanded form of equation (ref) already makes explicit, this regression instead identifies
within each covariate cell. Recovering $\delta_T(\bar x)$ from this regression therefore requires dividing by an estimate of the persistence factor $\lambda_T(\bar x)$, exactly as in the standard instrumental-variables ratio of equation (ref). Under Model A, $\lambda_T(\bar x)=1$ for all $\bar x$, and the rescaling becomes unnecessary, consistent with the fact that under Model A the regression of $Y_T$ on $\nabla D_T$ already estimates $\delta_T(\bar x)$ directly. The variance of the persistence-factor estimate must be propagated into the standard error of the rescaled estimate, for instance via the delta method. We return to this in the empirical application of Section (ref).
The non-nesting of (IV) and ($\nabla$Y) established in Proposition (ref) carries a further implication that complements the overidentification tests, concerning the popular two-way fixed effects (TWFE) approach, which simultaneously relies on differenced outcomes $\nabla Y$ and treatment changes $\nabla D$. Under specific modeling assumptions, TWFE bears a double robustness (DR) property for a treatment effect $\delta_T(\bar X_{T-1})$ that takes the same value in periods $T-1$ and $T$: the linear projection coefficient in a population regression of $\nabla Y_T$ on $\nabla D_T$ conditional on $\bar X_{T-1}$, denoted by $\beta_{\text{TWFE}}(\bar X_{T-1})$, recovers the treatment effect within each covariate cell, if the time-constant unobserved factor $U$ is additively separable in either the treatment equation or the outcome equation, without requiring both simultaneously. As in Proposition (ref), this does not rule out the treatment effect varying across covariate values, but in contrast to the assumptions underlying Proposition (ref), treatment effects must not change between $T-1$ and $T$ for the realized covariate path of a given unit.
To formalize the DR result, we consider two distinct structural models, both restricted to the partially linear outcome equation (ref) with a treatment effect that is homogeneous across periods $T-1$ and $T$ given the covariate history, $\delta_{T}(\bar X_{T-1})=\delta_{T-1}(\bar X_{T-1})=\delta(\bar X_{T-1})$. The first model corresponds to Model B, under which $U$ is additively separable in the treatment equation (ref) and $\eta_T=f(U,\bar X_{T-1},V_T)$ as in the no-dynamic-effects restriction (ref) underlying Proposition (ref), which delivers the exogeneity condition $\mathrm{Cov}(\nabla D_T,\eta_T\mid\bar X_{T-1})=0$. The second model departs from this by relaxing additive separability of $U$ in the treatment equation, while instead imposing it in the outcome equation. Specifically, consider a treatment equation that does not require $U$ to be additively separable,
and an outcome equation with additively separable $U$,
which splits $U$ out additively from the residual, while maintaining the absence of dynamic effects. Under (ref), $U$ cancels exactly in $\nabla Y_T(\nabla d) = \delta(\bar X_{T-1})\,\nabla d + g(\bar X_{T-1},V_T) - g(\bar X_{T-2},V_{T-1})$, regardless of how $U$ enters the treatment equation (ref), so that the relevant residual $\nabla\tilde\eta_T := g(\bar X_{T-1},V_T) - g(\bar X_{T-2},V_{T-1})$ depends only on $(V_T,V_{T-1})$ given $\bar X_{T-1}$ and not on $U$ at all. Exogeneity of $\nabla D_T$ with respect to $\nabla\tilde\eta_T$ is then satisfied under the weaker condition $V_T \perp \bar{W}_T \mid \bar{X}_{T-1}$ --- implied by, but weaker than, the full condition (ref), since $U$ plays no role here --- together with the following additional condition on the lagged outcome shock:
which, together with condition (ref) under route (i) below, implies strict exogeneity of the treatment shocks from time-varying unobservables affecting the outcome conditional on $\bar{X}_{T-1}$ for periods $T$ and $T-1$, as typically assumed in panel models. Condition (ref) is required because TWFE considers the differenced outcome $\nabla Y_T = Y_T - Y_{T-1}$ as dependent variable, thus including $Y_{T-1}$, which depends on $V_{T-1}$. Condition (ref) alone, which restricts only $V_T$, says nothing about $V_{T-1}$. It is worth noting that condition (ref) is also required under Model B, as the exogeneity condition $\mathrm{Cov}(\nabla D_T,\eta_T\mid\bar X_{T-1})=0$ established for period $T$ in Proposition (ref) does not by itself extend to the lagged residual $\eta_{T-1}$. Without condition (ref) the TWFE projection coefficient would generally differ from $\delta(\bar X_{T-1})$ even when Model B holds for period $T$. Proposition (ref) formally states the DR result.
The two routes in Proposition (ref) are non-nested, which constitutes the DR property of TWFE for the linear projection coefficient: additive separability of $U$ in the treatment equation (ref) neither implies nor is implied by its additive separability in the outcome equation (ref). Under route (ii), $U$ need not cancel from $\nabla D_T$; under route (i), $\eta_T$ need not take the additively separable form of (ref). In both cases, what matters is that $U$ enters the relevant equation with the same coefficient in periods $T-1$ and $T$, so that it cancels exactly under differencing. This structural double robustness is related to, but distinct from, the findings of arkhangelsky2022doubly and arkhangelsky2021double. Those papers distinguish a model-based path restricting the outcome equation and a design-based path restricting the treatment equation, and construct estimators that are consistent if either restriction holds. Our result differs in that our framework accommodates continuously varying rather than binary treatments, and that both routes here concern the linear projection of the outcome on the treatment, rather than a nonparametric conditional mean.
By Proposition (ref), the treatment effect may be heterogeneous across covariates, but not between the two time periods being differenced. The following example shows that this restriction across time cannot be dispensed with.
Finally, it is worth discussing why no IV-based ratio, of the kind used in Proposition (ref), is needed for TWFE-based identification when the treatment effect is homogeneous (or linear) in the treatment level with a common slope $\delta(\bar X_{T-1})$ in both periods. Under homogeneity, $\nabla Y_T = \delta(\bar X_{T-1}) D_T + \eta_T - (\delta(\bar X_{T-1}) D_{T-1}+\eta_{T-1}) = \delta(\bar X_{T-1})\,\nabla D_T + \nabla\eta_T$: the prior level $D_{T-1}$ cancels algebraically from the regression equation itself, making the instrumental variable approach obsolete. This is different from the level regression of Proposition (ref): $D_{T-1}$ remains in the equation $Y_T = \delta_T(\bar X_{T-1}) D_{T-1} + \delta_T(\bar X_{T-1})\,\nabla D_T + \eta_T$ and its correlation with $\nabla D_T$ is absorbed, rather than eliminated, by dividing by the first-stage covariance $\mathrm{Cov}(\nabla D_T,D_T\mid\bar X_{T-1})$. Once the response function relating the outcome to the treatment level is nonlinear, so that the treatment effect is heterogeneous in the treatment level, this algebraic cancellation no longer occurs for TWFE. For a nonlinear response function $m$, $Y_T(D_T)-Y_{T-1}(D_{T-1}) = m(D_T)-m(D_{T-1})$ depends on both endpoints $D_{T-1}$ and $D_T$ rather than on $\nabla D_T$ alone, so that the resulting TWFE coefficient is a weighted average of effects across units. The DR result of Proposition (ref) is therefore specific to effects that are linear in treatment levels.
This section presents two simulation panels illustrating the non-nesting results of Section (ref), the rescaling result of Section (ref), and the double robustness (DR) of TWFE established in Proposition (ref). Throughout, all four estimators --- the OLS regression of $Y_1$ on $\nabla D_1$, the OLS regression of $\nabla Y_1$ on $D_1$ and $D_0$, the OLS regression of $Y_1$ on $D_1$, $D_0$, and $Y_0$, and TWFE --- are linear estimators, and the moment conditions they rely on are exactly the (IV), (D), and ($\nabla$Y) conditions of Section (ref). We label the first of these estimators “IV-$\nabla D$” throughout this section, rather than “CIA-$\nabla D$”, to reflect that what the simulation verifies is the linear moment condition (ref) of Proposition (ref) for instrument-based effect identification, not the full nonparametric conditional independence of Assumption (ref). Since the data-generating processes below have a single covariate $X_0$ and a treatment effect that does not vary with $X_0$, we write $\delta$ and $\lambda$ for the treatment effect $\delta_T(\bar x)$ and persistence factor $\lambda_T(\bar x)$ of Section (ref), dropping the covariate argument, which is constant across $X_0$ throughout.
Panel A uses the following data generating process (DGP) with independent period-specific unobservables:
We report results for four linear estimators: IV-$\nabla D$ (OLS of $Y_1$ on $\nabla D_1$ and $X_0$), ($\nabla$Y) (OLS of $\nabla Y_1$ on $D_1$, $D_0$, and $X_0$), (D) (OLS of $Y_1$ on $D_1$, $D_0$, $X_0$, and $Y_0$), and TWFE (OLS of $\nabla Y_1$ on $\nabla D_1$ and $X_0$).
The moment condition (IV) requires the treatment change to be uncorrelated with the structural residual: $\nabla D_1 = W_1 - W_0 + (\alpha-1)U$ contains $U$ whenever $\alpha \neq 1$, but this only induces a nonzero covariance with the residual if $U$ also affects $Y_1$, i.e.\ if $\gamma \neq 0$. (IV) therefore holds iff $\alpha=1$ or $\gamma=0$. ($\nabla$Y) requires the treatment level to be uncorrelated with the residualized outcome change: $\nabla Y_1 - \delta(D_1-D_0) = (\gamma-1)U + V_1 - V_0$ correlates with $D_1$ whenever $\gamma \neq 1$ and $\alpha \neq 0$, so ($\nabla$Y) holds iff $\gamma=1$ or $\alpha=0$. (D) requires no residual correlation after conditioning on $Y_0$, $D_0$, and $X_0$: when $\gamma=0$, $U$ does not enter $Y_1$ so there is no correlation regardless of $\alpha$; when $\alpha=0$, $U$ does not enter $D_1$ so $D_1$ is exogenous regardless of $\gamma$. (D) therefore holds iff $\alpha=0$ or $\gamma=0$.
TWFE's DR property rests on a different, and in general non-equivalent, pair of conditions. Route (i) of Proposition (ref) requires $U$ to enter the treatment equation with the same coefficient in both periods --- here, period $0$'s coefficient is fixed at $1$, so route (i) requires $\alpha=1$, regardless of $\gamma$. Route (ii) requires $U$ to enter the outcome equation with the same coefficient in both periods --- here, requiring $\gamma=1$, regardless of $\alpha$. Note that $\delta=1$ in both periods throughout, so the homogeneity condition of Proposition (ref) is otherwise satisfied whenever one of these two conditions holds. The condition $\gamma=0$, which makes (IV) and (D) hold, does not by itself satisfy either route: it removes $U$ from the period-$1$ outcome residual entirely, rather than matching its coefficient to period $0$'s, where $U$ still enters with coefficient $1$.
We consider six scenarios: A1 ($\alpha=1, \gamma=2$), in which (IV) holds ($\alpha=1$) but ($\nabla$Y) fails ($\gamma \neq 1$, $\alpha \neq 0$) and (D) fails ($\alpha \neq 0$, $\gamma \neq 0$); route (i) for TWFE's DR applies since $\alpha=1$. A2 ($\alpha=1, \gamma=0$), in which (IV) and (D) hold since $\alpha=1$ and $\gamma=0$ respectively, but ($\nabla$Y) fails since $\gamma \neq 1$ and $\alpha \neq 0$; route (i) for TWFE's DR again applies since $\alpha=1$. A3 ($\alpha=1, \gamma=1$), in which (IV) and ($\nabla$Y) hold simultaneously, and both DR routes apply. A4 ($\alpha=2, \gamma=1$), in which ($\nabla$Y) holds ($\gamma=1$) but (IV) fails ($\alpha \neq 1$, $\gamma \neq 0$) and (D) fails; route (i) for TWFE's DR fails since $\alpha\neq1$, but route (ii) applies since $\gamma=1$. A5 ($\alpha=2, \gamma=0$), in which (IV) and (D) hold since $\gamma=0$ eliminates $U$ from $Y_1$, but ($\nabla$Y) fails since $\gamma \neq 1$ and $\alpha \neq 0$; neither DR route applies, since $\alpha\neq1$ and $\gamma\neq1$, even though (IV) holds. A6 ($\alpha=2, \gamma=2$), in which all three moment conditions are violated and neither DR route applies either.
The probability limits against which bias is measured follow directly from equation (ref): under (IV), the IV-$\nabla D$ regression coefficient converges to $\delta\cdot\lambda_1(X_0)$, not to $\delta$ itself, while ($\nabla$Y), (D), and TWFE converge to $\delta$ directly when their respective moment conditions hold. We therefore rescale the IV-$\nabla D$ coefficient by $1/\hat\lambda_1$, exactly as in the rescaling discussed in Section (ref) and applied in the empirical application below, and report bias for the rescaled estimate against the common target $\delta=1$, on the same footing as the other three estimators. The persistence factor $\lambda_1$ depends on $\alpha$ in this DGP: when $\alpha=1$, $\nabla D_1 = W_1 - W_0$ with $W_0$ and $W_1$ independent and of equal variance, so $\lambda_1 = \mathrm{Var}(W_1)/(\mathrm{Var}(W_1)+\mathrm{Var}(W_0)) = 1/2$; when $\alpha=2$, $\lambda_1=1$ instead. Rescaling by the scenario-specific $\hat\lambda_1$ in each case isolates the bias attributable to a genuine violation of condition (IV) from the mechanical effect of $\lambda_1$ differing from one, which would otherwise contaminate the comparison across scenarios with different values of $\alpha$. TWFE avoids any such rescaling because differencing both outcome and treatment yields $\nabla Y_1 = \delta\,\nabla D_1 + \nabla V_1$ whenever $\delta$ is homogeneous across periods, as it is throughout this DGP, so that the numerator and denominator of the TWFE regression coefficient cancel exactly to recover $\delta=1$ regardless of $\alpha$. TWFE bias, as well as ($\nabla$Y) and (D) biases, are reported against $\delta=1$.
Table (ref) reports bias and root mean squared error (RMSE) based on 1{,}000 simulations and two sample sizes, $n=500$ and $n=2{,}000$. For all consistent estimators, the RMSE approximately halves when the sample size quadruples, consistent with the expected $\sqrt{n}$ convergence rate, while the bias remains negligible across both sample sizes. Scenario A1 shows that (IV) does not imply ($\nabla$Y) or (D): the rescaled IV-$\nabla D$ estimate has a bias of $\approx 0$ against $\delta=1$, while ($\nabla$Y) has a persistent bias of $0.33$ and (D) has a bias of $0.50$. TWFE also has a bias of $\approx 0$ against $\delta=1$: this reflects route (i) for TWFE's DR, which applies because $\alpha=1$, rather than the moment condition (IV) as such.
Scenarios A4 and A5 both have $\alpha=2$, so $\lambda_1=1$ in both, and the rescaled IV-$\nabla D$ estimate isolates the bias attributable to condition (IV) alone. At A5, where $\gamma=0$ makes (IV) hold, the rescaled bias is $\approx 0$, confirming that rescaling by the correct, scenario-specific $\hat\lambda_1$ removes any contamination from $\lambda_1$ differing from one half. At A4, where $\gamma=1\neq0$ makes (IV) fail, the rescaled bias is $0.33$, reflecting the genuine violation. The two scenarios diverge sharply for TWFE, however: it is unbiased at A4 but has a bias of $-0.34$ at A5, even though (IV) holds at A5 and fails at A4. The reason is that, in this DGP, $U$ enters the period-$0$ outcome with coefficient $1$, so route (ii) for TWFE's DR requires $\gamma=1$ specifically, not merely $\gamma\neq$ some other value: at A4, $\gamma=1$ matches this coefficient exactly, and TWFE is robust through route (ii); at A5, $\gamma=0$ instead removes $U$ from the period-$1$ residual without matching it to period $0$, so neither DR route applies, and TWFE is biased even though the single-period condition (IV) holds. Scenario A5 thus shows that satisfying (IV) alone --- a restriction on the period-$1$ residual only --- does not confer DR on TWFE when $U$'s coefficient in the treatment equation also changes across periods. Scenarios A2 and A3 confirm the remaining non-nesting directions of Proposition (ref), and A6 confirms that all four estimators are biased when all moment conditions are violated simultaneously.
Panel B uses a DGP in which the treatment shock follows a random walk and a dynamic treatment effect is present:
where $\phi \geq 0$ controls the dynamic effect of $D_0$ on $Y_1$. This DGP satisfies the treatment equation of Model A, with $\nabla D_1 = \varepsilon_1$ always free of $U$ by the random-walk structure, so by Proposition (ref) Assumptions (ref), (ref), and (ref) all hold simultaneously, regardless of $\gamma$ or $\phi$, and TWFE inherits consistency. Since $\lambda_1=1$ here, IV-$\nabla D$ is not attenuated and all four estimators are reported against $\delta=1$. We consider two scenarios: B1 ($\gamma=1, \phi=0$), a baseline without dynamic effects and moderate confounding, in which all strategies are straightforwardly valid; and B2 ($\gamma=2, \phi=0.5$), which combines strong fixed-effect confounding with a dynamic treatment effect that would invalidate strategies under the Panel A DGP, but does not do so here because $\nabla D_1 = \varepsilon_1$ is a genuinely fresh innovation, independent of $U$ and of the entire treatment history.
Table (ref) confirms Proposition (ref): all four estimators are unbiased in both scenarios, with RMSE again approximately halving when going from $n=500$ to $n=2{,}000$, consistent with $\sqrt{n}$ convergence. Scenario B2 is the key illustration: despite strong fixed-effect confounding and a dynamic treatment effect, all four methods remain consistent under the random-walk structure of Model A. The larger RMSE of IV-$\nabla D$ and TWFE relative to ($\nabla$Y) and (D) in B2 reflects that ($\nabla$Y) and (D) include $D_0$ as a regressor, directly controlling for the dynamic effect $\phi D_0$ on $Y_1$ and thereby reducing residual variance, whereas IV-$\nabla D$ and TWFE do not include $D_0$ separately so this variation remains in the residual.
The contrast between Panels A and B illustrates the central message of Section (ref): whenever the treatment process is not (close to) a random walk, as in Panel A whenever $\alpha\neq1$, the IV-$\nabla D$ estimator is informative about the structural parameter $\delta$ only after rescaling by the persistence factor, and it does not, in general, identify the same object as ($\nabla$Y), (D), or TWFE even when its own moment condition (IV) is satisfied. Only under the random-walk structure of Model A, illustrated in Panel B, do all four estimators target $\delta$ directly and simultaneously.
To illustrate the identification strategies and the overidentification tests developed in Sections (ref)--(ref), we estimate the price elasticity of cigarette demand using the panel data previously analyzed by baltagi1994 covering 46 US states over the period 1963--1992. The data set covers $1{,}380$ state-year observations (or $1{,}334$ after first-differencing) and is available in the plm package by croissant2008plm for the statistical software R. The outcome $Y_{i,t}$ for individual $i$ in period $t$ is log per-capita cigarette sales (packs per year), the treatment $D_{i,t}$ is log real cigarette price (nominal price deflated by the CPI), and the covariates $X_{i,t}$ consist of log real per-capita disposable income and log population aged 16 and over. Cigarette demand is an interesting testing ground, as real prices vary substantially across states and over time owing to differences in state excise taxes, and the literature offers a well-established benchmark price elasticity of approximately $-0.3$ to $-0.5$, as discussed in chaloupkaWarner2000.
We implement four empirical strategies: the instrumental-variables estimator motivated by Proposition (ref), which we label IV-$\nabla D$; the DiD-type estimator based on Assumption (ref), which we label ($\nabla$Y); the selection-on-observables estimator based on Assumption (ref), which we label (D); and TWFE. In line with our previous discussion, for any strategy in which $D_{i,t}$ enters in levels, $D_{i,t-1}$ is added as an additional control variable, and whenever $Y_{i,t}$ enters in levels, $Y_{i,t-1}$ is added as an additional control variable. The continuous controls $X_{i,t}$ enter at both the current level $X_{i,t}$ and the lagged level $X_{i,t-1}$ as separate regressors. Year fixed effects are included in all four specifications. State fixed effects are never included explicitly, but are eliminated by outcome differencing when relying on ($\nabla$Y) and TWFE, while $Y_{i,t-1}$ is controlled for instead when relying on IV-$\nabla D$ and (D). Assuming linear outcome models, the four regression specifications are:
As established in Section (ref), ($\nabla$Y), (D), and TWFE all estimate the homogeneous price elasticity $\delta$ directly under their respective moment conditions, while the IV-$\nabla D$ coefficient converges to $\delta\cdot\lambda$ and must be rescaled by the inverse of an estimate of the persistence factor $\lambda$, denoted by $\hat\lambda$, before overidentification tests can be run. Here $\delta$ and $\lambda$ denote the pooled, covariate-independent versions of $\delta_T(\bar x)$ and $\lambda_T(\bar x)$ from Section (ref): the OLS specifications below impose a single price elasticity and a single persistence factor common to all states and years, rather than allowing either to vary with $\bar x$. We estimate $\hat\lambda$ as the pooled OLS coefficient from a regression of $D_{i,t}$ on $\nabla D_{i,t}$ after partialling out $Y_{i,t-1}$, $X_{i,t-1}$, and year fixed effects, matching the definition in equation (ref) averaged over the joint distribution of states and years:
where tildes denote residuals after partialling out $Y_{i,t-1}$, $X_{i,t-1}$, and year fixed effects. The contemporaneous controls $X_{i,t}$ are excluded since they are measured after treatment assignment, but including them leaves $\hat\lambda$ unchanged at three decimal places. The standard error of $\hat\lambda$ is computed by block-bootstrapping states with 500 bootstrap samples, and the resulting uncertainty is propagated into the standard error of the rescaled IV-$\nabla D$ estimate via the delta method.
In addition to OLS, we estimate treatment effects using the causal forest of WagerAthey2018 and AtheyTibshiraniWager2019, which allows for heterogeneous treatment effects and nonparametric estimation. For ($\nabla$Y) and (D), the treatment enters in levels, and the causal forest directly estimates the conditional average marginal effect $\delta_t(\bar x)$ as defined in equation (ref), if Assumptions (ref) and (ref) are satisfied, respectively. For IV-$\nabla D$, Proposition (ref) guarantees that the ratio in equation (ref) recovers the price elasticity exactly when it is homogeneous, and Proposition (ref) establishes the analogous result for TWFE when the price elasticity takes the same value in both periods being differenced. Both results are specific to a price elasticity that does not vary with the price level itself. If, however, the price elasticity is heterogeneous in the price level, as permitted when applying the causal forest, the IV-$\nabla D$ ratio identifies a weighted average of the marginal price response rather than $\delta_t(\bar x)$, as discussed in Section (ref). Furthermore, TWFE's DR property no longer applies under effect heterogeneity, which needs to be borne in mind when interpreting the results further below. For IV-$\nabla D$, we train a causal forest with $Y_{i,t}$ as the outcome and $\nabla D_{i,t}$ as the treatment, conditional on pre-determined covariates $\bar{X}_{i,t-1}$ including year dummies, and a second causal forest with $D_{i,t}$ as the outcome and $\nabla D_{i,t}$ as the treatment to obtain unit-level estimates $\hat\lambda_t(\bar{x}_i)$, dividing the first by the second before averaging. For TWFE, we train a single causal forest with $\nabla Y_{i,t}$ as the outcome and $\nabla D_{i,t}$ as the treatment conditional on the covariates. We use the grf package of TibshiraniAtheyWager2020grf with 2{,}000 honest trees and tuned hyperparameters throughout.
Table (ref) reports the estimation results. The linear estimate of the persistence factor is $\hat\lambda = 0.552$ with a standard error (SE) of $0.021$ based on the block bootstrap, strongly rejecting the random-walk hypothesis $\lambda=1$ ($p<0.001$). This implies that Model A does not describe the price process, motivating the instrument-based approach underlying IV-$\nabla D$, for which the rescaling factor is $1/\hat\lambda = 1.81$ for the linear case. The OLS estimates based on ($\nabla$Y) ($\hat\delta=-0.395$, SE$\,=0.038$), (D) ($\hat\delta=-0.402$, SE$\,=0.039$), and TWFE ($\hat\delta=-0.380$, SE$\,=0.039$) are tightly grouped, while the rescaled IV-$\nabla D$ estimate ($\hat\delta=-0.684$, SE$\,=0.075$) lies approximately $0.29$ log-points above this cluster. Running Hausman overidentification tests reflects this finding: all three comparisons involving IV-$\nabla D$ reject ($p<0.001$ against ($\nabla$Y), $p=0.001$ against (D), $p<0.001$ against TWFE), while the comparisons ($\nabla$Y) vs.\ (D) ($p=0.896$), ($\nabla$Y) vs.\ TWFE ($p=0.793$), and (D) vs.\ TWFE ($p=0.695$) all fail to reject, confirming that the level-based strategies and TWFE agree closely. The causal forest estimates provide a more nuanced picture. The estimates based on ($\nabla$Y) ($\hat\delta=-0.326$, SE$\,=0.030$) and (D) ($\hat\delta=-0.386$, SE$\,=0.037$) remain close to each other, with the corresponding Hausman test failing to reject ($p=0.206$). The causal forest estimate for TWFE ($\hat\delta=-0.365$, SE$\,=0.036$) also falls in this range, and does not reject against either ($\nabla$Y) ($p=0.408$) or (D) ($p=0.684$). The rescaled nonparametric IV-$\nabla D$ estimate ($\hat\delta=-0.519$, SE$\,=0.075$) shifts somewhat toward ($\nabla$Y) and (D) relative to OLS, though ($\nabla$Y) vs.\ IV-$\nabla D$ continues to reject ($p=0.018$) and IV-$\nabla D$ vs.\ TWFE is borderline ($p=0.067$), while IV-$\nabla D$ vs.\ (D) no longer rejects ($p=0.115$).
Taken together, these results indicate that the price-change-based instrumental-variables strategy tends to disagree with ($\nabla$Y) and (D) in this application: across both OLS and the causal forest, Hausman tests consistently find that the IV-$\nabla D$ estimate is distinct from those based on ($\nabla$Y) and (D), which agree closely with each other under both estimators, and largely with the OLS estimate of TWFE as well. In a linear world in which the price elasticity does not vary with the price level, the gap between the rescaled linear IV-$\nabla D$ estimate and the other three strategies based on OLS indicates a violation of the IV-exogeneity condition (ref). The comparison with TWFE is especially informative in light of Proposition (ref), since the linear TWFE estimate remains valid whenever either the parallel-trends or the price-change exogeneity condition holds. A plausible source of such a violation is that states experiencing large year-to-year price increases differ systematically in ways that past outcomes and covariates do not fully capture, plausibly because tax-driven price changes reflect state-level political and fiscal conditions that can also be associated with cigarette consumption. If the true model is not linear in the treatment level, the causal forest is arguably more appropriate as an estimation method due to its increased flexibility. When considering the causal forest results, the gap between IV-$\nabla D$ and ($\nabla$Y) and (D) narrows somewhat relative to OLS, yet remains statistically significant. In a nonlinear model, the difference between the IV-$\nabla D$ ratio and the level-based approaches can then either be driven by heterogeneity in the price elasticity across price levels, a violation of some identifying assumptions such as condition (ref), or both. Without imposing linearity, we are therefore unable to rule out either explanation on the basis of these estimates.
This paper has clarified when exploiting treatment changes rather than levels identifies causal effects. The central difficulty is that a unit's treatment change is not assigned independently of its history: it builds on whatever treatment level the unit already had, and that level reflects the same forces that may also drive the outcome. Removing a fixed, time-constant confounder is not enough to rule this out, since the outcome can still depend on the unit's evolving treatment history through channels a simple differencing argument does not address.
We show that a treatment process whose unexplained, time-varying component follows a random walk resolves this fully: because each period brings a genuinely new shock, unrelated to everything before it, the treatment change carries no information about the unit's history, and heterogeneous, dynamic treatment effects are identified without further restrictions on the outcome. A second model, which does not require the random walk but otherwise leaves the treatment process unrestricted, does not achieve this on its own, as we show by explicit example. Conditioning on the lagged treatment level does not repair it either. We show, however, that if dynamic treatment effects are ruled out and the treatment effect is taken to be constant given covariates, this second model still makes the treatment change a valid instrument for the treatment level, identifying that constant effect via the standard instrumental-variables ratio. The two models are not nested --- each relaxes one restriction while imposing another.
The random walk permits identifying the conditional average marginal effect, for any pattern of treatment effect heterogeneity. The second model is built around the opposite case, a treatment effect taken to be constant given covariates, and its instrumental-variables route is designed for that case. If the treatment effect is in fact heterogeneous across treatment levels, this same route still identifies a weighted average of the marginal response, exactly as a conventional instrument would under treatment effect heterogeneity, but generally not the same conditional average marginal effect that a selection-on-observables or DiD strategy targets directly. TWFE does not escape this limitation either: its clean recovery of the conditional average marginal effect, established in this paper for the linear case, also relies on conditional effect homogeneity, and a nonparametric version of TWFE loses this property once treatment effects vary with the treatment level.
We further show that, under the random walk, the treatment-change strategy coincides with two conventional strategies based on treatment levels --- selection-on-observables and difference-in-differences --- motivating Hausman-type overidentification tests, while at the level of the linear regression coefficients used in practice the three strategies remain genuinely non-nested. We establish a double-robustness (DR) property of the two-way fixed effects estimator for a treatment effect that is constant across periods: it remains consistent if the time-constant confounder enters either the treatment process or the outcome process in a way that cancels exactly under differencing. The first of these two conditions is exactly the one underlying the second model's instrumental-variables route described above; the second is the parallel-trends condition underlying difference-in-differences. Neither condition needs to hold on its own, but this DR property does not extend to more general models once treatment effects vary across periods and across treatment levels.
These results matter for empirical practice. Researchers using treatment changes for identification should be explicit about which structural route they rely on, since the two are not interchangeable. A natural diagnostic is to test whether the treatment process lacks the persistence implied by a random walk. Rejecting this, as we find for cigarette prices in our empirical application, means the treatment-change estimator should be read through the instrumental-variables lens rather than as recovering the same effect as the other strategies. The overidentification tests developed here offer a further diagnostic, best combined with falsification tests on pre-treatment periods, and the DR property of TWFE provides some protection against misspecification when strategies disagree, though it does not substitute for direct examination of the underlying structural assumptions.