Extracted main text — title through conclusion, appendix excluded. This is what our citation measures are computed over, published so the extraction can be checked by eye.
48,012 characters · 14 sections · 61 citation commands
\runningauthor{Arbour, Parikh, Niknam, Stuart, Rudolph, Feller}
\twocolumn[ \aistatstitle{Regularizing Extrapolation in Causal Inference}
\aistatsauthor{David Arbour\footnotemark[1] \And Harsh Parikh\footnotemark[1] \And Bijan Niknam}
\aistatsaddress{Adobe Research \And Yale University \And Johns Hopkins University}
\aistatsauthor{Elizabeth Stuart \And Kara Rudolph \And Avi Feller} \aistatsaddress{Johns Hopkins University \And Columbia University \And University of California, Berkeley} ] \footnotetext[1]{co-first authors; alphabetical order}
A core challenge in observational causal inference and domain adaptation is to adjust data distributions so that features are comparable across distinct groups, such as control and treated arms or source and target populations imbens2015causal, farahani2021brief. Weighting estimators and linear smoothers, in which the prediction is a weighted average of training outcomes, are widely used for such adjustment; examples include implicit weighting estimators like ordinary least squares (OLS) and random forests and explicit weighting approaches like inverse propensity score weighting li2013propensity and importance sampling thomas2017importance.
An important divide among weighting estimators is whether weights are constrained to be non-negative, such as in traditional IPW, matching stuart2010, the synthetic control method abadie2010synthetic, and stable balancing weights zubizarreta2015stable, ben2021balancing, as well as in the weighting component of popular doubly robust estimators like double machine learning chernozhukov2018double. This constraint limits extrapolation and dependence on parametric modeling assumptions, but typically at the cost of worse feature imbalance between re-weighted groups. This imbalance is especially pronounced in high-dimensional settings, when the curse of dimensionality means that positivity is less likely to hold, leading to further bias damour2021overlap. By contrast, linear smoothers like OLS and kernel ridge regression allow for arbitrarily negative weights robins2007comment, which can improve feature imbalance but at the cost of greater model dependence and higher estimator variance. Finally, augmented estimators that combine outcome modeling with explicit weighting strategies can be viewed as performing controlled extrapolation, balancing model dependence against feature imbalance. Pure weighting and pure outcome modeling thus represent the two extremes of no versus uncontrolled extrapolation.
In this paper, we leverage this geometric perspective to establish a general framework for systematically controlling extrapolation. In particular, we propose a unified approach that directly penalizes the level of extrapolation, replacing the current practice of a hard non-negativity constraint with a soft constraint and corresponding hyperparameter. Unlike prior research on extrapolation in machine learning that emphasizes predictions beyond observed covariate support, we conceptualize extrapolation through unit weights, a particularly natural framework for handling high-dimensional covariates ben2021augmented. Specifically, our contributions are:
Extrapolation and generalization are core topics in causal inference and machine learning. Recent surveys by degtiar2023review and johansson2022generalization provide comprehensive overviews on generalizability and transportability methods.
\paragraph{Extrapolation and the synthetic control method.} Extrapolating far from the support of the data is a longstanding concern in statistics and the social sciences especially; see king2006dangers for a seminal discussion of possible dangers of unchecked extrapolation. Methods that limit extrapolation are common; the synthetic control method abadie2010synthetic is a particularly prominent example. doudchenko2016balancing discuss the non-negativity constraint in this context, and explore possible regularization. Most relevant to our approach, ben2021augmented developed the augmented synthetic control method, which combines outcome modeling with constrained weights to reduce bias while controlling extrapolation.
\paragraph{Extrapolation in machine learning.} Within machine learning, there has been substantial recent progress on approaches for addressing extrapolation. shen2024engression introduced engression, a framework that views extrapolation through the lens of distributional regression, enabling principled uncertainty quantification outside the training distribution. kong2024towards developed a causal lens for understanding extrapolation, establishing theoretical connections between causal structure and extrapolation. netanyahu2023learning proposed a transductive approach for learning to extrapolate, leveraging unlabeled test points to guide the extrapolation process. dong2022first provided foundational analysis toward understanding the extrapolation of nonlinear models to unseen domains, establishing bounds on extrapolation error. Finally, pfister2024extrapolation developed extrapolation-aware nonparametric statistical inference methods, with formal guarantees on validity beyond the support of training data.
Unlike this recent literature, we approach extrapolation from a weighting perspective, which offers particular advantages in high-dimensional settings. Rather than focusing on predictions outside the covariate support, we frame extrapolation in terms of the properties of unit weights, providing a natural parameterization for high-dimensional settings ben2021augmented. This perspective allows us to directly quantify and regularize the degree of extrapolation without relying on complex directional derivatives or high-dimensional density estimation.
\paragraph{Positivity violations and shifting the target.} Our discussion is closely related to the literature on positivity violations in causal inference. crump2006moving, li2018balancing, and parikh2024we all proposed to avoid issues due to positivity violations by shifting the estimand to regions with greater overlap. By contrast, our approach directly incorporates the severity of positivity violations into the weight estimation process.
\paragraph{Weighting representations.} A growing literature highlights the connections between various causal estimators through their weighting representations chattopadhyay2023implied. knaus2024treatment provided a unified framework for viewing treatment effect estimators as weighted outcomes. bruns2023augmented showed that augmented balancing weights can be interpreted as a form of linear regression. lin2022regression examined regression-adjusted imputation estimators through their weighting properties. Our framework builds on these insights by explicitly parameterizing the degree of extrapolation through weight regularization, providing a continuum of estimators that navigate the bias-variance tradeoff.
To ease exposition, we focus on the causal inference problem of estimating the missing control potential outcome for the Average Treatment Effect on the Treated (ATT). As we note below, however, these results hold for general linear estimands as well as for domain adaptation in ML johansson2022generalization.
For each unit $i \in [n]$, we observe the tuple $(X_i, Y_i, Z_i)$, with covariates $X_i \in \mathcal{X}$, outcome $Y_i \in \mathbb{R}$, and binary treatment $Z_i \in \{0,1\}$. Invoking SUTVA, let $Y_i(0)$ and $Y_i(1)$ denote the control and treated potential outcomes, respectively, for unit $i$. Our estimand of interest is the ATT, $\mathbb{E}[Y_i(1) - Y_i(0) \mid Z_i = 1]$; we discuss generalizations below. Since we observe $Y(1)$ for the treated group, the key challenge is to estimate the missing control potential outcome mean, $\mathbb{E}[Y_i(0) \mid Z_i = 1]$. Finally, define the density ratio $dQ/dP(x)$, where $Q$ and $P$ denote the populations of units assigned to treatment and control, respectively. We need the following key assumptions for nonparametric identification:
In our setup, we consider situations when the population overlap assumption (ref) might be violated. In that case, researchers can instead rely on parametric assumptions on $\mu({\boldsymbol{x}}) = \mathbb{E}[Y(0) \mid X_i = {\boldsymbol{x}}]$, such as linearity, to identify and estimate the expected outcomes.
Finally, following chattopadhyay2023implied, we will focus on estimating the mean at a target covariate profile, ${\boldsymbol{x}}^\star \in \mathcal{X}$, corresponding to our estimand of interest. For the ATT, this profile is simply the mean of the treated population, ${\boldsymbol{x}}^\star = \mathbb{E}[X \mid Z = 1]$, where $\mu({\boldsymbol{x}}^\star) = \mathbb{E}[Y(0) \mid Z = 1]$.
\paragraph{Linear in features.} Since we are focused on linear smoothers, we consider models that are linear in some features, but which could be complex functions of the underlying covariates. This is an extremely large model class that ranges from simple linear models to the last layer embedding from a pre-trained large language model. For our setup, we let ${\boldsymbol{x}}$ be the features in the representation implied by the parametric model, rather than simply the raw covariates. We further assume:
Parameterizing $\mu$ in terms of its H\"older constants is useful for characterizing departures from linearity that directly affect the estimation error bound.
\paragraph{General linear estimands.} We can leverage recent work on the Riesz representer chernozhukov2022automatic to immediately generalize our results to any linear functional of the data. Following bruns2023augmented, for each unit $i \in [n]$, we observe the tuple $(X_i, Y_i, Z_i)$, with covariates $X_i \in \mathcal{X}$, outcome $Y_i \in \mathbb{R}$, and treatment $Z_i \in \mathcal{Z}$. The target functional is then $\mathbb{E}[h(X_i, Z_i, m)]$ for a function $h \in L_2$, where $m(x,z) = \mathbb{E}[Y_i \mid X_i = x, Z_i = z]$. Many common problems in causal inference and domain adaptation are special cases of this setup, including counterfactual quantities like the average derivative and the expected policy-specific outcome. Finally, define a feature map $\phi : \mathcal{X} \times \mathcal{Z} \to \mathbb{R}^d$; the target feature profile is then $\phi^*(x,z) = \mathbb{E}[ h(X, Z, \phi) ]$. Our results below apply by replacing the simple covariate profile ${\boldsymbol{x}}^\star$ with the much more general feature profile $\phi^\star(x,z)$.
Our focus is on weighting estimators or linear smoothers buja1989linear of the form:
with weights $w_{\star \leftarrow i}({\boldsymbol{x}}_i)$, where $\star \leftarrow i$ emphasizes that the weights can depend both on the source covariates ${\boldsymbol{x}}_i$ and the target covariates ${\boldsymbol{x}}^\star$ lin2022regression. When there is no ambiguity, we suppress the dependence on the covariates ${\boldsymbol{x}}_i$ and the target ${\boldsymbol{x}}^\star$.
A broad class of estimators have this form. See knaus2024treatment for a comprehensive discussion of the weighting form for common causal inference estimators. We highlight several special cases here, with a focus on whether the implied weights are constrained to be non-negative.
\paragraph{Explicit weighting estimators.} The first class of methods estimate the density ratio $\widehat{dQ/dP}(x)$, either directly or indirectly.
\paragraph{Linear smoothers and implicit weighting estimators.} A wide range of popular outcome models are linear smoothers that implicitly estimate weights $w$, including (kernel ridge) regression, $k$-nearest neighbors, random forests, xgboost, and many implementations of neural networks; see lin2022regression, curth2024random. We highlight two prominent examples with and without a non-negativity constraint.
\paragraph{Augmented and hybrid estimators.} Finally, augmented or hybrid estimators combine initial weights ${\boldsymbol{w}}^0$ and outcome model $\hat{m}$:
When $\hat{m}$ is a linear smoother, then $\hat\mu^{dr}({\boldsymbol{x}})$ also has a weighting representation. Let $\hat{m}({\boldsymbol{x}}^\star) = \sum \hat{\omega}_i({\boldsymbol{x}}) Y_i$ for a weighting function $\hat{\omega}: \mathbb{R}^d \to \mathbb{R}^n$. Following ben2021augmented:
For example, when the outcome model is ridge regression, the implied weights for the doubly robust estimator have the following form: $$ \hat{w}^{dr}_i = \hat{w}^0_i + ({\boldsymbol{x}}^\star - {\boldsymbol{x}}'\hat{{\boldsymbol{w}}}^0)' ({\boldsymbol{x}}'{\boldsymbol{x}} + \lambda \mathbb{I})^{-1} {\boldsymbol{x}}_i. $$ Importantly, even if the initial weights ${\boldsymbol{w}}^0$ are constrained to be non-negative, such as in traditional IPW, the implied doubly robust weights ${\boldsymbol{w}}^{dr}$ could be negative. In fact, the combined weights can be negative even if both the initial weights ${\boldsymbol{w}}^0$ and the outcome model-implied weights $\hat{\omega}$ are non-negative.
There are many examples of combined estimators of this form: standard Augmented IPW chattopadhyay2023implied, bias correction for inexact matching lin2021nn_matching, augmented synthetic control method ben2021augmented, and regression-adjusted imputation estimators more broadly lin2022regression. Finally, both debiased machine learning chernozhukov2018double and automatic debiased machine learning chernozhukov2022automatic have this form. The former constrains the initial weights to be non-negative; the latter does not.
Our goal is to bound the estimation error $\left| \mu({\boldsymbol{x}}^\star) - \sum_{i=1}^n w_i Y_i \right|.$ We begin by building intuition for our approach in three steps.
\paragraph{Reflection representation.} Under linearity, $\mu(-{\boldsymbol{x}}_i) = -\mu({\boldsymbol{x}}_i)$, so a negative weight $w_i < 0$ on ${\boldsymbol{x}}_i$ yields $w_i \mu({\boldsymbol{x}}_i) = |w_i| \mu(-{\boldsymbol{x}}_i)$; in other words, a negative weight $w_i$ is equivalent to applying a positive weight $|w_i|$ to the reflected point $-{\boldsymbol{x}}_i$. We can then construct a “reflected” estimator, denoted by $\ddagger$, which reflects points with negative weights around the origin:
where $\hat\mu({\boldsymbol{x}}^\star) = \hat\mu^\ddagger({\boldsymbol{x}}^\star)$ if $\mu$ is an odd function, and where $w_i {\boldsymbol{X}}_i = |w_i| {\boldsymbol{X}}^\ddagger_i$ for all $i$.
\paragraph{Measuring parametric model violations.} The difference between $\hat\mu({\boldsymbol{x}}^\star)$ and $\hat\mu^\ddagger({\boldsymbol{x}}^\star)$ measures the degree to which the assumed parametric model is violated. Specifically, we can write $\mu(-{\boldsymbol{x}}_i) = \delta({\boldsymbol{x}}_i) - \mu({\boldsymbol{x}}_i)$, where $\delta({\boldsymbol{x}}_i) \equiv \mu(-{\boldsymbol{x}}_i) + \mu({\boldsymbol{x}}_i)$. If $\mu$ is an odd function (e.g., $\mu$ is linear through the origin), then $\delta({\boldsymbol{x}}_i) = 0$ for all $i$. Thus, $\delta({\boldsymbol{x}}_i)$ is a point-specific measure of the extent to which the true outcome function violates the assumed parametric model; throughout, our discussion of “nonlinearity” should be understood as referring to such violations.
We use this representation to decompose the estimator $\hat{\mu}({\boldsymbol{x}}^\star)$:
\paragraph{Error bound.} Although $\delta({\boldsymbol{X}})$ is unknown, we can bound it via H\"older continuity: $|\delta({\boldsymbol{x}})| = |\mu({\boldsymbol{x}}) + \mu(-{\boldsymbol{x}})| \leq |\mu({\boldsymbol{x}}) - \mu(\mathbf{0})| + |\mu(-{\boldsymbol{x}}) - \mu(\mathbf{0})| \leq 2a\|{\boldsymbol{x}}\|^\alpha$, where the last step uses $\mu(\mathbf{0}) = 0$, which holds after centering.\footnote{Replace $Y_i$ with $Y_i - \hat{\mu}(\mathbf{0})$, where $\hat{\mu}(\mathbf{0})$ is the fitted intercept.} The resulting error bound is therefore
The first term directly depends on the imbalance between the target point ${\boldsymbol{x}}^\star$ and the re-weighted (reflected) training points $|{\boldsymbol{w}}|'{\boldsymbol{X}}^\ddagger$. The second term captures additional error due to model violation, corresponding to the $\delta({\boldsymbol{X}})$ term above; this is the key new term that our framework regularizes. The third term is the noise.
Thus far we have presented a conservative nonparametric bound. We now provide a slightly refined characterization by noting that the extent of the bias induced by negative weights is driven by the asymmetry in $\mu$. We do so by considering the decomposition of $\mu$ into its even and odd components, i.e., $\mu(x) = \mu_e(x) + \mu_o(x)$. By the definition of odd functions, we have $-\mu_o(x) = \mu_o(-x)$; we can then bound the worst-case risk of $\hat{\boldsymbol{w}}$ using the assumed H{\"o}lder constants $a$ and $\alpha$ and isolate the effect of the even component. The formal statement is given below in Proposition (ref); the proof is given in Appendix (ref).
The proof in Appendix (ref) proceeds via an even-odd decomposition that shows that negative weights introduce additional bias only through the even component of $\mu$; the odd part is absorbed exactly into the first term via the reflection ${\boldsymbol{X}}_i^\ddagger$. The noise term in Proposition (ref) requires a sub-Gaussian assumption.
Since $\mu_e$ is unidentifiable from a single dataset, we construct a conservative worst-case form that does not require access to $\mu_e$. For completeness, Proposition (ref) in Appendix (ref) provides an empirical analog that approximates $\mu_e$ via nearest-neighbor matching when the data are approximately symmetric.
Finally, following chattopadhyay2023implied, we define negative influence as the fraction of total weight on units with negative weights, $\sum_i\mathbf{1}[w_i < 0] |w_i| / \sum_i |w_i|$. This is a useful summary of the extent to which the estimate relies on extrapolation.
We now propose an estimator to learn weights ${\boldsymbol{w}}$ that directly control the error bound in Equation (ref). To do so, we modify the standard balancing weights optimization problem in Equation (ref) by using the Lagrangian form of the non-negativity constraint, rather than the hard constraint. Thus, the combined estimator minimizes the error bound by controlling three terms: covariate imbalance, dispersion of the weights, and level of extrapolation:
where
Compared to the standard balancing weights problem (ref), which trades off only imbalance and variance, the new objective (ref) introduces term (c) to control extrapolation. When the target lies outside the convex hull of the training points, achieving balance requires some weights to be negative, which increases both $\|{\boldsymbol{w}}\|_2$ and reliance on parametric assumptions. For $\gamma = 0$, Equation (ref) recovers unconstrained balancing weights; at the other extreme, $\gamma \to \infty$ is equivalent to a hard non-negativity constraint. Increasing $\gamma$ reduces extrapolation bias and $\|{\boldsymbol{w}}\|_2$ but worsens imbalance in term (a).
Regularizing existing estimators. Since many causal estimators have a weighting representation (Section (ref)), we can regularize extrapolation in any baseline estimator with implied weights ${\boldsymbol{w}}'$ by solving $$ \hat{\mathbf{w}} \in \arg \min_{\mathbf{w}} \|\mathbf{w} - \mathbf{w}' \|_2^2 + \gamma \textstyle\sum_{i=1}^n \mathbbm{1}(w_i < 0)\, \lvert w_i\rvert \, \|{\boldsymbol{X}}_i\|^\alpha. $$ For example, the augmented synthetic control method ben2021augmented first solves with non-negative weights, then augments with a ridge outcome model that implicitly introduces negative adjustment weights; the formulation above instead directly controls the degree of negativity through $\gamma$.
Convexity. Despite the indicator function in term (c), the optimization problem (ref) is strongly convex and admits a unique global minimizer. To see this, note that $\mathbf{1}(w_i < 0)|w_i| = \max(0, -w_i)$, which is convex as the pointwise maximum of two affine functions. Term (a) is a squared norm of an affine function of ${\boldsymbol{w}}$, hence convex, and term (b) is strongly convex with parameter $2\lambda$. More generally, term (c) can be written using an $\ell_p$ norm over the vector of per-unit penalties. When $p = 1$ (as written above and in Proposition (ref)), introducing slack variables $s_i \geq -w_i$, $s_i \geq 0$ reduces the problem to a quadratic program (QP), which can be solved exactly in polynomial time with standard solvers. When $p = 2$, the problem becomes a second-order cone program (SOCP), which is likewise solvable in polynomial time.
Finally, we can specialize the error bound for our proposed estimator:
The proof is provided in the appendix. The variance term $\sigma\|{\boldsymbol{x}}^*\|_2\sqrt{\log(2/\delta)/\lambda}$ does not depend on $\gamma$: increasing $\gamma$ further constrains the feasible set and cannot inflate $\|\hat{w}\|_2$. This means regularizing extrapolation reduces the bias terms without incurring additional variance cost. The full bias-bias-variance tradeoff is demonstrated empirically in Sections (ref) and (ref).
We argue that $\gamma$ should be treated as a sensitivity parameter rather than a tuning parameter, and encourage researchers to examine the full set of estimates it spans. We recommend the following procedure:
If the goal is a single point estimate, we can instead choose $\gamma^*$ in the spirit of Lepski's method, selecting the largest $\gamma$ for which the change in the point estimate remains below a researcher-defined cutoff.
We evaluate our approach using synthetic data with both linear and nonlinear data generating processes (DGPs) where the target point lies outside the convex hull of training points (Figure (ref)), creating a challenging extrapolation scenario with limited sample size ($n = 10$ training units, $n/p = 5$). We also consider a high-dimensional setting ($p = 5000$, $n/p = 0.2$) using the Friedman DGP. Full descriptions and additional figures are provided in Appendix (ref).
We consider two DGPs:
For the linear DGP, where the parametric assumption holds, estimation error increases monotonically as we regularize extrapolation (i.e., increase $\gamma$): relying on correct parametric assumptions yields optimal estimates. However, for the nonlinear DGP (Figure (ref)), the quadratic and interaction terms violate the linearity assumption. The results illustrate the bias-bias-variance tradeoff predicted by our theory: small amounts of extrapolation remain beneficial due to the linear component, but excessive extrapolation leads to high error rates due to violations of the parametric model. The high-dimensional experiment further demonstrates that sweeping over $\gamma$ smoothly interpolates between parametric regression-like behavior (unconstrained extrapolation) and IPW-like behavior (no extrapolation).
We now apply our framework to the problem of generalizing causal estimates from a randomized trial to a target population. Appendix (ref) states the formal identification assumptions and maps this setting onto the general framework of Section (ref).
The Starting Treatment With Agonist Replacement Therapies (START) trial ($S_i = 1$), initiated in 2006, was a multi-center study comparing buprenorphine versus methadone in treating opioid use disorder saxon2013buprenorphine, hser2014treatment. The trial enrolled 1,271 participants, who were randomized in a 2:1 ratio to receive either buprenorphine or methadone. Methadone was found to have higher rates of patient retention in treatment compared to buprenorphine hser2014treatment. Our analysis focuses on the outcome of relapse to regular opioid use within 24 weeks of medication assignment, defined as non-study opioid use for four consecutive weeks or daily use for seven consecutive days.
parikh2024we identified that Hispanic women with a pre-treatment history of amphetamine and benzodiazepine use were underrepresented in the START trial relative to the target population ($S_i = 0$), highlighting a practical violation of the positivity assumption (ref). In this study, we estimate the target average treatment effect (TATE), $\tau = \mathbb{E}[Y_i(1) - Y_i(0) \mid S_i = 0]$, for this underrepresented subgroup using our proposed framework alongside standard linear regression, gradient boosting regression (GBR), inverse probability weighting (IPW), and double machine learning estimators.
The target sample is drawn from the 2015–2017 Treatment Episode Dataset - Admissions (TEDS-A), which includes data on individuals entering publicly funded substance use treatment programs across 48 states (excluding Oregon and Georgia) and the District of Columbia. Our analysis focuses on Hispanic women with a pre-treatment history of amphetamine and benzodiazepine use.
We code methadone as $Z=1$ and buprenorphine as $Z=0$, with $Y=1$ representing relapse. Pretreatment covariates include age, race, biological sex, and substance use history (amphetamine, benzodiazepines, cannabis, and intravenous drug use) measured at the initiation of medication for opioid use disorder (MOUD) treatment. For each treatment arm $z \in \{0,1\}$, we estimate $\mu_z({\boldsymbol{x}}^\star) = \mathbb{E}[Y_i \mid X_i = {\boldsymbol{x}}^\star, S_i = 1, Z_i = z]$ at the target profile ${\boldsymbol{x}}^\star = \mathbb{E}[X_i \mid S_i = 0]$ using the trial participants assigned to arm $z$ as source units. The estimated TATE is then $\hat{\tau} = \hat{\mu}_1({\boldsymbol{x}}^\star) - \hat{\mu}_0({\boldsymbol{x}}^\star)$.
We then apply our proposed framework to this problem. By varying \(\gamma\) from 0.01 to 10, we examine how treatment effect estimates shift with increasing regularization of negative weights. Without regularization, the point estimates converge to those from linear regression. As regularization intensifies, however, the estimates smoothly shift towards zero and occasionally change sign from negative to positive for smaller values of \(\lambda\). This sensitivity underscores the influence of assumptions on the point estimates. While increasing \(\gamma\) reduces negative influence (Figure (ref)), it worsens covariate balance, as reflected in higher RMSE values (Figure (ref)). Thus, our framework highlights a trade-off between minimizing reliance on parametric assumptions and achieving optimal covariate balance. Applied researchers should therefore interpret treatment effect estimates for this under-represented subgroup with caution given the sensitivity to modeling assumptions. As parikh2024we emphasized, collecting more representative trial data is critical to credibly estimate treatment effects.
This work proposes a framework for regularizing extrapolation in causal inference by replacing hard non-negativity constraints with soft penalties on negative weights. Our theoretical error bounds show a fundamental “bias-bias-variance” tradeoff between distributional imbalance, model misspecification, and estimator variance, decomposing extrapolation bias through a novel reflection perspective. Empirically, synthetic data experiments confirm that controlled extrapolation smoothly interpolates between fully constrained and unconstrained approaches. A real-world medication trial illustrates how sweeping over the regularization parameter provides a practical sensitivity analysis for transportability estimates under positivity violations.
Limitations and Future Work. Our approach focuses on weighting-type estimators and relies on H\"{o}lder continuity and conditional ignorability, which may not hold in practice. Operationalizing sensitivity analysis for unmeasured confounding is a critical next step; existing proposals for balancing weights soriano2023interpretable do not directly apply to our framework, and adapting such methods is an important direction. More broadly, future work should extend the bias-bias-variance tradeoff analysis to more flexible estimator classes and weaker continuity assumptions. A key open question is to characterize data-generating processes under which soft-constrained extrapolation ($\gamma > 0$) provably improves MSE relative to both unconstrained ($\gamma = 0$) and fully constrained ($\gamma \to \infty$) estimators, for example when the density ratio is large near ${\boldsymbol{x}}^\star$. Finally, our theoretical results assume sub-Gaussian noise, though analogous bounds follow under bounded outcomes via Hoeffding-type inequalities.
The authors would like to thank the reviewers, the area chair, and the program chair of AISTATS 2026 for their constructive input to help improve the paper. Harsh Parikh, Kara Rudolph, and Elizabeth Stuart would like to acknowledge that this work was funded by NIH NIDA R01DA056407.