EconBase
← All papers

Estimating and Improving Dynamic Treatment Regimes With a Time-Varying Instrumental Variable

Shuxiao Chen, Bo Zhang

arXiv 15 Apr 2021 · Statistics — Methodology

arXiv:2104.07822 · PDF · Extracted main text

Abstract

Estimating dynamic treatment regimes (DTRs) from retrospective observational data is challenging as some degree of unmeasured confounding is often expected. In this work, we develop a framework of estimating properly defined "optimal" DTRs with a time-varying instrumental variable (IV) when unmeasured covariates confound the treatment and outcome, rendering the potential outcome distributions only partially identified. We derive a novel Bellman equation under partial identification, use it to define a generic class of estimands (termed IV-optimal DTRs), and study the associated estimation problem. We then extend the IV-optimality framework to tackle the policy improvement problem, delivering IV-improved DTRs that are guaranteed to perform no worse and potentially better than a pre-specified baseline DTR. Importantly, our IV-improvement framework opens up the possibility of strictly improving upon DTRs that are optimal under the no unmeasured confounding assumption (NUCA). We demonstrate via extensive simulations the superior performance of IV-optimal and IV-improved DTRs over the DTRs that are optimal only under the NUCA. In a real data example, we embed retrospective observational registry data into a natural, two-stage experiment with noncompliance using a time-varying IV and estimate useful IV-optimal DTRs that assign mothers to high-level or low-level neonatal intensive care units based on their prognostic variables.

Citation extraction

71
references
134
in-text mentions
71
distinct cited
4
self-citations
20,423
main-text words

appendix boundary found by appendix_command · 60% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Cui, Y. and Tchetgen Tchetgen, E (2021) Machine intelligence for individualized decision making under a counterfactual world: A rejoinder1.00063100%
2Murphy, S. A (2003) Optimal dynamic treatment regimes1.00063100%
3Pu, H. and Zhang, B (2020) Estimating optimal treatment rules with an instrumental variable: A partial identification learning approach self0.87462100%
4Cui, Y. and Tchetgen Tchetgen, E (2020) A semiparametric instrumental variable approach to optimal treatment regimes under endogeneity0.87452100%
5Manski, C. F (2003) Partial identification of probability distributions0.84333100%
6Michael, H., Cui, Y., Lorch, S., and Tchetgen, E. T (2020) Instrumental variable estimation of marginal structural mean models for time-varying treatment0.84333100%
7Schulte, P. J., Tsiatis, A. A., Laber, E. B., and Davidian, M (2014) Q-and a-learning methods for estimating optimal dynamic treatment regimes0.81142100%
8Kallus, N., Mao, X., and Zhou, A (2019) Interval estimation of individual-level causal effects under unobserved confounding0.73732100%
9Kallus, N. and Zhou, A (2020) Minimax-optimal policy learning under unobserved confounding0.73732100%
10Lorch, S. A., Baiocchi, M., Ahlberg, C. E., and Small, D. S (2012) The differential impact of delivery hospital on the outcomes of premature infants0.73732100%

Showing the top 10 of 71 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Dynamic Local Average Treatment Effects0.87452