EconBase
← All papers

Policy Learning under Biased Sample Selection

Lihua Lei, Roshni Sahoo, Stefan Wager

arXiv 23 Apr 2023 · Econometrics · 4 citations (OpenAlex)

arXiv:2304.11735 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Practitioners often use data from a randomized controlled trial to learn a treatment assignment policy that can be deployed on a target population. A recurring concern in doing so is that, even if the randomized trial was well-executed (i.e., internal validity holds), the study participants may not represent a random sample of the target population (i.e., external validity fails)--and this may lead to policies that perform suboptimally on the target population. We consider a model where observable attributes can impact sample selection probabilities arbitrarily but the effect of unobservable attributes is bounded by a constant, and we aim to learn policies with the best possible performance guarantees that hold under any sampling bias of this type. In particular, we derive the partial identification result for the worst-case welfare in the presence of sampling bias and show that the optimal max-min, max-min gain, and minimax regret policies depend on both the conditional average treatment effect (CATE) and the conditional value-at-risk (CVaR) of potential outcomes given covariates. To avoid finite-sample inefficiencies of plug-in estimates, we further provide an end-to-end procedure for learning the optimal max-min and max-min gain policies that does not require the separate estimation of nuisance parameters.

Citation extraction

37
references
87
in-text mentions
37
distinct cited
3
self-citations
9,771
main-text words

appendix boundary found by appendix_command · 44% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Christopher Adjaho and Timothy Christensen (2022) Externally valid treatment choice0.69371100%
2Charles F Manski (2011) Choosing treatment policies under ambiguity0.69371100%
3Nian Si, Fan Zhang, Zhengyuan Zhou, and Jose Blanchet (2020) Distributional robust batch contextual bandits0.69371100%
4Leonard J Savage (1951) The theory of statistical decision0.69351100%
5Nathan Kallus and Angela Zhou (2021) Minimax-optimal policy learning under unobserved confounding0.64441100%
6Tong Mu, Yash Chandak, Tatsunori B Hashimoto, and Emma Brunskill (2022) Factored DRO: Factored distributionally robust policies for contextual bandits0.64441100%
7Roshni Sahoo, Lihua Lei, and Stefan Wager (2022) Learning from a biased sample self0.6308175%
8Eli Ben-Michael, D James Greiner, Kosuke Imai, and Zhichao Jiang (2021) Safe policy learning through extrapolation: Application to pre-trial risk assessment0.58531100%
9Alan S Gerber, Donald P Green, and Christopher W Larimer (2008) Social pressure and voter turnout: Evidence from a large-scale field experiment0.58531100%
10Toru Kitagawa and Aleksey Tetenov (2018) Who should be treated? empirical welfare maximization methods for treatment choice0.58531100%

Showing the top 10 of 37 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1The Transfer Performance of Economic Models0.40511
2Externally Valid Policy Choice0.40511
3Policy Learning with New Treatments0.40511
4Treatment Choice, Mean Square Regret and Partial Identification0.40511
5Decision Theory for Treatment Choice Problems with Partial Identification0.40511
6Robust Bayes Treatment Choice with Partial Identification0.40511
7Policy Learning with $$-Expected Welfare0.40511
8Policy Learning under Unobserved Confounding: A Robust and Efficient Approach0.40511
9Distributionally Robust Treatment Effect0.40511
10Distributionally Robust Instrumental Variables Estimation0.00011