EconBase
← All papers

Sensitivity Analysis for Causal ML: A Use Case at Booking.com

Philipp Bach, Victor Chernozhukov, Carlos Cinelli, Lin Jia, Sven Klaassen, Nils Skotara, Martin Spindler

arXiv 10 Oct 2025 · Econometrics

arXiv:2510.09109 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Causal Machine Learning has emerged as a powerful tool for flexibly estimating causal effects from observational data in both industry and academia. However, causal inference from observational data relies on untestable assumptions about the data-generating process, such as the absence of unobserved confounders. When these assumptions are violated, causal effect estimates may become biased, undermining the validity of research findings. In these contexts, sensitivity analysis plays a crucial role, by enabling data scientists to assess the robustness of their findings to plausible violations of unconfoundedness. This paper introduces sensitivity analysis and demonstrates its practical relevance through a (simulated) data example based on a use case at Booking.com. We focus our presentation on a recently proposed method by Chernozhukov et al. (2023), which derives general non-parametric bounds on biases due to omitted variables, and is fully compatible with (though not limited to) modern inferential tools of Causal Machine Learning. By presenting this use case, we aim to raise awareness of sensitivity analysis and highlight its importance in real-world scenarios.

Citation extraction

33
references
66
in-text mentions
33
distinct cited
13
self-citations
6,415
main-text words

appendix boundary found by appendix_command · 85% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Victor Chernozhukov, Carlos Cinelli, Whitney Newey, Amit Sharma, and… (2023) Long story short: Omitted variable bias in causal machine learning, 2023 self0.98017694%
2Victor Chernozhukov, Denis Chetverikov, Mert Demirer, Esther Duflo,… (2018) Double/debiased machine learning for treatment and structural parameters, 2018 self0.87462100%
3Carlos Cinelli and Chad Hazlett (2020) Making sense of sensitivity: Extending omitted variable bias self0.87452100%
4Philipp Bach, Victor Chernozhukov, Malte S. Kurz, and Martin Spindler (2022) DoubleML – An object-oriented implementation of double machine learning in Python self0.73732100%
5Guido W Imbens (2003) Sensitivity to exogeneity assumptions in program evaluation0.73732100%
6Carlos Cinelli and Chad Hazlett (2022) An omitted variable bias framework for sensitivity analysis of instrumental variables self0.64422100%
7Philipp Bach, Malte S. Kurz, Victor Chernozhukov, Martin Spindler, a… (2024) DoubleML: An object-oriented implementation of double machine learning in R self0.58531100%
8Victor Chernozhukov, Whitney K Newey, and Rahul Singh (2022) Automatic debiased machine learning of causal and structural effects self0.51121100%
9Joshua D Angrist and Jörn-Steffen Pischke (2009) Mostly harmless econometrics: An empiricist's companion0.40511100%
10Tyler J. Vanderweele and Onyebuchi A. Arah (2011) Bias formulas for sensitivity analysis of unmeasured confounding for general outcomes, treatments, and confounders0.40511100%

Showing the top 10 of 33 scored citations.