EconBase
← Back to paper

Modeling Interference Using Experiment Roll-out

The exact contents of citations.db main_text.text for this paper — one flattened LaTeX string, title through conclusion, appendix excluded, unmodified except for removing email addresses. This is what our citation measures are computed over.

2,006 characters


\begin{center}
  {\LARGE Modeling Interference Using Experiment Roll-out} \\
  \vspace{.4cm}
  {\large Ariel Boyarsky$^1$ ~~~~  Hongseok Namkoong$^1$ ~~~~ Jean Pouget-Abadie$^2$} \\
  \vspace{.2cm}
  {$^1$Decision, Risk, and Operations Division, Columbia Business School, $^2$Google Research}  \\
  \vspace{.2cm}
  \texttt{\{aboyarsky26, namkoong\}@gsb.columbia.edu, [email removed]}
\end{center}

\vspace{.2cm}

\begin{abstract}
Experiments on online marketplaces and social networks suffer from \emph{interference}, where the outcome of a unit is impacted by the treatment status of other units. We propose a framework for modeling interference using a ubiquitous deployment mechanism for experiments, staggered  \emph{roll-out} designs, which slowly increase the fraction of units exposed to the treatment to mitigate any unanticipated adverse side effects. Our main idea is to leverage the temporal variations in treatment assignments introduced by roll-outs to model the interference structure. Since there are often multiple competing models of interference in practice we first develop a  model selection method that evaluates models based on their ability to explain outcome variation observed along the roll-out. Through simulations, we show that our heuristic model selection method, \textsc{Leave-One-Period-Out}, outperforms other baselines. Next, we present a set of model identification conditions under which the estimation of common estimands is possible and show how these conditions are aided by roll-out designs. We conclude with a set of considerations, robustness checks, and potential limitations for practitioners wishing to use our framework.
\end{abstract}








\label{sec:Model Selection}


\label{sec:Identification}



\section{Discussion}
\label{sec:considerations}





\paragraph{Acknowledgement}
We thank Kevin Han, Shuangning Li, Jialiang Mao, and Han Wu for their thoughtful feedback.

\bibliographystyle{apalike}
\bibliography{tex/paper/bibliography.bib}

\pagebreak