Samantha Horn, Sabina J. Sloman
arXiv 1 Jul 2022 · Statistics — Methodology
arXiv:2207.00683 · PDF · DOI · OpenAlex · Extracted main text
We use a simulation study to compare three methods for adaptive experimentation: Thompson sampling, Tempered Thompson sampling, and Exploration sampling. We gauge the performance of each in terms of social welfare and estimation accuracy, and as a function of the number of experimental waves. We further construct a set of novel "hybrid" loss measures to identify which methods are optimal for researchers pursuing a combination of experimental aims. Our main results are: 1) the relative performance of Thompson sampling depends on the number of experimental waves, 2) Tempered Thompson sampling uniquely distributes losses across multiple experimental aims, and 3) in most cases, Exploration sampling performs similarly to random assignment.
appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.
The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.
| Reference | Intensity | Mentions | Sections | Main text | |
|---|---|---|---|---|---|
| 1 | Stefano Caria, Maximilian Kasy, Simon Quinn, Soha Shami, Alex Teytel… (2020) An adaptive targeted field experiment: Job search assistance for refugees in jordan | 0.843 | 3 | 3 | 100% |
| 2 | Maximilian Kasy and Anja Sautmann (2021) Adaptive treatment assignment in experiments for policy choice | 0.843 | 3 | 3 | 100% |
| 3 | William R Thompson (1933) On the likelihood that one unknown probability exceeds another in view of the evidence of two samples | 0.644 | 2 | 2 | 100% |
| 4 | Chris Kaibel and Torsten Biemann (2021) Rethinking the gold standard with multi-armed bandits: Machine learning allocation algorithms for experiments | 0.405 | 1 | 1 | 100% |
| 5 | Jianchang Lin and Veronica Bunn (2017) Comparison of multi-arm multi-stage design and adaptive randomization in platform clinical trials | 0.405 | 1 | 1 | 100% |
| 6 | Elizabeth G Ryan, Sarah E Lamb, Esther Williamson, and Simon Gates (2020) Bayesian adaptive designs for multi-arm trials: an orthopaedic case study | 0.405 | 1 | 1 | 100% |
| 7 | Lorenzo Trippa, Eudocia Q Lee, Patrick Y Wen, Tracy T Batchelor, Tim… (2012) Bayesian adaptive randomized trial design for patients with recurrent glioblastoma | 0.405 | 1 | 1 | 100% |
| 8 | Kert Viele, Kristine Broglio, Anna McGlothlin, and Benjamin R Saville (2020) Comparison of methods for control allocation in multiple arm studies using response adaptive randomization | 0.405 | 1 | 1 | 100% |
| 9 | James MS Wason and Lorenzo Trippa (2014) A comparison of bayesian adaptive randomization and multi-stage designs for multi-arm clinical trials | 0.405 | 1 | 1 | 100% |
| 10 | J Kyle Wathen and Peter F Thall (2017) A simulation study of outcome adaptive randomization in multi-arm clinical trials | 0.405 | 1 | 1 | 100% |
Showing the top 10 of 10 scored citations.