EconBase
← All papers

When and How to Pilot: Design Rules for Two-Wave Experiments

Juan C. Yamin

arXiv 18 Jul 2026 · Econometrics

arXiv:2607.16982 · PDF · Extracted main text

Abstract

Experimenters often run pilots, but how much a small pilot should shape the main-wave design has no settled answer. This paper shows how noisy pilot evidence should guide treatment assignment probabilities in two-wave experiments. Two canonical rules mark the extremes. Balanced assignment guards against worst cases but ignores evidence that one arm is noisier. Feasible Neyman allocation adapts, but with a finite pilot it can overreact to noise, producing arbitrarily large precision losses. We propose a Conditional Minimax Regret (CMR) rule that minimizes worst-case regret over a finite-sample confidence set for the treatment and control variances. CMR retains balance's worst-case protection with high probability, converges to the Neyman allocation as the pilot grows, and attains the minimax-regret rate up to constants. It extends to multi-arm and stratified designs, and simulations calibrated to four field experiments show it avoids feasible Neyman's severe small-pilot losses while capturing most of its large-pilot gains.

Citation extraction

34
references
73
in-text mentions
50
distinct cited
0
self-citations
16,392
main-text words

appendix boundary found by appendix_command · 36% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Timothy B. Armstrong (2026) Asymptotic efficiency bounds for a class of experimental designs, 20260.92843100%
2Yong Cai and Ahnaf Rafi (2024) On the performance of the Neyman allocation with small pilots0.8434375%
3Jinyong Hahn, Keisuke Hirano, and Dean Karlan (2009) Adaptive experimental design using the propensity score0.8434375%
4Isaiah Andrews and Jiafeng Chen (2025) Certified decisions, 20250.81142100%
5Andreas Maurer and Massimiliano Pontil (2009) Empirical Bernstein bounds and sample variance penalization0.7373367%
6Leonard J Savage (1951) The theory of statistical decision0.73732100%
7Jörg Stoye (2009) Minimax regret treatment choice with finite samples0.73732100%
8Jerzy Neyman (1934) On the two different aspects of the representative method: The method of stratified sampling and the method of purposive selection0.64422100%
9Charles F Manski (2021) Econometrics for decision making: Building foundations sketched by Haavelmo and Wald0.58531100%
10Max Tabord-Meehan (2023) Stratification trees for adaptive randomisation in randomised controlled trials0.5112250%

Showing the top 10 of 50 scored citations.