EconBase
← All papers

On the Efficiency of Finely Stratified Experiments

Yuehao Bai, Jizhou Liu, Azeem M. Shaikh, Max Tabord-Meehan

arXiv 27 Jul 2023 · Econometrics · 8 citations (OpenAlex)

arXiv:2307.15181 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper studies the use of finely stratified designs for the efficient estimation of a large class of treatment effect parameters that arise in the analysis of experiments. By a "finely stratified" design, we mean experiments in which units are divided into groups of a fixed size and a proportion within each group is assigned to a binary treatment uniformly at random. The class of parameters considered are those that can be expressed as the solution to a set of moment conditions constructed using a known function of the observed data. They include, among other things, average treatment effects, quantile treatment effects, and local average treatment effects as well as the counterparts to these quantities in experiments in which the unit is itself a cluster. In this setting, we establish three results. First, we show that under a finely stratified design, the naive method of moments estimator achieves the same asymptotic variance as what could typically be attained under alternative treatment assignment mechanisms only through ex post covariate adjustment. Second, we argue that the naive method of moments estimator under a finely stratified design is asymptotically efficient by deriving a lower bound on the asymptotic variance of regular estimators of the parameter of interest in the form of a convolution theorem. In this sense, finely stratified experiments are attractive because they lead to efficient estimators of treatment effect parameters "by design." Finally, we strengthen this conclusion by establishing conditions under which a "fast-balancing" property of finely stratified designs is in fact necessary for the naive method of moments estimator to attain the efficiency bound.

Citation extraction

73
references
171
in-text mentions
73
distinct cited
10
self-citations
14,649
main-text words

appendix boundary found by appendix_command · 60% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Cytrynbaum, Max (2023) Designing representative and balanced experiments by local randomization1.000105100%
2Bai, Yuehao and Liu, Jizhou and Shaikh, Azeem M. and Tabord-Meehan,… (2024) Inference in cluster randomized trials with matched pairs self1.00054100%
3Rafi, Ahnaf (2023) Efficient Semiparametric Estimation of Average Treatment Effects Under Covariate Adaptive Randomization1.00053100%
4Armstrong, Timothy B (2022) Asymptotic Efficiency Bounds for a Class of Experimental Designs0.9416383%
5Bai, Yuehao and Romano, Joseph P. and Shaikh, Azeem M (2022) Inference in Experiments With Matched Pairs self0.90912575%
6Cytrynbaum, Max (2024) Finely Stratified Rerandomization Designs0.87452100%
7Bai, Yuehao (2022) Optimality of Matched-Pair Designs in Randomized Controlled Trials self0.84333100%
8Tsiatis, Anastasios A. and Davidian, Marie and Zhang, Min and Lu, Xi… (2008) Covariate adjustment for two-sample treatment comparisons in randomized clinical trials: a principled yet flexible approach0.84333100%
9van der Vaart, A. W (1998) Asymptotic statistics0.79412550%
10van der Vaart, A. W. and Wellner, Jon (1996) Weak Convergence and Empirical Processes: With Applications to Statistics0.7639344%

Showing the top 10 of 73 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Finely Stratified Rerandomization Designs1.000104
2A New Design-Based Variance Estimator for Finely Stratified Experiments1.00054
3Inference in Experiments with Matched Pairs and Imperfect Compliance0.92843
4Partial Identification under Stratified Randomization0.810328
5Adjustments with Many Regressors under Covariate-Adaptive Randomizations0.51121
6A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances0.51121
7Coupling Designs for Randomized Experiments with Complex Treatments0.51121
8Inference in Cluster Randomized Trials with Matched Pairs0.40511
9Inference for Two-stage Experiments under Covariate-Adaptive Randomization0.40511
10Covariate Adjustment in Experiments with Matched Pairs0.40511