EconBase
← All papers

Inference in Experiments with Matched Pairs and Imperfect Compliance

Yuehao Bai, Hongchang Guo, Azeem M. Shaikh, Max Tabord-Meehan

arXiv 24 Jul 2023 · Econometrics · publishedJournal of Business and Economic Statistics (2024)

arXiv:2307.13094 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper studies inference for the local average treatment effect in randomized controlled trials with imperfect compliance where treatment status is determined according to "matched pairs." By "matched pairs," we mean that units are sampled i.i.d. from the population of interest, paired according to observed, baseline covariates and finally, within each pair, one unit is selected at random for treatment. Under weak assumptions governing the quality of the pairings, we first derive the limit distribution of the usual Wald (i.e., two-stage least squares) estimator of the local average treatment effect. We show further that conventional heteroskedasticity-robust estimators of the Wald estimator's limiting variance are generally conservative, in that their probability limits are (typically strictly) larger than the limiting variance. We therefore provide an alternative estimator of the limiting variance that is consistent. Finally, we consider the use of additional observed, baseline covariates not used in pairing units to increase the precision with which we can estimate the local average treatment effect. To this end, we derive the limiting behavior of a two-stage least squares estimator of the local average treatment effect which includes both the additional covariates in addition to pair fixed effects, and show that its limiting variance is always less than or equal to that of the Wald estimator. To complete our analysis, we provide a consistent estimator of this limiting variance. A simulation study confirms the practical relevance of our theoretical results. Finally, we apply our results to revisit a prominent experiment studying the effect of macroinsurance on microenterprise in Egypt.

Citation extraction

22
references
74
in-text mentions
22
distinct cited
4
self-citations
9,442
main-text words

appendix boundary found by appendix_command · 62% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Groh, M. and McKenzie, D (2016) Macroinsurance for microenterprises: A randomized experiment in post-revolution egypt1.000104100%
2Bai, Y., Liu, J., Shaikh, A. M. and Tabord-Meehan, M (2023) On the efficiency of finely stratified experiments self0.92843100%
3Bai, Y., Romano, J. P. and Shaikh, A. M (2022) Inference in experiments with matched pairs self0.88820670%
4Bai, Y., Jiang, L., Romano, J. P., Shaikh, A. M. and Zhang, Y (2023) Covariate adjustment in experiments with matched pairs self0.88513469%
5Resnjanskij, S., Ruhose, J., Wiederhold, S. and Woessmann, L (2021) Can mentoring alleviate family disadvantage in adolscence? a field experiment to improve labor-market prospects0.84333100%
6Bai, Y., Liu, J. and Tabord-Meehan, M (2023) Inference for Matched Tuples and Fully Blocked Factorial Designs self0.64422100%
7Glennerster, R. and Takavarasha, K (2014) Running randomized evaluations: A practical guide0.64422100%
8Frölich, M (2007) Nonparametric iv estimation of local average treatment effects with covariates0.5114225%
9Imbens, G. W. and Angrist, J. D (1994) Identification and estimation of local average treatment effects0.51121100%
10Athey, S. and Imbens, G. W (2017) The econometrics of randomized experiments0.51121100%

Showing the top 10 of 22 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1A New Design-Based Variance Estimator for Finely Stratified Experiments0.92844
2On the Efficiency of Highly Stratified Experiments0.40511
3A Primer on the Analysis of Randomized Experiments and a Survey of some Recent Advances0.40511
4Identification and Inference on Treatment Effects under Covariate-Adaptive Randomization and Imperfect Compliance0.40511
5Unbiased Regression-Adjusted Estimation of Average Treatment Effects in Randomized Controlled Trials0.40511
6Covariate Adjustment in Stratified Experiments0.00011