EconBase
← All papers

On the implementation of Approximate Randomization Tests in Linear Models with a Small Number of Clusters

Yong Cai, Ivan A. Canay, Deborah Kim, Azeem M. Shaikh

arXiv 17 Feb 2021 · Econometrics · publishedJournal of Econometric Methods (2022) · 6 citations (OpenAlex)

arXiv:2102.09058 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper provides a user's guide to the general theory of approximate randomization tests developed in Canay, Romano, and Shaikh (2017) when specialized to linear regressions with clustered data. An important feature of the methodology is that it applies to settings in which the number of clusters is small -- even as small as five. We provide a step-by-step algorithmic description of how to implement the test and construct confidence intervals for the parameter of interest. In doing so, we additionally present three novel results concerning the methodology: we show that the method admits an equivalent implementation based on weighted scores; we show the test and confidence intervals are invariant to whether the test statistic is studentized or not; and we prove convexity of the confidence intervals for scalar parameters. We also articulate the main requirements underlying the test, emphasizing in particular common pitfalls that researchers may encounter. Finally, we illustrate the use of the methodology with two applications that further illuminate these points. The companion {\tt R} and {\tt Stata} packages facilitate the implementation of the methodology and the replication of the empirical exercises.

Citation extraction

13
references
51
in-text mentions
13
distinct cited
4
self-citations
12,027
main-text words

appendix boundary found by appendix_command · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Canay, I. A., Romano, J. P. and Shaikh, A. M (2017) Randomization tests under an approximate symmetry assumption self1.000155100%
2Munyo, I. and Rossi, M. A (2015) First-day criminal recidivism1.00093100%
3Canay, I. A., Santos, A. and Shaikh, A. M (2021) small self1.00073100%
4Meng, X., Qian, N. and Yared, P (2015) The institutional causes of china's great famine, 1959–19611.00063100%
5Cameron, A. C., Gelbach, J. B. and Miller, D. L (2008) Bootstrap-based improvements for inference with clustered errors0.73732100%
6Ibragimov, R. and Müller, U. K (2010) t-statistic based correlation and heterogeneity robust inference0.64422100%
7Liang, K.-Y. and Zeger, S. L (1986) Longitudinal data analysis using generalized linear models0.64422100%
8Canay, I. A., Romano, J. P. and Shaikh, A. M (2017) Supplement to ‘Randomization tests under an approximate symmetry assumption’ self0.51121100%
9Bertrand, M., Duflo, E. and Mullainathan, S (2004) How much should we trust differences-in-differences estimates?0.40511100%
10Canay, I. A. and Kamat, V (2018) Approximate permutation tests and induced order statistics in the regression discontinuity design self0.40511100%

Showing the top 10 of 13 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Combining Clusters for the Approximate Randomization Test0.87452
2Network Cluster-Robust Inference0.73732
3Inference with few treated units0.58531
4Cluster-Robust Inference: A Guide to Empirical Practice0.40511
5Randomization Inference: Theory and Applications0.40511