EconBase
← All papers

Generalized Random Forests

Susan Athey, Julie Tibshirani, Stefan Wager

arXiv 5 Oct 2016 · Statistics — Methodology · publishedThe Annals of Statistics (2019) · 16 citations (OpenAlex)

arXiv:1610.01271 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We propose generalized random forests, a method for non-parametric statistical estimation based on random forests (Breiman, 2001) that can be used to fit any quantity of interest identified as the solution to a set of local moment equations. Following the literature on local maximum likelihood estimation, our method considers a weighted set of nearby training examples; however, instead of using classical kernel weighting functions that are prone to a strong curse of dimensionality, we use an adaptive weighting function derived from a forest designed to express heterogeneity in the specified quantity of interest. We propose a flexible, computationally efficient algorithm for growing generalized random forests, develop a large sample theory for our method showing that our estimates are consistent and asymptotically Gaussian, and provide an estimator for their asymptotic variance that enables valid confidence intervals. We use our approach to develop new methods for three statistical tasks: non-parametric quantile regression, conditional average partial effect estimation, and heterogeneous treatment effect estimation via instrumental variables. A software implementation, grf for R and C++, is available from CRAN.

Citation extraction

84
references
220
in-text mentions
84
distinct cited
1
self-citations
23,066
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1barticle[author] Wager, StefanS. Athey, SusanS (2018) ) self1.000276100%
2barticle[author] Meinshausen, NicolaiN (2006) )1.000123100%
3barticle[author] Athey, SusanS. Imbens, GuidoG (2016) )1.00074100%
4barticle[author] Mentch, LucasL. Hooker, GilesG (2016) )1.00074100%
5barticle[author] Breiman, LeoL (2001) )1.00073100%
6barticle[author] Newey, Whitney KW. K (1994) a)1.00064100%
7barticle[author] Scornet, ErwanE., Biau, GérardG. Vert, Jean-Philipp… (2015) )1.00063100%
8barticle[author] Sexton, JosephJ. Laake, PetterP (2009) )1.00063100%
9bbook[author] Breiman, LeoL., Friedman, JeromeJ., Stone, Charles JC.… (1984) )0.92843100%
10binproceedings[author] Denil, MishaM., Matheson, DavidD. De Freitas,… (2014) )0.92843100%

Showing the top 10 of 84 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Local Linear Forests1.000174
2Non-Parametric Inference Adaptive to Intrinsic Dimension1.000164
3Nonparametric Estimation of Conditional Densities by Generalized Random Forests1.000164
4Orthogonal Random Forest for Causal Inference1.000104
5Simultaneous Inference for Local Structural Parameters with Random Forests$^*$1.00084
6Censored Quantile Regression Forests1.00074
7Meta-Learners for Estimation of Causal Effects: Finite Sample Cross-Fit Performance1.00076
8Recovering Direct Price Effects of Environmental Amenities in Housing Markets: Regression and Causal Machine Learning Model Assessment with Empirical Monte Carlo Simulation1.00074
9Aggregation Trees1.00063
10Policy Learning With Rare Outcomes1.00053