EconBase
← All papers

The Sorted Effects Method: Discovering Heterogeneous Effects Beyond Their Averages

Victor Chernozhukov, Ivan Fernandez-Val, Ye Luo

arXiv 17 Dec 2015 · Statistics — Methodology · publishedEconometrica (2018) · 81 citations (OpenAlex)

arXiv:1512.05635 · PDF · DOI · OpenAlex · Extracted main text

Abstract

The partial (ceteris paribus) effects of interest in nonlinear and interactive linear models are heterogeneous as they can vary dramatically with the underlying observed or unobserved covariates. Despite the apparent importance of heterogeneity, a common practice in modern empirical work is to largely ignore it by reporting average partial effects (or, at best, average effects for some groups). While average effects provide very convenient scalar summaries of typical effects, by definition they fail to reflect the entire variety of the heterogeneous effects. In order to discover these effects much more fully, we propose to estimate and report sorted effects -- a collection of estimated partial effects sorted in increasing order and indexed by percentiles. By construction the sorted effect curves completely represent and help visualize the range of the heterogeneous effects in one plot. They are as convenient and easy to report in practice as the conventional average partial effects. They also serve as a basis for classification analysis, where we divide the observational units into most or least affected groups and summarize their characteristics. We provide a quantification of uncertainty (standard errors and confidence bands) for the estimated sorted effects and related classification analysis, and provide confidence sets for the most and least affected groups. The derived statistical results rely on establishing key, new mathematical results on Hadamard differentiability of a multivariate sorting operator and a related classification operator, which are of independent interest. We apply the sorted effects method and classification analysis to demonstrate several striking patterns in the gender wage gap.

Citation extraction

34
references
60
in-text mentions
34
distinct cited
1
self-citations
13,204
main-text words

appendix boundary found by appendix_command · 41% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1van der Vaart and Wellner (1996) Weak Convergence and Empirical Processes0.79410650%
2Chernozhukov, Fernández-Val, and Galichon (2009) Improving point and interval estimators of monotone functions by rearrangement0.6443267%
3List, Shaikh, and Xu (2016) Multiple hypothesis testing in experimental economics0.64422100%
4Spivak (1965) Calculus on manifolds. A modern approach to classical theorems of advanced calculus0.5854325%
5van der Vaart (1998) Asymptotic Statistics0.5853333%
6Chernozhukov, Kocatulum, and Menzel (2015) Inference on sets in finance0.58531100%
7Chernozhukov, Fernández-Val, and Galichon (2010) Quantile and probability curves without crossing0.5112250%
8Blau and Kahn (2017) The Gender Wage Gap: Extent, Trends, and Explanations0.51121100%
9Chernozhukov, Hong, and Tamer (2007) Estimation and Inference on Identified Parameter Sets in Econometric Models0.51121100%
10Oaxaca (1973) Male-Female Wage Differentials in Urban Labor Markets0.51121100%

Showing the top 10 of 34 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Statistical Inference of Optimal Allocations 1: Regularities and their Implications0.967217
2A Unifying Framework for Testing Shape Restrictions0.64422
3Inference on the Distribution of Individual Treatment Effects in Nonseparable Triangular ModelsDate0.64422
4Difference-in-Differences with Multiple Time Periods0.40511
51908.087790.40511
6Group Average Treatment Effects for Observational Studies0.40511
7Feature Selection for Personalized Policy Analysis0.40511
8Nonparametric Causal Decomposition of Group Disparities0.40511
9Multiply-Robust Causal Change Attribution0.40511
10Estimating Heterogeneous Treatment Effects with Item-Level Outcome Data: Insights from Item Response Theory0.40511