EconBase
← All papers

Robustly estimating heterogeneity in factorial data using Rashomon Partitions

Aparajithan Venkateswaran, Anirudh Sankar, Arun G. Chandrasekhar, Tyler H. McCormick

arXiv 2 Apr 2024 · Statistics — Methodology · 1 citations (OpenAlex)

arXiv:2404.02141 · PDF · DOI · OpenAlex · Extracted main text

Abstract

In both observational data and randomized control trials, researchers select statistical models to articulate how the outcome of interest varies with combinations of observable covariates. Choosing a model that is too simple can obfuscate important heterogeneity in outcomes between covariate groups, while too much complexity risks identifying spurious patterns. In this paper, we propose a novel Bayesian framework for model uncertainty called Rashomon Partition Sets (RPSs). The RPS consists of all models that have posterior density close to the maximum a posteriori (MAP) model. We construct the RPS by enumeration, rather than sampling, which ensures that we explore all models models with high evidence in the data, even if they offer dramatically different substantive explanations. We use a l0 prior, which allows the allows us to capture complex heterogeneity without imposing strong assumptions about the associations between effects, showing this prior is minimax optimal from an information-theoretic perspective. We characterize the approximation error of (functions of) parameters computed conditional on being in the RPS relative to the entire posterior. We propose an algorithm to enumerate the RPS from the class of models that are interpretable and unique, then provide bounds on the size of the RPS. We give simulation evidence along with three empirical examples: price effects on charitable giving, heterogeneity in chromosomal structure, and the introduction of microfinance.

Citation extraction

0
references
0
in-text mentions
0
distinct cited
0
self-citations
56
main-text words

appendix boundary found by appendix_command · 42% of the source is main text. Read the extracted text to check this.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Generalizability with ignorance in mind: learning what we do (not) know for archetypes discovery0.92843
2Decision Theory for the Archetype Discovery Problem0.51121
3Some models are useful, but when?: A decision-theoretic approach to choosing when to refit large-scale prediction models0.40511
4Position: Prioritize Identifying Structure, Not Complex Models, for Scientific Discovery0.40511