EconBase
← All papers

Shrinkage for Categorical Regressors

Phillip Heiler, Jana Mareckova

arXiv 7 Jan 2019 · Econometrics · publishedJournal of Econometrics (2020)

arXiv:1901.01898 · PDF · DOI · OpenAlex

Abstract

This paper introduces a flexible regularization approach that reduces point estimation risk of group means stemming from e.g. categorical regressors, (quasi-)experimental data or panel data models. The loss function is penalized by adding weighted squared l2-norm differences between group location parameters and informative first-stage estimates. Under quadratic loss, the penalized estimation problem has a simple interpretable closed-form solution that nests methods established in the literature on ridge regression, discretized support smoothing kernels and model averaging methods. We derive risk-optimal penalty parameters and propose a plug-in approach for estimation. The large sample properties are analyzed in an asymptotic local to zero framework by introducing a class of sequences for close and distant systems of locations that is sufficient for describing a large range of data generating processes. We provide the asymptotic distributions of the shrinkage estimators under different penalization schemes. The proposed plug-in estimator uniformly dominates the ordinary least squares in terms of asymptotic risk if the number of groups is larger than three. Monte Carlo simulations reveal robust improvements over standard methods in finite samples. Real data examples of estimating time trends in a panel and a difference-in-differences study illustrate potential applications.

Citation extraction

No citation data for this paper: 1901.01898_source: not a tar archive and not gzip (Not a gzipped file (b'%P')). arXiv holds no LaTeX source for roughly 8% of econ.EM submissions (PDF-only), and those can never enter the citation graph.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Efficient Covariate Balancing for the Local Average Treatment Effect0.40511
2Heterogeneity Analysis with Heterogeneous Treatments0.40511