EconBase
← All papers

Hamiltonian Monte Carlo for Regression with High-Dimensional Categorical Data

Szymon Sacher, Laura Battaglia, Stephen Hansen

arXiv 16 Jul 2021 · Econometrics · 1 citations (OpenAlex)

arXiv:2107.08112 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Latent variable models are increasingly used in economics for high-dimensional categorical data like text and surveys. We demonstrate the effectiveness of Hamiltonian Monte Carlo (HMC) with parallelized automatic differentiation for analyzing such data in a computationally efficient and methodologically sound manner. Our new model, Supervised Topic Model with Covariates, shows that carefully modeling this type of data can have significant implications on conclusions compared to a simpler, frequently used, yet methodologically problematic, two-step approach. A simulation study and revisiting Bandiera et al. (2020)'s study of executive time use demonstrate these results. The approach accommodates thousands of parameters and doesn't require custom algorithms specific to each model, making it accessible for applied researchers

Citation extraction

39
references
62
in-text mentions
39
distinct cited
4
self-citations
6,315
main-text words

appendix boundary found by appendix_command · 88% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Bandiera, O., Prat, A., Hansen, S., and Sadun, R (2020) CEO Behavior and Firm Performance self1.00084100%
2Munro, E. and Ng, S (2020) Latent Dirichlet Analysis of Categorical Survey Responses0.96510490%
3Neal, R. M (2012) MCMC using Hamiltonian dynamics0.84333100%
4Blei, D. M., Ng, A. Y., and Jordan, M. I (2003) Latent dirichlet allocation0.64422100%
5Egami, N., Fong, C. J., Grimmer, J., Roberts, M. E., and Stewart, B. M (2018) How to Make Causal Inferences Using Texts0.64422100%
6Phan, D., Pradhan, N., and Jankowiak, M (2019) Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro0.64422100%
7Griffiths, T. L. and Steyvers, M (2004) Finding scientific topics0.51121100%
8Hoffman, M. D. and Gelman, A (2014) The No-U-Turn Sampler: Adaptively Setting Path Lengths in Hamiltonian Monte Carlo0.51121100%
9Adams, R. B., Ragunathan, V., and Tumarkin, R (2021) Death by Committee? An Analysis of Corporate Board (Sub-) Committees0.40511100%
10Bandiera, O., Fischer, G., Prat, A., and Ytsma, E (2021) Do Women Respond Less to Performance Pay? Building Evidence from Multiple Experiments0.40511100%

Showing the top 10 of 39 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Inference for Regression with Variables Generated by AI or Machine Learning0.40511