EconBase
← All papers

Latent Dirichlet Analysis of Categorical Survey Responses

Evan Munro, Serena Ng

arXiv 10 Oct 2019 · Econometrics

arXiv:1910.04883 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Beliefs are important determinants of an individual's choices and economic outcomes, so understanding how they comove and differ across individuals is of considerable interest. Researchers often rely on surveys that report individual beliefs as qualitative data. We propose using a Bayesian hierarchical latent class model to analyze the comovements and observed heterogeneity in categorical survey responses. We show that the statistical model corresponds to an economic structural model of information acquisition, which guides interpretation and estimation of the model parameters. An algorithm based on stochastic optimization is proposed to estimate a model for repeated surveys when responses follow a dynamic structure and conjugate priors are not appropriate. Guidance on selecting the number of belief types is also provided. Two examples are considered. The first shows that there is information in the Michigan survey responses beyond the consumer sentiment index that is officially published. The second shows that belief types constructed from survey responses can be used in a subsequent analysis to estimate heterogeneous returns to education.

Citation extraction

66
references
84
in-text mentions
67
distinct cited
1
self-citations
12,593
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Card (1995) Using geographic variation in college proximity to estimate the return to schooling0.87472100%
2Erosheva (2002) Grade of Membership and Latent Structures with Application to Disability Survey Data0.73732100%
3Manski (2004) Measuring Expectations0.73732100%
4Blei, Ng, and Jordan (2003) Latent Dirichlet Allocation0.64422100%
5Blei and Lafferty (2006) Dynamic Topic Models0.64422100%
6Ruiz, Athey, Blei, et al (2020) Shopper: A probabilistic model of consumer choice with substitutes and complements0.64422100%
7Welling and Teh (2011) Bayesian Learning via Stochastic Gradient Langevin Dynamics0.58531100%
8Fox and Jordan (2013) Mixed membership models for time series0.51121100%
9Wang and Blei (2018) The blessings of multiple causes0.51121100%
10Bhadury, Chen, Zhu, and Liu (2016) Scaling Up Dynamic Topic Models0.40511100%

Showing the top 10 of 67 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Hamiltonian Monte Carlo for Regression with High-Dimensional Categorical Data0.965104
2Inference for Regression with Variables Generated by AI or Machine Learning0.64422