EconBase
← All papers

High-Dimensional Tail Index Regression: with An Application to Text Analyses of Viral Posts in Social Media

Yuya Sasaki, Jing Tao, Yulong Wang

arXiv 2 Mar 2024 · Statistics — Machine Learning

arXiv:2403.01318 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Motivated by the empirical observation of power-law distributions in the credits (e.g., "likes") of viral social media posts, we introduce a high-dimensional tail index regression model and propose methods for estimation and inference of its parameters. First, we present a regularized estimator, establish its consistency, and derive its convergence rate. Second, we introduce a debiasing technique for the regularized estimator to facilitate inference and prove its asymptotic normality. Third, we extend our approach to handle large-scale online streaming data using stochastic gradient descent. Simulation studies corroborate our theoretical findings. We apply these methods to the text analysis of viral posts on X (formerly Twitter) related to LGBTQ+ topics.

Citation extraction

40
references
72
in-text mentions
40
distinct cited
0
self-citations
5,950
main-text words

appendix boundary found by appendix_command · 31% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Cai, T Tony and Guo, Zijian and Ma, Rong (2023) Statistical inference for high-dimensional generalized linear models with binary outcomes0.7547443%
2Sara van de Geer and Peter Bühlmann and Ya’acov Ritov and Ruben Deze… (2014) On asymptotically optimal confidence regions and tests for high-dimensional models0.7373367%
3Zhang, Cun-Hui and Zhang, Stephanie S (2014) Confidence intervals for low dimensional parameters in high dimensional linear models0.7373367%
4Wang, Hansheng and Tsai, Chih-Ling (2009) Tail index regression0.73732100%
5Gardes, L. and Girard, S (2010) Conditional extremes from heavy-tailed distributions: An application to the estimation of extreme rain fall return levels0.64422100%
6de Haan, L. and A. Ferreira (2007) Extreme Value Theory: An Introduction0.64422100%
7Gabaix, Xavier (2009) Power Laws in Economics and Finance0.64422100%
8Gabaix, Xavier (2016) Power Laws in Economics: An Introduction0.64422100%
9Negahban, Sahand and Yu, Bin and Wainwright, Martin J and Ravikumar,… (2009) A unified framework for high-dimensional analysis of $ m $-estimators with decomposable regularizers0.64422100%
10van de Geer, Sara A (2008) High-dimensional generalized linear models and the lasso0.64422100%

Showing the top 10 of 40 scored citations.