EconBase
← All papers

SGMM: Stochastic Approximation to Generalized Method of Moments

Xiaohong Chen, Sokbae Lee, Yuan Liao, Myung Hwan Seo, Youngki Shin, Myunghyun Song

arXiv 25 Aug 2023 · Econometrics · publishedJournal of Financial Econometrics (2023) · 7 citations (OpenAlex)

arXiv:2308.13564 · PDF · DOI · OpenAlex · Extracted main text

Abstract

We introduce a new class of algorithms, Stochastic Generalized Method of Moments (SGMM), for estimation and inference on (overidentified) moment restriction models. Our SGMM is a novel stochastic approximation alternative to the popular Hansen (1982) (offline) GMM, and offers fast and scalable implementation with the ability to handle streaming datasets in real time. We establish the almost sure convergence, and the (functional) central limit theorem for the inefficient online 2SLS and the efficient SGMM. Moreover, we propose online versions of the Durbin-Wu-Hausman and Sargan-Hansen tests that can be seamlessly integrated within the SGMM framework. Extensive Monte Carlo simulations show that as the sample size increases, the SGMM matches the standard (offline) GMM in terms of estimation accuracy and gains over computational efficiency, indicating its practical value for both large-scale and online datasets. We demonstrate the efficacy of our approach by a proof of concept using two well known empirical examples with large sample sizes.

Citation extraction

40
references
98
in-text mentions
44
distinct cited
7
self-citations
11,936
main-text words

appendix boundary found by appendix_command · 53% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Lee, S., Y. Liao, M. H. Seo, and Y. Shin (2022) Fast and robust online inference with stochastic gradient descent via random scaling self0.9619489%
2Angrist, J. D. and A. B. Krueger (1991) Does compulsory school attendance affect schooling and earnings?0.87482100%
3Angrist, J. D. and W. N. Evans (1998) Children and their parents' labor supply: Evidence from exogenous variation in family size0.87462100%
4Kiefer, N. M., T. J. Vogelsang, and H. Bunzel (2000) Simple robust testing of regression hypotheses0.81142100%
5Polyak, B. T. and A. B. Juditsky (1992) Acceleration of stochastic approximation by averaging0.7639344%
6Hansen, P (1982) Large sample properties of generalized method of moments estimators0.73732100%
7Robbins, H. and S. Monro (1951) A Stochastic Approximation Method0.64422100%
8Bottou, L., F. E. Curtis, and J. Nocedal (2018) Optimization methods for large-scale machine learning0.64422100%
9Gupta, A. and M. H. Seo (2023) Robust inference on infinite and growing dimensional time-series regression0.64422100%
10Lee, S., Y. Liao, M. H. Seo, and Y. Shin (2022) Fast inference for quantile regression with millions of observations self0.64422100%

Showing the top 10 of 44 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1SLIM: Stochastic Learning and Inference in Overidentified Models0.92853
2Online Learning in Semiparametric Econometric Models0.73732
3Asymptotic Theory for IV-Based Reinforcement Learning with Potential Endogeneity0.40511