EconBase
← All papers

Inference in Partially Linear Models under Dependent Data with Deep Neural Networks

Chad Brown

arXiv 29 Oct 2024 · Econometrics

arXiv:2410.22574 · PDF · DOI · OpenAlex · Extracted main text

Abstract

I consider inference in a partially linear regression model under stationary $\beta$-mixing data after first stage deep neural network (DNN) estimation. Using the DNN results of Brown (2024), I show that the estimator for the finite dimensional parameter, constructed using DNN-estimated nuisance components, achieves $\sqrt{n}$-consistency and asymptotic normality. By avoiding sample splitting, I address one of the key challenges in applying machine learning techniques to econometric models with dependent data. In a future version of this work, I plan to extend these results to obtain general conditions for semiparametric inference after DNN estimation of nuisance components, which will allow for considerations such as more efficient estimation procedures, and instrumental variable settings.

Citation extraction

34
references
75
in-text mentions
34
distinct cited
0
self-citations
9,602
main-text words

appendix boundary found by none_found · 100% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chad Brown (2024) Statistical Properties of Deep Neural Networks with Dependent Data1.000223100%
2P. M. Robinson (1988) Root-N-Consistent Semiparametric Regression0.81142100%
3Max H. Farrell, Tengyuan Liang, and Sanjog Misra (2021) Deep Neural Networks for Estimation and Inference0.73732100%
4D. Bosq (1998) Nonparametric Statistics for Stochastic Processes. Lecture Notes in Statistics, Vol. 1100.64441100%
5Qizhao Chen, Vasilis Syrgkanis, and Morgane Austern (2022) Debiased Machine Learning without Sample-Splitting for Stable Estimators0.64422100%
6Herold Dehling and Walter Philipp (2002) Empirical Process Techniques for Dependent Data0.64422100%
7Peter L. Bartlett, Olivier Bousquet, and Shahar Mendelson (2005) Local Rademacher complexities0.58531100%
8Xiaohong Chen (2007) Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models0.51121100%
9Xiaohong Chen and Xiaotong Shen (1998) Sieve Extremum Estimates for Weakly Dependent Data0.51121100%
10James Davidson (2022) Stochastic Limit Theory: An Introduction for Econometricians (second edition, second edition ed.)0.51121100%

Showing the top 10 of 34 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Statistical Properties of Deep Neural Networks with Dependent Data0.84333
2Neighborhood Stability in Double/Debiased Machine Learning with Dependent Data0.73732