EconBase
← All papers

ReLU-Based and DNN-Based Generalized Maximum Score Estimators

Xiaohong Chen, Wayne Yuan Gao, Likang Wen

arXiv 24 Nov 2025 · Econometrics

arXiv:2511.19121 · PDF · Extracted main text

Abstract

We propose a new formulation of the maximum score estimator that uses compositions of rectified linear unit (ReLU) functions, instead of indicator functions as in Manski (1975,1985), to encode the sign alignment restrictions. Since the ReLU function is Lipschitz, our new ReLU-based maximum score criterion function is substantially easier to optimize using standard gradient-based optimization pacakges. We also show that our ReLU-based maximum score (RMS) estimator can be generalized to an umbrella framework defined by multi-index single-crossing (MISC) conditions, while the original maximum score estimator cannot be applied. We establish the $n^{-s/(2s+1)}$ convergence rate and asymptotic normality for the RMS estimator under order-$s$ Holder smoothness. In addition, we propose an alternative estimator using a further reformulation of RMS as a special layer in a deep neural network (DNN) architecture, which allows the estimation procedure to be implemented via state-of-the-art software and hardware for DNN.

Citation extraction

36
references
104
in-text mentions
36
distinct cited
2
self-citations
17,610
main-text words

appendix boundary found by appendix_command · 59% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1–- (1985) Semiparametric analysis of discrete response: Asymptotic properties of the maximum score estimator1.00063100%
2–- and Gao, W. Y (2025) Semiparametric learning of integral functionals on submanifolds0.9416383%
3Horowitz, J. L (1992) A smoothed maximum score estimator for the binary response model0.874132100%
4Kim, J. and Pollard, D (1990) Cube root asymptotics0.87492100%
5Gao, W. Y. and Li, M (2024) Identification of semiparametric panel multinomial choice models with infinite-dimensional fixed effects self0.87472100%
6Manski, C. F (1975) Maximum score estimation of the stochastic utility model of choice0.81142100%
7–-, –- and Xu, S (2023) Logical differencing in dyadic network formation models with nontransferable utilities0.73732100%
8Van Der Vaart, A. W. and Wellner, J. A (1996) Weak Convergence and Empirical Processes0.6444250%
9Delsol, L. and Van Keilegom, I (2020) Semiparametric m-estimation with non-smooth criterion functions0.6443267%
10Chen, X (2007) Large sample sieve estimation of semi-nonparametric models self0.64422100%

Showing the top 10 of 36 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Nonparametric Uniform Inference in Binary Classification and Policy Values0.40511
2Gaussian Approximation for Maximum Score and Non-Smooth M-Estimators with Multiway Dependence0.40511
3Root-$n$ Asymptotically Normal Maximum Score Estimation0.40511