EconBase
← All papers

Rectified Linear Unit Regression

Tatsushi Oka

arXiv 28 May 2026 · Econometrics

arXiv:2605.30609 · PDF · DOI · OpenAlex · Extracted main text

Abstract

This paper develops a regression framework for the direct estimation of integrated functionals of conditional outcome distributions. The proposed method, termed rectified linear unit (ReLU) regression, projects the ReLU-transformed outcome onto covariates and admits a closed-form estimator. Its population regression function coincides with the integrated conditional distribution function of the outcome, and its convex conjugate, obtained via the Legendre-Fenchel transformation, recovers the integrated conditional quantile function. Both the regression and its conjugate require only mild distributional assumptions and accommodate non-continuous outcomes. We establish the uniform asymptotic distribution of the estimator and develop inference for the conjugate functional via the delta method for Hadamard directionally differentiable maps. Building on these results, we establish identification and inference for average quantile treatment effects over arbitrary subintervals of probability levels. This broadens the set of distributional parameters available to empirical work.

Citation extraction

51
references
91
in-text mentions
51
distinct cited
0
self-citations
7,578
main-text words

appendix boundary found by appendix_titled_section at “Appendix ” · 54% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chernozhukov, V., I. Fernandez-Val, B. Melly, and K. Wüthrich (2020) Generic inference on quantile and quantile effect functions for discrete outcomes0.9285380%
2Fang, Z. and A. Santos (2019) Inference on directionally differentiable functions0.8558462%
3Rockafellar, R. T. and S. Uryasev (2000) Optimization of conditional value-at-risk0.81142100%
4Dümbgen, L (1993) On nondifferentiable functions and the bootstrap0.73732100%
5Ogryczak, W. and A. Ruszczynski (2002) Dual stochastic dominance and related mean-risk models0.73732100%
6Rockafellar, R. T. and S. Uryasev (2002) Conditional value-at-risk for general loss distributions0.73732100%
7Finkelstein, A., S. Taubman, B. Wright, M. Bernstein, J. Gruber, J.… (2012) The oregon health insurance experiment: Evidence from the first year0.64441100%
8Angrist, J., V. Chernozhukov, and I. Fernández-Val (2006) Quantile regression under misspecification, with an application to the U.S wage structure0.64422100%
9Beare, B. K. and J. Moon (2015) Transforming Monotone triangular systems0.64422100%
10Delgado, M. A. and J. C. Escanciano (2012) Testing the equality of conditional distribution functions in an ordered choice model0.64422100%

Showing the top 10 of 51 scored citations.