EconBase
← All papers

Ill-Conditioned Orthogonal Scores in Double Machine Learning

Gabriel Saco

arXiv 8 Dec 2025 · Statistics — Methodology

arXiv:2512.07083 · PDF · Extracted main text

Abstract

Double Machine Learning is often justified by nuisance-rate conditions, yet finite-sample reliability also depends on the conditioning of the orthogonal-score Jacobian. This conditioning is typically assumed rather than tracked. When residualized treatment variance is small, the Jacobian is ill-conditioned and small systematic nuisance errors can be amplified, so nominal confidence intervals may look precise yet systematically under-cover. Our main result is an exact identity for the cross-fitted PLR-DML estimator, with no Taylor approximation. From this identity, we derive a stochastic-order bound that separates oracle noise from a conditioning-amplified nuisance remainder and yields a sufficiency condition for root-n-inference. We further connect the amplification factor to semiparametric efficiency geometry via the Riesz representer and use a triangular-array framework to characterize regimes as residual treatment variation weakens. These results motivate an out-of-fold diagnostic that summarizes the implied amplification scale. We do not propose universal thresholds. Instead, we recommend reporting the diagnostic alongside cross-learner sensitivity summaries as a fragility assessment, illustrated in simulation and an empirical example.

Citation extraction

32
references
53
in-text mentions
32
distinct cited
0
self-citations
10,538
main-text words

appendix boundary found by appendix_command · 83% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Chernozhukov, V., Chetverikov, D., Demirer, M., Duflo, E., Hansen, C… (2018) Double/debiased machine learning for treatment and structural parameters1.00083100%
2D'Amour, A., Ding, P., Feller, A., Lei, L., & Sekhon, J (2021) Overlap in observational studies with high-dimensional covariates0.84333100%
3Chernozhukov, V., Newey, W. K., & Singh, R (2022) Automatic debiased machine learning of causal and structural effects0.73732100%
4Kennedy, E. H (2024) Semiparametric doubly robust targeted double machine learning: A review0.73732100%
5Newey, W. K (1990) Semiparametric efficiency bounds0.73732100%
6Robinson, P. M (1988) Root-$N$-consistent semiparametric regression0.73732100%
7Belsley, D. A., Kuh, E., & Welsch, R. E (1980) Regression Diagnostics: Identifying Influential Data and Sources of Collinearity0.64422100%
8Golub, G. H., & Van Loan, C. F (2013) Matrix Computations0.64422100%
9Khan, S., & Tamer, E (2010) Irregular identification, support conditions, and inverse weight estimation0.64422100%
10Rosenbaum, P. R., & Rubin, D. B (1983) The central role of the propensity score in observational studies for causal effects0.51121100%

Showing the top 10 of 32 scored citations.