EconBase
← All papers

How Robust are Robustness Checks?

Brenda Prallon

arXiv 22 Feb 2026 · Econometrics

arXiv:2602.19384 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Robustness checks are routine in empirical work, but there is no standard statistical procedure to formally measure what one can learn from them. I propose a "robustness radius" measure to quantify the amount by which the robustness checks estimands differ from the main specification estimand. I do so by framing robustness checks as explicitly biased regressions, clarifying what exactly the estimands are when comparing multiple regressions with slightly different samples, and applying a test from the moment inequalities literature. The robustness radius is easily interpretable and adapts to sampling uncertainty and correlation across regressions. An application shows that, although assessing overall robustness is context-specific, the robustness radius guides those judgments and improves transparency.

Citation extraction

22
references
63
in-text mentions
22
distinct cited
0
self-citations
8,402
main-text words

appendix boundary found by appendix_command · 86% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Lu, Xun and White, Halbert (2014) Robustness checks and robustness tests in applied economics1.00063100%
2Cox, Gregory and Shi, Xiaoxia (2022) Simple Adaptive Size-Exact Testing for Full-Vector and Subvector Inference in Moment Inequality Models0.93221581%
3Paul Diegert and Matthew A. Masten and Alexandre Poirier (2023) Assessing Omitted Variable Bias when the Controls are Endogenous0.87462100%
4Bei, Xinyue (2024) Inference on Union Bounds0.84333100%
5Massenkoff, Maxim and Wilmers, Nathan (2023) Wage Stagnation and the Decline of Standardized Pay Rates, 1974–19910.73732100%
6Altonji, Joseph G. and Elder, Todd E. and Taber, Christopher R (2005) Selection on Observed and Unobserved Variables: Assessing the Effectiveness of Catholic Schools0.64422100%
7Chernozhukov, Victor and others (2024) Long Story Short: Omitted Variable Bias in Causal Machine Learning0.64422100%
8Cinelli, Carlos and Hazlett, Chad (2020) Making sense of sensitivity: Extending omitted variable bias0.64422100%
9Oster, Emily (2019) Unobservable selection and coefficient stability: Theory and evidence0.64422100%
10Hansen, B (2022) Econometrics0.5112250%

Showing the top 10 of 22 scored citations.