EconBase
← All papers

A model of multiple hypothesis testing

Davide Viviano, Kaspar Wuthrich, Paul Niehaus

arXiv 27 Apr 2021 · General Economics · publishedThe Review of Economic Studies (2026) · 11 citations (OpenAlex)

arXiv:2104.13367 · PDF · DOI · OpenAlex · Extracted main text

Abstract

Multiple hypothesis testing practices vary widely, without consensus on which are appropriate when. This paper provides an economic foundation for these practices designed to capture leading examples, such as regulatory approval on the basis of clinical trials. In studies of multiple treatments or sub-populations, adjustments may be appropriate depending on scale economies in the research production function, with control of classical notions of compound errors emerging in some but not all cases. In studies with multiple outcomes, indexing is appropriate and adjustments to test levels may be appropriate if the intended audience is heterogeneous. Data on actual costs in the drug approval process suggest both that some adjustment is warranted in that setting and that standard procedures may be overly conservative.

Citation extraction

54
references
95
in-text mentions
54
distinct cited
1
self-citations
17,345
main-text words

appendix boundary found by appendix_command · 52% of the source is main text. Read the extracted text to check this.

Most heavily cited references

The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.

ReferenceIntensityMentionsSectionsMain text
1Banerjee, A. V., S. Chassang, S. Montero, and E. Snowberg (2020) A theory of experimenters: Robustness, randomization, and balance0.87452100%
2Lehmann, E. L. and J. P. Romano (2005) Testing statistical hypotheses0.8434375%
3Sidák, Z (1968) On multivariate normal probabilities of rectangles: their dependence on correlations0.8434375%
4Gilboa, I. and D. Schmeidler (1989) Maxmin expected utility with non-unique prior0.81142100%
5Tetenov, A (2016) An economic theory of statistical testing0.79414750%
6Romano, J. P., A. Shaikh, and M. Wolf (2011) Consonance and the closure method in multiple testing0.7373367%
7Tetenov, A (2012) Statistical treatment choice based on asymmetric minimax regret criteria0.73732100%
8Viviano, D., K. Wuthrich, and P. Niehaus (2025) A model of multiple hypothesis testing self0.64422100%
9Efron, B (2008) Microarrays, empirical bayes and the two-groups model0.64422100%
10Food and Drug Administration (2022, October) (2022) Multiple endpoints in clinical trials guidance for industry0.64422100%

Showing the top 10 of 54 scored citations.

Cited by, within the corpus

arXiv econ.EM papers that cite this one, ranked by how heavily they lean on it.

Citing paperIntensityMentionsSections
1Designing persuasive experiments0.51121
22412.164520.40511
3Certified Decisions0.40511
4Publication Design with Incentives in Mind0.40511
52510.211780.40511