Uwe Hassler, Marc-Oliver Pohle
arXiv 4 Sep 2020 · Statistics — Applications · publishedInternational Statistical Review (2022) · 2 citations (OpenAlex)
arXiv:2009.02198 · PDF · DOI · OpenAlex · Extracted main text
Questionable research practices like HARKing or p-hacking have generated considerable recent interest throughout and beyond the scientific community. We subsume such practices involving secret data snooping that influences subsequent statistical inference under the term MESSing (manipulating evidence subject to snooping) and discuss, illustrate and quantify the possibly dramatic effects of several forms of MESSing using an empirical and a simple theoretical example. The empirical example uses numbers from the most popular German lottery, which seem to suggest that 13 is an unlucky number.
appendix boundary found by appendix_titled_section at “Appendix” · 95% of the source is main text. Read the extracted text to check this.
The works this paper leans on most, across its whole bibliography — not restricted to papers in our corpus. Ranked by composite intensity, which combines how often a work is mentioned, how many sections mention it, and how much of that falls in the main text rather than the appendix.
| Reference | Intensity | Mentions | Sections | Main text | |
|---|---|---|---|---|---|
| 1 | Simmons, J. P., L. D. Nelson, and U. Simonsohn (2011) False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant | 1.000 | 5 | 3 | 100% |
| 2 | Kerr, N. L (1998) HARKing: Hypothesizing After the Results are Known | 0.737 | 3 | 2 | 100% |
| 3 | Wallis, W. A (1942) Compounding probabilities from independent signficance tests | 0.644 | 2 | 2 | 100% |
| 4 | Christensen, G., J. Freese, and E. Miguel (2019) Transparent and reproducible social science research: How to do open science | 0.644 | 2 | 2 | 100% |
| 5 | Hand, D. J (1998) Data mining: Statistics and more? | 0.585 | 3 | 1 | 100% |
| 6 | White, H (2000) A reality check for data snooping | 0.585 | 3 | 1 | 100% |
| 7 | John, L. K., G. Loewenstein, and D. Prelec (2012) Measuring the prevalence of questionable research practices with incentives for truth telling | 0.511 | 2 | 1 | 100% |
| 8 | Sterling, T. D., W. L. Rosenbaum, and J. J. Weinkam (1995) Publication decisions revisited: The effect of the outcome of statistical tests on the decision to publish and vice versa | 0.511 | 2 | 1 | 100% |
| 9 | Wasserstein, R. L. and N. A. Lazar (2016) The ASA statement on p-values: Context, process, and purpose | 0.511 | 2 | 1 | 100% |
| 10 | Chuard, P. J. C., M. Vrtílek, M. L. Head, and M. D. Jennions (2019) Evidence that nonsignificant results are sometimes preferred: Reverse $p$-hacking or selective reporting? | 0.405 | 1 | 1 | 100% |
Showing the top 10 of 30 scored citations.