Skip to main content
Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging 12/2019

03.08.2019 | Editorial

The p value wars (again)

verfasst von: Ulrich Dirnagl

Erschienen in: European Journal of Nuclear Medicine and Molecular Imaging | Ausgabe 12/2019

Einloggen, um Zugang zu erhalten

Excerpt

More than 800 researchers, many of them prominent biostatisticians, called to “raise up against the p-value.” [1] This recent battle cry was just the climax of a growing insurrection, which prominently surfaced in 2018 when another group of biostatisticians demanded that we should “redefine statistical significance,” [2] and proposed to change the default p value threshold for statistical significance from 0.05 to 0.005 for claims of new discoveries. For many researchers and experts, this demand did not go far enough; in a follow-up statement, they demanded to “remove rather than redefine statistical significance.” [3] This apparent upheaval even made it into the lay press. The Financial Times, for example, analyzed that “Scientists strike back against statistical tyranny.” [4] What’s all the fuzz about? …
Literatur
1.
Zurück zum Zitat Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature. 2019;567:305–7.CrossRef Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature. 2019;567:305–7.CrossRef
2.
Zurück zum Zitat Benjamin DJ, Berger JO, Johannesson M, Nosek BA, Wagenmakers E-J, Berk R, et al. Redefine statistical significance. Nat Hum Behav. 2018;2:6–10.CrossRef Benjamin DJ, Berger JO, Johannesson M, Nosek BA, Wagenmakers E-J, Berk R, et al. Redefine statistical significance. Nat Hum Behav. 2018;2:6–10.CrossRef
3.
Zurück zum Zitat Amrhein V, Greenland S. Remove, rather than redefine, statistical significance. Nat Hum Behav. 2018;2:4.CrossRef Amrhein V, Greenland S. Remove, rather than redefine, statistical significance. Nat Hum Behav. 2018;2:4.CrossRef
4.
Zurück zum Zitat Anjana A. Scientists strike back against statistical tyranny | Financial Times. Financial Times; 2019. Anjana A. Scientists strike back against statistical tyranny | Financial Times. Financial Times; 2019.
5.
Zurück zum Zitat Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533:452–4.CrossRef Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533:452–4.CrossRef
6.
Zurück zum Zitat Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2:0696–701. Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2:0696–701.
7.
Zurück zum Zitat Ioannidis JPA, Fanelli D, Dunne DD, Goodman SN. Meta-research: evaluation and improvement of research methods and practices. PLoS Biol. 2015;13:e1002264.CrossRef Ioannidis JPA, Fanelli D, Dunne DD, Goodman SN. Meta-research: evaluation and improvement of research methods and practices. PLoS Biol. 2015;13:e1002264.CrossRef
8.
Zurück zum Zitat Henderson VC, Demko N, Hakala A, MacKinnon N, Federico CA, Fergusson D, et al. A meta-analysis of threats to valid clinical inference in preclinical research of sunitinib. Elife. 2015;4:1–13.CrossRef Henderson VC, Demko N, Hakala A, MacKinnon N, Federico CA, Fergusson D, et al. A meta-analysis of threats to valid clinical inference in preclinical research of sunitinib. Elife. 2015;4:1–13.CrossRef
9.
Zurück zum Zitat Nissen SB, Magidson T, Gross K, Bergstrom CT. Publication bias and the canonization of false facts. 2016.CrossRef Nissen SB, Magidson T, Gross K, Bergstrom CT. Publication bias and the canonization of false facts. 2016.CrossRef
10.
Zurück zum Zitat Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, et al. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14:365–76.CrossRef Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, et al. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14:365–76.CrossRef
11.
Zurück zum Zitat Colquhoun D. The reproducibility of research and the misinterpretation of p-values. R Soc Open Sci. 2017;4:171085.CrossRef Colquhoun D. The reproducibility of research and the misinterpretation of p-values. R Soc Open Sci. 2017;4:171085.CrossRef
13.
Zurück zum Zitat Bennett CM, Baird AA, Miller MB, Wolford GL. Neural correlates of interspecies perspective taking in the post-mortem Atlantic salmon: an argument for proper multiple comparisons correction. J Serendipitous Unexpected Results. 2011;1:1–5. Bennett CM, Baird AA, Miller MB, Wolford GL. Neural correlates of interspecies perspective taking in the post-mortem Atlantic salmon: an argument for proper multiple comparisons correction. J Serendipitous Unexpected Results. 2011;1:1–5.
14.
Zurück zum Zitat Mudge JF, Martyniuk CJ, Houlahan JE. Optimal alpha reduces error rates in gene expression studies: a meta-analysis approach. BMC Bioinformatics. 2017;18:312.CrossRef Mudge JF, Martyniuk CJ, Houlahan JE. Optimal alpha reduces error rates in gene expression studies: a meta-analysis approach. BMC Bioinformatics. 2017;18:312.CrossRef
16.
Zurück zum Zitat Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K. A comprehensive review of genetic association studies. Genet Med. 2002;4:45–61.CrossRef Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K. A comprehensive review of genetic association studies. Genet Med. 2002;4:45–61.CrossRef
17.
Zurück zum Zitat Lew MJ. Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don’t know P. Br J Pharmacol. 2012;166:1559–67.CrossRef Lew MJ. Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don’t know P. Br J Pharmacol. 2012;166:1559–67.CrossRef
18.
Zurück zum Zitat Diong J, Butler AA, Gandevia SC, Héroux ME. Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice. PLoS One. 2018;13:e0202121.CrossRef Diong J, Butler AA, Gandevia SC, Héroux ME. Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice. PLoS One. 2018;13:e0202121.CrossRef
19.
Zurück zum Zitat Nickerson RS. Null hypothesis significance testing: a review of an old and continuing controversy. Psychol Methods. 2000;5:241–301.CrossRef Nickerson RS. Null hypothesis significance testing: a review of an old and continuing controversy. Psychol Methods. 2000;5:241–301.CrossRef
21.
Zurück zum Zitat Bialik C. How to be sure you’ve found a Higgs boson. Wall Street J. 2012. Bialik C. How to be sure you’ve found a Higgs boson. Wall Street J. 2012.
22.
Zurück zum Zitat Overbye D. Tiny neutrinos may have broken cosmic speed limit: The New York Times; 2011. Overbye D. Tiny neutrinos may have broken cosmic speed limit: The New York Times; 2011.
24.
Zurück zum Zitat Ioannidis JP, The A. Importance of predefined rules and prespecified statistical analyses. JAMA. 2019;321:2067.CrossRef Ioannidis JP, The A. Importance of predefined rules and prespecified statistical analyses. JAMA. 2019;321:2067.CrossRef
25.
Zurück zum Zitat Ioannidis JPA. Retiring statistical significance would give bias a free pass. Nature. 2019;567:461–1. Ioannidis JPA. Retiring statistical significance would give bias a free pass. Nature. 2019;567:461–1.
26.
Zurück zum Zitat Kimmelman J, Mogil JS, Dirnagl U. Distinguishing between exploratory and confirmatory preclinical research will improve translation. PLoS Biol. 2014;12:e1001863.CrossRef Kimmelman J, Mogil JS, Dirnagl U. Distinguishing between exploratory and confirmatory preclinical research will improve translation. PLoS Biol. 2014;12:e1001863.CrossRef
27.
Zurück zum Zitat Harlow, L. L., Mulaik, S. A. & Steiger, J. H. What if there were no significance tests? (1997). Harlow, L. L., Mulaik, S. A. & Steiger, J. H. What if there were no significance tests? (1997).
28.
29.
Zurück zum Zitat Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond ‘p<0.05’. Am Stat. 2019;73:1–19.CrossRef Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond ‘p<0.05’. Am Stat. 2019;73:1–19.CrossRef
Metadaten
Titel
The p value wars (again)
verfasst von
Ulrich Dirnagl
Publikationsdatum
03.08.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
European Journal of Nuclear Medicine and Molecular Imaging / Ausgabe 12/2019
Print ISSN: 1619-7070
Elektronische ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-019-04467-5

Weitere Artikel der Ausgabe 12/2019

European Journal of Nuclear Medicine and Molecular Imaging 12/2019 Zur Ausgabe