Weak Statistical Standards Implicated in Scientific Irreproducibility
By Erika Check Hayden,
Nature
| 11. 11. 2013
The
plague of non-reproducibility in science may be mostly due to scientists’ use of weak statistical tests, as shown by an innovative method developed by statistician Valen Johnson, at Texas A&M University in College Station.
Johnson compared the strength of two types of tests: frequentist tests, which measure how unlikely a finding is to occur by chance, and Bayesian tests, which measure the likelihood that a particular hypothesis is correct given data collected in the study. The strength of the results given by these two types of tests had not been compared before, because they ask slightly different types of questions.
So Johnson developed a method that makes the results given by the tests — the P value in the frequentist paradigm, and the Bayes factor in the Bayesian paradigm — directly comparable. Unlike frequentist tests, which use objective calculations to reject a null hypothesis, Bayesian tests require the tester to define an alternative hypothesis to be tested — a subjective process. But Johnson developed a 'uniformly most powerful' Bayesian test that defines the alternative hypothesis in a standard way...
Related Articles
By Jeffrey Gettleman and Maya Tekeli, The New York Times | 09.24.2025
For some Greenlanders, sorry isn’t enough.
The prime minister of Denmark, Mette Frederiksen, made a special visit Wednesday to Greenland’s capital, Nuuk, to apologize in person for a traumatic chapter in Greenlandic history, when Danish doctors forced birth control on...
By Emma McDonald Kennedy
| 09.25.2025
In the leadup to the 2024 election, Donald Trump repeatedly promised to make IVF more accessible. He made the commitment central to his campaign, even referring to himself as the “father of IVF.” In his first month in office, Trump issued an executive order promising to expand IVF access. The order set a 90-day deadline for policy recommendations for “lowering costs and reducing barriers to IVF,” although it didn’t make any substantive reproductive healthcare policy changes.
The response to the...
By Marianne Lamers, NEMO Kennislink [cites CGS' Katie Hasson] | 09.23.2025
Een rijtje gespreide vulva’s gaapt de bezoeker aan. Zó ziet een bevalling eruit, en zó een baarmoeder met foetus. Een zwangerschap, maar dan zonder zwangere vrouw, gestript van zorgen, gêne en pijn. De zwangerschapsmodellen en oefenbekkens, te zien in de...
By Johana Bhuiyan, The Guardian | 09.23.2025
In March 2021, a 25-year-old US citizen was traveling through Chicago’s Midway airport when they were stopped by US border patrol agents. Though charged with no crime, the 25-year-old was subjected to a cheek swab to collect their DNA, which...