Weak Statistical Standards Implicated in Scientific Irreproducibility
By Erika Check Hayden,
Nature
| 11. 11. 2013
The
plague of non-reproducibility in science may be mostly due to scientists’ use of weak statistical tests, as shown by an innovative method developed by statistician Valen Johnson, at Texas A&M University in College Station.
Johnson compared the strength of two types of tests: frequentist tests, which measure how unlikely a finding is to occur by chance, and Bayesian tests, which measure the likelihood that a particular hypothesis is correct given data collected in the study. The strength of the results given by these two types of tests had not been compared before, because they ask slightly different types of questions.
So Johnson developed a method that makes the results given by the tests — the P value in the frequentist paradigm, and the Bayes factor in the Bayesian paradigm — directly comparable. Unlike frequentist tests, which use objective calculations to reject a null hypothesis, Bayesian tests require the tester to define an alternative hypothesis to be tested — a subjective process. But Johnson developed a 'uniformly most powerful' Bayesian test that defines the alternative hypothesis in a standard way...
Related Articles
By Jason Kehe, Wired | 04.11.2024
God help the babies! Or, absent God, a fertility startup called Orchid. It offers prospective parents a fantastical choice: Have a regular baby or have an Orchid baby. A regular baby might grow up and get cancer. Or be born...
By Neel Shah, The PrePrint | 04.11.2024
Years ago, I interviewed for a residency position at The Johns Hopkins Hospital in Baltimore. Standing before the domed Victorian building at the campus entrance, I couldn’t help but be in awe of the history of the place, the great...
By Judith Levine, The Intercept | 04.04.2024
WHEN THE ALABAMA Supreme Court ruled that fertilized embryos were “extrauterine children,” it did more than imperil the future of in vitro fertilization in Alabama and, potentially, the U.S. The ruling, on the claimed “wrongful death” of frozen embryos...
By Justin McCurry, The Guardian | 04.01.2024
A Chinese scientist who was imprisoned for his role in creating the world’s first genetically edited babies says he has returned to his laboratory to work on the treatment of Alzheimer’s and other genetic diseases.
In an interview with a...