Weak Statistical Standards Implicated in Scientific Irreproducibility
By Erika Check Hayden,
Nature
| 11. 11. 2013
The
plague of non-reproducibility in science may be mostly due to scientists’ use of weak statistical tests, as shown by an innovative method developed by statistician Valen Johnson, at Texas A&M University in College Station.
Johnson compared the strength of two types of tests: frequentist tests, which measure how unlikely a finding is to occur by chance, and Bayesian tests, which measure the likelihood that a particular hypothesis is correct given data collected in the study. The strength of the results given by these two types of tests had not been compared before, because they ask slightly different types of questions.
So Johnson developed a method that makes the results given by the tests — the P value in the frequentist paradigm, and the Bayes factor in the Bayesian paradigm — directly comparable. Unlike frequentist tests, which use objective calculations to reject a null hypothesis, Bayesian tests require the tester to define an alternative hypothesis to be tested — a subjective process. But Johnson developed a 'uniformly most powerful' Bayesian test that defines the alternative hypothesis in a standard way...
Related Articles
By Tomoko Otake, The Japan Times | 04.09.2024
A decade ago, researcher Haruko Obokata caused a sensation when she published two papers in the journal Nature, in which she claimed that she had discovered a way to create stem cells easily using the so-called STAP method.
With STAP...
By Yelena Biberman and Jonathan D. Moreno, Bioethics Forum | 04.16.2024
A quiet biological revolution in warfare is underway. The genome is emerging as a new domain of conflict. The level of destruction that only nuclear weapons could previously achieve is fast becoming as accessible as a cyberattack.
Now for the...
CGS is excited to announce the launch of a new anti-eugenics initiative that has been years in the making. Legacies of Eugenics in Science, Medicine, and Technology kicks off with a monthly essay series published at the Los Angeles Review of Books that will expose and contest the reemergence of eugenic ideas in contemporary health sciences, human biotechnology, public health, and medicine. Community and campus-based events featuring the authors are also being planned. The project is a collaboration among CGS...
By Tristan Manalac, BioSpace | 04.02.2024
Verve Therapeutics has suspended enrollment in the Phase Ib Heart-1 study evaluating its lead gene editing program VERVE-101 following a serious adverse event, the company announced Tuesday.
A patient, who received a 0.45-mg/kg dose of VERVE-101, developed a grade 3...