Title |
A power fallacy
|
---|---|
Published in |
Behavior Research Methods, October 2014
|
DOI | 10.3758/s13428-014-0517-4 |
Pubmed ID | |
Authors |
Eric-Jan Wagenmakers, Josine Verhagen, Alexander Ly, Marjan Bakker, Michael D. Lee, Dora Matzke, Jeffrey N. Rouder, Richard D. Morey |
Abstract |
The power fallacy refers to the misconception that what holds on average -across an ensemble of hypothetical experiments- also holds for each case individually. According to the fallacy, high-power experiments always yield more informative data than do low-power experiments. Here we expose the fallacy with concrete examples, demonstrating that a particular outcome from a high-power experiment can be completely uninformative, whereas a particular outcome from a low-power experiment can be highly informative. Although power is useful in planning an experiment, it is less useful-and sometimes even misleading-for making inferences from observed data. To make inferences from data, we recommend the use of likelihood ratios or Bayes factors, which are the extension of likelihood ratios beyond point hypotheses. These methods of inference do not average over hypothetical replications of an experiment, but instead condition on the data that have actually been observed. In this way, likelihood ratios and Bayes factors rationally quantify the evidence that a particular data set provides for or against the null or any other hypothesis. |
X Demographics
Geographical breakdown
Country | Count | As % |
---|---|---|
United States | 2 | 13% |
Australia | 1 | 7% |
Japan | 1 | 7% |
United Kingdom | 1 | 7% |
Sweden | 1 | 7% |
Unknown | 9 | 60% |
Demographic breakdown
Type | Count | As % |
---|---|---|
Scientists | 8 | 53% |
Members of the public | 6 | 40% |
Practitioners (doctors, other healthcare professionals) | 1 | 7% |
Mendeley readers
Geographical breakdown
Country | Count | As % |
---|---|---|
Germany | 3 | 2% |
United Kingdom | 2 | 1% |
United States | 2 | 1% |
Chile | 1 | <1% |
Ireland | 1 | <1% |
Sweden | 1 | <1% |
Portugal | 1 | <1% |
Canada | 1 | <1% |
Netherlands | 1 | <1% |
Other | 2 | 1% |
Unknown | 160 | 91% |
Demographic breakdown
Readers by professional status | Count | As % |
---|---|---|
Student > Ph. D. Student | 35 | 20% |
Researcher | 35 | 20% |
Student > Master | 20 | 11% |
Professor | 16 | 9% |
Professor > Associate Professor | 14 | 8% |
Other | 42 | 24% |
Unknown | 13 | 7% |
Readers by discipline | Count | As % |
---|---|---|
Psychology | 94 | 54% |
Agricultural and Biological Sciences | 10 | 6% |
Medicine and Dentistry | 9 | 5% |
Neuroscience | 7 | 4% |
Engineering | 5 | 3% |
Other | 25 | 14% |
Unknown | 25 | 14% |