Evaluating replicability of laboratory experiments in economics

• The replicability of some scientific findings has recently been called into question. To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that weremade publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs.

Subject headings

SAMHÄLLSVETENSKAP  -- Ekonomi och näringsliv (hsv//swe)

SOCIAL SCIENCES  -- Economics and Business (hsv//eng)

SAMHÄLLSVETENSKAP  -- Ekonomi och näringsliv -- Nationalekonomi (hsv//swe)

SOCIAL SCIENCES  -- Economics and Business -- Economics (hsv//eng)

Keyword

prediction markets

replication

reproducibility

competition

selection

exchange

policy

cancer

false

power

Publication and Content Type

ref (subject category)

art (subject category)