Sökning: onr:"swepub:oai:hhs.se:1154965620006056" >
Predicting replicat...
Predicting replication outcomes in the Many Labs 2 study
-
- Forsell, Eskil (författare)
- Spotify Sweden AB (SE)
-
- Viganola, Domenico (författare)
- Stockholm School of Economics,Handelshögskolan i Stockholm
-
- Pfeiffer, Thomas (författare)
- Massey University (NZ)
-
visa fler...
-
- Chen, Yiling (författare)
- John A. Paulson School of Engineering and Applied Sciences
-
- Nosek, Brian A. (författare)
- University of Virginia (US)
-
- Johannesson, Magnus (författare)
- Stockholm School of Economics,Handelshögskolan i Stockholm
-
- Dreber Almenberg, Anna (författare)
- Stockholm School of Economics,Handelshögskolan i Stockholm
-
- Almenberg, Johan (författare)
- National Institute of Economic Research (SE)
-
- Wilson, Brad (författare)
- Consensus Point
-
visa färre...
-
(creator_code:org_t)
- Elsevier, 2019
- 2019
- Engelska.
-
Ingår i: Journal of Economic Psychology. - : Elsevier. - 1872-7719 .- 0167-4870. ; 75:Part A SI
- Relaterad länk:
-
https://research.hhs... (primary) (Object in context)
-
visa fler...
-
https://doi.org/10.1...
-
https://research.hhs...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- Understanding and improving reproducibility is crucial for scientific progress. Prediction markets and related methods of eliciting peer beliefs are promising tools to predict replication outcomes. We invited researchers in the field of psychology to judge the replicability of 24 studies replicated in the large scale Many Labs 2 project. We elicited peer beliefs in prediction markets and surveys about two replication success metrics: the probability that the replication yields a statistically significant effect in the original direction (p < 0.001), and the relative effect size of the replication. The prediction markets correctly predicted 75% of the replication outcomes, and were highly correlated with the replication outcomes. Survey beliefs were also significantly correlated with replication outcomes, but had larger prediction errors. The prediction markets for relative effect sizes attracted little trading and thus did not work well. The survey beliefs about relative effect sizes performed better and were significantly correlated with observed relative effect sizes. The results suggest that replication outcomes can be predicted and that the elicitation of peer beliefs can increase our knowledge about scientific reproducibility and the dynamics of hypothesis testing.
Ämnesord
- SAMHÄLLSVETENSKAP -- Psykologi (hsv//swe)
- SOCIAL SCIENCES -- Psychology (hsv//eng)
Publikations- och innehållstyp
- art (ämneskategori)
- ref (ämneskategori)
Hitta via bibliotek
Till lärosätets databas