1. |
- Benjamin, Daniel J., et al.
(författare)
-
Redefine statistical significance
- 2018
-
Ingår i: Nature Human Behaviour. - : Nature Research (part of Springer Nature). - 2397-3374. ; 2:1, s. 6-10
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)
|
|
2. |
- Altmejd, Adam, et al.
(författare)
-
Predicting the replicability of social science lab experiments
- 2019
-
Ingår i: PLOS ONE. - : Public Library of Science (PLoS). - 1932-6203. ; 14:12
-
Tidskriftsartikel (refereegranskat)abstract
- We measure how accurately replication of experimental results can be predicted by black-box statistical models. With data from four large-scale replication projects in experimental psychology and economics, and techniques from machine learning, we train predictive models and study which variables drive predictable replication. The models predicts binary replication with a cross-validated accuracy rate of 70% (AUC of 0.77) and estimates of relative effect sizes with a Spearman ρ of 0.38. The accuracy level is similar to market-aggregated beliefs of peer scientists [1, 2]. The predictive power is validated in a pre-registered out of sample test of the outcome of [3], where 71% (AUC of 0.73) of replications are predicted correctly and effect size correlations amount to ρ = 0.25. Basic features such as the sample and effect sizes in original papers, and whether reported effects are single-variable main effects or two-variable interactions, are predictive of successful replication. The models presented in this paper are simple tools to produce cheap, prognostic replicability metrics. These models could be useful in institutionalizing the process of evaluation of new findings and guiding resources to those direct replications that are likely to be most informative.
|
|
3. |
- Camerer, C. F., et al.
(författare)
-
Evaluating replicability of laboratory experiments in economics
- 2016
-
Ingår i: Science. - : American Association for the Advancement of Science (AAAS). - 0036-8075 .- 1095-9203. ; 351:6280, s. 1433-1436
-
Tidskriftsartikel (refereegranskat)abstract
- The replicability of some scientific findings has recently been called into question. To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that weremade publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs.
|
|
4. |
- Camerer, C. F., et al.
(författare)
-
Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015
- 2018
-
Ingår i: Nature Human Behaviour. - : Springer Science and Business Media LLC. - 2397-3374. ; 2:9, s. 637-644
-
Tidskriftsartikel (refereegranskat)abstract
- Being able to replicate scientific findings is crucial for scientific progress1-15. We replicate 21 systematically selected experimental studies in the social sciences published in Nature and Science between 2010 and 201516-36. The replications follow analysis plans reviewed by the original authors and pre-registered prior to the replications. The replications are high powered, with sample sizes on average about five times higher than in the original studies. We find a significant effect in the same direction as the original study for 13 (62%) studies, and the effect size of the replications is on average about 50% of the original effect size. Replicability varies between 12 (57%) and 14 (67%) studies for complementary replicability indicators. Consistent with these results, the estimated truepositive rate is 67% in a Bayesian analysis. The relative effect size of true positives is estimated to be 71%, suggesting that both false positives and inflated effect sizes of true positives contribute to imperfect reproducibility. Furthermore, we find that peer beliefs of replicability are strongly related to replicability, suggesting that the research community could predict which results would replicate and that failures to replicate were not the result of chance alone.
|
|
5. |
|
|
6. |
- Dreber Almenberg, Anna, et al.
(författare)
-
fMRI data of mixed gambles from the Neuroimaging Analysis Replication and Prediction Study
- 2019
-
Ingår i: Scientific Data. - : Nature Research (part of Springer Nature): Fully open access journals / Nature Publishing Group. - 2052-4463 .- 2052-4463. ; 6:1
-
Tidskriftsartikel (refereegranskat)abstract
- There is an ongoing debate about the replicability of neuroimaging research. It was suggested that one of the main reasons for the high rate of false positive results is the many degrees of freedom researchers have during data analysis. In the Neuroimaging Analysis Replication and Prediction Study (NARPS), we aim to provide the first scientific evidence on the variability of results across analysis teams in neuroscience. We collected fMRI data from 108 participants during two versions of the mixed gambles task, which is often used to study decision-making under risk. For each participant, the dataset includes an anatomical (T1 weighted) scan and fMRI as well as behavioral data from four runs of the task. The dataset is shared through OpenNeuro and is formatted according to the Brain Imaging Data Structure (BIDS) standard. Data pre-processed with fMRIprep and quality control reports are also publicly shared. This dataset can be used to study decision-making under risk and to test replicability and interpretability of previous results in the field.
|
|
7. |
- Fang, Dawei, 1983, et al.
(författare)
-
How tournament incentives affect asset markets: A comparison between winner-take-all tournaments and elimination contests
- 2017
-
Ingår i: Journal of Economic Dynamics and Control. - : Elsevier BV. - 0165-1889. ; 75, s. 1-27
-
Tidskriftsartikel (refereegranskat)abstract
- We investigate the impact of investment managers׳ tournament incentives on investment strategies and market efficiency, distinguishing between winner-take-all tournaments (WTA), where a minority wins, and elimination contests (EC), where a majority wins. Theoretically, we show that investment managers play heterogeneous strategies in WTA and homogeneous strategies in EC, and markets are more prone to mispricing in WTA than in EC. Experimentally, we find that investment managers play more heterogeneous strategies in WTA than in EC, but this does not trigger significant differences in prices. Moreover, prices in WTA and EC do not differ significantly from markets composed of linearly incentivized subjects.
|
|
8. |
- Huber, J., et al.
(författare)
-
Market versus Residence Principle: Experimental Evidence on the Effects of a Financial Transaction Tax
- 2017
-
Ingår i: Economic Journal. - : Oxford University Press (OUP). - 0013-0133 .- 1468-0297. ; 127:605
-
Tidskriftsartikel (refereegranskat)abstract
- The effects of a financial transaction tax (FTT) are scientifically disputed, as seemingly small details of its implementation may matter a lot. In this article, we provide experimental evidence on the different effects of an FTT, depending on whether it is implemented as a tax on markets, on residents, or a combination of both. We find that a tax on markets has negative effects on volatility and trading volume, whereas a tax on residents shows none of these undesired effects. Additionally, we observe that individual risk attitude is not related to traders’ reaction to the different forms of an FTT. © 2017 The Authors. The Economic Journal published by John Wiley & Sons Ltd on behalf of Royal Economic Society.
|
|
9. |
- Huber, Jürgen, et al.
(författare)
-
The influence of investment experience on market prices: laboratory evidence
- 2016
-
Ingår i: Experimental Economics. - : Springer Science and Business Media LLC. - 1386-4157 .- 1573-6938. ; 19:2, s. 394-411
-
Tidskriftsartikel (refereegranskat)abstract
- We run laboratory experiments to analyze the impact of prior investment experience on price efficiency in asset markets. Before subjects enter the asset market they gain either no, positive, or negative investment experience in an investment game. To get a comprehensive picture about the role of experience we implement two asset market designs. One is prone to inefficient pricing, exhibiting bubble and crash patterns, while the other exhibits efficient pricing. We find that (i) both, positive and negative, experience gained in the investment game lead to efficient pricing in both market settings. Further, we show that (ii) the experience effect dominates potential effects triggered by positive and negative sentiment generated by the investment game. We conjecture that experiencing changing price paths in the investment game can create a higher sensibility on changing fundamentals (through higher salience) among subjects in the subsequently run asset market.
|
|
10. |
- Kirchler, Michael, 1977, et al.
(författare)
-
Immaterial and monetary gifts in economic transactions: evidence from the field
- 2018
-
Ingår i: Experimental Economics. - : Springer Science and Business Media LLC. - 1386-4157 .- 1573-6938. ; 21:1, s. 205-230
-
Tidskriftsartikel (refereegranskat)abstract
- Reciprocation of monetary gifts is well-understood in economics. In contrast, there is little research on reciprocal behavior following immaterial gifts like compliments. We narrow this gap and investigate how employees reciprocate after receiving immaterial gifts and material gifts over time. We purchase (1) ice cream from fast food restaurants, and (2) durum doner, a common lunch snack, from independent vendors. Prior to the food's preparation, we either compliment or tip the salesperson. We find that salespersons reciprocate compliments with higher product weight than in a control treatment. Importantly, this reciprocal behavior following immaterial gifts grows over repeated transactions. Tips, in contrast, have a stronger level effect which does not change over time.
|
|
11. |
- Kirchler, Michael, 1977, et al.
(författare)
-
Market design and moral behavior
- 2016
-
Ingår i: Management science. - : Institute for Operations Research and the Management Sciences (INFORMS). - 0025-1909 .- 1526-5501. ; 62:9, s. 2615-2625
-
Tidskriftsartikel (refereegranskat)abstract
- In an experiment with 739 subjects, we study whether and how different interventions might have an influence on the degree of moral behavior when subjects make decisions that can generate negative externalities on uninvolved parties. Particularly, subjects can either take money for themselves or donate it to UNICEF for measles vaccines. By considering two fairly different institutional regimes-one with individual decision making, one with a double-auction market-we expose the different interventions to a kind of robustness check. We find that the threat of monetary punishment promotes moral behavior in both regimes. Getting subjects more involved with the traded good has no effect, though, in both regimes. Only the removal of anonymity, thus making subjects identifiable, has different effects across regimes, which we explain by different perceptions of responsibility.
|
|
12. |
- Kirchler, Michael, 1977, et al.
(författare)
-
Rankings and Risk-Taking in the Finance Industry
- 2018
-
Ingår i: Journal of Finance. - : Wiley. - 0022-1082. ; 73:5, s. 2271-2302
-
Tidskriftsartikel (refereegranskat)abstract
- Rankings are omnipresent in the finance industry, yet the literature is silent on how they impact financial professionals' behavior. Using lab-in-the-field experiments with 657 professionals and lab experiments with 432 students, we investigate how rank incentives affect investment decisions. We find that both rank and tournament incentives increase risk-taking among underperforming professionals, while only tournament incentives affect students. This rank effect is robust to the experimental frame (investment frame vs. abstract frame), to payoff consequences (own return vs. family return), to social identity priming (private identity vs. professional identity), and to professionals' gender (no gender differences among professionals).
|
|
13. |
- Kirchler, Michael, 1977, et al.
(författare)
-
The effect of fast and slow decisions on risk taking
- 2017
-
Ingår i: Journal of Risk and Uncertainty. - : Springer Science and Business Media LLC. - 0895-5646 .- 1573-0476. ; 54:1, s. 37-59
-
Tidskriftsartikel (refereegranskat)abstract
- We experimentally compare fast and slow decisions in a series of experiments on financial risk taking in three countries involving over 1700 subjects. To manipulate fast and slow decisions, subjects were randomly allocated to responding within 7 seconds (time pressure) or waiting for at least 7 or 20 seconds (time delay) before responding. To control for different effects of time pressure and time delay on measurement noise, we estimate separate parameters for noise and risk preferences within a random utility framework. We find that time pressure increases risk aversion for gains and risk taking for losses compared to time delay, implying that time pressure increases the reflection effect of Prospect Theory. The results for gains are weaker and less robust than the results for losses. We find no significant difference between time pressure and time delay for loss aversion (tested in only one of the experiments). Time delay also leads to less measurement noise than time pressure and unconstrained decisions, and appears to be an effective way of decreasing noise in experiments.
|
|
14. |
- Kirchler, Michael, 1977, et al.
(författare)
-
The "inflow-effect"-Trader inflow and price efficiency
- 2015
-
Ingår i: European Economic Review. - : Elsevier BV. - 0014-2921. ; 77, s. 1-19
-
Tidskriftsartikel (refereegranskat)abstract
- We investigate the impact of cash and trader inflow on price efficiency in multi-period experimental asset markets. Implementing eight treatments with 672 subjects, we find that (i) the joint inflow of cash and traders triggers strong overvaluation and massive price run-ups (inflow-effect). Remarkably, the effect occurs in almost all of the 30 markets with joint cash and trader inflow and is very robust. The effect even prevails in markets with complete and symmetric fundamental information. We further show that (ii) in treatments with the joint inflow of cash and traders, prices crash to fundamentals towards maturity of the asset. The analysis of traders' beliefs reveals that (iii) despite fundamental values staying constant, beliefs about fundamentals co-move with upwardly trending prices. Finally, we report a speculative motive only among the optimists in treatments where we observe the inflow-effect. (C) 2015 Elsevier BM. All rights reserved.
|
|
15. |
- McCarthy, Randy J., et al.
(författare)
-
Registered Replication Report on Srull and Wyer (1979)
- 2018
-
Ingår i: Advances in Methods and Practices in Psychological Science. - : SAGE Publications Inc. - 2515-2459 .- 2515-2467. ; 1:3, s. 321-336
-
Tidskriftsartikel (refereegranskat)abstract
- Srull and Wyer (1979) demonstrated that exposing participants to more hostility-related stimuli caused them subsequently to interpret ambiguous behaviors as more hostile. In their Experiment 1, participants descrambled sets of words to form sentences. In one condition, 80% of the descrambled sentences described hostile behaviors, and in another condition, 20% described hostile behaviors. Following the descrambling task, all participants read a vignette about a man named Donald who behaved in an ambiguously hostile manner and then rated him on a set of personality traits. Next, participants rated the hostility of various ambiguously hostile behaviors (all ratings on scales from 0 to 10). Participants who descrambled mostly hostile sentences rated Donald and the ambiguous behaviors as approximately 3 scale points more hostile than did those who descrambled mostly neutral sentences. This Registered Replication Report describes the results of 26 independent replications (N = 7,373 in the total sample; k = 22 labs and N = 5,610 in the primary analyses) of Srull and Wyer?s Experiment 1, each of which followed a preregistered and vetted protocol. A random-effects meta-analysis showed that the protagonist was seen as 0.08 scale points more hostile when participants were primed with 80% hostile sentences than when they were primed with 20% hostile sentences (95% confidence interval, CI = [0.004, 0.16]). The ambiguously hostile behaviors were seen as 0.08 points less hostile when participants were primed with 80% hostile sentences than when they were primed with 20% hostile sentences (95% CI = [?0.18, 0.01]). Although the confidence interval for one outcome excluded zero and the observed effect was in the predicted direction, these results suggest that the currently used methods do not produce an assimilative priming effect that is practically and routinely detectable.
|
|
16. |
- Razen, M., et al.
(författare)
-
Cash inflow and trading horizon in asset markets
- 2017
-
Ingår i: European Economic Review. - : Elsevier BV. - 0014-2921. ; 92, s. 359-384
-
Tidskriftsartikel (refereegranskat)abstract
- It is conjectured that one of the major ingredients of historic financial bubbles was the inflow of money in various forms. We run 36 laboratory asset markets to investigate the joint effect of cash inflow and trading horizon on price efficiency. We show that markets with cash inflow and long trading horizon exhibit bubbles and crashes. We also observe that markets with extended trading horizon but without cash inflow and markets with shorter trading horizon do not trigger bubbles. Finally, we report that beliefs about prices and, importantly, about (constant) fundamentals follow bubble patterns as well.
|
|
17. |
- Stefan, M., et al.
(författare)
-
Ethnical discrimination in Europe: Field evidence from the finance industry
- 2018
-
Ingår i: PLoS ONE. - : Public Library of Science (PLoS). - 1932-6203. ; 13:1
-
Tidskriftsartikel (refereegranskat)abstract
- The integration of ethnical minorities has been a hotly discussed topic in the political, societal, and economic debate. Persistent discrimination of ethnical minorities can hinder successful integration. Given that unequal access to investment and financing opportunities can cause social and economic disparities due to inferior economic prospects, we conducted a field experiment on ethnical discrimination in the finance sector with 1,218 banks in seven European countries. We contacted banks via e-mail, either with domestic or Arabic sounding names, asking for contact details only. We find pronounced discrimination in terms of a substantially lower response rate to e-mails from Arabic senders. Remarkably, the observed discrimination effect is robust for loan- and investment-related requests, across rural and urban locations of banks, and across countries. © 2018 Stefan et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
|
|
18. |
- Stockl, T., et al.
(författare)
-
Hot hand and gambler's fallacy in teams: Evidence from investment experiments
- 2015
-
Ingår i: Journal of Economic Behavior & Organization. - : Elsevier BV. - 0167-2681. ; 117, s. 327-339
-
Tidskriftsartikel (refereegranskat)abstract
- In laboratory experiments we explore the effects of communication and group decision making on investment behavior and on subjects' proneness to behavioral biases. Most importantly, we show that communication and group decision making do not impact subjects' overall proneness to the hot hand fallacy and to the gambler's fallacy. However, groups decide differently than individuals, as they rely significantly less on useless outside advice from "experts" and choose the risk-free option less frequently. Furthermore we document gender differences in investment behavior: groups of two female subjects choose the risk-free investment more often and are marginally more prone to the hot hand fallacy than groups of two male subjects. (C) 2015 The Authors. Published by Elsevier B.V.
|
|
19. |
- Stockl, T., et al.
(författare)
-
Multi-period experimental asset markets with distinct fundamental value regimes
- 2015
-
Ingår i: Experimental Economics. - : Springer Science and Business Media LLC. - 1386-4157 .- 1573-6938. ; 18:2, s. 314-334
-
Tidskriftsartikel (refereegranskat)abstract
- In this methodological study we analyze price adjustment processes in multi-period laboratory asset markets with five distinct fundamental value regimes in a unified framework. Minimizing the effect of between-treatment variations we run markets with deterministically decreasing, constant, randomly fluctuating and-as main innovation-markets with deterministically increasing s. We find (i) efficient pricing in markets with constant s, (ii) overvaluation in markets with decreasing s, and (iii) undervaluation in markets with increasing s. (iv) Markets with randomly fluctuating fundamentals show overvaluation when s predominantly decline and undervaluation when s are mostly upward-sloping. Finally, we document that (v) bid-ask spreads and volatility of price changes are positively correlated with mispricing across regimes. The main contribution of the paper is to provide clean comparisons between distinct regimes, in particular between markets with increasing s and other regimes.
|
|
20. |
- Tinghög, Gustav, 1979-, et al.
(författare)
-
Intuition and Moral Decision-Making : The Effect of Time Pressure and Cognitive Load on Moral Judgment and Altruistic Behavior
- 2016
-
Ingår i: PLOS ONE. - San Fransisco : library of science. - 1932-6203. ; 11:10
-
Tidskriftsartikel (refereegranskat)abstract
- Do individuals intuitively favor certain moral actions over others? This study explores the role of intuitive thinking—induced by time pressure and cognitive load—in moral judgment and behavior. We conduct experiments in three different countries (Sweden, Austria, and the United States) involving over 1,400 subjects. All subjects responded to four trolley type dilemmas and four dictator games involving different charitable causes. Decisions were made under time pressure/time delay or while experiencing cognitive load or control. Overall we find converging evidence that intuitive states do not influence moral decisions. Neither time-pressure nor cognitive load had any effect on moral judgments or altruistic behavior. Thus we find no supporting evidence for the claim that intuitive moral judgments and dictator game giving differ from more reflectively taken decisions. Across all samples and decision tasks men were more likely to make utilitarian moral judgments and act selfishly compared to women, providing further evidence that there are robust gender differences in moral decision-making. However, there were no significant interactions between gender and the treatment manipulations of intuitive versus reflective decision-making.
|
|
21. |
- Verschuere, Bruno, et al.
(författare)
-
Registered Replication Report on Mazar, Amir, and Ariely (2008)
- 2018
-
Ingår i: Advances in Methods and Practices in Psychological Science. - : SAGE Publications. - 2515-2459 .- 2515-2467. ; 1:3, s. 299-317
-
Tidskriftsartikel (refereegranskat)abstract
- The self-concept maintenance theory holds that many people will cheat in order to maximize self-profit, but only to the extent that they can do so while maintaining a positive self-concept. Mazar, Amir, and Ariely (2008, Experiment 1) gave participants an opportunity and incentive to cheat on a problem-solving task. Prior to that task, participants either recalled the Ten Commandments (a moral reminder) or recalled 10 books they had read in high school (a neutral task). Results were consistent with the self-concept maintenance theory. When given the opportunity to cheat, participants given the moral-reminder priming task reported solving 1.45 fewer matrices than did those given a neutral prime (Cohenâs d = 0.48); moral reminders reduced cheating. Mazar et al.âs article is among the most cited in deception research, but their Experiment 1 has not been replicated directly. This Registered Replication Report describes the aggregated result of 25 direct replications (total N = 5,786), all of which followed the same preregistered protocol. In the primary meta-analysis (19 replications, total n = 4,674), participants who were given an opportunity to cheat reported solving 0.11 more matrices if they were given a moral reminder than if they were given a neutral reminder (95% confidence interval = [−0.09, 0.31]). This small effect was numerically in the opposite direction of the effect observed in the original study (Cohen’s d = −0.04).
|
|