| 1. |
- Ebersole, Charles R., et al.
(författare)
-
Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
- 2020
-
Ingår i: Advances in Methods and Practices in Psychological Science. - : Sage. - 2515-2467 .- 2515-2459. ; 3:3, s. 309-331
-
Tidskriftsartikel (refereegranskat)abstract
- Replication studies in psychological science sometimes fail to reproduce prior findings. If these studies use methods that are unfaithful to the original study or ineffective in eliciting the phenomenon of interest, then a failure to replicate may be a failure of the protocol rather than a challenge to the original finding. Formal pre-data-collection peer review by experts may address shortcomings and increase replicability rates. We selected 10 replication studies from the Reproducibility Project: Psychology (RP:P; Open Science Collaboration, 2015) for which the original authors had expressed concerns about the replication designs before data collection; only one of these studies had yielded a statistically significant effect (p < .05). Commenters suggested that lack of adherence to expert review and low-powered tests were the reasons that most of these RP:P studies failed to replicate the original effects. We revised the replication protocols and received formal peer review prior to conducting new replication studies. We administered the RP:P and revised protocols in multiple laboratories (median number of laboratories per original study = 6.5, range = 3-9; median total sample = 1,279.5, range = 276-3,512) for high-powered tests of each original finding with both protocols. Overall, following the preregistered analysis plan, we found that the revised protocols produced effect sizes similar to those of the RP:P protocols (Delta r = .002 or .014, depending on analytic approach). The median effect size for the revised protocols (r = .05) was similar to that of the RP:P protocols (r = .04) and the original RP:P replications (r = .11), and smaller than that of the original studies (r = .37). Analysis of the cumulative evidence across the original studies and the corresponding three replication attempts provided very precise estimates of the 10 tested effects and indicated that their effect sizes (median r = .07, range = .00-.15) were 78% smaller, on average, than the original effect sizes (median r = .37, range = .19-.50).
|
|
| 2. |
- Jones, Benedict C, et al.
(författare)
-
To which world regions does the valence-dominance model of social perception apply?
- 2021
-
Ingår i: Nature Human Behaviour. - : Springer Science and Business Media LLC. - 2397-3374. ; 5:1, s. 159-169
-
Tidskriftsartikel (refereegranskat)abstract
- Over the past 10 years, Oosterhof and Todorov's valence-dominance model has emerged as the most prominent account of how people evaluate faces on social dimensions. In this model, two dimensions (valence and dominance) underpin social judgements of faces. Because this model has primarily been developed and tested in Western regions, it is unclear whether these findings apply to other regions. We addressed this question by replicating Oosterhof and Todorov's methodology across 11 world regions, 41 countries and 11,570 participants. When we used Oosterhof and Todorov's original analysis strategy, the valence-dominance model generalized across regions. When we used an alternative methodology to allow for correlated dimensions, we observed much less generalization. Collectively, these results suggest that, while the valence-dominance model generalizes very well across regions when dimensions are forced to be orthogonal, regional differences are revealed when we use different extraction methods and correlate and rotate the dimension reduction solution. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 5 November 2018. The protocol, as accepted by the journal, can be found at https://doi.org/10.6084/m9.figshare.7611443.v1 .
|
|
| 3. |
- ODonnell, Michael, et al.
(författare)
-
Registered Replication Report: Dijksterhuis and van Knippenberg (1998)
- 2018
-
Ingår i: Perspectives on Psychological Science. - : SAGE PUBLICATIONS LTD. - 1745-6916 .- 1745-6924. ; 13:2, s. 268-294
-
Tidskriftsartikel (refereegranskat)abstract
- Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (professor) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (soccer hooligans). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the professor category and those primed with the hooligan category (0.14%) and no moderation by gender.
|
|
| 4. |
- Anderson, Christopher J., et al.
(författare)
-
Response to Comment on "Estimating the reproducibility of psychological science"
- 2016
-
Ingår i: Science. - : American Association for the Advancement of Science (AAAS). - 0036-8075 .- 1095-9203. ; 351:6277
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)abstract
- Gilbert et al. conclude that evidence from the Open Science Collaboration's Reproducibility Project: Psychology indicates high reproducibility, given the study methodology. Their very optimistic assessment is limited by statistical misconceptions and by causal inferences from selectively interpreted, correlational data. Using the Reproducibility Project: Psychology data, both optimistic and pessimistic conclusions about reproducibility are possible, and neither are yet warranted.
|
|
| 5. |
- Moshontz, Hannah, et al.
(författare)
-
The Psychological Science Accelerator: Advancing Psychology Through a Distributed Collaborative Network
- 2018
-
Ingår i: Advances in Methods and Practices in Psychological Science. - : SAGE Publications. - 2515-2459 .- 2515-2467. ; 1:4, s. 501-515
-
Tidskriftsartikel (refereegranskat)abstract
- Concerns about the veracity of psychological research have been growing. Many findings in psychological science are based on studies with insufficient statistical power and nonrepresentative samples, or may otherwise be limited to specific, ungeneralizable settings or populations. Crowdsourced research, a type of large-scale collaboration in which one or more research projects are conducted across multiple lab sites, offers a pragmatic solution to these and other current methodological challenges. The Psychological Science Accelerator (PSA) is a distributed network of laboratories designed to enable and support crowdsourced research projects. These projects can focus on novel research questions or replicate prior research in large, diverse samples. The PSA’s mission is to accelerate the accumulation of reliable and generalizable evidence in psychological science. Here, we describe the background, structure, principles, procedures, benefits, and challenges of the PSA. In contrast to other crowdsourced research networks, the PSA is ongoing (as opposed to time limited), efficient (in that structures and principles are reused for different projects), decentralized, diverse (in both subjects and researchers), and inclusive (of proposals, contributions, and other relevant input from anyone inside or outside the network). The PSA and other approaches to crowdsourced psychological science will advance understanding of mental processes and behaviors by enabling rigorous research and systematic examination of its generalizability.
|
|
| 6. |
- Chapple, Christopher R, et al.
(författare)
-
Multicriteria Decision Analysis Applied to the Clinical Use of Pharmacotherapy for Overactive Bladder Symptom Complex
- 2020
-
Ingår i: European urology focus. - : Elsevier BV. - 2405-4569. ; 6:3, s. 522-530
-
Tidskriftsartikel (refereegranskat)abstract
- The nonspecific storage symptom complex overactive bladder (OAB) is an important clinical condition in functional urology. Until recently, pharmacological therapy comprised antimuscarinic drugs, but more recently beta 3 agonists have added to the available agents. Traditional reporting of efficacy and safety of these agents relies upon regulatory placebo-controlled studies. There remains no head-to-head comparison of existing agents in the contemporary literature. Contemporary conclusions on comparative efficacy and safety drawn from the use of these agents are based on systematic reviews of the literature and associated meta-analyses.In this study, we used the analytical model of multicriteria decision analysis (MCDA) to compare contemporary pharmacotherapy for OAB.Efficacy and safety data from published, randomised, placebo-controlled trials of antimuscarinic antagonists, the beta 3 agonist, and the combination of an antimuscarinic and beta 3 agonist were used to populate the MCDA model.Experts assessed weights of the relative importance of favourable and unfavourable effects, which provided a common measure of benefits and safety that were combined in the MCDA model to give an overall ranking of the OAB drugs.When benefits are judged as more important than safety, fesoterodine 4 or 8mg used in a flexible dosing pattern provides the most favourable therapeutic option, over a wide sensitivity analysis relating to benefits and harms.In our analysis using an MCDA model, in both the flexible dosing pattern of fesoterodine and the solifenacin combination with mirabegron, the benefit-safety balance is better in terms of benefits and/or safety than any of the other available OAB drugs. Caution in interpretation of the data has to be expressed as the fesoterodine data are based on a flexible dosing regimen, which adds an additional dimension of personalising therapy.Overactive bladder (OAB) is a common condition with a significant impact on the quality of life. Possible symptoms include the following: (1) urgency-a compelling desire to urinate, which is difficult to defer; (2) urgency urinary incontinence-urgency leading to incontinence episodes; (3) frequency-increased frequency of wanting to pass urine; and (4) nocturia-increase in instances of getting up at night to urinate. To date, the mainstay of therapy for OAB has been antimuscarinic drugs and, more recently, the beta 3 agonist mirabegron. Ten international experts in urology, obstetrics, gynaecology, healthy ageing, and data analysis compared the benefit-risk balance of 14 OAB drugs licensed in Europe. The experts considered the importance of a favourable effect on the above four symptoms and also potential for side effects, but only three of these side effects, constipation, dry mouth, and dizziness, showed clinically relevant differences among the six drugs they considered. The observations recorded here suggest interesting differences between drugs across a wide range of possible trade-offs between benefit and safety. The different recruitment criteria used for each study may influence the results seen, so they need to be treated with caution. Comparison of flexibly dosed fesoterodine studies with fixed-dose fesoterodine studies introduces an additional potential bias; definitive conclusions can be drawn only if enough comparable placebo-controlled flexible dosing studies with other drugs were available.
|
|
