| 1. |
- Schweinsberg, Martin, et al.
(författare)
-
Same data, different conclusions : Radical dispersion in empirical results when independent analysts operationalize and test the same hypothesis
- 2021
-
Ingår i: Organizational Behavior and Human Decision Processes. - : Elsevier BV. - 0749-5978 .- 1095-9920. ; 165, s. 228-249
-
Tidskriftsartikel (refereegranskat)abstract
- In this crowdsourced initiative, independent analysts used the same dataset to test two hypotheses regarding the effects of scientists' gender and professional status on verbosity during group meetings. Not only the analytic approach but also the operationalizations of key variables were left unconstrained and up to individual analysts. For instance, analysts could choose to operationalize status as job title, institutional ranking, citation counts, or some combination. To maximize transparency regarding the process by which analytic choices are made, the analysts used a platform we developed called DataExplained to justify both preferred and rejected analytic paths in real time. Analyses lacking sufficient detail, reproducible code, or with statistical errors were excluded, resulting in 29 analyses in the final sample. Researchers reported radically different analyses and dispersed empirical outcomes, in a number of cases obtaining significant effects in opposite directions for the same research question. A Boba multiverse analysis demonstrates that decisions about how to operationalize variables explain variability in outcomes above and beyond statistical choices (e.g., covariates). Subjective researcher decisions play a critical role in driving the reported empirical results, underscoring the need for open data, systematic robustness checks, and transparency regarding both analytic paths taken and not taken. Implications for orga-nizations and leaders, whose decision making relies in part on scientific findings, consulting reports, and internal analyses by data scientists, are discussed.
|
|
| 2. |
- Thompson, Paul M., et al.
(författare)
-
The ENIGMA Consortium : large-scale collaborative analyses of neuroimaging and genetic data
- 2014
-
Ingår i: BRAIN IMAGING BEHAV. - : Springer Science and Business Media LLC. - 1931-7557 .- 1931-7565. ; 8:2, s. 153-182
-
Tidskriftsartikel (refereegranskat)abstract
- The Enhancing NeuroImaging Genetics through Meta-Analysis (ENIGMA) Consortium is a collaborative network of researchers working together on a range of large-scale studies that integrate data from 70 institutions worldwide. Organized into Working Groups that tackle questions in neuroscience, genetics, and medicine, ENIGMA studies have analyzed neuroimaging data from over 12,826 subjects. In addition, data from 12,171 individuals were provided by the CHARGE consortium for replication of findings, in a total of 24,997 subjects. By meta-analyzing results from many sites, ENIGMA has detected factors that affect the brain that no individual site could detect on its own, and that require larger numbers of subjects than any individual neuroimaging study has currently collected. ENIGMA's first project was a genome-wide association study identifying common variants in the genome associated with hippocampal volume or intracranial volume. Continuing work is exploring genetic associations with subcortical volumes (ENIGMA2) and white matter microstructure (ENIGMA-DTI). Working groups also focus on understanding how schizophrenia, bipolar illness, major depression and attention deficit/hyperactivity disorder (ADHD) affect the brain. We review the current progress of the ENIGMA Consortium, along with challenges and unexpected discoveries made on the way.
|
|
| 3. |
- Blösch, Günter, et al.
(författare)
-
Twenty-three unsolved problems in hydrology (UPH) - a community perspective
- 2019
-
Ingår i: Hydrological Sciences Journal. - : Informa UK Limited. - 0262-6667 .- 2150-3435. ; 64:10, s. 1141-1158
-
Tidskriftsartikel (refereegranskat)abstract
- This paper is the outcome of a community initiative to identify major unsolved scientific problems in hydrology motivated by a need for stronger harmonisation of research efforts. The procedure involved a public consultation through online media, followed by two workshops through which a large number of potential science questions were collated, prioritised, and synthesised. In spite of the diversity of the participants (230 scientists in total), the process revealed much about community priorities and the state of our science: a preference for continuity in research questions rather than radical departures or redirections from past and current work. Questions remain focused on the process-based understanding of hydrological variability and causality at all space and time scales. Increased attention to environmental change drives a new emphasis on understanding how change propagates across interfaces within the hydrological system and across disciplinary boundaries. In particular, the expansion of the human footprint raises a new set of questions related to human interactions with nature and water cycle feedbacks in the context of complex water management problems. We hope that this reflection and synthesis of the 23 unsolved problems in hydrology will help guide research efforts for some years to come.
|
|
| 4. |
- Sumaila, U. Rashid, et al.
(författare)
-
WTO must ban harmful fisheries subsidies
- 2021
-
Ingår i: Science. - : American Association for the Advancement of Science (AAAS). - 0036-8075 .- 1095-9203. ; 374:6567, s. 544-544
-
Tidskriftsartikel (övrigt vetenskapligt/konstnärligt)
|
|
| 5. |
- ODonnell, Michael, et al.
(författare)
-
Registered Replication Report: Dijksterhuis and van Knippenberg (1998)
- 2018
-
Ingår i: Perspectives on Psychological Science. - : SAGE PUBLICATIONS LTD. - 1745-6916 .- 1745-6924. ; 13:2, s. 268-294
-
Tidskriftsartikel (refereegranskat)abstract
- Dijksterhuis and van Knippenberg (1998) reported that participants primed with a category associated with intelligence (professor) subsequently performed 13% better on a trivia test than participants primed with a category associated with a lack of intelligence (soccer hooligans). In two unpublished replications of this study designed to verify the appropriate testing procedures, Dijksterhuis, van Knippenberg, and Holland observed a smaller difference between conditions (2%-3%) as well as a gender difference: Men showed the effect (9.3% and 7.6%), but women did not (0.3% and -0.3%). The procedure used in those replications served as the basis for this multilab Registered Replication Report. A total of 40 laboratories collected data for this project, and 23 of these laboratories met all inclusion criteria. Here we report the meta-analytic results for those 23 direct replications (total N = 4,493), which tested whether performance on a 30-item general-knowledge trivia task differed between these two priming conditions (results of supplementary analyses of the data from all 40 labs, N = 6,454, are also reported). We observed no overall difference in trivia performance between participants primed with the professor category and those primed with the hooligan category (0.14%) and no moderation by gender.
|
|
| 6. |
- Karyotaki, Eirini, et al.
(författare)
-
Internet-Based Cognitive Behavioral Therapy for Depression : A Systematic Review and Individual Patient Data Network Meta-analysis
- 2021
-
Ingår i: JAMA psychiatry. - : American Medical Association. - 2168-6238 .- 2168-622X. ; 78:4, s. 361-371
-
Forskningsöversikt (refereegranskat)abstract
- IMPORTANCE: Personalized treatment choices would increase the effectiveness of internet-based cognitive behavioral therapy (iCBT) for depression to the extent that patients differ in interventions that better suit them.OBJECTIVE: To provide personalized estimates of short-term and long-term relative efficacy of guided and unguided iCBT for depression using patient-level information.DATA SOURCES: We searched PubMed, Embase, PsycInfo, and Cochrane Library to identify randomized clinical trials (RCTs) published up to January 1, 2019.STUDY SELECTION: Eligible RCTs were those comparing guided or unguided iCBT against each other or against any control intervention in individuals with depression. Available individual patient data (IPD) was collected from all eligible studies. Depression symptom severity was assessed after treatment, 6 months, and 12 months after randomization.DATA EXTRACTION AND SYNTHESIS: We conducted a systematic review and IPD network meta-analysis and estimated relative treatment effect sizes across different patient characteristics through IPD network meta-regression.MAIN OUTCOMES AND MEASURES: Patient Health Questionnaire-9 (PHQ-9) scores.RESULTS: Of 42 eligible RCTs, 39 studies comprising 9751 participants with depression contributed IPD to the IPD network meta-analysis, of which 8107 IPD were synthesized. Overall, both guided and unguided iCBT were associated with more effectiveness as measured by PHQ-9 scores than control treatments over the short term and the long term. Guided iCBT was associated with more effectiveness than unguided iCBT (mean difference [MD] in posttreatment PHQ-9 scores, -0.8; 95% CI, -1.4 to -0.2), but we found no evidence of a difference at 6 or 12 months following randomization. Baseline depression was found to be the most important modifier of the relative association for efficacy of guided vs unguided iCBT. Differences between unguided and guided iCBT in people with baseline symptoms of subthreshold depression (PHQ-9 scores 5-9) were small, while guided iCBT was associated with overall better outcomes in patients with baseline PHQ-9 greater than 9.CONCLUSIONS AND RELEVANCE: In this network meta-analysis with IPD, guided iCBT was associated with more effectiveness than unguided iCBT for individuals with depression, benefits were more substantial in individuals with moderate to severe depression. Unguided iCBT was associated with similar effectiveness among individuals with symptoms of mild/subthreshold depression. Personalized treatment selection is entirely possible and necessary to ensure the best allocation of treatment resources for depression.
|
|
| 7. |
- Furukawa, Toshi A., et al.
(författare)
-
Dismantling, optimising, and personalising internet cognitive behavioural therapy for depression : a systematic review and component network meta-analysis using individual data
- 2021
-
Ingår i: Lancet psychiatry. - London, United Kingdom : Elsevier. - 2215-0374 .- 2215-0366. ; 8:6, s. 500-511
-
Forskningsöversikt (refereegranskat)abstract
- Findings We identified 76 RCTs, including 48 trials contributing individual participant data (11 704 participants) and 28 trials with aggregate data (6474 participants). The participants' weighted mean age was 42.0 years and 12 406 (71%) of 17 521 reported were women. There was suggestive evidence that behavioural activation might be beneficial (iMD -1.83 [95% credible interval (CrI) -2.90 to -0.80]) and that relaxation might be harmful (1.20 [95% CrI 0.17 to 2.27]). Baseline severity emerged as the strongest prognostic factor for endpoint depression. Combining human and automated encouragement reduced dropouts from treatment (incremental odds ratio, 0.32 [95% CrI 0.13 to 0.93]). The risk of bias was low for the randomisation process, missing outcome data, or selection of reported results in most of the included studies, uncertain for deviation from intended interventions, and high for measurement of outcomes. There was moderate to high heterogeneity among the studies and their components. 511
|
|
| 8. |
- Scott, Kirk, et al.
(författare)
-
Repeat Immigration: A Previously Unobserved Source of Heterogeneity?
- 2017
-
Ingår i: Scandinavian Journal of Public Health. - : SAGE Publications. - 1651-1905 .- 1403-4948. ; 45:Suppl 17, s. 25-29
-
Tidskriftsartikel (refereegranskat)abstract
- AIMS:Register data allow for nuanced analyses of heterogeneities between sub-groups which are not observable in other data sources. One heterogeneity for which register data is particularly useful is in identifying unique migration histories of immigrant populations, a group of interest across disciplines. Years since migration is a commonly used measure of integration in studies seeking to understand the outcomes of immigrants. This study constructs detailed migration histories to test whether misclassified migrations may mask important heterogeneities. In doing so, we identify a previously understudied group of migrants called repeat immigrants, and show that they differ systematically from permanent immigrants. In addition, we quantify the degree to which migration information is misreported in the registers.METHOD:The analysis is carried out in two steps. First, we estimate income trajectories for repeat immigrants and permanent immigrants to understand the degree to which they differ. Second, we test data validity by cross-referencing migration information with changes in income to determine whether there are inconsistencies indicating misreporting.RESULTS:From the first part of the analysis, the results indicate that repeat immigrants systematically differ from permanent immigrants in terms of income trajectories. Furthermore, income trajectories differ based on the way in which years since migration is calculated. The second part of the analysis suggests that misreported migration events, while present, are negligible.CONCLUSIONS:Repeat immigrants differ in terms of income trajectories, and may differ in terms of other outcomes as well. Furthermore, this study underlines that Swedish registers provide a reliable data source to analyze groups which are unidentifiable in other data sources.
|
|
| 9. |
- Smyth, Joshua M., et al.
(författare)
-
Everyday stress response targets in the science of behavior change
- 2018
-
Ingår i: Behaviour Research and Therapy. - : Elsevier. - 0005-7967 .- 1873-622X. ; 101, s. 20-29
-
Tidskriftsartikel (refereegranskat)abstract
- Stress is an established risk factor for negative health outcomes, and responses to everyday stress can interfere with health behaviors such as exercise and sleep. In accordance with the Science of Behavior Change (SOBC) program, we apply an experimental medicine approach to identifying stress response targets, developing stress response assays, intervening upon these targets, and testing intervention effectiveness. We evaluate an ecologically valid, within-person approach to measuring the deleterious effects of everyday stress on physical activity and sleep patterns, examining multiple stress response components (i.e., stress reactivity, stress recovery, and stress pile-up) as indexed by two key response indicators (negative affect and perseverative cognition). Our everyday stress response assay thus measures multiple malleable stress response targets that putatively shape daily health behaviors (physical activity and sleep). We hypothesize that larger reactivity, incomplete recovery, and more frequent stress responses (pile-up) will negatively impact health behavior enactment in daily life. We will identify stress-related reactivity, recovery, and response in the indicators using coordinated analyses across multiple naturalistic studies. These results are the basis for developing a new stress assay and replicating the initial findings in a new sample. This approach will advance our understanding of how specific aspects of everyday stress responses influence health behaviors, and can be used to develop and test an innovative ambulatory intervention for stress reduction in daily life to enhance health behaviors. (C) 2017 Elsevier Ltd. All rights reserved.
|
|
| 10. |
- Zawadzki, Matthew J., et al.
(författare)
-
Understanding stress reports in daily life : a coordinated analysis of factors associated with the frequency of reporting stress
- 2019
-
Ingår i: Journal of behavioral medicine. - : Springer. - 0160-7715 .- 1573-3521. ; 42:3, s. 545-560
-
Tidskriftsartikel (refereegranskat)abstract
- Although stress is a common experience in everyday life, a clear understanding of how often an individual experiences and reports stress is lacking. Notably, there is little information regarding factors that may influence how frequently stress is reported, including which stress dimension is measured (i.e., stressorsdid an event happen, subjective stresshow stressed do you feel, conditional stresshow stressful a stressor was) and the temporal features of that assessment (i.e., time of day, day of study, weekday vs. weekend day). The purpose of the present study was to conduct a coordinated analysis of five independent ecological momentary assessment studies utilizing varied stress reporting dimensions and temporal features. Results indicated that, within days, stress was reported at different frequencies depending on the stress dimension. Stressors were reported on 15-32% of momentary reports made within a day; across days, the frequency ranged from 42 to 76% of days. Depending on the cutoff, subjective stress was reported more frequently ranging about 8-56% of all moments within days, and 40-90% of days. Likewise, conditional stress ranged from just 3% of moments to 22%, and 11-69% of days. For the temporal features, stress was reported more frequently on weekdays (compared to weekend days) and on days earlier in the study (relative to days later in the study); time of day was inconsistently related to stress reports. In sum, stress report frequency depends in part on how stress is assessed. As such, researchers may wish to measure stress in multiple ways and, in the case of subjective and conditional stress with multiple operational definitions, to thoroughly characterize the frequency of stress reporting.
|
|
