| 1. |
- Botvinik-Nezer, Rotem, et al.
(författare)
-
Variability in the analysis of a single neuroimaging dataset by many teams
- 2020
-
Ingår i: Nature. - : Springer Science and Business Media LLC. - 0028-0836 .- 1476-4687. ; 582, s. 84-88
-
Tidskriftsartikel (refereegranskat)abstract
- Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses(1). The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset(2-5). Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed. The results obtained by seventy different teams analysing the same functional magnetic resonance imaging dataset show substantial variation, highlighting the influence of analytical choices and the importance of sharing workflows publicly and performing multiple analyses.
|
|
| 2. |
- Jones, Benedict C, et al.
(författare)
-
To which world regions does the valence-dominance model of social perception apply?
- 2021
-
Ingår i: Nature Human Behaviour. - : Springer Science and Business Media LLC. - 2397-3374. ; 5:1, s. 159-169
-
Tidskriftsartikel (refereegranskat)abstract
- Over the past 10 years, Oosterhof and Todorov's valence-dominance model has emerged as the most prominent account of how people evaluate faces on social dimensions. In this model, two dimensions (valence and dominance) underpin social judgements of faces. Because this model has primarily been developed and tested in Western regions, it is unclear whether these findings apply to other regions. We addressed this question by replicating Oosterhof and Todorov's methodology across 11 world regions, 41 countries and 11,570 participants. When we used Oosterhof and Todorov's original analysis strategy, the valence-dominance model generalized across regions. When we used an alternative methodology to allow for correlated dimensions, we observed much less generalization. Collectively, these results suggest that, while the valence-dominance model generalizes very well across regions when dimensions are forced to be orthogonal, regional differences are revealed when we use different extraction methods and correlate and rotate the dimension reduction solution. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on 5 November 2018. The protocol, as accepted by the journal, can be found at https://doi.org/10.6084/m9.figshare.7611443.v1 .
|
|
| 3. |
- Menkveld, Albert J., et al.
(författare)
-
Nonstandard Errors
- 2024
-
Ingår i: JOURNAL OF FINANCE. - : Wiley-Blackwell. - 0022-1082 .- 1540-6261. ; 79:3, s. 2339-2390
-
Tidskriftsartikel (refereegranskat)abstract
- In statistics, samples are drawn from a population in a data-generating process (DGP). Standard errors measure the uncertainty in estimates of population parameters. In science, evidence is generated to test hypotheses in an evidence-generating process (EGP). We claim that EGP variation across researchers adds uncertainty-nonstandard errors (NSEs). We study NSEs by letting 164 teams test the same hypotheses on the same data. NSEs turn out to be sizable, but smaller for more reproducible or higher rated research. Adding peer-review stages reduces NSEs. We further find that this type of uncertainty is underestimated by participants.
|
|
| 4. |
- Malbet, F., et al.
(författare)
-
Faint objects in motion: the new frontier of high precision astrometry
- 2021
-
Ingår i: Experimental Astronomy. - : Springer Science and Business Media LLC. - 0922-6435 .- 1572-9508. ; 51:3, s. 845-886
-
Tidskriftsartikel (refereegranskat)abstract
- Sky survey telescopes and powerful targeted telescopes play complementary roles in astronomy. In order to investigate the nature and characteristics of the motions of very faint objects, a flexibly-pointed instrument capable of high astrometric accuracy is an ideal complement to current astrometric surveys and a unique tool for precision astrophysics. Such a space-based mission will push the frontier of precision astrometry from evidence of Earth-mass habitable worlds around the nearest stars, to distant Milky Way objects, and out to the Local Group of galaxies. As we enter the era of the James Webb Space Telescope and the new ground-based, adaptive-optics-enabled giant telescopes, by obtaining these high precision measurements on key objects that Gaia could not reach, a mission that focuses on high precision astrometry science can consolidate our theoretical understanding of the local Universe, enable extrapolation of physical processes to remote redshifts, and derive a much more consistent picture of cosmological evolution and the likely fate of our cosmos. Already several missions have been proposed to address the science case of faint objects in motion using high precision astrometry missions: NEAT proposed for the ESA M3 opportunity, micro-NEAT for the S1 opportunity, and Theia for the M4 and M5 opportunities. Additional new mission configurations adapted with technological innovations could be envisioned to pursue accurate measurements of these extremely small motions. The goal of this White Paper is to address the fundamental science questions that are at stake when we focus on the motions of faint sky objects and to briefly review instrumentation and mission profiles.
|
|
| 5. |
- Andrighetto, Giulia, et al.
(författare)
-
Changes in social norms during the early stages of the COVID-19 pandemic across 43 countries
- 2024
-
Ingår i: Nature Communications. - : NATURE PORTFOLIO. - 2041-1723. ; 15:1
-
Tidskriftsartikel (refereegranskat)abstract
- The emergence of COVID-19 dramatically changed social behavior across societies and contexts. Here we study whether social norms also changed. Specifically, we study this question for cultural tightness (the degree to which societies generally have strong norms), specific social norms (e.g. stealing, hand washing), and norms about enforcement, using survey data from 30,431 respondents in 43 countries recorded before and in the early stages following the emergence of COVID-19. Using variation in disease intensity, we shed light on the mechanisms predicting changes in social norm measures. We find evidence that, after the emergence of the COVID-19 pandemic, hand washing norms increased while tightness and punishing frequency slightly decreased but observe no evidence for a robust change in most other norms. Thus, at least in the short term, our findings suggest that cultures are largely stable to pandemic threats except in those norms, hand washing in this case, that are perceived to be directly relevant to dealing with the collective threat. Tightness-looseness theory predicts that social norms strengthen following threat. Here the authors test this and find that, after the emergence of the COVID-19 pandemic, hand washing norms increased, but no evidence was observed for a robust change in most other norms.
|
|
| 6. |
- Antov, Dago, et al.
(författare)
-
European road users' risk perception and mobility : the SARTRE 4 survey
- 2012
-
Rapport (övrigt vetenskapligt/konstnärligt)abstract
- The SARTRE (Social Attitudes to Road Traffic Risk in Europe) project started in 1991. It consists of a European wide survey about knowledge of road traffic laws and road traffic risks, attitudes regarding road safety issues, reported road traffic behaviours, transport habits and needs in several European countries. Various topics related to road safety are in the focus of the project such as alcohol, drugs, or phone use while driving, speeding, use of advanced driver assistance systems and the transport infrastructure and environment.
|
|
