| 1. |
- Botvinik-Nezer, Rotem, et al.
(author)
-
Variability in the analysis of a single neuroimaging dataset by many teams
- 2020
-
In: Nature. - : Springer Science and Business Media LLC. - 0028-0836 .- 1476-4687. ; 582, s. 84-88
-
Journal article (peer-reviewed)abstract
- Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses(1). The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset(2-5). Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed. The results obtained by seventy different teams analysing the same functional magnetic resonance imaging dataset show substantial variation, highlighting the influence of analytical choices and the importance of sharing workflows publicly and performing multiple analyses.
|
|
| 2. |
- Weinstein, John N., et al.
(author)
-
The cancer genome atlas pan-cancer analysis project
- 2013
-
In: Nature Genetics. - : Springer Science and Business Media LLC. - 1061-4036 .- 1546-1718. ; 45:10, s. 1113-1120
-
Research review (peer-reviewed)abstract
- The Cancer Genome Atlas (TCGA) Research Network has profiled and analyzed large numbers of human tumors to discover molecular aberrations at the DNA, RNA, protein and epigenetic levels. The resulting rich data provide a major opportunity to develop an integrated picture of commonalities, differences and emergent themes across tumor lineages. The Pan-Cancer initiative compares the first 12 tumor types profiled by TCGA. Analysis of the molecular aberrations and their functional roles across tumor types will teach us how to extend therapies effective in one cancer type to others with a similar genomic profile. © 2013 Nature America, Inc. All rights reserved.
|
|
| 3. |
- Witt, Suzanne T., et al.
(author)
-
What Executive Function Network is that? An Image-Based Meta-Analysis of Network Labels
- 2021
-
In: Brain Topography. - : Springer Nature. - 0896-0267 .- 1573-6792. ; 34:5, s. 598-607
-
Journal article (peer-reviewed)abstract
- The current state of label conventions used to describe brain networks related to executive functions is highly inconsistent, leading to confusion among researchers regarding network labels. Visually similar networks are referred to by different labels, yet these same labels are used to distinguish networks within studies. We performed a literature review of fMRI studies and identified nine frequently-used labels that are used to describe topographically or functionally similar neural networks: central executive network (CEN), cognitive control network (CCN), dorsal attention network (DAN), executive control network (ECN), executive network (EN), frontoparietal network (FPN), working memory network (WMN), task positive network (TPN), and ventral attention network (VAN). Our aim was to meta-analytically determine consistency of network topography within and across these labels. We hypothesized finding considerable overlap in the spatial topography among the neural networks associated with these labels. An image-based meta-analysis was performed on 158 group-level statistical maps (SPMs) received from authors of 69 papers listed on PubMed. Our results indicated that there was very little consistency in the SPMs labeled with a given network name. We identified four clusters of SPMs representing four spatially distinct executive function networks. We provide recommendations regarding label nomenclature and propose that authors looking to assign labels to executive function networks adopt this template set for labeling networks.
|
|
