| 1. |
- Botvinik-Nezer, Rotem, et al.
(författare)
-
Variability in the analysis of a single neuroimaging dataset by many teams
- 2020
-
Ingår i: Nature. - : Springer Science and Business Media LLC. - 0028-0836 .- 1476-4687. ; 582, s. 84-88
-
Tidskriftsartikel (refereegranskat)abstract
- Data analysis workflows in many scientific domains have become increasingly complex and flexible. Here we assess the effect of this flexibility on the results of functional magnetic resonance imaging by asking 70 independent teams to analyse the same dataset, testing the same 9 ex-ante hypotheses(1). The flexibility of analytical approaches is exemplified by the fact that no two teams chose identical workflows to analyse the data. This flexibility resulted in sizeable variation in the results of hypothesis tests, even for teams whose statistical maps were highly correlated at intermediate stages of the analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Notably, a meta-analytical approach that aggregated information across teams yielded a significant consensus in activated regions. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset(2-5). Our findings show that analytical flexibility can have substantial effects on scientific conclusions, and identify factors that may be related to variability in the analysis of functional magnetic resonance imaging. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for performing and reporting multiple analyses of the same data. Potential approaches that could be used to mitigate issues related to analytical variability are discussed. The results obtained by seventy different teams analysing the same functional magnetic resonance imaging dataset show substantial variation, highlighting the influence of analytical choices and the importance of sharing workflows publicly and performing multiple analyses.
|
|
| 2. |
- Haugg, Amelie, et al.
(författare)
-
Can we predict real-time fMRI neurofeedback learning success from pretraining brain activity?
- 2020
-
Ingår i: Human Brain Mapping. - : Wiley. - 1065-9471 .- 1097-0193. ; 41:14, s. 3839-3854
-
Tidskriftsartikel (refereegranskat)abstract
- Neurofeedback training has been shown to influence behavior in healthy participants as well as to alleviate clinical symptoms in neurological, psychosomatic, and psychiatric patient populations. However, many real-time fMRI neurofeedback studies report large inter-individual differences in learning success. The factors that cause this vast variability between participants remain unknown and their identification could enhance treatment success. Thus, here we employed a meta-analytic approach including data from 24 different neurofeedback studies with a total of 401 participants, including 140 patients, to determine whether levels of activity in target brain regions during pretraining functional localizer or no-feedback runs (i.e., self-regulation in the absence of neurofeedback) could predict neurofeedback learning success. We observed a slightly positive correlation between pretraining activity levels during a functional localizer run and neurofeedback learning success, but we were not able to identify common brain-based success predictors across our diverse cohort of studies. Therefore, advances need to be made in finding robust models and measures of general neurofeedback learning, and in increasing the current study database to allow for investigating further factors that might influence neurofeedback learning.
|
|
| 3. |
- Haugg, Amelie, et al.
(författare)
-
Predictors of real-time fMRI neurofeedback performance and improvement - A machine learning mega-analysis.
- 2021
-
Ingår i: NeuroImage. - : Elsevier. - 1053-8119 .- 1095-9572. ; 237
-
Tidskriftsartikel (refereegranskat)abstract
- Real-time fMRI neurofeedback is an increasingly popular neuroimaging technique that allows an individual to gain control over his/her own brain signals, which can lead to improvements in behavior in healthy participants as well as to improvements of clinical symptoms in patient populations. However, a considerably large ratio of participants undergoing neurofeedback training do not learn to control their own brain signals and, consequently, do not benefit from neurofeedback interventions, which limits clinical efficacy of neurofeedback interventions. As neurofeedback success varies between studies and participants, it is important to identify factors that might influence neurofeedback success. Here, for the first time, we employed a big data machine learning approach to investigate the influence of 20 different design-specific (e.g. activity vs. connectivity feedback), region of interest-specific (e.g. cortical vs. subcortical) and subject-specific factors (e.g. age) on neurofeedback performance and improvement in 608 participants from 28 independent experiments. With a classification accuracy of 60% (considerably different from chance level), we identified two factors that significantly influenced neurofeedback performance: Both the inclusion of a pre-training no-feedback run before neurofeedback training and neurofeedback training of patients as compared to healthy participants were associated with better neurofeedback performance. The positive effect of pre-training no-feedback runs on neurofeedback performance might be due to the familiarization of participants with the neurofeedback setup and the mental imagery task before neurofeedback training runs. Better performance of patients as compared to healthy participants might be driven by higher motivation of patients, higher ranges for the regulation of dysfunctional brain signals, or a more extensive piloting of clinical experimental paradigms. Due to the large heterogeneity of our dataset, these findings likely generalize across neurofeedback studies, thus providing guidance for designing more efficient neurofeedback studies specifically for improving clinical neurofeedback-based interventions. To facilitate the development of data-driven recommendations for specific design details and subpopulations the field would benefit from stronger engagement in open science research practices and data sharing.
|
|
