| 1. |
- Böhme, Rebecca, et al.
(författare)
-
Reversal learning strategy in adolescence is associated with prefrontal cortex activation
- 2017
-
Ingår i: European Journal of Neuroscience. - : WILEY-BLACKWELL. - 0953-816X .- 1460-9568. ; 45:1, s. 129-137
-
Tidskriftsartikel (refereegranskat)abstract
- Adolescence is a critical maturation period for human cognitive control and executive function. In this study, a large sample of adolescents (n=85) performed a reversal learning task during functional magnetic resonance imaging. We analyzed behavioral data using a reinforcement learning model to provide individually fitted parameters and imaging data with regard to reward prediction errors (PE). Following a model-based approach, we formed two groups depending on whether individuals tended to update expectations predominantly for the chosen stimulus or also for the unchosen one. These groups significantly differed in their problem behavior score obtained using the child behavior checklist (CBCL) and in a measure of their developmental stage. Imaging results showed that dorsolateral striatal areas covaried with PE. Participants who relied less on learning based on task structure showed less prefrontal activation compared with participants who relied more on task structure. An exploratory analysis revealed that PE-related activity was associated with pubertal development in prefrontal areas, insula and anterior cingulate. These findings support the hypothesis that the prefrontal cortex is implicated in mediating flexible goal-directed behavioral control.
|
|
| 2. |
- Gleich, Tobias, et al.
(författare)
-
Prefrontal and Striatal Glutamate Differently Relate to Striatal Dopamine : Potential Regulatory Mechanisms of Striatal Presynaptic Dopamine Function?
- 2015
-
Ingår i: Journal of Neuroscience. - : Society for Neuroscience. - 0270-6474 .- 1529-2401. ; 35:26, s. 9615-9621
-
Tidskriftsartikel (refereegranskat)abstract
- Theoretical and animal work has proposed that prefrontal cortex (PFC) glutamate inhibits dopaminergic inputs to the ventral striatum (VS) indirectly, whereas direct VS glutamatergic afferents have been suggested to enhance dopaminergic inputs to the VS. In the present study, we aimed to investigate relationships of glutamate and dopamine measures in prefrontostriatal circuitries of healthy humans. We hypothesized that PFC and VS glutamate, as well as their balance, are differently associated with VS dopamine. Glutamate concentrations in the left lateral PFC and left striatum were assessed using 3-Tesla proton magnetic resonance spectroscopy. Striatal presynaptic dopamine synthesis capacity was measured by fluorine-18-l-dihydroxyphenylalanine (F-18-FDOPA) positron emission tomography. First, a negative relationship was observed between glutamate concentrations in lateral PFC and VS dopamine synthesis capacity (n = 28). Second, a positive relationship was revealed between striatal glutamate and VS dopamine synthesis capacity (n = 26). Additionally, the intraindividual difference between PFC and striatal glutamate concentrations correlated negatively with VS dopamine synthesis capacity (n = 24). The present results indicate an involvement of a balance in PFC and striatal glutamate in the regulation of VS dopamine synthesis capacity. This notion points toward a potential mechanism how VS presynaptic dopamine levels are kept in a fine-tuned range. A disruption of this mechanism may account for alterations in striatal dopamine turnover as observed in mental diseases (e.g., in schizophrenia).SIGNIFICANCE STATEMENT The present work demonstrates complementary relationships between prefrontal and striatal glutamate and ventral striatal presynaptic dopamine using human imaging measures: a negative correlation between prefrontal glutamate and presynaptic dopamine and a positive relationship between striatal glutamate and presynaptic dopamine are revealed. The results may reflect a regulatory role of prefrontal and striatal glutamate for ventral striatal presynaptic dopamine levels. Such glutamate–dopamine relationships improve our understanding of neurochemical interactions in prefrontostriatal circuits and have implications for the neurobiology of mental disease.
|
|
| 3. |
- Böhme, Rebecca, et al.
(författare)
-
Aberrant Salience Is Related to Reduced Reinforcement Learning Signals and Elevated Dopamine Synthesis Capacity in Healthy Adults
- 2015
-
Ingår i: Journal of Neuroscience. - : Society for Neuroscience. - 0270-6474 .- 1529-2401. ; 35:28, s. 10103-10111
-
Tidskriftsartikel (refereegranskat)abstract
- The striatum is known to play a key role in reinforcement learning, specifically in the encoding of teaching signals such as reward prediction errors (RPEs). It has been proposed that aberrant salience attribution is associated with impaired coding of RPE and heightened dopamine turnover in the striatum, and might be linked to the development of psychotic symptoms. However, the relationship of aberrant salience attribution, RPE coding, and dopamine synthesis capacity has not been directly investigated. Here we assessed the association between a behavioral measure of aberrant salience attribution, the salience attribution test, to neural correlates of RPEs measured via functional magnetic resonance imaging while healthy participants (n = 58) performed an instrumental learning task. A subset of participants (n = 27) also underwent positron emission tomography with the radiotracer [18F]fluoro-l-DOPA to quantify striatal presynaptic dopamine synthesis capacity. Individual variability in aberrant salience measures related negatively to ventral striatal and prefrontal RPE signals and in an exploratory analysis was found to be positively associated with ventral striatal presynaptic dopamine levels. These data provide the first evidence for a specific link between the constructs of aberrant salience attribution, reduced RPE processing, and potentially increased presynaptic dopamine function.
|
|
| 4. |
- Deserno, Lorenz, et al.
(författare)
-
Reinforcement Learning and Dopamine in Schizophrenia : Dimensions of Symptoms or Specific Features of a Disease Group?
- 2013
-
Ingår i: Frontiers in Psychiatry. - Lausanne, Switzerland : Frontiers Research Foundation. - 1664-0640. ; 4
-
Forskningsöversikt (refereegranskat)abstract
- Abnormalities in reinforcement learning are a key finding in schizophrenia and have been proposed to be linked to elevated levels of dopamine neurotransmission. Behavioral deficits in reinforcement learning and their neural correlates may contribute to the formation of clinical characteristics of schizophrenia. The ability to form predictions about future outcomes is fundamental for environmental interactions and depends on neuronal teaching signals, like reward prediction errors. While aberrant prediction errors, that encode non-salient events as surprising, have been proposed to contribute to the formation of positive symptoms, a failure to build neural representations of decision values may result in negative symptoms. Here, we review behavioral and neuroimaging research in schizophrenia and focus on studies that implemented reinforcement learning models. In addition, we discuss studies that combined reinforcement learning with measures of dopamine. Thereby, we suggest how reinforcement learning abnormalities in schizophrenia may contribute to the formation of psychotic symptoms and may interact with cognitive deficits. These ideas point toward an interplay of more rigid versus flexible control over reinforcement learning. Pronounced deficits in the flexible or model-based domain may allow for a detailed characterization of well-established cognitive deficits in schizophrenia patients based on computational models of learning. Finally, we propose a framework based on the potentially crucial contribution of dopamine to dysfunctional reinforcement learning on the level of neural networks. Future research may strongly benefit from computational modeling but also requires further methodological improvement for clinical group studies. These research tools may help to improve our understanding of disease-specific mechanisms and may help to identify clinically relevant subgroups of the heterogeneous entity schizophrenia.
|
|
| 5. |
- Deserno, Lorenz, et al.
(författare)
-
Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making
- 2015
-
Ingår i: Proceedings of the National Academy of Sciences of the United States of America. - : National Academy of Sciences. - 0027-8424 .- 1091-6490. ; 112:5, s. 1595-1600
-
Tidskriftsartikel (refereegranskat)abstract
- Whether humans make choices based on a deliberative “model-based” or a reflexive “model-free” system of behavioral control remains an ongoing topic of research. Dopamine is implicated in motivational drive as well as in planning future actions. Here, we demonstrate that higher presynaptic dopamine in human ventral striatum is associated with more pronounced model-based behavioral control, as well as an enhanced coding of model-based signatures in lateral prefrontal cortex and diminished coding of model-free learning signals in ventral striatum. Our study links ventral striatal presynaptic dopamine to a balance between two distinct modes of behavioral control in humans. The findings have implications for neuropsychiatric diseases associated with alterations of dopamine neurotransmission and a disrupted balance of behavioral control.Dual system theories suggest that behavioral control is parsed between a deliberative “model-based” and a more reflexive “model-free” system. A balance of control exerted by these systems is thought to be related to dopamine neurotransmission. However, in the absence of direct measures of human dopamine, it remains unknown whether this reflects a quantitative relation with dopamine either in the striatum or other brain areas. Using a sequential decision task performed during functional magnetic resonance imaging, combined with striatal measures of dopamine using [18F]DOPA positron emission tomography, we show that higher presynaptic ventral striatal dopamine levels were associated with a behavioral bias toward more model-based control. Higher presynaptic dopamine in ventral striatum was associated with greater coding of model-based signatures in lateral prefrontal cortex and diminished coding of model-free prediction errors in ventral striatum. Thus, interindividual variability in ventral striatal presynaptic dopamine reflects a balance in the behavioral expression and the neural signatures of model-free and model-based control. Our data provide a novel perspective on how alterations in presynaptic dopamine levels might be accompanied by a disruption of behavioral control as observed in aging or neuropsychiatric diseases such as schizophrenia and addiction.
|
|
| 6. |
- Deserno, Lorenz, et al.
(författare)
-
Volatility Estimates Increase Choice Switching and Relate to Prefrontal Activity in Schizophrenia
- 2020
-
Ingår i: Biological Psychiatry. - : ELSEVIER. - 2451-9022. ; 5:2, s. 173-183
-
Tidskriftsartikel (refereegranskat)abstract
- BACKGROUND: Reward-based decision making is impaired in patients with schizophrenia (PSZ), as reflected by increased choice switching. The underlying cognitive and motivational processes as well as associated neural signatures remain unknown. Reinforcement learning and hierarchical Bayesian learning account for choice switching in different ways. We hypothesized that enhanced choice switching, as seen in PSZ during reward-based decision making, relates to higher-order beliefs about environmental volatility, and we examined the associated neural activity. METHODS: In total, 46 medicated PSZ and 43 healthy control subjects performed a reward-based decision-making task requiring flexible responses to changing action-outcome contingencies during functional magnetic resonance imaging. Detailed computational modeling of choice data was performed, including reinforcement learning and the hierarchical Gaussian filter. Trajectories of learning from computational modeling informed the analysis of functional magnetic resonance imaging data. RESULTS: A 3-level hierarchical Gaussian filter accounted best for the observed choice data. This model revealed a heightened initial belief about environmental volatility and a stronger influence of volatility on lower-level learning of action-outcome contingencies in PSZ as compared with healthy control subjects. This was replicated in an independent sample of nonmedicated PSZ. Beliefs about environmental volatility were reflected by higher activity in dorsolateral prefrontal cortex of PSZ as compared with healthy control subjects. CONCLUSIONS: Our study suggests that PSZ inferred the environment as overly volatile, which may explain increased choice switching. In PSZ, activity in dorsolateral prefrontal cortex was more strongly related to beliefs about environmental volatility. Our computational phenotyping approach may provide useful information to dissect clinical heterogeneity and could improve prediction of outcome.
|
|
| 7. |
- Nickchen, Katharina, et al.
(författare)
-
Reversal learning reveals cognitive deficits and altered prediction error encoding in the ventral striatum in Huntingtons disease
- 2017
-
Ingår i: Brain Imaging and Behavior. - : SPRINGER. - 1931-7557 .- 1931-7565. ; 11:6, s. 1862-1872
-
Tidskriftsartikel (refereegranskat)abstract
- Huntingtons disease (HD) is an autosomal dominant neurodegenerative condition characterized by a triad of movement disorder, neuropsychiatric symptoms and cognitive deficits. The striatum is particularly vulnerable to the effects of mutant huntingtin, and cell loss can already be found in presymptomatic stages. Since the striatum is well known for its role in reinforcement learning, we hypothesized to find altered behavioral and neural responses in HD patients in a probabilistic reinforcement learning task performed during functional magnetic resonance imaging. We studied 24 HD patients without central nervous system (CNS)-active medication and 25 healthy controls. Twenty HD patients and 24 healthy controls were able to complete the task. Computational modeling was used to calculate prediction error values and estimate individual parameters. We observed that gray matter density and prediction error signals during the learning task were related to disease stage. HD patients in advanced disease stages appear to use a less complex strategy in the reversal learning task. In contrast, HD patients in early disease stages show intact encoding of learning signals in the degenerating left ventral striatum. This effect appears to be lost with disease progression.
|
|
| 8. |
- Pankow, Anne, et al.
(författare)
-
Aberrant Salience Is Related to Dysfunctional Self-Referential Processing in Psychosis
- 2016
-
Ingår i: Schizophrenia Bulletin. - : Oxford University Press. - 0586-7614 .- 1745-1701. ; 42:1, s. 67-76
-
Tidskriftsartikel (refereegranskat)abstract
- Background. A dysfunctional differentiation between self-relevant and irrelevant information may affect the perception of environmental stimuli as abnormally salient. The aberrant salience hypothesis assumes that positive symptoms arise from an attribution of salience to irrelevant stimuli accompanied by the feeling of self-relevance. Self-referential processing relies on the activation of cortical midline structures which was demonstrated to be impaired in psychosis. We investigated the neural correlates of self-referential processing, aberrant salience attribution, and the relationship between these 2 measures across the psychosis continuum. Methods. Twenty-nine schizophrenia patients, 24 healthy individuals with subclinical delusional ideation, and 50 healthy individuals participated in this study. Aberrant salience was assessed behaviorally in terms of reaction times to task irrelevant cues. Participants performed a self-reference task during fMRI in which they had to apply neutral trait words to them or to a public figure. The correlation between self-referential processing and aberrant salience attribution was tested. Results. Schizophrenia patients displayed increased aberrant salience attribution compared with healthy controls and individuals with subclinical delusional ideation, while the latter exhibited intermediate aberrant salience scores. In the self-reference task, schizophrenia patients showed reduced activation in the ventromedial prefrontal cortex (vmPFC), but individuals with subclinical delusional ideation did not differ from healthy controls. In schizophrenia patients, vmPFC activation correlated negatively with implicit aberrant salience attribution. Conclusions. Higher aberrant salience attribution in schizophrenia patients is related to reduced vmPFC activation during self-referential judgments suggesting that aberrant relevance coding is reflected in decreased neural self-referential processing as well as in aberrant salience attribution.
|
|
