Sökning: onr:"swepub:oai:DiVA.org:kth-331435" >
Reinforcement learn...
Reinforcement learning in a spiking neural model of striatum plasticity
-
- González-Redondo, Álvaro (författare)
- Research Centre for Information and Communications Technologies (CITIC-UGR), University of Granada, Calle Periodista Rafael Gómez Montero 2, E18071 Granada, Spain
-
- Garrido, Jesús (författare)
- Research Centre for Information and Communications Technologies (CITIC-UGR), University of Granada, Calle Periodista Rafael Gómez Montero 2, E18071 Granada, Spain
-
- Naveros Arrabal, Francisco (författare)
- Research Centre for Information and Communications Technologies (CITIC-UGR), University of Granada, Calle Periodista Rafael Gómez Montero 2, E18071 Granada, Spain
-
visa fler...
-
- Hellgren Kotaleski, Jeanette (författare)
- KTH,Beräkningsvetenskap och beräkningsteknik (CST)
-
- Grillner, Sten (författare)
- Department of Neuroscience, Karolinska Institute, Stockholm SE-17165, Sweden
-
- Ros, Eduardo (författare)
- Research Centre for Information and Communications Technologies (CITIC-UGR), University of Granada, Calle Periodista Rafael Gómez Montero 2, E18071 Granada, Spain
-
visa färre...
-
(creator_code:org_t)
- Elsevier BV, 2023
- 2023
- Engelska.
-
Ingår i: Neurocomputing. - : Elsevier BV. - 0925-2312 .- 1872-8286. ; 548
- Relaterad länk:
-
https://doi.org/10.1...
-
visa fler...
-
https://urn.kb.se/re...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- The basal ganglia (BG), and more specifically the striatum, have long been proposed to play an essential role in action-selection based on a reinforcement learning (RL) paradigm. However, some recent findings, such as striatal spike-timing-dependent plasticity (STDP) or striatal lateral connectivity, require further research and modelling as their respective roles are still not well understood. Theoretical models of spiking neurons with homeostatic mechanisms, lateral connectivity, and reward-modulated STDP have demonstrated a remarkable capability to learn sensorial patterns that statistically correlate with a rewarding signal. In this article, we implement a functional and biologically inspired network model of the striatum, where learning is based on a previously proposed learning rule called spike-timing-dependent eligibility (STDE), which captures important experimental features in the striatum. The proposed computational model can recognize complex input patterns and consistently choose rewarded actions to respond to such sensorial inputs. Moreover, we assess the role different neuronal and network features, such as homeostatic mechanisms and lateral inhibitory connections, play in action-selection with the proposed model. The homeostatic mechanisms make learning more robust (in terms of suitable parameters) and facilitate recovery after rewarding policy swapping, while lateral inhibitory connections are important when multiple input patterns are associated with the same rewarded action. Finally, according to our simulations, the optimal delay between the action and the dopaminergic feedback is obtained around 300 ms, as demonstrated in previous studies of RL and in biological studies.
Ämnesord
- MEDICIN OCH HÄLSOVETENSKAP -- Medicinska och farmaceutiska grundvetenskaper -- Neurovetenskaper (hsv//swe)
- MEDICAL AND HEALTH SCIENCES -- Basic Medicine -- Neurosciences (hsv//eng)
- NATURVETENSKAP -- Data- och informationsvetenskap -- Bioinformatik (hsv//swe)
- NATURAL SCIENCES -- Computer and Information Sciences -- Bioinformatics (hsv//eng)
Nyckelord
- Dopamine
- Eligibility trace
- Reinforcement learning
- Spike-timing-dependent plasticity
- Spiking neural network
- Striatum
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas