Affective-Associative Two-Process theory: A neural network investigation of adaptive behaviour in differential outcomes training

• In this article we present a novel neural network implementation of Associative Two-Process (ATP) theory based on an Actor-Critic-like architecture. Our implementation emphasizes the affective components of differential reward magnitude and reward omission expectation and thus we model Affective-Associative Two-Process theory (Aff-ATP). ATP has been used to explain the findings of differential outcomes training (DOT) procedures, which emphasize learning differentially valuated outcomes for cueing actions previously associated with those outcomes. ATP hypothesizes the existence of a prospective' memory route through which outcome expectations can bring to bear on decision making and can even substitute for decision making based on the retrospective' inputs of standard working memory. While DOT procedures are well recognized in the animal learning literature they have not previously been computationally modelled. The model presented in this article helps clarify the role of ATP computationally through the capturing of empirical data based on DOT. Our Aff-ATP model illuminates the different roles that prospective and retrospective memory can have in decision making (combining inputs to action selection functions). In specific cases, the model's prospective route allows for adaptive switching (correct action selection prior to learning) following changes in the stimulus-response-outcome contingencies.

Ämnesord

SAMHÄLLSVETENSKAP  -- Annan samhällsvetenskap -- Tvärvetenskapliga studier inom samhällsvetenskap (hsv//swe)

SOCIAL SCIENCES  -- Other Social Sciences -- Social Sciences Interdisciplinary (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

SAMHÄLLSVETENSKAP  -- Psykologi (hsv//swe)

SOCIAL SCIENCES  -- Psychology (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datorseende och robotik (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Vision and Robotics (hsv//eng)

Nyckelord

Actor-Critic

reward learning

animal models

Associative-Two Process theory

neo-behaviourism

conditional discrimination performance

computational model

recognition

memory

decision-making

reward

expectancies

children

dopamine

amygdala

cortex

Computer Science

Psychology

Social Sciences - Other Topics

Actor-Critic

Interaction Lab (ILAB)

Publikations- och innehållstyp

ref (ämneskategori)

art (ämneskategori)