Keyboard Shortcuts?

×
  • Next step
  • Previous step
  • Skip this slide
  • Previous slide
  • mShow slide thumbnails
  • nShow notes
  • hShow handout latex source
  • NShow talk notes latex source

Click here and press the right key for the next slide (or swipe left)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

Two Kinds of Motivational State

motivational states

Preferences are one kind of motivational state. These states change under the influence of data-driven learning and fashion, among other things. I prefer chocolate over rhubarb right now, but might later have the reverse preference.
When we think about motivational states, the most familiar kind is ...

primary motivational states

not directly modifiable by learning

  • hunger
  • thirst
  • lust
  • disgust
  • ...
... preference. These states change over time in under the influence of learning (and fashion, ...) I prefer chocolate over rhubarb right now, but might later have the reverse preference.

preferences

changing, influenced by learning (and fashion, ...)

  • chocolate over rhubarb
  • lime over lemon
  • red over blue
  • ...
Another kind of motivational state is what animal learning theorists call ‘primary motivational states’.
These are not modifiable by data-driven learning (nor fashion), or at least not readily modifiable.
They inlcude hunger, thirst, lust and disgust.

Can your primary motivational states diverge from your preferences?

Premises

1. Toxicosis directly influences only primary motivational states.

2. Primary motivational states directly influence only stimulus-driven actions.

To a first approximation, the \emph{stimulus-driven} actions are those actions formed in the presence of stimuli because of the stimuli’s presence (not driven by representations of the stimulus).

 

You see a rat and a lever. The rat presses the lever occasionally. Now you start rewarding the rat: when it presses the lever it is rewarded with a particular kind of food. As a consequence, the rat presses the lever more often.
\subsection{Devaluation - standard procedure} \begin{itemize} \item Training: Rat is put in chamber with Lever; pressing Lever dispenses sucrose (novel food). \item Devaluation: Rat is taken into another chamber, poisoned, and then exposed to sucrose. \item Extinction Test: Rat returns to chamber with Lever; pressing Lever does nothing. \end{itemize}

Dickinson, 1985 figure 3; Balleine & Dickinson, 1991 figure 1 (part)

Devaluation - standard procedure:

Training: Rat is put in chamber with Lever; pressing Lever dispenses sucrose (novel food).

Devaluation: Rat is taken into another chamber, poisoned, and then exposed to sucrose.

Extinction Test: Rat returns to chamber with Lever; pressing Lever does nothing.

Dickinson, 1985 figure 3; Balleine & Dickinson, 1991 figure 1 (part)

‘Mean lever-press rates during the extinction (left-hand panel) and reacquisition tests (right-handpanel) followingthe devaluation of either the contingent (group D-N) or non-contingentfood (group N-D).’
‘Experiment I: Mean number of lever presses ... during the extinction test session ... The various groups received either immediate (Groups IMM/SUC and IMM/ H20) or delayed (Groups DELjSUC and DEL/H2O) toxicosis [delayed did not cause aversion] and were re-exposed either to the sucrose solution (Groups IMM/SUC and DEL/SUC) or to water (Groups IMM/H2O and DEL/H20).’
Pavlovain conditioning, primary motivational states can have a direct effect on actions.

Aversion does not directly influence preferences.

‘The pattern of results accords [...] with a role for an incentive learning process in the reinforcer devaluation effect;

not only must consumption of the reinforcer be paired with toxicosis,

the animals must also have an opportunity to contact the reinforcer after aversion conditioning if there is to be a change in instrumental performance’

\citep[p.~293]{balleine:1991_instrumental}

Balleine & Dickinson, 1991 p. 293

[To introduce the term ‘incentive learning’]
A moment ago I asked, What happens if we poison the subjects but do not re-expose them to the food?

Can your primary motivational states dissociate from your preferences?

The two kinds of motivational states can dissociate

motivational states

primary motivational states

not directly modifiable by learning

  • hunger
  • thirst
  • satiety
  • disgust
  • ...

preferences

changing, influenced by learning (and fashion, ...)

  • chocolate over rhubarb
  • lime over lemon
  • red over blue
  • ...