Keyboard Shortcuts?f

×
  • Next step
  • Previous step
  • Skip this slide
  • Previous slide
  • mShow slide thumbnails
  • tShow transcript (+SHIFT = all transcript)
  • nShow notes (+SHIFT = all notes)

Please be cautious in using the transcripts.

They were created mechanically and have mostly not been checked or revised.

Here is how they were created:

  1. live lecture recorded;
  2. machine transcription of live recording;
  3. ask LLM to clean up transcript, and link to individual slides.

This is an error-prone process.

Click here and press the right key for the next slide.

(This may not work on mobile or ipad. You can try using chrome or firefox, but even that may fail. Sorry.)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

Goal-Directed and Habitual Processes

insert-transcript#3452425f-b374-46b5-9281-3f3199ccefb1-here
Here is an alternative to the Simple Picture and the story about intention we were just telling ...
Start with a simple history ... this might explain why you press a button now.
insert-transcript#a60e3c1c-be47-4fdd-82cf-3a8940834f15-here

‘instrumental behavior is controlled by two dissociable processes: a goal-directed and an habitual process’

‘an action is goal-directed if it is mediated by
the interaction of
a representation of the causal relationship between the action and outcome
and
a representation of the current incentive value, or utility, of the outcome
in a way that rationalizes the action’ Dickinson (2016, p. 177).

belief desire

insert-transcript#87c29fa4-febf-4a17-bdc6-3241d6abb18b-here

stimulus action outcome

a → b = a follows b

may be rewarding; if it is ...
When the action is performed in the presence of the simulus, the connection is strengthened (or ‘reinforced’) if the action is rewarded.
If the connection is strong enough, the presence of the stimulus will cause the action to occur.

habitual process

Action occurs in the presence of Stimulus.

Outcome follows action

Agent is thereby rewarded

Stimulus-Action Link is strengthened due to reward

Given Stimulus, will Action occur? It depends on the strength of the Stimulus-Action Link.

Let’s check we all understand the key terms here.
Action may be a complex, coordinated instrumental action, such as pressing a lever.

‘goal-directed’ process

Action leads to Outcome.
 

Belief in Action-Outcome link is strengthened.

Agent has a Desire for the Outcome
 

Will Action occur? It depends on the Belief in the Action-Outcome Link and Agent’s Desire.

insert-transcript#40922fd9-0ca1-4664-9586-7fa29f18a5ce-here

What is the relation between an instrumental action and the outcome (or outcomes) to which it is directed?

light
smoke
open
pour
tilt
soak
scare
freak out
fill
intention or habitual process
or ???
coordinates
specifies
So I am going to try to show that it can be habitual processes, not just intentions.
On the face of it this may be puzzling given that I have been emphasizing that, in the case of habitual processes, the outcome only matters because it generates a history of rewards.
It is the stimulus–action link that matters for habitual processes, not any intention about an outcomes.
So how could the action be directed to a particular outcome in virtue of an habitual process?
insert-transcript#7572afc9-e3e3-48e2-b4a7-f619d518e3e9-here
Can make it a bit more intuitive by returning to an action that is clearly instrumental.
Snack machine from earlier: example of instrument action was pressing a lever to get a snack.
Now I want to say that this kind of behaviour can be explained in humans by habitual processes. We will see evidence concerning this next week.

What is the relation between an instrumental action and the outcome (or outcomes) to which it is directed?

An instrumental action is an action that happens in order to bring about an outcome.
insert-transcript#4c7c6e5b-22b9-44a9-84c3-36bae9376489-here

What is the relation between an instrumental action and the outcome or outcomes to which it is directed?

habitual

The outcome is related to the action via their history.

Action was caused by stimulus–action link

Stimulus–action link exists because of a rewarding Outcome in the past

Habitual processes exist to enable the agent to bring such Outcomes about.

goal-directed

The outcome is related to the action via an intention.

The intention specifies an outcome.

The intention causes the actions in a way that would normally increase the probability of the specified outcome ocurring.

insert-transcript#5d03a80e-2264-4860-a64a-74201f7deb73-here

What is the relation between an instrumental action and the outcome (or outcomes) to which it is directed?

light
smoke
open
pour
tilt
soak
scare
freak out
fill
intention or habitual process
or ???
coordinates
specifies