Keyboard Shortcuts?f

×
  • →Next step
  • ←Previous step
  • ↓Skip this slide
  • ↑Previous slide
  • mShow slide thumbnails
  • tShow transcript (+SHIFT = all transcript)
  • nShow notes (+SHIFT = all notes)

Please be cautious in using the transcripts.

They were created mechanically and have mostly not been checked or revised.

Here is how they were created:

  1. live lecture recorded;
  2. machine transcription of live recording;
  3. ask LLM to clean up transcript, and link to individual slides.

This is an error-prone process.

Click here and press the right key for the next slide.

(This may not work on mobile or ipad. You can try using chrome or firefox, but even that may fail. Sorry.)

also ...

Press the left key to go backwards (or swipe right)

Press n to toggle whether notes are shown (or add '?notes' to the url before the #)

Press m or double tap to slide thumbnails (menu)

Press ? at any time to show the keyboard shortcuts

 

Goal-Directed and Habitual: Some Evidence

insert-transcript#5614b34b-2ea2-4501-8abd-8e68b4b7b95c-here

‘instrumental behavior itself involves two systems, the goal-directed and the habitual’

(Dickinson & Pérez, 2018, p. 12)

prediction?

insert-transcript#048e6373-de89-4344-b99f-5561268a2f03-here
We are intervening on the cognitive load (stress), so we would expect ...
insert-transcript#eada30dd-2b25-4ab6-a050-e606cb604926-here
... lower influence from goal-directed processes that without the intevention
insert-transcript#d9ce2528-f4eb-417e-8b2c-337fb4ea4e32-here

‘instrumental behavior itself involves two systems, the goal-directed and the habitual’

(Dickinson & Pérez, 2018, p. 12)

prediction?

prediction: increasing stress will reduce the influence of your preferences

Evidence: Schwabe & Wolf, 2010

insert-transcript#7dbb5aef-7449-4a38-b4f1-a54a8e3a0a1a-here

Schwabe and Wolf, 2010 figure 1

‘Figure 1. (A) Time line of the experiment. Participants were first trained in the instrumental task. After the selective outcome devaluation (satiation with oranges or chocolate pudding) but before the extinction test, subjects were exposed to stress (socially evaluated cold pressor test) or a control condition. (B) The instrumental task (reproduced with permission from the Society for Neuroscience). Participants completed three trial types (chocolate, orange, and neutral). In each trial type, there was one action that led with a high probability to a food outcome and one action that led with a low probability to a food outcome. Depending on the trial type, the high probability action yielded chocolate milk or orange juice with a probability of p = 0.5, a common outcome (peppermint tea) with a probability of p = 0.2, or nothing. The low probability action led to the common liquid with a probability of p = 0.2. After an action was chosen, the referring symbol was highlighted for 3 s before the food was delivered. During the extinction test, chocolate milk and orange juice were no longer presented.’
insert-transcript#844fade8-5191-4e17-bf39-f49495ed243a-here

Schwabe & Wolf (2010, p. figure 6)

‘Figure 6. Percent high probability actions of controls and stressed participants in the last 15-trial block of training and the first 15-trial block of extinction testing. After selective outcome devaluation, controls showed a decrease in the choice of the high probability action associated with the food eaten to satiety (* p < .01) whereas the choice behavior of stressed participants was insensitive to the changes in outcome value. Data represent M ± SEM.’

When stressed,

your preferences matter less:

habitual processes dominate.

Student Q: How do we know participants are actually stressed?
Schwabe & Wolf (2010) measured three indicators of stress, subjective stress ratings, blood pressure and (most importantly) cortisol levels. They found that responses consistent with the domination of habitual processes were statistically related to cortisol levels.
‘Interestingly, the increase in salivary cortisol from immediately before to 20 min after the SECPT exposure correlated significantly with the number of devalued high probability choices in the SECPT group $(r=0.57,p<.01)$ indicating that higher cortisol responses to the SECPT were associated with more habitual behavior.’
insert-transcript#8f6df945-3091-4d08-8728-0c23b251a9d0-here
[student q in transcript 8f6df945-3091-4d08-8728-0c23b251a9d0 is answered in notes in previous slides]

How is this evidence for the dual-process theory of instrumental action?

insert-transcript#d879e7e5-c26c-4913-b092-a4431ad8d479-here
We are intervening on the cognitive load (stress), so we would expect ...
insert-transcript#30038130-1e73-4114-ae16-b824b4a1019e-here
Lower influence from goal-directed processes that without the intevention
insert-transcript#fdb14113-830b-4892-a53b-99b4d1e3d671-here
But how does this lead to the prediction that preferences will matter less?
insert-transcript#7a7d0806-aced-4c4f-8a66-250bc7ce47cc-here
[SKIP THIS SECTION UNLESS SOMEONE ASKS]

How exactly do we derive that prediction?

I.e. the prediction that cognitive load will selectively hinder the goal-directed process.

Having two processes
allows you to make complementary
speed–accuracy trade-offs:
habitual processes are fast but limited, whereas goal-directed processes are more flexible but slower

Any broadly computational system will face ...
insert-transcript#9fea11e0-66d1-471a-b942-413e341163ff-here
We are intervening on the cognitive load (stress), so we would expect ...
insert-transcript#4a56f954-2b6d-4925-a817-cecce8113c27-here
Lower influence from goal-directed processes that without the intevention
insert-transcript#e5fe6913-3b66-4e4c-aee9-e2d16b35ca96-here
But how does this lead to the prediction that preferences will matter less?
insert-transcript#80a22279-9962-4c05-89ad-149122393b24-here

more evidence

neurophysiology

insert-transcript#03281213-8735-4dd1-bf1d-613e776fc4a0-here

‘[instumental] and habitual control have been doubly dissociated in two brain regions.

In the PFC, lesions of the prelimbic and infralimbic areas disrupt goal-directed and habitual behavior, respectively ...

prelimbic cortex is part of dmPFC (dorsomedial prefrontal cortex)
infralimbic cortex is part of vmPFC (ventromedial prefrontal cortex)

These dissociations suggest that different neural circuits mediate the two forms of control’

(Dickinson, 2016, p. 184)

insert-transcript#a8c37ba8-9c48-47ef-936e-155bfb90b4cf-here

conclusion - three bits of evidence

  • cognitive load (via stress) - Schwabe & Wolf (2010)
  • [representation of contingency - Klossek, Yu, & Dickinson (2011)]
  • neurophysiology - Dickinson (2016)
    • skipped the evidence about representation of contingency this year.