garcia_2023_experiential

bandit psych-101

Across 9 experiments (N = 102-128 each), participants performed a two-option reinforcement-learning task contrasting experiential options (learned through feedback) with symbolic options (described by explicit probabilities), in either interleaved or blocked designs. Each trial recorded a binary choice between the two options, reaction time, and reward outcome, with phases tagged LE (experiential learning only), ES (experiential vs symbolic), EE (experiential vs experiential), SP (symbolic-only probability estimation), and condition-specific deactivate-option variants (exps 6-7). The research question asks whether experiential values are underweighted when options also carry symbolic/described information, which the paper tests with Q-learning and logistic choice models; the reproduced headline effects are experiential learning accuracy (LE > chance), accuracy rising with decision value, and reduced probability of choosing the experiential option as the symbolic option's expected value rises.

Responses
398,157
40,735 held out
CORE effects
–
no effects simulated
CORE test NLL (avg)
0.343
rank 2 of 7 models
Best model
CORE (no phonemes)
test NLL (avg) 0.341

Likelihood of human responses

modelPNLLtest NLL (avg)test responses train NLL (avg)train responses
CORE13,955.30.342640,7350.3191357,422
CORE (no prediction errors)14,170.80.347940,7350.3227357,422
CORE (no phonemes) best13,885.10.340940,7350.3129357,422
CORE (no forgetting)14,463.30.355140,7350.3324357,422
CORE (no hierarchy)19,090.10.468640,7350.4516357,422
Transformer17,733.90.435340,7350.4142357,422
Centaur18,073.20.443740,735––

Experiments

exptask classparticipantsresponsesconditionssimulatedeffects
exp0GarciaExperiential12325,8501no–
exp1GarciaExperiential11625,1311no–
exp2GarciaExperiential11225,6941no–
exp3GarciaExperiential12322,0021no–
exp4GarciaExperiential11236,9451no–
exp5GarciaExperiential12869,2361no–
exp6GarciaExperiential11669,2321no–
exp7GarciaExperiential11869,1151no–
exp8GarciaExperiential10254,9521no–

Behavioral effects

No behavioral effects were simulated for this study.

Transcript

Welcome. In this decision-making task, each trial presents options that can win or lose you points. Options are of three kinds: experiential symbols (numbered; you learn their value from the outcomes they deliver; each session uses a new set of symbols), symbolic lotteries (a pie chart stating an explicit win probability), and ambiguous options (value hidden). In choice phases you are shown two options: press A to choose option 1, or press B to choose option 2.
Option 1 (experiential symbol 1) is on the right; option 2 (experiential symbol 5) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 1) is on the left; option 2 (experiential symbol 5) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 3) is on the left; option 2 (experiential symbol 4) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 7) is on the left; option 2 (experiential symbol 6) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 7) is on the right; option 2 (experiential symbol 6) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 8) is on the right; option 2 (experiential symbol 2) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 8) is on the right; option 2 (experiential symbol 2) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 3) is on the left; option 2 (experiential symbol 4) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 8) is on the right; option 2 (experiential symbol 2) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 7) is on the right; option 2 (experiential symbol 6) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 3) is on the left; option 2 (experiential symbol 4) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 1) is on the right; option 2 (experiential symbol 5) is on the left. You press A. You win 1 point.
This phase shows one experiential symbol and one symbolic lottery; choose the option you prefer. Outcomes are not shown in this phase, but your choices still count toward your points.
Option 1 (experiential symbol 2) is on the left; option 2 (a symbolic lottery with a 10% win probability) is on the right. You press A.
Option 1 (experiential symbol 6) is on the left; option 2 (a symbolic lottery with a 20% win probability) is on the right. You press A.
Option 1 (experiential symbol 1) is on the left; option 2 (a symbolic lottery with a 0% win probability) is on the right. You press A.
Option 1 (a symbolic lottery with a 80% win probability) is on the left; option 2 (a symbolic lottery with a 20% win probability) is on the right. You press A.
Option 1 (experiential symbol 1) is on the right; option 2 (a symbolic lottery with a 20% win probability) is on the left. You press A.
Option 1 (experiential symbol 7) is on the right; option 2 (a symbolic lottery with a 0% win probability) is on the left. You press A.
Option 1 (experiential symbol 3) is on the right; option 2 (a symbolic lottery with a 0% win probability) is on the left. You press A.
Option 1 (a symbolic lottery with a 60% win probability) is on the left; option 2 (a symbolic lottery with a 40% win probability) is on the right. You press A.
Option 1 (experiential symbol 3) is on the left; option 2 (a symbolic lottery with a 10% win probability) is on the right. You press A.
Option 1 (experiential symbol 2) is on the right; option 2 (a symbolic lottery with a 0% win probability) is on the left. You press A.
Option 1 (experiential symbol 5) is on the right; option 2 (a symbolic lottery with a 20% win probability) is on the left. You press A.
Option 1 (experiential symbol 8) is on the right; option 2 (a symbolic lottery with a 20% win probability) is on the left. You press A.
This phase shows one option at a time. Report your estimate of its win probability as a number from 0 to 100 in steps of 5 (0, 5, 10, 15, 20, 25, 30, 35, 40, 45, 50, 55, 60, 65, 70, 75, 80, 85, 90, 95 or 100). The outcome of your answer is not shown.
You are shown one option: experiential symbol 7. You report your estimate of its win probability (0 to 100): 50.
You are shown one option: experiential symbol 5. You report your estimate of its win probability (0 to 100): 65.
You are shown one option: a symbolic lottery with a 10% win probability. You report your estimate of its win probability (0 to 100): 10.
You are shown one option: a symbolic lottery with a 0% win probability. You report your estimate of its win probability (0 to 100): 0.
You are shown one option: experiential symbol 8. You report your estimate of its win probability (0 to 100): 45.
You are shown one option: experiential symbol 3. You report your estimate of its win probability (0 to 100): 65.
This phase shows two experiential symbols; you learn which one is better from the outcomes they give you.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You win 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press B. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You lose 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the right; option 2 (experiential symbol 14) is on the left. You press B. You win 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 16) is on the left; option 2 (experiential symbol 9) is on the right. You press A. You lose 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 11) is on the left; option 2 (experiential symbol 14) is on the right. You press A. You win 1 point.
Option 1 (experiential symbol 13) is on the right; option 2 (experiential symbol 10) is on the left. You press B. You lose 1 point.
Option 1 (experiential symbol 13) is on the left; option 2 (experiential symbol 10) is on the right. You press B. You win 1 point.
Option 1 (experiential symbol 12) is on the right; option 2 (experiential symbol 15) is on the left. You press A. You lose 1 point.
Option 1 (experiential symbol 16) is on the right; option 2 (experiential symbol 9) is on the left. You press A. You win 1 point.
Option 1 (experiential symbol 12) is on the left; option 2 (experiential symbol 15) is on the right. You press A. You win 1 point.