dezfouli_2019_models
N = 101 participants (34 healthy, 34 unipolar depression, 33 bipolar depression) completed a two-armed bandit instrumental learning task across 12 blocks with varying reward probabilities (0.25/0.125/0.08 vs 0.05). On each trial, participants chose left (R1) or right (R2) buttons for food rewards. The dataset covers 132,251 trials. The paper fits RNN, Q-learning variants (QL, QLP, GQL), and logistic regression models to compare learning strategies and predict diagnostic labels across groups.
Responses
132,251
13,115 held out
CORE effects
–
no effects simulated
CORE test NLL (avg)
0.256
rank 3 of 7 models
Best model
CORE (no phonemes)
test NLL (avg) 0.248
Likelihood of human responses
| model | PNLL | test NLL (avg) | test responses | train NLL (avg) | train responses |
|---|---|---|---|---|---|
| CORE | 3,355.6 | 0.2559 | 13,115 | 0.2785 | 119,136 |
| CORE (no prediction errors) | 3,363.7 | 0.2565 | 13,115 | 0.2815 | 119,136 |
| CORE (no phonemes) best | 3,252.7 | 0.2480 | 13,115 | 0.2740 | 119,136 |
| CORE (no forgetting) | 3,671.5 | 0.2799 | 13,115 | 0.3057 | 119,136 |
| CORE (no hierarchy) | 3,832.3 | 0.2922 | 13,115 | 0.3295 | 119,136 |
| Transformer | 3,596.3 | 0.2742 | 13,115 | 0.3026 | 119,136 |
| Centaur | 3,300.4 | 0.2516 | 13,115 | – | – |
Experiments
| exp | task class | participants | responses | conditions | simulated | effects |
|---|---|---|---|---|---|---|
| exp0 | TwoArmedBandit | 101 | 132,251 | 1 | no | – |
Behavioral effects
No behavioral effects were simulated for this study.
Transcript
You see two buttons side by side: a left button and a right button. Your task is to press one button on each trial to try to earn food rewards. On a trial, press the left button by typing L, or the right button by typing R. Pressing a button sometimes earns you a food reward (an M&M chocolate or a BBQ-flavoured cracker) and sometimes earns you nothing. The chance of earning a reward from each button changes from time to time, so pay attention to what happens and try to earn as many rewards as you can. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press R. You earn a food reward. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You earn a food reward. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press R. You receive nothing. You press R. You earn a food reward. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press R. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You earn a food reward. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing. You press L. You receive nothing.