steingroever_2015_data

iowa-gambling-task psych-101

This data-pooling paper benchmarks healthy adult Iowa Gambling Task (IGT) performance across 10 independent studies, providing a "super control group" of N=617 participants. The data are trial-level: on each of 95–150 trials participants choose one of four decks (A–D) and receive win/loss feedback; the choice and resulting win and loss amounts are recorded per trial, along with a subject-to-study index. The three experiment files correspond to the three trial-count groups: exp0 (95 trials, N=15, all from Fridberg), exp1 (100 trials, N=504, from Horstmann/Kjome/Maia/Premkumar/SteingroverInPrep/Wood/Worthy), and exp2 (150 trials, N=98, from Steingroever2011/Wetzels). The dataset supports benchmarking healthy IGT performance and computational model-comparison of decision-making under uncertainty.

Responses
66,525
6,750 held out
CORE effects
2 / 2
CORE test NLL (avg)
0.852
rank 1 of 7 models
Best model
CORE
test NLL (avg) 0.852

Likelihood of human responses

modelPNLLtest NLL (avg)test responses train NLL (avg)train responses
CORE best5,752.70.85236,7500.906459,775
CORE (no prediction errors)5,779.90.85636,7500.915059,775
CORE (no phonemes)5,774.50.85556,7500.908159,775
CORE (no forgetting)5,878.40.87096,7500.929459,775
CORE (no hierarchy)6,461.70.95736,7501.047559,775
Transformer6,202.50.91896,7500.981559,775
Centaur5,756.10.85286,750––

Experiments

exptask classparticipantsresponsesconditionssimulatedeffects
exp0IowaGamblingTask151,4251no–
exp1IowaGamblingTask50450,4001yesigt_learning_net_score_increase, igt_learning_advantageous_late_blocks
exp2IowaGamblingTask9814,7001no–

Behavioral effects

effectexperimentpaperCORECORE (no prediction errors)CORE (no phonemes)CORE (no forgetting)CORE (no hierarchy)
igt_learning_net_score_increaseexp1–✓ yes
+4.012
✓ yes
+3.242
✓ yes
+3.734
✓ yes
+3.591
✓ yes
+4.278
igt_learning_advantageous_late_blocksexp1–✓ yes
+2.254
✓ yes
+1.480
✓ yes
+1.778
✓ yes
+1.524
✓ yes
+0.881

Transcript

You are taking part in the Iowa gambling task. You are given a loan of $2000 in play money. In front of you are four decks of cards, labeled A, B, C, and D. On each trial you pick one card from one of the four decks by pressing the letter of that deck: A, B, C, or D. After each choice you win some money, and sometimes you also lose some money. Some decks are better overall than others. Your goal is to win as much money as possible, so choose the decks you think are best.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 0.
You pick deck B. You win 100; you lose 1250.
You pick deck A. You win 100; you lose 0.
You pick deck A. You win 100; you lose 0.
You pick deck A. You win 100; you lose 150.
You pick deck C. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck A. You win 100; you lose 0.
You pick deck A. You win 100; you lose 300.
You pick deck C. You win 50; you lose 0.
You pick deck C. You win 50; you lose 50.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck A. You win 100; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck A. You win 100; you lose 200.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck A. You win 100; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck A. You win 100; you lose 250.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck A. You win 100; you lose 350.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck A. You win 100; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck A. You win 100; you lose 350.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 250.
You pick deck D. You win 50; you lose 0.
You pick deck D. You win 50; you lose 0.