levering_2019_revisiting

category-learning psych-101

One between-subjects category-learning experiment (N = 270; 144 LS, 126 NLS participants) comparing a linearly separable (LS) and a nonlinearly separable (NLS) category structure, a conceptual replication of Medin & Schwanenflugel (1981). In each session, 25 training blocks present randomly selected exemplars requiring an Alpha/Beta category-membership classification with accuracy feedback and RT per trial, followed by a single-exemplar typicality-rating test (classify then rate 1–9) and a paired-exemplar typicality-choice test. The authors test whether NLS structures are as easy to learn as LS structures and compare human learning curves to ALCOVE, SUSTAIN, PROTO-ALCOVE, and DIVA cognitive models, finding NLS categories easier to learn and prototype (PROTO-ALCOVE) accounts incompatible with the observed data.

Responses
44,280
4,428 held out
CORE effects
–
no effects simulated
CORE test NLL (avg)
0.486
rank 2 of 7 models
Best model
CORE (no phonemes)
test NLL (avg) 0.473

Likelihood of human responses

modelPNLLtest NLL (avg)test responses train NLL (avg)train responses
CORE2,152.90.48624,4280.399839,852
CORE (no prediction errors)2,158.60.48754,4280.398839,852
CORE (no phonemes) best2,096.20.47344,4280.388739,852
CORE (no forgetting)2,196.50.49614,4280.421039,852
CORE (no hierarchy)2,821.40.63724,4280.601539,852
Transformer2,285.90.51624,4280.434639,852
Centaur2,182.50.49294,428––

Experiments

exptask classparticipantsresponsesconditionssimulatedeffects
exp0CategoryLearning27044,2802no–

Behavioral effects

No behavioral effects were simulated for this study.

Transcript

You will learn to classify geometric shapes into two categories, Alpha and Beta. Each shape has three features: Shape, Color, and Size, each taking value 1 or 2. On each trial, a shape appears and you decide which category it belongs to: press A for Alpha or B for Beta. After each answer you are told whether you were correct. You train over 25 blocks, each covering all six training shapes once.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to B. Incorrect. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to A. Incorrect. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A. Correct. The correct category was Alpha.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B. Correct. The correct category was Beta.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A. Correct. The correct category was Alpha.
The training phase is over and the test begins. You see each of the eight possible shapes (the six trained shapes plus two new ones). For each shape, first classify it: press A for Alpha or B for Beta. Then rate how typical that shape is of its category on a scale from 1 (not typical) to 9 (highly typical), typing one of 1, 2, 3, 4, 5, 6, 7, 8, or 9. No feedback is given.
You see a shape with Shape 1, Color 1, Size 2. You decide it belongs to A.
You rate its typicality: 5.
You see a shape with Shape 2, Color 2, Size 2. You decide it belongs to A.
You rate its typicality: 3.
You see a shape with Shape 1, Color 1, Size 1. You decide it belongs to B.
You rate its typicality: 5.
You see a shape with Shape 2, Color 2, Size 1. You decide it belongs to B.
You rate its typicality: 8.
You see a shape with Shape 1, Color 2, Size 1. You decide it belongs to A.
You rate its typicality: 9.
You see a shape with Shape 2, Color 1, Size 2. You decide it belongs to A.
You rate its typicality: 4.
You see a shape with Shape 2, Color 1, Size 1. You decide it belongs to B.
You rate its typicality: 3.
You see a shape with Shape 1, Color 2, Size 2. You decide it belongs to B.
You rate its typicality: 5.
Finally you see pairs of shapes. For each pair, decide which shape is more typical of its category: press A to pick the first shape or B to pick the second.
You see a shape with Shape 2, Color 2, Size 2 and a shape with Shape 2, Color 2, Size 1. You judge the more typical shape is B (the second).
You see a shape with Shape 2, Color 1, Size 1 and a shape with Shape 1, Color 1, Size 1. You judge the more typical shape is A (the first).
You see a shape with Shape 1, Color 2, Size 2 and a shape with Shape 2, Color 2, Size 2. You judge the more typical shape is A (the first).
You see a shape with Shape 2, Color 2, Size 2 and a shape with Shape 2, Color 1, Size 2. You judge the more typical shape is B (the second).
You see a shape with Shape 1, Color 1, Size 1 and a shape with Shape 1, Color 1, Size 2. You judge the more typical shape is B (the second).
You see a shape with Shape 1, Color 1, Size 1 and a shape with Shape 1, Color 2, Size 1. You judge the more typical shape is B (the second).