transformer generalization

Unexpected resultTechnologyOct 24, 2026

The Biased Dataset That Helped Some AI Models Learn the Real Rule

In a toy transformer task, skewed training data sometimes helped deeper models escape shortcuts, while smaller models stayed trapped.