💬Emergent Abilities
Also known as Emergent Ability, Emergent Abilities of LLMs, Emergence (LLM)
Skills that seem to pop up all at once when a model gets big.
Think of it like
It is like water that gets colder and colder. Nothing seems to change, then all at once it is ice.
Example
A small model gets every three-step sum wrong. A model many times its size gets most of them right. That kind of jump was called emergent.
Why it matters
If skills can jump, a bigger model may surprise the people who made it. That is one reason labs test each new size with care.
Definition
Common mistake
Key takeaways
- 1A sudden jump. Missing in small models, there in large ones.
- 2Hard to predict. Small models give no warning.
- 3Maybe the marking. Part credit can show smooth growth.