💬Decoder (Transformer)
Also known as Decoder, Decoder-Only Model
The part of a transformer that writes. It adds one token at a time.
Think of it like
Think of it like a storyteller. They say one word, then pick the next, and the next.
Example
Jack asks his chat assistant for a packing list. A model that is only a decoder writes it one token at a time. Each new token looks back at all the ones before.
Why it matters
Decoders are what generate text. Every chat reply you read was written by one.
Definition
Common mistake
Key takeaways
- 1Writes text. One token at a time.
- 2Only looks back. Never at future tokens.
- 3Chat models use it. Decoder-only stacks.