💬Transformer
Also known as Transformer Model, Transformer Architecture
The design inside most big chat models. It is built on attention.
Think of it like
Think of it like a reader who sees all the words on a page at once. They do not read one by one.
Example
Emma's assistant reads her 10-page report. Its transformer lets each word look back at the title and the key words, all in one pass.
Why it matters
Without it, the big chat models of today could not have been trained.
Definition
Common mistake
Key takeaways
- 1Built on attention. Every token sees the rest.
- 2Trains in parallel. Fast on GPUs.
- 3Since 2017. Under nearly every LLM.