💬Encoder (Transformer)
Also known as Encoder, Encoder-Only Model
The part of a transformer that reads text and finds its meaning.
Think of it like
Think of it like a reader who reads the whole page. Then they tell you what it means.
Example
Emma's search tool uses a model that is only an encoder, a kind made popular by BERT in 2018. It turns each help page into a vector, so a question finds the right page.
Why it matters
Encoders do quiet work behind search and spam filters. They also sort lots of text.
Definition
Common mistake
Key takeaways
- 1Reads the whole text. Both directions.
- 2Gives vectors. The meaning as numbers.
- 3Does not write. Used for search and sorting.