🔤BERT (Language Model)
Also known as BERT, Bidirectional Encoder Representations from Transformers, BERT Model
A language model from 2018 that reads text in both directions. It is built to understand, not to write.
Think of it like
It is like a reader who looks at both sides of a gap. Then she guesses the missing word.
Example
In 2019, Google said BERT would help Search understand one in 10 searches in the US in English.
Why it matters
It showed that one model trained on plain text could be tuned for many language tasks. Many search and labeling tools still run on models like it.
Definition
Common mistake
Key takeaways
- 1Both directions. It looks left and right of each word.
- 2Encoder only. Built to understand, not to write.
- 3Tune for a task. One base model, many uses.