🔤Corpus
Also known as Text Corpus, Corpora
A big set of text that a language model learns from.
Think of it like
Think of it like a huge pile of books. A computer reads them all to learn words.
Example
Jack wants a model that reads legal letters. He builds a corpus of 50,000 old letters from his firm and trains on it.
Why it matters
A model can only learn what its corpus holds. Gaps and slants in the text become gaps and slants in the model.
Definition
Common mistake
Key takeaways
- 1A lot of text. Gathered for one purpose.
- 2Shapes the model. It learns what is there.
- 3Quality counts. Not just size.