💬Base Model
Also known as Pretrained Model, Raw Model
A model fresh from its first training. It carries text on but does not follow orders.
Think of it like
Think of it like a parrot that has heard a lot. It goes on with what it hears, but it does not follow orders.
Example
Jack types 'Write a poem about rain' into a base model. It replies with more lines like 'Write a poem about snow', because that is how such lists usually go on.
Why it matters
Every chat assistant starts as a base model. That is why it needs more training to be of help.
Definition
Common mistake
Key takeaways
- 1First round only. Trained to guess the next token.
- 2Carries text on. In the same style.
- 3A starting point. For instruct and chat models.