💬Post-Training
Also known as Posttraining, LLM Post-Training
The last stage of training. It turns a model that has read a lot into a helper.
Think of it like
It is like manners class. You already know lots of words. Now you learn to be helpful and kind.
Example
At first, the lab's model can only carry on text. After post-training, it answers questions, keeps to rules, and says no to bad asks.
Why it matters
Most of what makes a chat model feel helpful, safe and good at reasoning is added here.
Definition
Common mistake
Key takeaways
- 1Copy good answers. Examples written to learn from.
- 2Learn preferences. Which answer people like more.
- 3Reward right work. On tasks a computer can check.