💬Reinforcement Learning from Human Feedback (RLHF)
Also known as RLHF, Human Feedback Training
A model learns which answers people like best. Then it gives more of those.
Think of it like
Think of it like a coach who says which of two tries was better. Over time, you learn what they like.
Example
Workers see two replies to 'How do I fix a flat tyre?' and pick the clearer one, 100,000 times over. The model then learns to write the clearer kind.
Why it matters
It is a big reason chat helpers are kind and useful, not odd or rude.
Definition
Common mistake
Key takeaways
- 1People compare answers. Pick the better of two.
- 2A reward model learns. To score any answer.
- 3The model chases reward. Writes what scores high.