💬Parameter-Efficient Fine-Tuning (PEFT)
Also known as PEFT, Efficient Fine-Tuning
A way to tune a model. Only a small add-on learns, and the rest stays the same.
Think of it like
It is like a sticky note on a book. You add the note, not a new book.
Example
Jack wants a model that writes in his shop's style. He trains a small add-on on one graphics card, and keeps a different add-on for his support replies.
Why it matters
It lets people tune large models on one graphics card, not a room full of them.
Definition
Common mistake
Key takeaways
- 1Freeze the model. Its own weights do not change.
- 2Train a small add-on. A tiny part learns the task.
- 3Swap add-ons. One base, many small files.