Skip to content
BENIBIX Learn

Fine-Tuning

AI💬 LLMsLanguage Model Training

Also known as Finetuning, Model Fine-Tuning

More training on a model that is done, so it gets good at one job.

Think of it like

Think of it like a cook who knows how to cook. Then they learn the dishes of one shop.

Example

Lucy's support team fine-tunes a model on 2,000 past replies. Now it answers in the firm's tone and knows its product names.

Why it matters

It is how one general model becomes many special ones. You do not pay for a whole new model.

Definition

Fine-tuning is more training on a model that is already trained, using a small set of examples for one job. The model keeps what it knew and gets better at that job or style. A few hundred to a few thousand good examples are often enough. It is much cheaper than training from scratch. It changes the model's weights, so the new skill is built in.
A general model and a few examples of one job go in. A model good at that job comes out.

Common mistake

Using it to add new facts. Fine-tuning is good at style and format. For facts that change, giving the model the right papers at question time works better.

Key takeaways

  1. 1
    Starts from a trained model. Not from scratch.
  2. 2
    Small, focused data. Hundreds to thousands of examples.
  3. 3
    Changes the weights. The skill is built in.

Compare

Learn it properly