Skip to content
BENIBIX Learn

Base Model

AI💬 LLMsModel Types

Also known as Pretrained Model, Raw Model

A model fresh from its first training. It carries text on but does not follow orders.

Think of it like

Think of it like a parrot that has heard a lot. It goes on with what it hears, but it does not follow orders.

Example

Jack types 'Write a poem about rain' into a base model. It replies with more lines like 'Write a poem about snow', because that is how such lists usually go on.

Why it matters

Every chat assistant starts as a base model. That is why it needs more training to be of help.

Definition

A base model is a language model straight after its first big round of training. It has not yet been taught to follow orders. It is very good at carrying on text in the same style. Ask it a question and it may write more questions, as if it were filling in a list. Teams use base models as the starting point for chat models, and for research.
Given the same question, the base model on top just keeps the list going.

Common mistake

Testing a base model like a chat assistant and calling it broken. It was never trained to answer.

Key takeaways

  1. 1
    First round only. Trained to guess the next token.
  2. 2
    Carries text on. In the same style.
  3. 3
    A starting point. For instruct and chat models.

Compare

Learn it properly