Skip to content
BENIBIX Learn

Language Model

Also known as LM, Statistical Language Model

A model that guesses which word comes next. Repeat it and it writes.

Think of it like

Think of it like a friend who can end your sentence. They have heard lots of them.

Example

Lucy types 'See you' on her phone. The keyboard suggests 'soon', 'later' and 'tomorrow', the three words its language model rates highest.

Why it matters

Every chat assistant is built on a language model. Knowing it guesses the next word explains both its skill and its mistakes.

Definition

A language model is a model that guesses how likely a piece of text is. In practice, it looks at some words and gives a chance for each word that could come next. Pick a likely word, add it, and guess again, and the model writes text. Phone keyboards use small ones to suggest the next word. Large language models are the same idea, trained on far more text.
After 'I drink', the model gives every possible next word a chance. Tea gets the most.

Common mistake

Thinking it looks facts up. It picks likely words, so a wrong answer can sound just as sure as a right one.

Key takeaways

  1. 1
    Guesses the next word. With a chance for each.
  2. 2
    Writes by repeating. One word, then the next.
  3. 3
    Small or large. Same idea, more text.

Learn it properly