Skip to content
BENIBIX Learn

Learn Large Language Models (LLMs)

What is inside the model behind a chat app, and why it writes the way it does. Fifteen lessons start with the numbers inside a model. Then come tokens, the context window, and how a model is trained and tuned. The last ones cover how to pick a model, why some think before they answer, and the three ways they go wrong. It assumes nothing. It stops at the model. Writing prompts and building apps on one are separate subjects.

Not started

0 of 15 lessons done

15 lessons5 sections~3 h74 termsSee the wordsBasic

Level 1 · What an LLM is

score0250/22 words

The numbers inside a model, and the tokens it reads. How it picks each one, and how much it can see at once.

  1. Large Language Model BasicsWhat a large language model is, and what its billions of numbers do. Why a bigger model needs far more memory to run.10 min4 terms
  2. Tokens and TokenizersWhat a token is, and how a tokenizer cuts text into numbered pieces. Why a model writes its reply one token at a time.10 min3 terms
  3. Temperature and SamplingHow a model picks each token from a list of chances. What temperature, top-k, top-p and beam search change about that pick.12 min8 terms
  4. The LLM Context WindowHow much text a model can see at once, and how a chat is sent as messages with roles. What happens when the space runs out.12 min7 terms

Level 2 · Inside the model

score25400/11 words

The design that almost every LLM uses. How each token finds the other words it needs.

  1. Transformer ArchitectureThe design inside almost every LLM. How it turns tokens into lists of numbers, keeps word order, and passes them up through its layers.13 min8 terms
  2. Self-Attention and Multi-HeadHow each token pulls meaning from the others. Why long texts cost so much, and what many heads and faster maths change.13 min3 terms

Level 3 · How a model is trained

score40650/23 words

Reading trillions of tokens, then learning to follow requests. Tuning a model for one job, and copying a big one into a small one.

  1. Pretraining an LLMHow a model learns from trillions of tokens of text. What scaling laws predict, and why the result does not follow requests yet.12 min5 terms
  2. Post-Training and RLHFHow a base model becomes a helper that does what you ask. Example answers, people's picks, a model that scores, and answers a program can check.14 min8 terms
  3. Fine-Tuning and LoRAHow to train a finished model for one job. Full fine-tuning against LoRA and QLoRA, and why tuning is a poor way to add facts.13 min5 terms
  4. Knowledge DistillationHow a big model teaches a small one, and what small models are good at. The risk of training a model on text that models wrote.12 min5 terms

Level 4 · Choosing and running a model

score65850/13 words

Open or closed, thinking or quick, and what makes a reply fast. The choices behind every app built on a model.

  1. Open-Weight vs Closed ModelsThe difference between a model you download and one you reach online. What a frontier model and a dated snapshot mean when you pick one.12 min5 terms
  2. Reasoning Models and ThinkingWhy some models write out their working before they answer, and what that costs. Which jobs it helps, and which it only slows down.11 min4 terms
  3. LLM Speed and StreamingThe two numbers that decide how fast a model feels. How streaming, the KV cache and speculative decoding each cut the wait.12 min4 terms

Level 5 · Where LLMs go wrong

score851000/5 words

Made-up facts, out-of-date facts, eager agreement, and losing track in a long input. How to spot each one, and what to do.

  1. LLM HallucinationsWhy a model states false facts in a calm, sure tone, and where it happens most. How old facts and eager agreement add to it.12 min3 terms
  2. Long Context ProblemsWhy a model misses facts in the middle of a long input, and why answers get worse as it grows. How to send less, in a better order.10 min2 terms

Words in this course

The 74 glossary entries this course teaches, in the order it teaches them. Open any of them on its own.

Back to the top

See what comes after this course