Skip to content
BENIBIX Learn

Probability Distribution

General🔢 Math & StatisticsProbability

Also known as Distribution

Every outcome and its chance, side by side. All the chances add up to 1.

Think of it like

Think of it like you roll a dice lots of times. Then you count how often each number came up.

Example

Lucy's model has to pick the word after 'I drink'. It gives tea 0.5, coffee 0.3, water 0.15 and all other words 0.05. That list is a distribution.

Why it matters

AI models rarely give one answer. They give a distribution, and a choice is then made from it.

Definition

A probability distribution shows every possible outcome and how likely each one is. For a fair dice, each of the six faces has a probability of 1 in 6. People's heights are different. Most are near the middle, and few are very short or tall, so the chart is shaped like a bell. All the probabilities add up to 1. A language model's answer is a distribution over its next word.
This one is shaped like a bell. Values near the middle are common, and far ones are rare.

Common mistake

Treating the most likely outcome as the only one. A 0.5 chance still leaves the other half for everything else.

Key takeaways

  1. 1
    Every outcome. Listed with its chance.
  2. 2
    Adds up to 1. Nothing is left out.
  3. 3
    Has a shape. Flat, bell or lopsided.

Learn it properly