# Parameter Count

> How many weights a model has, written like 8B for 8 billion.

**Field:** Artificial Intelligence  
**Category:** LLMs  
**Also known as:** Model Size, Number of Parameters

## Think of it like

Think of it like you count all the knobs on a huge music desk.

## Definition

Parameter count is the number of weights a model learned in training. It is the usual way to say how big a model is, like 8B for 8 billion. Bigger models tend to know more, but they need more memory and cost more to run. At 2 bytes per weight, an 8B model needs about 16 GB just to load. Size alone does not decide quality.

## Example

Emma compares two models. The 8B one fits on her 24 GB graphics card, while the 70B one needs about 140 GB, so she would have to rent a server.

## Why it matters

It tells you about how much memory and money a model needs. You learn this before you try to run it.

## Common mistake

Thinking a bigger model is always better. A newer small model trained well can beat an older one many times its size.

## Three principles

- **Counts the weights.** Written like 8B.
- **Sets the memory.** About 2 bytes per weight.
- **Not the whole story.** Data and training count too.

## Related terms

- [Model Parameter](https://learn.benibix.com/term/ai/model-parameter)
- [Weight (Neural Network)](https://learn.benibix.com/term/ai/weight)
- [Small Language Model (SLM)](https://learn.benibix.com/term/ai/small-language-model)
- [Video Memory (VRAM)](https://learn.benibix.com/term/infrastructure/video-memory)
- [Emergent Abilities](https://learn.benibix.com/term/ai/emergent-abilities)

## Taught in

- [Large Language Model Basics](https://learn.benibix.com/learn/ai-llms/large-language-model-basics): LLMs, 1/15
- [AI Model Names and Sizes](https://learn.benibix.com/learn/ai-models-providers/ai-model-names-and-sizes): AI Models and Providers, 6/13

![Four bars for models of 1, 8, 70 and 400 billion parameters. Under each, the memory the weights need at two bytes each: about 2, 16, 140 and 800 gigabytes.](https://learn.benibix.com/diagrams/llm-parameter-count.svg)

---

Source: https://learn.benibix.com/term/ai/parameter-count
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-18
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
