💬Parameter Count
Also known as Model Size, Number of Parameters
How many weights a model has, written like 8B for 8 billion.
Think of it like
Think of it like you count all the knobs on a huge music desk.
Example
Emma compares two models. The 8B one fits on her 24 GB graphics card, while the 70B one needs about 140 GB, so she would have to rent a server.
Why it matters
It tells you about how much memory and money a model needs. You learn this before you try to run it.
Definition
Common mistake
Key takeaways
- 1Counts the weights. Written like 8B.
- 2Sets the memory. About 2 bytes per weight.
- 3Not the whole story. Data and training count too.