Skip to content
BENIBIX Learn

Model Parameter vs Hyperparameter

People often think both are learned in training. Only one is. Parameters are the numbers inside the model, and training finds them. Hyperparameters are the settings you pick first, like the size of each step. You set those by hand. The rest you never touch.

AI📈 Machine Learning

Model Parameter

A number inside a model that training learns. Together they hold what it knows.

A model parameter is one of the numbers a model learns in training. Together, they hold all the model knows. Training starts them at random. Then it nudges them, step by step, until the answers are good. A small model may have a few, and a big one has billions. Nobody sets them by hand.

Example
Jack's line for house prices has two parameters: a starting price and a price per square metre. Training finds them from his data.
Why it matters
When people say a model is big, they mean it has many parameters. More can mean more skill, and always means more cost to run.
Full entry
AI📈 Machine Learning

Hyperparameter

A setting you pick before training. It shapes how the model learns.

A hyperparameter is a setting you choose before training starts. It shapes how the model learns, but the model does not learn it. Examples are how big each learning step is, how deep a tree may grow, or how many layers a network has. People try a few values and keep the one that works best. That search is called tuning.

Example
Lucy trains the same model three times, with steps of size 0.1, 0.01 and 0.001. The middle one gives the best results, so she keeps it.
Why it matters
The same data and method can give a good or a bad model, just from these settings. Tuning them is a normal part of the job.
Full entry

In one line

Model Parameter
A number inside a model that training learns. Together they hold what it knows.
Hyperparameter
A setting you pick before training. It shapes how the model learns.