📏AI Benchmark
Also known as LLM Benchmark, Model Benchmark
A public test that many AI models take. Their scores can then be compared.
Think of it like
It is like one big exam that every kid in the land takes. Then you can compare schools.
Example
When a new model comes out, its maker shows a table of benchmark scores. Jack uses it to pick three models to try, then tests them on his own eval set.
Why it matters
It gives everyone the same ruler. Without it, no one could check the claim that a model is better.
Definition
Common mistake
Key takeaways
- 1Public and fixed. The same for all.
- 2Compare models. On one ruler.
- 3Gets used up. Then replaced.