💬Test-Time Compute
Also known as Inference-Time Compute, Test-Time Scaling, Inference Scaling
The work a model does while it answers. More of it can mean better answers.
Think of it like
It is like taking more time on a hard test question. The more you check, the more you get right.
Example
A team runs the same model twice on a hard maths set. With a larger thinking budget, it solves more of the problems, but each answer costs more.
Why it matters
It is a second way to get better answers. You pay more per question, not to train a bigger model.
Definition
Common mistake
Key takeaways
- 1At answer time. Not during training.
- 2Think or sample more. Longer steps, or many tries.
- 3Gains then a plateau. Cost keeps climbing.