💬LLM Temperature
Also known as Temperature, Sampling Temperature
A setting for how random the model's word picks are. Low is steady, high is wild.
Think of it like
Think of it like a dial from calm to wild. Turn it down for safe words and up for surprise.
Example
Emma sets temperature to 0 to pull dates out of invoices, so she gets the same result each time. For slogan ideas she uses 0.9 and gets more variety.
Why it matters
It is the first knob to turn when answers are too dull or too wild for the job.
Definition
Common mistake
Key takeaways
- 1Low is steady. The top token wins.
- 2High is varied. Rare tokens get picked.
- 3Pick per job. Facts low, ideas higher.