💬LLM Non-Determinism
Also known as Non-Deterministic Output (LLM), LLM Nondeterminism
The same prompt can give a new answer each time you ask.
Think of it like
It is like asking a friend the same riddle twice. Most days you hear the same answer, but not always.
Example
Emma sends one prompt twice at temperature 0 and gets two answers. They match until the third sentence, then go different ways.
Why it matters
Tests that expect the exact same text will break. Checks need to judge the meaning, not the exact words.
Definition
Common mistake
Key takeaways
- 1Sampling adds chance. On purpose.
- 2Temperature 0 is no lock. Server math still varies.
- 3One word drifts. The rest can follow.