💬Greedy Decoding
Also known as Greedy Search (LLM), Argmax Decoding
Always picking the one most likely next word. Fast, but dull.
Think of it like
It is like you always grab the biggest slice of cake. You never look at the rest.
Example
Asked to finish 'The cat sat on the', a greedy model always says 'mat'. That word had the top chance.
Why it matters
It is the plain starting point that other ways of picking words are compared with.
Definition
Common mistake
Key takeaways
- 1Top token. At every single step.
- 2No looking back. Each choice is final.
- 3Nearly the same. Much like temperature 0.