📈Softmax Function
Also known as Softmax, Softmax Activation, Normalized Exponential
Turns raw scores into chances that add up to 100%.
Think of it like
It is like cutting one pizza for three friends. The most hungry gets the big slice.
Example
A photo model scores cat 4, dog 2 and fox 1. Softmax turns those into about 84% cat, 11% dog and 4% fox.
Why it matters
It lets a network say how sure it is of each answer. Temperature works by changing the scores first.
Definition
Example code
python
import torch
torch.softmax(torch.tensor([4.0, 2.0, 1.0]), dim=0)
# tensor([0.8438, 0.1142, 0.0420])Common mistake
Key takeaways
- 1Scores in. One raw score per answer.
- 2Chances out. All positive, summing to 1.
- 3Big gaps grow. A lead in score becomes a bigger lead.