💬Gating Network
Also known as MoE Router, Expert Router, Router Network
The part that picks which experts each token goes to.
Think of it like
It is like the person at a front desk. They send each visitor to the right two rooms.
Example
In Emma's model, the router sees the token 'loop' and sends it to the two experts that score highest. The other six skip it.
Why it matters
Definition
Common mistake
Key takeaways
- 1Score every expert. One number each, for every token.
- 2Keep the top few. Often one or two.
- 3Share the load. Training keeps all experts busy.