📈Batch Size
Also known as Mini-Batch Size, Batch (Machine Learning)
How many examples the model reads before each update. Often 32 or 64.
Think of it like
Think of it like marking tests in piles. You check one pile, fix your notes, then take the next pile.
Example
Lucy has 1,000 examples and a batch size of 100. Each epoch has 10 batches, so the weights get 10 updates per pass.
Why it matters
It changes how fast training runs and how much memory it needs. A batch too big for the chip will not run at all.
Definition
Common mistake
Key takeaways
- 1Examples per step. How many before one update.
- 2Splits the data. Into many small batches.
- 3A trade. Bigger needs more memory.