🔎Chunking (RAG)
Also known as Document Chunking, Text Splitting
Cutting a long file into small bits. Then search can find the right bit.
Think of it like
Think of it like cutting a cake into slices. Each person takes just the slice they want.
Example
Emma's 80-page manual becomes 400 chunks of about 300 tokens each. A question about returns now finds the two chunks on returns, not the whole manual.
Why it matters
Chunk size and borders decide what the search can find. Bad chunking breaks RAG before the model even runs.
Definition
Common mistake
Key takeaways
- 1Small pieces. Often a few hundred tokens.
- 2A little overlap. Ideas are not cut in half.
- 3Follow the structure. Headings and paragraphs.