🗄️Small Files Problem
Also known as Small File Problem, Too Many Small Files
A lake table with too many tiny files. Each read is slow.
Think of it like
It is like a book torn into single pages. Reading it means picking up a thousand sheets.
Example
A stream writes a new file every 10 seconds. After 30 days the table holds about 260,000 files, and a simple count takes minutes.
Why it matters
Slow reads cost money on every query. It is one of the most common reasons a lake gets slow.
Definition
Common mistake
Key takeaways
- 1Many tiny files. Each one costs time to open.
- 2Often from streams. Small writes, very often.
- 3Fixed by merging. Compaction makes fewer, larger files.