Skip to content
BENIBIX Learn

Big Data

Data🧭 FoundationsData Engineering

Data too big or too fast for one computer. Many machines share the work.

Think of it like

It is like a flood of letters. There are too many for one mail carrier, so a whole team has to help.

Example

A video site logs every click from millions of viewers. That is billions of rows a day, so the work is spread over hundreds of machines.

Why it matters

Once data outgrows one machine, the tools change. You need storage and processing spread over many machines.

Definition

Big data is data too large or too fast for one computer to handle. People often describe it with three Vs. Volume means there is a lot of it. Velocity means it arrives fast. Variety means it comes in many shapes. Handling it takes many machines working together.

Common mistake

Calling any large spreadsheet big data. If one laptop can handle it, it is not big data.

Key takeaways

  1. 1
    Volume. Too much to fit on one machine.
  2. 2
    Velocity. It arrives faster than one machine can keep up.
  3. 3
    Variety. Text, logs, pictures and tables all mixed.

Learn it properly