Skip to content
BENIBIX Learn

CPU vs GPU

People often think a GPU is just a faster CPU. It is a different kind of chip. A CPU has a few strong cores that can do any job, one step after another. A GPU has thousands of small cores that all do the same sum at once. AI needs the second kind of work, so it runs far faster on a GPU.

Infrastructure🔧 Hardware

Central Processing Unit (CPU)

The main chip in a computer. It runs apps, one step at a time.

A central processing unit is the main chip in a computer that runs programs. It follows instructions one after another, very fast. A modern CPU has from a few cores to over a hundred, and each core can work on its own task. It is good at many different jobs. It is slow at doing millions of the same small sum at once, which is what AI needs.

Example
Emma opens a sheet of sums. The CPU loads the file, works out the totals and draws the screen in a blink.
Why it matters
Everything a computer does goes through the CPU. For AI, it runs the code around the model. Other chips do the hard math.
Full entry
Infrastructure🔧 Hardware

Graphics Processing Unit (GPU)

A chip with thousands of small cores. It does the heavy math for AI.

A graphics processing unit is a chip with thousands of small cores working at once. It was built to draw game graphics, where millions of pixels need the same kind of sum. AI training needs exactly that kind of work, so GPUs became the main chips for AI. A GPU has its own fast memory, called video memory. A big model is often trained on thousands of GPUs together.

Example
Jack trains an image model on his laptop CPU, and one epoch takes 6 hours. On a GPU, the same epoch takes 10 minutes.
Why it matters
GPUs made deep learning practical. How many of them exist sets how fast new AI can be built.
Full entry

In one line

Central Processing Unit (CPU)
The main chip in a computer. It runs apps, one step at a time.
Graphics Processing Unit (GPU)
A chip with thousands of small cores. It does the heavy math for AI.