CPU vs GPU
People often think a GPU is just a faster CPU. It is a different kind of chip. A CPU has a few strong cores that can do any job, one step after another. A GPU has thousands of small cores that all do the same sum at once. AI needs the second kind of work, so it runs far faster on a GPU.
Central Processing Unit (CPU)
The main chip in a computer. It runs apps, one step at a time.
A central processing unit is the main chip in a computer that runs programs. It follows instructions one after another, very fast. A modern CPU has from a few cores to over a hundred, and each core can work on its own task. It is good at many different jobs. It is slow at doing millions of the same small sum at once, which is what AI needs.
Graphics Processing Unit (GPU)
A chip with thousands of small cores. It does the heavy math for AI.
A graphics processing unit is a chip with thousands of small cores working at once. It was built to draw game graphics, where millions of pixels need the same kind of sum. AI training needs exactly that kind of work, so GPUs became the main chips for AI. A GPU has its own fast memory, called video memory. A big model is often trained on thousands of GPUs together.
In one line
- Central Processing Unit (CPU)
- The main chip in a computer. It runs apps, one step at a time.
- Graphics Processing Unit (GPU)
- A chip with thousands of small cores. It does the heavy math for AI.