Skip to content
BENIBIX Learn

Graphics Processing Unit (GPU)

Infrastructure🔧 HardwareProcessors

Also known as GPU, Graphics Card

A chip with thousands of small cores. It does the heavy math for AI.

Think of it like

Think of it like a kitchen with a thousand cooks. Each one only peels, but they all peel at once.

Example

Jack trains an image model on his laptop CPU, and one epoch takes 6 hours. On a GPU, the same epoch takes 10 minutes.

Why it matters

GPUs made deep learning practical. How many of them exist sets how fast new AI can be built.

Definition

A graphics processing unit is a chip with thousands of small cores working at once. It was built to draw game graphics, where millions of pixels need the same kind of sum. AI training needs exactly that kind of work, so GPUs became the main chips for AI. A GPU has its own fast memory, called video memory. A big model is often trained on thousands of GPUs together.
The GPU is the chip packed with tiny cores. They all run the same sum on different data at once.

Common mistake

Looking only at GPU speed. The amount of video memory often decides which models it can run at all.

Key takeaways

  1. 1
    Thousands of cores. Small and simple.
  2. 2
    All at once. The same sum on lots of data.
  3. 3
    AI's main engine. Training and running models.

Compare

Learn it properly