# NVIDIA CUDA

> NVIDIA's way to run any program on its GPUs. Most AI training uses it.

**Field:** Infrastructure  
**Category:** Hardware  
**Also known as:** CUDA, CUDA Toolkit, Compute Unified Device Architecture

## Think of it like

It is like one voice that tells a thousand cooks what to do.

## Definition

CUDA is NVIDIA's platform for running general programs on its GPUs. NVIDIA first released it in 2007. It lets code split one big job into thousands of small pieces, and each runs on its own GPU core. Most AI tools, such as PyTorch and TensorFlow, use CUDA under the hood. It only works on NVIDIA chips. Other chip makers have their own versions, but far less AI code is written for them.

## Example

Jack installs PyTorch on a computer with an NVIDIA card. One line checks that PyTorch can see CUDA, so his model will train on the GPU.

## Example code

```console
$ python -c "import torch; print(torch.cuda.is_available())"
True
```

PyTorch asks if CUDA and a GPU are ready. True means the work can run on the GPU.

## Why it matters

So much AI code is written for CUDA that NVIDIA's chips are hard to replace. This is a big reason NVIDIA leads in AI chips.

## Common mistake

Expecting CUDA code to run on any GPU. It needs an NVIDIA card, and a driver new enough for its CUDA version.

## Three principles

- **Programs on the GPU.** Not just graphics any more.
- **NVIDIA only.** Other makers' chips need other tools.
- **AI's base layer.** PyTorch and TensorFlow build on it.

## Related terms

- [Graphics Processing Unit (GPU)](https://learn.benibix.com/term/infrastructure/graphics-processing-unit)
- [Video Memory (VRAM)](https://learn.benibix.com/term/infrastructure/video-memory)
- [PyTorch](https://learn.benibix.com/term/ai/pytorch)
- [TensorFlow](https://learn.benibix.com/term/ai/tensorflow)
- [GPU Cloud](https://learn.benibix.com/term/ai/gpu-cloud)
- [Parallelism](https://learn.benibix.com/term/development/parallelism)

## Taught in

- [CPU vs GPU vs TPU](https://learn.benibix.com/learn/infrastructure-hardware/cpu-vs-gpu-vs-tpu): Computer Hardware, 4/8

![A stack of four layers. At the top, your code in Python. Under it, PyTorch. Under that, CUDA and the NVIDIA driver. At the bottom, an NVIDIA GPU drawn as a grid of many small cores. Arrows run down from each layer to the next.](https://learn.benibix.com/diagrams/hw-cuda-stack.svg)

---

Source: https://learn.benibix.com/term/infrastructure/cuda
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
