RAM vs VRAM
People often think a computer's memory is one pool that every chip shares. With a graphics card, there are two. RAM belongs to the CPU, and video memory sits on the card for the GPU alone. A model that fits in 32 GB of RAM can still be too big for a GPU with 12 GB of video memory.
Random Access Memory (RAM)
Fast memory for the work being done right now. It empties when power goes off.
Random access memory is the fast, short-term memory a computer works from. Programs and their data are loaded into RAM from storage so the CPU can reach them quickly. It is much faster than a disk, but it is emptied when the power goes off. A laptop often has 8 to 32 gigabytes. To run an AI model on the CPU, the whole model usually has to fit in RAM.
Video Memory (VRAM)
The GPU's own fast memory. A model must fit in it to run on the GPU.
Video memory is the fast memory on a graphics card that only the GPU uses. It sits right next to the GPU chip. For the GPU, it is much faster than normal RAM. To run an AI model on a GPU, the model's weights usually have to fit in its video memory. Home graphics cards often have 8 to 32 gigabytes, and data centre GPUs have 80 or more.
In one line
- Random Access Memory (RAM)
- Fast memory for the work being done right now. It empties when power goes off.
- Video Memory (VRAM)
- The GPU's own fast memory. A model must fit in it to run on the GPU.