Skip to content
BENIBIX Learn

Provisioned Throughput

AI☁️ Cloud AI PlatformsCloud AI Basics

Also known as Reserved Capacity, Provisioned Throughput Units, PTU

You rent a fixed share of a model, for a fixed price.

Think of it like

It is like renting your own car for a month. It is always ready, even on days you stay home.

Example

Emma's help app gets thousands of chats each hour, all day. She buys provisioned throughput, so replies stay fast at the busiest times.

Why it matters

For a busy app, steady speed and a known bill can count for more than the lowest price.

Definition

Provisioned throughput means you reserve a fixed amount of model capacity from a cloud, for a fixed price. You pay by the hour or the month, whether you use it or not. In return, your requests do not share space with everyone else, so speed stays steady. Each cloud has its own name and unit for it. It suits apps with steady, heavy traffic. For light or spiky use, paying per token is usually cheaper.
Pay per token goes up and down. Provisioned throughput is flat.

Common mistake

Buying it before you know your traffic. If the capacity sits idle, you pay for nothing.

Key takeaways

  1. 1
    Reserved for you. Not shared.
  2. 2
    Fixed price. Used or not.
  3. 3
    Steady speed. For heavy traffic.

Compare