Skip to content
BENIBIX Learn

Token Pricing

Development🧬 AI EngineeringLLM APIs

Also known as LLM Pricing, Price per Million Tokens, API Pricing (LLM)

What you pay to use a model. There is a set price for each million tokens.

Think of it like

Think of it like paying for sweets by weight. A bigger bag costs more, and some sweets cost more per bag.

Example

Lucy compares two models for tagging support tickets. The small one costs a tenth as much per token and tags just as well, so she picks it.

Why it matters

It turns a choice, like which model to use or how much chat to send, into a cost you can plan.

Definition

Token pricing is how model makers charge for API use. You pay a set price for each million tokens. Input and output have their own prices, and output most often costs four or five times more. Big, smart models cost far more per token than small, fast ones. Some also charge less for input that was cached or for batch jobs. To find the cost of a call, add the input tokens times the input price to the output tokens times the output price.
Input and output have separate prices. A small model costs far less than a large one.

Common mistake

Picking the biggest model for every task. Many simple jobs run just as well on a small model at a fraction of the price.

Key takeaways

  1. 1
    Per million tokens. The usual unit.
  2. 2
    Output costs more. Often several times.
  3. 3
    Model size matters. Small is cheap.