Understanding token usage
Understanding token usage
A request is billed on tokens, not on how much you typed. This explains what a token is and why a short prompt can still cost more than you expect.
What a token is
Models read and write text in tokens, not characters or words. A token is roughly a few characters of English — a short word is one token, a long or unusual word is several. Both what you send (input tokens) and what the model returns (output tokens) are counted.
Input and output are priced separately
Every model has two rates: one for input tokens and a higher one for output tokens. Output is the more expensive side, so a short question that produces a long answer is dominated by the output it generated.
| Direction | What it counts | Relative rate |
|---|---|---|
| Input | Everything sent to the model on this request. | Lower |
| Output | Everything the model generates in reply. | Higher |
The exact per-million-token rate for each model is shown on the pricing page and is the source of truth.
See current pricingKeeping usage down
- Start a fresh session for an unrelated task so old history is not resent.
- Ask for focused output when you don’t need a long explanation.
- Reuse stable context so it can be cached — see prompt caching.