What Is Prompt Caching and How Is It Billed?

A model with no listed cache price is billed at its normal input price. The Model Rates calculator assumes 80% of input is read from the cache from the second turn of a conversation, so its estimate is lower than a message-by-message guess with no caching. Actual savings depend on the provider and on how quickly a customer replies, because cached text expires after a few minutes.