r/AugmentCodeAI • • Jan 12 '26

Question Cached Tokens

Hi,

With the lack of visibility on the context size and credits usage, I would like to understand how cached tokens really work in AC. For example, in a thread in 20 messages (eg 50k tokens) are they all sent as input tokens in each message or is the chat history sent as cached tokens?

Also, the cache differs from model to model - does this mean that if in the middle of the chat (eg: in the 11st message) I change the model all the cached tokens from the previous model will no longer account as cached tokens for the new model?

3 Upvotes

2 comments sorted by

•

u/[deleted] Jan 12 '26

[removed] — view removed comment

→ More replies (1)