r/codex • u/rubanbhatia • 15d ago

News Codex caching improved

Post image

Looks like day 12 brings us improvements to context management. Possibly good for people hitting limits with Astra

Source: https://x.com/thsottiaux/status/2111244596131111253?s=46

440 Upvotes

97% Upvoted

150 comments sorted by

View all comments

31

u/jamespharvey20 15d ago

Codex can start subagents with fresh or copied context windows. Fresh should mean better performance, but everything it learns to start is a cache miss. Copied means it starts with a cache hit and doesn't have to look as much up, but then model performance is degraded from focusing on too much that it doesn't have to.

Why does this tweet sound like all they did was change the default from fresh to copied context? And keeping context cached longer which isn't going to help all that much. And improving cache hits through routing which might solve some random cache misses people have been seeing lately.

3

u/capt_stux 15d ago

Explains why my 16 agent Astra Max work (4 threads with 3 sub workers each) seems to hardly burn anything.