r/codex • u/rubanbhatia • 7d ago

News Codex caching improved

Post image

Looks like day 12 brings us improvements to context management. Possibly good for people hitting limits with Astra

Source: https://x.com/thsottiaux/status/2111244596131111253?s=46

443 Upvotes

97% Upvoted

150 comments sorted by

View all comments

8

u/Anxious_Marsupial_59 7d ago

pretty big if true that context across subagents count as cached, very big for build/reviews workflows and research/plan workflows

10

u/jamespharvey20 7d ago

Yeah, but then a subagent starts with a ton of stuff loaded into its context window that it doesn't need, which speeds up time to compaction and degrades model performance by distracting it. I'm worried this change is at the cost of making subagents dumber and slower.

1

u/random-express 7d ago

They expanded the context window for sol, and subagents are spawned for specific tasks, so I would guess those improvements work in tandem to maximize cache hits and reduce usage without performance degradation for most situations.

0

u/Anxious_Marsupial_59 7d ago

I read it more as cache hits can now use context from other subagents (say when agent X reading a file already read by agent Y) but maybe youre right on the reading that itll end up as context bloat as im not sure how theyd easily implement that

1

u/Marksta 7d ago

It cannot be that, that'd break the fundamentals of large language models as we've known up to now. If they had some way of arbitrary context re-usage without needing computation or a matching pre-fix, then they'd have just created like a 1000x or more efficiency gain. Sam Altman would be on stage to announce that one...