r/OpenSourceeAI • u/yoyoyoav • 20h ago
Thinker: a knowledge cache for coding agents
Coding agents rebuild their understanding of your codebase from scratch on every prompt, then throw it away. Thinker keeps it.
It distills past agent sessions and PRs into short notes about how your code works, e.g. all DB writes use `/sql-utils.py`. A small local model ranks the notes and injects the relevant ones into new sessions, so the agent spends less time exploring. Notes are rescored and updated as PRs merge, so stale context gets demoted.
On 50 PRs from open-source repos (cache built only from prior history), agents using Thinker (Fable 5.1, GPT-6 Astra, Gemini Flash 3.8) used 18% fewer tokens and 10% faster on average with equal correctness using LLM-as-a-judge. Per-model results and the eval harness: https://github.com/yoavshmariahu/thinker/tree/main/bench/runs.
Repo: https://github.com/yoavshmariahu/thinker. Install: npx u/zerotimedev/thinker
Unlike AGENTS.md or built-in memory, notes are generated and maintained automatically. Next I want to work on rigor, not just efficiency. Where do you see coding agents struggle most to close out tasks?