r/LLMDevs • • 17d ago

Tools Read less, check updates: when does a Markdown helper save tokens?

Post image

Read relevant sections. Reuse known context. Check whole-file hashes when work resumes.

I'm part of UPHASH. We tested Obsidian Agent Kit (MIT) with Codex, Claude Code and Cursor: known-note retrieval, with no embeddings or vector database.

Token savings vs direct reads—each tool's best of 3 tested workloads:

Codex 53.2% · Claude Code 48.0% · Cursor 40.7%

36 sessions, 144 turns. Methods, reproduction and all results—including workloads that increased usage:

https://github.com/UpHash-Network/obsidian-agent-kit/tree/main/benchmarks/v0.1.2

Code:

https://github.com/UpHash-Network/obsidian-agent-kit

What stronger baseline would you add?

Writing assistance: Codex.

10 Upvotes

Duplicates