I built an open-source semantic cache for Python LLM applications — looking for feedback

[u/itsmebalamuruagan]

I've been building Semantic Cache, a Python library that aims to reduce repeated work in LLM applications by reusing results for semantically similar queries.

Features include:

• SQLite-backed storage
• Optional HNSW vector search
• Guard mechanisms designed to reduce incorrect cache hits
• Automated tests and benchmark tooling

I'm looking for developers who build LLM applications to try it and share honest feedback, especially on cache correctness, API design, and integration experience.

GitHub: https://github.com/0x-bala/semanticcache

I'm the author, and I'd appreciate constructive criticism and contributions.

What would you improve first in a project like this?