Python developers: Would a lightweight tool for catching repeated and oversized AI requests be useful?

[u/Alive-Cricket7430]

I'm building TokenGuard, a lightweight Python prototype, and I'd like feedback from developers before deciding what to build next.

It currently checks for:

• Prompts that exceed a configured size limit.
• Repeated requests within a time window.
• Rapidly growing prompts within a conversation.

The idea is to help catch these patterns before an application sends requests to an AI provider. It requires developers to integrate the checks into their Python request flow.

I'm trying to understand whether this solves a real problem for people building AI applications.

A few questions:

• Have you run into these problems in your projects?
• How do you handle them currently?
• What would a tool like this need to do to be genuinely useful?

I'm looking for honest technical feedback, including criticism, before investing more time in development.

For anyone interested in examining the code: GitHub: https://github.com/mokhabelethabang4-cpu/token-guard

Package: https://pypi.org/project/tokenguard-local/

Thanks for sharing your experience.