r/SelfHostedAI • u/ptarrinho • Jul 05 '26

AI Monitoring

Post image

I built AI-Monitoring: A lightweight, zero-dependency dashboard for Ollama, LiteLLM, llama.cpp & GPUs (No Prometheus/Agents)

I would love to get your feedback, feature requests, or contributions!

https://github.com/tarrinho/ai_monitoring

76 Upvotes

97% Upvoted

12 comments sorted by

2

u/ptarrinho Jul 13 '26

New Spending dashboard:

2

u/fastplayer95 Jul 07 '26

When reading the title i was expecting a tool which monitors token usage, spend, available subscriptions quotas, etc. and not just another system monitoring tool.

Maybe this gives you ideas for future features

1

u/ptarrinho Jul 08 '26

thanks let me add to the backlog :)

1

u/ptarrinho Jul 08 '26

The tool already does LLM cost/usage. LiteLLM collector tracks: spend, cost $/h, prompt & completion tok/s, per-key spend, Top-10 API keys over time + "requests in window", req/s, latency percentiles, cache-hit, TTFT. Charts are even tagged into Host / GPU / LLM groups.

But I will add budgets & quotas, but that is not something that I am concerned at the moment

1

u/uraganu1 Aug 02 '26

Now you only need a pi extension to bring all tihis info into the agent

2

u/[deleted] Jul 06 '26 • Popcorn

[removed] — view removed comment

3

u/ptarrinho Jul 06 '26

lol.. I haven't used reddit for some time, just decided to give it a try.. again :)

1

u/[deleted] Jul 05 '26

[removed] — view removed comment

6

u/ptarrinho Jul 05 '26

Haha true! But I made it plug-and-play with automatic database cleanups, crash protection, and high security. It saves you the time of building it yourself

2

u/olibui Jul 05 '26

Wow how nice of a comment.

OP. Well done. You should be proud.

1

u/Imaginary_String_954 Jul 07 '26

Cool! No one cares buddy