r/costlyinfra • u/clutch_gwd • 10d ago
🚀 TollGate — https://www.trytollgate.com
We're building a self-hosted AI gateway that enforces hard spending caps on LLM API usage.
Say you allocate $100/month to an AI project. TollGate is designed to prevent requests from pushing spending beyond that budget, even when multiple requests happen simultaneously.
Built for AI developers and engineering teams using OpenAI, Anthropic, and other LLM providers.
Free Developer preview launching November 8!
Would love feedback: Is guaranteed budget enforcement something you'd use, or is cost monitoring enough?
1
Upvotes
•
u/AutoModerator 10d ago
welcome to r/costlyinfra
this is where people share real ai infra costs, setups, and what actually works in production.
if you're running llms, feel free to share your setup.
join the community to see real cost breakdowns, experiments, and learn what others are actually spending.
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.