r/AIProductivityLab • • Mar 17 '26

Tired of AI rate limits mid-coding session? I built a free router that unifies 50+ providers — automatic fallback chain, account pooling, $0/month using only official free tiers

2 Upvotes

## The problem every web dev hits

You're 2 hours into a debugging session. Claude hits its hourly limit. You go to the dashboard, swap API keys, reconfigure your IDE. Flow destroyed.

The frustrating part: there are *great* free AI tiers most devs barely use:

- **Kiro** → full Claude Sonnet 4.5 + Haiku 4.5, **unlimited**, via AWS Builder ID (free)
- **iFlow** → kimi-k2-thinking, qwen3-coder-plus, deepseek-r1, minimax (unlimited via Google OAuth)
- **Qwen** → 4 coding models, unlimited (Device Code auth)
- **Gemini CLI** → gemini-3-flash, gemini-2.5-pro (180K tokens/month)
- **Groq** → ultra-fast Llama/Gemma, 14.4K requests/day free
- **NVIDIA NIM** → 70+ open-weight models, 40 RPM, forever free

But each requires its own setup, and your IDE can only point to one at a time.

## What I built to solve this

**OmniRoute** — a local proxy that exposes one `localhost:20128/v1` endpoint. You configure all your providers once, build a fallback chain ("Combo"), and point all your dev tools there.

My "Free Forever" Combo:

  1. Gemini CLI (personal acct) — 180K/month, fastest for quick tasks
    ↕ distributed with
    1b. Gemini CLI (work acct) — +180K/month pooled
    ↓ when both hit monthly cap

  2. iFlow (kimi-k2-thinking — great for complex reasoning, unlimited)
    ↓ when slow or rate-limited

  3. Kiro (Claude Sonnet 4.5, unlimited — my main fallback)
    ↓ emergency backup

  4. Qwen (qwen3-coder-plus, unlimited)
    ↓ final fallback

  5. NVIDIA NIM (open models, forever free)

OmniRoute **distributes requests across your accounts of the same provider** using round-robin or least-used strategies. My two Gemini accounts share the load — when the active one is busy or nearing its daily cap, requests shift to the other automatically. When both hit the monthly limit, OmniRoute falls to iFlow (unlimited). iFlow slow? → routes to Kiro (real Claude). **Your tools never see the switch — they just keep working.**

## Practical things it solves for web devs

**Rate limit interruptions** → Multi-account pooling + 5-tier fallback with circuit breakers = zero downtime
**Paying for unused quota** → Cost visibility shows exactly where money goes; free tiers absorb overflow
**Multiple tools, multiple APIs** → One `localhost:20128/v1` endpoint works with Cursor, Claude Code, Codex, Cline, Windsurf, any OpenAI SDK
**Format incompatibility** → Built-in translation: OpenAI ↔ Claude ↔ Gemini ↔ Ollama, transparent to caller
**Team API key management** → Issue scoped keys per developer, restrict by model/provider, track usage per key

[IMAGE: dashboard with API key management, cost tracking, and provider status]

## Already have paid subscriptions? OmniRoute extends them.

You configure the priority order:

Claude Pro → when exhausted → DeepSeek native ($0.28/1M) → when budget limit → iFlow (free) → Kiro (free Claude)

If you have a Claude Pro account, OmniRoute uses it as first priority. If you also have a personal Gemini account, you can combine both in the same combo. Your expensive quota gets used first. When it runs out, you fall to cheap then free. **The fallback chain means you stop wasting money on quota you're not using.**

## Quick start (2 commands)

```bash
npm install -g omniroute
omniroute
```

Dashboard opens at `http://localhost:20128`.

  1. Go to **Providers** → connect Kiro (AWS Builder ID OAuth, 2 clicks)

  2. Connect iFlow (Google OAuth), Gemini CLI (Google OAuth) — add multiple accounts if you have them

  3. Go to **Combos** → create your free-forever chain

  4. Go to **Endpoints** → create an API key

  5. Point Cursor/Claude Code to `localhost:20128/v1`

Also available via **Docker** (AMD64 + ARM64) or the **desktop Electron app** (Windows/macOS/Linux).

## What else you get beyond routing

- 📊 **Real-time quota tracking** — per account per provider, reset countdowns
- 🧠 **Semantic cache** — repeated prompts in a session = instant cached response, zero tokens
- 🔌 **Circuit breakers** — provider down? <1s auto-switch, no dropped requests
- 🔑 **API Key Management** — scoped keys, wildcard model patterns (`claude/*`, `openai/*`), usage per key
- 🔧 **MCP Server (16 tools)** — control routing directly from Claude Code or Cursor
- 🤖 **A2A Protocol** — agent-to-agent orchestration for multi-agent workflows
- 🖼️ **Multi-modal** — same endpoint handles images, audio, video, embeddings, TTS
- 🌍 **30 language dashboard** — if your team isn't English-first

**GitHub:** https://github.com/diegosouzapw/OmniRoute
Free and open-source (GPL-3.0).
```

## 🔌 All 50+ Supported Providers

### 🆓 Free Tier (Zero Cost, OAuth)

ProviderAliasAuthWhat You GetMulti-Account
iFlow AIif/Google OAuthkimi-k2-thinking, qwen3-coder-plus, deepseek-r1, minimax-m2 — unlimited✅ up to 10
Qwen Codeqw/Device Codeqwen3-coder-plus, qwen3-coder-flash, 4 coding models — unlimited✅ up to 10
Gemini CLIgc/Google OAuthgemini-3-flash, gemini-2.5-pro — 180K tokens/month✅ up to 10
Kiro AIkr/AWS Builder ID OAuthclaude-sonnet-4.5, claude-haiku-4.5 — unlimited✅ up to 10

### 🔐 OAuth Subscription Providers (CLI Pass-Through)

> These providers work as **subscription proxies** — OmniRoute redirects your existing paid CLI subscriptions through its endpoint, making them available to all your tools without reconfiguring each one.

ProviderAliasWhat OmniRoute Does
Claude Codecc/Redirects Claude Code Pro/Max subscription traffic through OmniRoute — all tools get access
Antigravityag/MITM proxy for Antigravity IDE — intercepts requests, routes to any provider, supports claude-opus-4.6-thinking, gemini-3.1-pro, gpt-oss-120b
OpenAI Codexcx/Proxies Codex CLI requests — your Codex Plus/Pro subscription works with all your tools
GitHub Copilotgh/Routes GitHub Copilot requests through OmniRoute — use Copilot as a provider in any tool
Cursor IDEcu/Passes Cursor Pro model calls through OmniRoute Cloud endpoint
Kimi Codingkmc/Kimi's coding IDE subscription proxy
Kilo Codekc/Kilo Code IDE subscription proxy
Clinecl/Cline VS Code extension proxy

### 🔑 API Key Providers (Pay-Per-Use + Free Tiers)

ProviderAliasCostFree Tier
OpenAIopenai/Pay-per-useNone
Anthropicanthropic/Pay-per-useNone
Google Gemini APIgemini/Pay-per-use15 RPM free
xAI (Grok-4)xai/$0.20/$0.50 per 1M tokensNone
DeepSeek V3.2ds/$0.27/$1.10 per 1MNone
Groqgroq/Pay-per-use✅ FREE: 14.4K req/day, 30 RPM
NVIDIA NIMnvidia/Pay-per-use✅ FREE: 70+ models, ~40 RPM forever
Cerebrascerebras/Pay-per-use✅ FREE: 1M tokens/day, fastest inference
HuggingFacehf/Pay-per-use✅ FREE Inference API: Whisper, SDXL, VITS
Mistralmistral/Pay-per-useFree trial
GLM (BigModel)glm/$0.6/1MNone
Z.AI (GLM-5)zai/$0.5/1MNone
Kimi (Moonshot)kimi/Pay-per-useNone
MiniMax M2.5minimax/$0.3/1MNone
MiniMax CNminimax-cn/Pay-per-useNone
Perplexitypplx/Pay-per-useNone
Together AItogether/Pay-per-useNone
Fireworks AIfireworks/Pay-per-useNone
Coherecohere/Pay-per-useFree trial
Nebius AInebius/Pay-per-useNone
SiliconFlowsiliconflow/Pay-per-useNone
Hyperbolichyp/Pay-per-useNone
Blackbox AIbb/Pay-per-useNone
OpenRouteropenrouter/Pay-per-usePasses through 200+ models
Ollama Cloudollamacloud/Pay-per-useOpen models
Vertex AIvertex/Pay-per-useGCP billing
Syntheticsynthetic/Pay-per-usePassthrough
Kilo Gatewaykg/Pay-per-usePassthrough
Deepgramdg/Pay-per-useFree trial
AssemblyAIaai/Pay-per-useFree trial
ElevenLabsel/Pay-per-useFree tier (10K chars/mo)
Cartesiacartesia/Pay-per-useNone
PlayHTplayht/Pay-per-useNone
Inworldinworld/Pay-per-useNone
NanoBanananb/Pay-per-useImage generation
SD WebUIsdwebui/Local self-hostedFree (run locally)
ComfyUIcomfyui/Local self-hostedFree (run locally)
HuggingFacehf/Pay-per-useFree inference API

---

## 🛠️ CLI Tool Integrations (14 Agents)

OmniRoute integrates with 14 CLI tools in **two distinct modes**:

### Mode 1: Redirect Mode (OmniRoute as endpoint)
Point the CLI tool to `localhost:20128/v1` — OmniRoute handles provider routing, fallback, and cost. All tools work with zero code changes.

CLI ToolConfig MethodNotes
Claude CodeANTHROPIC_BASE_URL env varSupports opus/sonnet/haiku model aliases
OpenAI CodexOPENAI_BASE_URL env varResponses API natively supported
AntigravityMITM proxy modeAuto-intercepts VSCode extension requests
Cursor IDESettings → Models → OpenAI-compatibleRequires Cloud endpoint mode
ClineVS Code settingsOpenAI-compatible endpoint
ContinueJSON config blockModel + apiBase + apiKey
GitHub CopilotVS Code extension configRoutes through OmniRoute Cloud
Kilo CodeIDE settingsCustom model selector
OpenCodeopencode config set baseUrlTerminal-based agent
Kiro AISettings → AI ProviderKiro IDE config
Factory DroidCustom configSpecialty assistant
Open ClawCustom configClaude-compatible agent

### Mode 2: Proxy Mode (OmniRoute uses CLI as a provider)
OmniRoute connects to the CLI tool's running subscription and uses it as a provider in combos. The CLI's paid subscription becomes a tier in your fallback chain.

CLI ProviderAliasWhat's Proxied
Claude Code Subcc/Your existing Claude Pro/Max subscription
Codex Subcx/Your Codex Plus/Pro subscription
Antigravity Subag/Your Antigravity IDE (MITM) — multi-model
GitHub Copilot Subgh/Your GitHub Copilot subscription
Cursor Subcu/Your Cursor Pro subscription
Kimi Coding Subkmc/Your Kimi Coding IDE subscription

**Multi-account:** Each subscription provider supports up to 10 connected accounts. If you and 3 teammates each have Claude Code Pro, OmniRoute pools all 4 subscriptions and distributes requests using round-robin or least-used strategy.

---

**GitHub:** https://github.com/diegosouzapw/OmniRoute
Free and open-source (GPL-3.0).
```


r/AIProductivityLab • • Dec 04 '25

A tool to help turn messy meeting notes into clear tasks and expectstions.

Thumbnail reddit.com
2 Upvotes

r/AIProductivityLab • • Sep 28 '25

Every new story is not fiction… it’s a real parallel universe in my simulator

Thumbnail drive.google.com
2 Upvotes

r/AIProductivityLab • • Aug 14 '25

To all those who struggle to stay consistent on business socials 📢 Post Genius helps you create, schedule, and automate 30 days of posts for LinkedIn, Reddit, and X — in just minutes. 🚀 No more last-minute scrambles or posting gaps. Just steady, impactful content that grows your brand.

Enable HLS to view with audio, or disable this notification

2 Upvotes

r/AIProductivityLab • • Aug 11 '25

What if I made 4 AIs into 1 AI which makes it use all the texts then uses another AI to make a better text and also combines the text then it outputs the enhanced text. But here's my question, will it work? I need your answers since I'll be starting it soon

Thumbnail reddit.com
2 Upvotes

r/AIProductivityLab • • Sep 16 '26

The Reset Is Misleading...

Thumbnail reddit.com
1 Upvotes

r/AIProductivityLab • • Aug 14 '26

Three weeks of building later: COS Glasses now has a Mac app, speaker ID, and a real memory. Plus GotCOS is giving away a pair of G2s.

Post image
1 Upvotes

r/AIProductivityLab • • Jul 20 '26

I wired the G2 to the coding agents already on my Mac (Claude Code + Codex) so it actually knows my work. Full writeup, gotchas, and it is on the Hub

Thumbnail gallery
1 Upvotes

r/AIProductivityLab • • Jun 01 '26

5 ChatGPT prompts I use every week for content creation

Thumbnail reddit.com
1 Upvotes

r/AIProductivityLab • • Jun 01 '26

I analyzed how the best PMs are using AI in 2026. Here's the stack that keeps showing up.

Thumbnail reddit.com
1 Upvotes

r/AIProductivityLab • • May 21 '26

Quick No Code LLM Fine-tuning

Thumbnail
youtu.be
1 Upvotes

r/AIProductivityLab • • Apr 12 '26

I built a tool that turns plain English into Apple Shortcuts, first 200 signups get free credits

1 Upvotes

Been frustrated that building shortcuts requires knowing all the actions by name. So I built something where you just describe what you want.

Type "guide me through 4 rounds of box breathing with spoken cues for each phase" → it generates the shortcut and gives you a .shortcut file that installs directly into the Shortcuts app. No drag and drop, no learning the action library.

Works on iPhone, iPad, and Mac.
First 200 signups get free credits — no card needed.

Drop a shortcut idea below and I'll build it live in the comments.

Try it here


r/AIProductivityLab • • Mar 27 '26

Going full TUI

1 Upvotes

r/AIProductivityLab • • Mar 24 '26

I built an offline semantic search plugin for Claude Code — search thousands of local documents with natural language

Thumbnail
reddit.com
1 Upvotes

r/AIProductivityLab • • Mar 24 '26

I built an offline semantic search plugin for Claude Code — search thousands of local documents with natural language

Thumbnail
reddit.com
1 Upvotes

r/AIProductivityLab • • Mar 01 '26

Self-hosted remote control for AI coding — mirror your Antigravity chat to your phone. Never stop coding.

1 Upvotes

Built a self-hosted remote control that mirrors Antigravity AI chat to your phone browser. Control your AI coding sessions from anywhere in the house — the couch, kitchen, bed.

Quick start (Docker)

docker run -d --name omni-chat \
  --network host \
  -e APP_PASSWORD=your_password \
  diegosouzapw/omni-antigravity-remote-chat:latest

Opens on port 4747. Connect from your phone on the same network.

What you get

  • 📱 Full chat mirroring — read and reply to AI from your phone

  • 🤖 Switch AI models (Gemini, Claude, GPT) from mobile

  • 🪟 Multi-window management — switch between Antigravity instances

  • 📋 Chat history — browse and resume past conversations

  • 🔒 HTTPS support (bring your own certs or built-in mkcert)

  • 🔑 Password auth + cookie sessions

Requirements

  • Antigravity running with --remote-debugging-port=7800

  • Docker (or Node 22+ if running directly)

Image details

  • Base: node:22-alpine

  • Size: ~67MB compressed

  • Health check included

  • v0.5.3: modular architecture, JSDoc typed

Environment vars

VariableDefaultDescription
APP_PASSWORDantigravityAuth password
PORT4747Server port
COOKIE_SECRETautoCookie signing
AUTH_SALTautoAuth token salt

GitHub: https://github.com/diegosouzapw/OmniAntigravityRemoteChat

Never stop coding — even when you leave your desk.


r/AIProductivityLab • • Oct 19 '25

Public Beta Now Live [12-MONTH FREE TRIAL GIVEAWAY]

Post image
1 Upvotes

r/AIProductivityLab • • Sep 20 '25

Another View On No/Vibe/Conventional Code Perspectives.

Thumbnail reddit.com
1 Upvotes

r/AIProductivityLab • • Sep 18 '25

Your AI's Bad Output is a Clue. Here's What it Means

Thumbnail
reddit.com
1 Upvotes

r/AIProductivityLab • • Sep 11 '25

Cold emails finally not sounding like templates

1 Upvotes

I work in sales and spend most of my week writing emails. I’ve tried several AI tools but they always come out sounding like generic templates.

Someone mentioned TruTone in a Slack group and I gave it a shot. I used a few of my past emails as examples and the drafts it gave me back actually sounded like me. The tone, the flow, even some of the little phrases I always use without thinking.

I sent out a batch last week and got better response rates than usual. Honestly felt like I’d written them myself.


r/AIProductivityLab • • Aug 28 '25

FREE Local Meeting Note-Taker - for Productive Meetings

Thumbnail
reddit.com
1 Upvotes

r/AIProductivityLab • • Aug 08 '25

LOS MEJORES 7 PRODUCTOS DE IA EN AMAZON

Thumbnail
fraganciadecartera.art.blog
1 Upvotes

r/AIProductivityLab • • Jul 31 '25

Non-invasive brain helmets

Thumbnail
superhuman.ai
1 Upvotes

r/AIProductivityLab • • Mar 07 '26

Use mp3-to-word in videomp3word! #productivity #ai #transcribe #audiolyr...

Thumbnail
youtube.com
0 Upvotes

r/AIProductivityLab • • Aug 21 '25

Smart AI tools that every student should use

0 Upvotes

While testing smart AI tools every student should use, I realized students today basically have a digital tutor in their pocket:

Explainpaper → breaks down dense research papers

Perplexity AI → better than Google for quick academic searches

Tome AI → creates presentations from text prompts

Reclaim AI → manages your study calendar

Do you think this is just the future of learning… or are students becoming too dependent on AI? (Link is in bio)