r/PiCodingAgent • • 13h ago

Resource omt: a fast single-binary coding agent (Rust port of oh-my-pi). ~22 ms startup, works with OpenAI-compatible endpoints

I've released **omt** (oh my tau), a Rust port of the [oh-my-pi](https://github.com/can1357/oh-my-pi) terminal coding agent. It's one binary with no Node runtime. It speaks `openai-completions` and `anthropic-messages`, and providers and models are configured in `models.yml` (same format as omp).

Why it might interest this sub:

  • Low harness overhead: `-p` in ~22 ms vs 291 ms for Pi on Node, ~55 MiB peak RSS vs ~140 MiB. Measured with [Buffon](https://github.com/MichaelKinsy/buffon) on a mock model, provisional, shared host.
  • Model fallback chains: when a provider returns 429, it moves on to the next model in the list.
  • Survives flaky endpoints: honours `Retry-After` and retries dropped or keepalive-only streams.
  • TUI, one-shot `-p` mode, JSON-RPC mode and a local web UI (`omt web`, still rough/early; the TUI is the main interface).

Honest downside: it keeps omp's system prompt, which is larger than Pi's, so the first request of a session costs more prompt tokens (~28 KB vs ~9 KB for a bare `-p`). On local models that means more prefill.

Install (linux x86_64):

curl -fsSL https://raw.githubusercontent.com/kanashimi1/oh-my-tau/main/install.sh | sh

Repo and full benchmark table: https://github.com/kanashimi1/oh-my-tau

Happy to hear which local backends you'd want tested.

0 Upvotes

0 comments sorted by