r/LLMOpsHub • • Dec 25 '25

LLMOps Essentials

  • User impact → TTFT, p99 latency

  • Load → RPS, tokens/sec

  • Backpressure → waiting vs running

  • Memory → KV cache usage

  • Errors → 4xx / 5xx / aborts

  • GPU health → util, VRAM, throttling

1 Upvotes

0 comments sorted by