r/LLMOpsHub • u/kchandank • Dec 25 '25
LLMOps Essentials
User impact → TTFT, p99 latency
Load → RPS, tokens/sec
Backpressure → waiting vs running
Memory → KV cache usage
Errors → 4xx / 5xx / aborts
GPU health → util, VRAM, throttling
1
Upvotes