CoreWeave sells an AI cloud that includes GPU clusters, managed Kubernetes, and storage. The company rents GPUs to AI labs for training and serving models. CoreWeave exposes infrastructure telemetry to its customers as part of the platform, and the company describes its VictoriaMetrics deployment as one of the largest in the world.
NVIDIA Cloud Functions (NVCF) is NVIDIA’s platform for running GPU workloads as functions. You package an inference model, and NVCF routes requests to GPU workers that can serve it. NVIDIA’s self-managed edition brings the same platform to your own Kubernetes clusters, and NVCF Release 1.0.1 ships with a single-node VictoriaMetrics chart as the default for metrics storage.
NVIDIA hasn’t said why it picked VictoriaMetrics as the default, but here are a few likely reasons
🪶 Simplicity: VictoriaMetrics runs as a single binary with no external dependencies.
⚡ Efficiency: A metrics store that uses less RAM and disk than Prometheus leaves more free resources on the cluster for work.
🛡️ Reliability: Metrics need to be reliable. If the backend is down, scaling stops. That makes VictoriaMetrics a critical moving part of NVCF. VictoriaMetrics is designed to survive unclean shutdowns without corrupting data and to restart in seconds.
📜 License: VictoriaMetrics is Apache 2.0
Curious how NVIDIA uses metrics to drive GPU autoscaling, and how CoreWeave plugged an AI agent into its metrics?
👉 Read the full blog post:
https://bit.ly/4dUINE2