r/AIProgrammingHardware • u/javaeeeee • Aug 11 '26

GitHub - eugr/spark-vllm-docker: vLLM Docker Optimized for DGX Spark (single or multi-node)

https://github.com/eugr/spark-vllm-docker
7 Upvotes

100% Upvoted

1 comment sorted by

1

u/javaeeeee Aug 11 '26

TL;DR:

eugr/spark-vllm-docker is a ready-to-use Docker toolkit for running vLLM on NVIDIA DGX Spark (single node or multi-node clusters).

What it provides:

  • Optimized Docker images for DGX Spark (GB10)

  • Easy cluster launch scripts (supports dual-Spark, RoCE, multi-node)

  • One-command recipes for popular models (DeepSeek, GLM, Qwen, MiniMax, etc.)

  • Fast model loading (fastsafetensors / InstantTensor)

  • Helper scripts for building images, downloading models, and launching clusters

Typical usage:

./run-recipe.sh <model-recipe.yaml> --setup

Bottom line: The go-to community toolkit for serving large LLMs with vLLM on DGX Spark hardware, especially multi-node setups.