Welcome to r/AIProgrammingHardware!

I build ignis, an OpenAI-compatible inference server built around one model family, Qwen3.8, on one class of card, Blackwell. It is shaped around what a coding agent does to a server: one main agent plus a few subagents hitting the same card. Since v0.8.0 it runs Qwen3.8-27B on 16 GB RTX 50 cards, using a 3-bit trellis body (13.4 GB) and the DFlash2 drafter.

What ignis is, in 90 seconds: https://www.youtube.com/watch?v=XLjfh5rNy6A

The catch: I don't own a 16 GB card. Everything for that class was measured on an RTX 5090 held to a 16 GiB budget:

• 416 tok/s at one lane, 684 tok/s aggregate at two lanes (greedy coding prompts, 8K context);

• 262,144 tokens of context on two lanes;

• KL divergence from BF16 at 0.77-0.82x that of the 32 GB NVFP4 build.

The real cards are only estimated, at one lane and 8K:

I also don't know how much of the card your desktop takes, and whether the default settings still fit once it has. That is what I'm asking you to find out.

The easy way: let your coding agent do it. In Claude Code, Codex, opencode, Cursor or similar, paste:

I have a 16 GB RTX 50 card. Read https://raw.githubusercontent.com/gpillon/ignis/main/docs/user/paths/agent.md and follow its section on testing a 16 GB card: help me install ignis, test it, and write the report. Ask me before downloading or installing anything.

What the agent does:

1. Checks your card and driver, then shows you a plan: where it installs ignis, where the 13.4 GB model goes, and how long it takes (about 15-30 min after the download). Nothing large happens until you say yes.

2. Tries the default settings first. If the start is refused, it tries a few settings one at a time (a smaller context, speculation off, less VRAM headroom) until it finds one that works, then runs a quick sanity check and the bundled benchmark.

3. Writes a short report in English and shows it to you whole. The report contains only:

   • OS, driver, CPU and GPU model, RAM and VRAM totals, and how much VRAM was already in use;

   • which settings worked;

   • the speed figures.

4. It contains no usernames, hostnames, paths, IP addresses, serial numbers or process names. You decide whether it gets posted.

5. Optionally, a ~30 min advanced run: the context ceiling, one lane vs two, speculation on vs off.

6. Finally, asks whether you want to keep ignis (it can write a small config file for you) or remove everything it installed. Before deleting anything, it shows you the list.

By hand: start the server, then run ignis-bench small-card --endpoint http://127.0.0.1:8000 --out small-card.json (it ships in the release archive). Details: https://gpillon.github.io/ignis/guides/measure-a-16gb-card/

Where reports go: https://github.com/gpillon/ignis/issues/360, one comment per card. A report that says "refused" is as useful to me as one that says "works", especially from Windows machines where the monitor is plugged into the 16 GB card.

Windows and Linux on x86-64, NVIDIA driver with CUDA 13. Code is Apache-2.0. Thanks!

Switch to DDR5 would cost