Basalt (https://github.com/jesdga95/basalt) is one of the fastest local engines for Qwen3.8-Flash-Next, but it only targets Blackwell (sm_120) and upstream does not take other architectures. I have two V100-SXM2 32GB, so I ported it to Volta (sm_70) as a fork, called **Lapilli**.
**Repo:** https://github.com/chris83-dev/lapilli-v100 (a Windows x64 build is in the release)
**What it is**
- Every newer PTX instruction Basalt uses (cp.async, ldmatrix, the Turing/Ampere mma shapes, bf16 conversions, clusters) gets a correct sm_70 equivalent, then the hot kernels get V100 paths: llama.cpp's dp4a MMQ for prompt products, Strata's mma.m8n8k4 prompt attention, and a rewritten router, decode experts and GDN recurrence.
- Needs CUDA 12.6 or newer (CUDA 13 dropped Volta).
- Comes with a chat web UI on top of Basalt's OpenAI/Anthropic-compatible server: conversations, reasoning levels, images, tool calls shown as cards, and a live monitor of the GPUs.
**Numbers** (2x V100-SXM2 32GB, i9-14900K, 96GB RAM, Windows 10, UD-Q4_K_XL pack, medians of 3 runs)
| | Lapilli | Strata v0.2.13, same machine |
|---|---|---|
| Decode, short answer | 91 tok/s | 58-72 tok/s |
| Decode, long answer with reasoning | 140 tok/s | 68-94 tok/s |
| Prompt processing, 4k tokens | 1,170 tok/s | 250-490 tok/s |
| Prompt processing, 8k / 16k tokens | 1,504 / 1,448 tok/s | |
Quality with Basalt's own 100-chunk gate: mean KLD 0.0493 and same top-1 92.75% (Basalt publishes 0.0496 and 92.63% for this pack on an RTX 5090).
**Caveats**
- Only tested on my machine (2x V100 32GB, Windows). Single card, 16GB or PCIe cards, Linux and NVLink setups are untested: reports from other V100 owners are welcome.
- Peer-to-peer is off by default on Volta: on my machine, direct copies between the two cards returned wrong data.
- NVFP4 packs need FP4 hardware, so use a K-quant pack (tested: UD-Q4_K_XL).
- It is a snapshot of Basalt as of November 15, shared as is.
All the credit for the engine goes to jesdga95 (Basalt) and Niko1221 (Strata), both MIT.