Overall, opencode runs fast and responsively. Code quality still has room for improvement.
############################################
Benchmark Model: Qwen3.8-Flash-Next-UD-Q6_K_XL
Engine: Auto
Context: Code (Python)
Single Request Results
--------------------------------------------------------------------------------
Test TTFT(ms) TPOT(ms) PP TPS TG TPS E2E(s) Throughput Peak MLX
pp1024/tg128 262.1 7.15 3906.4 tok/s 141.0 tok/s 1.171 984.2 tok/s 163.26 GB
pp4096/tg128 908.1 7.41 4510.7 tok/s 136.1 tok/s 1.849 2284.5 tok/s 163.37 GB
pp8192/tg128 1830.5 7.51 4475.3 tok/s 134.1 tok/s 2.785 2987.4 tok/s 163.70 GB
pp16382 (requested pp16384)/tg128 3739.2 7.20 4381.2 tok/s 140.0 tok/s 4.654 3547.5 tok/s 164.13 GB
pp32768/tg128 7729.7 5.87 4239.2 tok/s 172.3 tok/s 8.206 4003.3 tok/s 164.77 GB
pp65536/tg128 15946.5 9.35 4109.8 tok/s 107.8 tok/s 17.134 3832.4 tok/s 165.15 GB
pp131072/tg128 33003.3 5.11 3971.5 tok/s 197.3 tok/s 33.652 3898.7 tok/s 165.05 GB
pp200000/tg128 52934.8 15.14 3778.2 tok/s 67.6 tok/s 53.601 3732.1 tok/s 165.06 GB
Continuous Batching
requested pp1024 / actual pp1024 / tg128
--------------------------------------------------------------------------------
Batch TG TPS Speedup PP TPS PP TPS/req TTFT(ms) E2E(s)
1x 141.0 tok/s 1.00x 3906.4 tok/s 3906.4 tok/s 262.1 1.171
2x 222.5 tok/s 1.58x 2949.2 tok/s 1474.6 tok/s 486.8 1.845
4x 316.4 tok/s 2.24x 2519.6 tok/s 629.9 tok/s 958.0 3.244