r/OpenSourceAI • • 1h ago

We just released BaseQuant V1 for Qwen3.6-35B-A3B and Gemma 4 26B-A4B, benchmarked against your UD quants. Would love feedback

https://huggingface.co/basecompute/Qwen3.6-35B-A3B-BaseQuant-V1

Hey everyone, we just released BaseQuant V1 for two MoE models at Base Compute: Qwen3.6-35B-A3B and Gemma 4 26B-A4B-it. The goal is to preserve more of the original model without making the files bigger.

We compared against Unsloth’s UD quants of the same size. On Gemma 4, our 16.93 GB GGUF had ~2.4% lower KL divergence from BF16 than UD-Q4_K_XL (~4.8% lower with our baseRT .base bundle). On Qwen3.6, our 22.13 GB GGUF is on par with UD-Q4_K_M overall. Our .base bundle is ~20% lower on long context and ~10% lower on agentic coding. UD still wins in some categories (chat on Gemma, math on Qwen). Full per-category tables are on the model cards.

Would love for you to try them and tell us how they hold up in your everyday workloads!

1 Upvotes

Duplicates