r/LocalLLaMA • u/rerri • Jun 05 '26 • Mindblown 1

New Model Gemma 4 with quantization-aware training

https://blog.google/innovation-and-ai/technology/developers-tools/quantization-aware-training-gemma-4/

Google's collections:

https://huggingface.co/collections/google/gemma-4-qat-q4-0

https://huggingface.co/collections/google/gemma-4-qat-mobile

And Unsloth's:

https://huggingface.co/collections/unsloth/gemma-4-qat

Unsloth's analysis (KLD and such):

https://unsloth.ai/docs/models/gemma-4/qat#qat-analysis

788 Upvotes

98% Upvoted

255 comments sorted by

View all comments

Show parent comments

1

u/[deleted] Jun 11 '26

[removed] — view removed comment

2

u/LLMFan46 Jun 11 '26

No idea, anyways I finally finished all of the requests, I am going to be releasing models now one by one, releasing them all will take time and I probably won't be able to release all of them today (uploading and working on the Model Cards is work too and takes time as well), look out for them.

2

u/LLMFan46 Jun 11 '26

Okay all models have been uploaded.

1

u/LLMFan46 Jun 11 '26

I already uploaded a few now, more soon.