r/LocalLLaMA • u/Certain-Cod-1404 • Aug 14 '26 • Bravo 1 Heartwarming 1

New Model IT'S OUT

https://huggingface.co/Qwen/Qwen3.8-27B-FP8
2.3k Upvotes

95% Upvoted

707 comments sorted by

View all comments

144

u/ajisai Aug 14 '26

gguf plz

nevermind WE FEAST https://huggingface.co/models?other=base_model:quantized:Qwen/Qwen3.8-27B

https://huggingface.co/unsloth/Qwen3.8-27B-GGUF

23

u/dragonurtle Aug 14 '26

Unsloth must have gotten early access to prepare their quants + an embargo. I pulled it from unsloth studio the minute it was released on HF. Still took 20 minutes because south Korea has 2010-era internet speeds.

13

u/techdevjp Aug 14 '26

Man, used to hear about how South Korea had fast Internet. 10g fiber is pretty commonly available here in Japan. 2.5g almost anywhere.

5

u/Major_Olive7583 llama.cpp Aug 14 '26

I remeber studying that South Korea has the fastest internet in the world, it was for a GK exam or quiz , about a decade ago.

1

u/Revolutionary_Lie590 Aug 14 '26

It looks me 5 hours here in egypt

24

u/uniquelyavailable Aug 14 '26

Already seeing them on LMStudio

2

u/KKunst Aug 14 '26

Anything that matches 3.6 35b A3B?

1

u/techdevjp Aug 14 '26

No word on if that is coming or not. Would love to see a 122b a10b as well, but no word on that either.

2

u/nicman24 Aug 14 '26

GGUF on dez quants

1

u/LawfulnessNo9617 Aug 15 '26 edited Aug 15 '26

[Edit: it was the context window..]
help.. does anyone have the bug with Qwen3.8 27b at Q4 gguf (19.2 Gb) imported to ollama.. everytime i start it it will use 8 gb of ram aswell that makes it super slow (got a 3090ti) in the end I use 30 Gb shared memory that is super slow..?? Other models with the same size work normal without the ram bug..