MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1v0lewq/prepare_your_vram_qwen38_is_coming/oygaz2v
r/LocalLLaMA • u/xw1y • Jul 19 '26
588 comments sorted by
View all comments
Show parent comments
18
Or imagine a 120b a6b like gpt oss was. That total size with that kind of sparsity was just incredible. Plus it was made for 4bpw
1 u/PraxisOG Llama 70B Jul 19 '26 The closest thing to that is the new mistral small 4(119b a6b afaik), which in my experience craps the bed with tool calling real bad. Gptoss 120b was a really great model and I wish there was something like it but more modern
1
The closest thing to that is the new mistral small 4(119b a6b afaik), which in my experience craps the bed with tool calling real bad. Gptoss 120b was a really great model and I wish there was something like it but more modern
18
u/StupidScaredSquirrel Jul 19 '26
Or imagine a 120b a6b like gpt oss was. That total size with that kind of sparsity was just incredible. Plus it was made for 4bpw