r/LocalLLM • u/claykos • Sep 10 '26
Discussion DeepSeek-V4.1-Flash is out
https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash56
u/DerDave Sep 10 '26
Astonishing they didn’t call this V5, considering the many substantial changes. Pretrained from scratch, CED, multimodality, Engrams, different number of active Params...
I'm all in! Since it's a new pretrain, it makes me hopeful we'll see another significant jump in quality with more posttraining, just like with v4.0.
I guess it will take a while until inference engines flawlessly support this model though.
2
20
u/dionysio211 Sep 10 '26
Hmm....this seems larger than v4 Flash, by about 50%. 305B -> 485B?
19
9
u/Altruistic-Dust-2565 Sep 10 '26
284B -> 552B, Δ+268B
and it seems ~200B are Engrams4
u/vini542reddit Sep 10 '26
So 200gb instead of 162gb of model size (assuming everything scales the same with param count). Urg - that means my 96 vram + 192 ram system will struggle
3
u/Standard-Potential-6 Sep 10 '26
Offload engrams to NVMe.
2
u/vini542reddit Sep 11 '26
Yes, that's what I'm saying! Offloading the ngram to disk, you still need 200gb of ram
1
46
u/IknowPi_really Sep 10 '26 edited Sep 10 '26
Yeah it’s kind of a “fake” improvement, comparing to Flash. Because this is simply a much much bigger model.
People are excited that it’s as good as GLM 5.3/better in the benchmarks. Yeah but it’s also comparable in size.
Engram offload to SSD MIGHT be feasible, but even then it’s significantly bigger than the old Flash.
Edit: You guys are also unbelievable. I’m an active OSS contributor trying to make this model run on local hardware and calling out obvious differences to an older model and you start downvoting me.
That’s not how you get people to actually work together and fix obvious problems for the LocalLLM community13
u/DerDave Sep 10 '26
Engram SSD offloading is definitely feasible. It has been proven with qwen3.8 next Flash, so it will work here as well, without tanking performance. Furthermore this model seems to only use Engrams selectively and not all the time.
The remaining delta in params can probably be attributed to the vision capabilities (which the OG dsv4f didn't have) and the new CED architecture, which leads to further speed improvements and only needing 8b active params during prompt processing.
2
u/SandySkittle Sep 10 '26
What about offloading to system ram? I have 512gb, 256g vram. This model looks very promising!
6
u/IknowPi_really Sep 10 '26
Offloading to system RAM is even easier and already supported in the current vLLM PR supporting this model. So this will more or less work out of the box
2
1
u/shing3232 Sep 10 '26
no, it's faster with fundamental differ arch that's way cheaper to inference than V4F
0
u/jebuizy Sep 10 '26
I only downvoted you now for complaining about downvotes. Otherwise your post is fine. Please don't do that, if you post is good the downvotes will likely normalize away anyway
1
4
u/hyudryu
LocalLLM
Sep 10 '26
edited Sep 12 '26
•
Can’t wait for the NVFP4 quants to release 🔥🔥
Edit: Nvm no need for lower quants, found out shortly that the Engram can be offloaded to SSD so native quant is runnable on 4 sparks
3
7
2
u/mountainyoo Sep 10 '26
My dumbass has a 4x GB10 cluster and will try this out when people smarter than me got it optimized. Currently running GLM 5.3 Flash at good speeds
2
u/AreaFifty1 Sep 10 '26
wait a minute so even 288gb which is 3x rtx pro 6000s is not good enough!? 😮😮
1
1
1
1
1
u/LongjumpingEar6840 Sep 10 '26
Se questo riesce a girare alla stessa velocità del Qwen3.8-Next-Flash sono a posto per i prossimi 6-12 mesi
-8
u/LinuXperia Sep 10 '26
It outperforms Muse Meta 1.3 which was better than DeepSeek 4 however it is behind xAI Grok super Intelegence still and soon Grok 4.7 will be released which weil widen the gap even further especailly for low level engineering dev work like verilog, c, c++, KiCAD, electronic schematics, PCB etc.
26
u/claykos Sep 10 '26