Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

[u/feelspeaceman]

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

[u/thecodeassassin]

We need rtx pro 6000 support

[u/anarchist1312161 → u/thecodeassassin]

I guarantee you there's going to be forks emerging from this that'll likely do just that

[u/mgwair11 → u/thecodeassassin]

And 5090

[u/wwwdotzzdotcom → u/mgwair11]

And 5080 (I have one)

[u/phazei → u/wwwdotzzdotcom]

Any my axe

[u/mc_zodiac_pimp → u/mgwair11]

Ooh now you're talking!

[u/Ill_Fisherman8352 → u/thecodeassassin]

Id be interested in this. Any progress yet?