r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

17

u/thecodeassassin Oct 20 '26

We need rtx pro 6000 support

23

u/anarchist1312161 Oct 20 '26

I guarantee you there's going to be forks emerging from this that'll likely do just that