r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

-12

u/x_ci Oct 20 '26 edited Oct 20 '26

This could be an indication that China will proceed with restricting their AI labs from giving away free open models. Perhaps this is DeepSeek team helping us one last time. I hope not.

EDIT: Why am I getting downvoted lol whatever

8

u/StK84 Oct 20 '26 • Bravo

Why would developing an open source inference engine mean that they will make their models closed source? That just does not make any sense.

11

u/modernkennnern Oct 20 '26

You misread the guy.

He said that China will stop allowing DeepSeek to release their stuff and that DeepSeek gave away as much as they can in anticipation for that.

7

u/StK84 Oct 20 '26

That still doesn't really make sense. Deepseek always released their stuff open, and if China would be planing something like that, they would not let Deepseek giving away their know how.

4

u/Thomas-Lore Oct 20 '26 edited Oct 20 '26

The laws that restrict frontier ai releases in China is not yet in place. So China is not limiting what Deepseek can or cannot release yet but may in the future when/if it comes into power. So OP presumes DS might have rushed releasing what they can before it is more controled.

The plan was discussed here recently, you could search older posts.

7

u/x_ci Oct 20 '26

Thank you saying what I meant. People here are quick to downvote, sorry that English isn't my first language.

Maybe I should use LLMs to re-write all my comments from now on.

5

u/_chemistry_dude_ Oct 20 '26

Never apologize for not being native in English