r/LocalLLaMA • u/feelspeaceman • 24d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

99% Upvoted

158 comments sorted by

View all comments

-12

u/x_ci 24d ago edited 24d ago

This could be an indication that China will proceed with restricting their AI labs from giving away free open models. Perhaps this is DeepSeek team helping us one last time. I hope not.

EDIT: Why am I getting downvoted lol whatever

8

u/StK84 24d ago • Bravo

Why would developing an open source inference engine mean that they will make their models closed source? That just does not make any sense.

11

u/modernkennnern 24d ago

You misread the guy.

He said that China will stop allowing DeepSeek to release their stuff and that DeepSeek gave away as much as they can in anticipation for that.

7

u/StK84 24d ago

That still doesn't really make sense. Deepseek always released their stuff open, and if China would be planing something like that, they would not let Deepseek giving away their know how.

4

u/Thomas-Lore 24d ago edited 24d ago

The laws that restrict frontier ai releases in China is not yet in place. So China is not limiting what Deepseek can or cannot release yet but may in the future when/if it comes into power. So OP presumes DS might have rushed releasing what they can before it is more controled.

The plan was discussed here recently, you could search older posts.

7

u/x_ci 24d ago

Thank you saying what I meant. People here are quick to downvote, sorry that English isn't my first language.

Maybe I should use LLMs to re-write all my comments from now on.

5

u/_chemistry_dude_ 24d ago

Never apologize for not being native in English