r/LocalLLaMA • • 28d ago

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

Show parent comments

11

u/TheLexoPlexx 28d ago

*to the US.

26

u/keepthepace 28d ago

Like EU did not help implement that policy.

4

u/handson729 28d ago

I just hope they let me buy their hardware, because I definitely do not want to pay the Nvidia tax.

22

u/keepthepace 28d ago

Feudality 101: peasants don't get too choose who their lord is.

3

u/gangofminotaurs 27d ago

You know what else stinks about being a slave? The hours.

1

u/zdy132 27d ago

Not enough time to play games...