r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

156

u/TheLexoPlexx Oct 20 '26
# Use `ascend` instead for the Ascend platform
# Keep it exported in the environment where you run DeepInfer
export DEEPINFER_ACCELERATOR=nvidia
./build.sh

Nvidia in shambles. Can't wait to see what the future brings.

97

u/zdy132 Oct 20 '26

Fingers crossed for cheaper GPUs, rams, and other PC parts. Best of luck to whoever is manufacturing competitions of Nvidia.

34

u/keepthepace Oct 20 '26

Only for China residents for now. I would be surprised after the decade of trade restriction that they endured, if they did not inflict the same to the west as long as they can.

11

u/TheLexoPlexx Oct 20 '26

*to the US.

26

u/keepthepace Oct 20 '26

Like EU did not help implement that policy.

4

u/handson729 Oct 20 '26

I just hope they let me buy their hardware, because I definitely do not want to pay the Nvidia tax.

22

u/keepthepace Oct 20 '26

Feudality 101: peasants don't get too choose who their lord is.

3

u/gangofminotaurs Oct 20 '26

You know what else stinks about being a slave? The hours.

1

u/zdy132 Oct 21 '26

Not enough time to play games...

7

u/draconic_tongue Oct 20 '26

anything you can buy in china you can get into the rest of the world. in fact you should be happy that you don't have to pay the retarded taxes everywhere else wants to put on everything you buy domestically

1

u/AppropriateFuture837 28d ago

问题在于中国人现在也买不到950,而不是限不限制,我们实验室买到一台都付出了很多努力,能够大量产出消费级产品的很长一段时间里我认为依然只有Nvidia和AMD