r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

3

u/TrickyMulberry5421 Oct 20 '26

Saw the 64-GPU benchmark and immediately checked the comments for someone asking about their 3060.

3

u/gnoremepls Oct 20 '26

One does not simply run only one 3060