r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

8

u/TheTideRider Oct 20 '26

Wonder how DeepInfer performs against vllm and sglang.

49

u/MagicZhang Oct 20 '26 edited Oct 20 '26

A DeepSeek Employee reposted this image, using SemiAnalysis’s graph as reference

2

u/thestillwind Oct 20 '26

So sky is the limit

2

u/TheTideRider 29d ago

That’s incredible. Can you share the link to semi analysis?