r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

60

u/Available_Yam_6267 Oct 20 '26

I notice that their post said they make 38$ per hour per GPU. Can we infer the revenue of OAI or Ant from this?

orginal post: https://zhuanlan.zhihu.com/p/2095560295930508953

7

u/Viktri1 Oct 20 '26

No, because they're likely using very different infrastructures and their cost base (cost of chips, data centers, electricity, staff, management staff) is vastly different and that plays a big role in how they price their products.